feat: have the S3 Object Lambda reader ask the API by jackmisbach · Pull Request #2118 · METR/hawk

jackmisbach · 2026-10-11T20:55:36Z

Overview

Deploy 2 of 3: Object Lambda asks the API from #2115 to authorize each read, then continues delivering permitted files. Merge only after #2115 is live on prd, tst and stg; stg deploys by hand.

Approach

Concern	Before	After
Permission decision	Lambda's separate policy path	API shares the viewer's checker
Restricted reader identity	Any role session named after a user	Identity Center session in the deployment's account
Membership cache after Identity Center sync	15 min	1 min
Decision unavailable	Lambda error	Retryable 503
Permitted / denied read	Stream file / 404	Unchanged

The Lambda signs each request with its role. Its access_decision log line adds the session and issuer ARNs and authorize_ms (replacing decision_age_seconds), and undecidable reads log at ERROR so an outage reaches Sentry. It keeps its old grants for rollback until cleanup. Sharing policy logic gives future database checks the API's existing access/pool. Today's model policy remains S3 .models.json.

Risks

Reads now depend on API/STS availability and shared STS quota. More than 16 concurrent verifications per API worker get retryable 503s.
Non-Identity-Center sessions lose restricted reads; sampled production reads used Identity Center.
Revert this before feat: add the S3 reader authorization endpoint to the API #2115. The lock-file change also rolls API tasks.

Testing & validation

Combined dev test, 2026-10-11, heads 318f5f4 / 8e1c7fd:

Restricted-file read	Before median	After median	Observed increase
HEAD	118.078 ms	128.240 ms	+10.162 ms
GET 64 KiB	179.239 ms	193.218 ms	+13.979 ms
Range GET 4 KiB	151.286 ms	172.703 ms	+21.417 ms

Twenty observations per operation in consecutive serial batches; same laptop, SSO login and synthetic object; SDK retries disabled. All 120 old and 120 new serial reads passed. Added API and STS components measured 5.6 ms and 5.0 ms medians inside AWS (details); existing policy/identity lookups move into the API.

This small measured median cost buys shared permission logic and keeps future database connectivity in the API. Cold lookups/initialization can add hundreds of milliseconds or seconds; this is not a production latency guarantee.

Scan reads, 18 expected denials and 60 reads at up to four clients/five starts per second passed. An isolated connection failure returned 503 with zero bytes for HEAD/GET/range. Lambda, infra and type checks pass. Sustained load, recursive copies and #1871/#2099 were not benchmarked.

Verified the change works (commands / manual steps described above)
Added or updated tests where it makes sense

Code quality

pre-commit run --all-files passes (ruff, basedpyright/mypy, eslint/prettier/tsc, shellcheck — what CI's Lint job runs)

Before merging

PR title is a Conventional Commit with a lower-case subject — it becomes the squash-merge commit subject and drives the SemVer bump
All commits are signed and show as Verified on GitHub — see Commit signing

Second of three deploys. The reader Lambda now asks the API's /s3_reader/authorize (deployed in the first step) instead of reading .models.json and Identity Store itself, and answers 503, never a denial, when the API cannot decide. It no longer logs whole events, which carry the reader's presigned URL. Its old grants stay for this deploy so in-flight invocations of the previous version keep working; the next deploy removes them. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

…sion The API judges restricted reads by these ARNs, and the whole-event log line that used to hold them is gone, so a not_identity_center_session denial had nothing to explain it. Neither ARN is a secret. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

An unavailable decision used to be an unhandled exception, which Sentry caught. Now the reader answers 503 and logs it, so log it at ERROR with the cause attached: otherwise a broken network path or audience mismatch would fail every read through the access point without paging anyone. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

…ects - The handler tests sent only a principalId, so forwarding just that (as main does) passed them while denying every Identity Center read in prd. Send and expect the full identity instead. - Don't follow redirects from the API: requests would re-send the proof headers to the new location. - Name only the keys of an unknown event, never its presigned URL. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

greptile-apps · 2026-10-11T21:01:20Z

PSA: The priority scale is not very intuitive.
P1 = Should fix — bugs, incorrect behavior, edge cases
P2 = Consider fixing — code quality, maintainability, best practices

Confidence Score: 5/5

[Critical impact] This PR appears safe to merge after #2115 is deployed to all required environments.

Summary

Moves eval_log_reader authorization to the Hawk API while keeping permitted object reads on the caller’s credentials.

The reader asks Hawk’s API before serving each S3 read.
Reads return 503 when the API cannot decide.

Diagram

sequenceDiagram
    participant Reader
    participant S3 as S3 Object Lambda
    participant Lambda as eval_log_reader
    participant API as Hawk API
    participant STS
    Reader->>S3: GetObject or HeadObject
    S3->>Lambda: Object URL and reader identity
    Lambda->>API: Signed POST /s3_reader/authorize
    API->>STS: Verify reader role proof
    STS-->>API: Caller identity
    API->>API: Check folder groups and reader grants
    API-->>Lambda: Permit, deny, or unavailable
    alt Permitted
        Lambda->>S3: Read using caller's presigned URL
        Lambda-->>Reader: Object or metadata
    else Denied
        Lambda-->>Reader: 404
    else Unavailable
        Lambda-->>Reader: 503
    end

_{Reviews (1) · Last reviewed commit: "fix: pin the reader's forwarded identity..." · Reviewed by Greptile}

github-actions · 2026-10-11T21:16:35Z

🥥 `preview` on hawk/tst

14 meaningful change(s) · 🟢 1 create · 🔁 7 replace · 🟡 6 update — 17 rebuild-churn hidden

🟡 token-broker-lambda-function · update · aws:lambda/function:Function
🔁 db-migrate-task-def · replace · aws:ecs/taskDefinition:TaskDefinition
🔁 db-migrate-run · replace · command:local:Command
🔁 relay-task-def · replace · aws:ecs/taskDefinition:TaskDefinition
🔁 middleman-task-def · replace · aws:ecs/taskDefinition:TaskDefinition
🟡 sample-editor-job-def · update · aws:batch/jobDefinition:JobDefinition
🟡 eval-log-reader-lambda-function · update · aws:lambda/function:Function
🟢 api-tasks-identity-store-read-policy · create · aws:iam/rolePolicy:RolePolicy
🔁 live-ingest-task-def · replace · aws:ecs/taskDefinition:TaskDefinition
🟡 eval-log-importer-job-def · update · aws:batch/jobDefinition:JobDefinition
🟡 scan-importer-lambda-function · update · aws:lambda/function:Function
🟡 job-status-updated-lambda-function · update · aws:lambda/function:Function
🔁 api-platform-metrics-task-def · replace · aws:ecs/taskDefinition:TaskDefinition
🔁 api-task-def · replace · aws:ecs/taskDefinition:TaskDefinition

Show diffs (14 resource(s))

🟡 token-broker-lambda-function · update · aws:lambda/function:Function

-      imageUri    : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/inspect-ai/token_broker-lambda@sha256:1ae6d79ca95ff2b38a629255862f4edeb1c30ca319cf64b3104d3d20cf05ba3..."
+      imageUri    : [unknown]
-      lastModified: "2026-10-11T05:17:52.000+0000"

🔁 db-migrate-task-def · replace · aws:ecs/taskDefinition:TaskDefinition

       containerDefinitions: (json) [
-          [0]: {
-              command         : [
-                  [0]: "upgrade"
-                  [1]: "head"
                 ]
-              entryPoint      : [
-                  [0]: "alembic"
                 ]
-              environment     : [
-                  [0]: {
-                      name : "DATABASE_URL"
-                      value: "[REDACTED]"
                     }
                 ]
-              essential       : true
-              image           : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/hawk/api@sha256:a9ff21e9385527d17151edd2ec54996990e3cd2c4db991663bd348e3ca1f9a17"
-              logConfiguration: {
-                  logDriver: "awslogs"
-                  options  : {
-                      awslogs-group        : "tst/hawk/migrate"
-                      awslogs-region       : "us-west-2"
-                      awslogs-stream-prefix: "migrate"
                     }
                 }
-              mountPoints     : []
-              name            : "migrate"
-              portMappings    : []
-              systemControls  : []
-              volumesFrom     : []
             }
         ]
  => [unknown]

🔁 db-migrate-run · replace · command:local:Command

       environment: {
-          TASK_DEF_ARN: "[REDACTED]"
+          TASK_DEF_ARN: [unknown]
         }
       triggers   : [
-          [0]: "sha256:a9ff21e9385527d17151edd2ec54996990e3cd2c4db991663bd348e3ca1f9a17"
+          [0]: [unknown]
-          [2]: "[REDACTED]"
+          [2]: [unknown]
         ]

🔁 relay-task-def · replace · aws:ecs/taskDefinition:TaskDefinition

       containerDefinitions: (json) [
-          [0]: {
-              cpu             : 512
-              environment     : [
-                  [0]: {
-                      name : "HAWK_ENV"
-                      value: "tst"
                     }
-                  [1]: {
-                      name : "HAWK_OTEL_TRACING_ENABLED"
-                      value: "true"
                     }
-                  [2]: {
-                      name : "HAWK_RELAY_ALLOWED_ORIGINS"
-                      value: (json) [
-                          [0]: "[REDACTED]"
                         ]
                     }
-                  [3]: {
-                      name : "HAWK_RELAY_IDLE_TIMEOUT_SECONDS"
-                      value: "900"
                     }
-                  [4]: {
-                      name : "HAWK_RELAY_KUBECONFIG"
-                      value: (json) {
-                          clusters       : [
-                              [0]: {
-                                  cluster: {
-                                      certificate-authority-data: "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURNakNDQWhxZ0F3SUJBZ0lSQVBJMVppb3YxSWZObFMzRUk5VjIwVGd3RFFZSktvWklodmNOQVFFTEJRQXcKSnpFUU1BNEdBMVVFQ2hNSFFWZF..."
-                                      server                    : "[REDACTED]"
                                     }
-                                  name   : "eks"
                                 }
                             ]
-                          contexts       : [
-                              [0]: {
-                                  context: {
-                                      cluster  : "eks"
-                                      namespace: "inspect"
-                                      user     : "aws"
                                     }
-                                  name   : "eks"
                                 }
                             ]
-                          current-context: "eks"
-                          users          : [
-                              [0]: {
-                                  name: "aws"
-                                  user: {
-                                      exec: {
-                                          apiVersion: "client.authentication.k8s.io/v1beta1"
-                                          args      : [
-                                              [0]: "--region=us-west-2"
-                                              [1]: "eks"
-                                              [2]: "get-token"
-                                              [3]: "--cluster-name=tst"
-                                              [4]: "--output=json"
                                             ]
-                                          command   : "aws"
                                         }
                                     }
                                 }
                             ]
                         }
                     }
-                  [5]: {
-                      name : "HAWK_RELAY_MAX_CONCURRENT_SESSIONS"
-                      value: "40"
                     }
-                  [6]: {
-                      name : "HAWK_RELAY_MAX_SESSIONS_PER_PRINCIPAL"
-                      value: "5"
                     }
-                  [7]: {
-                      name : "HAWK_RELAY_MAX_SESSION_SECONDS"
-                      value: "14400"
                     }
-                  [8]: {
-                      name : "HAWK_RELAY_RUNNER_NAMESPACE"
-                      value: "inspect"
                     }
-                  [9]: {
-                      name : "HAWK_RELAY_TOKEN_AUDIENCE"
-                      value: "[REDACTED]"
                     }
-                  [10]: {
-                      name : "HAWK_RELAY_TOKEN_DEFAULT_PERMISSIONS"
-                      value: ""
                     }
-                  [11]: {
-                      name : "HAWK_RELAY_TOKEN_EMAIL_FIELD"
-                      value: "sub"
                     }
-                  [12]: {
-                      name : "HAWK_RELAY_TOKEN_ISSUER"
-                      value: "[REDACTED]"
                     }
-                  [13]: {
-                      name : "HAWK_RELAY_TOKEN_JWKS_URI"
-                      value: "[REDACTED]"
                     }
-                  [14]: {
-                      name : "HAWK_RELAY_VALKEY_URL"
-                      value: "[REDACTED]"
                     }
-                  [15]: {
-                      name : "HAWK_SERVICE"
-                      value: "relay"
                     }
-                  [16]: {
-                      name : "HAWK_SERVICE_VERSION"
-                      value: "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst-hawk-relay@sha256:adcddd2803228e9b20e8d833299f170ec1681ffdf02c6f6d4a6998239a937628"
                     }
-                  [17]: {
-                      name : "SENTRY_DSN"
-                      value: ""
                     }
-                  [18]: {
-                      name : "SENTRY_ENVIRONMENT"
-                      value: "tst"
                     }
                 ]
-              essential       : true
-              healthCheck     : {
-                  command    : [
-                      [0]: "CMD"
-                      [1]: "python3"
-                      [2]: "-c"
-                      [3]: "import urllib.request; urllib.request.urlopen('[REDACTED]', timeout=5)"
                     ]
-                  interval   : 30
-                  retries    : 5
-                  startPeriod: 60
-                  timeout    : 10
                 }
-              image           : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst-hawk-relay@sha256:adcddd2803228e9b20e8d833299f170ec1681ffdf02c6f6d4a6998239a937628"
-              logConfiguration: {
-                  logDriver: "awslogs"
-                  options  : {
-                      awslogs-group        : "tst/hawk/relay"
-                      awslogs-region       : "us-west-2"
-                      awslogs-stream-prefix: "relay"
-                      mode                 : "non-blocking"
                     }
                 }
-              mountPoints     : []
-              name            : "relay"
-              portMappings    : [
-                  [0]: {
-                      containerPort: 8080
-                      hostPort     : 8080
-                      name         : "relay"
-                      protocol     : "tcp"
                     }
                 ]
-              systemControls  : []
-              volumesFrom     : []
             }
         ]
  => [unknown]

🔁 middleman-task-def · replace · aws:ecs/taskDefinition:TaskDefinition

       containerDefinitions: (json) [
-          [0]: {
-              cpu             : 128
-              environment     : [
-                  [0]: {
-                      name : "DD_APM_ENABLED"
-                      value: "true"
                     }
-                  [1]: {
-                      name : "DD_APM_NON_LOCAL_TRAFFIC"
-                      value: "true"
                     }
-                  [2]: {
-                      name : "DD_APM_RECEIVER_SOCKET"
-                      value: "/var/run/datadog/apm.socket"
                     }
-                  [3]: {
-                      name : "DD_DOGSTATSD_NON_LOCAL_TRAFFIC"
-                      value: "true"
                     }
-                  [4]: {
-                      name : "DD_ECS_FARGATE"
-                      value: "true"
                     }
-                  [5]: {
-                      name : "DD_ENV"
-                      value: "tst"
                     }
-                  [6]: {
-                      name : "DD_PROCESS_AGENT_ENABLED"
-                      value: "false"
                     }
-                  [7]: {
-                      name : "DD_SITE"
-                      value: "us3.datadoghq.com"
                     }
-                  [8]: {
-                      name : "DD_TAGS"
-                      value: "env:tst service:middleman"
                     }
-                  [9]: {
-                      name : "ECS_FARGATE"
-                      value: "true"
                     }
                 ]
-              essential       : false
-              healthCheck     : {
-                  command    : [
-                      [0]: "CMD"
-                      [1]: "agent"
-                      [2]: "health"
                     ]
-                  interval   : 30
-                  retries    : 3
-                  startPeriod: 15
-                  timeout    : 5
                 }
-              image           : "public.ecr.aws/datadog/agent:7"
-              logConfiguration: {
-                  logDriver: "awslogs"
-                  options  : {
-                      awslogs-group        : "tst/middleman"
-                      awslogs-region       : "us-west-2"
-                      awslogs-stream-prefix: "datadog-agent"
                     }
                 }
-              memory          : 256
-              mountPoints     : [
-                  [0]: {
-                      containerPath: "/var/run/datadog"
-                      readOnly     : false
-                      sourceVolume : "dd-sockets"
                     }
                 ]
-              name            : "datadog-agent"
-              portMappings    : [
-                  [0]: {
-                      containerPort: 8126
-                      hostPort     : 8126
-                      protocol     : "tcp"
                     }
-                  [1]: {
-                      containerPort: 8125
-                      hostPort     : 8125
-                      protocol     : "udp"
                     }
                 ]
-              secrets         : [
-                  [0]: {
-                      name     : "DD_API_KEY"
-                      valueFrom: "[REDACTED]"
                     }
                 ]
-              systemControls  : []
-              volumesFrom     : []
             }
-          [1]: {
-              cpu              : 1920
-              dependsOn        : [
-                  [0]: {
-                      condition    : "START"
-                      containerName: "datadog-agent"
                     }
                 ]
-              environment      : [
-                  [0]: {
-                      name : "DD_AGENT_HOST"
-                      value: "localhost"
                     }
-                  [1]: {
-                      name : "DD_DOGSTATSD_PORT"
-                      value: "8125"
                     }
-                  [2]: {
-                      name : "DD_DOGSTATSD_TAGS"
-                      value: "service:middleman,env:tst"
                     }
-                  [3]: {
-                      name : "DD_ENV"
-                      value: "tst"
                     }
-                  [4]: {
-                      name : "DD_LOGS_INJECTION"
-                      value: "true"
                     }
-                  [5]: {
-                      name : "DD_SERVICE"
-                      value: "middleman"
                     }
-                  [6]: {
-                      name : "DD_SITE"
-                      value: "us3.datadoghq.com"
                     }
-                  [7]: {
-                      name : "DD_TRACE_AGENT_URL"
-                      value: "[REDACTED]"
                     }
-                  [8]: {
-                      name : "DD_TRACE_CLIENT_IP_ENABLED"
-                      value: "true"
                     }
-                  [9]: {
-                      name : "DD_TRACE_CLIENT_IP_HEADER"
-                      value: "X-Forwarded-For"
                     }
-                  [10]: {
-                      name : "DD_TRACE_REQUEST_BODY_ENABLED"
-                      value: "false"
                     }
-                  [11]: {
-                      name : "DD_TRACE_RESPONSE_BODY_ENABLED"
-                      value: "false"
                     }
-                  [12]: {
-                      name : "DD_TRACE_SAMPLE_RATE"
-                      value: "1.0"
                     }
-                  [13]: {
-                      name : "DD_TRACE_SAMPLING_RULES"
-                      value: (json) [
-                          [0]: {
-                              resource   : "GET /health"
-                              sample_rate: 0
                             }
-                          [1]: {
-                              resource   : "GET /health/deep"
-                              sample_rate: 0
                             }
                         ]
                     }
-                  [14]: {
-                      name : "GOOGLE_CLOUD_PROJECT_FOR_PUBLIC_MODELS"
-                      value: "metr-pub"
                     }
-                  [15]: {
-                      name : "HAWK_OTEL_TRACING_ENABLED"
-                      value: "true"
                     }
-                  [16]: {
-                      name : "HAWK_SERVICE_VERSION"
-                      value: "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst-middleman@sha256:7c2701266da486b66fe4c62fee7c30ca14406820b800c75e4e5d1ced51fc5eb9"
                     }
-                  [17]: {
-                      name : "MIDDLEMAN_ACCEPT_DEV_ADMIN"
-                      value: "true"
                     }
-                  [18]: {
-                      name : "MIDDLEMAN_ANTHROPIC_DEFAULT_PROFILE"
-                      value: "platform-tst"
                     }
-                  [19]: {
-                      name : "MIDDLEMAN_ANTHROPIC_PROFILES"
-                      value: (json) {
-                          platform-tst: {
-                              assertion_source  : "aws_sts"
-                              auth_type         : "wif"
-                              federation_rule_id: "[REDACTED]"
-                              organization_id   : "[REDACTED]"
-                              service_account_id: "[REDACTED]"
-                              workspace_id      : "[REDACTED]"
                             }
                         }
                     }
-                  [20]: {
-                      name : "MIDDLEMAN_API_KEYS_SECRET_ARN"
-                      value: "[REDACTED]"
                     }
-                  [21]: {
-                      name : "MIDDLEMAN_AUTH_PROVIDERS"
-                      value: (json) [
-                          [0]: {
-                              admin_groups      : []
-                              audiences         : [
-                                  [0]: "[REDACTED]"
                                 ]
-                              default_groups    : []
-                              email_field       : "sub"
-                              issuer            : "[REDACTED]"
-                              jwks_uri          : "[REDACTED]"
-                              teams_claim       : "teams"
-                              teams_group_prefix: "team-"
                             }
                         ]
                     }
-                  [22]: {
-                      name : "MIDDLEMAN_CONFIG_FILE"
-                      value: "middleman.yaml"
                     }
-                  [23]: {
-                      name : "MIDDLEMAN_DATABASE_URL"
-                      value: "[REDACTED]"
                     }
-                  [24]: {
-                      name : "MIDDLEMAN_ENV"
-                      value: "tst"
                     }
-                  [25]: {
-                      name : "MIDDLEMAN_METRICS_LOG_GROUP"
-                      value: "tst/middleman/metrics"
                     }
-                  [26]: {
-                      name : "MIDDLEMAN_OPENAI_DEFAULT_PROFILE"
-                      value: "platform-tst"
                     }
-                  [27]: {
-                      name : "MIDDLEMAN_OPENAI_PROFILES"
-                      value: (json) {
-                          platform-tst: {
-                              assertion_source    : "aws_sts"
-                              auth_type           : "wif"
-                              identity_provider_id: "idp_8ea4e83a3097ff7282b3537e"
-                              service_account_id  : "user-5eb374f4dd8cd6cab8a0d14e"
                             }
                         }
                     }
-                  [28]: {
-                      name : "MIDDLEMAN_TRAFFIC_LOG_CW_GROUP"
-                      value: "tst/middleman/traffic"
                     }
-                  [29]: {
-                      name : "MIDDLEMAN_TRAFFIC_LOG_LEVEL"
-                      value: "summary"
                     }
-                  [30]: {
-                      name : "MIDDLEMAN_TRAFFIC_LOG_S3_BUCKET"
-                      value: "tst-metr-middleman-traffic"
                     }
-                  [31]: {
-                      name : "MIDDLEMAN_VALKEY_URL"
-                      value: "[REDACTED]"
                     }
-                  [32]: {
-                      name : "SENTRY_DSN"
-                      value: ""
                     }
-                  [33]: {
-                      name : "SENTRY_ENVIRONMENT"
-                      value: "tst"
                     }
-                  [34]: {
-                      name : "SENTRY_TRACES_SAMPLE_RATE"
-                      value: "0"
                     }
-                  [35]: {
-                      name : "WEB_CONCURRENCY"
-                      value: "4"
                     }
                 ]
-              essential        : true
-              healthCheck      : {
-                  command    : [
-                      [0]: "CMD"
-                      [1]: "python"
-                      [2]: "-c"
-                      [3]: "import urllib.request; urllib.request.urlopen('[REDACTED]', timeout=5)"
                     ]
-                  interval   : 30
-                  retries    : 5
-                  startPeriod: 120
-                  timeout    : 10
                 }
-              image            : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst-middleman@sha256:7c2701266da486b66fe4c62fee7c30ca14406820b800c75e4e5d1ced51fc5eb9"
-              logConfiguration : {
-                  logDriver: "awslogs"
-                  options  : {
-                      awslogs-group        : "tst/middleman"
-                      awslogs-region       : "us-west-2"
-                      awslogs-stream-prefix: "middleman"
-                      max-buffer-size      : "25m"
-                      mode                 : "non-blocking"
                     }
                 }
-              memory           : 3840
-              memoryReservation: 100
-              mountPoints      : [
-                  [0]: {
-                      containerPath: "/var/run/datadog"
-                      readOnly     : false
-                      sourceVolume : "dd-sockets"
                     }
                 ]
-              name             : "middleman"
-              portMappings     : [
-                  [0]: {
-                      containerPort: 3500
-                      hostPort     : 3500
-                      name         : "middleman"
-                      protocol     : "tcp"
                     }
                 ]
-              systemControls   : []
-              volumesFrom      : []
             }
         ]
  => [unknown]

🟡 sample-editor-job-def · update · aws:batch/jobDefinition:JobDefinition

-      arn                : "[REDACTED]"
       containerProperties: (json) {
-          command                     : []
-          environment                 : [
-              [0]: {
-                  name : "SENTRY_ENVIRONMENT"
-                  value: "tst"
                 }
             ]
-          executionRoleArn            : "[REDACTED]"
-          fargatePlatformConfiguration: {
-              platformVersion: "1.4.0"
             }
-          image                       : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/hawk/sample-editor-lambda@sha256:e184592cffbd40a56e16f2565eadffebbf342e84f54174ccb17e64f09edbc8f4"
-          jobRoleArn                  : "[REDACTED]"
-          logConfiguration            : {
-              logDriver    : "awslogs"
-              options      : {
-                  awslogs-group  : "/aws/batch/tst-hawk-sample-editor"
-                  max-buffer-size: "25m"
-                  mode           : "non-blocking"
                 }
-              secretOptions: []
             }
-          mountPoints                 : []
-          networkConfiguration        : {
-              assignPublicIp: "DISABLED"
             }
-          resourceRequirements        : [
-              [0]: {
-                  type : "VCPU"
-                  value: "4"
                 }
-              [1]: {
-                  type : "MEMORY"
-                  value: "12288"
                 }
             ]
-          runtimePlatform             : {
-              cpuArchitecture      : "ARM64"
-              operatingSystemFamily: "LINUX"
             }
-          secrets                     : []
-          ulimits                     : []
-          volumes                     : []
         }
  => [unknown]
-      revision           : 9

🟡 eval-log-reader-lambda-function · update · aws:lambda/function:Function

       environment : {
           variables: {
+              HAWK_API_URL: "[REDACTED]"
             }
         }
-      imageUri    : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/inspect-ai/eval_log_reader-lambda@sha256:157db0dbe8176de7af348bc304fec2ae3b1ac59ee02e1cd8c071e446b6dc..."
+      imageUri    : [unknown]
-      lastModified: "2026-10-11T05:17:52.000+0000"

🟢 api-tasks-identity-store-read-policy · create · aws:iam/rolePolicy:RolePolicy

         name      : "tst-hawk-api-tasks-identity-store-read"
         policy    : (json) {
             Statement: [
                 [0]: {
                     Action  : [
                         [0]: "identitystore:GetUserId"
                         [1]: "identitystore:ListGroupMembershipsForMember"
                         [2]: "identitystore:ListGroups"
                     ]
                     Effect  : "Allow"
                     Resource: "*"
                     Sid     : "IdentityStoreRead"
                 }
             ]
             Version  : "2012-10-17"
         }
         role      : "tst-hawk-api-tasks"

🔁 live-ingest-task-def · replace · aws:ecs/taskDefinition:TaskDefinition

       containerDefinitions: (json) [
-          [0]: {
-              command         : [
-                  [0]: "--live-ingest"
-                  [1]: "--bucket"
-                  [2]: "tst-metr-inspect"
-                  [3]: "--queue-url"
-                  [4]: "[REDACTED]"
                 ]
-              cpu             : 1024
-              environment     : [
-                  [0]: {
-                      name : "DATABASE_URL"
-                      value: "[REDACTED]"
                     }
-                  [1]: {
-                      name : "LOG_LEVEL"
-                      value: "INFO"
                     }
-                  [2]: {
-                      name : "POWERTOOLS_METRICS_NAMESPACE"
-                      value: "tst/hawk/eval_log_importer"
                     }
-                  [3]: {
-                      name : "POWERTOOLS_SERVICE_NAME"
-                      value: "eval_log_importer"
                     }
-                  [4]: {
-                      name : "SENTRY_DSN"
-                      value: ""
                     }
-                  [5]: {
-                      name : "SENTRY_ENVIRONMENT"
-                      value: "tst"
                     }
                 ]
-              essential       : true
-              image           : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/hawk/eval-log-importer-lambda@sha256:879892bb11bfa75964fd599ee8f28098ef5ebeb648449575d81a0ca45d13bd5c"
-              logConfiguration: {
-                  logDriver: "awslogs"
-                  options  : {
-                      awslogs-group        : "tst/hawk/live-ingest"
-                      awslogs-region       : "us-west-2"
-                      awslogs-stream-prefix: "live-ingest-consumer"
-                      mode                 : "non-blocking"
                     }
                 }
-              memory          : 8192
-              mountPoints     : []
-              name            : "live-ingest-consumer"
-              portMappings    : []
-              stopTimeout     : 120
-              systemControls  : []
-              volumesFrom     : []
             }
         ]
  => [unknown]

🟡 eval-log-importer-job-def · update · aws:batch/jobDefinition:JobDefinition

-      arn                : "[REDACTED]"
       containerProperties: (json) {
-          command                     : []
-          environment                 : [
-              [0]: {
-                  name : "DATABASE_URL"
-                  value: "[REDACTED]"
                 }
-              [1]: {
-                  name : "LOG_LEVEL"
-                  value: "INFO"
                 }
-              [2]: {
-                  name : "POWERTOOLS_METRICS_NAMESPACE"
-                  value: "tst/hawk/eval_log_importer"
                 }
-              [3]: {
-                  name : "POWERTOOLS_SERVICE_NAME"
-                  value: "eval_log_importer"
                 }
-              [4]: {
-                  name : "SENTRY_ENVIRONMENT"
-                  value: "tst"
                 }
             ]
-          ephemeralStorage            : {
-              sizeInGiB: 50
             }
-          executionRoleArn            : "[REDACTED]"
-          fargatePlatformConfiguration: {
-              platformVersion: "1.4.0"
             }
-          image                       : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/hawk/eval-log-importer-lambda@sha256:879892bb11bfa75964fd599ee8f28098ef5ebeb648449575d81a0ca45d13bd5c"
-          jobRoleArn                  : "[REDACTED]"
-          logConfiguration            : {
-              logDriver    : "awslogs"
-              options      : {
-                  awslogs-group: "/aws/batch/tst-hawk-eval-log-importer"
                 }
-              secretOptions: []
             }
-          mountPoints                 : []
-          networkConfiguration        : {
-              assignPublicIp: "DISABLED"
             }
-          resourceRequirements        : [
-              [0]: {
-                  type : "VCPU"
-                  value: "8"
                 }
-              [1]: {
-                  type : "MEMORY"
-                  value: "61440"
                 }
             ]
-          runtimePlatform             : {
-              cpuArchitecture      : "ARM64"
-              operatingSystemFamily: "LINUX"
             }
-          secrets                     : []
-          ulimits                     : []
-          volumes                     : []
         }
  => [unknown]
-      revision           : 10

🟡 scan-importer-lambda-function · update · aws:lambda/function:Function

-      imageUri    : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/inspect-ai/scan_importer-lambda@sha256:de3ccb3df9ac0d5a1f92d113a9e8c3d4eacce6e1e757cfedbeecb4f10f96bf..."
+      imageUri    : [unknown]
-      lastModified: "2026-10-11T05:19:41.000+0000"

🟡 job-status-updated-lambda-function · update · aws:lambda/function:Function

-      imageUri    : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/inspect-ai/job_status_updated-lambda@sha256:10356a2ffe544ed1a87ed57cf7483f256816d976dccd7da0e134c8d89..."
+      imageUri    : [unknown]
-      lastModified: "2026-10-11T05:19:42.000+0000"

🔁 api-platform-metrics-task-def · replace · aws:ecs/taskDefinition:TaskDefinition

       containerDefinitions: (json) [
-          [0]: {
-              command               : []
-              cpu                   : 1024
-              entryPoint            : [
-                  [0]: "python"
-                  [1]: "-m"
-                  [2]: "hawk.api.platform_metrics"
                 ]
-              environment           : [
-                  [0]: {
-                      name : "AWS_REGION"
-                      value: "us-west-2"
                     }
-                  [1]: {
-                      name : "HAWK_API_KUBECONFIG"
-                      value: (json) {
-                          clusters       : [
-                              [0]: {
-                                  cluster: {
-                                      certificate-authority-data: "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURNakNDQWhxZ0F3SUJBZ0lSQVBJMVppb3YxSWZObFMzRUk5VjIwVGd3RFFZSktvWklodmNOQVFFTEJRQXcKSnpFUU1BNEdBMVVFQ2hNSFFWZF..."
-                                      server                    : "[REDACTED]"
                                     }
-                                  name   : "eks"
                                 }
                             ]
-                          contexts       : [
-                              [0]: {
-                                  context: {
-                                      cluster  : "eks"
-                                      namespace: "inspect"
-                                      user     : "aws"
                                     }
-                                  name   : "eks"
                                 }
                             ]
-                          current-context: "eks"
-                          users          : [
-                              [0]: {
-                                  name: "aws"
-                                  user: {
-                                      exec: {
-                                          apiVersion: "client.authentication.k8s.io/v1beta1"
-                                          args      : [
-                                              [0]: "--region=us-west-2"
-                                              [1]: "eks"
-                                              [2]: "get-token"
-                                              [3]: "--cluster-name=tst"
-                                              [4]: "--output=json"
                                             ]
-                                          command   : "aws"
                                         }
                                     }
                                 }
                             ]
                         }
                     }
-                  [2]: {
-                      name : "HAWK_API_PLATFORM_METRICS_ENV"
-                      value: "tst"
                     }
-                  [3]: {
-                      name : "HAWK_API_PLATFORM_METRICS_VPC_ID"
-                      value: "vpc-0e7f3fd3a534912f2"
                     }
-                  [4]: {
-                      name : "HAWK_API_RUNNER_NAMESPACE_PREFIX"
-                      value: "inspect"
                     }
-                  [5]: {
-                      name : "SENTRY_DSN"
-                      value: ""
                     }
-                  [6]: {
-                      name : "SENTRY_ENVIRONMENT"
-                      value: "tst"
                     }
                 ]
-              essential             : true
-              image                 : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/hawk/api@sha256:a9ff21e9385527d17151edd2ec54996990e3cd2c4db991663bd348e3ca1f9a17"
-              logConfiguration      : {
-                  logDriver: "awslogs"
-                  options  : {
-                      awslogs-group        : "tst/hawk/api"
-                      awslogs-region       : "us-west-2"
-                      awslogs-stream-prefix: "platform-metrics"
-                      mode                 : "non-blocking"
                     }
                 }
-              memory                : 8192
-              memoryReservation     : 100
-              mountPoints           : []
-              name                  : "platform-metrics"
-              portMappings          : []
-              readonlyRootFilesystem: false
-              systemControls        : []
-              user                  : "0"
-              volumesFrom           : []
             }
         ]
  => [unknown]

🔁 api-task-def · replace · aws:ecs/taskDefinition:TaskDefinition

       containerDefinitions: (json) [
-          [0]: {
-              command               : [
-                  [0]: "--forwarded-allow-ips=*"
-                  [1]: "--host=0.0.0.0"
-                  [2]: "--no-access-log"
-                  [3]: "--port=8080"
-                  [4]: "--proxy-headers"
-                  [5]: "--workers=5"
                 ]
-              cpu                   : 2048
-              environment           : [
-                  [0]: {
-                      name : "DD_SITE"
-                      value: "us3.datadoghq.com"
                     }
-                  [1]: {
-                      name : "HAWK_API_APP_NAME"
-                      value: "hawk"
                     }
-                  [2]: {
-                      name : "HAWK_API_CODE_ACCESS_GIT_HOSTS"
-                      value: (json) [
-                          [0]: "github.com"
-                          [1]: "gitlab.com"
                         ]
                     }
-                  [3]: {
-                      name : "HAWK_API_DATABASE_URL"
-                      value: "[REDACTED]"
                     }
-                  [4]: {
-                      name : "HAWK_API_DEFAULT_HUMAN_AGENT_ITEM"
-                      value: "human_agent"
                     }
-                  [5]: {
-                      name : "HAWK_API_DEFAULT_HUMAN_AGENT_NAME"
-                      value: "metr_agents"
                     }
-                  [6]: {
-                      name : "HAWK_API_DEFAULT_HUMAN_AGENT_PACKAGE"
-                      value: "[REDACTED]"
                     }
-                  [7]: {
-                      name : "HAWK_API_DOCKER_IMAGE_REPO"
-                      value: "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/inspect-tasks"
                     }
-                  [8]: {
-                      name : "HAWK_API_EXPECTED_LONGEST_RUN_DAYS"
-                      value: "40"
                     }
-                  [9]: {
-                      name : "HAWK_API_FEATURE_FLAGS_APPLICATION"
-                      value: "kf42uv5"
                     }
-                  [10]: {
-                      name : "HAWK_API_FEATURE_FLAGS_PROFILE"
-                      value: "n53imc7"
                     }
-                  [11]: {
-                      name : "HAWK_API_JUMPHOST_HOST"
-                      value: "tst-jumphost-7c7d4f567323211f.elb.us-west-2.amazonaws.com"
                     }
-                  [12]: {
-                      name : "HAWK_API_JUMPHOST_HOST_KEY"
-                      value: "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBXX4UdYx9Q1pGJbxPlw1Kl5IfZS1K0p1c9AzG8UN6/G\n"
                     }
-                  [13]: {
-                      name : "HAWK_API_KUBECONFIG"
-                      value: (json) {
-                          clusters       : [
-                              [0]: {
-                                  cluster: {
-                                      certificate-authority-data: "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURNakNDQWhxZ0F3SUJBZ0lSQVBJMVppb3YxSWZObFMzRUk5VjIwVGd3RFFZSktvWklodmNOQVFFTEJRQXcKSnpFUU1BNEdBMVVFQ2hNSFFWZF..."
-                                      server                    : "[REDACTED]"
                                     }
-                                  name   : "eks"
                                 }
                             ]
-                          contexts       : [
-                              [0]: {
-                                  context: {
-                                      cluster  : "eks"
-                                      namespace: "inspect"
-                                      user     : "aws"
                                     }
-                                  name   : "eks"
                                 }
                             ]
-                          current-context: "eks"
-                          users          : [
-                              [0]: {
-                                  name: "aws"
-                                  user: {
-                                      exec: {
-                                          apiVersion: "client.authentication.k8s.io/v1beta1"
-                                          args      : [
-                                              [0]: "--region=us-west-2"
-                                              [1]: "eks"
-                                              [2]: "get-token"
-                                              [3]: "--cluster-name=tst"
-                                              [4]: "--output=json"
                                             ]
-                                          command   : "aws"
                                         }
                                     }
                                 }
                             ]
                         }
                     }
-                  [14]: {
-                      name : "HAWK_API_KUEUE_ADMISSION_ENABLED"
-                      value: "true"
                     }
-                  [15]: {
-                      name : "HAWK_API_KUEUE_MONITORING_ENABLED"
-                      value: "true"
                     }
-                  [16]: {
-                      name : "HAWK_API_KUEUE_RUNNER_QUEUE_NAME"
-                      value: "hawk-runners"
                     }
-                  [17]: {
-                      name : "HAWK_API_KUEUE_SANDBOX_QUEUE_NAME"
-                      value: "hawk-sandboxes"
                     }
-                  [18]: {
-                      name : "HAWK_API_LOG_FORMAT"
-                      value: "json"
                     }
-                  [19]: {
-                      name : "HAWK_API_MAX_OUTSTANDING_JOBS_PER_USER"
-                      value: "128"
                     }
-                  [20]: {
-                      name : "HAWK_API_MIDDLEMAN_API_URL"
-                      value: "[REDACTED]"
                     }
-                  [21]: {
-                      name : "HAWK_API_MIDDLEMAN_TRAFFIC_LOG_GROUP"
-                      value: "tst/middleman/traffic"
                     }
-                  [22]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_ADMIN_CLAIM"
-                      value: "[REDACTED]"
                     }
-                  [23]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_AUDIENCE"
-                      value: "[REDACTED]"
                     }
-                  [24]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_AUTHORIZATION_ENDPOINT"
-                      value: "[REDACTED]"
                     }
-                  [25]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_CLIENT_ID"
-                      value: "[REDACTED]"
                     }
-                  [26]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_DEFAULT_PERMISSIONS"
-                      value: ""
                     }
-                  [27]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_DEVICE_AUTHORIZATION_ENDPOINT"
-                      value: "[REDACTED]"
                     }
-                  [28]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_EMAIL_FIELD"
-                      value: "sub"
                     }
-                  [29]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_ISSUER"
-                      value: "[REDACTED]"
                     }
-                  [30]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_JWKS_URI"
-                      value: "[REDACTED]"
                     }
-                  [31]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_REVOCATION_ENDPOINT"
-                      value: "[REDACTED]"
                     }
-                  [32]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_SCOPES"
-                      value: "openid profile email offline_access"
                     }
-                  [33]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_SCOPES_SUPPORTED"
-                      value: (json) [
-                          [0]: "openid"
-                          [1]: "profile"
-                          [2]: "email"
-                          [3]: "offline_access"
                         ]
                     }
-                  [34]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_TOKEN_ENDPOINT"
-                      value: "[REDACTED]"
                     }
-                  [35]: {
-                      name : "HAWK_API_OTEL_TRACING_ENABLED"
-                      value: "true"
                     }
-                  [36]: {
-                      name : "HAWK_API_REFRESH_TOKEN_LIFETIME_DAYS"
-                      value: "45"
                     }
-                  [37]: {
-                      name : "HAWK_API_RELAY_URL"
-                      value: "[REDACTED]"
                     }
-                  [38]: {
-                      name : "HAWK_API_RUNNER_CLUSTER_ROLE_NAME"
-                      value: "hawk-runner"
                     }
-                  [39]: {
-                      name : "HAWK_API_RUNNER_COREDNS_IMAGE_URI"
-                      value: "public.ecr.aws/eks-distro/coredns/coredns:v1.11.4-eks-1-33-latest"
                     }
-                  [40]: {
-                      name : "HAWK_API_RUNNER_CPU_ARCHITECTURE"
-                      value: "arm64"
                     }
-                  [41]: {
-                      name : "HAWK_API_RUNNER_DEFAULT_ENV_ARN"
-                      value: "[REDACTED]"
                     }
-                  [42]: {
-                      name : "HAWK_API_RUNNER_DEFAULT_IMAGE_URI"
-                      value: "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/inspect-ai/runner@sha256:a24f69507aadc7aaa0326d8351fff0508a6747839679c300e26056a2cd2bce2d"
                     }
-                  [43]: {
-                      name : "HAWK_API_RUNNER_EVAL_TASK_ARCHITECTURE"
-                      value: "amd64"
                     }
-                  [44]: {
-                      name : "HAWK_API_RUNNER_HARDENED_RUNTIME_CLASS_NAME"
-                      value: "gvisor"
                     }
-                  [45]: {
-                      name : "HAWK_API_RUNNER_NAMESPACE"
-                      value: "inspect"
                     }
-                  [46]: {
-                      name : "HAWK_API_RUNNER_NAMESPACE_PREFIX"
-                      value: "inspect"
                     }
-                  [47]: {
-                      name : "HAWK_API_RUNNER_SECRET_ARN_PATTERNS"
-                      value: (json) [
-                          [0]: "[REDACTED]"
                         ]
                     }
-                  [48]: {
-                      name : "HAWK_API_RUNNER_SECRET_DEFAULT_ARN_PREFIX"
-                      value: "[REDACTED]"
                     }
-                  [49]: {
-                      name : "HAWK_API_S3_BUCKET_NAME"
-                      value: "tst-metr-inspect"
                     }
-                  [50]: {
-                      name : "HAWK_API_SUBMISSION_GUARD_ENABLED"
-                      value: "false"
                     }
-                  [51]: {
-                      name : "HAWK_API_TASK_BRIDGE_REPOSITORY"
-                      value: "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/inspect-tasks"
                     }
-                  [52]: {
-                      name : "HAWK_API_TOKEN_BROKER_URL"
-                      value: "[REDACTED]"
                     }
-                  [53]: {
-                      name : "HAWK_API_VALKEY_URL"
-                      value: "[REDACTED]"
                     }
-                  [54]: {
-                      name : "HAWK_API_VIEWER_URL"
-                      value: "[REDACTED]"
                     }
-                  [55]: {
-                      name : "HAWK_SERVICE_VERSION"
-                      value: "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/hawk/api@sha256:a9ff21e9385527d17151edd2ec54996990e3cd2c4db991663bd348e3ca1f9a17"
                     }
-                  [56]: {
-                      name : "SENTRY_DSN"
-                      value: ""
                     }
-                  [57]: {
-                      name : "SENTRY_ENVIRONMENT"
-                      value: "tst"
                     }
-                  [58]: {
-                      name : "UVICORN_TIMEOUT_KEEP_ALIVE"
-                      value: "75"
                     }
                 ]
-              essential             : true
-              healthCheck           : {
-                  command    : [
-                      [0]: "CMD"
-                      [1]: "python"
-                      [2]: "-c"
-                      [3]: "import urllib.request; urllib.request.urlopen('[REDACTED]', timeout=5)"
                     ]
-                  interval   : 30
-                  retries    : 5
-                  startPeriod: 90
-                  timeout    : 10
                 }
-              image                 : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/hawk/api@sha256:a9ff21e9385527d17151edd2ec54996990e3cd2c4db991663bd348e3ca1f9a17"
-              logConfiguration      : {
-                  logDriver: "awslogs"
-                  options  : {
-                      awslogs-group        : "tst/hawk/api"
-                      awslogs-region       : "us-west-2"
-                      awslogs-stream-prefix: "ecs"
-                      mode                 : "non-blocking"
                     }
                 }
-              memory                : 8192
-              memoryReservation     : 100
-              mountPoints           : []
-              name                  : "api"
-              portMappings          : [
-                  [0]: {
-                      containerPort: 8080
-                      hostPort     : 8080
-                      name         : "api"
-                      protocol     : "tcp"
                     }
                 ]
-              readonlyRootFilesystem: false
-              secrets               : [
-                  [0]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_COUNT"
-                      valueFrom: "[REDACTED]"
                     }
-                  [1]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_KEY_0"
-                      valueFrom: "[REDACTED]"
                     }
-                  [2]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_KEY_1"
-                      valueFrom: "[REDACTED]"
                     }
-                  [3]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_KEY_2"
-                      valueFrom: "[REDACTED]"
                     }
-                  [4]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_VALUE_0"
-                      valueFrom: "[REDACTED]"
                     }
-                  [5]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_VALUE_1"
-                      valueFrom: "[REDACTED]"
                     }
-                  [6]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_VALUE_2"
-                      valueFrom: "[REDACTED]"
                     }
-                  [7]: {
-                      name     : "HAWK_API_SSH_ADMIN_PRIVATE_KEY"
-                      valueFrom: "[REDACTED]"
                     }
                 ]
-              systemControls        : []
-              user                  : "0"
-              volumesFrom           : []
             }
         ]
  => [unknown]

Full preview (including hidden churn)

Previewing update (tst):
@ previewing update....
  pulumi:pulumi:Stack: (same)
    [urn=urn:pulumi:tst::hawk::pulumi:pulumi:Stack::hawk-tst]
@ previewing update....
    ~ docker-build:index:Image: (update)
        [id=sha256:be9e55f67506791a64f3940fe36b2e6f6412057e5948d37d8f917eb74a434ea9]
        [urn=urn:pulumi:tst::hawk::metr:hawk:HawkEcr$docker-build:index:Image::ecr-runner-image]
        [provider=urn:pulumi:tst::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "876f77af9007aa26d58e705ec5887678258cbc12b71eaf7e34950c5545c8f57a"
    ~ docker-build:index:Image: (update)
        [id=sha256:6ce26ea160513cb409ed362d521c9e65664c7009717a76175b5541efcb8c5c61]
        [urn=urn:pulumi:tst::hawk::metr:hawk:HawkStack$metr:hawk:TokenBroker$metr:hawk:DockerLambda$docker-build:index:Image::token-broker-lambda-image]
        [provider=urn:pulumi:tst::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "f3a01dfcf01630d80b44a733f3e8ad6bd62dff81ba7785fbbe8929c093fdbf0f"
    ~ docker-build:index:Image: (update)
        [id=sha256:7a7cc25a1587c6dde7b875961b7390a72d05e006d94fa010176e717c24c2a115]
        [urn=urn:pulumi:tst::hawk::metr:hawk:HawkStack$metr:hawk:HawkImage$docker-build:index:Image::image-image]
        [provider=urn:pulumi:tst::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "876f77af9007aa26d58e705ec5887678258cbc12b71eaf7e34950c5545c8f57a"
    ~ aws:lambda/function:Function: (update)
        [id=tst-inspect-ai-token_broker]
        [urn=urn:pulumi:tst::hawk::metr:hawk:HawkStack$metr:hawk:TokenBroker$metr:hawk:DockerLambda$aws:lambda/function:Function::token-broker-lambda-function]
        [provider=urn:pulumi:tst::hawk::pulumi:providers:aws::default_7_44_0::[REDACTED]]
      ~ imageUri    : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/inspect-ai/token_broker-lambda@sha256:1ae6d79ca95ff2b38a629255862f4edeb1c30ca319cf64b3104d3d20cf05ba3..." => [unknown]
      - lastModified: "2026-10-11T05:17:52.000+0000"
    +-aws:ecs/taskDefinition:TaskDefinition: (replace)
        [id=tst-hawk-migrate]
        [urn=urn:pulumi:tst::hawk::metr:hawk:HawkStack$metr:hawk:DbMigrate$aws:ecs/taskDefinition:TaskDefinition::db-migrate-task-def]
        [provider=urn:pulumi:tst::hawk::pulumi:providers:aws::default_7_44_0::[REDACTED]]
      ~ containerDefinitions: (json) [
      -     [0]: {
              - command         : [
              -     [0]: "upgrade"
              -     [1]: "head"
                ]
              - entryPoint      : [
              -     [0]: "alembic"
                ]
              - environment     : [
              -     [0]: {
                      - name : "DATABASE_URL"
                      - value: "[REDACTED]"
                    }
                ]
              - essential       : true
              - image           : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/tst/hawk/api@sha256:a9ff21e9385527d17151edd2ec54996990e3cd2c4db991663bd348e3ca1f9a17"
              - logConfiguration: {
                  - logDriver: "awslogs"
                  - options  : {
                      - awslogs-group        : "tst/hawk/migrate"
                      - awslogs-region       : "us-west-2"
                      - awslogs-stream-prefix: "migrate"
                    }
                }
              - mountPoints     : []
              - name            : "migrate"
              - portMappings    : []
              - systemControls  : []
              - volumesFrom     : []
            }
        ]
 => [unknown]
    +-command:local:Command: (replace)
        [id=db-migrate-runbd740318]
        [urn=urn:pulumi:tst::hawk::metr:hawk:HawkStack$metr:hawk:DbMigrate$command:local:Command::db-migrate-run]
        [provider=urn:pulumi:tst::hawk::pulumi:providers:command::default_1_2_1::[REDACTED]]
      ~ environment: {
          ~ TASK_DEF_ARN: "[REDACTED]" => [unknown]
        }
      ~ triggers   : [
          ~ [0]: "sha256:a9ff21e9385527d17151edd2ec54996990e3cd2c4db991663bd348e3ca1f9a17" => [unknown]
          ~ [2]: "[REDACTED]" => [unknown]
        ]
    ~ docker-build:index:Image: (update)
        [id=sha256:036a3f6f9d48c8ff28544b0b41d17e3b87894f1fd51adbd9e0cc6ba981cea646]
        [urn=urn:pulumi:tst::hawk::metr:hawk:HawkRelay$docker-build:index:Image::relay-image]
        [provider=urn:pulumi:tst::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "cc8789a486ce64de008a26c490e4e969dc8c1dad926e7913df04f158510710fa"
    ~ docker-build:index:Image: (update)
        [id=sha256:97588405ef3f7e423413efc414113d474a0692b58bb9b31206d25288d401975c]
        [urn=urn:pulumi:tst::hawk::metr:core:Middleman$docker-build:index:Image::middleman-image]
        [provider=urn:pulumi:tst::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "243485a8fe455622fa58823d5cc573c292daa78e2bc55c8f9090e58ad3536b3e"
    ~ docker-build:index:Image: (update)
        [id=sha256:0c5ba8a604b5f12461895f5d97b99354e02eafcfc2db15fb4937f3ac03ca0910]
        [urn=urn:pulumi:tst::hawk::metr:hawk:HawkStack$metr:hawk:SampleEditor$docker-build:index:Image::sample-editor-image]
        [provider=urn:pulumi:tst::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "dc22a96905713bc12c0c8b3af4441cf95443b23d1403baaded1184efa79d7e60"
    ~ docker-build:index:Image: (update)
        [id=sha256:3cac72169fda095f79afa042ba0ad49cfa1d26d20b361fb1e447edb18611c4c5]
        [urn=urn:pulumi:tst::hawk::metr:hawk:HawkStack$metr:hawk:JobStatusUpdated$metr:hawk:DockerLambda$docker-build:index:Image::job-status-updated-lambda-image]
        [provider=urn:pulumi:tst::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "f3a01dfcf01630d80b44a733f3e8ad6bd62dff81ba7785fbbe8929c093fdbf0f"
    ~ docker-build:index:Image: (update)
        [id=sha256:b0771502d88afac858e06422c9a051fca79a937582cdb2e913a5dfe1c2550b05]
        [urn=urn:pulumi:tst::hawk::metr:hawk:HawkStack$metr:hawk:EvalLogReader$metr:hawk:DockerLambda$docker-build:index:Image::eval-log-reader-lambda-image]
        [provider=urn:pulumi:tst::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "f3a01dfcf01630d80b44a733f3e8ad6bd62dff81ba7785fbbe8929c093fdbf0f"
    +-aws:ecs/taskDefinition:TaskDefinition: (replace)
        [id=tst-hawk-relay]
        [urn=urn:pulumi:tst::hawk::metr:hawk:HawkRelay$aws:ecs/taskDefinition:TaskDefinition::relay-task-def]
        [provider=urn:pulumi:tst::hawk::pulumi:providers:aws::default_7_44_0::[REDACTED]]
      ~ containerDefinitions: (json) [
      -     [0]: {
              - cpu             : 512
              - environment     : [
              -     [0]: {
                      - name : "HAWK_ENV"
                      - value: "tst"
                    }
              -     [1]: {
                      - name : "HAWK_OTEL_TRACING_ENABLED"
                      - value: "true"
                    }
              -     [2]: {
                      - name : "HAWK_RELAY_ALLOWED_ORIGINS"
                      - value: (json) [
                      -     [0]: "[REDACTED]"
                        ]

                    }
              -     [3]: {
                      - name : "HAWK_RELAY_IDLE_TIMEOUT_SECONDS"
                      - value: "900"
                    }
              -     [4]: {
                      - name : "HAWK_RELAY_KUBECONFIG"
                      - value: (json) {
                          - clusters       : [
                          -     [0]: {
… (truncated — see the workflow run logs for the complete report)

github-actions · 2026-10-11T21:16:36Z

🥥 `preview` on hawk/prd

14 meaningful change(s) · 🟢 1 create · 🔁 7 replace · 🟡 6 update — 18 rebuild-churn hidden

🟡 token-broker-lambda-function · update · aws:lambda/function:Function
🔁 db-migrate-task-def · replace · aws:ecs/taskDefinition:TaskDefinition
🔁 middleman-task-def · replace · aws:ecs/taskDefinition:TaskDefinition
🔁 relay-task-def · replace · aws:ecs/taskDefinition:TaskDefinition
🟡 sample-editor-job-def · update · aws:batch/jobDefinition:JobDefinition
🔁 db-migrate-run · replace · command:local:Command
🟡 eval-log-reader-lambda-function · update · aws:lambda/function:Function
🟢 api-tasks-identity-store-read-policy · create · aws:iam/rolePolicy:RolePolicy
🟡 eval-log-importer-job-def · update · aws:batch/jobDefinition:JobDefinition
🔁 live-ingest-task-def · replace · aws:ecs/taskDefinition:TaskDefinition
🔁 api-task-def · replace · aws:ecs/taskDefinition:TaskDefinition
🟡 scan-importer-lambda-function · update · aws:lambda/function:Function
🔁 api-platform-metrics-task-def · replace · aws:ecs/taskDefinition:TaskDefinition
🟡 job-status-updated-lambda-function · update · aws:lambda/function:Function

Show diffs (14 resource(s))

🟡 token-broker-lambda-function · update · aws:lambda/function:Function

-      imageUri    : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd/inspect-ai/token_broker-lambda@sha256:857b440da29ed0f0c2e92da602a46286570cc5d1c8c6c068092cd3ac37d71c0..."
+      imageUri    : [unknown]
-      lastModified: "2026-10-11T05:18:13.000+0000"

🔁 db-migrate-task-def · replace · aws:ecs/taskDefinition:TaskDefinition

       containerDefinitions: (json) [
-          [0]: {
-              command         : [
-                  [0]: "upgrade"
-                  [1]: "head"
                 ]
-              entryPoint      : [
-                  [0]: "alembic"
                 ]
-              environment     : [
-                  [0]: {
-                      name : "DATABASE_URL"
-                      value: "[REDACTED]"
                     }
                 ]
-              essential       : true
-              image           : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd/hawk/api@sha256:62017302c2688cf8074a349f54d372f1b9906124e256e6ef14276e33124e71af"
-              logConfiguration: {
-                  logDriver: "awslogs"
-                  options  : {
-                      awslogs-group        : "prd/hawk/migrate"
-                      awslogs-region       : "us-west-2"
-                      awslogs-stream-prefix: "migrate"
                     }
                 }
-              mountPoints     : []
-              name            : "migrate"
-              portMappings    : []
-              systemControls  : []
-              volumesFrom     : []
             }
         ]
  => [unknown]

🔁 middleman-task-def · replace · aws:ecs/taskDefinition:TaskDefinition

       containerDefinitions: (json) [
-          [0]: {
-              cpu             : 128
-              environment     : [
-                  [0]: {
-                      name : "DD_APM_ENABLED"
-                      value: "true"
                     }
-                  [1]: {
-                      name : "DD_APM_NON_LOCAL_TRAFFIC"
-                      value: "true"
                     }
-                  [2]: {
-                      name : "DD_APM_RECEIVER_SOCKET"
-                      value: "/var/run/datadog/apm.socket"
                     }
-                  [3]: {
-                      name : "DD_DOGSTATSD_NON_LOCAL_TRAFFIC"
-                      value: "true"
                     }
-                  [4]: {
-                      name : "DD_ECS_FARGATE"
-                      value: "true"
                     }
-                  [5]: {
-                      name : "DD_ENV"
-                      value: "prd"
                     }
-                  [6]: {
-                      name : "DD_PROCESS_AGENT_ENABLED"
-                      value: "false"
                     }
-                  [7]: {
-                      name : "DD_SITE"
-                      value: "us3.datadoghq.com"
                     }
-                  [8]: {
-                      name : "DD_TAGS"
-                      value: "env:prd service:middleman"
                     }
-                  [9]: {
-                      name : "ECS_FARGATE"
-                      value: "true"
                     }
                 ]
-              essential       : false
-              healthCheck     : {
-                  command    : [
-                      [0]: "CMD"
-                      [1]: "agent"
-                      [2]: "health"
                     ]
-                  interval   : 30
-                  retries    : 3
-                  startPeriod: 15
-                  timeout    : 5
                 }
-              image           : "public.ecr.aws/datadog/agent:7"
-              logConfiguration: {
-                  logDriver: "awslogs"
-                  options  : {
-                      awslogs-group        : "prd/middleman"
-                      awslogs-region       : "us-west-2"
-                      awslogs-stream-prefix: "datadog-agent"
                     }
                 }
-              memory          : 256
-              mountPoints     : [
-                  [0]: {
-                      containerPath: "/var/run/datadog"
-                      readOnly     : false
-                      sourceVolume : "dd-sockets"
                     }
                 ]
-              name            : "datadog-agent"
-              portMappings    : [
-                  [0]: {
-                      containerPort: 8126
-                      hostPort     : 8126
-                      protocol     : "tcp"
                     }
-                  [1]: {
-                      containerPort: 8125
-                      hostPort     : 8125
-                      protocol     : "udp"
                     }
                 ]
-              secrets         : [
-                  [0]: {
-                      name     : "DD_API_KEY"
-                      valueFrom: "[REDACTED]"
                     }
                 ]
-              systemControls  : []
-              volumesFrom     : []
             }
-          [1]: {
-              cpu              : 8064
-              dependsOn        : [
-                  [0]: {
-                      condition    : "START"
-                      containerName: "datadog-agent"
                     }
                 ]
-              environment      : [
-                  [0]: {
-                      name : "DD_AGENT_HOST"
-                      value: "localhost"
                     }
-                  [1]: {
-                      name : "DD_DOGSTATSD_PORT"
-                      value: "8125"
                     }
-                  [2]: {
-                      name : "DD_DOGSTATSD_TAGS"
-                      value: "service:middleman,env:prd"
                     }
-                  [3]: {
-                      name : "DD_ENV"
-                      value: "prd"
                     }
-                  [4]: {
-                      name : "DD_LOGS_INJECTION"
-                      value: "true"
                     }
-                  [5]: {
-                      name : "DD_SERVICE"
-                      value: "middleman"
                     }
-                  [6]: {
-                      name : "DD_SITE"
-                      value: "us3.datadoghq.com"
                     }
-                  [7]: {
-                      name : "DD_TRACE_AGENT_URL"
-                      value: "[REDACTED]"
                     }
-                  [8]: {
-                      name : "DD_TRACE_CLIENT_IP_ENABLED"
-                      value: "true"
                     }
-                  [9]: {
-                      name : "DD_TRACE_CLIENT_IP_HEADER"
-                      value: "X-Forwarded-For"
                     }
-                  [10]: {
-                      name : "DD_TRACE_REQUEST_BODY_ENABLED"
-                      value: "false"
                     }
-                  [11]: {
-                      name : "DD_TRACE_RESPONSE_BODY_ENABLED"
-                      value: "false"
                     }
-                  [12]: {
-                      name : "DD_TRACE_SAMPLE_RATE"
-                      value: "1.0"
                     }
-                  [13]: {
-                      name : "DD_TRACE_SAMPLING_RULES"
-                      value: (json) [
-                          [0]: {
-                              resource   : "GET /health"
-                              sample_rate: 0
                             }
-                          [1]: {
-                              resource   : "GET /health/deep"
-                              sample_rate: 0
                             }
                         ]
                     }
-                  [14]: {
-                      name : "GOOGLE_CLOUD_PROJECT_FOR_PUBLIC_MODELS"
-                      value: "metr-pub"
                     }
-                  [15]: {
-                      name : "HAWK_OTEL_TRACING_ENABLED"
-                      value: "true"
                     }
-                  [16]: {
-                      name : "HAWK_SERVICE_VERSION"
-                      value: "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd-middleman@sha256:b2fd3572ace6a6086bf60e016e131a6c1fbae840a22a062a4e429b870f4e7da8"
                     }
-                  [17]: {
-                      name : "MIDDLEMAN_ACCEPT_DEV_ADMIN"
-                      value: "false"
                     }
-                  [18]: {
-                      name : "MIDDLEMAN_ANTHROPIC_DEFAULT_PROFILE"
-                      value: "prd-zdr-default"
                     }
-                  [19]: {
-                      name : "MIDDLEMAN_ANTHROPIC_PROFILES"
-                      value: (json) {
-                          cvp-prd           : {
-                              federation_rule_id    : "[REDACTED]"
-                              mode                  : "wif"
-                              okta_client_id        : "[REDACTED]"
-                              okta_client_secret_key: "OKTA_ANTHROPIC_WIF_CVP_PRD_CLIENT_SECRET"
-                              okta_scope            : "anthropic:federate"
-                              okta_token_url        : "[REDACTED]"
-                              organization_id       : "[REDACTED]"
-                              service_account_id    : "[REDACTED]"
-                              workspace_id          : "[REDACTED]"
                             }
-                          prd-data-retention: {
-                              federation_rule_id    : "[REDACTED]"
-                              mode                  : "wif"
-                              okta_client_id        : "[REDACTED]"
-                              okta_client_secret_key: "OKTA_ANTHROPIC_WIF_GENERAL_PRD_CLIENT_SECRET"
-                              okta_scope            : "anthropic:federate"
-                              okta_token_url        : "[REDACTED]"
-                              organization_id       : "[REDACTED]"
-                              service_account_id    : "[REDACTED]"
-                              workspace_id          : "[REDACTED]"
                             }
-                          prd-zdr-default   : {
-                              assertion_source     : "aws_sts"
-                              auth_type            : "wif"
-                              federation_rule_id   : "[REDACTED]"
-                              high_priority_profile: "prd-zdr-high"
-                              organization_id      : "[REDACTED]"
-                              service_account_id   : "[REDACTED]"
-                              workspace_id         : "[REDACTED]"
                             }
-                          prd-zdr-high      : {
-                              assertion_source  : "aws_sts"
-                              auth_type         : "wif"
-                              federation_rule_id: "[REDACTED]"
-                              organization_id   : "[REDACTED]"
-                              service_account_id: "[REDACTED]"
-                              workspace_id      : "[REDACTED]"
                             }
-                          predeployment-prd : {
-                              federation_rule_id    : "[REDACTED]"
-                              mode                  : "wif"
-                              okta_client_id        : "[REDACTED]"
-                              okta_client_secret_key: "OKTA_ANTHROPIC_WIF_PREDEPLOYMENT_PRD_CLIENT_SECRET"
-                              okta_scope            : "anthropic:federate"
-                              okta_token_url        : "[REDACTED]"
-                              organization_id       : "[REDACTED]"
-                              service_account_id    : "[REDACTED]"
-                              workspace_id          : "[REDACTED]"
                             }
                         }
                     }
-                  [20]: {
-                      name : "MIDDLEMAN_API_KEYS_SECRET_ARN"
-                      value: "[REDACTED]"
                     }
-                  [21]: {
-                      name : "MIDDLEMAN_AUTH_PROVIDERS"
-                      value: (json) [
-                          [0]: {
-                              admin_groups      : []
-                              audiences         : [
-                                  [0]: "[REDACTED]"
                                 ]
-                              default_groups    : []
-                              email_field       : "sub"
-                              issuer            : "[REDACTED]"
-                              jwks_uri          : "[REDACTED]"
-                              teams_claim       : "teams"
-                              teams_group_prefix: "team-"
                             }
                         ]
                     }
-                  [22]: {
-                      name : "MIDDLEMAN_CONFIG_FILE"
-                      value: "middleman.yaml"
                     }
-                  [23]: {
-                      name : "MIDDLEMAN_DATABASE_URL"
-                      value: "[REDACTED]"
                     }
-                  [24]: {
-                      name : "MIDDLEMAN_ENV"
-                      value: "prd"
                     }
-                  [25]: {
-                      name : "MIDDLEMAN_METRICS_LOG_GROUP"
-                      value: "prd/middleman/metrics"
                     }
-                  [26]: {
-                      name : "MIDDLEMAN_OPENAI_DEFAULT_PROFILE"
-                      value: "prd-default"
                     }
-                  [27]: {
-                      name : "MIDDLEMAN_OPENAI_PROFILES"
-                      value: (json) {
-                          prd-data-retention: {
-                              assertion_source    : "aws_sts"
-                              auth_type           : "wif"
-                              identity_provider_id: "idp_c809e89d42f1da574f14c8c4"
-                              service_account_id  : "user-72da34fd871547e66407bfc9"
                             }
-                          prd-daybreak      : {
-                              assertion_source    : "aws_sts"
-                              auth_type           : "wif"
-                              identity_provider_id: "idp_748e681d7403e79951db1582"
-                              service_account_id  : "user-e5515f4e96f55e5faefc44e5"
                             }
-                          prd-default       : {
-                              assertion_source    : "aws_sts"
-                              auth_type           : "wif"
-                              identity_provider_id: "idp_3ec50729f877fb9731369e6d"
-                              service_account_id  : "user-9b1379d8e53482930198fbde"
                             }
                         }
                     }
-                  [28]: {
-                      name : "MIDDLEMAN_TRAFFIC_LOG_CW_GROUP"
-                      value: "prd/middleman/traffic"
                     }
-                  [29]: {
-                      name : "MIDDLEMAN_TRAFFIC_LOG_LEVEL"
-                      value: "full"
                     }
-                  [30]: {
-                      name : "MIDDLEMAN_TRAFFIC_LOG_S3_BUCKET"
-                      value: "metr-prd-middleman-traffic"
                     }
-                  [31]: {
-                      name : "MIDDLEMAN_VALKEY_URL"
-                      value: "[REDACTED]"
                     }
-                  [32]: {
-                      name : "SENTRY_DSN"
-                      value: "[REDACTED]"
                     }
-                  [33]: {
-                      name : "SENTRY_ENVIRONMENT"
-                      value: "prd"
                     }
-                  [34]: {
-                      name : "SENTRY_TRACES_SAMPLE_RATE"
-                      value: "0"
                     }
-                  [35]: {
-                      name : "WEB_CONCURRENCY"
-                      value: "16"
                     }
                 ]
-              essential        : true
-              healthCheck      : {
-                  command    : [
-                      [0]: "CMD"
-                      [1]: "python"
-                      [2]: "-c"
-                      [3]: "import urllib.request; urllib.request.urlopen('[REDACTED]', timeout=5)"
                     ]
-                  interval   : 30
-                  retries    : 5
-                  startPeriod: 120
-                  timeout    : 10
                 }
-              image            : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd-middleman@sha256:b2fd3572ace6a6086bf60e016e131a6c1fbae840a22a062a4e429b870f4e7da8"
-              logConfiguration : {
-                  logDriver: "awslogs"
-                  options  : {
-                      awslogs-group        : "prd/middleman"
-                      awslogs-region       : "us-west-2"
-                      awslogs-stream-prefix: "middleman"
-                      max-buffer-size      : "25m"
-                      mode                 : "non-blocking"
                     }
                 }
-              memory           : 16128
-              memoryReservation: 100
-              mountPoints      : [
-                  [0]: {
-                      containerPath: "/var/run/datadog"
-                      readOnly     : false
-                      sourceVolume : "dd-sockets"
                     }
                 ]
-              name             : "middleman"
-              portMappings     : [
-                  [0]: {
-                      containerPort: 3500
-                      hostPort     : 3500
-                      name         : "middleman"
-                      protocol     : "tcp"
                     }
                 ]
-              systemControls   : []
-              volumesFrom      : []
             }
         ]
  => [unknown]

🔁 relay-task-def · replace · aws:ecs/taskDefinition:TaskDefinition

       containerDefinitions: (json) [
-          [0]: {
-              cpu             : 512
-              environment     : [
-                  [0]: {
-                      name : "HAWK_ENV"
-                      value: "prd"
                     }
-                  [1]: {
-                      name : "HAWK_OTEL_TRACING_ENABLED"
-                      value: "true"
                     }
-                  [2]: {
-                      name : "HAWK_RELAY_ALLOWED_ORIGINS"
-                      value: (json) [
-                          [0]: "[REDACTED]"
                         ]
                     }
-                  [3]: {
-                      name : "HAWK_RELAY_IDLE_TIMEOUT_SECONDS"
-                      value: "900"
                     }
-                  [4]: {
-                      name : "HAWK_RELAY_KUBECONFIG"
-                      value: (json) {
-                          clusters       : [
-                              [0]: {
-                                  cluster: {
-                                      certificate-authority-data: "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURCVENDQWUyZ0F3SUJBZ0lJQWczeDVnSEY5ZFV3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QW..."
-                                      server                    : "[REDACTED]"
                                     }
-                                  name   : "eks"
                                 }
                             ]
-                          contexts       : [
-                              [0]: {
-                                  context: {
-                                      cluster  : "eks"
-                                      namespace: "inspect"
-                                      user     : "aws"
                                     }
-                                  name   : "eks"
                                 }
                             ]
-                          current-context: "eks"
-                          users          : [
-                              [0]: {
-                                  name: "aws"
-                                  user: {
-                                      exec: {
-                                          apiVersion: "client.authentication.k8s.io/v1beta1"
-                                          args      : [
-                                              [0]: "--region=us-west-2"
-                                              [1]: "eks"
-                                              [2]: "get-token"
-                                              [3]: "--cluster-name=prd"
-                                              [4]: "--output=json"
                                             ]
-                                          command   : "aws"
                                         }
                                     }
                                 }
                             ]
                         }
                     }
-                  [5]: {
-                      name : "HAWK_RELAY_MAX_CONCURRENT_SESSIONS"
-                      value: "40"
                     }
-                  [6]: {
-                      name : "HAWK_RELAY_MAX_SESSIONS_PER_PRINCIPAL"
-                      value: "5"
                     }
-                  [7]: {
-                      name : "HAWK_RELAY_MAX_SESSION_SECONDS"
-                      value: "14400"
                     }
-                  [8]: {
-                      name : "HAWK_RELAY_RUNNER_NAMESPACE"
-                      value: "inspect"
                     }
-                  [9]: {
-                      name : "HAWK_RELAY_TOKEN_AUDIENCE"
-                      value: "[REDACTED]"
                     }
-                  [10]: {
-                      name : "HAWK_RELAY_TOKEN_DEFAULT_PERMISSIONS"
-                      value: ""
                     }
-                  [11]: {
-                      name : "HAWK_RELAY_TOKEN_EMAIL_FIELD"
-                      value: "sub"
                     }
-                  [12]: {
-                      name : "HAWK_RELAY_TOKEN_ISSUER"
-                      value: "[REDACTED]"
                     }
-                  [13]: {
-                      name : "HAWK_RELAY_TOKEN_JWKS_URI"
-                      value: "[REDACTED]"
                     }
-                  [14]: {
-                      name : "HAWK_RELAY_VALKEY_URL"
-                      value: "[REDACTED]"
                     }
-                  [15]: {
-                      name : "HAWK_SERVICE"
-                      value: "relay"
                     }
-                  [16]: {
-                      name : "HAWK_SERVICE_VERSION"
-                      value: "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd-hawk-relay@sha256:db41e0a31cf06f38296e5a4929e71cd5da3dd41f89ed4140a0079a75dccfa9fa"
                     }
-                  [17]: {
-                      name : "SENTRY_DSN"
-                      value: ""
                     }
-                  [18]: {
-                      name : "SENTRY_ENVIRONMENT"
-                      value: "prd"
                     }
                 ]
-              essential       : true
-              healthCheck     : {
-                  command    : [
-                      [0]: "CMD"
-                      [1]: "python3"
-                      [2]: "-c"
-                      [3]: "import urllib.request; urllib.request.urlopen('[REDACTED]', timeout=5)"
                     ]
-                  interval   : 30
-                  retries    : 5
-                  startPeriod: 60
-                  timeout    : 10
                 }
-              image           : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd-hawk-relay@sha256:db41e0a31cf06f38296e5a4929e71cd5da3dd41f89ed4140a0079a75dccfa9fa"
-              logConfiguration: {
-                  logDriver: "awslogs"
-                  options  : {
-                      awslogs-group        : "prd/hawk/relay"
-                      awslogs-region       : "us-west-2"
-                      awslogs-stream-prefix: "relay"
-                      mode                 : "non-blocking"
                     }
                 }
-              mountPoints     : []
-              name            : "relay"
-              portMappings    : [
-                  [0]: {
-                      containerPort: 8080
-                      hostPort     : 8080
-                      name         : "relay"
-                      protocol     : "tcp"
                     }
                 ]
-              systemControls  : []
-              volumesFrom     : []
             }
         ]
  => [unknown]

🟡 sample-editor-job-def · update · aws:batch/jobDefinition:JobDefinition

-      arn                : "[REDACTED]"
       containerProperties: (json) {
-          command                     : []
-          environment                 : [
-              [0]: {
-                  name : "SENTRY_DSN"
-                  value: "[REDACTED]"
                 }
-              [1]: {
-                  name : "SENTRY_ENVIRONMENT"
-                  value: "prd"
                 }
             ]
-          executionRoleArn            : "[REDACTED]"
-          fargatePlatformConfiguration: {
-              platformVersion: "1.4.0"
             }
-          image                       : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd/hawk/sample-editor-lambda@sha256:d6f75348e4c90ef7a325d308d72b9e862c99487e353f8dccd6df7ce840abacc0"
-          jobRoleArn                  : "[REDACTED]"
-          logConfiguration            : {
-              logDriver    : "awslogs"
-              options      : {
-                  awslogs-group  : "/aws/batch/prd-hawk-sample-editor"
-                  max-buffer-size: "25m"
-                  mode           : "non-blocking"
                 }
-              secretOptions: []
             }
-          mountPoints                 : []
-          networkConfiguration        : {
-              assignPublicIp: "DISABLED"
             }
-          resourceRequirements        : [
-              [0]: {
-                  type : "VCPU"
-                  value: "4"
                 }
-              [1]: {
-                  type : "MEMORY"
-                  value: "12288"
                 }
             ]
-          runtimePlatform             : {
-              cpuArchitecture      : "ARM64"
-              operatingSystemFamily: "LINUX"
             }
-          secrets                     : []
-          ulimits                     : []
-          volumes                     : []
         }
  => [unknown]
-      revision           : 572

🔁 db-migrate-run · replace · command:local:Command

       environment: {
-          TASK_DEF_ARN: "[REDACTED]"
+          TASK_DEF_ARN: [unknown]
         }
       triggers   : [
-          [0]: "sha256:62017302c2688cf8074a349f54d372f1b9906124e256e6ef14276e33124e71af"
+          [0]: [unknown]
-          [2]: "[REDACTED]"
+          [2]: [unknown]
         ]

🟡 eval-log-reader-lambda-function · update · aws:lambda/function:Function

       environment : {
           variables: {
+              HAWK_API_URL: "[REDACTED]"
             }
         }
-      imageUri    : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd/inspect-ai/eval_log_reader-lambda@sha256:3484dbc9ba8c39ca1d12d8679ad5bd3718791ad42eccb699c6deb7d6598c..."
+      imageUri    : [unknown]
-      lastModified: "2026-10-11T05:18:13.000+0000"

🟢 api-tasks-identity-store-read-policy · create · aws:iam/rolePolicy:RolePolicy

         name      : "prd-hawk-api-tasks-identity-store-read"
         policy    : (json) {
             Statement: [
                 [0]: {
                     Action  : [
                         [0]: "identitystore:GetUserId"
                         [1]: "identitystore:ListGroupMembershipsForMember"
                         [2]: "identitystore:ListGroups"
                     ]
                     Effect  : "Allow"
                     Resource: "*"
                     Sid     : "IdentityStoreRead"
                 }
             ]
             Version  : "2012-10-17"
         }
         role      : "prd-hawk-api-tasks"

🟡 eval-log-importer-job-def · update · aws:batch/jobDefinition:JobDefinition

-      arn                : "[REDACTED]"
       containerProperties: (json) {
-          command                     : []
-          environment                 : [
-              [0]: {
-                  name : "DATABASE_URL"
-                  value: "[REDACTED]"
                 }
-              [1]: {
-                  name : "LOG_LEVEL"
-                  value: "INFO"
                 }
-              [2]: {
-                  name : "POWERTOOLS_METRICS_NAMESPACE"
-                  value: "prd/hawk/eval_log_importer"
                 }
-              [3]: {
-                  name : "POWERTOOLS_SERVICE_NAME"
-                  value: "eval_log_importer"
                 }
-              [4]: {
-                  name : "SENTRY_DSN"
-                  value: "[REDACTED]"
                 }
-              [5]: {
-                  name : "SENTRY_ENVIRONMENT"
-                  value: "prd"
                 }
             ]
-          ephemeralStorage            : {
-              sizeInGiB: 50
             }
-          executionRoleArn            : "[REDACTED]"
-          fargatePlatformConfiguration: {
-              platformVersion: "1.4.0"
             }
-          image                       : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd/hawk/eval-log-importer-lambda@sha256:a1344244e570b0e0cb16f6ab39763218a24272fea6500e726583c1895168738a"
-          jobRoleArn                  : "[REDACTED]"
-          logConfiguration            : {
-              logDriver    : "awslogs"
-              options      : {
-                  awslogs-group: "/aws/batch/prd-hawk-eval-log-importer"
                 }
-              secretOptions: []
             }
-          mountPoints                 : []
-          networkConfiguration        : {
-              assignPublicIp: "DISABLED"
             }
-          resourceRequirements        : [
-              [0]: {
-                  type : "VCPU"
-                  value: "8"
                 }
-              [1]: {
-                  type : "MEMORY"
-                  value: "61440"
                 }
             ]
-          runtimePlatform             : {
-              cpuArchitecture      : "ARM64"
-              operatingSystemFamily: "LINUX"
             }
-          secrets                     : []
-          ulimits                     : []
-          volumes                     : []
         }
  => [unknown]
-      revision           : 573

🔁 live-ingest-task-def · replace · aws:ecs/taskDefinition:TaskDefinition

       containerDefinitions: (json) [
-          [0]: {
-              command         : [
-                  [0]: "--live-ingest"
-                  [1]: "--bucket"
-                  [2]: "prd-metr-inspect"
-                  [3]: "--queue-url"
-                  [4]: "[REDACTED]"
                 ]
-              cpu             : 1024
-              environment     : [
-                  [0]: {
-                      name : "DATABASE_URL"
-                      value: "[REDACTED]"
                     }
-                  [1]: {
-                      name : "LOG_LEVEL"
-                      value: "INFO"
                     }
-                  [2]: {
-                      name : "POWERTOOLS_METRICS_NAMESPACE"
-                      value: "prd/hawk/eval_log_importer"
                     }
-                  [3]: {
-                      name : "POWERTOOLS_SERVICE_NAME"
-                      value: "eval_log_importer"
                     }
-                  [4]: {
-                      name : "SENTRY_DSN"
-                      value: "[REDACTED]"
                     }
-                  [5]: {
-                      name : "SENTRY_ENVIRONMENT"
-                      value: "prd"
                     }
                 ]
-              essential       : true
-              image           : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd/hawk/eval-log-importer-lambda@sha256:a1344244e570b0e0cb16f6ab39763218a24272fea6500e726583c1895168738a"
-              logConfiguration: {
-                  logDriver: "awslogs"
-                  options  : {
-                      awslogs-group        : "prd/hawk/live-ingest"
-                      awslogs-region       : "us-west-2"
-                      awslogs-stream-prefix: "live-ingest-consumer"
-                      mode                 : "non-blocking"
                     }
                 }
-              memory          : 8192
-              mountPoints     : []
-              name            : "live-ingest-consumer"
-              portMappings    : []
-              stopTimeout     : 120
-              systemControls  : []
-              volumesFrom     : []
             }
         ]
  => [unknown]

🔁 api-task-def · replace · aws:ecs/taskDefinition:TaskDefinition

       containerDefinitions: (json) [
-          [0]: {
-              command               : [
-                  [0]: "--forwarded-allow-ips=*"
-                  [1]: "--host=0.0.0.0"
-                  [2]: "--no-access-log"
-                  [3]: "--port=8080"
-                  [4]: "--proxy-headers"
-                  [5]: "--workers=5"
                 ]
-              cpu                   : 2048
-              environment           : [
-                  [0]: {
-                      name : "DD_SITE"
-                      value: "us3.datadoghq.com"
                     }
-                  [1]: {
-                      name : "HAWK_API_APP_NAME"
-                      value: "hawk"
                     }
-                  [2]: {
-                      name : "HAWK_API_CODE_ACCESS_GIT_HOSTS"
-                      value: (json) [
-                          [0]: "github.com"
-                          [1]: "gitlab.com"
                         ]
                     }
-                  [3]: {
-                      name : "HAWK_API_CORS_ALLOWED_ORIGIN_REGEX"
-                      value: "^(?:[REDACTED]"
                     }
-                  [4]: {
-                      name : "HAWK_API_DATABASE_URL"
-                      value: "[REDACTED]"
                     }
-                  [5]: {
-                      name : "HAWK_API_DATADOG_EVAL_SET_DASHBOARD_URL"
-                      value: "[REDACTED]"
                     }
-                  [6]: {
-                      name : "HAWK_API_DATADOG_SCAN_DASHBOARD_URL"
-                      value: "[REDACTED]"
                     }
-                  [7]: {
-                      name : "HAWK_API_DEFAULT_HUMAN_AGENT_ITEM"
-                      value: "human_agent"
                     }
-                  [8]: {
-                      name : "HAWK_API_DEFAULT_HUMAN_AGENT_NAME"
-                      value: "metr_agents"
                     }
-                  [9]: {
-                      name : "HAWK_API_DEFAULT_HUMAN_AGENT_PACKAGE"
-                      value: "[REDACTED]"
                     }
-                  [10]: {
-                      name : "HAWK_API_DOCKER_IMAGE_REPO"
-                      value: "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd/inspect-tasks"
                     }
-                  [11]: {
-                      name : "HAWK_API_EXPECTED_LONGEST_RUN_DAYS"
-                      value: "40"
                     }
-                  [12]: {
-                      name : "HAWK_API_FEATURE_FLAGS_APPLICATION"
-                      value: "xhik6v0"
                     }
-                  [13]: {
-                      name : "HAWK_API_FEATURE_FLAGS_PROFILE"
-                      value: "hrwlfhl"
                     }
-                  [14]: {
-                      name : "HAWK_API_JUMPHOST_HOST"
-                      value: "prd-jumphost-e11fa5d43d03488a.elb.us-west-2.amazonaws.com"
                     }
-                  [15]: {
-                      name : "HAWK_API_JUMPHOST_HOST_KEY"
-                      value: "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFPT9sKJtV3C7Tnx5PjD6Kk5bL5RTjvA6L3Bw3FxzI/x\n"
                     }
-                  [16]: {
-                      name : "HAWK_API_KUBECONFIG"
-                      value: (json) {
-                          clusters       : [
-                              [0]: {
-                                  cluster: {
-                                      certificate-authority-data: "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURCVENDQWUyZ0F3SUJBZ0lJQWczeDVnSEY5ZFV3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QW..."
-                                      server                    : "[REDACTED]"
                                     }
-                                  name   : "eks"
                                 }
                             ]
-                          contexts       : [
-                              [0]: {
-                                  context: {
-                                      cluster  : "eks"
-                                      namespace: "inspect"
-                                      user     : "aws"
                                     }
-                                  name   : "eks"
                                 }
                             ]
-                          current-context: "eks"
-                          users          : [
-                              [0]: {
-                                  name: "aws"
-                                  user: {
-                                      exec: {
-                                          apiVersion: "client.authentication.k8s.io/v1beta1"
-                                          args      : [
-                                              [0]: "--region=us-west-2"
-                                              [1]: "eks"
-                                              [2]: "get-token"
-                                              [3]: "--cluster-name=prd"
-                                              [4]: "--output=json"
                                             ]
-                                          command   : "aws"
                                         }
                                     }
                                 }
                             ]
                         }
                     }
-                  [17]: {
-                      name : "HAWK_API_KUEUE_ADMISSION_ENABLED"
-                      value: "true"
                     }
-                  [18]: {
-                      name : "HAWK_API_KUEUE_MONITORING_ENABLED"
-                      value: "true"
                     }
-                  [19]: {
-                      name : "HAWK_API_KUEUE_RUNNER_QUEUE_NAME"
-                      value: "hawk-runners"
                     }
-                  [20]: {
-                      name : "HAWK_API_KUEUE_SANDBOX_QUEUE_NAME"
-                      value: "hawk-sandboxes"
                     }
-                  [21]: {
-                      name : "HAWK_API_LOG_FORMAT"
-                      value: "json"
                     }
-                  [22]: {
-                      name : "HAWK_API_MAX_OUTSTANDING_JOBS_PER_USER"
-                      value: "128"
                     }
-                  [23]: {
-                      name : "HAWK_API_MIDDLEMAN_API_URL"
-                      value: "[REDACTED]"
                     }
-                  [24]: {
-                      name : "HAWK_API_MIDDLEMAN_TRAFFIC_LOG_GROUP"
-                      value: "prd/middleman/traffic"
                     }
-                  [25]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_ADMIN_CLAIM"
-                      value: "[REDACTED]"
                     }
-                  [26]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_AUDIENCE"
-                      value: "[REDACTED]"
                     }
-                  [27]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_AUTHORIZATION_ENDPOINT"
-                      value: "[REDACTED]"
                     }
-                  [28]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_CLIENT_ID"
-                      value: "[REDACTED]"
                     }
-                  [29]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_DEFAULT_PERMISSIONS"
-                      value: ""
                     }
-                  [30]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_DEVICE_AUTHORIZATION_ENDPOINT"
-                      value: "[REDACTED]"
                     }
-                  [31]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_EMAIL_FIELD"
-                      value: "sub"
                     }
-                  [32]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_ISSUER"
-                      value: "[REDACTED]"
                     }
-                  [33]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_JWKS_URI"
-                      value: "[REDACTED]"
                     }
-                  [34]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_REVOCATION_ENDPOINT"
-                      value: "[REDACTED]"
                     }
-                  [35]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_SCOPES"
-                      value: "openid profile email offline_access"
                     }
-                  [36]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_SCOPES_SUPPORTED"
-                      value: (json) [
-                          [0]: "openid"
-                          [1]: "profile"
-                          [2]: "email"
-                          [3]: "offline_access"
                         ]
                     }
-                  [37]: {
-                      name : "HAWK_API_MODEL_ACCESS_TOKEN_TOKEN_ENDPOINT"
-                      value: "[REDACTED]"
                     }
-                  [38]: {
-                      name : "HAWK_API_OTEL_TRACING_ENABLED"
-                      value: "true"
                     }
-                  [39]: {
-                      name : "HAWK_API_REFRESH_TOKEN_LIFETIME_DAYS"
-                      value: "45"
                     }
-                  [40]: {
-                      name : "HAWK_API_RELAY_URL"
-                      value: "[REDACTED]"
                     }
-                  [41]: {
-                      name : "HAWK_API_RUNNER_CLUSTER_ROLE_NAME"
-                      value: "hawk-runner"
                     }
-                  [42]: {
-                      name : "HAWK_API_RUNNER_COREDNS_IMAGE_URI"
-                      value: "public.ecr.aws/eks-distro/coredns/coredns:v1.11.4-eks-1-33-latest"
                     }
-                  [43]: {
-                      name : "HAWK_API_RUNNER_CPU_ARCHITECTURE"
-                      value: "arm64"
                     }
-                  [44]: {
-                      name : "HAWK_API_RUNNER_DEFAULT_ENV_ARN"
-                      value: "[REDACTED]"
                     }
-                  [45]: {
-                      name : "HAWK_API_RUNNER_DEFAULT_IMAGE_URI"
-                      value: "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd/inspect-ai/runner@sha256:9259f77f59b3cd74f8fa3264e43b9059726c7c0738606e2325bfb6bd3422644f"
                     }
-                  [46]: {
-                      name : "HAWK_API_RUNNER_EVAL_TASK_ARCHITECTURE"
-                      value: "amd64"
                     }
-                  [47]: {
-                      name : "HAWK_API_RUNNER_HARDENED_RUNTIME_CLASS_NAME"
-                      value: "gvisor"
                     }
-                  [48]: {
-                      name : "HAWK_API_RUNNER_MEMORY"
-                      value: "64Gi"
                     }
-                  [49]: {
-                      name : "HAWK_API_RUNNER_MEMORY_REQUEST"
-                      value: "8Gi"
                     }
-                  [50]: {
-                      name : "HAWK_API_RUNNER_NAMESPACE"
-                      value: "inspect"
                     }
-                  [51]: {
-                      name : "HAWK_API_RUNNER_NAMESPACE_PREFIX"
-                      value: "inspect"
                     }
-                  [52]: {
-                      name : "HAWK_API_RUNNER_SECRET_ARN_PATTERNS"
-                      value: (json) [
-                          [0]: "[REDACTED]"
                         ]
                     }
-                  [53]: {
-                      name : "HAWK_API_RUNNER_SECRET_DEFAULT_ARN_PREFIX"
-                      value: "[REDACTED]"
                     }
-                  [54]: {
-                      name : "HAWK_API_RUNNER_STORAGE_GRANTS"
-                      value: (json) {
-                          lmca-heldout-assets: {
-                              env       : {
-                                  LMCA_HELDOUT_ASSETS_REMOTE_URL: "[REDACTED]"
                                 }
-                              permission: "lmca-heldout-signees"
                             }
-                          task-assets        : {
-                              env       : {
-                                  TASK_ASSETS_REMOTE_URL: "[REDACTED]"
                                 }
-                              permission: "task-assets"
                             }
                         }
                     }
-                  [55]: {
-                      name : "HAWK_API_S3_BUCKET_NAME"
-                      value: "prd-metr-inspect"
                     }
-                  [56]: {
-                      name : "HAWK_API_SUBMISSION_GUARD_ENABLED"
-                      value: "false"
                     }
-                  [57]: {
-                      name : "HAWK_API_TASK_BRIDGE_REPOSITORY"
-                      value: "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd/inspect-tasks"
                     }
-                  [58]: {
-                      name : "HAWK_API_TOKEN_BROKER_URL"
-                      value: "[REDACTED]"
                     }
-                  [59]: {
-                      name : "HAWK_API_VALKEY_URL"
-                      value: "[REDACTED]"
                     }
-                  [60]: {
-                      name : "HAWK_API_VIEWER_URL"
-                      value: "[REDACTED]"
                     }
-                  [61]: {
-                      name : "HAWK_SERVICE_VERSION"
-                      value: "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd/hawk/api@sha256:62017302c2688cf8074a349f54d372f1b9906124e256e6ef14276e33124e71af"
                     }
-                  [62]: {
-                      name : "SENTRY_DSN"
-                      value: "[REDACTED]"
                     }
-                  [63]: {
-                      name : "SENTRY_ENVIRONMENT"
-                      value: "prd"
                     }
-                  [64]: {
-                      name : "UVICORN_TIMEOUT_KEEP_ALIVE"
-                      value: "75"
                     }
                 ]
-              essential             : true
-              healthCheck           : {
-                  command    : [
-                      [0]: "CMD"
-                      [1]: "python"
-                      [2]: "-c"
-                      [3]: "import urllib.request; urllib.request.urlopen('[REDACTED]', timeout=5)"
                     ]
-                  interval   : 30
-                  retries    : 5
-                  startPeriod: 90
-                  timeout    : 10
                 }
-              image                 : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd/hawk/api@sha256:62017302c2688cf8074a349f54d372f1b9906124e256e6ef14276e33124e71af"
-              logConfiguration      : {
-                  logDriver: "awslogs"
-                  options  : {
-                      awslogs-group        : "prd/hawk/api"
-                      awslogs-region       : "us-west-2"
-                      awslogs-stream-prefix: "ecs"
-                      mode                 : "non-blocking"
                     }
                 }
-              memory                : 8192
-              memoryReservation     : 100
-              mountPoints           : []
-              name                  : "api"
-              portMappings          : [
-                  [0]: {
-                      containerPort: 8080
-                      hostPort     : 8080
-                      name         : "api"
-                      protocol     : "tcp"
                     }
                 ]
-              readonlyRootFilesystem: false
-              secrets               : [
-                  [0]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_COUNT"
-                      valueFrom: "[REDACTED]"
                     }
-                  [1]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_KEY_0"
-                      valueFrom: "[REDACTED]"
                     }
-                  [2]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_KEY_1"
-                      valueFrom: "[REDACTED]"
                     }
-                  [3]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_KEY_2"
-                      valueFrom: "[REDACTED]"
                     }
-                  [4]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_VALUE_0"
-                      valueFrom: "[REDACTED]"
                     }
-                  [5]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_VALUE_1"
-                      valueFrom: "[REDACTED]"
                     }
-                  [6]: {
-                      name     : "HAWK_API_RUNNER_SECRET_GIT_CONFIG_VALUE_2"
-                      valueFrom: "[REDACTED]"
                     }
-                  [7]: {
-                      name     : "HAWK_API_SSH_ADMIN_PRIVATE_KEY"
-                      valueFrom: "[REDACTED]"
                     }
                 ]
-              systemControls        : []
-              user                  : "0"
-              volumesFrom           : []
             }
         ]
  => [unknown]

🟡 scan-importer-lambda-function · update · aws:lambda/function:Function

-      imageUri    : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd/inspect-ai/scan_importer-lambda@sha256:e37b5b9c964465904af58d13a2620a62511964abcec2aa5bea910f895d1c9a..."
+      imageUri    : [unknown]
-      lastModified: "2026-10-11T05:19:55.000+0000"

🔁 api-platform-metrics-task-def · replace · aws:ecs/taskDefinition:TaskDefinition

       containerDefinitions: (json) [
-          [0]: {
-              command               : []
-              cpu                   : 1024
-              entryPoint            : [
-                  [0]: "python"
-                  [1]: "-m"
-                  [2]: "hawk.api.platform_metrics"
                 ]
-              environment           : [
-                  [0]: {
-                      name : "AWS_REGION"
-                      value: "us-west-2"
                     }
-                  [1]: {
-                      name : "HAWK_API_KUBECONFIG"
-                      value: (json) {
-                          clusters       : [
-                              [0]: {
-                                  cluster: {
-                                      certificate-authority-data: "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURCVENDQWUyZ0F3SUJBZ0lJQWczeDVnSEY5ZFV3RFFZSktvWklodmNOQVFFTEJRQXdGVEVUTUJFR0ExVUUKQXhNS2EzVmlaWEp1WlhSbGN6QW..."
-                                      server                    : "[REDACTED]"
                                     }
-                                  name   : "eks"
                                 }
                             ]
-                          contexts       : [
-                              [0]: {
-                                  context: {
-                                      cluster  : "eks"
-                                      namespace: "inspect"
-                                      user     : "aws"
                                     }
-                                  name   : "eks"
                                 }
                             ]
-                          current-context: "eks"
-                          users          : [
-                              [0]: {
-                                  name: "aws"
-                                  user: {
-                                      exec: {
-                                          apiVersion: "client.authentication.k8s.io/v1beta1"
-                                          args      : [
-                                              [0]: "--region=us-west-2"
-                                              [1]: "eks"
-                                              [2]: "get-token"
-                                              [3]: "--cluster-name=prd"
-                                              [4]: "--output=json"
                                             ]
-                                          command   : "aws"
                                         }
                                     }
                                 }
                             ]
                         }
                     }
-                  [2]: {
-                      name : "HAWK_API_PLATFORM_METRICS_ENV"
-                      value: "prd"
                     }
-                  [3]: {
-                      name : "HAWK_API_PLATFORM_METRICS_VPC_ID"
-                      value: "vpc-039eaa8c54514334a"
                     }
-                  [4]: {
-                      name : "HAWK_API_RUNNER_NAMESPACE_PREFIX"
-                      value: "inspect"
                     }
-                  [5]: {
-                      name : "SENTRY_DSN"
-                      value: "[REDACTED]"
                     }
-                  [6]: {
-                      name : "SENTRY_ENVIRONMENT"
-                      value: "prd"
                     }
… (truncated — see the workflow run logs for the complete diff)

Full preview (including hidden churn)

Previewing update (prd):
@ previewing update....
  pulumi:pulumi:Stack: (same)
    [urn=urn:pulumi:prd::hawk::pulumi:pulumi:Stack::hawk-prd]
@ previewing update....
    +-command:local:Command: (replace)
        [id=rds-db-users8852b7b8]
        [urn=urn:pulumi:prd::hawk::metr:core:CoreStack$metr:core:Rds$command:local:Command::rds-db-users]
        [provider=urn:pulumi:prd::hawk::pulumi:providers:command::default_1_2_1::[REDACTED]]
      ~ triggers: [
          ~ [0]: "1791759098.751903" => "1791778095.3314307"
        ]
    ~ docker-build:index:Image: (update)
        [id=sha256:2e66064f33d568e6590b3c466c0ee07c080def877daba61957403ee11026be52]
        [urn=urn:pulumi:prd::hawk::metr:hawk:HawkEcr$docker-build:index:Image::ecr-runner-image]
        [provider=urn:pulumi:prd::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "876f77af9007aa26d58e705ec5887678258cbc12b71eaf7e34950c5545c8f57a"
    ~ docker-build:index:Image: (update)
        [id=sha256:6816a4bfaf8990f20e6afb5bed9e3dccc058141711525d4a6707bb9e0fd2a782]
        [urn=urn:pulumi:prd::hawk::metr:hawk:HawkStack$metr:hawk:TokenBroker$metr:hawk:DockerLambda$docker-build:index:Image::token-broker-lambda-image]
        [provider=urn:pulumi:prd::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "f3a01dfcf01630d80b44a733f3e8ad6bd62dff81ba7785fbbe8929c093fdbf0f"
    ~ docker-build:index:Image: (update)
        [id=sha256:043354010c4c798a8135d29d7eec14127da3de2c39ca103ac695272b008d46bf]
        [urn=urn:pulumi:prd::hawk::metr:hawk:HawkStack$metr:hawk:HawkImage$docker-build:index:Image::image-image]
        [provider=urn:pulumi:prd::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "876f77af9007aa26d58e705ec5887678258cbc12b71eaf7e34950c5545c8f57a"
    ~ docker-build:index:Image: (update)
        [id=sha256:5068735b4fd8cb0484817af46578cc598fbf9a5cff3f074e77ad5a16adf75805]
        [urn=urn:pulumi:prd::hawk::metr:core:Middleman$docker-build:index:Image::middleman-image]
        [provider=urn:pulumi:prd::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "243485a8fe455622fa58823d5cc573c292daa78e2bc55c8f9090e58ad3536b3e"
    ~ docker-build:index:Image: (update)
        [id=sha256:79257f2e2fd99dc6ce86f6577e76f3a541c0c11c75fc52ab2fc393fb8e912f82]
        [urn=urn:pulumi:prd::hawk::metr:hawk:HawkRelay$docker-build:index:Image::relay-image]
        [provider=urn:pulumi:prd::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "cc8789a486ce64de008a26c490e4e969dc8c1dad926e7913df04f158510710fa"
    ~ docker-build:index:Image: (update)
        [id=sha256:59b8244b71383bc83f7b960795e47fbe8b3f5ffb3a84c253ff99b0755c056d70]
        [urn=urn:pulumi:prd::hawk::metr:hawk:HawkStack$metr:hawk:SampleEditor$docker-build:index:Image::sample-editor-image]
        [provider=urn:pulumi:prd::hawk::pulumi:providers:docker-build::default_0_0_22::[REDACTED]]
      - contextHash: "dc22a96905713bc12c0c8b3af4441cf95443b23d1403baaded1184efa79d7e60"
    ~ aws:lambda/function:Function: (update)
        [id=prd-inspect-ai-token_broker]
        [urn=urn:pulumi:prd::hawk::metr:hawk:HawkStack$metr:hawk:TokenBroker$metr:hawk:DockerLambda$aws:lambda/function:Function::token-broker-lambda-function]
        [provider=urn:pulumi:prd::hawk::pulumi:providers:aws::default_7_44_0::[REDACTED]]
      ~ imageUri    : "[REDACTED].dkr.ecr.us-west-2.amazonaws.com/prd/inspect-ai/token_broker-lambda@sha256:857b440da29ed0f0c2e92da602a46286570cc5d1c8c6c068092cd3ac37d71c0..." => [unknown]
      - lastModified: "2026-10-11T05:18:13.000+0000"
… (truncated — see the workflow run logs for the complete report)

Copilot

🟡 Changes recommended

Credential refresh or proof-signing failures can bypass the intended retryable 503 handling and audit logging.

1 open finding

Convert credential refresh and signing failures to retryable auth errors · New

What changed in this PR

Moves S3 Object Lambda authorization decisions from the reader Lambda to the Hawk API.

Changes:

Signs and submits each read decision to /s3_reader/authorize.
Returns retryable 503 responses when authorization is unavailable.
Updates dependencies, tests, infrastructure, and documentation.

File	Description
`infra/tests/test_components.py`	Tests API URL wiring.
`infra/hawk/eval_log_reader.py`	Configures the reader API URL.
`infra/hawk/__init__.py`	Passes the API URL to the reader.
`hawk/uv.lock`	Updates resolved reader dependencies.
`hawk/services/modules/eval_log_reader/uv.lock`	Updates module lock dependencies.
`hawk/services/modules/eval_log_reader/tests/test_eval_log_reader.py`	Tests API authorization and failure handling.
`hawk/services/modules/eval_log_reader/pyproject.toml`	Replaces obsolete dependencies.
`hawk/services/modules/eval_log_reader/eval_log_reader/index.py`	Delegates authorization to the API.
`hawk/AGENTS.md`	Updates system-flow documentation.
`docs/infrastructure/security.md`	Documents the authorization boundary.
`docs/infrastructure/architecture.md`	Updates the Object Lambda flow.

🧠 Review effort: Balanced

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

+    proof = aws_caller_proof.sign(
+        credentials.get_frozen_credentials(),


Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

Dismissed because a newer commit was pushed; Greptile will re-review the current head.

jackmisbach and others added 5 commits October 11, 2026 13:51

docs: audit S3 Object Lambda reads under the endpoint now deciding them

9d39dff

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

jackmisbach requested a review from a team as a code owner October 11, 2026 20:55

jackmisbach requested review from tbroadley and removed request for a team October 11, 2026 20:55

greptile-apps Bot previously approved these changes Oct 11, 2026

View reviewed changes

jackmisbach requested a balanced review from Copilot October 11, 2026 21:13

jackmisbach added this pull request to stack #2119 October 11, 2026 21:14

jackmisbach deployed to tst-pulumi-preview October 11, 2026 21:14 — with GitHub Actions Active

jackmisbach deployed to prd-pulumi-preview October 11, 2026 21:14 — with GitHub Actions Active

jackmisbach mentioned this pull request Oct 11, 2026

chore: remove the S3 reader Lambda's unused grants #2120

Open

5 tasks done

jackmisbach requested review from QuantumLove and removed request for tbroadley October 11, 2026 21:23

Copilot started reviewing on behalf of jackmisbach October 11, 2026 21:24 View session

Copilot AI reviewed Oct 11, 2026

View reviewed changes

Comment thread hawk/services/modules/eval_log_reader/eval_log_reader/index.py

Comment on lines +167 to +168

proof = aws_caller_proof.sign(

credentials.get_frozen_credentials(),

This was referenced Oct 11, 2026

feat: add the S3 reader authorization endpoint to the API #2115

Open

feat: enforce code access for runs and results #1871

Draft

docs: show the reader Lambda asking the API in the architecture diagram

06b04fd

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

jackmisbach requested a review from a team as a code owner October 12, 2026 04:05

jackmisbach deployed to prd-pulumi-preview October 12, 2026 04:05 — with GitHub Actions Active

jackmisbach deployed to tst-pulumi-preview October 12, 2026 04:05 — with GitHub Actions Active

Navigation Menu

Repository navigation

feat: have the S3 Object Lambda reader ask the API - #2118

feat: have the S3 Object Lambda reader ask the API#2118
jackmisbach wants to merge 6 commits into
jackmisbach/s3-reader-1-apifrom
jackmisbach/s3-reader-2-lambda

jackmisbach commented Oct 11, 2026 •

edited

Loading

Uh oh!

greptile-apps Bot commented Oct 11, 2026 •

edited

Loading

Diagram

Uh oh!

github-actions Bot commented Oct 11, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Oct 11, 2026 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

This branch was successfully deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

		proof = aws_caller_proof.sign(
		credentials.get_frozen_credentials(),

Conversation

jackmisbach commented Oct 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview

Approach

Risks

Testing & validation

Code quality

Before merging

Uh oh!

greptile-apps Bot commented Oct 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Confidence Score: 5/5

Summary

Diagram

Uh oh!

github-actions Bot commented Oct 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🥥 preview on hawk/tst

Uh oh!

github-actions Bot commented Oct 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🥥 preview on hawk/prd

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

🟡 Changes recommended

Uh oh!

This branch was successfully deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

jackmisbach commented Oct 11, 2026 •

edited

Loading

greptile-apps Bot commented Oct 11, 2026 •

edited

Loading

github-actions Bot commented Oct 11, 2026 •

edited

Loading

🥥 `preview` on hawk/tst

github-actions Bot commented Oct 11, 2026 •

edited

Loading

🥥 `preview` on hawk/prd