Skip to content

[test optimization] Use duration buckets for cucumber EFD retries#8287

Merged
juan-fernandez merged 11 commits into
masterfrom
juan-fernandez/efd-duration-retries-cucumber
May 7, 2026
Merged

[test optimization] Use duration buckets for cucumber EFD retries#8287
juan-fernandez merged 11 commits into
masterfrom
juan-fernandez/efd-duration-retries-cucumber

Conversation

@juan-fernandez
Copy link
Copy Markdown
Collaborator

@juan-fernandez juan-fernandez commented May 6, 2026

What does this PR do?

Updates Cucumber Early Flake Detection rerun scheduling to use the slow_test_retries duration buckets returned by the settings API.

Propagates the retry thresholds to Cucumber workers, and marks tests with test.early_flake.abort_reason=slow when the selected bucket aborts additional retries.

Motivation

Jest and Mocha already limit EFD retry attempts based on the duration of the first test execution. Cucumber should apply the same API-driven retry bucket behavior so slow tests do not keep scheduling unnecessary EFD retries.

Additional Notes

Stack: 2/5. This is now the base PR for the remaining framework PRs after #8286 merged.

@codecov
Copy link
Copy Markdown

codecov Bot commented May 6, 2026

Codecov Report

❌ Patch coverage is 90.90909% with 5 lines in your changes missing coverage. Please review.
✅ Project coverage is 89.70%. Comparing base (6c0da23) to head (243e343).
⚠️ Report is 2 commits behind head on master.

Files with missing lines Patch % Lines
packages/datadog-instrumentations/src/cucumber.js 90.56% 5 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #8287      +/-   ##
==========================================
- Coverage   89.74%   89.70%   -0.04%     
==========================================
  Files         836      836              
  Lines       44375    44425      +50     
  Branches     8163     8183      +20     
==========================================
+ Hits        39823    39853      +30     
- Misses       4552     4572      +20     
Flag Coverage Δ
aiguard-integration-active 40.57% <ø> (ø)
aiguard-integration-latest 40.52% <ø> (ø)
aiguard-integration-maintenance 40.57% <ø> (ø)
aiguard-macos 35.26% <ø> (-0.09%) ⬇️
aiguard-ubuntu 35.36% <ø> (-0.09%) ⬇️
aiguard-windows 35.17% <ø> (-0.09%) ⬇️
apm-capabilities-tracing-macos 49.09% <0.00%> (-0.01%) ⬇️
apm-capabilities-tracing-ubuntu-active 49.12% <0.00%> (-0.01%) ⬇️
apm-capabilities-tracing-ubuntu-latest 49.09% <0.00%> (-0.01%) ⬇️
apm-capabilities-tracing-ubuntu-maintenance 49.30% <0.00%> (-0.01%) ⬇️
apm-capabilities-tracing-ubuntu-oldest 49.10% <0.00%> (-0.19%) ⬇️
apm-capabilities-tracing-windows 48.92% <0.00%> (-0.15%) ⬇️
apm-integrations-aerospike-18-gte.5.2.0 34.25% <ø> (-0.09%) ⬇️
apm-integrations-aerospike-20-gte.5.5.0 34.27% <ø> (-0.09%) ⬇️
apm-integrations-aerospike-22-gte.5.12.1 34.27% <ø> (-0.09%) ⬇️
apm-integrations-aerospike-22-gte.6.0.0 34.27% <ø> (-0.09%) ⬇️
apm-integrations-aerospike-eol- 34.17% <ø> (-0.09%) ⬇️
apm-integrations-child-process 35.28% <ø> (-0.09%) ⬇️
apm-integrations-confluentinc-kafka-javascript-18 41.13% <ø> (-0.09%) ⬇️
apm-integrations-confluentinc-kafka-javascript-20 41.15% <ø> (-0.09%) ⬇️
apm-integrations-confluentinc-kafka-javascript-22 41.15% <ø> (-0.09%) ⬇️
apm-integrations-confluentinc-kafka-javascript-24 41.08% <ø> (-0.09%) ⬇️
apm-integrations-couchbase-18 34.44% <ø> (-0.09%) ⬇️
apm-integrations-couchbase-eol 34.57% <ø> (ø)
apm-integrations-dns 34.16% <ø> (-0.09%) ⬇️
apm-integrations-elasticsearch 34.91% <ø> (-0.08%) ⬇️
apm-integrations-http-latest 42.08% <ø> (-0.08%) ⬇️
apm-integrations-http-maintenance 42.14% <ø> (-0.08%) ⬇️
apm-integrations-http-oldest 42.15% <ø> (-0.08%) ⬇️
apm-integrations-http2 39.61% <ø> (+0.02%) ⬆️
apm-integrations-kafkajs-latest 41.03% <ø> (-0.09%) ⬇️
apm-integrations-kafkajs-oldest 41.08% <ø> (-0.08%) ⬇️
apm-integrations-net 34.86% <ø> (-0.09%) ⬇️
apm-integrations-next-11.1.4 29.29% <ø> (-0.08%) ⬇️
apm-integrations-next-13.2.0 30.73% <ø> (-0.08%) ⬇️
apm-integrations-next-gte.10.2.0.and.lt.11 23.10% <ø> (ø)
apm-integrations-next-gte.11.0.0.and.lt.13 30.74% <ø> (-0.08%) ⬇️
apm-integrations-next-gte.13.0.0.and.lt.14 30.99% <ø> (-0.08%) ⬇️
apm-integrations-next-gte.14.0.0.and.lte.14.2.6 30.80% <ø> (-0.08%) ⬇️
apm-integrations-next-gte.14.2.7.and.lt.15 30.80% <ø> (-0.08%) ⬇️
apm-integrations-next-gte.15.0.0 30.87% <ø> (-0.08%) ⬇️
apm-integrations-oracledb 34.54% <ø> (-0.09%) ⬇️
apm-integrations-prisma-18-gte.6.16.0.and.lt.7.0.0 34.87% <ø> (-0.08%) ⬇️
apm-integrations-prisma-latest-all 35.19% <ø> (-0.08%) ⬇️
apm-integrations-restify 36.34% <ø> (-0.09%) ⬇️
apm-integrations-sharedb 33.84% <ø> (-0.09%) ⬇️
apm-integrations-tedious 34.34% <ø> (-0.09%) ⬇️
appsec-express 51.94% <ø> (-0.04%) ⬇️
appsec-fastify 48.60% <ø> (-0.07%) ⬇️
appsec-graphql 48.90% <ø> (-0.06%) ⬇️
appsec-integration-active 37.25% <9.43%> (-0.05%) ⬇️
appsec-integration-latest 37.22% <9.43%> (-0.05%) ⬇️
appsec-integration-maintenance 37.24% <9.43%> (-0.05%) ⬇️
appsec-integration-oldest 37.24% <9.43%> (-0.05%) ⬇️
appsec-kafka 41.47% <ø> (-0.03%) ⬇️
appsec-ldapjs 40.67% <ø> (-0.07%) ⬇️
appsec-lodash 40.78% <ø> (-0.07%) ⬇️
appsec-macos 55.75% <ø> (-0.07%) ⬇️
appsec-mongodb-core 45.05% <ø> (-0.08%) ⬇️
appsec-mongoose 45.94% <ø> (-0.07%) ⬇️
appsec-mysql 47.95% <ø> (-0.07%) ⬇️
appsec-next-latest-11.1.4 29.41% <ø> (-0.08%) ⬇️
appsec-next-latest-13.2.0 30.87% <ø> (-0.09%) ⬇️
appsec-next-latest-gte.10.2.0.and.lt.11 28.71% <ø> (ø)
appsec-next-latest-gte.11.0.0.and.lt.13 30.86% <ø> (-0.09%) ⬇️
appsec-next-latest-gte.13.0.0.and.lt.14 31.10% <ø> (-0.08%) ⬇️
appsec-next-latest-gte.14.0.0.and.lte.14.2.6 30.94% <ø> (-0.09%) ⬇️
appsec-next-latest-gte.14.2.7.and.lt.15 30.94% <ø> (-0.09%) ⬇️
appsec-next-latest-gte.15.0.0 30.94% <ø> (-0.09%) ⬇️
appsec-next-oldest-11.1.4 29.42% <ø> (-0.09%) ⬇️
appsec-next-oldest-13.2.0 31.15% <ø> (-0.09%) ⬇️
appsec-next-oldest-gte.10.2.0.and.lt.11 28.84% <ø> (ø)
appsec-next-oldest-gte.11.0.0.and.lt.13 30.87% <ø> (-0.09%) ⬇️
appsec-next-oldest-gte.13.0.0.and.lt.14 31.34% <ø> (-0.08%) ⬇️
appsec-next-oldest-gte.14.0.0.and.lte.14.2.6 31.19% <ø> (-0.09%) ⬇️
appsec-next-oldest-gte.14.2.7.and.lt.15 31.19% <ø> (-0.09%) ⬇️
appsec-next-oldest-gte.15.0.0 31.19% <ø> (-0.09%) ⬇️
appsec-node-serialize 40.00% <ø> (-0.07%) ⬇️
appsec-passport 43.62% <ø> (-0.08%) ⬇️
appsec-postgres 47.50% <ø> (-0.07%) ⬇️
appsec-sourcing 39.34% <ø> (-0.07%) ⬇️
appsec-stripe 41.40% <ø> (-0.08%) ⬇️
appsec-template 40.16% <ø> (-0.07%) ⬇️
appsec-ubuntu 55.82% <ø> (-0.07%) ⬇️
appsec-windows 55.67% <ø> (-0.08%) ⬇️
debugger-ubuntu-active 43.19% <ø> (ø)
debugger-ubuntu-latest 43.14% <ø> (ø)
debugger-ubuntu-maintenance 43.21% <ø> (-0.43%) ⬇️
debugger-ubuntu-oldest 43.64% <ø> (ø)
instrumentations-instrumentation-bluebird 29.28% <ø> (-0.09%) ⬇️
instrumentations-instrumentation-body-parser 36.88% <ø> (-0.08%) ⬇️
instrumentations-instrumentation-child_process 34.77% <ø> (-0.09%) ⬇️
instrumentations-instrumentation-cookie-parser 31.10% <ø> (-0.08%) ⬇️
instrumentations-instrumentation-express 31.32% <ø> (-0.08%) ⬇️
instrumentations-instrumentation-express-mongo-sanitize 31.22% <ø> (-0.08%) ⬇️
instrumentations-instrumentation-express-session 36.57% <ø> (-0.08%) ⬇️
instrumentations-instrumentation-fs 28.97% <ø> (-0.09%) ⬇️
instrumentations-instrumentation-generic-pool 29.88% <ø> (ø)
instrumentations-instrumentation-http 36.24% <ø> (-0.09%) ⬇️
instrumentations-instrumentation-knex 29.25% <ø> (-0.09%) ⬇️
instrumentations-instrumentation-light-my-request 36.51% <ø> (-0.08%) ⬇️
instrumentations-instrumentation-mongoose 30.31% <ø> (-0.08%) ⬇️
instrumentations-instrumentation-multer 36.67% <ø> (-0.08%) ⬇️
instrumentations-instrumentation-mysql2 34.76% <ø> (-0.09%) ⬇️
instrumentations-instrumentation-passport 40.25% <ø> (-0.08%) ⬇️
instrumentations-instrumentation-passport-http 40.04% <ø> (-0.08%) ⬇️
instrumentations-instrumentation-passport-local 40.53% <ø> (-0.08%) ⬇️
instrumentations-instrumentation-pg 34.31% <ø> (-0.09%) ⬇️
instrumentations-instrumentation-promise 29.22% <ø> (-0.09%) ⬇️
instrumentations-instrumentation-promise-js 29.22% <ø> (-0.09%) ⬇️
instrumentations-instrumentation-q 29.25% <ø> (-0.09%) ⬇️
instrumentations-instrumentation-url 29.22% <ø> (-0.09%) ⬇️
instrumentations-instrumentation-when 29.23% <ø> (-0.09%) ⬇️
instrumentations-integration-esbuild-active 19.49% <9.43%> (-0.03%) ⬇️
instrumentations-integration-esbuild-latest 19.47% <9.43%> (-0.03%) ⬇️
instrumentations-integration-esbuild-maintenance 19.49% <9.43%> (-0.03%) ⬇️
instrumentations-integration-esbuild-oldest 19.48% <9.43%> (-0.03%) ⬇️
llmobs-ai 37.72% <ø> (-0.08%) ⬇️
llmobs-anthropic 37.77% <ø> (-0.08%) ⬇️
llmobs-bedrock 36.45% <ø> (-0.08%) ⬇️
llmobs-google-genai 36.79% <ø> (-0.08%) ⬇️
llmobs-langchain 36.52% <ø> (-0.17%) ⬇️
llmobs-openai 40.54% <ø> (-0.08%) ⬇️
llmobs-sdk-active 45.35% <ø> (-0.09%) ⬇️
llmobs-sdk-latest 45.29% <ø> (-0.09%) ⬇️
llmobs-sdk-maintenance 45.35% <ø> (-0.09%) ⬇️
llmobs-sdk-oldest 45.34% <ø> (-0.09%) ⬇️
llmobs-vertex-ai 36.95% <ø> (-0.08%) ⬇️
openfeature-macos 37.89% <ø> (-0.07%) ⬇️
openfeature-ubuntu 38.02% <ø> (ø)
openfeature-unit-active 48.62% <ø> (ø)
openfeature-unit-latest 48.46% <ø> (ø)
openfeature-unit-maintenance 48.62% <ø> (ø)
openfeature-unit-oldest 48.62% <ø> (ø)
openfeature-windows 37.82% <ø> (-0.01%) ⬇️
platform-core 37.45% <ø> (ø)
platform-esbuild 40.80% <ø> (ø)
platform-instrumentations-misc 30.71% <ø> (ø)
platform-integration-active 46.94% <ø> (-0.01%) ⬇️
platform-integration-latest 46.91% <ø> (ø)
platform-integration-maintenance 46.96% <ø> (ø)
platform-integration-oldest 47.13% <ø> (ø)
platform-shimmer 42.46% <ø> (ø)
platform-unit-guardrails 36.24% <ø> (ø)
platform-webpack 20.59% <11.11%> (-0.02%) ⬇️
plugins-azure-durable-functions 36.78% <ø> (-0.17%) ⬇️
plugins-azure-event-hubs 34.79% <ø> (ø)
plugins-azure-service-bus 35.24% <ø> (ø)
plugins-bullmq 40.17% <ø> (+0.03%) ⬆️
plugins-cassandra 34.68% <ø> (+0.04%) ⬆️
plugins-cookie 26.66% <ø> (ø)
plugins-cookie-parser 26.47% <ø> (ø)
plugins-crypto 27.72% <ø> (ø)
plugins-dd-trace-api 34.70% <ø> (-0.09%) ⬇️
plugins-express-mongo-sanitize 26.60% <ø> (ø)
plugins-express-session 26.43% <ø> (ø)
plugins-fastify 38.66% <ø> (-0.08%) ⬇️
plugins-fetch 34.99% <ø> (-0.08%) ⬇️
plugins-fs 35.05% <ø> (-0.09%) ⬇️
plugins-generic-pool 25.58% <ø> (ø)
plugins-google-cloud-pubsub 42.37% <ø> (-0.08%) ⬇️
plugins-grpc 37.41% <ø> (-0.08%) ⬇️
plugins-handlebars 26.64% <ø> (ø)
plugins-hapi 36.55% <ø> (-0.09%) ⬇️
plugins-hono 36.83% <ø> (-0.08%) ⬇️
plugins-ioredis ?
plugins-knex 26.32% <ø> (ø)
plugins-langgraph 34.41% <ø> (-0.09%) ⬇️
plugins-ldapjs 24.20% <ø> (ø)
plugins-light-my-request 26.06% <ø> (ø)
plugins-limitd-client 29.52% <ø> (-0.15%) ⬇️
plugins-lodash 25.66% <ø> (ø)
plugins-mariadb 36.04% <ø> (-0.09%) ⬇️
plugins-memcached 34.79% <ø> (-0.09%) ⬇️
plugins-microgateway-core 35.67% <ø> (-0.09%) ⬇️
plugins-modelcontextprotocol-sdk 33.69% <ø> (-0.09%) ⬇️
plugins-moleculer 37.50% <ø> (-0.09%) ⬇️
plugins-mongodb 35.93% <ø> (-0.08%) ⬇️
plugins-mongodb-core 35.59% <ø> (-0.06%) ⬇️
plugins-mongoose 35.47% <ø> (-0.08%) ⬇️
plugins-multer 26.43% <ø> (ø)
plugins-mysql 35.52% <ø> (-0.22%) ⬇️
plugins-mysql2 35.81% <ø> (-0.09%) ⬇️
plugins-node-serialize 26.70% <ø> (ø)
plugins-opensearch 34.42% <ø> (-0.09%) ⬇️
plugins-passport-http 26.48% <ø> (ø)
plugins-pino 31.24% <ø> (-0.09%) ⬇️
plugins-postgres 33.75% <ø> (-0.07%) ⬇️
plugins-process 27.72% <ø> (ø)
plugins-pug 26.66% <ø> (ø)
plugins-redis 35.20% <ø> (-0.03%) ⬇️
plugins-router 39.00% <ø> (-0.08%) ⬇️
plugins-sequelize 25.36% <ø> (ø)
plugins-test-and-upstream-amqp10 35.03% <ø> (-0.09%) ⬇️
plugins-test-and-upstream-amqplib 40.27% <ø> (-0.09%) ⬇️
plugins-test-and-upstream-apollo 35.88% <ø> (-0.08%) ⬇️
plugins-test-and-upstream-avsc 34.37% <ø> (-0.09%) ⬇️
plugins-test-and-upstream-bunyan 30.60% <ø> (-0.09%) ⬇️
plugins-test-and-upstream-connect 37.21% <ø> (-0.09%) ⬇️
plugins-test-and-upstream-graphql 36.82% <ø> (-0.09%) ⬇️
plugins-test-and-upstream-koa 36.81% <ø> (-0.08%) ⬇️
plugins-test-and-upstream-protobufjs 34.58% <ø> (-0.09%) ⬇️
plugins-test-and-upstream-rhea 40.29% <ø> (-0.09%) ⬇️
plugins-undici 35.71% <ø> (-0.08%) ⬇️
plugins-url 27.72% <ø> (ø)
plugins-valkey 34.80% <ø> (-0.09%) ⬇️
plugins-vm 27.72% <ø> (ø)
plugins-winston 31.10% <ø> (-0.09%) ⬇️
plugins-ws 38.34% <ø> (-0.08%) ⬇️
profiling-macos 42.79% <ø> (-0.02%) ⬇️
profiling-ubuntu 43.10% <ø> (-0.12%) ⬇️
profiling-windows 39.97% <ø> (-0.07%) ⬇️
serverless-aws-sdk-latest-aws-sdk 34.72% <ø> (-0.07%) ⬇️
serverless-aws-sdk-latest-bedrockruntime 33.24% <ø> (-0.08%) ⬇️
serverless-aws-sdk-latest-client 22.27% <ø> (ø)
serverless-aws-sdk-latest-dynamodb 35.66% <ø> (-0.08%) ⬇️
serverless-aws-sdk-latest-eventbridge 28.77% <ø> (-0.08%) ⬇️
serverless-aws-sdk-latest-kinesis 38.60% <ø> (-0.08%) ⬇️
serverless-aws-sdk-latest-lambda 35.81% <ø> (-0.08%) ⬇️
serverless-aws-sdk-latest-s3 33.81% <ø> (-0.08%) ⬇️
serverless-aws-sdk-latest-serverless-peer-service 40.00% <ø> (-0.09%) ⬇️
serverless-aws-sdk-latest-sns 39.81% <ø> (-0.07%) ⬇️
serverless-aws-sdk-latest-sqs 38.95% <ø> (-0.08%) ⬇️
serverless-aws-sdk-latest-stepfunctions 34.40% <ø> (-0.08%) ⬇️
serverless-aws-sdk-latest-util 47.70% <ø> (ø)
serverless-aws-sdk-oldest-aws-sdk 34.78% <ø> (-0.07%) ⬇️
serverless-aws-sdk-oldest-bedrockruntime 33.28% <ø> (-0.08%) ⬇️
serverless-aws-sdk-oldest-client 22.65% <ø> (ø)
serverless-aws-sdk-oldest-dynamodb 35.70% <ø> (-0.08%) ⬇️
serverless-aws-sdk-oldest-eventbridge 28.81% <ø> (-0.08%) ⬇️
serverless-aws-sdk-oldest-kinesis 38.72% <ø> (-0.08%) ⬇️
serverless-aws-sdk-oldest-lambda 35.86% <ø> (-0.08%) ⬇️
serverless-aws-sdk-oldest-s3 33.87% <ø> (-0.08%) ⬇️
serverless-aws-sdk-oldest-serverless-peer-service 40.06% <ø> (-0.09%) ⬇️
serverless-aws-sdk-oldest-sns 39.99% <ø> (-0.08%) ⬇️
serverless-aws-sdk-oldest-sqs 39.01% <ø> (-0.08%) ⬇️
serverless-aws-sdk-oldest-stepfunctions 34.45% <ø> (-0.08%) ⬇️
serverless-aws-sdk-oldest-util 48.02% <ø> (ø)
serverless-azure-functions-eventhubs 38.43% <ø> (ø)
serverless-azure-functions-servicebus 38.49% <ø> (ø)
serverless-lambda 32.80% <ø> (-0.08%) ⬇️
test-optimization-cucumber-latest-7.0.0 50.22% <60.00%> (+0.16%) ⬆️
test-optimization-cucumber-latest-latest 52.94% <90.90%> (+0.28%) ⬆️
test-optimization-cucumber-oldest-7.0.0 50.25% <60.00%> (+0.19%) ⬆️
test-optimization-cypress-latest-12.0.0-commonJS 48.24% <ø> (+0.07%) ⬆️
test-optimization-cypress-latest-12.0.0-esm 48.25% <ø> (+0.05%) ⬆️
test-optimization-cypress-latest-14.5.4-commonJS 48.07% <ø> (+0.07%) ⬆️
test-optimization-cypress-latest-14.5.4-esm 48.10% <ø> (+0.05%) ⬆️
test-optimization-cypress-latest-latest-commonJS 48.57% <ø> (+0.07%) ⬆️
test-optimization-cypress-latest-latest-esm 48.62% <ø> (-0.02%) ⬇️
test-optimization-cypress-oldest-12.0.0-commonJS 48.26% <ø> (+0.07%) ⬆️
test-optimization-cypress-oldest-12.0.0-esm 48.29% <ø> (+0.07%) ⬆️
test-optimization-cypress-oldest-14.5.4-commonJS 48.11% <ø> (+0.07%) ⬆️
test-optimization-cypress-oldest-14.5.4-esm 48.14% <ø> (+0.07%) ⬆️
test-optimization-jest-latest-latest 54.36% <ø> (+0.08%) ⬆️
test-optimization-jest-latest-oldest 53.50% <ø> (+0.05%) ⬆️
test-optimization-jest-oldest-latest 54.37% <ø> (+0.08%) ⬆️
test-optimization-jest-oldest-oldest 53.46% <ø> (+0.08%) ⬆️
test-optimization-mocha-latest-latest 53.18% <ø> (+0.08%) ⬆️
test-optimization-mocha-latest-oldest 50.80% <ø> (+0.08%) ⬆️
test-optimization-mocha-oldest-latest 53.25% <ø> (+0.08%) ⬆️
test-optimization-mocha-oldest-oldest 50.74% <ø> (+0.06%) ⬆️
test-optimization-playwright-latest-latest-playwright-active-test-span 43.66% <ø> (+0.28%) ⬆️
test-optimization-playwright-latest-latest-playwright-atr 42.41% <ø> (+0.11%) ⬆️
test-optimization-playwright-latest-latest-playwright-efd 42.67% <ø> (+0.09%) ⬆️
test-optimization-playwright-latest-latest-playwright-final-status 42.88% <ø> (+0.08%) ⬆️
test-optimization-playwright-latest-latest-playwright-impacted-tests 42.30% <ø> (ø)
test-optimization-playwright-latest-latest-playwright-reporting 42.45% <ø> (+0.09%) ⬆️
test-optimization-playwright-latest-latest-playwright-test-management 44.39% <ø> (+0.10%) ⬆️
test-optimization-playwright-latest-oldest-playwright-active-test-span 43.69% <ø> (+0.28%) ⬆️
test-optimization-playwright-latest-oldest-playwright-atr 42.59% <ø> (+0.11%) ⬆️
test-optimization-playwright-latest-oldest-playwright-efd 42.69% <ø> (+0.09%) ⬆️
test-optimization-playwright-latest-oldest-playwright-final-status 42.92% <ø> (+0.14%) ⬆️
test-optimization-playwright-latest-oldest-playwright-impacted-tests 42.32% <ø> (ø)
test-optimization-playwright-latest-oldest-playwright-reporting 42.49% <ø> (+0.09%) ⬆️
test-optimization-playwright-latest-oldest-playwright-test-management 44.44% <ø> (+0.11%) ⬆️
test-optimization-playwright-oldest-latest-playwright-active-test-span 43.69% <ø> (+0.28%) ⬆️
test-optimization-playwright-oldest-latest-playwright-atr 42.44% <ø> (+0.11%) ⬆️
test-optimization-playwright-oldest-latest-playwright-efd 42.69% <ø> (+0.09%) ⬆️
test-optimization-playwright-oldest-latest-playwright-final-status 42.91% <ø> (+0.11%) ⬆️
test-optimization-playwright-oldest-latest-playwright-impacted-tests 42.35% <ø> (ø)
test-optimization-playwright-oldest-latest-playwright-reporting 42.46% <ø> (+0.09%) ⬆️
test-optimization-playwright-oldest-latest-playwright-test-management 44.40% <ø> (+0.10%) ⬆️
test-optimization-playwright-oldest-oldest-playwright-active-test-span 43.73% <ø> (+0.28%) ⬆️
test-optimization-playwright-oldest-oldest-playwright-atr 42.63% <ø> (+0.11%) ⬆️
test-optimization-playwright-oldest-oldest-playwright-efd 42.70% <ø> (+0.09%) ⬆️
test-optimization-playwright-oldest-oldest-playwright-final-status 42.94% <ø> (+0.11%) ⬆️
test-optimization-playwright-oldest-oldest-playwright-impacted-tests 42.36% <ø> (ø)
test-optimization-playwright-oldest-oldest-playwright-reporting 42.50% <ø> (+0.09%) ⬆️
test-optimization-playwright-oldest-oldest-playwright-test-management 44.45% <ø> (+0.11%) ⬆️
test-optimization-selenium-latest 45.47% <34.54%> (+0.04%) ⬆️
test-optimization-selenium-oldest 44.95% <ø> (+0.07%) ⬆️
test-optimization-testopt-active 47.08% <34.54%> (+0.11%) ⬆️
test-optimization-testopt-latest 47.04% <34.54%> (+0.11%) ⬆️
test-optimization-testopt-maintenance 47.08% <34.54%> (+0.11%) ⬆️
test-optimization-testopt-oldest 47.87% <ø> (+0.15%) ⬆️
test-optimization-vitest-latest 50.69% <ø> (+0.11%) ⬆️
test-optimization-vitest-oldest 47.40% <ø> (+0.33%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Overall package size

Self size: 5.77 MB
Deduped: 6.61 MB
No deduping: 6.61 MB

Dependency sizes | name | version | self size | total size | |------|---------|-----------|------------| | import-in-the-middle | 3.0.1 | 82.56 kB | 817.39 kB | | dc-polyfill | 0.1.10 | 26.73 kB | 26.73 kB |

🤖 This report was automatically generated by heaviest-objects-in-the-universe

@datadog-prod-us1-5
Copy link
Copy Markdown

datadog-prod-us1-5 Bot commented May 6, 2026

Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

🎯 Code Coverage (details)
Patch Coverage: 79.59%
Overall Coverage: 86.59% (-0.01%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 243e343 | Docs | Datadog PR Page | Give us feedback!

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented May 6, 2026

Benchmarks

Benchmark execution time: 2026-05-07 15:33:39

Comparing candidate commit 243e343 in PR branch juan-fernandez/efd-duration-retries-cucumber with baseline commit 6c0da23 in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 1755 metrics, 89 unstable metrics.

Base automatically changed from juan-fernandez/efd-duration-retries-mocha to master May 7, 2026 15:06
@juan-fernandez juan-fernandez changed the title fix(ci-visibility): use duration buckets for cucumber EFD retries [test optimization] Use duration buckets for cucumber EFD retries May 7, 2026
@juan-fernandez juan-fernandez marked this pull request as ready for review May 7, 2026 15:09
@juan-fernandez juan-fernandez requested a review from a team as a code owner May 7, 2026 15:09
@juan-fernandez juan-fernandez enabled auto-merge (squash) May 7, 2026 15:16
@juan-fernandez juan-fernandez merged commit 8d64c6e into master May 7, 2026
906 of 907 checks passed
@juan-fernandez juan-fernandez deleted the juan-fernandez/efd-duration-retries-cucumber branch May 7, 2026 15:47
@dd-octo-sts dd-octo-sts Bot mentioned this pull request May 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants