Skip to content

Add Windows/ECS/on-prem integration tests for OTLP, host_metrics, and Prometheus - #725

Open
Paamicky wants to merge 9 commits into
mainfrom
mcommey/otlp-integration-tests
Open

Add Windows/ECS/on-prem integration tests for OTLP, host_metrics, and Prometheus#725
Paamicky wants to merge 9 commits into
mainfrom
mcommey/otlp-integration-tests

Conversation

@Paamicky

@Paamicky Paamicky commented Jul 17, 2026

Copy link
Copy Markdown
Contributor

Description of the issue

Integration testing gaps exist for OTel components publishing to the OTLP endpoint across multiple platforms. Specifically: Windows, on-prem, and ECS have no coverage for OTLP, Prometheus, or Host Metrics. Log and Traces have been added to the existing OTLP test (which was metrics only). Also, new features (root-level cluster_name, collection_interval standardization, Prometheus $1/${1} escape) need integration test coverage.

Description of changes

  • Restructured otel_collect/ tests into linux/ and windows/ subdirectories for consistent platform organization
  • Added Windows integration tests for OTLP, Host Metrics, and Prometheus using the validator pattern
  • Added OTLP, Host Metrics, and Prometheus to on-prem (ec2_linux_onprem) test matrix
  • Added OTLP to ECS (ecs_ec2_daemon) test matrix
  • Updated all agent configs to include cluster_name and collection_interval for new feature validation
  • Added $1 and ${1} relabel configs to Prometheus scrape configs to validate dollar escape handling
  • Updated generator entries and partition exclusions to reflect new directory structure

Note

OTLP tests validate in us-east-2. OTLP traces are sent to CloudWatch Logs (Transaction Search) instead of XRay, which conflicts with the XRay tests in us-west-2, so OTLP runs in us-east-2 (CWL destination) while XRay stays on us-west-2. The agent sends data to us-east-2 and the validators query there, while the instance still runs in us-west-2. host_metrics, prometheus, DBI, and ECS stay in us-west-2

License

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Tests

  • All generator code compiles
  • All Linux test code compiles
  • Tests cover: EC2 Linux, Windows, on-prem, ECS, and EKS (existing) platforms
  • Features validated: OTLP endpoint publishing, cluster_name propagation, collection_interval, Prometheus $1/${1} escape
  • All integration for otel_collect passes otel_collect integ test

@Paamicky
Paamicky force-pushed the mcommey/otlp-integration-tests branch 3 times, most recently from 1c13e55 to 77ab553 Compare July 22, 2026 15:15
@Paamicky Paamicky changed the title Add test for otlp publishing components Add Windows/ECS/on-prem integration tests for OTLP, host_metrics, and Prometheus Jul 22, 2026
@Paamicky
Paamicky force-pushed the mcommey/otlp-integration-tests branch from 487c4ae to 77ab553 Compare July 22, 2026 15:58
@Paamicky Paamicky self-assigned this Jul 22, 2026
@Paamicky
Paamicky force-pushed the mcommey/otlp-integration-tests branch from 77ab553 to 70c0f64 Compare July 22, 2026 17:17
@Paamicky
Paamicky force-pushed the mcommey/otlp-integration-tests branch 4 times, most recently from 9b5188d to 7d0b2d5 Compare July 23, 2026 15:27
@Paamicky
Paamicky force-pushed the mcommey/otlp-integration-tests branch 6 times, most recently from 9de90fb to a878d9e Compare July 24, 2026 17:09
@Paamicky
Paamicky force-pushed the mcommey/otlp-integration-tests branch 4 times, most recently from d47df92 to bd8737a Compare July 27, 2026 13:48
@Paamicky
Paamicky force-pushed the mcommey/otlp-integration-tests branch 2 times, most recently from 20f02a7 to a67d4d4 Compare July 27, 2026 16:08
@Paamicky
Paamicky force-pushed the mcommey/otlp-integration-tests branch 4 times, most recently from 2bda6a1 to b8f09d5 Compare July 28, 2026 02:50
@Paamicky
Paamicky force-pushed the mcommey/otlp-integration-tests branch from b8f09d5 to 3ac3615 Compare July 28, 2026 03:17
@Paamicky
Paamicky force-pushed the mcommey/otlp-integration-tests branch from 854c1fa to 1d9247a Compare July 28, 2026 18:16
@Paamicky
Paamicky marked this pull request as ready for review July 28, 2026 20:01
@Paamicky
Paamicky requested a review from a team as a code owner July 28, 2026 20:01
@Paamicky
Paamicky requested review from JayPolanco and sky333999 July 28, 2026 20:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant