Skip to content

feat: support disabling monitoring for RootSync and RepoSync - #2233

Merged
google-oss-prow[bot] merged 1 commit into
GoogleContainerTools:mainfrom
cowsking:feat/disable-monitoring-1-25
Jul 28, 2026
Merged

feat: support disabling monitoring for RootSync and RepoSync#2233
google-oss-prow[bot] merged 1 commit into
GoogleContainerTools:mainfrom
cowsking:feat/disable-monitoring-1-25

Conversation

@cowsking

Copy link
Copy Markdown
Contributor

This commit introduces the ability to opt-out of monitoring sidecars (specifically otel-agent) for RootSync and RepoSync objects via the spec.monitoring.enabled field in the declarative API.

When monitoring is disabled, the config-sync controllers will omit the otel-agent container from the reconciler pods and set the environment variable DISABLE_MONITORING=true in the remaining vital containers to silence telemetry exporter logic. All Unit and E2E tests for this logic have been implemented accordingly.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces the ability to disable monitoring in Config Sync by adding a monitoring field to the RepoSync and RootSync CRD specs, and conditionally omitting the otel-agent container and its volumes when disabled. However, a critical issue was identified in the metrics registration logic across pkg/metrics/register.go, pkg/kmetrics/register.go, and pkg/resourcegroup/controllers/metrics/register.go. Returning a nil exporter when DISABLE_MONITORING is active will cause runtime panics (nil pointer dereferences) in callers that invoke defer exporter.Shutdown(ctx) or use the exporter without a nil check. To resolve this, all callers must be updated to handle a nil exporter safely, or a safe no-op exporter should be returned.

Important

The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.

Comment thread pkg/metrics/register.go
Comment thread pkg/kmetrics/register.go
Comment thread pkg/resourcegroup/controllers/metrics/register.go
Comment thread e2e/testcases/disable_monitoring_test.go
Comment thread e2e/testcases/disable_monitoring_test.go
@cowsking
cowsking force-pushed the feat/disable-monitoring-1-25 branch from d603b59 to e458faf Compare July 21, 2026 21:54
@cowsking
cowsking force-pushed the feat/disable-monitoring-1-25 branch 3 times, most recently from 8651415 to 1df8436 Compare July 22, 2026 17:04
@cowsking

Copy link
Copy Markdown
Contributor Author

/retest

@cowsking

Copy link
Copy Markdown
Contributor Author

/test kpt-config-sync-presubmit-e2e-multi-repo-test-group3

@cowsking

Copy link
Copy Markdown
Contributor Author

/test kpt-config-sync-presubmit-e2e-multi-repo-test-group1

Comment thread pkg/api/configsync/v1alpha1/sync_types.go
Comment thread cmd/reconciler-manager/main.go
Comment thread e2e/testcases/disable_monitoring_test.go Outdated
Comment thread pkg/kmetrics/register.go

// RegisterOTelExporter creates the OTLP metrics exporter.
func RegisterOTelExporter(ctx context.Context, containerName string) (*otlpmetricgrpc.Exporter, error) {
if os.Getenv("DISABLE_MONITORING") == "true" {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Meant to be "!="? I wonder why the test was not catching this

@cowsking cowsking Jul 26, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In cmd/reconciler-manager/main.go, we use if os.Getenv("DISABLE_MONITORING") != "true" because we are conditionally executing and wrapping a block of code (and persisting general initialization flow afterwards).

Here in pkg/kmetrics/register.go (and pkg/metrics/register.go), we use == "true" as an early return to guard clause. If monitoring is explicitly disabled, we initialize the safe Noop variables and return early. The rest of the function operates under the assumption that monitoring is active.

Returning nil here is by design, no exporter exists when monitoring is disabled. All four call sites in this PR already nil-check OTel Collector Exporter before Shutdown, so this can't panic.

Comment thread pkg/metrics/register.go
Comment thread pkg/metrics/register.go
@cowsking
cowsking force-pushed the feat/disable-monitoring-1-25 branch 4 times, most recently from afdb4ee to 7cc953d Compare July 27, 2026 18:16
This commit introduces the ability to opt-out of monitoring sidecars
(specifically otel-agent) for RootSync and RepoSync objects via the
spec.monitoring.enabled field in the declarative API.

When monitoring is disabled, the config-sync controllers will omit the
otel-agent container from the reconciler pods and set the environment
variable DISABLE_MONITORING=true in the remaining vital containers to
silence telemetry exporter logic. All Unit and E2E tests for this logic
have been implemented accordingly.

TAG=agy
@cowsking
cowsking force-pushed the feat/disable-monitoring-1-25 branch from 7cc953d to 145627f Compare July 27, 2026 18:25

@tiffanny29631 tiffanny29631 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@google-oss-prow

Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: tiffanny29631

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@google-oss-prow
google-oss-prow Bot merged commit 4e6e21b into GoogleContainerTools:main Jul 28, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants