Skip to content

Refactor test and autotune agent to use fix test harness and use speedup as the major metric - #74

Open
shangkunwang01 wants to merge 5 commits into
mainfrom
shangkun-refactor-test-autotune
Open

Refactor test and autotune agent to use fix test harness and use speedup as the major metric#74
shangkunwang01 wants to merge 5 commits into
mainfrom
shangkun-refactor-test-autotune

Conversation

@shangkunwang01

@shangkunwang01 shangkunwang01 commented Jul 27, 2026

Copy link
Copy Markdown
Collaborator

This PR refactors the testing and autotuning workflow in the MaxKernel auto-agent, updates the core performance evaluation metric, and introduces several architectural improvements to the pipeline agent.

  • Testing & Autotuning Refactor:
    • Enforced the use of a fixed test harness across both test and autotuning agents.
    • Moved test generation to the beginning of the pipeline_agent lifecycle so tests are prepared earlier.
  • Performance Metric Update:
    • Replaced absolute latency with relative speedup as the primary metric for evaluating and comparing kernel performance across the auto-search and autotuning workflows.

@gemini-code-assist

Copy link
Copy Markdown

Caution

The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased.

@shangkunwang01
shangkunwang01 requested a review from NinaCai July 27, 2026 20:11
@shangkunwang01
shangkunwang01 force-pushed the shangkun-refactor-test-autotune branch 2 times, most recently from 6ee9f51 to 21ad2f6 Compare July 31, 2026 01:50
@shangkunwang01
shangkunwang01 force-pushed the shangkun-refactor-test-autotune branch from 44a6b2d to e9bae90 Compare July 31, 2026 22:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant