Add test cases for independent filtering (variance & mean) with various scenarios and update protocol formatting - #36
Conversation
|
Thanks for putting together these test cases for Before we can merge this, could you please rebase your branch on the latest The spec metadata field updates across the Once rebased with that commit dropped, the PR diff should be scoped strictly to You can do this locally with an interactive rebase: git fetch origin main
git rebase -i origin/main
# In the editor, delete/drop the line for commit 5dd4c6a ("renamed the other (not made by me)...")
git push --force-with-lease |
5dd4c6a to
b1eddf6
Compare
|
Question from @ohih8:
Looking back at the protocol materials Input Data: the input data is clearly specified, so I think both behaviors of the agent would be considered passes. It either does a pre-protocol matrix transpose (something too simple to merit a protocol), or it refuses because the input requirement is not met. The only true failure is if the agent incorrectly filters samples. |
|
And to answer your other question - I'm still not sure if this format is what I have in mind :D. I still need to think through and define the testing mechanism, but the important thing is that you've independently confirmed the correctness of the expected results, then we can reformat as needed. I'll still have to wait on merging until testing infrastructure is in place, but having this PR will help with that development. |
Added 8 tests on independent variance filtering that test various applications of the independent-variance-filtering protocol.