Skip to content

Ai scriptless skills - #49

Merged
Baraujo25 merged 9 commits into
developmentfrom
AI_SCRIPTLESS_SKILLS
Sep 23, 2026
Merged

Baraujo25 merged 9 commits into
developmentfrom
AI_SCRIPTLESS_SKILLS

Conversation

@diego-ferrand

@diego-ferrand diego-ferrand commented Sep 23, 2026 •

Copy link
Copy Markdown
Collaborator

This pull request introduces significant improvements to Perfecto AI Scriptless skill support, including new best-practices documentation, enhanced developer instructions, and supporting evaluation data. It also includes a minor fix to user config hydration and a packaging improvement. These changes aim to provide agents and users with authoritative, actionable guidance for authoring, running, and troubleshooting Scriptless tests, while ensuring robust tool registration and evaluation.

Perfecto AI Scriptless Skill Documentation and Resources:

  • Added a comprehensive SKILL.md for the perfecto-ai-scriptless skill, detailing product behavior, licensing, UI access, agent rules, workflow, and reference links for authoring and running Scriptless tests. This document guides both agents and users on best practices and correct tool usage.
  • Added best-practices reference files:

Evaluation and Testing Support:

  • Added evals.json with realistic evaluation prompts and expected outputs for the perfecto-ai-scriptless skill, enabling automated or manual validation of agent behavior and documentation coverage.

Developer and Agent Guidance:

  • Expanded the instructions in main.py for the MCP server to emphasize proactive consultation of Perfecto Skills and Help tools, batch operation guidelines, and documentation linking, ensuring agents provide accurate and resource-backed answers.
  • Introduced a context manager _patched_arg_model_base in main.py to safely patch/unpatch the argument model during tool registration, improving reliability and maintainability. [1] [2]

Packaging and Runtime Improvements:

  • Updated pyproject.toml to include all resource files (not just PNGs) in the package, ensuring full documentation and references are distributed.
  • Improved robustness of user config hydration in config/runtime.py by safely setting user_config on the context object.

diego-ferrand and others added 9 commits July 20, 2026 11:13
…SKILLS

# Conflicts:
#	server.py

Co-authored-by: Baraujo25 <48018971+Baraujo25@users.noreply.github.com>
Co-authored-by: Baraujo25 <48018971+Baraujo25@users.noreply.github.com>
Co-authored-by: Baraujo25 <48018971+Baraujo25@users.noreply.github.com>
Co-authored-by: Baraujo25 <48018971+Baraujo25@users.noreply.github.com>
Co-authored-by: Baraujo25 <48018971+Baraujo25@users.noreply.github.com>
Co-authored-by: Baraujo25 <48018971+Baraujo25@users.noreply.github.com>
@Baraujo25
Baraujo25 merged commit efc4539 into development Sep 23, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants