[HWORKS-3275] ML software factory

[jimdowling]

User docs for the ML software factory (HWORKS-3275) and the Terminal's start screen.

• user_guides/client_installation/index.md:
  • The file table of hops setup covers /hops, /hops-ml, /hops-build, the dashboard, app, training and inference agents, and the removal of hops-fti.
  • A new section, Build an ML system, covers:
    • hops factory run <factory>: its questions asked in the terminal or read from --answers, --preset for an example, --no-launch, and resuming a system from its system.yaml;
    • how a new data source's secret is passed;
    • the system's AGENTS.md;
    • the hops-<slug> repository;
    • the project's registry.
  • It also covers the Factory page under AI/ML:
    • New and Example;
    • Login to GitHub;
    • a system's page;
    • Architecture with edits;
    • Status;
    • Delete with its three choices.
  • It ends with the hops factory run and hops factory system commands.
  • A new section, Build a silver medallion layer: the medallion_table tag, Tag as bronze tables, New Medallion Layer, third normal form, incremental runs, one job per refresh, applying changes to system.yaml, Status, Backfill, per-job delete, Add tables, and the layer commands of hops factory system.
  • A new section, Build a gold medallion layer of data marts: the Kimball model, the data mart as the unit added, edited and deleted, its requirements including verification, and the mart commands.
• user_guides/projects/terminal/start.md is a new page, Start the Terminal:
  • Resources and Spark Cluster settings.
  • LLM Provider: the providers, where the key is kept, Test, and which coding agents use it. Claude Code is covered for providers with an Anthropic-compatible API, as is the warning for an overriding settings.json env block.
• user_guides/agents/deployments/index.md: the agent example serves /predict and /v1/models/<name>:predict, the paths a prediction request arrives on.
• session_capacity_warnings.md: the terminal's button is now Start.

JIRA: https://hopsworks.atlassian.net/browse/HWORKS-3275

Related PRs: logicalclocks/hopsworks-api#1207, logicalclocks/hopsworks-front#2132, logicalclocks/hopsworks-ee#3384, logicalclocks/docker-images#1072, logicalclocks/hopsworks-helm#2447, logicalclocks/loadtest#1075.

Tested: hopsworks-docs markdownlint (0 errors) and hopsworks-docs check (strict build) pass.

Not yet documented: the Hops Run and GIS examples, the run-time and time-series fields of the requirements, sample code (reference_code), phase estimates, Resume building, and factory_enabled.

Factory definitions

The client installation guide describes creating, cloning, importing, exporting, editing and deleting a project's own factories, with an example definition and the hops factory commands, and the five built-in factories (ml-batch, ml-realtime, ml-agent, medallion-silver, medallion-gold).

Changes to a built system

The guide describes a factory's changes, the Change menu, hops factory run <factory> <system> --change <id>, and hops factory system delete-assets; the layer command list uses the change requests and hops job run for a backfill.

🤖 Generated with Claude Code

https://claude.ai/code/session_01RfHMsBbYDQZqoD58XVqeYE

[Copilot]

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.