Integrate capability-aware Apple Silicon runtime - #140
Open
Paul (nuclearspike) wants to merge 1 commit into
Open
Integrate capability-aware Apple Silicon runtime#140Paul (nuclearspike) wants to merge 1 commit into
Paul (nuclearspike) wants to merge 1 commit into
Conversation
Consolidates the work from Lightricks#132, Lightricks#133, Lightricks#134, and Lightricks#136 into one branch. - Capability-aware Fast T2V/I2V routing: auto uses MLX only for local text encoding, cached BF16 weights, and the exact clean 0.14.20.dev1 runtime at revision 3171bac4ba901c0237faea2678c34034b37abc2a. Prepared embeddings, A2V, Retake, Extend, IC-LoRA, and image generation stay on Torch. - MLX runs in a fresh process group per job. The backend never imports MLX; cancellation kills the whole group and process exit is the allocator teardown boundary. - Local Fast dimensions resolve before conditioning or inference. Distilled 540p uses the budget-bounded 896x512 two-stage grid (512x896 portrait), removes hidden per-axis rounding, reports the resolved pair in the completion API, rejects off-grid MLX commands, and makes strict QA require API dimensions to equal ffprobe output. - A prompt-safe JSONL profile is persisted for every MLX job, exposing live/last-job allocator active, cache, peak, phase, terminal status, path, timestamp, and exact runtime identity through the existing telemetry API and Settings UI. Incomplete tails, invalid timestamps, non-finite values, and killed-child cancellation are handled without breaking telemetry. - Adds an fcntl-based shared Metal lease so a second local GPU consumer on the same machine cannot run concurrent Metal work, plus process/system/MPS/MLX memory telemetry, capability routing and exact provenance in Settings, and a strict HD performance evidence harness that captures the post-child terminal profile. - q8 stays expert-only behind a visible quality warning; auto never selects it. Low-RAM MLX enables runtime auto-tiling. Backend: 596 passed. TypeScript and Pyright clean. OpenAPI generated bindings and drift check clean. Production frontend and Electron bundles pass. Full macOS production build from the integration base passes, producing a signed app, DMG, and ZIP.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Replaces #138, which I closed to correct the contents of the branch. Same technical change, clean history.
Summary
Evidence
Benchmark evidence under
backend/performance_runner/artifacts/has machine-specific paths and hostnames redacted.