Recipes

For a first real decision, follow the complete CPU walkthrough (中文) and its recorded LAYA demo.

• Laya text worker: start the external Python worker, connect the Rust frontend and compare direct and proxied responses.
• Laya native CUDA worker: build the Hopper bundle and serve English text decisions with Rust and CUDA.
• Laya on Apple Silicon: serve Laya on the Mac GPU with the Laya worker, put the frontend in front of it and run the benchmarks.
• Cua-S1 4B 0.2 text worker: download the pinned weights, start the worker and connect the Rust frontend.
• Cua-S1 4B 0.2 native text worker: build the CUDA library and the Rust worker, export the merged weights and start the worker.
• Open-Jev-27B-v1.1 native text worker: export the merged text backbone and trained decision head, then serve with Rust and CUDA.
• CLM behind the frontend: run CLM's own server behind the frontend on CPU with a stub encoder, and what the response comparison has to allow for.

Recipes contain setup, launch commands and examples. Reusable implementation code belongs under src/.

compare_with_backend.py checks that the frontend returns what the worker returned, for any recipe; test_compare_with_backend.py covers it without a model.