nexa_shim
nexa_shim
¶
Nexa SDK shim.
Thin FastAPI server wrapping the Nexa SDK (nexaai) as an
OpenAI-compatible API on port 18181. Intended for on-device inference
with GGUF models on Apple Silicon or CPU.
Usage: uvicorn openjarvis.engine.nexa_shim:app --host 127.0.0.1 --port 18181