Skip to content

nexa_shim

nexa_shim

Nexa SDK shim.

Thin FastAPI server wrapping the Nexa SDK (nexaai) as an OpenAI-compatible API on port 18181. Intended for on-device inference with GGUF models on Apple Silicon or CPU.

Usage: uvicorn openjarvis.engine.nexa_shim:app --host 127.0.0.1 --port 18181