Documentation Index
Fetch the complete documentation index at: https://docs.axioniclabs.ai/llms.txt
Use this file to discover all available pages before exploring further.
Overview
Python SDK for the Axionic platform. Remote inference via the Axionic API, local model loading via TransformerLens, steering vectors, SAE behavior monitoring, runtime policies, and a local OpenAI-compatible server. Install from PyPI:Two Modes of Operation
- Remote API
- Local Model
Generation, steering, and SAE operations run on Axionic-hosted GPU infrastructure. No local hardware requirements beyond running the SDK.
- Requires an API key (
ax_+ 48 hex characters) - Credits are deducted per inference call
- Supports all sampling methods including ADS
- Model does not need to fit in local memory
Execution Mode
Control where operations run withset_execution_mode():
| Mode | Behavior |
|---|---|
"auto" (default) | Remote if authenticated, local fallback if a model is loaded |
"remote" | Always use the Axionic API. Fails if not authenticated. |
"local" | Always use the locally loaded model. Fails if no model loaded. |
ADS, guided-generation, constrained-beam-search, speculative-decoding, and ensemble-sampling are remote-only regardless of execution mode. Steering perceptrons are also remote-only.