Installation

To install Arctic Inference from PyPI, use the following command:

pip install arctic-inference[vllm]

This will install the latst Arctic Inference and compatible vLLM version.

Alternatively, you can also clone the Arctic Inference repository and build/install it from source:

git clone https://github.com/snowflakedb/ArcticInference.git && pip install ./ArcticInference