Other LLMs

PairPilot uses the litellm package to connect to hundreds of other models. You can use PairPilot --model <model-name> to use any supported model.

To explore the list of supported models you can run PairPilot --list-models <model-name> with a partial model name. If the supplied name is not an exact match for a known model, PairPilot will return a list of possible matching models. For example:

$ PairPilot --list-models turbo

PairPilot v0.29.3-dev
Models which match "turbo":
- gpt-4-turbo-preview (openai/gpt-4-turbo-preview)
- gpt-4-turbo (openai/gpt-4-turbo)
- gpt-4-turbo-2024-04-09 (openai/gpt-4-turbo-2024-04-09)
- gpt-3.5-turbo (openai/gpt-3.5-turbo)
- ...

See the model warnings section for information on warnings which will occur when working with models that PairPilot is not familiar with.

LiteLLM

PairPilot uses the LiteLLM package to connect to LLM providers. The LiteLLM provider docs contain more detail on all the supported providers, their models and any required environment variables.

Other API key variables

Here are the API key environment variables that are supported by litellm. See their docs for more info.

• ALEPHALPHA_API_KEY
• ALEPH_ALPHA_API_KEY
• ANTHROPIC_API_KEY
• ANYSCALE_API_KEY
• AZURE_AI_API_KEY
• AZURE_API_KEY
• AZURE_OPENAI_API_KEY
• BASETEN_API_KEY
• CEREBRAS_API_KEY
• CLARIFAI_API_KEY
• CLOUDFLARE_API_KEY
• CODESTRAL_API_KEY
• COHERE_API_KEY
• CO_API_KEY
• DATABRICKS_API_KEY
• DEEPINFRA_API_KEY
• DEEPSEEK_API_KEY
• FIREWORKSAI_API_KEY
• FIREWORKS_AI_API_KEY
• FIREWORKS_API_KEY
• GEMINI_API_KEY
• GROQ_API_KEY
• HUGGINGFACE_API_KEY
• MARITALK_API_KEY
• MISTRAL_API_KEY
• NLP_CLOUD_API_KEY
• NVIDIA_NIM_API_KEY
• OLLAMA_API_KEY
• OPENAI_API_KEY
• OPENAI_LIKE_API_KEY
• OPENROUTER_API_KEY
• OR_API_KEY
• PALM_API_KEY
• PERPLEXITYAI_API_KEY
• PREDIBASE_API_KEY
• PROVIDER_API_KEY
• REPLICATE_API_KEY
• TOGETHERAI_API_KEY
• VOLCENGINE_API_KEY
• VOYAGE_API_KEY
• WATSONX_API_KEY
• WX_API_KEY
• XAI_API_KEY
• XINFERENCE_API_KEY