Skip to content

Feature/integrate llm providers#28

Merged
therevoltingx merged 6 commits into
mainfrom
feature/integrate-llm-providers
Jul 15, 2026
Merged

Feature/integrate llm providers#28
therevoltingx merged 6 commits into
mainfrom
feature/integrate-llm-providers

Conversation

@Sirajmx

@Sirajmx Sirajmx commented Jul 10, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Adds OpenAI and Gemini as supported LLM providers alongside the existing Anthropic default
  • Installs the required crewai extras (openai, gemini) in pyproject.toml so dependencies are present when a non-Anthropic model is configured
  • Adds OPENAI_API_KEY and GOOGLE_API_KEY as optional fields in Settings with inline provider-switch docs
  • Updates model references from gemini-2.0-flash (deprecated June 2026) to gemini-2.5-flash across settings.py, .env.example, and
    docs/guides/configuration.md
  • Fixes MANAGER_LLM_MODEL default in .env.example from claude-sonnet to claude-opus-4 to match settings.py

Provider configuration (.env.example)

Only one provider can be active at a time. The file ships with Anthropic uncommented as the default. To switch, comment out the Anthropic block
and uncomment the target block:

--Provider: Anthropic (default — active)
ANTHROPIC_API_KEY=your-anthropic-api-key-here
DEFAULT_LLM_MODEL=anthropic/claude-sonnet-4-5-20250929
MANAGER_LLM_MODEL=anthropic/claude-opus-4-20250514

-- Provider: OpenAI (alternative)
--OPENAI_API_KEY=your-openai-api-key-here
--DEFAULT_LLM_MODEL=openai/gpt-4o
-- MANAGER_LLM_MODEL=openai/gpt-4o

--Provider: Google Gemini (alternative)
--GOOGLE_API_KEY=your-google-api-key-here
--DEFAULT_LLM_MODEL=gemini/gemini-2.5-flash
--MANAGER_LLM_MODEL=gemini/gemini-2.5-flash

Test plan

  • Start seller agent with default Anthropic config — agents initialize without error
  • Swap to openai/gpt-4o + OPENAI_API_KEY — crew runs using OpenAI
  • Swap to gemini/gemini-2.5-flash + GOOGLE_API_KEY — crew runs using Gemini
  • Verify pyproject.toml extras install cleanly: pip install -e ".[anthropic,openai,gemini]"

@Sirajmx
Sirajmx requested review from atc964 and therevoltingx July 10, 2026 11:47
Kishore N and others added 3 commits July 15, 2026 16:50
…, HuggingFace, etc.)

Adds LLM_API_KEY/LLM_API_BASE_URL alongside the existing named providers
(Anthropic, OpenAI, Gemini, Bedrock). When LLM_API_BASE_URL is set, requests
route through CrewAI's native OpenAI-compatible client with the raw model id
the endpoint expects; otherwise behavior is unchanged.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Add custom OpenAI-compatible endpoint alternative (NVIDIA NIM, Ollama, HuggingFace, etc.)
@Sirajmx Sirajmx reopened this Jul 15, 2026
@Sirajmx

Sirajmx commented Jul 15, 2026

Copy link
Copy Markdown
Contributor Author

This should go to main branch to reflect all other llm providers

@therevoltingx
therevoltingx merged commit a8b4eff into main Jul 15, 2026
4 checks passed
@therevoltingx
therevoltingx deleted the feature/integrate-llm-providers branch July 15, 2026 18:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants