DougAnderson444/tool_calls.md

Created February 15, 2026 02:36

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/DougAnderson444/193c042a5be60804530553277dfe0892.js"></script>
Save DougAnderson444/193c042a5be60804530553277dfe0892 to your computer and use it in GitHub Desktop.

local tools

Raw

LiteLLM - Best as a proxy/router

Unified interface across providers Supports tool_choice parameter Can route to local models (vLLM, Ollama) or cloud APIs Automatic format translation

Run Ollama as the backend, then put LiteLLM in front of it to add proper tool_choice support:

# Terminal 1: Start Ollama
ollama serve

# Terminal 2: LiteLLM proxy
litellm --model ollama/qwen2.5-coder:7b --api_base http://localhost:11434

Author

ensure the model is available in ollama

ollama pull qwen3:14b-q4_K_M

ollama ls

litellm --model ollama/qwen3:14b-q4_K_M --api_base http://localhost:11434

Select an option