Ben Gitter gittb

🐘

Working on population of KB from unstructured audio and LLM access

digital general contractor, leveraging LLM subs

gittb / config.json

Last active November 19, 2024 15:54

Continue.dev: Qwen2.5-Coder 32B Instruct Chat and Autocomplete FIM config

	{
	"models": [
	{
	"apiBase": "YOURLOCALMODEL:8000/v1",
	"title": "Qwen2.5-Coder-32B-Instruct",
	"model": "/models/Qwen2.5-Coder-32B-Instruct",
	"provider": "openai",
	"apiKey": "YOURKEY"
	}
	],