Skip to content

Instantly share code, notes, and snippets.

@gittb
Last active November 19, 2024 15:54
Show Gist options
  • Select an option

  • Save gittb/b864f88b781c817a58ceeba2919cf005 to your computer and use it in GitHub Desktop.

Select an option

Save gittb/b864f88b781c817a58ceeba2919cf005 to your computer and use it in GitHub Desktop.
Continue.dev: Qwen2.5-Coder 32B Instruct Chat and Autocomplete FIM config
{
"models": [
{
"apiBase": "YOURLOCALMODEL:8000/v1",
"title": "Qwen2.5-Coder-32B-Instruct",
"model": "/models/Qwen2.5-Coder-32B-Instruct",
"provider": "openai",
"apiKey": "YOURKEY"
}
],
"tabAutocompleteModel": {
"model": "/models/Qwen2.5-Coder-32B-Instruct",
"provider": "openai",
"apiKey": "YOURKEY",
"title": "/models/Qwen2.5-Coder-32B-Instruct",
"apiBase": "YOURLOCALMODEL:8000/v1",
"contextLength": 32384,
"completionOptions": {
"temperature": 0.01,
"stop": [
"<|file_sep|>",
"<|fim_pad|>",
"<|fim_prefix|>",
"<|fim_middle|>",
"<|fim_suffix|>",
"<|repo_name|>",
"<|im_end|>",
"<|endoftext|>"
]
}
},
"tabAutocompleteOptions": {
"useCache": true,
"multilineCompletions": "auto",
"maxPromptTokens": 32384,
"useFileSuffix": true,
"debounceDelay": 100,
"template": "<|fim_prefix|>{{{ prefix }}}<|fim_suffix|>{{{ suffix }}}<|fim_middle|>"
}
}
@SecretiveShell
Copy link

Very nice!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment