neural-chat:7b-v3.1-q5_K_M

167.9K 1 year ago

A fine-tuned model based on Mistral with good coverage of domain and language.

7b

2 years ago

f36c54b7e769 · 5.1GB ·

model
llama
·
7.24B
·
Q5_K_M
template
### System: {{ .System }} ### User: {{ .Prompt }} ### Assistant:
params
{ "num_ctx": 4096, "stop": [ "<|im_start|>", "<|im_end|>" ] }

Readme

NeuralChat is a fine-tuned model released by Intel that’s based on Mistral, designed to be used for high-performance chatbot applications.

References

HuggingFace