neural-chat:7b-v3.2-q6

neural-chat:7b-v3.2-q6_K

167.8K Downloads Updated 1 year ago

A fine-tuned model based on Mistral with good coverage of domain and language.

Updated 2 years ago

2 years ago

9c0c2ea9c046 · 5.9GB ·

archllama

parameters7.24B

quantizationQ6_K

5.9GB

{ "num_ctx": 4096, "stop": [ "<|im_start|>", "<|im_end|>" ] }

74B

### System: {{ .System }} ### User: {{ .Prompt }} ### Assistant:

67B

NeuralChat is a fine-tuned model released by Intel that’s based on Mistral, designed to be used for high-performance chatbot applications.