yarn-llama2

108.4K 2 years ago

An extension of Llama 2 that supports a context of up to 128k tokens.

7b 13b

67 models

yarn-llama2:latest
75df67be3cee • 3.8GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b latest
75df67be3cee • 3.8GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b
8a0a518f30c5 • 7.4GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-128k
9fc4f0e902e7 • 3.8GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q2_K
cdf8cc638505 • 2.8GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q3_K_S
530c82d4467e • 2.9GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q3_K_M
45336ee1f0a9 • 3.3GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q3_K_L
aaabf5006e38 • 3.6GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q4_0
9fc4f0e902e7 • 3.8GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q4_1
f2a3da69d205 • 4.2GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q4_K_S
cc95e37e566a • 3.9GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q4_K_M
3d161bdec11d • 4.1GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q5_0
1b73590983c7 • 4.7GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q5_1
6f754622c8a4 • 5.1GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q5_K_S
e0f8b2069f93 • 4.7GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q5_K_M
68bdf2550ed6 • 4.8GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q6_K
aaf047ee8cc4 • 5.5GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-q8_0
46e9636b6006 • 7.2GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-128k-fp16
4516a999c8ea • 13GB • 128K context window •
Text input • 2 years ago
yarn-llama2:7b-64k
75df67be3cee • 3.8GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q2_K
5a72b555332e • 2.8GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q3_K_S
f1c57a39811e • 2.9GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q3_K_M
bb367368ddd7 • 3.3GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q3_K_L
fc7635aa06a7 • 3.6GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q4_0
75df67be3cee • 3.8GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q4_1
bdfb6c5a3e9b • 4.2GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q4_K_S
1b8985d3a359 • 3.9GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q4_K_M
76f2052b357c • 4.1GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q5_0
b453cc4f3d00 • 4.7GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q5_1
297d4906eee3 • 5.1GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q5_K_S
a8f6f4ceeeda • 4.7GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q5_K_M
cec9e8d58901 • 4.8GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q6_K
f583cc04b87c • 5.5GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-q8_0
59d75ca11360 • 7.2GB • 64K context window •
Text input • 2 years ago
yarn-llama2:7b-64k-fp16
cf9cd5b25466 • 13GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-128k
312277e27d21 • 7.4GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q2_K
00e51f24ad67 • 5.4GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q3_K_S
c753ad94de2e • 5.7GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q3_K_M
b5b98d8650ab • 6.3GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q3_K_L
7e92cb79ad6f • 6.9GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q4_0
312277e27d21 • 7.4GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q4_1
1952ac7b3231 • 8.2GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q4_K_S
b2ffe41a638b • 7.4GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q4_K_M
df02b797c5aa • 7.9GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q5_0
dc65f2b65862 • 9.0GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q5_1
7e02f3ba0b14 • 9.8GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q5_K_S
effbf903f606 • 9.0GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q5_K_M
6c618202668d • 9.2GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q6_K
311e2194fa2a • 11GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-q8_0
c1cec788ae55 • 14GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-128k-fp16
eecf1bcd524a • 26GB • 128K context window •
Text input • 2 years ago
yarn-llama2:13b-64k
8a0a518f30c5 • 7.4GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q2_K
0afb4364db77 • 5.4GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q3_K_S
37ef3189742b • 5.7GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q3_K_M
ec22dd2cb7ac • 6.3GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q3_K_L
be418e37797b • 6.9GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q4_0
8a0a518f30c5 • 7.4GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q4_1
4204c4116efc • 8.2GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q4_K_S
183a14c4be4d • 7.4GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q4_K_M
48fbabc18e03 • 7.9GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q5_0
506dd60df468 • 9.0GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q5_1
d6fe4567c627 • 9.8GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q5_K_S
91f3cccd9580 • 9.0GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q5_K_M
0cdae1412098 • 9.2GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q6_K
df2074aaebe3 • 11GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-q8_0
adbdaa2e0f7a • 14GB • 64K context window •
Text input • 2 years ago
yarn-llama2:13b-64k-fp16
8863e4eab466 • 26GB • 64K context window •
Text input • 2 years ago