LLMHardware.io

Find the right hardware for every LLM

Compare 5,204+ open-source models with minimum, comfortable, and headroom GPU recommendations.

Sort by:

Qwen/Qwen3-0.6B

Qwen/Qwen3-0.6B

text-gen
0.6B 19,873,705 downloads 1,220 likes
View Hardware

openai-community/gpt2

openai-community/gpt2

text-gen
16,125,428 downloads 3,226 likes
View Hardware

Qwen/Qwen2.5-7B-Instruct

Qwen/Qwen2.5-7B-Instruct

text-gen
7B 13,708,672 downloads 1,253 likes
View Hardware

deepseek-ai/DeepSeek-V3.2

deepseek-ai/DeepSeek-V3.2

text-gen
11,276,220 downloads 1,427 likes
View Hardware

Qwen/Qwen3-4B-Instruct-2507

Qwen/Qwen3-4B-Instruct-2507

text-gen
4B 10,340,261 downloads 829 likes
View Hardware

Qwen/Qwen3-8B

Qwen/Qwen3-8B

text-gen
8B 9,923,391 downloads 1,071 likes
View Hardware

meta-llama/Llama-3.1-8B-Instruct

meta-llama/Llama-3.1-8B-Instruct

text-gen
8B 9,668,434 downloads 5,779 likes
View Hardware

Qwen/Qwen2.5-1.5B-Instruct

Qwen/Qwen2.5-1.5B-Instruct

text-gen
1.5B 9,615,295 downloads 683 likes
View Hardware

Qwen/Qwen2.5-3B-Instruct

Qwen/Qwen2.5-3B-Instruct

text-gen
3B 9,372,290 downloads 450 likes
View Hardware

facebook/opt-125m

facebook/opt-125m

text-gen
8,008,846 downloads 249 likes
View Hardware

trl-internal-testing/tiny-Qwen2ForCausalLM-2.5

trl-internal-testing/tiny-Qwen2ForCausalLM-2.5

text-gen
7,476,564 downloads 6 likes
View Hardware

openai/gpt-oss-20b

openai/gpt-oss-20b

text-gen
20B 6,942,836 downloads 4,581 likes
View Hardware

Qwen/Qwen2.5-0.5B-Instruct

Qwen/Qwen2.5-0.5B-Instruct

text-gen
0.5B 6,191,102 downloads 507 likes
View Hardware

meta-llama/Llama-3.2-1B-Instruct

meta-llama/Llama-3.2-1B-Instruct

text-gen
1B 6,178,296 downloads 1,392 likes
View Hardware

Qwen/Qwen3-1.7B

Qwen/Qwen3-1.7B

text-gen
1.7B 5,382,266 downloads 454 likes
View Hardware

Qwen/Qwen3-32B

Qwen/Qwen3-32B

text-gen
32B 4,779,944 downloads 692 likes
View Hardware

dphn/dolphin-2.9.1-yi-1.5-34b

dphn/dolphin-2.9.1-yi-1.5-34b

text-gen
34B 4,698,540 downloads 62 likes
View Hardware

openai/gpt-oss-120b

openai/gpt-oss-120b

text-gen
120B 4,147,394 downloads 4,753 likes
View Hardware

Qwen/Qwen3-4B

Qwen/Qwen3-4B

text-gen
4B 4,084,406 downloads 606 likes
View Hardware

deepseek-ai/DeepSeek-R1

deepseek-ai/DeepSeek-R1

text-gen
4,023,498 downloads 13,317 likes
View Hardware

Qwen/Qwen2-1.5B-Instruct

Qwen/Qwen2-1.5B-Instruct

text-gen
1.5B 3,972,712 downloads 162 likes
View Hardware

meta-llama/Meta-Llama-3-8B

meta-llama/Meta-Llama-3-8B

text-gen
8B 3,458,214 downloads 6,529 likes
View Hardware

TinyLlama/TinyLlama-1.1B-Chat-v1.0

TinyLlama/TinyLlama-1.1B-Chat-v1.0

text-gen
1.1B 3,205,477 downloads 1,575 likes
View Hardware

EleutherAI/pythia-160m

EleutherAI/pythia-160m

text-gen
3,152,957 downloads 41 likes
View Hardware

Qwen/Qwen3-14B

Qwen/Qwen3-14B

text-gen
14B 3,050,612 downloads 390 likes
View Hardware

distilbert/distilgpt2

distilbert/distilgpt2

text-gen
2,736,040 downloads 625 likes
View Hardware

Qwen/Qwen3-Coder-30B-A3B-Instruct

Qwen/Qwen3-Coder-30B-A3B-Instruct

text-gen
30B 2,719,917 downloads 1,039 likes
View Hardware

Qwen/Qwen2.5-14B-Instruct

Qwen/Qwen2.5-14B-Instruct

text-gen
14B 2,658,219 downloads 331 likes
View Hardware

hmellor/tiny-random-LlamaForCausalLM

hmellor/tiny-random-LlamaForCausalLM

text-gen
2,549,585 downloads 0 likes
View Hardware

openai-community/gpt2-large

openai-community/gpt2-large

text-gen
2,348,019 downloads 348 likes
View Hardware

mistralai/Mistral-7B-Instruct-v0.2

mistralai/Mistral-7B-Instruct-v0.2

text-gen
7B 2,256,011 downloads 3,129 likes
View Hardware

Qwen/Qwen2.5-Coder-7B-Instruct

Qwen/Qwen2.5-Coder-7B-Instruct

text-gen
7B 2,191,051 downloads 702 likes
View Hardware

Andycurrent/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_GGUF

Andycurrent/Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_GGUF

text-gen
1B 2,157,480 downloads 19 likes
View Hardware

nvidia/Gemma-4-31B-IT-NVFP4

nvidia/Gemma-4-31B-IT-NVFP4

text-gen
31B 2,129,147 downloads 444 likes
View Hardware

Qwen/Qwen3-0.6B-FP8

Qwen/Qwen3-0.6B-FP8

text-gen
0.6B 2,116,821 downloads 59 likes
View Hardware

meta-llama/Llama-3.2-3B-Instruct

meta-llama/Llama-3.2-3B-Instruct

text-gen
3B 2,097,830 downloads 2,119 likes
View Hardware

Qwen/Qwen2.5-7B

Qwen/Qwen2.5-7B

text-gen
7B 1,992,454 downloads 281 likes
View Hardware

deepseek-ai/DeepSeek-R1-Distill-Llama-8B

deepseek-ai/DeepSeek-R1-Distill-Llama-8B

text-gen
8B 1,958,814 downloads 857 likes
View Hardware

Qwen/Qwen2.5-0.5B

Qwen/Qwen2.5-0.5B

text-gen
0.5B 1,949,479 downloads 399 likes
View Hardware

RedHatAI/Llama-3.2-1B-Instruct-FP8-dynamic

RedHatAI/Llama-3.2-1B-Instruct-FP8-dynamic

text-gen
1B 1,926,754 downloads 4 likes
View Hardware

Qwen/Qwen3-4B-Base

Qwen/Qwen3-4B-Base

text-gen
4B 1,923,374 downloads 87 likes
View Hardware

Qwen/Qwen2.5-14B-Instruct-AWQ

Qwen/Qwen2.5-14B-Instruct-AWQ

text-gen
14B 1,895,974 downloads 35 likes
View Hardware

meta-llama/Llama-2-7b-hf

meta-llama/Llama-2-7b-hf

text-gen
7B 1,782,446 downloads 2,297 likes
View Hardware

Qwen/Qwen2.5-Coder-7B

Qwen/Qwen2.5-Coder-7B

text-gen
7B 1,750,121 downloads 142 likes
View Hardware

EleutherAI/pythia-70m-deduped

EleutherAI/pythia-70m-deduped

text-gen
1,653,170 downloads 28 likes
View Hardware

meta-llama/Meta-Llama-3-8B-Instruct

meta-llama/Meta-Llama-3-8B-Instruct

text-gen
8B 1,629,384 downloads 4,500 likes
View Hardware

apple/OpenELM-1_1B-Instruct

apple/OpenELM-1_1B-Instruct

text-gen
1B 1,606,041 downloads 75 likes
View Hardware

microsoft/Phi-4-mini-instruct

microsoft/Phi-4-mini-instruct

text-gen
1,564,970 downloads 733 likes
View Hardware

meta-llama/Llama-3.1-8B

meta-llama/Llama-3.1-8B

text-gen
8B 1,557,284 downloads 2,177 likes
View Hardware

meta-llama/Llama-3.2-1B

meta-llama/Llama-3.2-1B

text-gen
1B 1,509,915 downloads 2,377 likes
View Hardware

zai-org/GLM-5-FP8

zai-org/GLM-5-FP8

text-gen
1,492,611 downloads 172 likes
View Hardware

HuggingFaceTB/SmolLM2-135M-Instruct

HuggingFaceTB/SmolLM2-135M-Instruct

text-gen
1,460,127 downloads 312 likes
View Hardware

nvidia/DeepSeek-R1-0528-NVFP4-v2

nvidia/DeepSeek-R1-0528-NVFP4-v2

text-gen
1,449,051 downloads 23 likes
View Hardware

Qwen/Qwen2.5-32B-Instruct-AWQ

Qwen/Qwen2.5-32B-Instruct-AWQ

text-gen
32B 1,417,403 downloads 99 likes
View Hardware

llamafactory/tiny-random-Llama-3

llamafactory/tiny-random-Llama-3

text-gen
1,403,809 downloads 3 likes
View Hardware

nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16

nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16

text-gen
30B 1,386,050 downloads 725 likes
View Hardware

nvidia/Kimi-K2.5-NVFP4

nvidia/Kimi-K2.5-NVFP4

text-gen
1,353,823 downloads 81 likes
View Hardware

Qwen/Qwen2.5-7B-Instruct-AWQ

Qwen/Qwen2.5-7B-Instruct-AWQ

text-gen
7B 1,338,985 downloads 40 likes
View Hardware

Qwen/Qwen3-30B-A3B

Qwen/Qwen3-30B-A3B

text-gen
30B 1,324,358 downloads 884 likes
View Hardware

Qwen/Qwen2.5-Coder-32B-Instruct

Qwen/Qwen2.5-Coder-32B-Instruct

text-gen
32B 1,320,337 downloads 2,014 likes
View Hardware

google/t5gemma-s-s-prefixlm

google/t5gemma-s-s-prefixlm

text-gen
1,271,969 downloads 3 likes
View Hardware

bigscience/bloomz-560m

bigscience/bloomz-560m

text-gen
1,263,024 downloads 137 likes
View Hardware

HuggingFaceTB/SmolLM2-135M

HuggingFaceTB/SmolLM2-135M

text-gen
1,235,151 downloads 189 likes
View Hardware

deepseek-ai/DeepSeek-V3

deepseek-ai/DeepSeek-V3

text-gen
1,207,791 downloads 4,064 likes
View Hardware

Qwen/Qwen3-8B-AWQ

Qwen/Qwen3-8B-AWQ

text-gen
8B 1,199,646 downloads 41 likes
View Hardware

kaitchup/Phi-3-mini-4k-instruct-gptq-4bit

kaitchup/Phi-3-mini-4k-instruct-gptq-4bit

text-gen
1,140,998 downloads 2 likes
View Hardware

Qwen/Qwen3-30B-A3B-Instruct-2507

Qwen/Qwen3-30B-A3B-Instruct-2507

text-gen
30B 1,131,302 downloads 805 likes
View Hardware

RedHatAI/Qwen2.5-1.5B-quantized.w8a8

RedHatAI/Qwen2.5-1.5B-quantized.w8a8

text-gen
1.5B 1,129,499 downloads 3 likes
View Hardware

deepseek-ai/DeepSeek-R1-0528

deepseek-ai/DeepSeek-R1-0528

text-gen
1,123,635 downloads 2,447 likes
View Hardware

ibm-research/PowerMoE-3b

ibm-research/PowerMoE-3b

text-gen
3B 1,112,581 downloads 19 likes
View Hardware

meta-llama/Llama-3.2-3B

meta-llama/Llama-3.2-3B

text-gen
3B 1,112,489 downloads 768 likes
View Hardware

mistralai/Mistral-7B-v0.1

mistralai/Mistral-7B-v0.1

text-gen
7B 1,111,044 downloads 4,081 likes
View Hardware

deepseek-ai/DeepSeek-R1-Distill-Qwen-32B

deepseek-ai/DeepSeek-R1-Distill-Qwen-32B

text-gen
32B 1,099,174 downloads 1,554 likes
View Hardware

farbodtavakkoli/OTel-LLM-8.3B-IT

farbodtavakkoli/OTel-LLM-8.3B-IT

text-gen
8.3B 1,093,537 downloads 1 likes
View Hardware

deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct

deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct

text-gen
1,065,957 downloads 590 likes
View Hardware

Qwen/Qwen2.5-Coder-14B-Instruct

Qwen/Qwen2.5-Coder-14B-Instruct

text-gen
14B 1,059,603 downloads 151 likes
View Hardware

Qwen/Qwen3Guard-Gen-0.6B

Qwen/Qwen3Guard-Gen-0.6B

text-gen
0.6B 1,050,890 downloads 71 likes
View Hardware

Qwen/Qwen2.5-1.5B

Qwen/Qwen2.5-1.5B

text-gen
1.5B 1,040,615 downloads 176 likes
View Hardware

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

text-gen
32B 1,021,659 downloads 35 likes
View Hardware

h2oai/h2ovl-mississippi-800m

h2oai/h2ovl-mississippi-800m

text-gen
998,457 downloads 39 likes
View Hardware

h2oai/h2ovl-mississippi-2b

h2oai/h2ovl-mississippi-2b

text-gen
2B 976,271 downloads 42 likes
View Hardware

Qwen/Qwen3-Coder-Next

Qwen/Qwen3-Coder-Next

text-gen
971,785 downloads 1,340 likes
View Hardware

RedHatAI/Llama-3.2-1B-Instruct-FP8

RedHatAI/Llama-3.2-1B-Instruct-FP8

text-gen
1B 965,841 downloads 3 likes
View Hardware

MiniMaxAI/MiniMax-M2.5

MiniMaxAI/MiniMax-M2.5

text-gen
961,976 downloads 1,467 likes
View Hardware

Qwen/Qwen3-4B-Thinking-2507

Qwen/Qwen3-4B-Thinking-2507

text-gen
4B 928,670 downloads 581 likes
View Hardware

nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

text-gen
120B 915,254 downloads 290 likes
View Hardware

deepseek-ai/DeepSeek-V2-Lite-Chat

deepseek-ai/DeepSeek-V2-Lite-Chat

text-gen
913,615 downloads 137 likes
View Hardware

farbodtavakkoli/OTel-LLM-1.2B-IT

farbodtavakkoli/OTel-LLM-1.2B-IT

text-gen
1.2B 905,748 downloads 0 likes
View Hardware

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Qwen/Qwen2.5-1.5B-Instruct-AWQ

text-gen
1.5B 879,520 downloads 7 likes
View Hardware

sshleifer/tiny-gpt2

sshleifer/tiny-gpt2

text-gen
874,003 downloads 35 likes
View Hardware

openai-community/gpt2-medium

openai-community/gpt2-medium

text-gen
856,645 downloads 200 likes
View Hardware

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

text-gen
14B 840,207 downloads 17 likes
View Hardware

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

text-gen
1B 821,603 downloads 46 likes
View Hardware

nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8

nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8

text-gen
30B 819,391 downloads 339 likes
View Hardware

nvidia/Llama-3.1-8B-Instruct-FP8

nvidia/Llama-3.1-8B-Instruct-FP8

text-gen
8B 807,995 downloads 35 likes
View Hardware

zai-org/GLM-5.1-FP8

zai-org/GLM-5.1-FP8

text-gen
795,053 downloads 99 likes
View Hardware

Qwen/Qwen3-14B-AWQ

Qwen/Qwen3-14B-AWQ

text-gen
14B 777,941 downloads 63 likes
View Hardware

TheBloke/TinyLlama-1.1B-Chat-v0.3-GPTQ

TheBloke/TinyLlama-1.1B-Chat-v0.3-GPTQ

text-gen
1.1B 757,496 downloads 10 likes
View Hardware

allenai/Olmo-3-7B-Instruct

allenai/Olmo-3-7B-Instruct

text-gen
7B 756,748 downloads 128 likes
View Hardware

Qwen/Qwen2-0.5B-Instruct

Qwen/Qwen2-0.5B-Instruct

text-gen
0.5B 742,302 downloads 200 likes
View Hardware

nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16

nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16

text-gen
120B 736,923 downloads 344 likes
View Hardware

meta-llama/Llama-3.1-70B-Instruct

meta-llama/Llama-3.1-70B-Instruct

text-gen
70B 731,969 downloads 910 likes
View Hardware

unsloth/Llama-3.1-8B-Instruct

unsloth/Llama-3.1-8B-Instruct

text-gen
8B 729,916 downloads 9 likes
View Hardware

cyankiwi/GLM-4.7-Flash-AWQ-4bit

cyankiwi/GLM-4.7-Flash-AWQ-4bit

text-gen
728,971 downloads 51 likes
View Hardware

microsoft/Phi-3-mini-4k-instruct

microsoft/Phi-3-mini-4k-instruct

text-gen
723,680 downloads 1,415 likes
View Hardware

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int4

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int4

text-gen
7B 720,606 downloads 13 likes
View Hardware

microsoft/Phi-3.5-mini-instruct

microsoft/Phi-3.5-mini-instruct

text-gen
720,381 downloads 975 likes
View Hardware

microsoft/Phi-tiny-MoE-instruct

microsoft/Phi-tiny-MoE-instruct

text-gen
716,403 downloads 35 likes
View Hardware

meta-llama/Llama-3.3-70B-Instruct

meta-llama/Llama-3.3-70B-Instruct

text-gen
70B 707,346 downloads 2,748 likes
View Hardware

Qwen/Qwen3-32B-AWQ

Qwen/Qwen3-32B-AWQ

text-gen
32B 707,044 downloads 131 likes
View Hardware

Qwen/Qwen2.5-32B-Instruct

Qwen/Qwen2.5-32B-Instruct

text-gen
32B 706,599 downloads 349 likes
View Hardware

Qwen/Qwen3-4B-Instruct-2507-FP8

Qwen/Qwen3-4B-Instruct-2507-FP8

text-gen
4B 703,609 downloads 75 likes
View Hardware

zerofata/L3.3-GeneticLemonade-Final-v2-70B

zerofata/L3.3-GeneticLemonade-Final-v2-70B

text-gen
70B 695,411 downloads 11 likes
View Hardware

QuantTrio/Qwen3-VL-30B-A3B-Instruct-AWQ

QuantTrio/Qwen3-VL-30B-A3B-Instruct-AWQ

text-gen
30B 695,408 downloads 42 likes
View Hardware

Qwen/Qwen2.5-72B-Instruct-AWQ

Qwen/Qwen2.5-72B-Instruct-AWQ

text-gen
72B 676,950 downloads 76 likes
View Hardware

farbodtavakkoli/OTel-LLM-0.6B-IT

farbodtavakkoli/OTel-LLM-0.6B-IT

text-gen
0.6B 669,484 downloads 0 likes
View Hardware

moonshotai/Kimi-K2-Instruct-0905

moonshotai/Kimi-K2-Instruct-0905

text-gen
666,120 downloads 707 likes
View Hardware

microsoft/phi-4

microsoft/phi-4

text-gen
657,336 downloads 2,238 likes
View Hardware

zai-org/GLM-4.7-Flash

zai-org/GLM-4.7-Flash

text-gen
652,731 downloads 1,720 likes
View Hardware

deepseek-ai/DeepSeek-V3-0324

deepseek-ai/DeepSeek-V3-0324

text-gen
651,318 downloads 3,109 likes
View Hardware

Qwen/Qwen3-4B-AWQ

Qwen/Qwen3-4B-AWQ

text-gen
4B 642,576 downloads 27 likes
View Hardware

Qwen/Qwen2-7B-Instruct

Qwen/Qwen2-7B-Instruct

text-gen
7B 638,783 downloads 684 likes
View Hardware

nvidia/Qwen3.5-397B-A17B-NVFP4

nvidia/Qwen3.5-397B-A17B-NVFP4

text-gen
397B 621,577 downloads 94 likes
View Hardware

KomeijiForce/bart-large-emojilm

KomeijiForce/bart-large-emojilm

text-gen
621,459 downloads 0 likes
View Hardware

Qwen/Qwen2.5-Coder-1.5B

Qwen/Qwen2.5-Coder-1.5B

text-gen
1.5B 612,131 downloads 91 likes
View Hardware

mlx-community/gpt-oss-20b-MXFP4-Q8

mlx-community/gpt-oss-20b-MXFP4-Q8

text-gen
20B 605,593 downloads 55 likes
View Hardware

bartowski/gemma-2-2b-it-GGUF

bartowski/gemma-2-2b-it-GGUF

text-gen
2B 604,528 downloads 94 likes
View Hardware

deepseek-ai/DeepSeek-R1-Distill-Qwen-7B

deepseek-ai/DeepSeek-R1-Distill-Qwen-7B

text-gen
7B 594,642 downloads 827 likes
View Hardware

microsoft/phi-2

microsoft/phi-2

text-gen
589,206 downloads 3,448 likes
View Hardware

Qwen/Qwen3-235B-A22B

Qwen/Qwen3-235B-A22B

text-gen
235B 588,224 downloads 1,091 likes
View Hardware

nvidia/NVIDIA-Nemotron-Nano-9B-v2

nvidia/NVIDIA-Nemotron-Nano-9B-v2

text-gen
9B 576,809 downloads 490 likes
View Hardware

Qwen/Qwen3-1.7B-Base

Qwen/Qwen3-1.7B-Base

text-gen
1.7B 569,987 downloads 72 likes
View Hardware

ricdomolm/mini-coder-1.7b

ricdomolm/mini-coder-1.7b

text-gen
1.7B 569,617 downloads 2 likes
View Hardware

HuggingFaceM4/tiny-random-LlamaForCausalLM

HuggingFaceM4/tiny-random-LlamaForCausalLM

text-gen
569,006 downloads 20 likes
View Hardware

moonshotai/Kimi-K2-Instruct

moonshotai/Kimi-K2-Instruct

text-gen
566,362 downloads 2,356 likes
View Hardware

google/gemma-3-1b-it

google/gemma-3-1b-it

text-gen
1B 566,353 downloads 943 likes
View Hardware

Qwen/Qwen2.5-Math-7B

Qwen/Qwen2.5-Math-7B

text-gen
7B 563,377 downloads 109 likes
View Hardware

unsloth/GLM-4.7-Flash

unsloth/GLM-4.7-Flash

text-gen
558,967 downloads 15 likes
View Hardware

peft-internal-testing/tiny-random-OPTForCausalLM

peft-internal-testing/tiny-random-OPTForCausalLM

text-gen
557,442 downloads 0 likes
View Hardware

trl-internal-testing/tiny-GptOssForCausalLM

trl-internal-testing/tiny-GptOssForCausalLM

text-gen
548,847 downloads 4 likes
View Hardware

MiniMaxAI/MiniMax-M2.7

MiniMaxAI/MiniMax-M2.7

text-gen
547,360 downloads 1,097 likes
View Hardware

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

text-gen
32B 543,758 downloads 40 likes
View Hardware

Qwen/Qwen3-8B-Base

Qwen/Qwen3-8B-Base

text-gen
8B 533,366 downloads 100 likes
View Hardware

bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

text-gen
7B 519,429 downloads 46 likes
View Hardware

Qwen/Qwen3-1.7B-GPTQ-Int8

Qwen/Qwen3-1.7B-GPTQ-Int8

text-gen
1.7B 514,369 downloads 7 likes
View Hardware

kosbu/Llama-3.3-70B-Instruct-AWQ

kosbu/Llama-3.3-70B-Instruct-AWQ

text-gen
70B 512,259 downloads 11 likes
View Hardware

GSAI-ML/LLaDA-8B-Instruct

GSAI-ML/LLaDA-8B-Instruct

text-gen
8B 508,944 downloads 356 likes
View Hardware

mlx-community/Kimi-K2.5

mlx-community/Kimi-K2.5

text-gen
500,918 downloads 34 likes
View Hardware

trl-internal-testing/tiny-random-LlamaForCausalLM

trl-internal-testing/tiny-random-LlamaForCausalLM

text-gen
500,318 downloads 8 likes
View Hardware

LilaRest/gemma-4-31B-it-NVFP4-turbo

LilaRest/gemma-4-31B-it-NVFP4-turbo

text-gen
31B 481,712 downloads 267 likes
View Hardware

google/gemma-2-9b-it

google/gemma-2-9b-it

text-gen
9B 478,279 downloads 794 likes
View Hardware

EleutherAI/gpt-neo-125m

EleutherAI/gpt-neo-125m

text-gen
475,976 downloads 228 likes
View Hardware

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8

text-gen
8B 468,523 downloads 44 likes
View Hardware

TechxGenus/DeepSeek-Coder-V2-Lite-Instruct-AWQ

TechxGenus/DeepSeek-Coder-V2-Lite-Instruct-AWQ

text-gen
463,886 downloads 9 likes
View Hardware

deepseek-ai/DeepSeek-R1-Distill-Qwen-14B

deepseek-ai/DeepSeek-R1-Distill-Qwen-14B

text-gen
14B 463,419 downloads 637 likes
View Hardware

Qwen/Qwen3-Coder-30B-A3B-Instruct-FP8

Qwen/Qwen3-Coder-30B-A3B-Instruct-FP8

text-gen
30B 462,439 downloads 180 likes
View Hardware

huihui-ai/Qwen2.5-72B-Instruct-abliterated

huihui-ai/Qwen2.5-72B-Instruct-abliterated

text-gen
72B 459,735 downloads 45 likes
View Hardware

K-Compression/HyperCLOVAX-SEED-Think-14B-GPTQ

K-Compression/HyperCLOVAX-SEED-Think-14B-GPTQ

text-gen
14B 456,111 downloads 0 likes
View Hardware

Qwen/Qwen2.5-Math-1.5B

Qwen/Qwen2.5-Math-1.5B

text-gen
1.5B 454,936 downloads 107 likes
View Hardware

zai-org/GLM-5

zai-org/GLM-5

text-gen
448,759 downloads 2,080 likes
View Hardware

NexVeridian/Qwen3-Coder-Next-8bit

NexVeridian/Qwen3-Coder-Next-8bit

text-gen
446,609 downloads 3 likes
View Hardware

bineric/lynx-instruct-30b

bineric/lynx-instruct-30b

text-gen
30B 443,693 downloads 3 likes
View Hardware

trl-internal-testing/tiny-Qwen3ForCausalLM

trl-internal-testing/tiny-Qwen3ForCausalLM

text-gen
440,019 downloads 1 likes
View Hardware

Qwen/Qwen2.5-72B-Instruct

Qwen/Qwen2.5-72B-Instruct

text-gen
72B 438,771 downloads 934 likes
View Hardware

Qwen/Qwen2.5-Coder-3B-Instruct

Qwen/Qwen2.5-Coder-3B-Instruct

text-gen
3B 438,497 downloads 104 likes
View Hardware

Qwen/Qwen2-0.5B

Qwen/Qwen2-0.5B

text-gen
0.5B 436,707 downloads 166 likes
View Hardware

farbodtavakkoli/OTel-LLM-1B-IT

farbodtavakkoli/OTel-LLM-1B-IT

text-gen
1B 433,807 downloads 1 likes
View Hardware

QuantTrio/Qwen3-Coder-30B-A3B-Instruct-AWQ

QuantTrio/Qwen3-Coder-30B-A3B-Instruct-AWQ

text-gen
30B 432,910 downloads 6 likes
View Hardware

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

text-gen
8B 432,384 downloads 99 likes
View Hardware

lmstudio-community/DeepSeek-R1-0528-Qwen3-8B-MLX-4bit

lmstudio-community/DeepSeek-R1-0528-Qwen3-8B-MLX-4bit

text-gen
8B 431,844 downloads 9 likes
View Hardware

farbodtavakkoli/OTel-LLM-270M-IT

farbodtavakkoli/OTel-LLM-270M-IT

text-gen
429,550 downloads 0 likes
View Hardware

lmstudio-community/LFM2-24B-A2B-MLX-4bit

lmstudio-community/LFM2-24B-A2B-MLX-4bit

text-gen
24B 428,374 downloads 4 likes
View Hardware

lmstudio-community/LFM2-24B-A2B-MLX-8bit

lmstudio-community/LFM2-24B-A2B-MLX-8bit

text-gen
24B 424,625 downloads 2 likes
View Hardware

lmstudio-community/LFM2-24B-A2B-MLX-6bit

lmstudio-community/LFM2-24B-A2B-MLX-6bit

text-gen
24B 424,028 downloads 3 likes
View Hardware

entropy/gpt2_zinc_87m

entropy/gpt2_zinc_87m

text-gen
423,777 downloads 4 likes
View Hardware

lmstudio-community/LFM2-24B-A2B-MLX-5bit

lmstudio-community/LFM2-24B-A2B-MLX-5bit

text-gen
24B 423,726 downloads 1 likes
View Hardware

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

text-gen
24B 423,607 downloads 29 likes
View Hardware

mistralai/Mistral-7B-Instruct-v0.1

mistralai/Mistral-7B-Instruct-v0.1

text-gen
7B 422,823 downloads 1,833 likes
View Hardware

Qwen/Qwen2.5-3B

Qwen/Qwen2.5-3B

text-gen
3B 418,054 downloads 178 likes
View Hardware

meta-llama/Llama-2-7b-chat-hf

meta-llama/Llama-2-7b-chat-hf

text-gen
7B 415,889 downloads 4,747 likes
View Hardware

zai-org/GLM-4.5-Air

zai-org/GLM-4.5-Air

text-gen
411,740 downloads 600 likes
View Hardware

deepseek-ai/DeepSeek-V2-Lite

deepseek-ai/DeepSeek-V2-Lite

text-gen
410,418 downloads 173 likes
View Hardware

LiquidAI/LFM2.5-1.2B-Instruct

LiquidAI/LFM2.5-1.2B-Instruct

text-gen
1.2B 406,678 downloads 577 likes
View Hardware

IlyaGusev/saiga_llama3_8b

IlyaGusev/saiga_llama3_8b

text-gen
8B 402,631 downloads 140 likes
View Hardware

ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4

ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4

text-gen
70B 397,322 downloads 31 likes
View Hardware

lmstudio-community/DeepSeek-R1-0528-Qwen3-8B-MLX-8bit

lmstudio-community/DeepSeek-R1-0528-Qwen3-8B-MLX-8bit

text-gen
8B 396,525 downloads 17 likes
View Hardware

ibm-granite/granite-4.0-micro

ibm-granite/granite-4.0-micro

text-gen
393,187 downloads 271 likes
View Hardware

unsloth/mistral-7b-v0.3-bnb-4bit

unsloth/mistral-7b-v0.3-bnb-4bit

text-gen
7B 392,019 downloads 22 likes
View Hardware

janhq/Jan-v3.5-4B-gguf

janhq/Jan-v3.5-4B-gguf

text-gen
4B 391,316 downloads 13 likes
View Hardware

bg-digitalservices/Gemma-4-26B-A4B-it-NVFP4

bg-digitalservices/Gemma-4-26B-A4B-it-NVFP4

text-gen
26B 390,642 downloads 25 likes
View Hardware

skt/kogpt2-base-v2

skt/kogpt2-base-v2

text-gen
386,770 downloads 61 likes
View Hardware

deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B

deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B

text-gen
1.5B 385,005 downloads 1,498 likes
View Hardware

Qwen/Qwen3-Coder-Next-FP8

Qwen/Qwen3-Coder-Next-FP8

text-gen
383,125 downloads 140 likes
View Hardware

deepseek-ai/DeepSeek-V4-Pro

deepseek-ai/DeepSeek-V4-Pro

text-gen
381,587 downloads 3,414 likes
View Hardware

prefeitura-rio/Rio-3.0-Open-Mini

prefeitura-rio/Rio-3.0-Open-Mini

text-gen
4B 376,000 downloads 8 likes
View Hardware

bigscience/bloom-560m

bigscience/bloom-560m

text-gen
373,325 downloads 371 likes
View Hardware

state-spaces/mamba-130m-hf

state-spaces/mamba-130m-hf

text-gen
371,941 downloads 70 likes
View Hardware

hmellor/tiny-random-BambaForCausalLM

hmellor/tiny-random-BambaForCausalLM

text-gen
360,553 downloads 0 likes
View Hardware

google/gemma-2-2b-it

google/gemma-2-2b-it

text-gen
2B 358,691 downloads 1,345 likes
View Hardware

Qwen/Qwen3-235B-A22B-Instruct-2507-FP8

Qwen/Qwen3-235B-A22B-Instruct-2507-FP8

text-gen
235B 355,830 downloads 147 likes
View Hardware

Showing first 200 models. Use search to find specific models.