Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

krishnateja95 updated a model about 10 hours ago

inference-optimization/thinkingmachines-Inkling-speculator.dflash

krishnateja95 published a model about 10 hours ago

inference-optimization/thinkingmachines-Inkling-speculator.dflash

nm-research updated a model about 18 hours ago

inference-optimization/Qwen3-8B-DFlash-b16-fullinstruct-muon1e3-ckpt1

View all activity

inference-optimization 's models 210

inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w4a16

Text Generation • 32B • Updated May 20 • 11

inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w8a8

Text Generation • 235B • Updated May 20 • 6

inference-optimization/Qwen3-235B-A22B-Instruct-2507-quantized.w4a16

Text Generation • 32B • Updated May 20 • 13

inference-optimization/Qwen3.6-35B-A3B-6.0-bits-mode-hybrid

Image-Text-to-Text • 28B • Updated May 20 • 119

inference-optimization/Gemma4_SWA_DFLASH

4B • Updated May 19 • 6

inference-optimization/DSV4-tiny-empty

3B • Updated May 18 • 2.34k

inference-optimization/final-ctest-Qwen3-8B-speculator.dflash

2B • Updated May 13 • 5

inference-optimization/qwen3-8b-peagle-speculators

inference-optimization/peagle-gemma4

2B • Updated May 6

inference-optimization/ctest-Qwen3.5-9B-speculator.dflash

2B • Updated May 5 • 4

inference-optimization/MiniMax-M2.5-BF16

Text Generation • 229B • Updated May 5 • 7

inference-optimization/ctest-Qwen3-8B-speculator.dflash

2B • Updated May 5 • 9

inference-optimization/DeepSeek-V4-Flash-bf16-NVFP4-FP8-BLOCK

inference-optimization/DeepSeek-V4-Flash-bf16

inference-optimization/DeepSeek-V4-Flash-5layers-nvfp4moe

20B • Updated Apr 28 • 7

inference-optimization/DeepSeek-V4-Flash-bf16-dequantized-5layers

34B • Updated Apr 28 • 3

inference-optimization/Qwen3.6-35B-A3B-NVFP4

Updated Apr 23 • 7

inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-gptq

2B • Updated Apr 22 • 2

inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-qmod

2B • Updated Apr 22

inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-qmod

5B • Updated Apr 22 • 2

inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-gptq

5B • Updated Apr 22 • 3

inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-gptq

2B • Updated Apr 22 • 5

inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-qmod

2B • Updated Apr 22 • 1

inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-qmod

5B • Updated Apr 22 • 2

inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-gptq

5B • Updated Apr 22 • 4

inference-optimization/Meta-Llama-3-8B-Instruct-W4A16_actorder_group

2B • Updated Apr 20 • 1

inference-optimization/llama3-8b-sharegpt-5k-gen

inference-optimization/Llama-3.2-3B-Instruct-FP8-Block

3B • Updated Apr 7 • 4

inference-optimization/Llama-3.2-1B-Instruct-FP8-Block

1B • Updated Apr 7 • 3

inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt5-speculator.eagle3

0.9B • Updated Apr 1 • 3