33 2 7

Benjamin Marie PRO

bnjmnmarie

https://kaitchup.substack.com/

bnjmn_marie

AI & ML interests

None yet

Recent Activity

new activity about 16 hours ago

kaitchup/Olmo-3.1-32B-Instruct-fp8-dynamic:Error running vllm 12

updated a model about 16 hours ago

kaitchup/Olmo-3.1-32B-Instruct-fp8-dynamic

updated a collection about 21 hours ago

Quantized Qwen3 2512

View all activity

Organizations

New activity in kaitchup/Olmo-3.1-32B-Instruct-fp8-dynamic about 16 hours ago

Error running vllm 12

#1 opened about 17 hours ago by

evetsagg

New activity in mistralai/Ministral-3-14B-Reasoning-2512 27 days ago

Reasoning not parsing correctly within VLLM

#4 opened 29 days ago by

SuperbEmphasis

New activity in Firworks/INTELLECT-3-nvfp4 about 1 month ago

works with vLLM, with FLASHINFER_MOE_FP4

#2 opened about 1 month ago by

bnjmnmarie

New activity in kaitchup/Olmo-3-7B-Instruct-fp8-dynamic about 1 month ago

Update README.md

#1 opened about 1 month ago by

bmarie

New activity in microsoft/UserLM-8b 2 months ago

Question about Llama 3.1 license compliance

😎 👍 6

#3 opened 3 months ago by

tokinasin

New activity in unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF 5 months ago

qwen3moe instead of qwen3_moe?

#5 opened 5 months ago by

bnjmnmarie

New activity in kaitchup-toolboxes/Qwen2.5 9 months ago

How can I get the access?

#1 opened 9 months ago by

minjunsz

New activity in kaitchup/Qwen2.5-72B-Instruct-AutoRound-GPTQ-4bit 9 months ago

how to run this model

#1 opened 9 months ago by

cicdatopea

New activity in kaitchup/QwQ-32B-AutoRoundGPTQ-4bit 9 months ago

Qwen-32B overflow issue

#1 opened 10 months ago by

cicdatopea

New activity in kaitchup/Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bit 10 months ago

Your quants are not listed in the base model

#2 opened 10 months ago by

dazipe

New activity in kaitchup/Mistral-Small-24B-Instruct-2501-AutoRound-GPTQ-4bit 11 months ago

Any plan for 8 bit?

#1 opened 11 months ago by

jm4n21

New activity in kaitchup-toolboxes/Llama3 12 months ago

github?

#2 opened 12 months ago by

silvacarl

New activity in kaitchup/Mistral-Nemo-Base-2407-AutoRound-GPTQ-asym-4bit 12 months ago

Request for Mistral Large 2 Instruct 2407 3bit with Autoround GPTQ

#1 opened 12 months ago by

MLDataScientist

New activity in kaitchup/Qwen2.5-Coder-32B-Instruct-AutoRound-GPTQ-2bit about 1 year ago

Update README.md

#1 opened about 1 year ago by

bmarie

New activity in kaitchup/Mistral-NeMo-Minitron-8B-Base-AutoRound-GPTQ-sym-4bit about 1 year ago

Mistral-large 2bit?

#1 opened about 1 year ago by

KnutJaegersberg

New activity in kaitchup-toolboxes/Llama3 about 1 year ago

SFT notebooks

#1 opened about 1 year ago by

silvacarl

New activity in kaitchup/qa-chat-persona-education about 1 year ago

Librarian Bot: Add language metadata for dataset

#2 opened about 1 year ago by

librarian-bot

New activity in kaitchup/OpenELM-270M-oasstguanaco-2e-ORPO over 1 year ago

Good, but it doesn't stop

#1 opened over 1 year ago by

FM-1976

New activity in kaitchup/Mistral-7B-v0.1-gptq-2bit almost 2 years ago

Does this quantized model adequately work？

#1 opened almost 2 years ago by

Dtree07

New activity in kaitchup/Llama-2-7b-mt-German-to-English almost 2 years ago

Loading the Model

#1 opened almost 2 years ago by deleted

Benjamin Marie PRO

AI & ML interests

Recent Activity

Organizations

bnjmnmarie's activity

Error running vllm 12

Reasoning not parsing correctly within VLLM

works with vLLM, with FLASHINFER_MOE_FP4

Update README.md

Question about Llama 3.1 license compliance

qwen3moe instead of qwen3_moe?

How can I get the access?

how to run this model

Qwen-32B overflow issue

Your quants are not listed in the base model

Any plan for 8 bit?

github?

Request for Mistral Large 2 Instruct 2407 3bit with Autoround GPTQ

Update README.md

Mistral-large 2bit?

SFT notebooks

Librarian Bot: Add language metadata for dataset

Good, but it doesn't stop

Does this quantized model adequately work？

Loading the Model