Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
NVIDIA-Nemotron-Nano-9B-v2-quantized.w4a16
like
1
Follow
Red Hat AI
1.58k
Text Generation
Transformers
Safetensors
neuralmagic
redhat
llmcompressor
quantized
INT4
conversational
arxiv:
2210.17323
Model card
Files
Files and versions
xet
Community
Train
Deploy
Use this model
main
NVIDIA-Nemotron-Nano-9B-v2-quantized.w4a16
6.47 GB
1 contributor
History:
3 commits
ekurtic
Create README.md
b5b4ceb
verified
6 days ago
.gitattributes
Safe
1.57 kB
Upload folder using huggingface_hub
6 days ago
README.md
6.05 kB
Create README.md
6 days ago
config.json
2.45 kB
Upload folder using huggingface_hub
6 days ago
configuration_nemotron_h.py
Safe
12.2 kB
Upload folder using huggingface_hub
6 days ago
generation_config.json
Safe
158 Bytes
Upload folder using huggingface_hub
6 days ago
gsm8k_5shot.txt
50.2 kB
Upload folder using huggingface_hub
6 days ago
model-00001-of-00002.safetensors
4.97 GB
xet
Upload folder using huggingface_hub
6 days ago
model-00002-of-00002.safetensors
1.48 GB
xet
Upload folder using huggingface_hub
6 days ago
model.safetensors.index.json
49.2 kB
Upload folder using huggingface_hub
6 days ago
modeling_nemotron_h.py
Safe
78.8 kB
Upload folder using huggingface_hub
6 days ago
nemotron_toolcall_parser_no_streaming.py
Safe
3.72 kB
Upload folder using huggingface_hub
6 days ago
recipe.yaml
680 Bytes
Upload folder using huggingface_hub
6 days ago
special_tokens_map.json
Safe
422 Bytes
Upload folder using huggingface_hub
6 days ago
tokenizer.json
Safe
17.1 MB
xet
Upload folder using huggingface_hub
6 days ago
tokenizer_config.json
Safe
181 kB
Upload folder using huggingface_hub
6 days ago
