Article
Speeding Up LLM Decoding with Advanced Universal Assisted Generation Techniques
•
20
Oren Pereg
orenpereg
AI & ML interests
AI, NLP
Recent Activity
upvoted
an
article
16 days ago
Accelerating Qwen3-8B Agent on Intel® Core™ Ultra with Depth-Pruned Draft Models
upvoted
an
article
about 1 month ago
SetFitABSA: Few-Shot Aspect Based Sentiment Analysis using SetFit
updated
a dataset
2 months ago
orenpereg/aime24-evaluation-results_seed-2
Organizations
published
an
article
8 months ago
published
an
article
about 1 year ago
Article
Universal Assisted Generation: Faster Decoding with Any Assistant Model
-
- +6
•
59
published
an
article
about 1 year ago
Article
Faster Assisted Generation with Dynamic Speculation
-
- +5
•
49
published
an
article
over 1 year ago
Article
Blazing Fast SetFit Inference with 🤗 Optimum Intel on Xeon
-
- +4
•
11
published
an
article
almost 2 years ago
Article
Accelerate StarCoder with 🤗 Optimum Intel on Xeon: Q8/Q4 and Speculative Decoding
- +9
•
9
published
an
article
almost 2 years ago
Article
SetFitABSA: Few-Shot Aspect Based Sentiment Analysis using SetFit
-
- +4
•
15
published
an
article
about 3 years ago
Article
SetFit: Efficient Few-Shot Learning Without Prompts
- +4
•
38
published
an
article
about 3 years ago
Article
SetFit: Efficient Few-Shot Learning Without Prompts
-
-
- +4
•
38