Article
Ultra-Long Sequence Parallelism: Ulysses + Ring-Attention Technical Principles and Implementation
By
•
•
5Jintao Huang
study-hjt
AI & ML interests
None yet
Recent Activity
new activity
about 1 month ago
Qwen/Qwen3-VL-235B-A22B-Instruct:🚀 Qwen3-VL Fine-tuning support. (transformers & Megatron)
new activity
about 1 month ago
Qwen/Qwen3-Omni-30B-A3B-Instruct:🚀 Qwen3-Omni Fine-tuning support. (transformers & Megatron)
upvoted
an
article
about 1 month ago
Ultra-Long Sequence Parallelism: Ulysses + Ring-Attention Technical Principles and Implementation
Organizations
