LongNet: Scaling Transformers to 1,000,000,000 Tokens
Paper
•
2307.02486
•
Published
•
81
Xingxing Zhang
fantasyorg
AI & ML interests
None yet
Recent Activity
authored
a paper
5 days ago
LongNet: Scaling Transformers to 1,000,000,000 Tokens
authored
a paper
5 days ago
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for
Language Models
authored
a paper
5 days ago
xRAG: Extreme Context Compression for Retrieval-augmented Generation
with One Token
Organizations
None yet
authored
11
papers
5 days ago
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Paper
•
2402.13064
•
Published
•
50
xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token
Paper
•
2405.13792
•
Published
•
1
Preference Optimization for Reasoning with Pseudo Feedback
Paper
•
2411.16345
•
Published
•
1
RedStone: Curating General, Code, Math, and QA Data for Large Language Models
Paper
•
2412.03398
•
Published
•
2
Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm Perspective
Paper
•
2501.11110
•
Published
•
4
Bootstrap Your Own Context Length
Paper
•
2412.18860
•
Published
WildLong: Synthesizing Realistic Long-Context Instruction Data at Scale
Paper
•
2502.16684
•
Published
•
1
Scaling Laws of Synthetic Data for Language Models
Paper
•
2503.19551
•
Published
•
1
Think Only When You Need with Large Hybrid-Reasoning Models
Paper
•
2505.14631
•
Published
•
20
QueST: Incentivizing LLMs to Generate Difficult Problems
Paper
•
2510.17715
•
Published
•
29
upvoted
a
paper
5 days ago
liked
a
model
about 2 months ago
upvoted
a
paper
2 months ago
upvoted
a
paper
5 months ago
liked
a
dataset
8 months ago
liked
a
dataset
about 1 year ago
liked
2
datasets
over 1 year ago