Collection by
Jan 30
Jan 30Collections
Discover the best community collections!
Collections including paper arxiv:2401.10241
Collection by
Jan 30
Jan 30Collection by
Jan 28, 2024
Jan 28, 2024Collection by
Mar 5
Mar 5-
Zero Bubble Pipeline Parallelism
Paper • 2401.10241 • Published • 25 -
Pipeline Parallelism with Controllable Memory
Paper • 2405.15362 • Published • 3 -
Balancing Pipeline Parallelism with Vocabulary Parallelism
Paper • 2411.05288 • Published • 20 -
PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization
Paper • 2503.01328 • Published • 16
Collection by
Feb 23, 2024
Feb 23, 2024-
Blending Is All You Need: Cheaper, Better Alternative to Trillion-Parameters LLM
Paper • 2401.02994 • Published • 52 -
Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
Paper • 2401.05566 • Published • 30 -
TrustLLM: Trustworthiness in Large Language Models
Paper • 2401.05561 • Published • 69 -
Zero Bubble Pipeline Parallelism
Paper • 2401.10241 • Published • 25
Collection by
Jan 30
Jan 30Collection by
Jan 30
Jan 30Collection by
May 3
May 3-
DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Search
Paper • 2408.08152 • Published • 60 -
ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition
Paper • 2402.15220 • Published • 22 -
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
Paper • 2402.19427 • Published • 56 -
Simple linear attention language models balance the recall-throughput tradeoff
Paper • 2402.18668 • Published • 20
Collection by
Jan 22, 2024
Jan 22, 2024Collection by
Jun 27, 2024
Jun 27, 2024-
LLM in a flash: Efficient Large Language Model Inference with Limited Memory
Paper • 2312.11514 • Published • 260 -
PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU
Paper • 2312.12456 • Published • 44 -
Accelerating LLM Inference with Staged Speculative Decoding
Paper • 2308.04623 • Published • 25 -
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Paper • 2208.07339 • Published • 5
Collection by
Jan 30
Jan 30Collection by
Jan 30
Jan 30Collection by
Jan 30
Jan 30Collection by
Jan 30
Jan 30Collection by
Jan 28, 2024
Jan 28, 2024Collection by
May 3
May 3-
DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Search
Paper • 2408.08152 • Published • 60 -
ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition
Paper • 2402.15220 • Published • 22 -
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
Paper • 2402.19427 • Published • 56 -
Simple linear attention language models balance the recall-throughput tradeoff
Paper • 2402.18668 • Published • 20
Collection by
Mar 5
Mar 5-
Zero Bubble Pipeline Parallelism
Paper • 2401.10241 • Published • 25 -
Pipeline Parallelism with Controllable Memory
Paper • 2405.15362 • Published • 3 -
Balancing Pipeline Parallelism with Vocabulary Parallelism
Paper • 2411.05288 • Published • 20 -
PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization
Paper • 2503.01328 • Published • 16
Collection by
Jan 22, 2024
Jan 22, 2024Collection by
Feb 23, 2024
Feb 23, 2024-
Blending Is All You Need: Cheaper, Better Alternative to Trillion-Parameters LLM
Paper • 2401.02994 • Published • 52 -
Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
Paper • 2401.05566 • Published • 30 -
TrustLLM: Trustworthiness in Large Language Models
Paper • 2401.05561 • Published • 69 -
Zero Bubble Pipeline Parallelism
Paper • 2401.10241 • Published • 25
Collection by
Jun 27, 2024
Jun 27, 2024-
LLM in a flash: Efficient Large Language Model Inference with Limited Memory
Paper • 2312.11514 • Published • 260 -
PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU
Paper • 2312.12456 • Published • 44 -
Accelerating LLM Inference with Staged Speculative Decoding
Paper • 2308.04623 • Published • 25 -
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Paper • 2208.07339 • Published • 5