Investigating Low-Rank Training in Transformer Language Models: Efficiency and Scaling Analysis
Paper
•
2407.09835
•
Published
•
1
Skander Moalla
skandermoalla
·
AI & ML interests
DeepRL, RL finetuning
Recent Activity
authored
a paper
2 days ago
Building on Efficient Foundations: Effectively Training LLMs with
Structured Feedforward Layers
authored
a paper
2 days ago
Apertus: Democratizing Open and Compliant LLMs for Global Language
Environments
authored
a paper
2 days ago
Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions
Organizations
upvoted
a
paper
25 days ago