neuralink's picture

🔄 In a Training Loop

neuralink

neuralink

·

https://phucnguyen.dev

AI & ML interests

distributed training @nous research. ex-nanotron @huggingface

Recent Activity

upvoted a paper about 1 month ago

Long Context Pre-Training with Lighthouse Attention

upvoted a paper about 1 month ago

Efficient Pre-Training with Token Superposition

published a Space about 2 months ago

neuralink/distill-blog-phuc

View all activity

Organizations

Articles 1

Article

76

A failed experiment: Infini-Attention, and why we should keep trying?

spaces 1

Distill Blog Phuc

Edit and host a simple static web page

models 4

neuralink/llama-doremi

Updated Jan 11, 2024

neuralink/memory

Updated Mar 12, 2023

neuralink/xlm-roberta-base-finetuned-panx-de

Updated Jan 16, 2023

neuralink/cartpole-vanila-policy-gradient

Updated Dec 17, 2022

datasets 0

None public yet