Qiang Gao
@gaoqiang_nlp
a third year master student at Wuhan University, focusing on the natural language processing area. I'm actively looking for a PhD position for 2025Fall.
Since everyone wants to learn RL for language models now post DeepSeek, reminder that I've been working on this book quietly in the background for months. Policy gradient chapter is coming together. Plugging away at the book every day now. rlhfbook dot com
The new chatGPT 4o with Canvas system prompt:
This is the best use for of a drone I've ever seen 😭
don’t worry about it babe it’s just a brand
Congratulations to the new faculty members in @MITEngineering, including Media Lab alum Anna Huang (@huangcza)! Huang will hold a joint appointment in @MITEECS and MIT Music and Theater Arts. news.mit.edu/2024/school-en…
The Top ML Papers of the Week (May 27 - June 2): - SimPO - GNN-RAG - Attention as an RNN - Abacus Embeddings - Symbolic Chain-of-Thought - Contextual Position Encoding ...
I've been thinking about the many, MANY, DPO spinoff methods we've been seeing recently for rlhf. IPO, D2PO, CPO, ORPO, SPO, sDPO, KTO, DNO... Most claim they're "the best" but doesn't properly compare to related work. What do we do in alignment research? Thread 📚
🎉 Exciting News! 🎉 Just open-sourced my latest project: Llama3-based 8x8b-MoE model! 🚀 Extends llama3-8B-Instruct model with MoE architecture. Check it out & give it a star! github.com/cooper12121/ll…
If you really want to do something useful in AI, instead of training another tiny llama, pick up this project hazyresearch.stanford.edu/blog/2024-01-1… and train a 1B-parameter multilingual BERT with 32k input size. The code is here github.com/HazyResearch/m2. The data is all over @huggingface. The…
To close out 2023, here are 10 of the most interesting AI research advancements we shared on our feed this year — and where you can find more details on the work. 1️⃣ Segment Anything (SAM) A step toward the first foundation model for image segmentation. Details:…
Alibaba releases DreaMoving demo on Hugging Face A Human Video Generation Framework based on Diffusion Models demo: huggingface.co/spaces/jiayong…
Key vulnerabilities of GPT-4: 1. Fine-tuning API can remove or diminish safety guardrails, causing the model to produce harmful outputs or assist with dangerous requests 2. Fine-tuning can make the model generate targeted misinformation against public figures 3. Fine-tuning…
If you're not using AI, you're falling behind.
//#つぶやきProcessing int n=999999,p[]=new int[n],i,j; float t=1; void setup(){ size(800,800); for(i=2;i<n;i++)if(p[i]==0)for(j=i+i;j<n;j+=i)p[j]=i; } void draw(){ clear(); stroke(-1); for(i=2;i<n;i++)if(p[i]==0)circle(i*sin(i*t)/99+400,i*cos(i*t)/99+400,2); t+=1e-7; }
Foundation models are transforming society: in the past month alone, we've seen a flurry of releases! GPT-4, Claude, PaLM API, Alpaca, Dolly, Jurassic-2, PaLM-E, GPT4All, Cerebras-GPT, OpenFlamingo, ... We built Ecosystem Graphs to track their footprint: crfm.stanford.edu/ecosystem-grap…
4 essential books anyone should read: • Machine Learning with PyTorch and Scikit-Learn • Transformers for NLP • Deep Learning with Python • Designing Machine Learning Systems
United States Xu hướng
- 1. Pat Spencer 1,801 posts
- 2. Jimmy Butler 2,164 posts
- 3. Mark Pope 1,775 posts
- 4. Podz 2,230 posts
- 5. Seth Curry 2,894 posts
- 6. Kerr 3,885 posts
- 7. Derek Dixon 1,126 posts
- 8. Carter Hart 3,510 posts
- 9. Hield 1,132 posts
- 10. #DubNation 1,215 posts
- 11. Brunson 7,212 posts
- 12. Knicks 14K posts
- 13. Connor Bedard 1,984 posts
- 14. Kentucky 29.3K posts
- 15. Jaylen Brown 8,296 posts
- 16. Celtics 15.8K posts
- 17. Caleb Wilson 1,065 posts
- 18. Notre Dame 38.1K posts
- 19. Van Epps 129K posts
- 20. Bama 24.5K posts
Something went wrong.
Something went wrong.