Barret Zoph: Thanks for having us on! Was fun t...| Robocrunch AI

Thanks for having us on!

Was fun talking about model sparsity and how conditional computation can be a useful for the future of LLMs. https://t.co/vilNWeXIuW
— Barret Zoph (@barret_zoph) April 28, 2022

https://twitter.com/ic4ai/status/1519684776327790592

Super looking forward to this! Coming up this Thursday on the MMLL webinar series: Prof. @andre_t_martins will tell us all about sparsity in D ...

Shared by Wilker Aziz at 5/10/2022 3-6

https://twitter.com/SomosNLP_/status/1506950281438900231

Lewis (@_lewtun) knows a lot about models #optimization. Don't hesitate to ask about it!!!

Shared by Manu Romero at 3/24/2022 1-1

https://twitter.com/jeremiecharris/status/1516798040752934914

Thanks for hosting us, Jeremie! Enjoyed discussing sparse expert models and how their role in scaling up our language models (and more).

Shared by William Fedus at 4/20/2022 0-3

https://twitter.com/charlinelelan/status/1508937537972285445

Tomorrow at #AISTATS2022 @charlinelelan is presenting our work on understanding how the choice of representation (and e.g. deep RL losses) affec ...

Shared by Marc G. Bellemare at 3/29/2022 2-8

http://arxiv.org/abs/2202.08906

Interested in using sparse expert models, but find they are unstable, hard to design or don’t fine-tune well? We address these key issues and t ...

Shared by Barret Zoph at 2/21/2022 1-4

On a related note, I'm working on a constrastive generative LM using a method similar to OpenAI's embedding model by letting it to predict both ...

Shared by Aran Komatsuzaki at 2/15/2022 0-3

768