Jack Clark    @jackclarkSF   ·   10/12/2021
Chinese company Inspur comes out with a 245B parameter language model. This follows other Chinese GPT3 equivalents, like Huawei's PanGu. Notable that one of the research contributions from Inspur is a system for massive internet data scraping and filtering.
 Reply      Retweet   25      Like     73    

More by:   Jack Clark
zoom in  

  More Tweets  

Language Log    @LanguageLog   ·   9/23/2021
Sino-French language lessons: Chinese signs from Quora.  Since they are rather lengthy and come with French explanations, I will depart from my usual Language Log treatment of providing Romanizations, transcriptions, and translations for the Chinese. …
 Reply      Retweet   1      Like     3    

More by:   Language Log
zoom in  

Hal Daumé III    @haldaume3   ·   10/11/2021
#nlproc folks: do you work on (any type of) natural language generation #NLG research/system? We'd be grateful if you participated in a 20-min survey to understand evaluation practices! Participants can enter a raffle for 1 of 10 $50 Amazon gift cards!
 Reply      Retweet   23      Like     47    

More by:   Hal Daumé III
zoom in  

Ethan Caballero    @ethancaballero   ·   10/6/2021
China has trained a 10 Trillion parameter language model. "M6-10T: Efficient Multi-Trillion Parameter Pretraining"
 Reply      Retweet   3      Like     2    

More by:   Ethan Caballero
zoom in  

Microsoft Research    @MSFTResearch   ·   10/13/2021
Large language models have come far thanks to deep learning and other methods. Learn how researchers are going beyond language to create tech for multimodal sensing and knowledge reasoning in AI at Microsoft Research Summit:
 Reply      Retweet   1      Like        

More by:   Microsoft Research
zoom in  

  More from:  

Jack Clark
@AnthropicAI, ONEAI OECD, co-chair @indexingai, writer @ Past: @openai, @business @theregister. Neural nets, distributed systems, weird futures

Language Log
Language Log is a group blog on language and linguistics started in the summer of 2003 by Mark Liberman and Geoffrey Pullum.

Hal Daumé III
I do NLP, ML, climbing & yoga; prof @umdcs & @umd_lsc, member of @umdclip and @hcil_umd; researcher @msftresearch; NY & DC. Views my own. He/him.

CUP Linguistics
Offering the latest in #language & #linguistics research from Cambridge University Press' books & journals (@CambridgeUP)

Interdisciplinary researcher focused on shaping AI towards long-term positive goals. Focusing on NLP, Computer Vision, and ethics. Opinions my own. =)