Martin Görner    @martin_gorner    11/24/2021      

Self-supervised learning techniques on images are making steady progress. Here are Masked Auto Encoders: https://t.co/eZpzogEUsZ I's impressive how much the neural network can reconstruct.
  
    202         1335




  Hashtags  

   #MetaAI






 
  Related  

MosaicML    @MosaicML    12/4/2021      

Transfer learning has become a key tool in efficiently training deep neural networks. Typically, a network is pretrained using a large amount of data on a related supervised or self-supervised task. Then, the final few layers (the "head") are removed and a new head is added.(2/8)
  
          3



Yuandong Tian    @tydsh    12/6/2021      

I am looking for a postdoc who wants to work on either of the following research topics: (1) learning to optimize via ML/RL techniques, (2) understanding and improving self-supervised learning techniques. Please contact me (yuandong@fb.com) if you are interested. Thanks!
  
    6         19



Sayak Paul    @RisingSayak    11/25/2021      

New work with @ariG23498 on implementing Masked Autoencoders for self-supervised pretraining of images. Thanks to @endernewton for the helpful discussions.
  
          3



Yann LeCun    @ylecun    12/4/2021      

SEAL: Self-Supervised Embodied Active Learning from #MetaAI
  
    7         45