Master List: Bi-weekly Paper Reading Group

Community Events Paper Reading Group
1

Upcoming Paper Reading Sessions

Nov 2, 2021, 10am PT / 10:30pm IST: EfficientNets
Paper: [1905.11946] EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Blog: https://amaarora.github.io/2020/08/13/efficientnet.html

Past Paper Reading Sessions

Oct 19, 2021, 10am PT / 10:30pm IST: Squeeze and Excitation Networks
Paper: [1709.01507] Squeeze-and-Excitation Networks
Blog: https://amaarora.github.io/2020/07/24/SeNet.html

Sep 21, 2021, 10am PT / 10:30pm IST: DenseNet
Paper: [1608.06993] Densely Connected Convolutional Networks
Blog: https://amaarora.github.io/2020/08/02/densenets.html

Sep 08, 2021 1pm AEST: ResNet
Paper: [1512.03385] Deep Residual Learning for Image Recognition
Blog: fastbook/14_resnet.ipynb at master · fastai/fastbook · GitHub

Aug 25, 2021 9am AEST: MDETR with author Aishwarya Kamath
Paper: [2104.12763] MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding
Youtube: https://www.youtube.com/watch?v=I68nn_0odto

Aug 11, 2021 1pm AEST: DETR
Paper: [2005.12872] End-to-End Object Detection with Transformers
Youtube: https://www.youtube.com/watch?v=XdFkEP-e2bw&list=PLD80i8An1OEG_vpqwQgwH1gIxeb9r30u5&index=6

July 28, 2021 1pm AEST: CaiT
Paper: [2103.17239] Going deeper with Image Transformers
Youtube: https://www.youtube.com/watch?v=FP7Ps6wYmLc&list=PLD80i8An1OEG_vpqwQgwH1gIxeb9r30u5&index=5

July 14, 2021 1pm AEST: MLP-Mixer w/ special guest Dr. Habib
Paper: [2105.01601] MLP-Mixer: An all-MLP Architecture for Vision
Youtube: https://www.youtube.com/watch?v=I68nn_0odto

June 30, 2021 1pm AEST: EfficientNetV2
Paper: [2104.00298] EfficientNetV2: Smaller Models and Faster Training
Youtube: https://www.youtube.com/watch?v=AX64YExZV1k&list=PLD80i8An1OEG_vpqwQgwH1gIxeb9r30u5&index=3

June 16, 2021 1pm AEST: ConViT with author Stephane D’ascoli
Paper: [2103.10697] ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases
Youtube: https://www.youtube.com/watch?v=QdbieYXn_XM&list=PLD80i8An1OEG_vpqwQgwH1gIxeb9r30u5&index=2

June 09, 2021 1pm AEST: NF-ResNet
Paper: [2101.08692] Characterizing signal propagation to close the performance gap in unnormalized ResNets
Youtube: https://www.youtube.com/watch?v=Sbe_3amAXVw&list=PLD80i8An1OEG_vpqwQgwH1gIxeb9r30u5&index=1

11 Likes
4

We’re also going to start out with live-coding sessions where we will look at code for every architecture that we discuss in our paper reading group. The live-coding session will be followed by PRG!

8 Likes
5

For me and others for any future reference ,links shared in Paper Reading Group

https://amaarora.github.io/2020/08/13/efficientnet.html

https://www.youtube.com/watch?v=AX64YExZV1k

https://medium.com/@zurister/depth-wise-convolution-and-depth-wise-separable-convolution-37346565d4ec

https://www.youtube.com/watch?v=jI_xPfOghzc&list=PLD80i8An1OEHdlrBwa7mKFaHX9tH86b93&index=12&t=2272s