Links mentioned in this video:
Apple's On-Device ML System for Federated Evaluation and Tuning
- arxiv.org/abs/2102.08503
- syncedreview.com/2021/02/19/a...
==========================================
Creating Privacy-Preserving Synthetic Data
- cloudblogs.microsoft.com/open...
- Whitepaper: azure.microsoft.com/en-us/res...
- Code: github.com/opendp/smartnoise-...
==========================================
Humans Are Trying to Take Bias Out of Facial Recognition Programs
- news.northeastern.edu/2021/02...
- arxiv.org/abs/2102.02320
==========================================
Model Search Platform for Finding Optimal ML Models
- ai.googleblog.com/2021/02/int...
- pdfs.semanticscholar.org/1bca...
==========================================
TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models
- arxiv.org/abs/2102.07988
==========================================
Gradient Checkpointing
- github.com/rasbt/deeplearning...
- github.com/cybertronai/gradie...
==========================================
Zero Redundancy Optimizer (ZeRO)
- www.deepspeed.ai/tutorials/zero/
- www.deepspeed.ai/tutorials/ze...
- github.com/facebookresearch/f...
==========================================
FairScale
- github.com/facebookresearch/f...