overview

Paper List

I-EGBR

• MAML: Chelsea Finn, Pieter Abbeel, Sergey Levine. Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks. ICML 2017.
• FOMAML: Chelsea Finn, Pieter Abbeel, Sergey Levine. On First-Order Meta-Learning Algorithms. ICML 2017.
• MSGD: Zhenguo Li, Fengwei Zhou, Fei Chen, Hang Li. Meta-SGD: Learning to Learn Quickly for Few-Shot Learning.
• MT-Net: Yoonho Lee, Seungjin Choi. Gradient-Based Meta-Learning with Learned Layerwise Metric and Subspace. ICML 2018.
• WarpGrad: Sebastian Flennerhag, Andrei A. Rusu, Razvan Pascanu, Francesco Visin, Hujun Yin, Raia Hadsell. Meta-Learning with warped gradient Descent. ICLR 2020.
• L2F: Sungyong Baik, Seokil Hong, Kyoung Mu Lee. Learning to Forget for Meta-Learning. CVPR 2020.

R-EGBR

• RAD: Luca Franceschi, Paolo Frasconi, Saverio Salzo, Riccardo Grazzi, Massimiliano Pontil. Bilevel Programming for Hyperparameter Optimization and Meta-Learning. ICML 2018.
• T-RAD: Amirreza Shaban, Ching-An Cheng, Nathan Hatch, Byron Boots. Truncated Back-propagation for Bilevel Optimization. AISTATS 2019
• OS-RAD: Hanxiao Liu, Karen Simonyan, Yiming Yang. DARTS: Differentiable Architecture Search. ICLR 2019.

IGBR

• LS: Fabian Pedregosa. Hyperparameter optimization with approximate gradient. ICML 2016.
• NS: Jonathan Lorraine, Paul Vicol, David Duvenaud. Optimizing millions of hyperparameters by implicit differentiation. AISTATS 2020.
• GN: T. Giovannelli, G. Kent, L. N. Vicente. Bilevel stochastic methods for optimization and machine learning: Bilevel stochastic descent and DARTS.

w/o LLS

• BDA: Risheng Liu, Pan Mu, Xiaoming Yuan, Shangzhi Zeng, Jin Zhang. A Generic First-Order Algorithmic Framework for Bi-Level Programming Beyond Lower-Level Singleton. ICML 2020.
• BFVIM: Risheng Liu, Xuan Liu, Xiaoming Yuan, Shangzhi Zeng, Jin Zhang. A Value Function-based Interior-point Method for Non-convex Bilevel Optimization. ICML 2021.
• IAPPT-GM: Risheng Liu, Yaohua Liu, Shangzhi Zeng, Jin Zhang. Towards Gradient-based Bilevel Optimization with Non-convex Followers and Beyond. NIPS 2021.

Survey on BLO

• Risheng Liu, Jiaxin Gao, Jin Zhang, Deyu Meng, Zhouchen Lin. Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective:A Survey and Beyond. TPAMI 2021.