Clik here to view.
Pointer Graph Networks.
Petar Velickovic, Lars Buesing, Matthew C. Overlan, Razvan Pascanu, Oriol Vinyals, Charles Blundell: Pointer Graph Networks. NeurIPS 2020
View ArticleClik here to view.
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of...
Aniruddh Raghu, Maithra Raghu, Samy Bengio, Oriol Vinyals: Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML. ICLR 2020
View ArticleClik here to view.
Reinforced Genetic Algorithm Learning for Optimizing Computation Graphs.
Aditya Paliwal, Felix Gimeno, Vinod Nair, Yujia Li, Miles Lubin, Pushmeet Kohli, Oriol Vinyals: Reinforced Genetic Algorithm Learning for Optimizing Computation Graphs. ICLR 2020
View ArticleClik here to view.
Scaling Language Models: Methods, Analysis & Insights from Training Gopher.
Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, H. Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick,...
View ArticleClik here to view.
Improving language models by retrieving from trillions of tokens.
Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George van den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, Diego de Las Casas, Aurelia...
View ArticleClik here to view.
Perceiver IO: A General Architecture for Structured Inputs & Outputs.
Andrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac, Carl Doersch, Catalin Ionescu, David Ding, Skanda Koppula, Daniel Zoran, Andrew Brock, Evan Shelhamer, Olivier J. Hénaff, Matthew M. Botvinick,...
View ArticleClik here to view.
WikiGraphs: A Wikipedia Text - Knowledge Graph Paired Dataset.
Luyu Wang, Yujia Li, Özlem Aslan, Oriol Vinyals: WikiGraphs: A Wikipedia Text - Knowledge Graph Paired Dataset. CoRR abs/2107.09556 (2021)
View ArticleClik here to view.
The Benchmark Lottery.
Mostafa Dehghani, Yi Tay, Alexey A. Gritsenko, Zhe Zhao, Neil Houlsby, Fernando Diaz, Donald Metzler, Oriol Vinyals: The Benchmark Lottery. CoRR abs/2107.07002 (2021)
View ArticleClik here to view.
Multimodal Few-Shot Learning with Frozen Language Models.
Maria Tsimpoukelli, Jacob Menick, Serkan Cabi, S. M. Ali Eslami, Oriol Vinyals, Felix Hill: Multimodal Few-Shot Learning with Frozen Language Models. CoRR abs/2106.13884 (2021)
View ArticleClik here to view.
Vector Quantized Models for Planning.
Sherjil Ozair, Yazhe Li, Ali Razavi, Ioannis Antonoglou, Aäron van den Oord, Oriol Vinyals: Vector Quantized Models for Planning. CoRR abs/2106.04615 (2021)
View ArticleClik here to view.
Machine Translation Decoding beyond Beam Search.
Rémi Leblond, Jean-Baptiste Alayrac, Laurent Sifre, Miruna Pislar, Jean-Baptiste Lespiau, Ioannis Antonoglou, Karen Simonyan, Oriol Vinyals: Machine Translation Decoding beyond Beam Search. CoRR...
View ArticleClik here to view.
Efficient Visual Pretraining with Contrastive Detection.
Olivier J. Hénaff, Skanda Koppula, Jean-Baptiste Alayrac, Aäron van den Oord, Oriol Vinyals, João Carreira: Efficient Visual Pretraining with Contrastive Detection. CoRR abs/2103.10957 (2021)
View ArticleClik here to view.
Perceiver: General Perception with Iterative Attention.
Andrew Jaegle, Felix Gimeno, Andrew Brock, Andrew Zisserman, Oriol Vinyals, João Carreira: Perceiver: General Perception with Iterative Attention. CoRR abs/2103.03206 (2021)
View ArticleClik here to view.
The MineRL 2020 Competition on Sample Efficient Reinforcement Learning using...
William H. Guss, Mario Ynocente Castro, Sam Devlin, Brandon Houghton, Noboru Sean Kuno, Crissman Loomis, Stephanie Milani, Sharada P. Mohanty, Keisuke Nakata, Ruslan Salakhutdinov, John Schulman,...
View ArticleClik here to view.
Multimodal Few-Shot Learning with Frozen Language Models.
Maria Tsimpoukelli, Jacob Menick, Serkan Cabi, S. M. Ali Eslami, Oriol Vinyals, Felix Hill: Multimodal Few-Shot Learning with Frozen Language Models. NeurIPS 2021: 200-212
View ArticleClik here to view.
Vector Quantized Models for Planning.
Sherjil Ozair, Yazhe Li, Ali Razavi, Ioannis Antonoglou, Aäron van den Oord, Oriol Vinyals: Vector Quantized Models for Planning. ICML 2021: 8302-8313
View ArticleClik here to view.
Perceiver: General Perception with Iterative Attention.
Andrew Jaegle, Felix Gimeno, Andy Brock, Oriol Vinyals, Andrew Zisserman, João Carreira: Perceiver: General Perception with Iterative Attention. ICML 2021: 4651-4664
View ArticleClik here to view.
Efficient Visual Pretraining with Contrastive Detection.
Olivier J. Hénaff, Skanda Koppula, Jean-Baptiste Alayrac, Aäron van den Oord, Oriol Vinyals, João Carreira: Efficient Visual Pretraining with Contrastive Detection. ICCV 2021: 10066-10076
View ArticleClik here to view.
Machine Translation Decoding beyond Beam Search.
Rémi Leblond, Jean-Baptiste Alayrac, Laurent Sifre, Miruna Pislar, Jean-Baptiste Lespiau, Ioannis Antonoglou, Karen Simonyan, Oriol Vinyals: Machine Translation Decoding beyond Beam Search. EMNLP (1)...
View ArticleClik here to view.
Understanding deep learning (still) requires rethinking generalization.
Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, Oriol Vinyals: Understanding deep learning (still) requires rethinking generalization. Commun. ACM 64(3): 107-115 (2021)
View ArticleClik here to view.
GraphCast: Learning skillful medium-range global weather forecasting.
Rémi Lam, Alvaro Sanchez-Gonzalez, Matthew Willson, Peter Wirnsberger, Meire Fortunato, Alexander Pritzel, Suman V. Ravuri, Timo Ewalds, Ferran Alet, Zach Eaton-Rosen, Weihua Hu, Alexander Merose,...
View ArticleClik here to view.
Emergent Abilities of Large Language Models.
Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang,...
View ArticleClik here to view.
A Generalist Agent.
Scott E. Reed, Konrad Zolna, Emilio Parisotto, Sergio Gomez Colmenarejo, Alexander Novikov, Gabriel Barth-Maron, Mai Gimenez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg, Tom Eccles, Jake Bruce,...
View ArticleClik here to view.
Flamingo: a Visual Language Model for Few-Shot Learning.
Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katie Millican, Malcolm Reynolds, Roman Ring, Eliza Rutherford, Serkan Cabi, Tengda...
View ArticleClik here to view.
Training Compute-Optimal Large Language Models.
Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, Tom Hennigan, Eric Noland,...
View ArticleClik here to view.
Non-isotropy Regularization for Proxy-based Deep Metric Learning.
Karsten Roth, Oriol Vinyals, Zeynep Akata: Non-isotropy Regularization for Proxy-based Deep Metric Learning. CoRR abs/2203.08547 (2022)
View ArticleClik here to view.
Integrating Language Guidance into Vision-based Deep Metric Learning.
Karsten Roth, Oriol Vinyals, Zeynep Akata: Integrating Language Guidance into Vision-based Deep Metric Learning. CoRR abs/2203.08543 (2022)
View ArticleClik here to view.
Competition-Level Code Generation with AlphaCode.
Yujia Li, David H. Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, Rémi Leblond, Tom Eccles, James Keeling, Felix Gimeno, Agustin Dal Lago, Thomas Hubert, Peter Choy, Cyprien de Masson...
View ArticleClik here to view.
Hierarchical Perceiver.
João Carreira, Skanda Koppula, Daniel Zoran, Adrià Recasens, Catalin Ionescu, Olivier J. Hénaff, Evan Shelhamer, Relja Arandjelovic, Matthew M. Botvinick, Oriol Vinyals, Karen Simonyan, Andrew...
View ArticleClik here to view.
General-purpose, long-context autoregressive modeling with Perceiver AR.
Curtis Hawthorne, Andrew Jaegle, Catalina Cangea, Sebastian Borgeaud, Charlie Nash, Mateusz Malinowski, Sander Dieleman, Oriol Vinyals, Matthew M. Botvinick, Ian Simon, Hannah Sheahan, Neil Zeghidour,...
View ArticleClik here to view.
MuZero with Self-competition for Rate Control in VP9 Video Compression.
Amol Mandhane, Anton Zhernov, Maribeth Rauh, Chenjie Gu, Miaosen Wang, Flora Xue, Wendy Shang, Derek Pang, Rene Claus, Ching-Han Chiang, Cheng Chen, Jingning Han, Angie Chen, Daniel J. Mankowitz,...
View ArticleClik here to view.
Unified Scaling Laws for Routed Language Models.
Aidan Clark, Diego de Las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake A. Hechtman, Trevor Cai, Sebastian Borgeaud, George van den Driessche, Eliza...
View ArticleClik here to view.
An empirical analysis of compute-optimal large language model training.
Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, Tom Hennigan, Eric Noland,...
View ArticleClik here to view.
Flamingo: a Visual Language Model for Few-Shot Learning.
Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katherine Millican, Malcolm Reynolds, Roman Ring, Eliza Rutherford, Serkan Cabi,...
View ArticleClik here to view.
General-purpose, long-context autoregressive modeling with Perceiver AR.
Curtis Hawthorne, Andrew Jaegle, Catalina Cangea, Sebastian Borgeaud, Charlie Nash, Mateusz Malinowski, Sander Dieleman, Oriol Vinyals, Matthew M. Botvinick, Ian Simon, Hannah Sheahan, Neil Zeghidour,...
View ArticleClik here to view.
Unified Scaling Laws for Routed Language Models.
Aidan Clark, Diego de Las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake A. Hechtman, Trevor Cai, Sebastian Borgeaud, George van den Driessche, Eliza...
View ArticleClik here to view.
Improving Language Models by Retrieving from Trillions of Tokens.
Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George van den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, Diego de Las Casas, Aurelia...
View ArticleClik here to view.
Perceiver IO: A General Architecture for Structured Inputs & Outputs.
Andrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac, Carl Doersch, Catalin Ionescu, David Ding, Skanda Koppula, Daniel Zoran, Andrew Brock, Evan Shelhamer, Olivier J. Hénaff, Matthew M. Botvinick,...
View ArticleClik here to view.
Integrating Language Guidance into Vision-based Deep Metric Learning.
Karsten Roth, Oriol Vinyals, Zeynep Akata: Integrating Language Guidance into Vision-based Deep Metric Learning. CVPR 2022: 16156-16168
View ArticleClik here to view.
Non-isotropy Regularization for Proxy-based Deep Metric Learning.
Karsten Roth, Oriol Vinyals, Zeynep Akata: Non-isotropy Regularization for Proxy-based Deep Metric Learning. CVPR 2022: 7410-7420
View ArticleClik here to view.
Emergent Abilities of Large Language Models.
Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang,...
View ArticleClik here to view.
A Generalist Agent.
Scott E. Reed, Konrad Zolna, Emilio Parisotto, Sergio Gómez Colmenarejo, Alexander Novikov, Gabriel Barth-Maron, Mai Gimenez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg, Tom Eccles, Jake Bruce,...
View ArticleClik here to view.
Deep Audio-Visual Speech Recognition.
Triantafyllos Afouras, Joon Son Chung, Andrew W. Senior, Oriol Vinyals, Andrew Zisserman: Deep Audio-Visual Speech Recognition. IEEE Trans. Pattern Anal. Mach. Intell. 44(12): 8717-8727 (2022)
View ArticleClik here to view.
Guest Editorial: Non-Euclidean Machine Learning.
Stefanos Zafeiriou, Michael M. Bronstein, Taco Cohen, Oriol Vinyals, Le Song, Jure Leskovec, Pietro Liò, Joan Bruna, Marco Gori: Guest Editorial: Non-Euclidean Machine Learning. IEEE Trans. Pattern...
View ArticleClik here to view.
Fantastic Gains and Where to Find Them: On the Existence and Prospect of...
Karsten Roth, Lukas Thede, Almut Sophia Koepke, Oriol Vinyals, Olivier J. Hénaff, Zeynep Akata: Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer...
View ArticleClik here to view.
AlphaStar Unplugged: Large-Scale Offline Reinforcement Learning.
Michaël Mathieu, Sherjil Ozair, Srivatsan Srinivasan, Çaglar Gülçehre, Shangtong Zhang, Ray Jiang, Tom Le Paine, Richard Powell, Konrad Zolna, Julian Schrittwieser, David H. Choi, Petko Georgiev,...
View ArticleClik here to view.
Waffling around for Performance: Visual Classification with Random Words and...
Karsten Roth, Jae-Myung Kim, A. Sophia Koepke, Oriol Vinyals, Cordelia Schmid, Zeynep Akata: Waffling around for Performance: Visual Classification with Random Words and Broad Concepts. CoRR...
View ArticleClik here to view.
Optimizing Memory Mapping Using Deep Reinforcement Learning.
Pengming Wang, Mikita Sazanovich, Berkin Ilbeyi, Phitchaya Mangpo Phothilimthana, Manish Purohit, Han Yang Tay, Ngân Vu, Miaosen Wang, Cosmin Paduraru, Edouard Leurent, Anton Zhernov, Julian...
View ArticleClik here to view.
Waffling around for Performance: Visual Classification with Random Words and...
Karsten Roth, Jae-Myung Kim, A. Sophia Koepke, Oriol Vinyals, Cordelia Schmid, Zeynep Akata: Waffling around for Performance: Visual Classification with Random Words and Broad Concepts. ICCV 2023:...
View ArticleClik here to view.
Faster sorting algorithms discovered using deep reinforcement learning.
Daniel J. Mankowitz, Andrea Michi, Anton Zhernov, Marco Gelmi, Marco Selvi, Cosmin Paduraru, Edouard Leurent, Shariq Iqbal, Jean-Baptiste Lespiau, Alex Ahern, Thomas Köppe, Kevin Millikin, Stephen...
View Article
