Our mission is to organize science by converting information into useful knowledge.
London, UK
- Tweets 455
- Following 10
- Followers 113,334
- Likes 531
🪐 Introducing Galactica. A large language model for science.
Can summarize academic literature, solve math problems, generate Wiki articles, write scientific code, annotate molecules and proteins, and more.
Explore and get weights: galactica.org
209
1,993
7,378
🎉 Papers with Code partners with arXiv! Code links are now shown on arXiv articles, and authors can submit code through arXiv. Read more: medium.com/paperswithcode/pa…
42
1,695
6,130
🎉 Introducing... Datasets! We are now indexing 3000+ research datasets from machine learning. Find datasets by task and modality, compare usage over time, browse benchmarks, and much more! Explore the catalogue here: paperswithcode.com/datasets
26
735
2,584
🎉 Introducing Datasets on arXiv! 🎉
The new "Code & Data" tab shows datasets used and introduced in the paper!
Read more: medium.com/paperswithcode/da…
15
443
2,049
🎉 We've just crossed 5000 Datasets! 🎉
We now index and organize more than 5000 research datasets for machine learning. A huge thanks to the research community for their ongoing contributions.
Browse the full catalogue here: paperswithcode.com/datasets
15
456
1,903
🎉 Papers with Code is expanding to more sciences! Today we launch new sites for physics, maths, CS, statistics and astronomy. You can use these sites to sync your code to show on arXiv. Explore our portal here: portal.paperswithcode.com
21
374
1,876
🎉 Introducing... Methods! We are now tracking 730+ building blocks of machine learning: optimizers, activations, attention layers, convolutions and much more! Compare usage over time and explore papers from a new perspective. Browse the catalogue here: paperswithcode.com/methods
10
549
1,784
We’ve just released the new Papers With Code! Site now has over 950+ ML tasks, 500+ evaluation tables (including state of the art results) and 8500+ papers with code. Explore the resource here: paperswithcode.com/sota. Have fun!
20
754
1,537
Graph neural networks are driving lots of progress in machine learning by extending deep learning approaches to complex graph data and applications.
Let’s take a look at a few methods ↓
10
287
1,321
🎉 A huge update to Papers with Code: now with 2500+ leaderboards and 20,000+ results. Plus, results now link directly to tables in arXiv! Read more in our blog post below and feel free to submit results from your own papers! medium.com/paperswithcode/a-…
4
325
1,290
⏪ Papers with Code: Year in Review. We’re ending the year by taking a look back at the top trending papers, libraries and benchmarks for 2020. Read on below!
medium.com/paperswithcode/pa…
6
266
914
🎉 Introducing...Papers with Libraries! We are now indexing ML libraries from the community. We start with the amazing TIMM by @wightmanr. Explore 330+ models, visualize architectures, compare results and hyperparameters, and so much more! paperswithcode.com/lib/timm
12
246
905
We’re excited to announce we’re joining Facebook AI! Read more about it here: medium.com/paperswithcode/pa… @facebookai
15
161
907
🎉 Introducing @paperswithdata 🎉
A curated, daily feed of newly published datasets in machine learning.
Follow to stay updated with new datasets!
2
255
819
⏪ Papers with Code: Year in Review
We’re ending the year by taking a look back at the top trending machine learning papers, libraries and new datasets for 2021. Read on below!
medium.com/paperswithcode/pa…
2
203
801
Graph neural networks are rapidly advancing progress in ML for complex graph data applications.
In this week’s newsletter, we show you recent uses of GNNs ranging from protein interface prediction to collaborative filtering! Read on below:
paperswithcode.com/newslette…
2
149
706
🔥 Introducing... the ML Reproducibility Challenge 2020! The 4th annual edition now expands to cover papers from 7 major ML conferences: NeurIPS, EMNLP, ACL, ICML, ICLR, CVPR and ECCV. Find more here at Papers With Code: paperswithcode.com/rc2020
211
685
Deep learning models for tabular data continue to improve. What are the latest methods and recent progress?
Let’s have a look ↓
4
134
672
🎉 Papers with Code partners with OpenReview 🎉
Find code and datasets directly from @openreviewnet papers!
6
97
647
🎉 Introducing sotabench : a new service with the mission of benchmarking every open source ML model. We run GitHub repos on free GPU servers to capture their results: compare to papers, other models and see speed/accuracy trade-offs. Check it out: sotabench.com
4
207
628
💫 There has been an explosion of interest in self-supervised learning (SSL) for vision and NLP.
In this week's newsletter, we show you recent uses of SSL across various ML tasks from medical image analysis to musical style transfer! Read on below:
paperswithcode.com/newslette…
3
156
590
🎉 We've just crossed 4000 Datasets! 🎉
A huge thanks to the community for their ongoing contributions.
Since launch:
🆕 1000+ new datasets added
🔗 Dataset links now show on arXiv
👩💻 Dataset loaders
Browse full catalogue here: paperswithcode.com/datasets
5
130
579
🎉 Introducing the new Papers with Code newsletter! Our newsletter helps you manage the firehose of new ML papers by highlighting trending papers, new state-of-the-art results, and community contributions from around PwC.
paperswithcode.com/newslette…
3
124
566
🎉 We've just crossed 1000 ML Methods! 🎉
A huge thanks to the community for their ongoing contributions.
Methods help to discover the latest building blocks of machine learning (e.g., attention layers and optimizers). Browse the catalogue here: paperswithcode.com/methods
5
86
539
🧬 Machine learning is having a big impact on scientific discovery
In this week's newsletter we show recent papers where ML is accelerating scientific discovery, from protein structure prediction to detecting gravitational waves.
paperswithcode.com/newslette…
1
114
530
💥 Deep learning makes strides on tabular data!
In this week’s newsletter, we summarize recent developments and papers using deep learning models for tabular data... and much more.
Read on below:
paperswithcode.com/newslette…
126
520
Thank you everyone for trying the Galactica model demo. We appreciate the feedback we have received so far from the community, and have paused the demo for now. Our models are available for researchers who want to learn more about the work and reproduce results in the paper.
30
45
506
Vision Transformers aim to bring the strengths of transformers into the world of computer vision.
It's early days but progress has been happening in areas such as as image recognition, video understanding, 3D analysis, and more.
Let’s take a look at some vision transformers ↓
3
97
510
We believe models should be open.
To accelerate science, we open source all models including the 120 billion model with no friction. You can access them here.
github.com/paperswithcode/ga…
5
51
486
10 Recent Trends in Language Models
In this thread, we summarize ten recent trends and insights in language models. ↓
4
126
477
Awesome tool by @EladRichardson. Chrome Extension that connects Google Scholar with code implementations from Papers With Code! 🔥chrome.google.com/webstore/d…
2
129
460
🤝 Code Snippets! Methods now come with links to example implementations, so you can see how to implement hundreds of methods in various frameworks. Example: paperswithcode.com/method/dr…
3
106
446
🎉 We've crossed 6000 Benchmarks! 🎉
We now maintain more than 6.4K benchmarks for machine learning. A huge thanks to the research community for ongoing contributions.
Browse all benchmarks here: paperswithcode.com/sota
7
69
396
🔥Top Trending ML Papers of the Month
Here is a thread to catchup on the top 10 trending papers of August on @paperswithcode.
2
83
384
StyleGAN3 is out and results are 🤯!
It proposes architectural changes that suppress aliasing and forces the model to implement more natural hierarchical refinement which improves its ability to generate video and animation.
paperswithcode.com/paper/ali…
1/8
1
84
390
📈 Self-supervised learning is a popular research trend, with lots of progress in the past year. Check out this task page with paper collections, resources and a new self-supervised ImageNet leaderboard. paperswithcode.com/task/self…
1
93
372
⚡️ Efficient Vision Models are Trending! ⚡️
This week’s newsletter highlights progress in building efficient vision models, adopting Transformers to challenging domains like GANs, recent papers, and more!
Read on below:
paperswithcode.com/newslette…
3
94
379
🎉 We've now crossed 6000 Datasets! 🎉
Some dataset stats:
- 1.8K for image tasks
- 1.6K for text tasks
- 286 for question answering
- 7.4K ML benchmarks in total
Thanks for all the contributions!
Below is a thread of recent popular datasets ↓
2
77
360
🔥 Our new autocomplete gives you 𝙛𝙖𝙨𝙩 access to 25k papers with code, 2.8k leaderboards, 1.6k tasks, 760 methods. Researchers can add results & methods for papers to enhance their discoverability (paperswithcode.com/add-metho…). We'll be featuring the best additions next week!
2
75
364
ICLR is starting! See all ICLR-2020 papers with official code sorted by number of GitHub stars here: paperswithcode.com/conferenc…
3
104
350
🔥 The debate between ConvNets and Transformers intensifies!
In this week's newsletter: the latest improvements on ConvNets, neural networks for mathematical reasoning, and a closer look at model generalization. Read on below:
paperswithcode.com/newslette…
2
80
339
XLNet outperforms BERT on 20 tasks, often by a large margin, and achieves state-of-the-art results on 18 tasks including question answering, natural language inference, sentiment analysis, and document ranking. Code and comparisons here: paperswithcode.com/paper/xln…
2
104
339
🔥The ML Reproducibility Challenge is back!
The 5th annual edition now expands to cover papers from 9 major ML conferences: NeurIPS, ICML, ICLR, ACL-IJCNLP, EMNLP, CVPR, ICCV, AAAI and IJCAI.
Find more here: paperswithcode.com/rc2021
7
98
331
✨ New Feature: Dataset Loaders! ✨
Easily find code to load datasets in your preferred framework!
Supporting: @huggingface datasets, TensorFlow datasets, OpenMMLab, AllenNLP, and many more libraries!
Example: paperswithcode.com/dataset/s…
3
74
329
💫 New research explains how vision transformers work!
In this week's newsletter: summary of how and why vision transformers work, improving OOD detection, a unified multimodal pretraining framework, and new state-of-the-art results. Read on below:
paperswithcode.com/newslette…
1
71
328
🔥Top Trending ML Papers of the Month
Here is a thread to catchup on the top 10 trending papers of May on @paperswithcode. 1/11
4
74
325
🎉 New feature: State-of-the-art GitHub badges. Submit evaluation results from your paper to obtain a badge for the official GitHub repository. A new way to highlight your paper's performance!
3
84
324
There's been a rapid adoption of self-attention models for visual recognition.
This weeks' newsletter highlights a taxonomy of self-attention models for vision, recent papers, and more! Read on below:
paperswithcode.com/newslette…
1
81
316
What do popular research repositories have in common? We aim to capture this with the ML Code Completeness Checklist - now part of the NeurIPS 2020 submission process. Read more here: medium.com/paperswithcode/ml…
1
87
318
🎉 New feature: PyTorch Hub and Google Colab integration! Now you can go straight from a paper to a Colab notebook, and obtain pre-trained models from PyTorch Hub (look out for more to come!). Get started with BERT : paperswithcode.com/paper/ber…
1
102
311
🔥 Torchvision on Papers with Code! 🔥
🔎 Discover and compare 60+ pre-trained models
🔮 Tasks: image/video classification, segmentation, object detection
🏋️ Training recipes for models
📱 Bonus: new MobileNetV3 models added by @bbriniotis!
paperswithcode.com/lib/torch…
2
63
298
Labels? Where we're going, we don't need...labels.
💥 VISSL is a new library for self-supervised learning by @priy2201 et al. You can browse and compare different self-supervised learning methods in the catalogue below!
paperswithcode.com/lib/vissl
1
70
293
🎉 Papers with Code partners with ACL!
Access code and datasets directly from ACL papers.
Huge thanks to @mjpost and @mmbollmann for the collaboration.
1
58
281
Keeping up with Language Models
Check out these trending papers to catchup on the latest developments in language models. ↓
1
41
280
🔥 Papers with Code Newsletter #9 🔥
We cover:
• MLP-style models with competitive results on image classification!
• dataset links on arXiv articles,
• diffusion models beat GANs on image synthesis,
• GNNs for fake news detection,
• ... and more
paperswithcode.com/newslette…
5
62
291
Now over 1,000 tables tracking the state-of-the-art in ML! Thanks to the amazing community for making this possible by submitting results from papers. paperswithcode.com/sota
3
84
275
💡The Vision Transformer has been getting some...attention. Results, code, methods and more have been indexed here: paperswithcode.com/paper/an-…. A good starting point for anyone who wants to dig deeper.
64
283
🤝 Papers with Code is now helping to maintain aideadlin.es.
AI Conference Deadlines makes it easy to find and follow conference deadlines in areas such as machine learning and NLP. Thanks to @abhshkdz for this great initiative.
2
66
275
We're hiring passionate engineers looking to make ML research more reproducible, discoverable and extensible. Apply here to work with us on this mission: paperswithcode.com/careers
3
59
274
🌊 MLPs are back with a vengeance: is this the next wave after Transformers?
In this week's newsletter we cover top trending papers for May (lots of MLPs!), a DALL-E like method for text-to-image generation, and much more!
paperswithcode.com/newslette…
2
68
279
✨ A single MSc course produced 9 papers! ✨
Learn about their story and how the Reproducibility Challenge can boost your course in a post by
@__alucic: medium.com/paperswithcode/ca…
2
55
273
🎉 Reproducibility Reports are LIVE!
Papers now link to reproducibility reports. Alongside code, this is a new signal for how reproducible a paper's findings are.
Thanks to RC2020 participants, reviewers and ACs for their hard work!
Example: paperswithcode.com/paper/tra…
1
57
273
DeiT is a new Vision Transformer which trains on ImageNet alone, with a new teacher-student training strategy specific to transformers. Paper, code, results, methods and more have been indexed below. paperswithcode.com/paper/tra…
2
44
265
📈 Vision Transformers are trending in the community!
In this week’s newsletter, we summarize recent research in vision transformers, real-time rendering of NeRFs, advancing GPT-style models, and more.
Read on below:
paperswithcode.com/newslette…
72
267
🛠️ Hybrid models for vision and NLP are on the rise!
In this week's newsletter: the latest hybrid architectures for vision and language, language models in embodied agents, top 10 trending papers, and more. Read below:
paperswithcode.com/newslette…
50
258
🚀 The ML Reproducibility Challenge is an amazing opportunity for students to learn about cutting edge ML research. @JesseDodge explains how you can incorporate it in your course to help your students: medium.com/paperswithcode/th…
68
259
Hot Research 🔥 on Papers with Code!
A new way to keep track of trending papers discussed by the community.
Check it out: paperswithcode.com/top-socia…
1
56
263
👩💻 Machine Learning Meets Code!
In this week’s newsletter, we summarize the latest advances in ML for code - including Codex (powering GitHub Copilot). Other highlights:
🧬 AlphaFold code released!
🤖 Transformers for RL
🎑 CLIP for VQA
Read on below:
paperswithcode.com/newslette…
60
255
Detectron2 on Papers with Code! 🚀
👁️ Discover 80+ models for object detection and segmentation.
⚖️ Visualize performance vs speed tradeoffs.
🔮 Perform advanced tasks like panoptic segmentation.
🚂 Find model recipes for training and evaluation.
paperswithcode.com/lib/detec…
1
60
260
Vision-language pre-trained models are driving lots of progress on machine learning tasks that require vision & language modalities.
Let’s take a look at some recent models ↓
1
54
254
🔥The ML Reproducibility Challenge is back!
The 6th edition now expands to papers from 11 ML conferences: NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR, ECCV, AAAI, IJCAI-ECAI, ACM FAccT & SIGIR.
ML journals included this year: JMLR, TACL, & TMLR.
Read more: paperswithcode.com/rc2022
68
242
Text-Driven Neural Stylization for 3D Meshes
This new paper proposes a text-driven, neural network based approach (Text2Mesh) for stylizing 3D meshes.
Paper & Code: paperswithcode.com/paper/tex…
(A short thread) 1/6
3
37
234
🔥Top Trending ML Papers of the Month
Here is a thread to catchup on the top 10 trending papers of June on @paperswithcode. ↓
1
45
232
An Animated History of ImageNet : from AlexNet to FixResNeXt-101. See the full table and add more results here: paperswithcode.com/sota/imag…
2
77
243
In a new paper from @wightmanr et al. a traditional ResNet-50 is re-trained using a modern training protocol. It achieves a very competitive 80.4% top-1 accuracy on ImageNet without using extra data or distillation.
[mini-thread]
paperswithcode.com/paper/res…
3
48
235
CVPR 2019 Implementations: get all the papers with code in one place here: paperswithcode.com/conferenc…
91
240
👩💻 Trending Libraries for 2020, featuring:
- Transformers @huggingface
- PyTorch Image Models @wightmanr
- Detectron2 @ppwwyyxx
- MMDetection @OpenMMLab
- as well as work by @eriklindernoren, @myleott, @ZloiAlexei, and others
3
55
234
🔍 Many of the @paperswithcode methods now appear as featured snippets on @Google! If you are an author, you can add your methods to the resource (with descriptions, images) to enhance their discoverability beyond your papers.
2
40
220
📈 Top trending ML papers of March 2021
In this week's newsletter: top trending papers, state-of-the-art speech recognition, revisiting neural probabilistic language models, progress on efficient vision models, and much more.
Read on below:
paperswithcode.com/newslette…
45
219
🔥Top Trending ML Papers of the Month
Here is a thread to catchup on the top 10 trending papers of July on @paperswithcode.
1
33
210
New state-of-the-art for several semantic segmentation benchmarks. FastFCN by Wu et al replaces dilated convolutions with a Joint Pyramid Upsampling (JPU) module to reduce computational complexity. Official code and comparisons here: paperswithcode.com/paper/fas…
61
208
💥 Exciting progress in language modeling for long sequences!
In this week's newsletter, read about new methods for long sequences (Fastformer, ∞-former, ALiBi), T5 on code, zero-shot FLAN, and much more.
paperswithcode.com/newslette…
1
44
203
🚀 Vision models are getting bigger and more effective!
In this week's newsletter: a summary of the latest in visual synthesis, new techniques for scaling up vision models, and much more.
paperswithcode.com/newslette…
3
33
200
🔍 Check out this link if you want to quickly browse the ICLR 2021 list of accepted papers containing code. You can filter papers by task, author, keyword, etc.
paperswithcode.com/conferenc…
51
203
🎉 We’ve just crossed 5000 ML Benchmarks! 🎉
A huge thanks to the community for their ongoing contributions.
Benchmarks help you keep track of the latest progress in ML across a wide range of tasks.
Browse all benchmarks here: paperswithcode.com/sota
1
34
198
Want a quick way to find the state of the art on a machine learning task? Type in “state of the art [task]” on @Google. Voila. 🔥
3
59
187
📄 Trending Papers for 2020, featuring:
- EfficientDet @tanmingxing @quocleix
- ResNeSt @zhanghang0704
- Big Transfer @__kolesnikov__ @giffmana
- FixRes @HugoTouvron
- as well as work by @QizheXie @colinraffel @ctnzr, and others
1
56
188
Read about the research at: arxiv.org/abs/2211.09085
6
30
146
💥MMDetection comes to Paper with Code!
Explore 370 object detection & instance segmentation models by @OpenMMLab:
⚖️ Compare speed vs performance.
📄 Linked papers and methods for each model.
👻 ...and much more!
Browse here: paperswithcode.com/lib/mmdet…
48
189
📈 Trending Papers with Code
ICYMI, here is a roundup of the top 10 trending machine learning papers on Papers with Code for February 2022. paperswithcode.com/newslette…
1
39
184
New state-of-the-art for object detection on COCO. Liu et al introduce a composite backbone architecture that extracts more representational basic features than the original backbone (trained for image classification). Code & comparisons here: paperswithcode.com/paper/cbn…
1
58
185
📈 Papers with Code now integrates with ongoing competitions! Our first partner is @Eval_AI - huge thanks to @rishabhjain2018! Learn more about how to integrate your competitions here: github.com/paperswithcode/pa…
5
36
181
We release our initial paper below. We train on a large scientific corpus of papers, reference material, knowledge bases and many other sources. Includes scientific text and also scientific modalities such as proteins, compounds and more.
galactica.org/paper.pdf
2
14
179
💫 Vision-and-Language models are trending!
In this week’s newsletter: we highlight progress in vision-and-language pretrained models, new ML papers & results, and more. Read on below:
paperswithcode.com/newslette…
33
187
NeurIPS 2019 Implementations - get all the papers with code in one place here: paperswithcode.com/conferenc…
73
176
Language models are getting more capable!
How are researchers measuring progress and probing language models? Let’s take a look in this thread.
1/6
3
27
175
Interesting new paper for image classification that introduces a new type of convolution (OctaveConv): achieves higher accuracy with fewer FLOPs on ImageNet. But no public code yet: implementations needed! paperswithcode.com/paper/dro…
5
53
175
💡 Can we build NNs to process any modality?
In this week's newsletter, we summarize architectures for handling diverse modalities and output tasks... and much more!
Read on below:
paperswithcode.com/newslette…
38
171
🎉 Introducing AllenNLP on Papers with Code Libraries
We are excited to welcome @ai2_allennlp to our library catalogue.
🕵️♀️ Explore state-of-the-art NLP models
🎯 Find training recipes, weights & model metadata
🏆 Compare models like RoBERTa and GPT-2
paperswithcode.com/lib/allen…
33
169
⚡️Multimodal research is rapidly advancing!
In this week's newsletter: we summarize progress in general-purpose ML (Unified-IO, MetaLM, LIFT) and more.
Read on here: paperswithcode.com/newslette…
46
167