BERT
文章标题：BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 作者：Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova 发表时 …
TECHNICAL JOURNAL
AI、Tracing、Profiling 与系统工程的长期记录
Archive
67
篇文章
Latest
2026-05-24
最近更新
Latest writing
更多文章
Transformer
文章标题：Attention Is All You Need 作者：Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin 发表时 …
MAE
文章标题：Masked Autoencoders Are Scalable Vision Learners 作者：Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, Ross Girshick 发表时间：2021 官方代码 BERT的CV …
VIT
[toc] Vision Transformer () 文章标题：An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 作者：Alexey Dosovitskiy; Lucas Beyer, Alexander …
ALBEF
文章标题：Align before Fuse: Vision and Language Representation Learning with Momentum Distillation 作者：Junnan Li, Ramprasaath R. Selvaraju, Akhilesh Deepak Gotmare, …
CLIP
文章标题：Learning Transferable Visual Models From Natural Language Supervision 作者：Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini …
VILT
文章标题：ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision 作者：Wonjae Kim, Bokyung Son, Ildoo Kim 发表时间：(ICML 2021) offical code 第一个摆脱了目 …
BYOL
SwAV 文章标题：Unsupervised Learning of Visual Features by Contrasting Cluster Assignments 作者：Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Piotr …
InstDisc
文章标题：Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination 作者：Zhirong Wu, Yuanjun Xiong, Stella Yu, Dahua Lin 发表时间：(CVPR 2018) 这篇论文提出了个 …