<p>It's interesting to observe the fate of the authors of the paper “Attention is all you need,” which was published back in 2017 and effectively became the starting point for GPT, which had such a huge impact.</p>
<p>In scientific articles, authors are usually listed in order of their contribution, with those who contributed the most listed first (by the way, this is a good hack for following smart people on Twitter. If you see a good scientific paper, follow the first 2-3 people).</p>
<p>So, what has happened to these individuals now:</p>
<ol>
<li>Ashish Vaswani: founded Adept (valuation >$1B), then a mysterious startup.</li>
<li>Noam Shazeer: founded Character.ai (valuation ~$1B) with 20+ employees.</li>
<li>Niki Parmar: moved from Google to Adept, and then to Ashish's new project.</li>
<li>Jakob Uszkoreit: founded Inceptive Life (models mRNA using AI).</li>
<li>Llion Jones: stayed at Google, came up with the meme-worthy title of the paper.</li>
<li>Aidan Gomez: founded Cohere.ai (valuation >$400m), 200+ employees.</li>
<li>Lukasz Kaiser: moved from Google to OpenAI, co-author of TensorFlow.</li>
<li>Illia Polosukhin: founded Near (blockchain protocol, valuation ~$2B).</li>
</ol>
<p>Legendary paper: <a href="https://arxiv.org/abs/1706.03762">https://arxiv.org/abs/1706.03762</a></p>
<p>#ai #gpt #paper</p>