Into AI

Introduction For the third post in this series, I read “Efficient Estimation of Word Representations in Vector Space” by Mikolov et al. More commonly known as the “word2vec” paper, Mikolov et al. present their research into efficient methods of translating tokenized vocabulary words into high-dimensional word embeddings using a stripped-down... [Read More]

Introduction For the second post in this series, I read the Bahdanau et al. 2014 paper, “Neural Machine Translation by Jointly Learning to Align and Translate”, which is credited with the first use of “attention” for sequential models. I use quotation marks around the word attention because the mechanism used... [Read More]

This is the first post in a series of posts for the year 2024 that I’m calling “A Paper a Week”. My goal is to read an academic paper each week of the year in an effort to gain a deeper understanding into the current state of AI and to... [Read More]