Can we solve a seq2seq task by adding attention to our model? And will it beat an LSTM?
Jun 29, 2020
We test how well ULMFIiT manages to predict Norwegian language movie review using a fine-tuned language model.
Jun 12, 2020
Can we use dimensionality reduction algorithms to make sense of the embedding weights of an AWD-LSTM language model? tl;dr: yes.
Apr 28, 2020
In this post we'll load a pretrained language model and fine tune it on our target corpus of TV and movie reviews.
Apr 20, 2020
AWD-LSTM is a special kind of recurrent neural network that is useful for language models. How can we set it up and customize it with the fastai library?
Apr 17, 2020
In this post I'll try to find a Norwegian language dataset suitable for sentiment analysis. This dataset will be used in the upcoming posts to test various deep learning methods such as ULMFiT and MultiFiT. I will also experiment with the fastai2 deep learning library.
Apr 6, 2020