Neural network language models are not only key tools in natural language processing (NLP), but are also drawing an increasing scientific interest as potential models of human language processing.