A fixed-window neural Language Model

image.png

优缺点 :

image.png

RNN neural network :

image.png

优缺点 :

image.png

Train a RNN Language Model:

image.png

image.png

Backpropagation for RNNs :

image.png

Generating with an RNN Language Model :

image.png

Vanishing gradient