NMT with Convolutional Seq2Seq and Transfromer
- Used Python Version:3.7.0
- Install necessary modules with
sudo pip3 install -r requiremnets.txt
command.
To train and test the model --> python3 train_and_test.py
For Conv-seq2seq model:
- Embedding_dimension = 256
- Hidden_dimension = 512
- Number of encoder layers = 10
- Number of decoder layers = 10
- Encoder kernel size = 3
- Decoder kernel size = 3
- Encoder dropout = 0.25
- Decoder dropout = 0.25
For Transformer:
- Hidden_dimension = 512
- Number of layers = 6
- Number of heads = 8
- Position feedforward layer dimension = 2048
- Dropout = 0.1