Max_seq_len of LSTM and Attention Net

RLlib
1
  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

Hello everyone!
I want to train an CNN+LSTM and CNN+AttentionNet model separately. My questions are the followings:

  1. How can I set the same number of past observations passed to an LSTM and to an Attention Net?

My best quess:

  • Set LSTM config → max_seq_len=64

  • Set Att.Net config → attention_memory_training=64
    attention_memory_inference=64

Should I set max_seq_len=64 for AttentionNet too? What max_seq_len affect on Attention Net?

  1. How many prev action/reward passed to LSTM if on LSTM config I set ‘lstm_use_prev_action=True’ and ‘lstm_use_prev_reward=True’. How can I match these on Attention Net?

My best quess:

  • on LSTM this will pass 64 past reward/action.

  • on Att.Net I have to set → attention_use_n_prev_actions=64
    attention_use_n_prev_rewards=64

Thank you in advance!