Results of Seaquest-v0 for DQN (Blue), DRQN (yellow), DRQN-TemporalAttention (brown), DRQN-SpatialAttention (purple):. Analysis of Recurrent Temporal Attention DQN: The number at the corner is the ...