Hi all. I just forked this repo to work on some contributions. I just ran the tests to verify my environment before starting and one test consistently fails:
[gw0] [ 83%] FAILED tests/rl/agents/test_dqn.py::test_naf_layer_full
Replacing crashed worker gw0
Thought I'd check if anyone else was seeing the same before I dive into this.
I have a question about this part of code:
Why reaching the number of maximum steps allowed trigger a terminal state?
Hi, I've ran into an issue while trying to use the fit() function on a SARSAAgent class. The issue appeared in callbacks.py in the function on_step_begin. Specifically, the assert for metrics.shape was not working due to the datatype (comparison of tuples (x,) and (y,z)) and then for np.isnan(metrics).all() as np couldn't handle metrics safely due to the wrong data type.
I've fixed it for myself but I was wondering if I should make an issue and do a pull request. It's probably not well done but I'm sure some Python guru can refactor it in a flash.
I'm using Python 3.8.7 and Numpy 1.19.5. Keras-rl should be the most recent one, I've pulled it yesterday.