Hi all. Thanks for pointing this out. Last week we released v1.3 of the binary and gym interface which fixed a couple of issues participants were having. We didn't yet update the challenge repo to target this latest version. I will update it today.
Just pushed a fix to master branch of obstacle-tower-challenge
Nguyen Huynh
@huynhnguyen
This message was deleted
I got this error on evaluation but it quite difficult to trace without log returned. Please help on it?
sorry I try to show my screen picture but fail to load
Karl
@zook111
@awjuliani many thanks.
Nguyen Huynh
@huynhnguyen
I think I miss the debug configure setting, sorry for the previous message. Thanks.
KarolisRam
@KarolisRam
what the... I haven't trained my agent on puzzle rooms at all (floors 10+) and it somehow got a score of 25 on one of the runs (14 floors probably)?! It gets to floor 10 from time to time, but not often. I hope I made a mistake in reward calculation... otherwise it might have become self aware D:
Arthur Juliani
@awjuliani
Hi @KarolisRam Could you possibly record a video of the agent? It might have discovered a bug that allows it to skip floors :)
KarolisRam
@KarolisRam
I'll try. Sadly I wasn't setting/saving random seeds, I will try to do a sweep of seeds and figure out what's happening.
KarolisRam
@KarolisRam
hmm even with a set seed the agent starting position seems to be a bit random (the agent is sometimes a bit further forward). Is this intended?
but atleast your score of > 5 qualifies you for the second round
parilo
@parilo
But I'm at 51 place
I thought only first 50 will go to second round
I will try with debug submission
SP Mohanty
@spMohanty
Okay sure
parilo
@parilo
Thank you!
SP Mohanty
@spMohanty
I will refrain from publicly commenting on the eligibility criteria !! But I can still voice my strong position from the beginning to allow everyone to take part in subsequent rounds.
:angel:
I am around for another 30 mins, and can quickly try to see why your submission fails
btw
running it in debug mode
will still give you only the same logs
I pasted on your submission issue
parilo
@parilo
Cool!
Now trying to rebuild the image and test it locally, so it will be looong way)