AgentRacer and QWOP
Started work today on both AgentRacer and QWOP.
AgentRacer is going good but ran into some issues. So far we have been using passages that we found online for NitroType. However, after doing some testing I found the models were likely trained on the passages, meaning they could easily predict what was being said next. I decided to transition away from general passages and integrate something analogous to monkeytype - randomized words. I'm utilized the google 10000 English frequency list, with a filter for only lowercase and a range of 2-8 letters. Going to run this for all versions (sprint, scramble, and reveal).
At the same time I've also sort of revived an old project of mine that I lost passion for. It started out with me wanting to try out CleanRL. I got it set up for QWOP and well the results were lackluster. I decided to give Claude a go at it and it only showed marginal improvements. This was 5-6 months ago. Today I got Astra to take a look at it. We landed on a much better environmental design. Doing a couple of things: For one I'm choosing a bunch of different runner networks. On top of that the training method is PPO and Astra is doing network design and experimentation. What's the Goal? Not sure yet, just having fun.
After this week imma start on the CoralBoard project and take a look at Omar's findings when it comes to AI being terrible at Yu-gi-oh.