You've pointed out a really slick project AReaL (which stands for Agent Reasoning and Learning). From a software engineering perspective
OpenPipe/ART (Agent Reinforcement Trainer) is a really exciting tool for software engineers, especially if you're looking to build more sophisticated and robust AI agents