The ACROSS International Laboratory in Hanoi (http://across-lab.org) is dedicated to the use of computer models and simulations for the participatory management of large socio-ecosystems. Within this framework, ACROSS is actively involved in the development of the GAMA modeling platform (http://gama-platform.org), a powerful tool for agent-based simulation (Taillandier et al., 2019).
In recent years, a growing trend in agent-based simulation has been the development of serious games, where human players interact with simulation environments to learn and experiment with complex systems. A recent example is the RAC game, developed with the GAMA platform, in which groups of players take on the role of village leaders making decisions about waste management (Biré et al., 2025). The game models four villages that share both local and common objectives.
Designing such a game requires a substantial calibration phase to define appropriate parameter values — such as action payoffs, success thresholds, and coordination mechanisms — so that the game remains challenging yet educational, effectively conveying the intended message (e.g., that coordination among villages is crucial for success). In this context, reinforcement learning (RL) offers a promising approach to assist with game calibration. By exploring the policy space for different parameter configurations, RL can help identify “optimal” strategies, which can then be analyzed to assess whether they align with the intended pedagogical objectives of the game.
A first connection between GAMA and popular RL libraries such as Gymnasium and PettingZoo has already been established. The objective of this internship is to implement and evaluate the GAMA–RL integration on a real-world use case, namely for the calibration of the RAC game. This work may involve further extending and refining the existing framework to ensure robustness and adaptability to complex multi-agent interactions.
The internship will be conducted in collaboration with INRAE Toulouse, where researchers specialized in reinforcement learning will provide their expertise. The project strongly emphasizes transdisciplinarity, fostering collaboration among experts in agent-based simulation, artificial intelligence, and sustainability science.