Check if we can wrap NetSecGame to implement the EntityGym API

[MariaRigaki]

Entity Gym is an open source Python library that defines an entity-based API for reinforcement learning environments. Entity Gym extends the standard paradigm of fixed-size observation spaces by allowing observations to contain dynamically-sized lists of entities.

If we can create a wrapper that implements the EntityGym API, then it may help other researchers use our environment. Not sure if this wrapper should be implemented on the environment or in the agents, though 🤔

[MariaRigaki]

Some more links:
Blog: https://clemenswinter.com/2023/04/14/entity-based-reinforcement-learning/
ENN-trainer: https://enn-trainer.readthedocs.io/en/latest/quick-start-guide.html
Ragged buffers: https://github.com/entity-neural-network/ragged-buffer

A relevant paper: https://arxiv.org/abs/2410.17647 (Entity-based Reinforcement Learning for Autonomous Cyber Defence)