HyPOLE: Hyperproperty-Guided Multi-Agent Reinforcement Learning under Partial Observation

[Submitted on 29 Jun 2026]

View PDF

Abstract:Formal specification is a powerful tool to guide the learning process and provides significant advantages over reward shaping: (1) mathematical rigor; (2) expressiveness to specify objectives and constraints, and (3) the ability to define tactics to achieve objectives. However, these benefits remain largely unexplored in the context of Multi-Agent Reinforcement Learning (MARL). This paper introduces HyPOLE, a novel framework for MARL under partial observability, where learning is guided by the expressive power of the so-called hyperproperties and, in particular, the temporal logic HyperLTL. We integrate Centralized Training for Decentralized Execution (CTDE) techniques with HyPOLE to synthesize decentralized policies, and our evaluation on SMAC, MessySMAC, and WildFire benchmark demonstrates clear advantages over baselines.

Submission history

From: Arshia Rafieioskouei [view email]
[v1] Mon, 29 Jun 2026 23:03:05 UTC (14,134 KB)