(ICML 2024) Pursuing Overall Welfare in Federated Learning through Sequential Decision Making (https://arxiv.org/abs/2402.14650)

StarCraft II high-level feature extractor and replay visualizer

A project to classification.

code for published paper titled "Optimal CO2 storage management considering safety constraints in multi-stakeholder multi-site GCS projects: a Markov game perspective  "

A personal website made using Jekyll's Ed theme

Implementation of a Decision Transformer for power-grid control in L2RPN. The model learns from offline Tutor/Junior demonstrations and continues training online, serving as a drop-in replacement for PPO in the original pipeline proposed by aspirin96.

Do humans adapt their planning horizon? - An analysis of sequential decision-making in the videogame Frogger

Autonomous Blue Team agent. Using Deep Reinforcement Learning for sequential intrusion detection and active incident response in simulated enterprise networks (CybORG / CAGE). Moving beyond static classification, this agent learns an interactive, explainable policy to continuously mitigate cyber threats.

Multi-agent drone search simulation for oil-spill detection under uncertainty.

PyTorch implementation of REACT: longitudinal active feature acquisition with Gumbel-Sigmoid relaxation for cost-aware sequential feature selection with context. ACM BCB 2026.

Risk-based sequential stopping: when to invoke an LLM in streaming systems. Code for ECML PKDD 2026 (Research Track). DOI: 10.5281/zenodo.20783298

Multi-stage Stochastic Programming for Integrated Network Optimization in Hurricane Relief Logistics and Evacuation Planning

Machine-checked Lean 4 / Mathlib formalization of Ismail's Primitives — six structural primitives proven necessary, mutually independent, and sequentially linked for sequential decision-making under uncertainty. 0 sorry · 0 axiom · ~12,700 lines.