GeoOutageBench: Benchmarking Ambiguity-aware, Ontology-grounded Geospatiotemporal KGQA for Multimodal Power Outage and Resilience Analysis

GeoOutageBench is a benchmark for assessing LLM-based geospatiotemporal KGQA for multimodal outage and resilience analysis. It considers a spatiotemporal KG that integrates visual, textual, and structured data from various sources. The benchmark provides a competency query taxonomy at different difficulty levels and evaluates three tasks: LLMs' understanding of ambiguous geospatiotemporal questions, ontology utility, and answer accuracy of multimodal KGQA retrieval.

RSS Score 0 9/30/2026, 4:00:00 AM Original Source
Save an API key to vote.