日本語

Contact

Lab visits, graduate study, research collaboration — feel free to get in touch.

Email

kyoshioka47@keio.jp

Kentaro (Ken) Yoshioka

Address

〒223-8522

Yagami Campus Bldg. 23, 3-14-1 Hiyoshi, Kohoku-ku, Yokohama, Kanagawa 223-8522, Japan

Students: 23-214, 14-305, 24-318 / PI: 23-216A

← Back to projects
arXiv 2026PreprintCircuit

Detect in Any Scene: An Agentic Framework for Object Detection with Experience-Aware Reasoning

W. Zhang, J. Yin, K. Yoshioka

Overview figure for DetAS
Figure 1 from the paper

An agentic detection framework that treats object detection as a dynamic decision process rather than a fixed pipeline. A multimodal large language model acts as the central agent, composing a detection workflow per scene by choosing from a toolbox of restoration modules and specialized detectors.

Two components drive it: Self-Adaptive Image Restoration, which decides whether and how to enhance an image before detection, and Multi-Expertise Detection, which reconciles the predictions of several domain-specialized detectors through instance-level reasoning. DetAS-X extends this with Self-Evolving Experience Harvesting, accumulating node-level decision experience from a small annotated set so the system reasons from past decisions at inference time.

Across six challenging benchmarks DetAS-X outperforms existing MLLM-based detectors by 28.36% F1 on average, reaching a 37.01% gain on DarkFace.