Orchestrating LLMs with Specialized Models: A Survey on Heterogeneous Multi-Model Agents

ACM Computing Surveys (ACM CSUR) · Accepted, 2026

Heterogeneous multi-model agents overview

Accepted by ACM Computing Surveys on 30 October 2026.

The survey maps how a central language model works with specialized perception, generation, and action models.

Abstract

This survey reviews 572 papers on heterogeneous multi-model agents published between 2023 and 2026. It groups systems by the specialized models an LLM coordinates, then compares how those components exchange information, handle feedback and uncertainty, and work across application domains. The linked project provides a browsable paper collection and supporting data.