EvoSteer is a new paradigm for online self-evolving graph orchestration that addresses challenges in LLM-based multi-agent systems, such as post-hoc evolution and credit diffusion. It uses Anchored Trajectory Balance and Validated Skill Admission to improve the orchestration process. Experimental results show that EvoSteer outperforms baselines in various tasks.