Agents in Collaboration, Robotics Foundations, and Self-Distillation Advances

8 selected AI/ML papers covering AI, IR, LG, CL, MA, CV, RO, SE, stat.ML and more

Today’s selection of 8 noteworthy AI/ML papers from arXiv, covering advances in agentic search systems, model distillation techniques, multimodal auditing, and embodied AI control.


1. SearchOS-V1: Towards Robust Open-Domain Information-Seeking Agent Collaboration

Authors: Yuyao Zhang, Junjie Gao, Zhengxian Wu, Jiaming Fan, Jin Zhang et al. | Categories: cs.AI, cs.IR Link: arxiv.org/abs/2607.15257v1

This paper introduces SearchOS, a multi-agent framework that externalizes search state into a Frontier Task, Evidence Graph, Coverage Map, and Failure Memory to prevent agents from getting trapped in repetitive loops. It employs pipeline-parallel scheduling and a Search Tool Middleware Harness to improve throughput and recover from stalls. On WideSearch and GISA, SearchOS outperforms all evaluated single- and multi-agent baselines across all metrics.

Takeaway: A significant step toward production-ready information-seeking agents—by making search progress explicit and shared, it solves the loop problem that plagues current systems.


2. On-Policy Delta Distillation

Authors: Byeongho Heo, Jaehui Hwang, Sangdoo Yun, Dongyoon Han | Categories: cs.LG, cs.CL Link: arxiv.org/abs/2607.15161v1

The authors propose On-Policy Delta Distillation (OPD²), which uses the difference between a teacher model and its pre-reasoning-tuning base model as a distillation reward signal. This “delta signal” directly captures the changes induced by reasoning tuning, rather than forcing the student to imitate the full teacher distribution. Experiments across math, science, and code benchmarks show OPD² consistently outperforms conventional on-policy distillation, enabling strong performance with short post-training.

Takeaway: An elegant insight—distill the change from fine-tuning, not the full distribution—that could make reasoning LLM training significantly more efficient.


3. Digital Pantheon: Simulating and Auditing Coalition Formation with LLM Agents

Authors: Dylan Van Mulders, Matthias Bogaert, Dirk Van den Poel | Categories: cs.CL, cs.AI, cs.MA Link: arxiv.org/abs/2607.15095v1

This work presents a multi-agent framework combining SFT, DPO, and RAG to create politically-partisan LLM agents that negotiate coalition agreements, operationalized on the 2019 Flemish election. The authors introduce MILT (Multi-Layered Information Lineage Topology) and CIS (Coalition Influence Score) to trace every clause back to its manifesto origin. Across three simulations, the framework yields stable winners and correctly predicts which provisions materialize in the real-world agreement.

Takeaway: A fascinating case study in computational political science—demonstrating that careful persona engineering can overcome RLHF neutrality bias to model complex human negotiations.


4. Symbal: Detecting Systematic Misalignments in Model-Generated Captions

Authors: Maya Varma, Jean-Benoit Delbrouck, Sophie Ostmeier, Akshay Chaudhari, Curtis Langlotz | Categories: cs.CV, cs.AI Link: arxiv.org/abs/2607.15216v1

Symbal detects “systematic misalignments”—recurring captioning errors linked to specific visual features—using a dual-stage setup with off-the-shelf foundation models. The authors also release SymbalBench, a benchmark of 1.7M image-text pairs across 420 datasets with annotated errors. Symbal identifies systematic misalignments in 63.8% of datasets, a nearly 4x improvement over the closest baseline.

Takeaway: Timely work for auditing LLM-generated vision-language data at scale—it surfaces systematic errors without requiring access to the original captioning model.


5. Scaling Behavior Foundation Model for Humanoid Robots

Authors: Weishuai Zeng, Kangning Yin, Xiaojie Niu, Shunlin Lu, Weixiang Zhong et al. | Categories: cs.RO, cs.AI Link: arxiv.org/abs/2607.15163v1

This paper presents the Humanoid Transformer, a Behavior Foundation Model (BFM) that achieves scalable humanoid control by coordinating motion tracking as a learning paradigm, on-policy rollout with reference motion diversity, and a novel transformer architecture. The approach reduces Mean Per-Keypoint Position Error by over 10% in local mode and 82% in global mode compared to existing controllers, with strong real-world deployment results.

Takeaway: A principled scaling recipe for humanoid control BFMs—demonstrating that architectural design and learning paradigms matter as much as data volume for embodied AI.


6. StructureClaw: Traceable LLM Agents and an Executable Benchmark for Structural Engineering Workflows

Authors: Sizhong Qin, Yi Gu, Yao Jiang, Ao Cai, Changjian Zhou et al. | Categories: cs.SE, cs.AI, cs.MA Link: arxiv.org/abs/2607.14896v1

StructureClaw introduces an artifact-centered workbench where LLM agents handle complete structural-engineering workflows—from interpreted requirements through to final reports—with governed engineering skills and typed tools. StructureClaw-Bench includes 150 scenarios, and average success rates jump from 56.8% (generic skill baseline) to 88.6% with the full automatic workflow. The benchmark reveals safe handling of invalid numerical inputs as a key remaining challenge.

Takeaway: Sets a new standard for evaluating domain-specialist LLM agents by requiring full artifact chains, not just final answers—a rigorous approach that exposes otherwise invisible workflow failures.


7. Optimal Self-Distillation for Rectified Flow via Linear Probing

Authors: Saptarshi Roy, Debepsita Mukherjee, Pratik Patil | Categories: stat.ML, cs.LG Link: arxiv.org/abs/2607.14947v1

This paper provides a theoretical framework for optimal self-distillation in rectified flow models, proving an exact affine path identity and deriving the optimal mixing coefficient between teacher and true velocities in closed form. The optimal coefficient follows a sign rule—positive mixing corrects under-regularized teachers, negative mixing fixes over-regularized ones. Experiments on Gaussian and image data show improved velocity risk and finite-step generation.

Takeaway: Important theoretical grounding for the increasingly common practice of model self-distillation, with practical tuning procedures that avoid expensive grid search.


Authors: Debayan Mukhopadhyay, Utshab Kumar Ghosh, Shubham Chatterjee | Categories: cs.IR, cs.CL Link: arxiv.org/abs/2607.15253v1

Using counterfactual trajectory analysis on ReAct agents over HotpotQA, this paper shows that static retrieval utility (SRU) and causal utility (CTU) are nearly independent (Spearman rho = -0.026). Roughly a third of documents read by the agent are “bridge documents”—causally load-bearing but appearing useless to a static reader. The mechanism is identified: bridge documents provide discriminative entities that redirect the agent’s search in subsequent turns.

Takeaway: A critical finding for retrieval-augmented generation—optimizing for static relevance fundamentally misses the causal role documents play in multi-step agentic reasoning.


This content was generated with AI assistance. Paper information sourced from arXiv.