AI PAPERS/DAILY
Subscribe free Open sourceView on GitHub Star This project is open sourceRead the code or use it in your own project. If you like it, don’t forget to give it a ★ star on GitHub.

All papersLLMs & Language ModelsUniversity of Maryland, Baltimore County

SMART: State-based Multi Agent Reasoning Traces for Verification-oriented Problem-Solving

/ Paper arXiv 2611.08196

Key numbers

20%…guided solution reasoning improves validation performance up to 20% on complex scientific claims spanning 3 datasets.
5%We show that grounding premises in real-world knowledge is necessary and improves performance up to 5%

From the paperCopied from the abstract, not written by AI.

Abstract

From the paperThe authors' own words.

Complex problems with limited context, such as claims, require a means to obtain additional knowledge necessary for solution reasoning. We propose a multi-agent framework, SMART, to obtain knowledge through capturing the implicit state of participating entities in a problem context. SMART curates the state knowledge as diverse, complementary and solution-salient premises using a variety of LLMs and a structured role-based prompt strategy. Using knowledge from these real-world verified curated premises, SMART's knowledge guided solution reasoning improves validation performance up to 20% on complex scientific claims spanning 3 datasets. We show that grounding premises in real-world knowledge is necessary and improves performance up to 5%.

From the full paper

From the paperCopied from the paper itself by our code.

Reading the paper on arXiv…

Ask this paper

/ Ask a questionAnswers come from the full paper and name the section

    / Your notes

    Select text in the abstract to highlight it or add a note. They stay in this browser.

      / Read next, same idea

      Read the PDF