The provided text outlines DYNAACT, a new framework intended to enhance sequential reasoning in Large Language Models (LLMs) by dynamically managing the available actions during complex problem-solving. This approach targets the inefficiency of current methods that either rely on manually defined and restrictive action spaces or utilize unstructured spaces that prove computationally prohibitive for exhaustive searches. DYNAACT addresses this by first estimating a broad action space from a corpus and then using a greedy algorithm to select an optimal, compact action space for each step. The core of the method is a submodular function that ensures the selected subset of actions maintains a balance between high utility (relevance to the current state) and sufficient diversity (avoiding redundant actions). Extensive evaluation on six benchmarks confirms that DYNAACT significantly improves problem-solving accuracy—especially in math and complex reasoning tasks—while also maintaining efficient inference compared to baseline methods.

Source:

https://openreview.net/pdf?id=R24ZqNwoDz