Analyzing a Run

Using the Runs Interface

The Runs Interface provides a comprehensive overview of your agent's execution history, helping you analyze its performance, track errors, and refine its behavior. This feature ensures transparency, allowing you to see exactly how your agent processes goals and interacts with tools in real-time.

Accessing Goal History

To view your agent’s execution history, navigate to the goal you want to inspect and click on the "History" button. This opens the Goal History module, where you’ll find a performance breakdown, detailed execution logs, and recommendations for improving goal success rates.

Performance Overview Metrics

At the top of the Goal History module, several key performance indicators help assess how efficiently your agent is operating:

• Efficiency: Measures how effectively the agent executed tasks based on available resources.

• Success Rate: Indicates the percentage of tasks that completed successfully without errors.

• Tool Utilization: Shows how efficiently the agent leveraged its plugins to accomplish goals.

• Time Efficiency: Evaluates whether the agent completed tasks within an optimal timeframe.

• Token Usage Graph: Displays how much compute power was consumed per goal execution, helping users optimize efficiency.

Execution History and Run States

Below the performance overview, you’ll find a chronological list of goal execution runs, ordered by time. Each run is color-coded based on its execution state:

• Blue Runs (Live Execution Logs): These logs capture raw execution data in real-time. They are useful for debugging and monitoring what the agent is doing live as it happens. More details on troubleshooting are covered in the Execution Logs and Common Errors section.

• Green Runs (Completed Goals): These runs represent fully executed goals, from start to finish.

Each run is also assigned a performance rating, ranging from Beginner to Legendary:

• Beginner: The goal did not complete successfully or was halted.

• Legendary: Every step executed perfectly with no errors.

Expanding a Run for Details

Clicking on a run expands it, revealing a structured breakdown of each execution step in the process. This allows you to analyze how your agent handled the task in sequential order. Each step includes:

• Execution Status: Whether the step was successful or failed (failed steps are marked in red).

• Success Criteria: The conditions the agent needed to meet for successful execution.

• Subtasks: Break down complex actions into granular steps.

• Tool Utilization: The plugin or tool the agent used for that specific step.

• Workflow Status: Indicates whether the execution was halted at this stage.

• Completion Status & Missing Requirements: If the step failed, this section outlines what prevented it from executing properly.

• Final Assessment: A summary of what happened during that stage of execution.

Recommendations for Optimization

At the bottom of each expanded run, you’ll find agent-generated recommendations suggesting improvements to enhance execution success. These recommendations may include:

• Adjusting task structures for better efficiency.

• Refining strategy definitions to align with execution logic.

• Enhancing tool selection for smoother automation.

For users seeking deeper analysis, full raw execution logs are available at the very bottom, offering a granular look at every event during the run.

At the bottom of the Goal History module, you'll also find quick edit buttons that allow you to instantly adjust your agent's personality, social strategy, trading strategy, and goal settings. Instead of navigating through multiple menus, this streamlined interface enables you to make real-time modifications based on execution results.

With this structured history system, the agents provide a transparent and data-driven approach to automation, allowing users to refine execution, troubleshoot errors, and continuously improve agent performance.