* initial mcp * food ordering with mcp * prompt eng * splitting out goals and updating docs * a diff so I can get tests from codex * a diff so I can get tests from codex * oops, missing files * tests, file formatting * readme and setup updates * setup.md link fixes * readme change * readme change * readme change * stripe food setup script * single agent mode default * prompt engineering for better multi agent performance * performance should be greatly improved * Update goals/finance.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update activities/tool_activities.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * co-pilot PR suggested this change, and now fixed it * stronger wording around json format response * formatting * moved docs to dir * moved image assets under docs * cleanup env example, stripe guidance * cleanup --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
10 KiB
Customizing the Agent
The agent operates in single-agent mode by default, focusing on one specific goal. It also supports an experimental multi-agent mode where users can have multiple agents, each with their own goal, and supports switching back to choosing a new goal at the end of every successful goal (or even mid-goal).
A goal can use two types of tools:
- Native Tools: Custom tools implemented directly in the codebase (in
/tools/) - MCP Tools: External tools accessed via Model Context Protocol (MCP) servers
It may be helpful to review the architecture for a guide and definition of goals, tools, etc.
Adding a New Goal Category
Goal Categories lets you pick which groups of goals to show in multi-agent mode. Set via an .env setting, GOAL_CATEGORIES.
Even if you don't intend to use the goal in a multi-agent scenario, goal categories are useful for organization and discovery.
- Pick a unique one that has some business meaning
- Use it in your .env file
- Add to .env.example
- Use it in your Goal definition, see below.
Adding a Goal
- Create a new Python file in the
/goals/directory (e.g.,goals/my_category.py) - these files contain descriptions of goals and the tools used to achieve them - Pick a name for your goal! (such as "goal_hr_schedule_pto")
- Fill out the required elements:
id: needs to be the same as the nameagent_name: user-facing name for the agent/chatbotcategory_tag: category for the goalagent_friendly_description: user-facing description of what the agent/chatbot doestools: the list of native tools the goal uses. These are defined in tools/tool_registry.py astool_registry.[name_of_tool]
Example:
tools=[
tool_registry.current_pto_tool,
tool_registry.future_pto_calc_tool,
tool_registry.book_pto_tool,
]
mcp_server_definition: (Optional) MCP server configuration for external tools. Can use predefined configurations fromshared/mcp_config.pyor define custom ones. See MCP Tools section below.description: LLM-facing description of the goal that lists all tools (native and MCP) by name and purpose.starter_prompt: LLM-facing first prompt given to begin the scenario. This field can contain instructions that are different from other goals, like "begin by providing the output of the first tool" rather than waiting on user confirmation. (See goal_choose_agent_type for an example.)example_conversation_history: LLM-facing sample conversation/interaction regarding the goal. See the existing goals for how to structure this.
- Add your new goal to a list variable (e.g.,
my_category_goals: List[AgentGoal] = [your_super_sweet_new_goal]) - Import and extend the goal list in
goals/__init__.pyby adding:- Import:
from goals.my_category import my_category_goals - Extend:
goal_list.extend(my_category_goals)
- Import:
Adding Native Tools
Native tools are custom implementations that run directly in your codebase. Use these for business logic specific to your application.
Note on Optional Tools
Tools can be optional - you can indicate this in the tool listing of goal description (see above section re: goal registry) by adding something like, "This step is optional and can be skipped by moving to the next tool." Here is an example from an older iteration of the goal_hr_schedule_pto goal, when it was going to have an optional step to check for existing calendar conflicts:
description="Help the user gather args for these tools in order: "
"1. CurrentPTO: Tell the user how much PTO they currently have "
"2. FuturePTO: Tell the user how much PTO they will have as of the prospective date "
"3. CalendarConflict: Tell the user what conflicts if any exist around the prospective date on a list of calendars. This step is optional and can be skipped by moving to the next tool. "
"4. BookPTO: Book PTO "
Tools should generally return meaningful information and be generally ‘failsafe’ in returning a useful result based on input. (If you're doing a local data approach like those in .tools/data/) it's good to document how they can be setup to get a good result in tool specific setup.
Add to Tool Registry
- Open /tools/tool_registry.py - this file contains mapping of tool names to tool definitions (so the AI understands how to use them)
- Define the tool
name: name of the tool - this is the name as defined in the goal description list of tools. The name should be (sort of) the same as the tool name given in the goal description. So, if the description lists "CurrentPTO" as a tool, the name here should becurrent_pto_tool.description: LLM-facing description of toolarguments: These are the input arguments to the tool. Each input argument should be defined as a ToolArgument. Tools don't have to have arguments but the arguments list has to be declared. If the tool you're creating doesn't have inputs, define arguments asarguments=[]
Create Each Native Tool Implementation
- The tools themselves are defined in their own files in
/tools- you can add a subfolder to organize them, see the hr tools for an example. - The file name and function name will be the same as each other and should also be the same as the name of the tool, without "tool" - so
current_pto_toolwould becurrent_pto.pywith a function namedcurrent_ptowithin it. - The function should have
args: dictas the input and also return adict - The return dict should match the output format you specified in the goal's
example_conversation_history - tools are where the user input+model output becomes deterministic. Add validation here to make sure what the system is doing is valid and acceptable
Add to tools/__init__.py and the tool get_handler()
- In tools/init.py, add an import statement for each new native tool as well as an applicable return statement in
get_handler. The tool name here should match the tool name as described in the goal'sdescriptionfield. Example:
if tool_name == "CurrentPTO":
return current_pto
Update workflow_helpers.py
- Add your new native tool to the static tools list in workflows/workflow_helpers.py so it's correctly identified as a native tool rather than an MCP tool.
Adding MCP Tools
MCP (Model Context Protocol) tools are external tools provided by MCP servers. They're useful for integrating with third-party services like Stripe, databases, or APIs without implementing custom code.
Configure MCP Server Definition
You can either use predefined MCP server configurations from shared/mcp_config.py or define custom ones.
Using Predefined Configurations
from shared.mcp_config import get_stripe_mcp_server_definition
# In your goal definition:
mcp_server_definition=get_stripe_mcp_server_definition(included_tools=["list_products", "create_customer"])
Custom MCP Server Definition
Add an mcp_server_definition to your goal:
mcp_server_definition=MCPServerDefinition(
name="stripe-mcp",
command="npx",
args=[
"-y",
"@stripe/mcp",
"--tools=all",
f"--api-key={os.getenv('STRIPE_API_KEY')}",
],
env=None,
included_tools=[
"list_products",
"list_prices",
"create_customer",
"create_invoice",
"create_payment_link",
],
)
MCP Tool Configuration
name: Identifier for the MCP servercommand: Command to start the MCP server (e.g., "npx", "python")args: Arguments to pass to the commandenv: Environment variables for the server (optional)included_tools: List of specific tools to use from the server (optional - if omitted, all tools are included)
How MCP Tools Work
- MCP tools are automatically loaded when the workflow starts
- They're dynamically converted to
ToolDefinitionobjects - The system automatically routes MCP tool calls to the appropriate MCP server
- No additional code implementation needed - just configuration
Tool Confirmation
There are three ways to manage confirmation of tool runs:
- Arguments confirmation box - confirm tool arguments and execution with a button click
- Can be disabled by env setting:
SHOW_CONFIRM=FALSE
- Can be disabled by env setting:
- Soft prompt confirmation via asking the model to prompt for confirmation: “Are you ready to be invoiced for the total cost of the train tickets?” in the goal_registry.
- Hard confirmation requirement as a tool argument. See for example the PTO Scheduling Tool:
ToolArgument(
name="userConfirmation",
type="string",
description="Indication of user's desire to book PTO",
),
If you really want to wait for user confirmation, record it on the workflow (as a Signal) and not rely on the LLM to probably get it, use option #3. I recommend exploring all three. For a demo, I would decide if you want the Arguments confirmation in the UI, and if not I'd generally go with option #2 but use #3 for tools that make business sense to confirm, e.g. those tools that take action/write data.
Add a Goal & Tools Checklist
For All Goals:
- Create goal file in
/goals/directory (e.g.,goals/my_category.py) - Add goal to the category's goal list in the file
- Import and extend the goal list in
goals/__init__.py - If a new category, add Goal Category to .env and .env.example
For Native Tools:
- Add native tools to tool_registry.py
- Implement tool functions in
/tools/directory - Add tools to tools/init.py in the
get_handler()function - Add tool names to static tools list in workflows/workflow_helpers.py
For MCP Tools:
- Add
mcp_server_definitionto your goal configuration (useshared/mcp_config.pyfor common servers) - Ensure MCP server is available and properly configured
- Set required environment variables (API keys, etc.)
- Test MCP server connectivity before running the agent
- If creating new MCP server configs, add them to
shared/mcp_config.pyfor reuse
And that's it! Happy AI Agent building!