Skip to main content

Passio NutritionAI

To best understand how NutritionAI can give your agents super food-nutrition powers, let's build an agent that can find that information via Passio NutritionAI.

Define tools

We first need to create the Passio NutritionAI tool.

Passio Nutrition AI

We have a built-in tool in LangChain to easily use Passio NutritionAI to find food nutrition facts. Note that this requires an API key - they have a free tier.

Once you create your API key, you will need to export that as:


... or provide it to your Python environment via some other means such as the dotenv package. You an also explicitly control the key via constructor calls.

from dotenv import load_dotenv
from langchain_core.utils import get_from_env


nutritionai_subscription_key = get_from_env(
"nutritionai_subscription_key", "NUTRITIONAI_SUBSCRIPTION_KEY"
API Reference:get_from_env
from import NutritionAI
from langchain_community.utilities.passio_nutrition_ai import NutritionAIAPI
API Reference:NutritionAI | NutritionAIAPI
nutritionai_search = NutritionAI(api_wrapper=NutritionAIAPI())
nutritionai_search.invoke("chicken tikka masala")
nutritionai_search.invoke("Schnuck Markets sliced pepper jack cheese")


Now that we have the tool, we can create a list of tools that we will use downstream.

tools = [nutritionai_search]

Create the agent

Now that we have defined the tools, we can create the agent. We will be using an OpenAI Functions agent - for more information on this type of agent, as well as other options, see this guide

First, we choose the LLM we want to be guiding the agent.

from langchain_openai import ChatOpenAI

llm = ChatOpenAI(model="gpt-3.5-turbo", temperature=0)
API Reference:ChatOpenAI

Next, we choose the prompt we want to use to guide the agent.

from langchain import hub

# Get the prompt to use - you can modify this!
prompt = hub.pull("hwchase17/openai-functions-agent")
[SystemMessagePromptTemplate(prompt=PromptTemplate(input_variables=[], template='You are a helpful assistant')),
MessagesPlaceholder(variable_name='chat_history', optional=True),
HumanMessagePromptTemplate(prompt=PromptTemplate(input_variables=['input'], template='{input}')),

Now, we can initalize the agent with the LLM, the prompt, and the tools. The agent is responsible for taking in input and deciding what actions to take. Crucially, the Agent does not execute those actions - that is done by the AgentExecutor (next step). For more information about how to think about these components, see our conceptual guide

from langchain.agents import create_openai_functions_agent

agent = create_openai_functions_agent(llm, tools, prompt)

Finally, we combine the agent (the brains) with the tools inside the AgentExecutor (which will repeatedly call the agent and execute tools). For more information about how to think about these components, see our conceptual guide

from langchain.agents import AgentExecutor

agent_executor = AgentExecutor(agent=agent, tools=tools, verbose=True)
API Reference:AgentExecutor

Run the agent

We can now run the agent on a few queries! Note that for now, these are all stateless queries (it won't remember previous interactions).

agent_executor.invoke({"input": "hi!"})

> Entering new AgentExecutor chain...
Hello! How can I assist you today?

> Finished chain.
{'input': 'hi!', 'output': 'Hello! How can I assist you today?'}
agent_executor.invoke({"input": "how many calories are in a slice pepperoni pizza?"})

If we want to keep track of these messages automatically, we can wrap this in a RunnableWithMessageHistory. For more information on how to use this, see this guide

{"input": "I had bacon and eggs for breakfast. How many calories is that?"}
"input": "I had sliced pepper jack cheese for a snack. How much protein did I have?"
"input": "I had sliced colby cheese for a snack. Give me calories for this Schnuck Markets product."
"input": "I had chicken tikka masala for dinner. how much calories, protein, and fat did I have with default quantity?"


That's a wrap! In this quick start we covered how to create a simple agent that is able to incorporate food-nutrition information into its answers. Agents are a complex topic, and there's lot to learn!

Was this page helpful?

You can leave detailed feedback on GitHub.