Skip to main content


This page covers how to use Fireworks models within Langchain.

Installation and setup​

  • Install the Fireworks client library.

    pip install fireworks-ai
  • Get a Fireworks API key by signing up at

  • Authenticate by setting the FIREWORKS_API_KEY environment variable.


There are two ways to authenticate using your Fireworks API key:

  1. Setting the FIREWORKS_API_KEY environment variable.

    os.environ["FIREWORKS_API_KEY"] = "<KEY>"
  2. Setting fireworks_api_key field in the Fireworks LLM module.

    llm = Fireworks(fireworks_api_key="<KEY>")

Using the Fireworks LLM module​

Fireworks integrates with Langchain through the LLM module. In this example, we will work the llama-v2-13b-chat model.

from langchain_community.llms.fireworks import Fireworks 

llm = Fireworks(
llm("Name 3 sports.")

For a more detailed walkthrough, see here.