Writer LLM

Writer is a platform to generate different language content.

This example goes over how to use LangChain to interact with Writer models.

Setup

To access Writer models you'll need to create a Writer account, get an API key, and install the writer-sdk and langchain-community packages.

Credentials

Head to Writer AI Studio to sign up to OpenAI and generate an API key. Once you've done this set the WRITER_API_KEY environment variable:

import getpass
import os

if not os.environ.get("WRITER_API_KEY"):
    os.environ["WRITER_API_KEY"] = getpass.getpass("Enter your Writer API key:")

Installation

The LangChain Writer integration lives in the langchain-community package:

%pip install -qU langchain-community writer-sdk

[notice] A new release of pip is available: 24.2 -> 24.3.1
[notice] To update, run: pip install --upgrade pip
Note: you may need to restart the kernel to use updated packages.

Now we can initialize our model object to interact with writer LLMs

from langchain_community.llms import Writer as WriterLLM

llm = WriterLLM(
    temperature=0.7,
    max_tokens=1000,
    # other params...
)

API Reference:Writer

Invocation

response_text = llm.invoke(input="Write a poem")

print(response_text)

Streaming

stream_response = llm.stream(input="Tell me a fairytale")

for chunk in stream_response:
    print(chunk, end="")

Async

Writer support asynchronous calls via ainvoke() and astream() methods

API reference

For detailed documentation of all Writer features, head to our API reference.

Related

• LLM conceptual guide
• LLM how-to guides