Skip to main content

C Transformers

The C Transformers library provides Python bindings for GGML models.

This example goes over how to use LangChain to interact with C Transformers models.


%pip install ctransformers

Load Model

from langchain.llms import CTransformers

llm = CTransformers(model="marella/gpt-2-ggml")

API Reference:

Generate Text

print(llm("AI is going to"))


from langchain.callbacks.streaming_stdout import StreamingStdOutCallbackHandler

llm = CTransformers(
model="marella/gpt-2-ggml", callbacks=[StreamingStdOutCallbackHandler()]

response = llm("AI is going to")


from langchain.prompts import PromptTemplate
from langchain.chains import LLMChain

template = """Question: {question}


prompt = PromptTemplate(template=template, input_variables=["question"])

llm_chain = LLMChain(prompt=prompt, llm=llm)

response ="What is AI?")