Skip to main content

Groq

Welcome to Groq! ๐Ÿš€ At Groq, we've developed the world's first Language Processing Unitโ„ข, or LPU. The Groq LPU has a deterministic, single core streaming architecture that sets the standard for GenAI inference speed with predictable and repeatable performance for any given workload.

Beyond the architecture, our software is designed to empower developers like you with the tools you need to create innovative, powerful AI applications. With Groq as your engine, you can:

  • Achieve uncompromised low latency and performance for real-time AI and HPC inferences ๐Ÿ”ฅ
  • Know the exact performance and compute time for any given workload ๐Ÿ”ฎ
  • Take advantage of our cutting-edge technology to stay ahead of the competition ๐Ÿ’ช

Want more Groq? Check out our website for more resources and join our Discord community to connect with our developers!

Installation and Setupโ€‹

Install the integration package:

pip install langchain-groq

Request an API key and set it as an environment variable:

export GROQ_API_KEY=gsk_...

Chat Modelโ€‹

See a usage example.


Was this page helpful?


You can also leave detailed feedback on GitHub.