LLMonitor is an open-source observability platform that provides cost and usage analytics, user tracking, tracing and evaluation tools.
Installation and Setup
Create an account on llmonitor.com, then copy your new app's
Once you have it, set it as an environment variable by running:
See a usage example.
from langchain.callbacks import LLMonitorCallbackHandler