Langtrace Mistral
Langtracemistral-cookbookthird_party
Export
RAG Observability with Mistral AI and Langtrace
This Notebook shows the instructions for setting up OpenTelemetry based tracing for Mistral with Langtrace AI.
The Goal for this notebook to showcase a simple RAG app where you can chat with the United states consititution pdf.
[1]
Requirement already satisfied: mistralai in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (1.2.3) Requirement already satisfied: langtrace-python-sdk in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (3.3.10) Requirement already satisfied: chromadb in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (0.5.20) Requirement already satisfied: pypdf in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (5.1.0) Requirement already satisfied: langchain in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (0.3.8) Requirement already satisfied: langchain-community in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (0.3.8) Requirement already satisfied: eval-type-backport<0.3.0,>=0.2.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from mistralai) (0.2.0) Requirement already satisfied: httpx<0.28.0,>=0.27.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from mistralai) (0.27.2) Requirement already satisfied: jsonpath-python<2.0.0,>=1.0.6 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from mistralai) (1.0.6) Requirement already satisfied: pydantic<3.0.0,>=2.9.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from mistralai) (2.10.1) Requirement already satisfied: python-dateutil==2.8.2 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from mistralai) (2.8.2) Requirement already satisfied: typing-inspect<0.10.0,>=0.9.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from mistralai) (0.9.0) Requirement already satisfied: six>=1.5 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from python-dateutil==2.8.2->mistralai) (1.16.0) Requirement already satisfied: colorama>=0.4.6 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (0.4.6) Requirement already satisfied: fsspec>=2024.6.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (2024.10.0) Requirement already satisfied: opentelemetry-api>=1.25.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (1.28.2) Requirement already satisfied: opentelemetry-exporter-otlp-proto-grpc>=1.25.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (1.28.2) Requirement already satisfied: opentelemetry-exporter-otlp-proto-http>=1.25.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (1.28.2) Requirement already satisfied: opentelemetry-instrumentation-sqlalchemy>=0.46b0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (0.49b2) Requirement already satisfied: opentelemetry-instrumentation>=0.47b0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (0.49b2) Requirement already satisfied: opentelemetry-sdk>=1.25.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (1.28.2) Requirement already satisfied: sentry-sdk>=2.14.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (2.19.0) Requirement already satisfied: sqlalchemy in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (2.0.35) Requirement already satisfied: tiktoken>=0.1.1 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (0.8.0) Requirement already satisfied: trace-attributes==7.1.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (7.1.0) Requirement already satisfied: transformers>=4.11.3 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (4.46.3) Requirement already satisfied: ujson>=5.10.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langtrace-python-sdk) (5.10.0) Requirement already satisfied: build>=1.0.3 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (1.2.2.post1) Requirement already satisfied: chroma-hnswlib==0.7.6 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (0.7.6) Requirement already satisfied: fastapi>=0.95.2 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (0.115.5) Requirement already satisfied: uvicorn[standard]>=0.18.3 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (0.32.1) Requirement already satisfied: numpy>=1.22.5 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (1.26.4) Requirement already satisfied: posthog>=2.4.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (3.7.3) Requirement already satisfied: typing-extensions>=4.5.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (4.12.2) Requirement already satisfied: onnxruntime>=1.14.1 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (1.20.1) Requirement already satisfied: opentelemetry-instrumentation-fastapi>=0.41b0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (0.49b2) Requirement already satisfied: tokenizers>=0.13.2 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (0.20.3) Requirement already satisfied: pypika>=0.48.9 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (0.48.9) Requirement already satisfied: tqdm>=4.65.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (4.67.1) Requirement already satisfied: overrides>=7.3.1 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (7.7.0) Requirement already satisfied: importlib-resources in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (6.4.5) Requirement already satisfied: grpcio>=1.58.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (1.68.0) Requirement already satisfied: bcrypt>=4.0.1 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (4.2.1) Requirement already satisfied: typer>=0.9.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (0.13.1) Requirement already satisfied: kubernetes>=28.1.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (31.0.0) Requirement already satisfied: tenacity>=8.2.3 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (9.0.0) Requirement already satisfied: PyYAML>=6.0.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (6.0.2) Requirement already satisfied: mmh3>=4.0.1 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (5.0.1) Requirement already satisfied: orjson>=3.9.12 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (3.10.12) Requirement already satisfied: rich>=10.11.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from chromadb) (13.9.4) Requirement already satisfied: aiohttp<4.0.0,>=3.8.3 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langchain) (3.11.7) Requirement already satisfied: langchain-core<0.4.0,>=0.3.21 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langchain) (0.3.21) Requirement already satisfied: langchain-text-splitters<0.4.0,>=0.3.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langchain) (0.3.2) Requirement already satisfied: langsmith<0.2.0,>=0.1.17 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langchain) (0.1.146) Requirement already satisfied: requests<3,>=2 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langchain) (2.32.3) Requirement already satisfied: dataclasses-json<0.7,>=0.5.7 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langchain-community) (0.6.7) Requirement already satisfied: httpx-sse<0.5.0,>=0.4.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langchain-community) (0.4.0) Requirement already satisfied: pydantic-settings<3.0.0,>=2.4.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langchain-community) (2.6.1) Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain) (2.4.3) Requirement already satisfied: aiosignal>=1.1.2 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain) (1.3.1) Requirement already satisfied: attrs>=17.3.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain) (24.2.0) Requirement already satisfied: frozenlist>=1.1.1 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain) (1.5.0) Requirement already satisfied: multidict<7.0,>=4.5 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain) (6.1.0) Requirement already satisfied: propcache>=0.2.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain) (0.2.0) Requirement already satisfied: yarl<2.0,>=1.17.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain) (1.18.0) Requirement already satisfied: packaging>=19.1 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from build>=1.0.3->chromadb) (24.2) Requirement already satisfied: pyproject_hooks in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from build>=1.0.3->chromadb) (1.2.0) Requirement already satisfied: marshmallow<4.0.0,>=3.18.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from dataclasses-json<0.7,>=0.5.7->langchain-community) (3.23.1) Requirement already satisfied: starlette<0.42.0,>=0.40.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from fastapi>=0.95.2->chromadb) (0.41.3) Requirement already satisfied: anyio in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from httpx<0.28.0,>=0.27.0->mistralai) (4.6.2.post1) Requirement already satisfied: certifi in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from httpx<0.28.0,>=0.27.0->mistralai) (2024.8.30) Requirement already satisfied: httpcore==1.* in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from httpx<0.28.0,>=0.27.0->mistralai) (1.0.7) Requirement already satisfied: idna in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from httpx<0.28.0,>=0.27.0->mistralai) (3.10) Requirement already satisfied: sniffio in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from httpx<0.28.0,>=0.27.0->mistralai) (1.3.1) Requirement already satisfied: h11<0.15,>=0.13 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from httpcore==1.*->httpx<0.28.0,>=0.27.0->mistralai) (0.14.0) Requirement already satisfied: google-auth>=1.0.1 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from kubernetes>=28.1.0->chromadb) (2.36.0) Requirement already satisfied: websocket-client!=0.40.0,!=0.41.*,!=0.42.*,>=0.32.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from kubernetes>=28.1.0->chromadb) (1.8.0) Requirement already satisfied: requests-oauthlib in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from kubernetes>=28.1.0->chromadb) (2.0.0) Requirement already satisfied: oauthlib>=3.2.2 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from kubernetes>=28.1.0->chromadb) (3.2.2) Requirement already satisfied: urllib3>=1.24.2 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from kubernetes>=28.1.0->chromadb) (2.2.3) Requirement already satisfied: durationpy>=0.7 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from kubernetes>=28.1.0->chromadb) (0.9) Requirement already satisfied: jsonpatch<2.0,>=1.33 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langchain-core<0.4.0,>=0.3.21->langchain) (1.33) Requirement already satisfied: requests-toolbelt<2.0.0,>=1.0.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from langsmith<0.2.0,>=0.1.17->langchain) (1.0.0) Requirement already satisfied: coloredlogs in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from onnxruntime>=1.14.1->chromadb) (15.0.1) Requirement already satisfied: flatbuffers in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from onnxruntime>=1.14.1->chromadb) (24.3.25) Requirement already satisfied: protobuf in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from onnxruntime>=1.14.1->chromadb) (5.28.3) Requirement already satisfied: sympy in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from onnxruntime>=1.14.1->chromadb) (1.13.3) Requirement already satisfied: deprecated>=1.2.6 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from opentelemetry-api>=1.25.0->langtrace-python-sdk) (1.2.15) Requirement already satisfied: importlib-metadata<=8.5.0,>=6.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from opentelemetry-api>=1.25.0->langtrace-python-sdk) (8.5.0) Requirement already satisfied: googleapis-common-protos~=1.52 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from opentelemetry-exporter-otlp-proto-grpc>=1.25.0->langtrace-python-sdk) (1.66.0) Requirement already satisfied: opentelemetry-exporter-otlp-proto-common==1.28.2 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from opentelemetry-exporter-otlp-proto-grpc>=1.25.0->langtrace-python-sdk) (1.28.2) Requirement already satisfied: opentelemetry-proto==1.28.2 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from opentelemetry-exporter-otlp-proto-grpc>=1.25.0->langtrace-python-sdk) (1.28.2) Requirement already satisfied: opentelemetry-semantic-conventions==0.49b2 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from opentelemetry-instrumentation>=0.47b0->langtrace-python-sdk) (0.49b2) Requirement already satisfied: wrapt<2.0.0,>=1.0.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from opentelemetry-instrumentation>=0.47b0->langtrace-python-sdk) (1.17.0) Requirement already satisfied: opentelemetry-instrumentation-asgi==0.49b2 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from opentelemetry-instrumentation-fastapi>=0.41b0->chromadb) (0.49b2) Requirement already satisfied: opentelemetry-util-http==0.49b2 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from opentelemetry-instrumentation-fastapi>=0.41b0->chromadb) (0.49b2) Requirement already satisfied: asgiref~=3.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from opentelemetry-instrumentation-asgi==0.49b2->opentelemetry-instrumentation-fastapi>=0.41b0->chromadb) (3.8.1) Requirement already satisfied: monotonic>=1.5 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from posthog>=2.4.0->chromadb) (1.6) Requirement already satisfied: backoff>=1.10.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from posthog>=2.4.0->chromadb) (2.2.1) Requirement already satisfied: annotated-types>=0.6.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from pydantic<3.0.0,>=2.9.0->mistralai) (0.7.0) Requirement already satisfied: pydantic-core==2.27.1 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from pydantic<3.0.0,>=2.9.0->mistralai) (2.27.1) Requirement already satisfied: python-dotenv>=0.21.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from pydantic-settings<3.0.0,>=2.4.0->langchain-community) (1.0.1) Requirement already satisfied: charset-normalizer<4,>=2 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from requests<3,>=2->langchain) (3.4.0) Requirement already satisfied: markdown-it-py>=2.2.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from rich>=10.11.0->chromadb) (3.0.0) Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from rich>=10.11.0->chromadb) (2.18.0) Requirement already satisfied: regex>=2022.1.18 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from tiktoken>=0.1.1->langtrace-python-sdk) (2024.11.6) Requirement already satisfied: huggingface-hub<1.0,>=0.16.4 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from tokenizers>=0.13.2->chromadb) (0.26.2) Requirement already satisfied: filelock in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from transformers>=4.11.3->langtrace-python-sdk) (3.16.1) Requirement already satisfied: safetensors>=0.4.1 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from transformers>=4.11.3->langtrace-python-sdk) (0.4.5) Requirement already satisfied: click>=8.0.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from typer>=0.9.0->chromadb) (8.1.7) Requirement already satisfied: shellingham>=1.3.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from typer>=0.9.0->chromadb) (1.5.4) Requirement already satisfied: mypy-extensions>=0.3.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from typing-inspect<0.10.0,>=0.9.0->mistralai) (1.0.0) Requirement already satisfied: httptools>=0.6.3 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from uvicorn[standard]>=0.18.3->chromadb) (0.6.4) Requirement already satisfied: uvloop!=0.15.0,!=0.15.1,>=0.14.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from uvicorn[standard]>=0.18.3->chromadb) (0.21.0) Requirement already satisfied: watchfiles>=0.13 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from uvicorn[standard]>=0.18.3->chromadb) (1.0.0) Requirement already satisfied: websockets>=10.4 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from uvicorn[standard]>=0.18.3->chromadb) (14.1) Requirement already satisfied: cachetools<6.0,>=2.0.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb) (5.5.0) Requirement already satisfied: pyasn1-modules>=0.2.1 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb) (0.4.1) Requirement already satisfied: rsa<5,>=3.1.4 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb) (4.9) Requirement already satisfied: zipp>=3.20 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from importlib-metadata<=8.5.0,>=6.0->opentelemetry-api>=1.25.0->langtrace-python-sdk) (3.21.0) Requirement already satisfied: jsonpointer>=1.9 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from jsonpatch<2.0,>=1.33->langchain-core<0.4.0,>=0.3.21->langchain) (3.0.0) Requirement already satisfied: mdurl~=0.1 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=10.11.0->chromadb) (0.1.2) Requirement already satisfied: humanfriendly>=9.1 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from coloredlogs->onnxruntime>=1.14.1->chromadb) (10.0) Requirement already satisfied: mpmath<1.4,>=1.1.0 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from sympy->onnxruntime>=1.14.1->chromadb) (1.3.0) Requirement already satisfied: pyasn1<0.7.0,>=0.4.6 in /Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages (from pyasn1-modules>=0.2.1->google-auth>=1.0.1->kubernetes>=28.1.0->chromadb) (0.6.1) [notice] A new release of pip is available: 23.2.1 -> 24.3.1 [notice] To update, run: pip install --upgrade pip Note: you may need to restart the kernel to use updated packages.
Imports & Initialize clients
[2]
Initializing Langtrace SDK.. ⭐ Leave our github a star to stay on top of our updates - https://github.com/Scale3-Labs/langtrace Exporting spans to Langtrace cloud..
/Users/ali/Work/mistral-cookbook/.venv/lib/python3.11/site-packages/tqdm/auto.py:21: TqdmWarning: IProgress not found. Please update jupyter and ipywidgets. See https://ipywidgets.readthedocs.io/en/stable/user_install.html from .autonotebook import tqdm as notebook_tqdm
Use Langchain to split pdf into chunks
[3]
Setup Chroma & Insert pdf chunks
Create a chroma collection, specifying the default embedding function which will be used in our RAG when inserting pdf chunks
[4]
Query Collection
- take query from user, get nearest 3 results from chunked pdf
- construct a prompt structure
- Give query and prompt to mistral for the actual response
[5]
Run everything together and monitor using Langtrace.
[6]
Creating collection Loading and splitting pdf Adding documents to collection Querying pdf Based on the context, the purpose of the Constitution is stated in the Preamble: "to form a more perfect Union, establish Justice, insure domestic Tranquility, provide for the common defence, promote the general Welfare, and secure the Blessings of Liberty to ourselves and our Posterity."
That's it! Now you should be able to see the traces for all your inference calls on Langtrace!
First Two Screenshots showcase the Trace and span structure of the whole RAG App.
Second Two Screenshots are details of Mistral's Run.
- You can see what prompt is specfically fetched from chromadb and sent to mistral as well as the response
