Rag With Hf And Milvus
zh-CNhf-cookbooknotebooks
Export
准备
依赖关系和环境
[1]
如果您使用 Google Colab，要启用刚刚安装的依赖项，您可能需要 重新启动运行时（单击屏幕顶部的“运行时”菜单，然后从下拉菜单中选择“重新启动会话”） 。
另外，我们建议您配置您的 Hugging Face User Access Token，并将其设置在您的环境变量中，因为我们将使用 Hugging Face Hub 的 LLM 。如果不设置 token 环境变量，您可能会受到较低的请求速率限制。
[2]
准备数据
我们使用 AI Act PDF 作为我们 RAG 中的私有知识。这是一个针对人工智能的监管框架，具有不同风险级别，对应或多或少的监管。
[3]
我们使用 LangChain 的 PyPDFLoader 从 PDF 中提取文本，然后将文本拆分为更小的块。默认情况下，我们将块大小设置为 1000，重叠设置为 200，这意味着每个块将有近 1000 个字符，两个块之间的重叠将是 200 个字符。
[4]
108
[5]
[6]
准备 embedding 模型
定义一个函数来生成文本 embedding。我们使用 BGE embedding模型 作为示例，但您也可以将其更改为任何其他 embedding 模型，例如在 MTEB排行榜 上选择。
[7]
生成测试 embedding 并打印其大小和前几个元素。
[8]
384 [-0.07660683244466782, 0.025316666811704636, 0.012505513615906239, 0.004595153499394655, 0.025780051946640015, 0.03816710412502289, 0.08050819486379623, 0.003035430097952485, 0.02439221926033497, 0.0048803347162902355]
将数据加载到 Milvus 中
创建 collection
[9]
对于
MilvusClient的参数：
- 将
uri设置为本地文件，例如./hf_milvus_demo.db，是最方便的方法，因为它会自动使用 Milvus Lite 将所有数据存储在此文件中。- 如果您有大量数据，例如超过一百万个向量，您可以在 Docker 或 Kubernetes 上设置性能更高的 Milvus 服务器。在此设置中，请使用服务器 uri，例如
http://localhost:19530作为您的uri。- 如果您想使用 Milvus 的全托管云服务 Zilliz Cloud ，请调整
uri和token，分别对应 Zilliz Cloud 中 Public Endpoint 和 Api key 。
检查 collection 是否已存在，如果存在则将其删除。
[10]
使用指定参数创建一个新 collection。
如果我们不指定任何字段信息，Milvus 会自动创建一个默认的 id 字段作为主键，并创建一个 vector 字段来存储向量数据。保留的 JSON 字段用于存储未定义 schema 的字段及其值。
[11]
插入数据
迭代文本行，创建 embedding，然后将数据插入到 Milvus 中。
这是一个新字段 text，它是 collection schema 中的未定义字段。它将自动添加到保留的 JSON 动态字段中，从更高的层次看来，它可被视为普通字段。
[12]
Creating embeddings: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 429/429 [00:52<00:00, 8.10it/s]
429
构建 RAG
检索查询数据
让我们具体指定一个有关该语料的问题。
[13]
在 collection 中搜索问题并检索语义前 3 个匹配项。
[14]
我们来看看查询的搜索结果
[15]
[
[
"EN 6 EN 2. LEGAL BASIS, SUBSIDIARITY AND PROPORTIONALITY \n2.1. Legal basis \nThe legal basis for the proposal is in the first place Article 114 of the Treaty on the \nFunctioning of the European Union (TFEU), which provides for the adoption of measures to \nensure the establishment and f unctioning of the internal market. \nThis proposal constitutes a core part of the EU digital single market strategy. The primary \nobjective of this proposal is to ensure the proper functioning of the internal market by setting \nharmonised rules in particular on the development, placing on the Union market and the use \nof products and services making use of AI technologies or provided as stand -alone AI \nsystems. Some Member States are already considering national rules to ensure that AI is safe \nand is developed a nd used in compliance with fundamental rights obligations. This will likely \nlead to two main problems: i) a fragmentation of the internal market on essential elements",
0.7412998080253601
],
[
"applications and prevent market fragmentation. \nTo achieve those objectives, this proposal presents a balanced and proportionate horizontal \nregulatory approach to AI that is limited to the minimum necessary requirements to address \nthe risks and problems linked to AI, withou t unduly constraining or hindering technological \ndevelopment or otherwise disproportionately increasing the cost of placing AI solutions on \nthe market. The proposal sets a robust and flexible legal framework. On the one hand, it is \ncomprehensive and future -proof in its fundamental regulatory choices, including the \nprinciple -based requirements that AI systems should comply with. On the other hand, it puts \nin place a proportionate regulatory system centred on a well -defined risk -based regulatory \napproach that does not create unnecessary restrictions to trade, whereby legal intervention is \ntailored to those concrete situations where there is a justified cause for concern or where such",
0.696428656578064
],
[
"approach that does not create unnecessary restrictions to trade, whereby legal intervention is \ntailored to those concrete situations where there is a justified cause for concern or where such \nconcern can reasonably be anticipated in the near future. At the same time, t he legal \nframework includes flexible mechanisms that enable it to be dynamically adapted as the \ntechnology evolves and new concerning situations emerge. \nThe proposal sets harmonised rules for the development, placement on the market and use of \nAI systems i n the Union following a proportionate risk -based approach. It proposes a single \nfuture -proof definition of AI. Certain particularly harmful AI practices are prohibited as \ncontravening Union values, while specific restrictions and safeguards are proposed in relation \nto certain uses of remote biometric identification systems for the purpose of law enforcement. \nThe proposal lays down a solid risk methodology to define \u201chigh -risk\u201d AI systems that pose",
0.6891457438468933
]
]
使用 LLM 获取 RAG 回答
在合并到 LLM 提示词之前，我们首先将检索到的文档列表展平为纯字符串。
[16]
定义语言模型的提示词。该提示与从 Milvus 检索到的文档组合在一起。
[17]
我们使用部署在 Hugging Face 推理服务上的 Mixtral-8x7B-Instruct-v0.1 根据提示词生成响应。
[18]
我们设置提示词格式并生成最后的回答。
[19]
[20]
The legal basis for the proposal is Article 114 of the Treaty on the Functioning of the European Union (TFEU), which provides for the adoption of measures to ensure the establishment and functioning of the internal market. The proposal aims to establish harmonized rules for the development, placing on the market, and use of AI systems in the Union following a proportionate risk-based approach.
恭喜！您已经使用 Hugging Face 和 Milvus 构建了 RAG 流程。