'Haystack specify column for Prediction
I am using an OpenSearchDocumentStore to store my data an feed it to my Haystack pipeline, the data includes uuids and other information, that are not relevant for the prediction but need to stack in the DocumentStore (I was told). Now I wonder if there is a way or need to specify a special Inputtext "column" for the retriever and reader.
Solution 1:[1]
Other information that are not relevant for retrieval should stay in the meta
field of Documents. For example you could create documents like:
doc = Document(
content="this is relevant for retrieval",
meta={"uuid": "1234", "comment": "this won't be used for retrieval"}
)
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
Solution | Source |
---|---|
Solution 1 | ZanSara |