Describe the bug
When you use prev-next augmenter, it is impossible to pass validation stage.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
This is happening because we cut some part of corpus.parquet. Because for validation we don’t need full corpus. However, at prev_next_augmenter, we have to retrieve contents from the prev id or next id at the corpus.
Then, at the corpus, the corresponding id is not existed. So the validation failed.
Code that bug is happened
At the prev next augmenter
Desktop (please complete the following information):
AutoRAG 0.3.6
python 3.10
Additional context
Add any other context about the problem here.
Pay now to fund the work behind this issue.
Get updates on progress being made.
Maintainer is rewarded once the issue is completed.
You're funding impactful open source efforts
You want to contribute to this effort
You want to get funding like this too