Skip to content
This repository has been archived by the owner on Feb 15, 2025. It is now read-only.

bug(api): Sometimes PDF contents gets mangled on extraction #1150

Open
CollectiveUnicorn opened this issue Sep 25, 2024 · 0 comments
Open

bug(api): Sometimes PDF contents gets mangled on extraction #1150

CollectiveUnicorn opened this issue Sep 25, 2024 · 0 comments
Labels
api possible-bug 🐛 Something may not be working

Comments

@CollectiveUnicorn
Copy link
Contributor

Steps to reproduce

  1. Download a PDF like the one attached here: aesopsfables00aeso.pdf
  2. Upload the PDF to using the API
  3. Create a new vector store or update an existing one using the PDF
  4. Wait for the vector indexing to complete
  5. Observe in the DB that the content is missing spaces between words.

Expected result

  • The content piece of the vector_content has spaces so that when given to the LLM the text is intelligible.

Actual Result

  • The content piece of the vector_content does not have spaces, so the LLM gets a glob of text.

Visual Proof (screenshots, videos, text, etc)

  • Screenshot 2024-09-25 at 2 47 03 PM
  • Screenshot 2024-09-25 at 2 47 37 PM

Additional Context

  • This does not happen for all PDFs only some of them.
@CollectiveUnicorn CollectiveUnicorn added the possible-bug 🐛 Something may not be working label Sep 25, 2024
@nywilken nywilken added the api label Oct 10, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
api possible-bug 🐛 Something may not be working
Projects
None yet
Development

No branches or pull requests

2 participants