PDF ChatBot – Upload, chat and interact with any PDF document

by armcat • 3 years ago

103 82 3 years ago

jimjimjim• 3 years ago

Interesting, but how many people are going to upload things they really shouldn't?

...

You retain ownership of any PDF documents you upload to AskYourPdf. By uploading PDF documents to AskYourPdf, you grant AskYourPdf a non-exclusive, worldwide, royalty-free license to use, modify, reproduce, and distribute the PDF documents for the purpose of providing the AskYourPdf web application

...

aaronharnly• 3 years ago

Yikes.

Spivak• 3 years ago

That is the legal jargon required for them to ingest, index, and display the PDF you upload back to you.

tiedieconderoga• 3 years ago

Since you mention it, I have heard several of my friends and colleagues saying that they think ChatGPT could be their lawyer, doctor, and tax prep advisor if only they could send it documents for review.

xkcd-sucks• 3 years ago

purpose of providing the AskYourPdf web application

For the purpose of funding it as a free service by selling upload content or derived metrics :)

yazzku2• 3 years ago

Everybody upload your tax documents and start asking questions! /s

isuckatcoding• 3 years ago

I’ve tried two similar services and for some reason both of them cap at 200pages. What’s your limit?

carlgreene• 3 years ago

Looks like 200 pages :(.

_pdp_• 3 years ago

Try unlimited pages at chatbotkit.com - there is 1,000,000 cap on the tokens though. Still more than all other services.

iKlsR• 3 years ago

PDF chatbots are the new equivalent of todo apps... https://custombot.ai/. No doubt cool but loses the lustre after you've seen the umpteenth one that passes on the token cost to you and still hallucinates.

cloudking• 3 years ago

Has anyone ever had a problem they needed to solve by asking their PDF a question?

taf2• 3 years ago

PDFs sure are annoying when you want to quickly jump through the docs… but really I wonder how this will do once gpt4 api supports images … maybe then it can help me understand electronic data sheets… cause I’m still trying to figure out was pin 0 the sdl or sda pin… and was vcc 3.3 or 1.8 volts…

yakubin• 3 years ago

„What do I need to learn to understand you?”

bowmessage• 3 years ago

Could be useful for a PDF textbook, perhaps?

kolinko2• 3 years ago

My real estate agent wanted me to sign up a document that is 10 pages long. I would prefer to use the bot to answer my questions, and possibly - verify with other legal things.

Tried the document with the service (after removing personal info), and it worked so-so. Could specify which paragraphs mention the commission, but couldn't extract info about how high the commission is.

Perhaps it's because the document is in Polish. But GPT-3.5 or 4 shouldn't have a problem with such queries.

Yackson00315• 3 years ago

You'll be suprised.

TrapLord_Rhodo4• 3 years ago

Yes - I write cyber security contracts. I feed it proposals i find from solicitation aggregators and it's suprisingly accurate at answering the below questions about 150 page pdfs.

*Granted, I don't use this service. I use llama index and AWS to store the vectorized prompt files.

Whats the contracting officers email address where the proposal needs to be submitted? What is the Proposal Due Date? What's the full Agency Name? What's a shorter way to say the agency name? What is the RFP number? What type of project are we responding to? Is it a proposal or just a request for information/ Sources Sought Notice? If it is a proposal, simply say proposal. If it is an Request for information or sources sought, say RFI. Are there any vendor upcoming vendor meetings? What is the CALENDAR OF EVENTS? Project Timelines, or deliverables? Can the response be submitted VIA Email? Or is it a sealed bid? What is a description of the scope of work, Scope Of Services or Performance Work Statement? IS the requirement for a Penetration Testing, or Audit Software? How Many Targets are there? Targets consist of Enterprise Systems (Databases, Cloud Enviroments, applications, servers, IP Addresses, Firewalls, network attached storage, and wireless networks ) and Enterprise infrastructure(Switchgears, routers, Modems, HUBS). List the total number of targets by each category. Does it require Social Engineering, Physical Security, Wireless Scanning or Perimieter Security?

adrianmonk• 3 years ago

I could see it for instruction manuals.

Upload CheapThermostatUserGuide.PDF and ask, "How do I set the clock?"

piceas• 3 years ago

I looked up the stat's for crime in my city yesterday.

The police department had a big pdf basically filled with tables. Other formats were not immediately obvious or available.

Asking it to convert it to a spreadsheet would be neat.

Asking it to extract just the locations of interest would be better.

rvz• 3 years ago

Almost all of them do the exact same thing and it is completely saturated with these websites looking very similar akin to a copy and paste job.

There is nothing new or unique about any of them other than a new AI snake-oil to push their new grift on to users uploading sensitive PDFs to 'chat' with their document as 'the future'.

Another race to the bottom until Microsoft Word or Google Docs releases the exact same thing for free and unlimited tokens.

sporkl2• 3 years ago

Doesn't seem to work well for music scores :(

Tangentially, I haven't been able to find any software which has reliable OCR for music scores; they tend to be just bad enough as to be useless. Was curious if any recent AI developments could be applied to this, but don't have the expertise to look into this myself. If anyone has any thoughts or wants to look into this, please feel free to email me! (link to my website in profile, which has my email)

thinkmassive• 3 years ago

Have you tried Audiveris?

https://audiveris.github.io/audiveris/_pages/handbook/

I haven’t tried it but my first thought was to use something like tesseract OCR, and I found this optical music recognition (OMR) project from there.

sporkl2• 3 years ago

I have tried Audiveris and unfortunately did not have any luck with it :/

adrianh• 3 years ago

We just launched a beta music scanning feature at Soundslice a few months ago:

https://www.soundslice.com/sheet-music-scanner/

It’ll accept images and PDFs of music, extracting the notes, rhythms, etc., so you can play it back and edit it with our built-in editor.

It uses machine learning and works significantly better than the other products on the market. There’s a bunch it doesn’t do yet, but it’s useful enough already that we launched in public beta.

dgco• 3 years ago

Just install Edge, sidebar Bing Chat with your PDF opened, ask your questions. You're welcome. https://twitter.com/sergeykarayev/status/1640764492018765824

croes2• 3 years ago

Sounds like a data protection nightmare.

Suddenly people don't seem to have any problems uploading their data to big companies.

What was Google criticised for? Not creating fancy responses from your data?

cdolan• 3 years ago

How is this loading in PDF page content? I think its just ripping text off the document?

It looks like it works well on PDF with a digital text layer. I tried it on an image of the Declaration of Independence and it told me "I'm Sorry but the webpage is empty..."

selfhoster11• 3 years ago

Clunky, at least on Linux.

anonymouse008• 3 years ago

How does this work? Do you first scrape the PDF or do you have gpt4 multimodal access? The privacy policy link is broken at the moment so I can’t tell for sure

jrpt2• 3 years ago

I can't answer for theirs but I made one too:

https://docalysis.com/

The way it works is you first parse the PDF to analyze its text, then use a LLM along with the relevant text when answering user questions.

laen• 3 years ago

Can you elaborate on how you parse the PDF? Are you simply converting it to text using a python library or something more robust like GROBID[1]?

1: https://github.com/kermitt2/grobid

Yackson00315• 3 years ago

You just upload your pdf doc directly or via a url and you are good to go.

msm_• 3 years ago

I think the GP was interested in technical details. Specifically, do you first scrape the pdf (using another tool presumably), or do you have gpt4 multimodal access?

da4id• 3 years ago

Just wanted to share my project too. I made a tutorial on how you can build the same thing here:

https://docs.dopplerai.com/quick-start

agumonkey• 3 years ago

Kinda like have the author at your fingertips

rockzom2• 3 years ago

(((:::)))

rockzom2• 3 years ago

Since I can't delete on Hacker News, this comment was one of several for an April Fool's joke related to AGI "taking over my account." I didn't realize there was a hidden meaning associated with triple parentheses. I apologize!

KomoD• 3 years ago

There was no joke, the only thing you did was spam

jrpt2• 3 years ago

Nice, I made one too:

https://docalysis.com/

My take on this space is that it'll eventually be built into the operating system or PDF viewers, so you're going to have to do more than just "chat with a PDF" -- but that chatting with PDFs is a great place to get started!

bodge5000• 3 years ago

I had an idea to do something like this combined with something like Zeal or DevDocs so you can have a kind of chatGPT localised just to your specific language or framework. But I guess this does just that job, but in a far more general way

Yackson00315• 3 years ago

Yea AskYourPdf is also multilingual.

lxe• 3 years ago

I'm guessing langchain / llamaindex + openai API?

nextworddev• 3 years ago

It’s a great mystery why people rave about Langchain library. I found it to be really bloated and verbose syntax makes it hard to understand what it’s doing unless you are digging into the code base. Poorly documented, too

ukuina3• 3 years ago

Have you tried Deepset Haystack?

madmax108• 3 years ago

What alternatives exist today? Honestly, I think langchain just fills a void for having a more streamlined "api" for LLM-driven app workflows which is why it's hyped. Plus the fact that they have bindings for both JS and Python makes it easy to get up and running and building custom "agents" for different tasks.

TrapLord_Rhodo4• 3 years ago

lol - Yeah, I could write this in 20 lines.

I have it answering a list of questions in an excel from three different 'Frames of mind' by passing three different directory'swith different content in each to get three different responses i can craft together.

   def excelGPT(self, dir, excel_file, sheet):
        #my GPT Key
        os.environ['OPENAI_API_KEY'] = 'sk-
        #Working Directory for training
        # root = 
        root_folder1 = 
        documents1 = SimpleDirectoryReader(root_folder1).load_data()
        index1 = GPTSimpleVectorIndex(documents1)

        root_folder2 = 
        documents2 = SimpleDirectoryReader(root_folder2).load_data()
        index2 = GPTSimpleVectorIndex(documents2)

        root_folder3 = 
        documents3 = SimpleDirectoryReader(root_folder3).load_data()
        index3 = GPTSimpleVectorIndex(documents3)

        file_name = dir + excel_file
        

        df = pd.read_excel(file_name, sheet_name=sheet)

        GSA_answer_array = []
        basic_answer_array = []
        QA_answer_array = []
        df_series = df.iloc[:,0]
        
        for i,x in enumerate(df_series):
            print("This is the index ", i)
            print(x)
            GSA_response = index1.query(x)
            basic_response = index2.query(x)
            QA_response = index3.query(x)
            GSA_answer_array.append(str(GSA_response))
            basic_answer_array.append(str(basic_response))
            QA_answer_array.append(str(QA_response))

        self.zip_to_docv2(dir, "Gippie_Response.docx", df_series, GSA_answer_array, basic_answer_array, QA_answer_array)

Lapsa• 3 years ago

why would you want to chat and interact with a PDF document?

swader9992• 3 years ago

Think of anything ever written, your personal library, the tax code, every up to date doc for your project and it's dependencies, your code base, your university texts...

Index them, store them in LLM format.

Then ask a question, you first semantically search all the relevant sources you've indexed, and get back a tight set of under the token limit results that you then pass on to your favorite LLM. Chat4all, ChatGPT etc then read those parts of your library and answer your question.

yazzku2• 3 years ago

Are you really going to leak your tax documents to ChatGPT? I had just joked about this in a comment above.

TrapLord_Rhodo4• 3 years ago

this comment blows my mind...

My head bursted with ideas when i first found out i could vectorize directorys and answer questions on them. I can run entire logic loops using an LLM as the input... How does that not blow your mind? '

Imagine scouring financial reports in real time?

Imagine being able to analyze thousand page regulations for self interest?

Imagine being able to interact with old newpapers, articles, and media lost to time.

Ask questions on entire class of books, and any information you want to aggregate...

kgbcia• 3 years ago

Does it fine tune the model or just learn like a plug-in?

radicalriddler2• 3 years ago

I'd be interested in how people parse text off a PDF. I'm making a TTS tool to convert documents (mainly HTML docs at the moment) to speech, PDF's would be a great addition.

bradleykingz• 3 years ago

How I dealt with it was by first converting to HTML using PDF Box. Extracting text from there is then pretty simple.

summarity• 3 years ago

Apache Tika can extract text (and metadata) from pretty much any file format ever invented.

radicalriddler2• 3 years ago

Thanks! I'll give this a shot. I wonder if it properly parses into real HTML or it's just div's all the way down.

airbreather3• 3 years ago

use pdftotext with the -bbox option to get the bounding box co-ords for each bit of text

Yackson00315• 3 years ago

I'm the founder of AskYourPdf. The released version is at its most basic level, we have some exciting new features coming!

AskYourPdf is significantly faster than other similar products around. Interestingly, we'll also be launching our API soon.

Take note, AskYourPdf is multilingual, completely free to use and you don't need to sign up.

dt23• 3 years ago

I think this could be very useful! But I guess there are still some hallucinations to deal with: I uploaded an arxiv paper and asked who the authors were, and it it hallucinated 4/4 (and stopped working when I asked it to please use the paper as a reference to answer my question).

xtracto• 3 years ago

This is a great application. My example use case was to upload a REIT quarterly report (in Spanish) and ask questions that I am interested in about it.

This is the report I uploaded: https://funo.mx/site_media/uploads/documentos/documento-4VK6...

I felt that at this point, it was more the "potential" than what it actually did. I asked some questions that it just couldn't answer. Also, at some point it started answering in English even though all my conversation with it had been in Spanish.

Excited to see how your service progresses!

paddw• 3 years ago

I feel like there is an arbitrage opportunity for someone willing to gather up all these sites and use them to facilitate a discounted GPT API...

elevaet• 3 years ago

I just had the misfortune of having to wade through pages and pages of byzantine building code where the relevant parts were scattered though the document. This would be very helpful for that kind of thing.

vsareto• 3 years ago

Getting ChatGPT (or any good-enough LLM) to generate/manipulate/edit/find discrepancies with PDFs would be great too. Probably best done with a plugin so it can execute code though. Dumping the PDF to HTML, telling ChatGPT to edit the HTML, then converting it back to a PDF is probably a non-starter although that does work on a basic level.

Anything ChatGPT<->PDF is probably a good business idea IMO. That stuff comes down to developers so often that it's almost a career specialization and PDF code can be unfun and tedious to write and maintain.

airbreather3• 3 years ago

This one is not very good, it seems not anywhere near even GPT 3.5.

PDF ChatBot – Upload, chat and interact with any PDF document

Related Stories