Human-Like Browser Automation with GPT-4 Vision and MeiliSearch

https://github.com/vignshwarar/AI-Employe

by georgehill • 3 years ago

21 10 3 years ago

“AI Employe” why are these people obsessed with replacing people? Do they understand that ai will be owned by corporations and a lot of ai startups will be replaced themselves, as most are irrelevant or trivial to replicate?

vignesh_warar5• 3 years ago

Hey, Repo author here, My intention is not to replace humans but to create more of a helping hand for them.

weq• 3 years ago

i cant tell what this is supposed todo. alot of buzz words, but how does this this create tests for me? does it save me time because I dont have have to care about ids of elements on my page? Will it automatically use the page and create tests based on me decribing the workflow? Is it aimed at people who are automating systems they dont own? CAn it take a set of AC's and then create tests automatically for me?

vignesh_warar5• 3 years ago

Hey there, Author here,

I agree — I should have done a better job writing the copy.

Here are some tasks you can accomplish with an AI employe:

- While I haven't optimized for testing, you can perform end-to-end tests simply by describing it. If the UI is complex, the AI employe will hallucinate; just click 'start recording' and demonstrate the tasks. It only records HTML changes, not the screen, microphone, or camera. and you don't have to worry about IDs or selectors—the AI employe will take care of it.

- Tasks related to OCR, like extracting data from PDFs, emails, and transferring it to CRMs/ERPs.

- Summarization tasks; for ex, there's a workflow example in AI employe where it automatically summarizes Hacker News comments for the website you're browsing. It automatically do the HN search, clicking the relevant link, and summarize the comments.

Since there are a couple of things an AI employe can do, I am simply confused about how to position it. Any feedback on how to position it is most welcome.

luke-stanley2• 3 years ago

"Buy the AI Employe License in an exclusive deal" - I don't know what this means but it sounds like this goes against the gift economy spirit of open source. What's the point, if we have to worry about licencing? Some GPT wrapper secret sauce? Directly using GitHub as a marketing launchpad for SaSS is distasteful. This is a shame because it sounds like there are some interesting ideas and problem solving happening here.

vignesh_warar5• 3 years ago

Hey, it is fully open-source; there are no restrictions. We are only charging for the hosted version. I mean, as the founder, I somehow need to pay my bills.

luke-stanley2• 3 years ago

Okay, just pointing out that the README essentially has a banner advert right at the start of the repo README, then it talks about getting a license, which is gonna confuse a lot of people into thinking they can't use it without a license, which is perhaps not an effective way to convert developers into customers on GitHub, right?

mensetmanusman• 3 years ago

I wonder if it passes the 'i'm not a robot' google button press.

vignesh_warar5• 3 years ago

No, OpenAI implemented some safety measures: https://platform.openai.com/docs/guides/vision#:~:text=captc....

Human-Like Browser Automation with GPT-4 Vision and MeiliSearch

Related Stories