Show HN: CopilotKit- Build in-app AI chatbots and AI-powered textareas

https://github.com/CopilotKit/CopilotKit

by swiftlyTyped • 3 years ago

197 67 3 years ago

github.com

swiftlyTyped23• 3 years ago

Open-Source (MIT).

If you'd like to contribute to the repo, or to the open copilot protocol, please join the GitHub/Discord!

squirrel23• 3 years ago

Pretty cool tech!

swiftlyTyped23• 3 years ago

Thank you!

nathan_tarbert• 3 years ago

This is great, if I understand correctly I just inject the hook - <CopilotPortal /> ?

swiftlyTyped23• 3 years ago

Thanks!

And Pretty much! You have to wrap the app (or the part you want copilot in) with a <CopilotProvider /> - this is UI-agnostic, business logic only. Then there are a few customizable UI providers you can use, or you can just build your own if needed.

If you check it out do let me know what you think!

vecplane• 3 years ago

Cool concept! Would this work with React Native, now or in the future?

swiftlyTyped23• 3 years ago

We're starting with react web, planning to expand from there to other surfaces, including React Native.

I suspect the gap from the current version, to React Native support is rather small. It's open-source, so feel free to open an issue so that it can get upvoted/prioritized, (or even better, you can work on it too ;) )

htsh• 3 years ago

Cool! Any plans for Svelte?

dschofie• 3 years ago

Super cool! Heads up: when clicking "website" next to "Join our Discord" on your repo, it looks like the link is broken

swiftlyTyped23• 3 years ago

Thanks for the pointer, fixed!

netsharc2• 3 years ago

Feels like Microsoft might send you a letter soon about the nane...

How about FirstOfficerKit, but that seems very far away from AI if one doesn't get that it's a synonym for copilot

swiftlyTyped23• 3 years ago

Yeah, I hope that doesn't happen.

That said the concept of a copilot is pretty generic, so hopefully we can peacefully coexist.

They've doubled down on the Copilot naming after the project was well underway, and I don't really want to rename it in anticipation of trouble that may never materialize

petercooper• 3 years ago

It feels like MS is already treating it like a generic term. I think I saw a Kevin Scott article recently where he kept referring to "copilots" as well. The term is being so widely used right now that they'd need to defend it quickly if they even have a trademark. (Looking at the USPTO database, MS applied for a trademark for "Microsoft Copilot" in September then filed an express abandonment a few days later.)

dontupvoteme• 3 years ago

The term is just blatantly lifted from an entire other industry, can you really trademark that?

netsharc2• 3 years ago

It's an airline term, I am not a lawyer at all but I feel like there's an argument somewhere that using it as a brand for an intelligent/computer assistant, or, fine if you want to be buzzwordy, AI assistant on a computer is a novel use.

A bit like "Apple". If you open a computer store named Apple, I think you can't get away with the argument that "It's a term from the agriculture industry!".

aragonite2• 3 years ago

Relately: I've noticed that if I use ChatGPT in Microsoft Edge, I get (sometimes very) helpful co-pilot style completions in the input text area. Is that an Edge-exclusive feature? And how does CopilotKit compare?

sdrinf• 3 years ago

So, wait, edge posts non-submitted content you've entered into textboxes to a cloud llm? or is this running in your browser?

aragonite2• 3 years ago

I now think it's likely I misunderstood what the feature involves and that it is actually way more limited than I thought compared to CopilotKit (perhaps it's little different from Gmail's Smart Compose), but this is a quick-and-dirty screenshot:

https://imgur.com/a/FwZu6f7

swiftlyTyped23• 3 years ago

I didn't know ChatGPT + Edge did that, pretty cool!

And yes, with CopilotKit you can implement the same to any text area in any app, that would work on any browser (+ other key features).

I can tell you that CopilotTextarea works very, very well if you give it the right context - but since I hadn't known about Edge's feature, I can't compare.

Even long term, I think this is functionality that will be better offered by the app itself rather than the browser - bc the app can control the relevant context beyond what's visible on the screen (e.g. RAG on users' backend state), customize the prompt, and potentially even design dedicated LLM chains (as needed).

explaininjs• 3 years ago

Funny you find those useful, I disabled them fairly quickly.

That said, prior to disabling them I’d actually use it the opposite way: If I’m entering prose into a box and the AI has a very good understanding of what I’m about to say, that’s a good indication I’m not saying anything remotely interesting and I should either change direction or abandon my comment entirely.

swiftlyTyped23• 3 years ago

Very interesting use-case!

With a creative project, if the AI can predict what you say next, then it's not creative enough!

ulidabess2• 3 years ago

Awesome project. I was looking through the Github and if I understand correctly, then it's plugged in to the OpenAI API by default?

Is there an option for using other LLMs with it?

ugh123• 3 years ago

Being able to plug this into Google Docs using your own local LLM would be very interesting...

swiftlyTyped23• 3 years ago

Correct.

The default backend implementation uses OpenAI, but you can use any LLM pretty easily.

ulidabess2• 3 years ago

Awesome, thanks!

BonoboIO2• 3 years ago

So this has nothing to do with Copilot from GitHub?

swiftlyTyped23• 3 years ago

Correct, Copilot here stands for AI "second brain" that "co-pilots" the app alongside the user.

(the abstract idea behind GitHub Copilot).

BonoboIO2• 3 years ago

Well it’s kind of misleading, because GitHub has kind of a following for their product named Copilot.

I think renaming it would benefit everyone.

jay-barronville• 3 years ago

Cool idea!

swiftlyTyped23• 3 years ago

Thanks!

mikigraf• 3 years ago

Amazing product! How does the connection to LLMs works? Bring your own LLM/API key?

swiftlyTyped23• 3 years ago

Yes, exactly.

And thanks for the kind words!

throw031720192• 3 years ago

Looks fantastic but does it require using your endpoints for inference? We have strict data requirements and use Azure OpenAI for security.

croes2• 3 years ago

Azure and security in one sentence.

Good one.

throw031720192• 3 years ago

Yes but They sign BAA for HIPAA. OpenAI does not last we checked.

swiftlyTyped23• 3 years ago

Good question!

No, we actually don't even offer our own endpoints for inference yet, precisely because of the data concerns you site.

Right now it's self-host only, but it's very very easy to self-host, and we'll keep it that way for every feature touching user data.

zerkten• 3 years ago

Why use the Copilot name? It's confusing because you seem to have an agnostic product.

swiftlyTyped23• 3 years ago

It's a fair point :)

AI Copilot started out synonymous with code completion, it still means that for many.

Our bet was this meaning would broaden with time.

CharlesW• 3 years ago

Now that it’s firmly entrenched as Microsoft branding you may want to reconsider. Soon, people searching for “AI Copilot” aren’t going to be able to find you.

_mme• 3 years ago

Nice project! I made Beak.js which has a similar way to connect a language model to the UI via React hooks: https://github.com/mme/beakjs

jakiestfu• 3 years ago

I'm really liking the agnosticism with Beak.js. Would love to read a blog post about the power of that or examples of useBeakFunction use-cases

swiftlyTyped23• 3 years ago

Great minds think alike!

Our `useMakeCopilotActionable` is similar to your `useBeakFunction` and `useMakeCopilotReadable` is analogous to your `useBeakInfo`.

I don't know how much farther you're planning to take things or if it's a demo/hobby project.

But real talk, if you're excited about this space and would like to explore joining our team, I'd love to chat and take it from there.

atai at copilotkit dot ai

xixixao• 3 years ago

Here's an open source alternative with context retrieval and message storage: https://github.com/get-convex/convex-ai-chat

(there are also versions using Assistants API and LangChain, linked from here: https://stack.convex.dev/ai-chat-using-openai-assistants-api)

swiftlyTyped23• 3 years ago

CopilotKit itself is open-source, and supports assistants API + langchain :) https://github.com/CopilotKit/CopilotKit

NoraCodes• 3 years ago

If I see functionality like this on a company's website, I am going to find someone else to do business with about 80% of the time.

asadalt• 3 years ago

why? Doesn't this generally help you write faster?

Racing0461• 3 years ago

Any chatbot/AI that i can't say "please refund this order due to product being damaged here is a pic" and it can't do a refund on its own is worthless. Not because i care about refunds, but if the bot can't do that, chances are it can't do anything real and its just trained on a bunch of docs and is worthless otherwise.

It's also 10x worse when the website has a green circle on it like teams/zoom showing it as "online" and makes you feel like you are actually talking to someone.

varispeed• 3 years ago

It's a waste of time.

Chat interface is used to talk to people. If you talk to a machine, there is no point to mimic human behaviour, especially when current iterations of AI can't reason. There should be a better way to do this.

Like 90% of the time I want to chat to customer rep, because I want to let them now there were missing items in the delivery and I want re-delivery or refund. That could be a simple expert system with a few buttons. But businesses want to discourage people from returning anything, so they are building those time wasting widgets hoping a % of people give up.

Like if my time costs £200 per hour and the wrong delivery was worth £50, I am not going to spend more than 15 minutes on this, unless it is critical to the business.

This has nothing to do with helping customers, but to save money.

AYoung010• 3 years ago

Grow your OpenAI bill exponentially with this one easy trick!

In all seriousness — looks nifty! Do you guys have any plans to bring suggestion latency down from what’s show in the demo?

swiftlyTyped23• 3 years ago

Latency is actually very low as-is, with GPT-4-Turbo!

But other than that, yes, we do have plans - using real-time RAG. I carried out some research with incredibly promising results

https://ai88.substack.com/p/rag-vs-context-window-in-gpt4-ac...

geniium• 3 years ago

Pretty cool idea

swiftlyTyped23• 3 years ago

Thank you!

dfxm12• 3 years ago

Microsoft recently rebranded their chatbot offering to Copilot Studio. Copilot is also the name of Microsoft's AI products.

It's hard enough keeping all of Microsoft's products with similar names straight. I don't want to confuse other products with them, too, unless, maybe, this is the point :)

itslennysfault• 3 years ago

It'd be nice if this was more clearly labeled as a React plugin. I saw "drop in replacement for <textarea>" and thought it was a web component and only realized it was a react plugin after reading further. Not a huge deal, but since it is a plugin and not a stand-alone thing it might make sense to make that clear up front.

swiftlyTyped23• 3 years ago

Thanks for the feedback! I'll update the docs.

swiftlyTyped23• 3 years ago

(also, I know that wasn't your core concern, but we are planning to build SDKs for other frontends in the not too distant future!).

Show HN: CopilotKit- Build in-app AI chatbots and AI-powered textareas

Related Stories