IBM Watson API

https://developer.ibm.com/watson/docs/developing-watson-apis/examples-qapi/1207-2/

by miket • 12 years ago

311 83 12 years ago

developer.ibm.com

Doublon• 12 years ago

"Questions" in the documentation without question mark (?) seem somehow wrong to me.

readerrrr• 12 years ago

Out of curiosity I googled the same request.

https://www.google.com/search?hl=en&safe=off&q=%22His+1983+h....

I think this might be useful if Watson was being feed with a medical database. Otherwise I don't see any need for it; is there any?

edit: Watson as a legal consultant would be great. There might be a product in that, not as an replacement for a lawyer but more as guide/search tool.

tluyben22• 12 years ago

I would think Watson can replace most lawyers (and MDs, and ...) of this world. Most of them don't think and just rehash stuff they learnt, just like Watson does. Sure for the exceptions you need actual people, but that is the same time when you would go from your corner lawyer to a more prominent one and when your doctor would forward you to an expert anyway.

ygra• 12 years ago

The point is, that (hopefully) your doctor knows where his expertise ends and when to refer you to an expert. I'm not sure Watson could reliably do the same.

jpwagner2• 12 years ago

Conversation you will never hear in a Dr. office:

  me: i have pain in my side
  dr: 25%: something you ate 22%: appendicitis, 18%: kidney stone...

Conversation you will never hear in a lawyer's office:

  me: am i allowed to...
  lawyer: 42%: Maybe, 38%: Yes, 20%: No

TheCondor• 12 years ago

Seriously?

Watson could replace lawyers or doctors for people that equate Google searches to legal advice or medical advice. Think legalzoom and webmd... Absolutely seems like it could be an entertaining way for a non lawyer or no doctor to explore a law or medical library. The majority on my time spent with lawyers has been discussing my issue until it could be distiled down to a couple concise legal questions; I bought a short sell house and the seller demanded that I put a clause in the contract that said his bank couldn't issue him an i9... I have. No authority over tax laws but I also didn't want any liability or an invalid contract, nor to willingly build a bogus one. There was some real language subtlty to it all and I didn't even know the questions to ask.

Same with doctors, pain is relative, strong pains turn lesser pains into mild discomfort and people are insanely good at ignoring and normalizing pains away. Do most patients even know what to ask or describe?

Don't get me wrong, I'd love to have a lawyer and a doctor on my smartphone all day everyday but it still seems like a ways off. Watson really seems like a tool that cuts your legal fees because your lawyers research time drops 90% or something. (Or rather, he makes 90% more profit from you..)

nradov• 12 years ago

Watson can't replace most physicians. Physicians have to physically interact with a patient to gather a relevant medical history as well as subjective and objective observations about the patient's symptoms. Robots and machine vision systems are nowhere near being able to fill that role.

Watson might be able to partially replace some specialists that primary care physicians use for consultations. When PCPs are unsure about a diagnosis or proper plan of care they will often consult with a specialist for advice via phone or e-mail. So in that case the PCP has already gathered at least some preliminary data and could feed it to a computer. But even for that use case Watson won't be able to provide same level of back-and-forth interaction that's often necessary to achieve the correct result.

sumukh1• 12 years ago

I actually built my own version of Watson based on this idea - jeopardy questions are often google-able/searchable on wikipedia. It was pretty easy to build out - but it only gets 80% of the way there.

The last 20% is the hardest - and it's why Watson is so impressive (even though even Watson is probably only at 90%)

flarg• 12 years ago

Did you every see that HN Post about QUANTA [1]? Do you think it would cover the last 20%?

[1] https://news.ycombinator.com/item?id=8298887

pcocko• 12 years ago

Here some examples about Watson implementations https://developer.ibm.com/watson/2014/03/27/industries-can-b...

But would be interesting to see a real application working. An online retail for example.

malanj• 12 years ago

Has anyone at HN used either IBM Watson or Wolfram Alpha to build a real (commercial) app? It feels like there should be a whole wave of apps built on either of these technologies but it doesn't seem to be materialising.

What is holding back the killer apps for answer/computation engines?

jj26• 12 years ago

I've heard the turnaround for a Watson implementation is about a year. IBM is just too slow, that's why the flood of apps isn't yet materializing.

aabajian• 12 years ago

Google / Wolfram Alpha / Watson are great at answering broad questions.

1. "Who was the 12th president?" - Zachary Taylor 2. "What color wine is cabernet sauvignon?" - Red 3. "Is a ferret a rodent?" - The ferret is the domesticated member of the Order Carnivora, Family Mustelidae and Genus Mustela. A common misconception is that ferrets are rodents.

The real challenge is answering niche questions:

1. What size are the OEM rear wheels of a Honda S2000? 2. How can I fix MySQL error 1064? 3. How do I remove wine from a macbook?

These types of questions aren't answerable by a simple mining of Wikipedia or Encyclopedic knowledge. They represent niches within our society (S2000 owners, programmers, people who spilled wine on their macbooks). Google provides excellent links to pages that contain answers to these questions, but it cannot deduce a single answer or common response. This is why sites like Answers.com, Yahoo! Answers, StackExchange, etc. can flourish, but it's also why an NLP question and answer system is very difficult.

I've been working on a system to mine existing responses to questions - http://gotoanswer.stanford.edu - I only have a small subset of programming-related questions (~10M), but you can get an idea for what I'm trying to do by searching for "How do I remove wine from a macbook?" You'll see that there are results for removing wine the liquid and WINE the windows non-emulator.

Rooster61• 12 years ago

You bring up a good point, but it seems as if Watson was designed with this in mind. If you notice in the JSON response, it lists this query as a factoid class.

It may handle different queries with different attributes differently, such as focusing on certain portions of its corpus or changing what aspects of its search results are more heavily weighed.

A query identified as a factoid might be researched and judged very differently than something a bit more nebulous, such as a comparison, or something with more specificity like the examples you listed.

Admittedly, I am basing quite a bit off of one example response given in their documentation, but it is an intriguing clue as to how Watson will handle that aspect of understanding which info to discern.

nl2• 12 years ago

You should put your contact details in your profile (In the "About" section - your email address isn't publicly visible).

Anyway - I'm really interested in this area. I have Q/A system built that can answer (some of) the broad-type questions you mention.

I think grouping Google/Wolfram/Watson together misses that each has their strengths and weaknesses, and that they take dramatically different approaches.

Google traditionally relies on ranking information it finds to answer questions (though the whole knowledge graph thing is moving it closer to what Watson does).

Wolfram relies on manual curation of facts and probably the best "calculation" engine of the three.

Watson relies on manual curation of sources, and automatic extraction of facts and ranking of them.

I think it's quite interesting that Google is moving to a model more similar to Watson.

Anyway - I'd love to hear about your approach and what you are doing. My contact is in my profile.

bussiere• 12 years ago

We are looking to use wolfram alpha for getting info on stock values and machine learning.

It seems very useful for this kind of business.

Diwoto• 12 years ago

Apps are definitely coming, I can't speak for other companies but for our app we're starting a private beta very soon and the launch/announcement is set for early next year.

ilaksh• 12 years ago

So you just ask it any random question and it knows everything? Or only things that come up on Jeopardy?

I don't see an API for feeding it information.

MartynX• 12 years ago

I would assume that they are working closer with companies that they trust to feed in information. Having that on an what will eventually be a public API is recipe for disaster.

matznerd6• 12 years ago

Each instance of Watson is unique and has to be trained as such based on it's "corpus" (set of data) and actual feedback on the quality of it's answers by experts. The public API sounds like it will allow access to specific flavors of pre-trained and data-filled Watsons, like the food- recipe one or some basic medical ones.

mooreds3• 12 years ago

I found the link above to be a bit useless as it jumps right into getting answers with evidence. Here's a better overview link: https://developer.ibm.com/watson/docs/developing-watson-apis...

mooreds3• 12 years ago

If you want access to the API, you have to fill out a form, here: http://www.ibm.com/smarterplanet/us/en/ibmwatson/form_ecosys...

This is buried in the docs as a comment on this page: https://developer.ibm.com/watson/docs/developing-watson-apis...

Edit:

No real support for 'playing around' with the API. Bummer.

Edit2:

Just went through the application process linked above. Be prepared to give info about yourself and your company and an explanation of why you want access to the Watson API, as well as what type of information you'll be working with. I stated 'just want to play around with the API'. We'll see how they react to that.

pesenti12• 12 years ago

Watson APIs will be accessible - without the need for an application - as part of BlueMix (https://ace.ng.bluemix.net/ - the IBM PaaS/Heroku) in a couple of weeks. Stay posted!

Ixiaus• 12 years ago

BlueMix is actually pretty exciting to me; I think IBM has finally stepped up as a competitor in the "cloud" ecosystem where Microsoft has really failed.

svankmajer• 12 years ago

That sounds great. I'll stay tuned.

mark_l_watson3• 12 years ago

That is great! I just signed up with my existing IBM ID. I am enjoying using IBM Watson right now on a customer project, and being able to experiment and learn on my own will both help the effort to help my customer and perhaps use IBM Watson for personal projects. BTW, I like your dev page, with starter kits for multiple languages and frameworks.

pesenti12• 12 years ago

IBM is about to make these APIs (and many others) much more accessible as part of BlueMix (https://ace.ng.bluemix.net/ - the IBM PaaS/Heroku). I lead the team in charge of developing the Watson platform. Ask me questions!

mooreds3• 12 years ago

Bluemix has a impressive list of IBM technologies available: https://ace.ng.bluemix.net/#/pricing/cloudOEPaneId=pricing

Until Watson is available in Bluemix, what is the best way to get access to the q and a API for exploration?

pesenti12• 12 years ago

Right now you need to apply here: http://www.ibm.com/smarterplanet/us/en/ibmwatson/form_ecosys... but many Watson APIs will be available on BlueMix very very shortly (think weeks not months).

somberi2• 12 years ago

Hey there. The startup I co-founded has been accepted by IBM partner for Watson. A few weeks into it, we are still doing the "form-filling" marathon and have not had access to an instance. Seems like the API, when available to public will be a faster way to access it. Punekale at google's mail.

pesenti12• 12 years ago

Not completely. The first set of APIs won't let you provide your own content - it will let you play with the Q&A API (and also do a lot of other fun things not directly related Q&A). The instance you will get access to through the application will let you provide your own content. We are working hard to make that available as self-service but that's going to take a little more time.

cik• 12 years ago

That's amazing news - thanks a tonne. Any chance there's someone at the mothership (maybe you!) we can reach out to, for support? Specifically I'd like to toss out some questions about data sources and whatnot - to understand if Watson is worth playing with for us.

pesenti12• 12 years ago

Best would be to ask the questions on the forum: https://developer.ibm.com//answers/?community=watson&cmp=usb...

cdnsteve• 12 years ago

1. How does Watson know to share only public data and not confidential data if it comes across it? How does it gather data?

2. Does it cache answers or does it try to "learn" and modify/improve the response each time?

pesenti12• 12 years ago

1. Right now data comes from our customers (not shared) or public sources (shared). Watson does not decide on its own what is shared or not.

2. Watson can learn from feedback (i.e., a user grading the quality of an answer).

matznerd6• 12 years ago

1. Watson has to be trained on a specific corpus of information. Each instance is it's own Watson, and needs to be trained. They say that each Watson starts off as a kindergartner. 2. Watson needs to be trained by an expert using sample questions and it learns from that.

JunkDNA• 12 years ago

I fully admit you may not be the right person for this question, but IBM has made a lot of hay about Watson in healthcare: lots of booths and talks at industry conferences, trotting out partner medical centers, PR pieces in the Wall Street Journal, etc... Despite all the noise, I have yet to see any sort of peer-reviewed clinical study that demonstrates the application of Watson in a real healthcare setting to improve patient outcomes. Has any study like this been conducted?

pesenti12• 12 years ago

We do have many actual projects with several healthcare providers. We have functioning systems (see one here https://www.youtube.com/watch?v=8lGJ0h_jAp8) and we are starting to deploy them. But the deployments are made very cautiously and in stages (and not yet broad enough for full study) because that's the nature of healthcare.

pinkyand• 12 years ago

While this is not peer-review , it's interesting :

http://www-03.ibm.com/press/us/en/pressrelease/43231.wss

jere• 12 years ago

Data: at least 50 percent of content is unstructured, and sufficient volume exists

Not quite what I expected. Does this mean the developers provide the data?

pesenti12• 12 years ago

The soon to come Watson platform will also come with a set of curated content. So it will be a mix of the content you provide and existing (free and paid) content.

matznerd6• 12 years ago

A given instance of Watson is unique based on it's corpus (documents that have been uploaded to it) and it's level of training and fine tuning. So far each instance has had to be trained from scratch, although they are making some Watson instances available that will come pre-trained in specific fields (like medicine).

aswath87• 12 years ago

When will BlueMix have Watson access?

atratus• 12 years ago

The Q&A is not particularly interesting...are there other api's we can experiment with? Also, is there any precedent for getting clojure up on bluemix?

pesenti12• 12 years ago

Yes many others - think NLP, multi-lingual, social media, speech, vision, etc. We'll start with a small set and keep expanding.

I don't know about Clojure, I would ask that question on their forum: https://developer.ibm.com/answers?community=bluemix

chris_j• 12 years ago

(Another) IBMer here. As far as I am aware, Bluemix doesn't have built-in support for Clojure but a few of us have played with it and there are a few ways that you can run Clojure apps:

I wrote a blog post about my experiences running a Hello World app using the Heroku buildpack for Clojure which you can find here:

http://mytediousblog.blogspot.co.uk/2014/07/running-clojure-...

In addition, since Bluemix natively supports Java apps, you can export a Clojure app as either an uberjar or an uberwar and run it directly on Bluemix that way. So for example, if you create an uberwar of your Clojure webapp then you can push it to Bluemix by doing:

  cf push your-app-name -p target/my-app-uberwar.war

... and Bluemix will run your app on a WebSphere Liberty Profile app server.

I'm happy to help if you have any questions - contact details in my HN profile.

dalek2point3• 12 years ago

I'm curious about the "copyright" field. Do you return the original sources from where Watson learnt the information he is presenting? What are the major sources? Have you faced copyright or legal restrictions to access information and has this affected Watson's ability to answer questions in a certain area?

pesenti12• 12 years ago

matznerd6• 12 years ago

When you create a Watson instance, you basically load it up with what they call a "corpus" of information. They are supposed to check the source of all your info etc that you have copyright to it. I don't know what it will be like once it is opened up more, but as of now they have pretty tight hands on Watson and will only accept projects with monetization and with revshare agreements...

billconan• 12 years ago

while this technology looks interesting, the marketing effort is terrible.

There is no link on the webpage pointing to access request. I had to find it from the comments.

there is no example questions other than that michael jackson example. and that example is not a question. why does it reply michael jackson as an answer? there is no explanation.

there should be a web access point for potential developers to play with the api. I still have no idea what question I can ask and what answer I can expect.

...

kordless• 12 years ago

Basic dev marketing.

pesenti12• 12 years ago

Yes we know and are working on it. The soon-to-come next version should fix all these issues.

logicalman• 12 years ago

Is BlueMix a Heroku competitor or compliment? I want to develop on the Watson API but I also want to use a stack I'm familiar with. Also, do you have range estimates for the price of accessing the Watson API?

pesenti12• 12 years ago

Yes BlueMix is a Heroku competitor. It is the easiest way to consume Watson APIs but won't be the only way. I can't disclose pricing yet.

matznerd6• 12 years ago

I went for an info session and a few events for Watson a couple of months ago at the IBM office in NYC. They are doing pricing with revenue shares. A lot of devs, including myself, were not happy about this. They basically were not open to projects that weren't directly making money off of Watson...

mark_l_watson3• 12 years ago

BlueMix is based on Cloud Foundry and is very easy to use. Pushed an app there yesterday as a test.

3327• 12 years ago

When will Watson instances be open for access?

bravura• 12 years ago

Do you mind emailing me? My email is in my profile.

80ProofPudding• 12 years ago

Waiting for my coffee to brew, I read that as "Emma Watson API".

Tyrant505• 12 years ago

Does this also give access to their cooking and recipe data?

Edit: http://www.ibm.com/smarterplanet/us/en/cognitivecooking/

mark_l_watson3• 12 years ago

I am helping a customer integrate Watson into their system so I am very happy to see the news about BlueMix (https://ace.ng.bluemix.net/) that apparently will allow me to keep experimenting with Watson after my consulting engagement is complete.

If you read the documentation, you will see that preparing training data and questions is fairly straightforward.

yatoomy• 12 years ago

Ive been looking into Watson's new application to analytics etc. How would that compare to say Mathimatica or the Wolfram Language/Data Science Platform?

kyberias• 12 years ago

Looking at that example, I wonder why that Porcaro quote is listed as evidence. It doesn't relate to Jackson's album at all.

beebs93• 12 years ago

I sent a e-mail to my co-workers containing "...natural English to ask Watson..." and somehow people read it as "You can ask Emma Watson, who is English, a question and she will respond".

And I thought, "...close enough - Watson could answer questions about Emma".

IBM Watson API

Related Stories