Ross: Attorney built on top of IBM's Watson

http://www.poweredbyross.com/

by firloop • 11 years ago

202 112 11 years ago

poweredbyross.com

Animats• 11 years ago

That's the winning project in the Watson Challenge.

http://metronews.ca/news/toronto/1230021/watson-challenge-wi...

mc32• 11 years ago

This might be a way to help overburdened court appointed defense attorneys better represent their clients (as well as speed up the overburdened judicial system).

datashovel• 11 years ago

I hope I see the day when computers can actually represent people in court.

deciplex2• 11 years ago

I hope I can see the day when the justice system is run completely by benevolent AI. Legislative too, for that matter, and at least partially the executive functions of government as well, while we're at it, including law enforcement.

sandworm3• 11 years ago

Public defenders don't do much research. Remember that the vast majority of criminal cases will not see trial, or often even a courtroom.

spacemanmatt3• 11 years ago

I'd like to think of this as comparable to CAD for architects, except attorneys have never had any serious domain-focused assistive software, beyond word processing. Maybe some have, but it's not a well-known category that I've been able to see.

skorgu• 11 years ago

There are some packages for very specific sub-fields, things like Collection Master and such but I'm not aware of anything generic enough to cover the field of 'law'.

hackuser2• 11 years ago

There is a lot out there, for everything from case management to practice management to discovery to legal research to legal composition to litigation support ...

LAMike• 11 years ago

I wonder if the creators where fans of 'Suits'

shrikant• 11 years ago

Sorry, downvoted you by mistake! I agree -- it might be a reference to Mike Ross (chap with an eidetic memory) from Suits.

phonon• 11 years ago

Nope. Read the end. http://thevarsity.ca/2015/01/12/a-lawyer-in-your-pocket/

steveeq1• 11 years ago

This is a good 80/20 solution. 80% of the value of the attorney for (less than) 20% of the effort/cost.

pfalke• 11 years ago

I tend to agree, but I can't find details on how it works. Quickly reading the site I had the impression that

- its for attorneys only

- it won't be entirely free, as published are promised compensation for their "premium content"

arethuza4• 11 years ago

Probably more like 100% of the fees for 20% of the cost to the law firm.

wodenokoto• 11 years ago

What people seem to misunderstand about steveeg1 comment is that a lot of time at an attorney office is spend sifting through old cases.

Since lawyers bill in hours they either have to raise their hourly bill or lie about the hours spend in order to keep the final price tag the same.

arethuza4• 11 years ago

As far as I know, litigators do spend a fair amount of time researching cases as it there job to assemble a case that is capable of being presented in court - although most litigation gets settled before going anywhere near a court.

However, in most law firms I know litigators are in the minority - and I don't think the likes of corporate lawyers spend much time researching cases?

bediger4000• 11 years ago

Why should the final price tag remain the same? Free market economics says that if we introduce efficiencies, the price comes down, and/or fewer people produce the same output. In general (exception is music, as far as I can tell) that's the case. Other labor markets have suffered horrible, drastic shake-outs, why not Law?

sandworm3• 11 years ago

This sort of device is only applicable for very specific areas of "law". It may work for generalized law questions, retrieval of known legal principals, or even for electronic discovery (data mining) but once you get beyond law school there is a human element. I would like to see a machine come up with a novel means of describing a realworld legal situation.

Ask him to determine whether John Stewart's use of media from other networks (ie fox news) constitutes fair use for purposes of copyright law. That very basic question, answerable by any second year law student, requires image recognition, cultural understanding, even a sense of humor. It cannot be answered from legal databases alone.

Or here is one I get all the time: What constitutes "reasonable security" for a law firm handling client information? How about for a hospital? Or a Bank? No two lawyers will ever agree on those standards. They cannot be gleaned from case law and change every day in response to new threats/technology/needs. I doubt the machine would have much to add.

Or, does a CDN violate the principals of net neutrality? Lol. Have at it R2D2.

TheMagicHorsey2• 11 years ago

Its not meant to replace humans. Its meant to reduce the amount of tedious research work they need to do.

If you reduce the vast tedium of researching stuff in Westlaw/LexisNexis, you can spend more time on your research memo. You can do more actual analysis work. Thus firms can reduce the number of associates they need on staff, because the associates won't be wasting time on wrangling research results.

Yes, you still need a smart human to pose the right questions to Watson.

sandworm3• 11 years ago

Perhaps, if you are the 1% of lawyers who are associates at big law firms doing appellate-level research. They basically the same job as law students do in LRW class, pulling hundreds of quasi-relevant caselaw from a massive database. That side of things has, in recent years, been outsourced overseas.

See companies like http://www.legalsupportglobal.com/

rhino3693• 11 years ago

It probably won't even replace the vast tedium of researching West/Lexis for a while, but it might replace the "attorneys" that West/Lexis employ to summarize and tag articles w/ metadata. There is a ton of humanhours put into West/Lexis databases. They aren't just keyword searches.

bmmayer1• 11 years ago

Why is this being downvoted? It's a perfectly reasonable comment.

quarterto• 11 years ago

It entirely misses the point of what's linked here, and does so in a combative manner.

TheMagicHorsey2• 11 years ago

Wow! If this actually works, firms can reduce the number of junior associates needed on litigation cases.

azinman2• 11 years ago

They already are. Law dropped in 2008 recession and hasn't recovered. Law school applicants are down 1/3 or something like that, and it's causing much stir [1].

[1] http://lawprofessors.typepad.com/legalwhiteboard/2014/10/wha...

nodata2• 11 years ago

and if I want Ross to help me sue IBM, does Ross act independently? :)

deciplex2• 11 years ago

That would be a violation of Directive 4. So no.

raverbashing• 11 years ago

So it will be IBM vs IBM

IBM wins of course. And the lawyers

nodata2• 11 years ago

Ross would have to win, otherwise IBM's product looks like a dud.

caskance3• 11 years ago

We should probably ask Euathlus.

hackuser2• 11 years ago

and if I want Ross to help me sue IBM, does Ross act independently? :)

I know you are joking, but your comment is a good response to the other commenter who wished for a future when law is administered by a "benevolent AI". Who writes the code for the AI?

aruggirello2• 11 years ago

Next step: Engineer built on top of IBM's Watson. Next next step: Engineer built on top of IBM's Watson to replace Watson development team. :)

adlpz• 11 years ago

Did anyone say Singularity? :)

longlivegnu• 11 years ago

that's not how that works

dannylandau• 11 years ago

Honest question -- This is amazing! But why limit the search only to legal profession, why not apply Watson to all general questions and compete with Google?

I'd love an answer to a question without a list of results.

akashizzle4• 11 years ago

Well, in a nutshell, the way Watson Ecosystem works, you are granted access to an instance of Watson in which you can build a corpus of knowledge only in a particular domain.

worldsayshi• 11 years ago

Well, solving a specific domain is easier than solving for all domains. Begin small. It's not the same type of technology as Google. It most likely contain a lot of specific configuration for understanding the semantics and expressions of law.

nirmel• 11 years ago

I run lawdingo.com. Any ideas on how we could use this?

mmariani• 11 years ago

I think the most obvious way would be to offer this as a subscription service to the lawyers of your platform. But, remember we're talking about IBM, this will cost you.

akashizzle4• 11 years ago

Follow ROSS for updates @poweredbyross on Twitter!

sevkih• 11 years ago

Couple of my friends that work for IBM told me that it still needs a lot of work because researchers that take blind tests can almost always tell apart the cold, inhuman responses that are devoid of any human decency from the responses generated by the computer.

monk_e_boy• 11 years ago

.... bravo. You been holding on to that one for a while? Waiting for the technology to catch up :)

LLWM• 11 years ago

I've thought the same about some human attorneys, too.

mjgoins• 11 years ago

This joke was almost perfect, but the wording hides the punchline.

thomasfl• 11 years ago

Does someone now where the stunning photo of a library was taken?

orky7• 11 years ago

Stuttgart City Library

petercooper• 11 years ago

http://en.wikipedia.org/wiki/Stadtbibliothek_Stuttgart

Another view of it: http://it.wikipedia.org/wiki/Biblioteca_civica_di_Stoccarda#... - it looks positively Kubrickian.

bshimmin2• 11 years ago

Absolutely beautiful. I wasn't 100% sure it was even real!

therockspush• 11 years ago

Kind of sounds like the beginning of Cinco e-Trial.

The best part is, e-Trial never gets it wrong.

https://www.youtube.com/watch?v=XL2RLTmqG4w

jakobegger• 11 years ago

I'm impressed, and I'd love to see it in action. But I'm also worried that this is going in the wrong direction.

If the law is getting too complex for humans to handle, the solution is not to create supercomputers that help us. The solution should be to simplify the law.

bshimmin2• 11 years ago

The law has always been complicated. I'm pretty sure the only people who would be able to "simplify the law" would be lawyers, and I can't really imagine they would think it would be in their best interests to do that.

ericd• 11 years ago

Also, it's a reflection of reality and human values, both of which which happen to be very complex, nuanced, and have plenty of edge cases for any rule we might try to dream up.

dragonwriter2• 11 years ago

The law has always been complicated. I'm pretty sure the only people who would be able to "simplify the law" would be lawyers, and I can't really imagine they would think it would be in their best interests to do that.

Lawyers are often behind movements to simplify the law. The problem is that efforts to simplify the law often lead to (what some substantial group feels are) substantially negative impacts given the complexity of the reality the law is meant to deal with.

Simplifying often sounds better in the abstract than in concrete terms.

wampus• 11 years ago

If the answers are comprehensive and accurate, this could aid the simplification of law by revealing conflicts and inconsistencies.

Reforming law to be machine readable might eventually provide a litmus test to prevent the passage of bad laws. It could also provide a way to flag prior law that is invalidated by a new law.

cowsandmilk• 11 years ago

Things like case law become more complicated due to the march of time. More cases get decided, more case law is created. Another is the question of legislative intent. The edits to law as it is being drafted can be used to argue a case. These edits increase with time.

prof_hobart• 11 years ago

In theory that would be great, and it's been attempted multiple times throughout history - the law has pretty much always been too complex.

The problem is that much (although admittedly not all) of the complexity in the law is a result of attempts to clarify and provide consistency to the nuance and obscure edge cases that occur in real life. Removing that nuance from codified law results in it being even more down to a judge's individual interpretation than it is today, meaning individuals would be even less clear on where they stand than they do now.

If a computer could accurately interpret the law, and that computer was freely available to everyone, I think we'd all be in a far better position.

JackC• 11 years ago

There have been some important efforts to make the law more accessible in the last, say, 50 years. E.g.:

* Jury instruction have been rewritten using the minimum number of terms that jurors won't already know.

* Legal decisions are written to be more readable to contemporary laypeople. (At least they seem that way to me -- it's a little hard to tell given the change in writing styles generally.)

* Uniform legal codes have refactored the law to make it more consistent state-to-state, and to remove complexity when for example two causes of action could be reduced to one.

* Property law (which probably moves more slowly than others) has moved away from centuries-old "magic phrases" that could break inexpertly-written deeds.

But all of this is basically syntax. It makes the system easier to learn, but doesn't reduce the fundamental complexity of the model.

And you can't reduce that complexity much, if you want a system that is "fair" and "just" at scale. "Fair" meaning that it treats like cases alike, and different cases differently. "Just" meaning that it mostly comes to what most people consider the right outcome in individual cases.

The scale here is hundreds of millions of people over hundreds of years, any two (or more) of whom can interact in a way they want the law to settle. Treating all of those cases "fairly" means at least one of: already having a rule that roughly guides the outcome for a given dispute (statutes and regulations), or taking into account the decisions other people came to in similar cases in the past (caselaw). Treating the cases "justly" means those rules and analogies have to be fine-grained -- if one of the parties points out a special circumstance in their case, and most people would feel that it should change the outcome, then it needs to be taken into account for the system to be just.

So law is complex because the potential interactions between hundreds of millions of unique individuals are complex.

You might want to reduce complexity by reducing the reach of the law, but I don't think you can reduce it that far and still have a recognizable society. For example, many libertarians would prefer a system with greatly reduced criminal law and commercial regulation -- but where the government still enforces contract and property law in a way that is predictable and fair. The system for fairly, justly, reliably, predictably enforcing the contracts entered by hundreds of millions of people over hundreds of years is going to be complex -- the same kind of complexity we have now.

Obviously the situation could be better or worse -- the stuff I listed at the top are small examples of how it's gotten better. Making the system (say) half as complex would be great. But it wouldn't fundamentally change the problem space, or make tools like Watson unhelpful for solving it.

jimbokun• 11 years ago

This seems similar to attempts to rewrite a complex code base to be simpler, more consistent, and easier to understand.

In practice, a lot of the quirky, wonky code is there to fix an actual bug that was encountered, and taking it out re-introduces the bug.

How do we know eliminating some of the complexities of current laws won't re-introduce some of the problems those complexities were trying to solve?

mdaniel• 11 years ago

How do we know eliminating some of the complexities of current laws won't re-introduce some of the problems those complexities were trying to solve?

The other side of that coin is: are the bad outcomes produced by the current codebase bad enough that we will replace them and accept the risk of re-introducing the other bugs?

Alternatively, the entire codebase is in English (+/-) so one could document the bugs that changes are attempting to address.

rhino3693• 11 years ago

The more you simplify the law, the more complex the application of the law becomes.

Murder occurs when a person, of sound memory and discretion, unlawfully kills a person, with malice aforethought.

Seems simple the there are hundreds of cases that tell you what exactly the limits of these elements are. Is being drunk sound mind? What constitutes malice aforethought.

The law is complicated because reality is complicated.

The civil law system keeps it a bit less complicated by not using precedent from old cases. But that means the application in your case is harder to predict. It is your judge making the gut call instead of a history of judges.

mihok• 11 years ago

Why is this only offered to lawyers and legal professionals? I have had countless scenarios where I just want to look up something regarding the laws surrounding a topic but get lost looking for accurate legal information... This seems like a perfect solution for that use case, no?

vertex-four• 11 years ago

One issue is that they'd have to be very careful to ensure they're not seen as providing legal advice.

alexhawdon• 11 years ago

Watson's good, but it's not that advanced. It's an 'expert system', in that it's a system for experts, not a system that is an expert.

This is a smarter, domain-specific search engine. You still need to be able to ask the right questions and then understand interpret the results it provides.

I still don't disagree that for certain 'low-stakes' issues it could be a useful tool for lay persons, but they'd need to understand the limitations. Perhaps they're worried that giving such access might tarnish the Watson brand -- if a medical doctor has tried Ross and found it wanting then when they roll out 'House' she might dismiss it as junk based on that experience.

caskance3• 11 years ago

No. It's more like StackOverflow. You wouldn't send a non-programmer there for basic questions, it's for people who work in the field looking for specific answers.

bsaul• 11 years ago

Does anyone know of in-depth articles that explain Watson internals (or even general such as what family of algorithms they're using) ?

A friend of mine got to visit their R&D department a few years ago, and told me they basically explained nothing at all and remained on the marketing level. But there's got to be something somewhere, like previous research articles by the team's members, right ?

abhijitr• 11 years ago

The team has published quite a few papers (albeit they are mostly behind paywalls). Here's a good overview: http://www.aaai.org/ojs/index.php/aimagazine/article/view/23...

grad_ml• 11 years ago

http://nlp.cs.rpi.edu/course/spring14/nlp.html

lurcio• 11 years ago

Wowed by the engineering brilliance. Ambivalent about the social cost-benefit. Creative destruction indeed (for the lower and middle orders, anyway).

"First it came for the factory workers,...and then the medics and lawyers..."

SixSigma2• 11 years ago

It won't be satisfied until there's no work left to do, then how will we spend our time!

caskance3• 11 years ago

Inventing new work for Watson

johnward• 11 years ago

I know there are a million things I would do if I didn't have to work.

HCIdivision17• 11 years ago

This century-long decent into lesiure is what's really killing us. I wish I could remember back when cars were unaffordable, computers were unattainable, and hobby supplies were expensive specialist shops. I bet those were the days!

digikata• 11 years ago

I'm optimistic that it's a good development, the more automation displaces high-salary occupations, the more likely society will change to address fundamental economic shifts associated with singularity, or post-scarcity, or whatever you want to label it. Doubly true since it's an frequent past occupation of politicians.

minthd3• 11 years ago

Is there an amazing demo of this tech that i missed ? because if not-this is just another marketing site for watson/ibm, nothing more. we've seen plenty of those done by IBM- without much result yet(for example, where is watson the chef app they promised), 4 years after jeopardy.

So i think it's better to be skeptical.

jameshart• 11 years ago

Where is the Watson chef app? It's been writing a book: http://www.amazon.com/Cognitive-Cooking-Chef-Watson-Innovati...

(disclosure: I work for IBM, not in the Watson group)

minthd3• 11 years ago

Again, we're looking for working technologies - not articles, movies or books.Its much easier to bullshit your way through a book than a working software - and comparing that to the state of the art and other commercial offerings.

melchebo• 11 years ago

Chef website: http://www.bonappetit.com/entertaining-style/trends-news/art...

Request beta access: https://watson.ihost.com/watson/chefwatson/page/survey.html

mikecb4• 11 years ago

Love the idea and execution, but this is less an attorney and more a legal librarian. Attorneys spend most of their time on the facts of the case.

In law school, most lawyers are taught to present each argument in a standard format called IRAC: Issue, Rule, Analysis, Conclusion. The issue is like the question presented on the front page here: "can courts pierce the corporate veil where a corporation has misappropriated funds?" ROSS spits out the relevant rule, and any information it can find on how to interpret that rule in specific situations. However, this is only the beginning of a lawyer's job. The largest part is taking that rule and actually applying it to the facts of the specific case. ROSS doesn't seem to be able to do this, yet. Finally, and least importantly, the lawyer comes up with a conclusion (or a series of probability-weighted conclusions). ROSS doesn't seem to be able to do this either. In law school and in court, it's not enough to cite the rule of law. It's much more important to apply the reasoning of the rule to every specific fact in the specific case.

It would be very interesting to see this intelligence applied not just to legal research, as here, but to e-discovery, which is the other time intensive task given to associates and contract attorneys. That would, I think, be the next step into turning this into a general purpose attorney that _would_ be able to handle the analysis and perhaps conclusory stage of a legal issue.

If anyone who worked on ROSS is here, where did you purchase your corpus from? West or lexis? How are you doing shepardizing and pruning of bad law?

dangerlibrary• 11 years ago

Right now, there are a lot of billable hours for what Ross can do in seconds. I don't think it's unfair to say that this is replacing a substantial portion of _some_ lawyer's jobs.

dragonwriter2• 11 years ago

I'd like to see a concrete description of the difference between what ROSS gives you versus what, say, LexisNexis does.

If its just giving you a simple answers and not actually producing the kind of research results a research attorney using traditional research tools would -- where the simple answer would be part of the heading, but sources and analysis would be part of the report -- its not going to be useful except as a novelty. In law, its rarely as important to get a simple answer as to have an answer that you can support as most correct and explain why other potential answers are less correct for the specific circumstances.

And, from the vague marketing hype, it doesn't seem like what is really needed in law is what ROSS is being sold as doing.

shockzzz• 11 years ago

Yes, e-discovery is definitely the missing piece here. At the end of the day, lawyers need to be empowered by technology to do their job better, and ultimately make the legal system better.

And it should be called RICK.

yourapostasy• 11 years ago

E-discovery has already gone through an impressive cost deflation with the application of more sophisticated scanning, OCR, and search algorithms that recently (in the past decade) came onto the market. I've seen more than a few law firms that developed an over-dependency upon discovery-related fees in their business model either drastically downsize, abruptly change, or in one case shutter their doors entirely (after a painful circling the drain).

If deep learning technology like Watson deflates further the remaining e-discovery market as well as the initial case research billables, it will be interesting to watch how law firms adjust their business models. For those that can stand out with consistently innovative, novel and creative legal services delivery (like nearly always coming up with newly-accepted interpretations of case law) that depends upon people, I could easily see rates for those attorneys go dramatically up, partly to backfill the revenue gap that is created in the wake of automation of these aspects of legal services business models, partly due to an exacerbation of the bifurcation effect automation seems to have upon labor markets.

akashizzle4• 11 years ago

Great comment. What ROSS does in addition to what you've described is ask questions against the context of a case. The case facts (inputed by users) will be factored into the queries so as to produce the most relevant information (rules, precedents and other connections across a vast body law) that would take an associate (especially a junior) many hours to unlock. And absolutely, ROSS is not the end. The quality of the execution lies in a legal researcher working well with a cognitive system that provides around-the-clock legal intelligence. And e-discovery is definitely on the radar for the future.

mikecb4• 11 years ago

Sounds awesome. What sort of computational cost does each query take?

mcmancini• 11 years ago

Interesting, IRAC sounds a lot like SOAP (subjective, objective, assessment, plan) notes used in medicine.

mikecb4• 11 years ago

Probably very similar. It's designed to make lawyers think methodically about a problem to avoid errors of logic and construction.

motters• 11 years ago

Expert systems. And so the AI circle has been completed.

SEJeff• 11 years ago

Seems more like this totally replaces the job of much of what a paralegal does, research. It is the logical evolution of tech to do just this however.

joshuaheard• 11 years ago

Now that this "Attorney" can do legal research, I guess the next steps are to get it to marshal the relevant facts and evidence, analyze documents and information, interview witnesses, negotiate with the other side, and present a case to the jury.

mikecb4• 11 years ago

Why do that? IBM becomes largest arbitrator ever, each side submits their case online, gets results in under a minute!

clavalle• 11 years ago

Unequal access to our legal system is the shadow problem of our age. It touches so many aspects of our society and we barely seem to be aware of the issue.

Hopefully this technology and others in the same vein will bring costs down and speed up the process so more people can have access to what they should have already by right.

Atropos• 11 years ago

Does anybody know if this is in the "idea" stage right now or if it is a working product?

If I understand correctly, this is a project by a team of University of Toronto undergraduate students for a competition to receive 100,000 $ seed funding by IBM and continued access to Watson. It seems to me that the stated goals are incredibly ambitious // hard to reach with these resources?

rootbear• 11 years ago

This brought to mind a passage from Stanislaw Lem's "The Cyberiad", where one of the main characters cooks up a one-use lawyer, much like a throw away shell script:

And Trurl went home, threw six heaping teaspoons of transistors into a big pot, added again as many condensers and resistors, poured electrolyte over it, stirred well and covered tightly with a lid, then went to bed, and in three days the mixture had organized itself into a first-rate lawyer. Trurl didn't even need to remove it from the pot, since it was only to serve this once, so he set the pot on the table and asked:

"What are you?"

"I'm a consulting attorney and specialist in jurisprudence," the pot gurgled, for there was a bit too much electrolyte in it.

If you've never read The Cyberiad, you really should.

conjecTech• 11 years ago

I am so glad other people are thinking about this. I think the potential use of ML and AI for helping with legal matters is absolutely huge, and I think it is one of those things that would add incredibly to a large number of people's lives. I've been financially intimidated by the threat of frivolous lawsuits far too often over the last five years, and I know the problem isn't unique to me. Even if you are undeniably right, you can easily drop $100k proving it. It's the same problem that is at the root of patent trolls. This is a fantastic idea, and it's good to see the Watson team working on such fantastic stuff. I honestly hope I get a chance to help them with their efforts at some point.

Ross: Attorney built on top of IBM's Watson

Related Stories