Second version of HoloLens HPU will incorporate AI coprocessor

https://www.microsoft.com/en-us/research/blog/second-version-hololens-hpu-will-incorporate-ai-coprocessor-implementing-dnns/

by itamarb • 9 years ago

142 87 9 years ago

microsoft.com

dsr_• 9 years ago

Is it time to recognize that "AI" is the meaningless buzzword of 2017?

"Nothing is cooler because it is cyber." -- J.D. Falk, RIP.

yread• 9 years ago

"AI" might be, "AI ASIC" is pretty cool though!

nsxwolf• 9 years ago

Next they'll add AI to the Juicebro.

deelowe2• 9 years ago

How is AI meaningless? I mean, I guess the term can be seen as silly, but I mentally map it to "statistical computing."

[edit] Since I'm getting down votes, can someone clarify? I wasn't being contrarian with the above comment. Is my mental map of what AI means as an industry term incorrect?

yequalsx• 9 years ago

Any term/phrase can be rendered meaningless by overuse and misuse. The person you are responding to isn't claiming AI, as it actually is and what it actually means, is meaningless. They are claiming that "AI" the phrase is becoming meaningless.

sp332• 9 years ago

AI doesn't have to be statistical. It can be rule-based, for example. The reason it's useless is that knowing your headset has "AI" in it doesn't tell you anything about its functionality.

ktta• 9 years ago

'AI' is often a delicate term (in the sense the real meaning is often hotly debated). It represents what many people worked decades of their lives for, but it is still really as hard and as abstract since the idea was first conceived.

Using the term might get points for marketing, but you'll only get contempt from the people who realize what it really stands for.

donpdonp• 9 years ago

I think you've hit it on the head. 'AI' computations are a variety of mathematical and statistical techniques, which on their own are varied and interesting but it doesnt suggest a fundamental difference in hardware over general purpose computing. GPUs provide distinct advatages for some kinds of operations, but its not well defined that "AI" has its own set of computations for which hardware can be custom built for, and be distinguishable from existing kinds of CPU hardware.

bitL• 9 years ago

"Statistical computing" is kinda outdated and stems from misunderstanding what ML is and the past reliance on some well-known statistical methods. Look at it as a parallelizable non-linear optimization able to reduce dimensionality by employing cool tricks and surprisingly efficient in some real-world tasks. If you just take a general, fully-connected DNN, it wouldn't work at all; those tricks like CNN/RNN/LSTM/GAN make it all work within a narrow setup of hyperparameters.

lend000• 9 years ago

An "AI" coprocessor could be an FPGA, a neuromorphic chip, a DSP, a TPU, or a GPU -- it's incredibly vague.

michaelbuckbee• 9 years ago

Your definition feels pretty reasonable, but I think the issue is that the term "AI" is being slapped on tons of services that do extremely basic predictions. If it has a formula in it, it's now "AI".

jorgemf• 9 years ago

AI uses more than statistics. Some algorithms doesn't use statistics at all, for example you can build decision trees using information theory instead of statistics. Statistics is a big part of AI, but in most algorithms you will find more than just statistics like optimization, algebra, ...

seanmcdirmid• 9 years ago

AI has been a word since McCarthy coined it in 1955. It is always "just around the corner", but it is hardly a meaningless buzzword.

freehunter2• 9 years ago

The problem is people keep moving the goalposts. As soon as some AI technique is shown, suddenly it's just an algorithm and not actually AI. AI is something else. And then we invent that, and suddenly it's just an algorithm, not AI.

AI is magic. As soon as you know how the trick is done, it's just a trick. It's not magic anymore. There can never be such thing as AI, because as soon as it's put into a computer, it's just an algorithm.

Computers are constantly doing things that only humans could have done just a few years prior, but it's never AI. It's just algorithms.

ramshanker• 9 years ago

I remember HoloLens being announced to be available in "windows 10 timeframe". Still awaiting (EDIT:) Cheaper consumer version.

eightysixfour2• 9 years ago

It has been available for more than a year.

wlesieutre• 9 years ago

If Windows 10 is the "forever" version of Windows with continuous upgrades then they've got plenty of time!

esterly• 9 years ago

HoloLen hardware can be purchased here https://www.microsoft.com/en-us/hololens/buy

MichaelGG• 9 years ago

Hardly the device for my kids to play Minecraft on like MS hyped. Starting to feel like another Kinect - the preview movie was amazing, the actually shipped one, meh.

connorcpu• 9 years ago

They're not really focused on making a consumer version, they're trying to turn it into an enterprise product first

godelmachine• 9 years ago

Don't they follow that model for everything? For stuff like RAM, HDD's and anything related to computers? They actually build the product for enterprise and then also sell it to individual consumers.

WorldMaker2• 9 years ago

The "cheaper consumer version" focus for now seems to be on the Windows 10 Mixed Reality goggles coming out in the Fall. Yes, it's not HoloLens displays (it's classic LCD screens strapped to your face) or standalone computer (it's tethered to a PC), but it is cheaper and it will be consumer focused in the Fall (and it will use most of the same Windows platform support and niceties like inside-out tracking).

dingo_bat• 9 years ago

Well windows 10's time frame is now "as long as Microsoft is in business". It's going to be a series of beta quality builds until eternity.

akvadrako• 9 years ago

Any idea who makes it? It's probably close in architecture to GPUs, the kind of thing Nvidia and AMD are positioned to capitalise on.

arcanus2• 9 years ago

I suspect it will have more in common with mobile GPUs than the big iron ASICs that come from NVIDIA or AMD.

neurotech13• 9 years ago

IMHO Its most likely a variant of the AMD GPU or APU, because it would take some major differentiation before nVidia would do a largely custom core processor, even for Microsoft.

nVidia's Tegra Xavier SoC is under development, with the Volta GPU architecture that would include the Tensor core which is specifically intended for deep learning and AI applications.

cr0sh• 9 years ago

Maybe:

http://www.general-vision.com/ ???

No idea, actually - but they are one of a handful of companies selling such a part.

zebrafish• 9 years ago

I was thinking it might be closer in spirit to AMD's APU which combines graphics and compute onto the same chip.

restricted_ptr• 9 years ago

They used customizable DSPs from Tensilica. I wonder if this is based on the same technology.

modeless• 9 years ago

You're right, Microsoft revealed last year in a Hot Chips presentation that HPU v1 is a Cadence Tensilica DSP with custom instructions [1]. Given that, I'd bet that HPU v2's neural net core is Cadence's "Vision C5" [2].

[1] http://www.tomshardware.com/news/microsoft-hololens-hpu-arch...

[2] https://www.cadence.com/content/cadence-www/global/en_US/hom...

deepnotderp• 9 years ago

I'm guessing it's close to the tpu design, ie a systolic matrix multiplier.

Other possible candidates include INT8 DSPs

guimarin2• 9 years ago

Altera, an Intel subsidiary. [1]

1. https://www.bloomberg.com/news/articles/2017-07-24/quest-for...

neurotech13• 9 years ago

Microsoft are using Intel/Altera FPGAs in the datacenter, and not likely for mass produced devices like this.

While it is possible they are using FPGAs for the Hololens Processing Unit, I seriously doubt it. The FPGA needed to exceed the performance of a high-end mobile GPU (OpenCL/CUDA for Deep Learning/AI) would have an excessive power consumption for a mobile device.

Another factor is that higher end FPGAs are expensive ($200+ wholesale) and typically cost thousands each, and not suited to a mass produced consumer device.

As for who made this HPU, I'd say AMD helped design it and GlobalFoundries (or maybe TSMC) are doing the production.

MrBuddyCasino• 9 years ago

My money is on Movidius:

https://newsroom.intel.com/news/intel-democratizes-deep-lear...

ratbr• 9 years ago

Serious question: what is an AI coprocessor technically? Some machine learnt models burned on a chip? Or some kind of a neural net with updatable weights?

arcanus2• 9 years ago

It is not well documented by anyone. However, the expectation is that it is a matrix or convolution coprocessor, as this is a common operation in deep neural networks (for both inference and training). For instance, NVIDIA says they are supporting 4x4 convolutions with the tensor unit.

dgacmu• 9 years ago

One example is: https://arxiv.org/abs/1704.04760

There are many potential designs for these things, but the first gen TPU is one that works, is in production, and has been described in a paper. But you have to differentiate if you mean an inference engine, or something that can also do training. For HoloLens, it's probably going to be an inference unit, which means it'll possibly look something like a TPU, perhaps with more specific hardware support optimized for convolutions (which are very important for visual processing DNNs these days), as the NVidia tensor units are.

Eridrus• 9 years ago

Probably also enough high speed memory to store the weights without needing to go to RAM.

chriskanan• 9 years ago

I was in the audience at CVPR when it was presented. They were doing semantic segmentation using resnet-18, so I'm guessing it speeds up convolutions and some linear algebra during inference. I'm guessing it won't be used for training.

danmaz74• 9 years ago

The AI coprocessor is probably the first processor designed directly by the marketing department...

gumby• 9 years ago

Oh man, that ship has sailed!

WorldMaker2• 9 years ago

According to the linked article, this coprocessor seems particularly focused on Deep Neural Networks (DNN), so it does sound like a updatable weight neural network evaluator.

hatsunearu• 9 years ago

A whole butt ton of GPU-style FMA and low precision float multiply ALUs would be my guess

protomyth• 9 years ago

How low precision can you get and still have it be useful?

zitterbewegung2• 9 years ago

I used a Hololens and it was awesome (it fit over my glasses). Inference on Hololens could make you do so much more. Maybe you could use it to take scans of parts from a CNC or the CNC tool and create a system that could tell you if a similar piece will fail in the future. From what I have seen compared to Google Glass I think it could be possible for richer interactions and also it uses both eyes. But, I haven't heard any Enterprise users use Hololens.

Pigo2• 9 years ago

We got a couple at my company and I've built some protoypes for it, and threw up a little blog for it. The cool thing is the HoloToolkit which seems to be maintained by some xbox developers, and scripts all the functionality you need to get off the ground.

The hard part has been coming up with prototypes that go beyond a cool experience, and solve some customer's problem. It doesn't recognize what it's looking at, as much as it's just recognizing the shape of what it's looking at. You have to write the functionality to then determine what it is. Though the HoloToolkit does have scripts that will recognize walls, floors, tables. But it falls really short of the wild ideas my co-workers come up with. There are some example projects out there that will show you how to determine faces, which is cool. But the best ideas most people have, the beta Skype app already knocks it out of the park.

aantix• 9 years ago

What is it about the beta Skype app that is so compelling?

Balgair4• 9 years ago

The use cases are pretty varied. We're using some for a medical study looking to see if the HL can help lessen pain through distraction (tested against normal distractions like iPads). The HL is nice, as it lessens incidents of simulator sickness. We're also trying to get the thing to be used to scan the homes and backyards of long-term stay patients so that they can 'go back home' for a little bit while hooked into the hospital. Honestly, in our experiences, it seems like the best use of VR is 'live' events like concerts, sports games, minecraft, etc.

As an aside, you know you are a real adult when you are given the HL for the first time ever, full of 3-d potential and amazing sound and all the coolest things your 10 year-old-self could think of, and you immediately dive into the wireless and firewall settings.

yellow_postit• 9 years ago

The virtual home sounds more appropriate for VR than AR or am I missing something about the in hospital scenario - with AR you'd still see all the hospital just with some bright holograms trying to be "in front"

cmac2992• 9 years ago

One of the best Enterprise uses I've heard for hololens is measuring spaces. The voices of VR podcast described a company that installs stair lift. Before theyd have to have multiple people come and take lots of measurements before the install. Now it's just one person who can get all measurements in less than 15 minutes.

tux1968• 9 years ago

The article mentions a demonstration of hand segmentation made at a conference, here's a short video of it:

https://mspoweruser.com/microsofts-next-version-hololens-wil...

0xffff2• 9 years ago

Side note in case anyone at MS happens to read this, but the only actual content on this page that appears above the fold for me (viewing on a Surface Pro 4) is the headline, which is pushed nearly to the bottom of my display by all the headers/nav/whitespace. This strikes me as remarkably bad design.

freehunter2• 9 years ago

I don't know if it's designed to do that or not, but that's been a huge trend for a few years now. I still have people request that I design a site like that, where the only thing visible by default on the homepage is a 68pt logo and on specific pages is a 68pt title. A navbar at the top and a navbar under the logo are also requested, both navbars displaying the same options.

I don't get it either.

0xbear3• 9 years ago

I hope it also contains a decent CPU. The first version has a ridiculously underpowered Atom with no vector capability of any kind. Not the kind of thing you would expect in a $3000 device.

clmckinley• 9 years ago

I agree that you would expect more from a $3000 computer, but that is not what hololens is. Considering all of novel sensors and capabilities with the hololens, it is pretty amazing to me that the hololens is only $3000.

0xbear3• 9 years ago

Have you actually used it? I have it on my desk. It's garbage. Low res, narrow FoV display, graphics capabilities from 10 years ago. I wouldn't pay fifty bucks for it if I was spending my own money.

mtgx• 9 years ago

But will it be anymore practical to use than the first version?

markingram2• 9 years ago

For people who understand neural networks, this is HUGE! I have been dreaming for a custom chip for neural networks for 5 years! If they pull it off and deliver a product launch in a year or two, then they would smoke the competition again.

Symmetry2• 9 years ago

Google has had their TPU out for a while now. And the next generation of NVidia GPU is supposed to have neural network accelerating hardware.

markingram2• 9 years ago

But they don't have HoloLens ;)

make3• 9 years ago

Are you kidding me. This is basically a marketing name for an 8bit gpu

tanilama• 9 years ago

You mean a matrix multiplication processor?

ori_b• 9 years ago

You mean headless GPU? (Or, in some cases, DSP?)

ericfrederich• 9 years ago

I went to a Microsoft store in the mall and they are showing off Oculus Rift. They've been showing off HoloLens for a couple years now haven't they?... still can't buy it?

lstamour• 9 years ago

You can buy it. You just have to bring your own software: https://www.microsoft.com/en-us/hololens/buy

Second version of HoloLens HPU will incorporate AI coprocessor

Related Stories