A Peek Inside the Niantic Real World AR Platform

https://nianticlabs.com/blog/nianticrealworldplatform/

by srameshc • 8 years ago

153 39 8 years ago

MaxLeiter• 8 years ago

Niantic is currently developing a Harry Potter AR game. I wouldn’t be surprised if they allow you to cast spells at other players during duels and what-not, as one of the demos shows

jerrysievert• 8 years ago

as both someone who's been in the mobile location industry (having headed an R&D center specifically focused on real-time location for mobile devices), and is an avid pokemon go player (and thus Niantic customer), I don't expect them to have anything close to their demos until a year after launch, and even then in extreme beta.

that said, it's almost time for me to do another 1km walk to try to eek out 400m of "egg distance" in pokemon go.

the-pigeon• 8 years ago

Interesting. Niantic has done a really poor job managing Pokemon Go and Ingress though.

Hopefully they've hired better management with boatloads of cash they've made with Pokemon Go.

jonknee• 8 years ago

I can't speak to the management as I've never played, but Pokemon Go is still one the highest revenue mobile apps in the world (behind Fortnite, but ahead of say Clash of Clans).

hrktb2• 8 years ago

Users have been frustrated and very vocal on the social media, there are clear areas where Niantic is pointed pitch forks at.

Yet I am not sure I would call that bad management, in that they kept the game running, core players are still there in decent numbers while casual players seem to be coming back in waves.

They can surely do better and the game is riddled with bugs, but no one is operating at that scale without significant issues, and they managed to not ruin the game while making impacting changes to the whole system for two years now.

I have my frustration with the games, but I genuinely think they made a very decent job.

pedroaraujo2• 8 years ago

As an early player of Pokémon Go since the release day, I can say that the whole game was poorly managed (and still is). Even after the initial spike of users, they can't do a major event without messing it up:

- https://www.theverge.com/2017/7/25/16019404/pokemon-go-fest-...

- https://www.destructoid.com/niantic-is-handling-pokemon-go-p...

The people who play Pokémon Go nowadays, they do it for the novelty of being Pokémon, not because it is a good game. Also, Pokémon Go is popular the same way Flappy Bird was popular: it's an effortless game to handle and it's very convenient to play when you already spend a lot of time on the phone.

Niantic managed to turn a multi-billion dollar game into a multi-million dollar one.

BryantD• 8 years ago

Their operational skills are poor. E.g.: there's a bug in Pokemon Go right now which causes name resets, and there's no way to revert to your old name. E.g.: the new Ingress client is more than a year overdue, and they are facing several hard deadlines related to App/Play Store update requirements.

They have, on the other hand, figured out how to run a live game with Pokemon Go, which is encouraging.

However, I don't think they have the necessary skills to operate as a platform for other game/app makers.

pavs• 8 years ago

If Pokemon Go was mismanagement or failure (though you didn't say it), I don't know what a success is. No one, including Niantic, could have predicted how massively popular it would be in such a short time, so they had scaling problems among others things. Its still the most popular and profitable mobile games out there.

pedroaraujo2• 8 years ago

Pokémon is the highest-grossing franchise of all time, even more than Star Wars or any of the Marvel/DC characters: - https://en.wikipedia.org/wiki/List_of_the_highest-grossing_m...

It was obvious that the popularity was going explode.

ruytlm• 8 years ago

As one of those who got stuck into Ingress in its early days, I'm always happy to see Niantic pushing forward.

The only issue is they always seem to be a step ahead of themselves, in terms of their ideas being just a little too far ahead of the technology.

It will be interesting to see how truly real-world AR shapes the world when it becomes widespread. I'm sure that some day anthropologists will look back on this era with fascination, at how both society and individual human development/behaviour were shaped by technology, in terms of things like the way that access to information and exposure to 'realities' not restricted to the real laws of physics shape development.

digi_owl• 8 years ago

Speaking of the laws of physics, i suspect the primary limitation for this will be the power supply.

I seem to recall that there are ongoing jokes regarding existing AR games that one basically have to bring a generator (aka car) to keep up with the battery drain of the game.

erikpukinskis3• 8 years ago

I would expect the rendering efficiency to get better fast. The amount of power spent on graphics relative to the actual amount of new information being generated is absurdly high.

We should start seeing more experiences designed specifically for low power renderability soon.

viraptor• 8 years ago

There's a large number of people who will happily walk around with a power bank if there's a good enough reason. This happened for both Pokemon and for Ingress.

BLKNSLVR3• 8 years ago

AR Rocket League!

eksemplar• 8 years ago

I think the most interesting part about niantic is how they’ve made hundreds of millions play Pokémon go without niantic ever realizing that the main attraction, wasn’t the AR.

mustacheemperor• 8 years ago

To quote CharlesW's comment below,

If you think beyond video, Pokémon's AR was a home run.
My kids know where Pokémon are most likely to live. They know where the gyms are. Their reality has definitely been augmented.

taneq• 8 years ago

Good to see them working on real AR instead of "render an geolocated object with the camera feed in the background" (original Pokemon Go). At least the new ARKit version attempts to track the feed a bit.

pbw• 8 years ago

Pokemon Go's AR was a joke, but the promise of AR was very real and compelling to people, so they were wildly successful and now have the resources to actually try and solve the technical problems for real.

A lot of startups work this way. They have an ambition to do something but really no chance of doing it. But if they can attract enough attention and raise enough money they might actually be able to attempt it for real.

Crowd funding overtly works like this, but it's really common in regular companies as well. If you can show there's a chance, maybe you can raise enough money to actually do it.

CharlesW• 8 years ago

Pokemon Go's AR was a joke…

If you think of AR as video overlays on reality, for sure.

If you think beyond video, Pokémon's AR was a home run. My kids know where Pokémon are most likely to live. They know where the gyms are. Their reality has definitely been augmented.

proto-n• 8 years ago

Yeah that's what many people confuse. In pokemon go, AR, meaning 3d stuff rendered over the camera input, is not really essential to the game, and most people never even use it, as it drains the battery too much.

On the other hand AR, as in augmented world map, is the core of the game and is brilliant.

BLKNSLVR3• 8 years ago

The "Neon" demo displayed the horribly limiting nature of the device. The AR aspect is great, but to have to see it through the lens of the device and to have to occupy both hands to interact whilst full-bodily moving around the space makes it seem quite "cacky" (I can't explain what I mean by cacky, but it sounds like what I mean).

It's like playing a shooter game in the real world, but having to have the device pointing in the right direction in order to see what's actually there. Like using a torch in pitch blackness (Doom 3). This is where a Google Glass / VR-style headgear kind of interface would be perfect.

But since this is all just in "tech demo" stage, I'm probably being too critical. It is "cool".

Tertiary worry: AR advertising.

AndrewKemendo2• 8 years ago

It's building the communications infrastructure you need for glasses to "just work."

You can't just come out with glasses because there is too much you don't know about how multi-user and persistent content AR interface and communications work from a standing start.

BLKNSLVR3• 8 years ago

My comment was based on my reaction to how unexpectedly badly the handling of the device fitted into the activity, and how obvious it was that a different interaction device was necessary.

And yes, I think Niantic are more of a technology / platform company than they are a game developer, and I think that's the level of their involvement in the Wizards Unite game.

Google "just came out with glasses", but that didn't go very well, probably for the reasons you gave. Google Glass time may be upon us again soon, however, given these tech demos.

GeorgeRichard• 8 years ago

it seem quite "cacky" (I can't explain what I mean by cacky, but it sounds like what I mean).

From cack-handed (inept; clumsy)?

https://en.oxforddictionaries.com/definition/cack-handed

erikpukinskis3• 8 years ago

People have some interesting presumptions about AR/VR:

- participants will predominantly look around in 360 degrees

- participants will be manipulating the objects they’re seeing projected in 3D

- participants will have prolonged engagements with virtual objects

- all people present in the room will also be interacting with the same virtual objects

If these are all true then your analysis is correct: headsets are the only way.

If all of these presumptions are at least somewhat false then handheld “opera glasses”-style AR experiences will be very popular.

Personally, I think even people who have headsets and spend a lot of time in VR will also use handheld displays, for transient use and when others are present.

madrox• 8 years ago

Well done. The occlusion is far better than I would've ever thought possible with a single camera on current mobile hardware.

Whenever they get the form factor right for AR, I think we'll get to see some really interesting apps

Applethief• 8 years ago

This is awesome! I'm loving the advancements in AR.

wpietri• 8 years ago

One of the big questions I have about AR is the extent to which it's a novelty versus something that delivers lasting value. As an example, 3D movies and especially 3D TVs were an impressive technical accomplishment that basically nobody cared about. It'll be interesting to see how this plays out.

Animats• 8 years ago

Not too bad. They definitely have Pokemon Go, the Next Generation. How good is the phone location system? Staying locked to the real world is essential for AR.

[1] https://www.youtube.com/watch?v=kPMHcanq0xM

kauloswag• 8 years ago

I wonder when the first AR adblocker will become available.

kriro• 8 years ago

I'm curious when Blizzard will enter the mobile AR/geo-game market. Walking around questing in groups with dungeon spawns etc. using the WoW-IP would be interesting as would hack and slashing around Diablo-style. Plenty of skinner-box random loot material to keep people playing as well. The battle systems of MMORPGs or Diablo should map nicely onto AR-games. I suppose actually using distance could get tricky as people would try risky things to get battle advantages so just spawn and fight round based is probably the way to go.

I thought Pokemon Go got dull rather quickly (played upto level 35, I liked Ingress a lot more) and I still can't understand why they didn't opt for round based battles. I've recently been playing Jurassic World Alive very casually and like the overall design more. Each "catch" is sort of meaningfull and the DNA-extraction sequence is more fun than catching a pokemon. On top of that the battle system is cooler and rewards good play to a certain degree.

Before playing Pokemon Go I thought of AR in terms of overlaying 3D models over a camera feed (which is the feature I turned off in Pokemon Go). It certainly gave me a different perspective as I thought of some other use cases for geo-location overlay.

A Peek Inside the Niantic Real World AR Platform

Related Stories