Watch a swarm of flying robotic drones construct a tiny building

http://www.botjunkie.com/2011/01/14/autonomous-quadrotor-teams-may-build-your-next-house/

by coffee • 16 years ago

357 78 16 years ago

wglb• 16 years ago

This is just way too much fun.

brudgers3• 16 years ago

Interesting, but robotic cranes on the ground would seem to be more efficient and reliable in ordinary circumstances. It's not a question of how to grip it, It's a simple question of weight ratios.

mitko2• 16 years ago

What you say makes sense - robotic cranes should be able to operate with heavier pieces, and will require less energy per piece placement.

However, MAVs (micro air vehicles) could reach into places where cranes wouldn't be able - i.e. inside the building. Also you can have many more MAVs working at the same time than cranes, so MAVs might be able to considerably speed up the building process.

RodgerTheGreat• 16 years ago

There's no reason you can't combine these approaches. Using larger ground-based equipment to move girders and small, flying machines to do things like interior finishing makes a lot of sense.

lyime• 16 years ago

How about the combination for both. Perhaps there could be a 80/20 mix. It could very well make a lot more economic sense. It would seem like the cost vs moving weight ration would be much higher for MAVs compared to a crane.

mixmax• 16 years ago

They're also a lot easier to move and set up than cranes.

brudgers3• 16 years ago

If robotic ground based cranes can't reach inside the building, then for the most part, neither can human workers [making similar adjustments for scale]. Robotic helicopters might have advantages where helicopters are currently used for construction. But those are limited cases.

Generally, the duration of construction is determined by economics and weather. Flying robots probably don't provide an advantage on either front.

There may be some applications for MAV's for the inspection of construction. But there's an off the shelf solution already availible [http://www.amazon.com/Air-Hogs-Hawk-Eye-Channel/dp/B00395EJR...]

bpd1069• 16 years ago

Key word being "ordinary".

Once you are free of that limitation, applications of this technique on varying scales opens up a new "world" of possibilities.

Pipelining/Parallelization could be achieved by throwing more bots at the problem.

T-zex• 16 years ago

A couple of years ago I've watched a documentary about crane operators working in a harbors. They were payed incredible salaries and it was stated that they won't be replaced by robots because of their capabilities in decision making.

hinathan• 16 years ago

Well, that and incredibly beneficial union rules. Lots of work printing cargo manifests, handing them to another person who types it into another system, and so on. But it's ok, that process only adds a marginal amount of delay, error, and cost. It's better than getting shut down by a strike, right?

stcredzero• 16 years ago

I could see potential in this to disrupt industries like roofing, skyscraper cleaning, and line maintenance.

onteria• 16 years ago

I highly recommend checking out The General Robotics, Automation, Sensing and Perception (GRASP)'s other projects as well:

http://www.grasp.upenn.edu/research

iamwil• 16 years ago

Pretty neat! I'm sure they'll get to it eventually, but there's no advantage to having three drones in this demo, since the work isn't pipelined. It seems that a drone has to wait until one finishes picking stuff up before it can pick up something itself.

AdamTReineke• 16 years ago

Right, but they're saving travel time. When one drone is flying back to grab a piece, the next drone is lowering a piece into place.

gridspy2• 16 years ago

Indeed. Because the work IS pipelined

Pickup --> Travel --> Deploy --> Return to pickup

adamsmith2• 16 years ago

Just like starcraft SCVs!

mhansen• 16 years ago

It is pipelined, it isn't parallelized.

yellowbkpk• 16 years ago

This lab has several other videos with quad rotor robots like this (e.g. http://www.youtube.com/watch?v=MvRTALJp8DM), but don't worry about them escaping and starting a robot domination: they rely on infrared motion capture systems in that room for extremely precise location sensing.

Once GPS gets sub-meter accuracy, then we should start worrying.

sliverstorm2• 16 years ago

GPS + Accelerometer is already pretty darn accurate, I'm not really sure why they use the IR room. Perhaps simply easier to set up, and easier to co-ordinate the bots?

eftpotrm8• 16 years ago

These things don't look very powerful, to put it mildly. GPS means outdoors which means wind which is a bit harder for a small, light hovering robot to handle. Indoor lets them demonstrate the principle with a useful simplifying assumption of no wind.

thalur• 16 years ago

Depending on which waveband you use, different vision tasks become a lot easier. It looks to me like all the sensing is done by the room, not the quadrotors, hence why its all room-mounted.

jakevoytko• 16 years ago

Solutions based on expensive IMUs [0], SLAM [1], or visual odometry are more realistic than GPS. As a rule, never use GPS for fine-grained control. Even ignoring accuracy, GPS fails when you lack line-of-sight to GPS satellites, which is extremely dangerous on a quadrotor - how do you safely land a flying chainsaw with no feedback? When finely controlling a platform, you need accurate relative position. The global position is usually unimportant when the platform's position on Earth doesn't matter.

Sensors designed for computer vision applications are surprisingly light and small! Board-level cameras can fit in the palm of your hand, and reasonable IMUs are not much bigger than a matchbox. The biggest obstacles today are tradeoffs between performance/weight and performance/battery life. The platform needs algorithms with acceptable results, requiring almost no supporting hardware, and that are robust to the thousands of things that go wrong when trying to sense (noise, errors, resolution, occlusions, etc). Algorithms that fit all of these requirements are very uncommon. In fact, I would not be surprised if there was an Iron Triangle in there somewhere.

[0] Inertial Measurement Units: Devices that estimate acceleration (or some other measure of movement).

[1] Simultaneous Localization and Mapping. Using stereo vision, lidar, radio ranging, etc. to estimate your position, plus how the environment looks.

adamsmith2• 16 years ago

You can also use acoustic ranging, since sound travels at about 1 foot per millisecond. We did this with ultrasound at MIT -- http://nms.csail.mit.edu/papers/index.php?detail=9

You can get about 1cm of ranging error (median), and say 10cm of positioning error.

asdkl234890• 16 years ago

Once GPS gets sub-meter accuracy, then we should start worrying.

Or once the kinect shrinks to size of a short stack of quarters.

johnohara• 16 years ago

Anybody know the weight of each column?

burgerbrain3• 16 years ago

In another video they show 4 of them working together to lift a 1.2 kg structure, and they don't seem to have much trouble with it. It also shows a single copter lifting a piece of 2x4 several inches long, but doesn't give the weight. As just a ballpark guess I'd say these things probably max out at lifting and flying with a little under half a kg, they don't seem to have any trouble with at least .25 kg. The columns in the video linked at the top of the page are most likey a lot lighter than that, simply because there's no need for them to be heavy.

EDIT: that piece of 2x4 looks to be about 12 inches long. Assuming the wood is pine (likely, and also light), and using 350kg/m^3 as the pine's density (http://www.simetric.co.uk/si_wood.htm the lightest figure quoted) that works out to about .55 kg. (http://www.wolframalpha.com/input/?i=350+kg%2Fm^3+*+%282*4*1...). Quite impressive.

eftpotrm8• 16 years ago

Great fun, but I suspect NIMBY concerns would kill any practical application.

Let's imagine they get the machines scaled to the point when they could build an actual habitable structure, and that they sort the power concerns that I suspect would make it insurmountably uneconomic.

Now, imagine a squad of sufficiently large and powerful helicopters buzzing away all day next to your office. How many people are going to be OK with that?

philwelch3• 16 years ago

Drones don't have lives, families, or seasonal affective disorder. There's no reason they can't work at night if it's less bothersome.

eftpotrm8• 16 years ago

Oh, you'd rather have a helicopter next door while you slept?

pg• 16 years ago

Why couldn't small drones build things out of small elements? A lot of our assumptions about what is a reasonable unit of work are based on examples with humans in the loop. It might make more sense to think of a fleet of these things as a form of 3D printer.

eftpotrm8• 16 years ago

Lots of them working together means active traffic management becomes critical to prevent collisions. That'll be regulated because even if they're moving things the size of bricks rather than I beams, do you want to see what happens when two hovering robots each carrying a brick 5 metres off the ground bump into each other and suddenly stop hovering? Or if they start creating turbulence for each other and interfere with flight even without contact? Even if it doesn't get regulated by law the insurance implications would force de facto regulation.

Lots of small components means more joints. With a brick as our example that's fine but I'm not convinced the gain over a squad of fairly cheap bricklayers is there - with a girder frame structure as is more typical for large commercial premises that means for the same design it's simultaneously weaker, heavier and more expensive. Not a trio of attributes I'd want to apply to my structure.

This is a sort of technology I love, that's clearly very interesting and with all sorts of potential. But I don't see construction as the ideal target market for it, by a long way. Freight unloading would have been a great case had it not gone containerised some years ago. Warehouse order picking as with Amazon et al? Perhaps. You can have the storage floor as a controlled space without people underneath which reduces the safety issues and there wouldn't be the same problem with noise nuisance. If we wanted to go down that road though I'm not sure it's a big enough win over cranes / arms and conveyor belts, or that either is a win over fairly cheap people pushing trolleys (having worked alongside exactly that in the past).

If we want to stick with construction it would make good sense for use in hazardous environments because it would provide a way of deploying a large, highly mobile force to an area where you couldn't deploy human labour (or where that deployment becomes severely impractical / unattractive for whatever reason - see the film 'Moon' for example), but I'm not sure that's a large enough market to justify the expense of developing the tech enough to make it fully usable. There doesn't seem to currently be a shortage of labour prepared to go and work in Siberian gold mines or northern Canadian tar sands quarries, for the right price, and I can't see the power technology for these devices scaling to the point to make them likely cheaper any time soon to invest in it.

Cool tech searching for a better application IMHO. I'd love to see that better application though and would be heading down there to watch when it happened.

jpitz• 16 years ago

So, human workers and ordinary, loud construction equipment buzzing away all day for 2 years is ok, but robot equipment - quite capable of working 24/7 and likely capable of going faster - buzzing away for 8 months, thats unacceptable? I think unions are gonna scream louder than any NIMBY concerns.

eftpotrm8• 16 years ago

24/7 robots are fine, but helicopters are _loud_, particularly those with the lifting power to do construction work. We're currently seeing small proof-of-concept machines lifting small, light parts, but the machines needed to lift useful construction parts will need to be many times larger and heavier, and if they're going to run for any serious amount of time (as would be needed to be useful) then they either need very much bigger batteries or large fuel tanks, which again means extra weight which means more power, more noise and more energy to lift the extra weight of the energy. It's not impossible but it's a vicious, not virtuous, circle.

I relatively regularly have the local police helicopter overhead and it's definitely loud enough to keep people awake, sometimes to wake you up in the first place. A whole fleet of these withing 1/4 mile of you will be loud, noticeably louder than a usual construction crew, and I'm still concerned about the neighbours complaining about the risk of this fleet of robot helicopters crashing into each other or dropping parts. Really, I think this is a very cool tech but a mad application of it that I really can't ever see working.

maeon3• 16 years ago

Great show, but there needs to be another device (carried by the quad rotors) to create very strong bonds between the parts. If the quad rotors could carry this bond-making robot that temporarily attaches to the parts and joins pieces with adhesive/nailgun/puzzle-piece fit, then they would be on to something.

Make a structure of actual use, like a tiny bridge across a moat that could hold people. The magnets have got to go.

csmeder• 16 years ago

Another approach would be to have a small electric lock built into the pieces. When a piece senses it is touching another piece this electric lock screws into place.

gridspy2• 16 years ago

What would be cooler would be a completely separate bond-building robot that can weld / whatever and can independently traverse the completed building. When it was too far from its next destination a quadrotor would come and give it a lift.

You might have several different types of crawler. A couple to receive materials from the quadrotor and hold them in place while a third follows a weld pattern.

GrandMasterBirt• 16 years ago

I think the part connection is just an implementation detail. They can make these guys place something and another robot attaches.

ars• 16 years ago

It's not. Their positioning is inaccurate, and the magnet helps guide to the final position.

thebigredjay• 16 years ago

I like the audible menacing drone. Any autonomous robot should emit a menacing drone.

btipling• 16 years ago

I think flying swarm rebotics would be best weaponized. You could call them hack-mans, man-chops, person-hacks...HRM

stevenbedrick• 16 years ago

Who do you think comprise the biggest funders this sort of research?

fara• 16 years ago

robots building robots. that would be cool

siculars2• 16 years ago

Wow, unions are gonna hate these.

BrandonM• 16 years ago

The shortsightedness of people worried about fewer jobs because of new technology is ridiculous. If you can build a house for the cost of land and materials only, the cost of living is lowered for everyone. With enough advancement and automation, the cost of life's necessities drops. As it decreases, the amount of human labor necessary to support day-to-day life will drop with it. Eventually we'll be able to support ourselves with very little laborious work, focusing instead on content production and other interesting and creative endeavors. Why try to prevent that?

JoeAltmaier• 16 years ago

Its Capitalism when everyone works for themselves (ok, the money works for them).

Its Socialism when we all work for the collective.

What do you call it when nobody works?

jokermatt999• 16 years ago

Because although a grand vision of the future is wonderful, so is a guaranteed paycheck for the foreseeable future. For the people who'd be replaced by these machines, "eventually things will be amazing" is not much comfort in the face of "and you'll be replaced".

fakespastic• 16 years ago

Imagine the damage virii of the future will be able to do to our infrastructure...

andrewcooke3• 16 years ago

I'm going to be a pedant here - that does not look like a swarm, and they don't claim it is (in the video, at least). By "swarm" I would understand that all have the same programming and that the assembly process is emergent from simpler instructions plus exploration and feedback. Instead they appear to be programmed to act sequentially with a pre-planned set of actions. There is no feedback, no emergence. In short, it's nowhere near as cool as you seem to think it is. It's just a bunch of dumb machines doing exactly what they are told to do, with no smarts.

scott_s• 16 years ago

No smarts? From their behavior, I got the impression that the robots were assessing what was the next step in construction, which included assessing if another robot was still working on construction. They also had to avoid collisions.

Anything programmed by humans is a "dumb machine doing exactly what they are told." I think you meant that to mean each individual step was hardcoded. I don't think it was. I think they were all following the same algorithm. The group certainly spends a lot of time on path planning: http://repository.upenn.edu/grasp_papers/

andrewcooke3• 16 years ago

Actually, you may be more right than you know (sorry). I've found this quote: "We tell the quadrotors what structure to build and they figure out the assembly plan and then build it." https://www.youtube.com/watch?v=W18Z3UnnS_0&feature=play...

It still doesn't look very swarm-like to me (more like some kind of planner algorithm; I know the quote implies a distributed intelligence, but look at the way they queue always in exactly the same place, do laps, etc etc), but that certainly sounds more promising.

SeanLuke• 16 years ago

Correct about the swarm -- indeed it's not a multiagent problem -- but perhaps a bit unfair regarding the "dumb machine" part.

This appears to be a "multi-body" problem (rather than a "multi-agent") problem: that is, there is likely one primary decision-maker which dictates the construction task ordering, likely computed via a partial-order multi-body planner. That's part 1 of the AI.

But there's another part that's equally interesting. The multi-body planner produces a series of construction steps. Each step is ordered with regard to certain steps, unordered with regard to other steps (these can be done in any order but not simultaneously), and explicitly declared parallel with yet other steps (they can be done simultaneously). The quad-roters grab the steps and perform them in parallel when possible, and at least form a queue otherwise. Last, the quad-rotors have to perform these steps without hitting one another, so there's a significant real-time multi-body path-planning problem involved.

Multi-body planning, scheduling, and plan monitoring is nontrivial and should not be so lightly dismissed.

andrewcooke3• 16 years ago

thank-you! (i'm sorry for "dismissing" the work; i do understand the amount of effort involved, but i was trying to emphasize what was not happening; thanks for the extra info on the unordered work, etc).

sliverstorm2• 16 years ago

Hey, you can't have emergent properties before you have foundation properties. Can't build a building with magical emergent properties if you don't first figure out how to make a bot that can lift the beams.

ph0rque• 16 years ago

This tech would have a great application in robotic fruit-picking/pruning applications.

d5tryr• 16 years ago

I've been cleaning up after a flood disaster for the past few days, the most amazing technology i've seen in that time is the bobcats and their drivers. It takes 10-15 people a few hours to empty a house of all it's waterlogged belongings on to the street, and then 15 minutes for the bobcat to get it up on the back of a truck. When I see a tech demo like this I'm very optimistic about it's potential for disaster relief, where simple structures, shelters, and platforms would be of great benefit.

netcan• 16 years ago

Brisbane?

grimatongueworm• 16 years ago

36 battery changes later...

ctdonath• 16 years ago

Quite. Total energy expenditure?

burgerbrain3• 16 years ago

No problem. These things can do precision landing so there's no reason they couldn't juice themselves back up in shifts.

shaunfs2• 16 years ago

Inductive charger landing pads, a must have. Let them build forever. Just make sure the pads are plugged into a neighbors outlet ... or their Chevy Volt.

http://translogic.aolautos.com/2011/01/06/ces-2011-gm-brings...

hanula• 16 years ago

"...May Build Your Next House". Yea, right. All in all it's designed to kill people in the end.

jaekwon• 16 years ago

Next I want these drones to make hexagonal structures and feed off of flower polen.

soamv• 16 years ago

The power limitation doesn't seem very difficult to surmount, a drone could just go swap its dead battery with one from a pool of batteries on chargers, and keep working.

They'd need two batteries in a drone to do that of course, or perhaps some other robot could execute the battery swap.

stretchwithme• 16 years ago

Robotic construction will eventually take over the construction industry. Especially once robotic transportation becomes possible.

There are many complex processes being performed at construction sites. Many steps take highly optimized machines to perform robotically but that a single human can do just by changing tools.

Because of these processes, automating the entire construction process would be very expensive to do right at the site.

All parts would have be modularized so they could be snapped together. Or robots will have to be able to change tools. Or parts will have to be moved from robot to robot, with as much work being done before parts are actually brought to the site.

Either way, it will be interesting to see how it works out.

shaunfs2• 16 years ago

This is awesome! It's sort of like a less precise large-scale 3D printer or MineCraft. I'm sure I'm not the only person who thinks this is certainly the beginning of automated construction. It works for assembly lines. We may finally be getting to the point where the same process will work in more mobile volatile environments.

Watch a swarm of flying robotic drones construct a tiny building

Related Stories