OnMetal Performance In Early Benchmarks

http://www.rackspace.com/blog/onmetal-shows-phenomenal-performance-in-early-benchmarks/

by jayofdoom • 12 years ago

64 38 12 years ago

cmsj6• 12 years ago

Still not seen a discussion of how they are dealing with the huge security nightmare of direct customer hardware access.

pfg• 12 years ago

Is this any different from your regular dedicated server provider? (Honest question, I don't know much about OpenStack.)

hyperliner3• 12 years ago

I am sure a regular dedicated server provider would take a long time to get you the server. Maybe days? Not sure.

I think their point is they provision a "dedicated" server in "minutes."

old-gregg3• 12 years ago

What makes you think it's "huge"? How do you think the dedicated hosting industry has been operating for more than a decade? You can re-flush the bios, you can secure-erase the storage, etc.

cmsj6• 12 years ago

Just because the dedicated server hosting industry hasn't been dealing with the problem, doesn't mean it's not there :)

If I flash the BIOS (or the network card firmware or the LOM device firmware or the disk controller firmware or the individual disk firmware, etc) with malicious firmware, it can lie to you when you try to reflash it later, leaving my malicious code running against later customers.

wmf2• 12 years ago

This was discussed at OpenStack Summit Atlanta: https://www.openstack.org/summit/openstack-summit-atlanta-20...

The main concern seems to be customers reflashing the firmware which they want to prevent with firmware signing.

cmsj6• 12 years ago

The question about that (at about 19:30 in the video) was asked by one of the Ironic developers on my team :)

The answer is basically "we don't do it, we'd like to see it happen". I wasn't at that session, but I was at the Atlanta Summit and so far I haven't managed to get a good answer from Rackspace people about how they're actually tackling this in production today.

abrahamrhoffman• 12 years ago

Wanna see if we can salt-call the servers to spin-up on demand. O_o

jayofdoom• 12 years ago

If it can do it for normal Rackspace Cloud instances, it can do it for OnMetal instances.

jderekw• 12 years ago

SoftLayer has been doing this since 2006 and also offers virtual compute instances as well. Can be purchased hourly or monthly

http://www.softlayer.com/bare-metal-servers

old-gregg3• 12 years ago

I've been SL customer and have using that prior to joining Rackspace and building OnMetal. The point isn't about "lets get rid of hypervisor", the point was to:

* Lets provision as quickly as VMs (as opposed to 1hr+ on SL)

* Lets engineer hardware to deliver maximum uptime via no-moving-parts design (as opposed to vanilla SuperMicro on SL)

* Lets design hardware to deliver maximum unit of work per dollar (like DB transactions/second per dollar, or requests/second/dollar) as opposed to average value elsewhere.

* Deriving from the above, lets just give RAM away nearly for free, and put dual 10Gig network in place, because modern apps should be mostly RAM-based.

* Lets adopt standard OpenStack provisioning API, with myriad of pre-existing tools, community and ecosystem (like auto-scaling, orchestration, etc) as opposed to proprietary API.

The end result is a completely different infrastructure, something akin to what OpenCompute pioneers use internally. This is how running at scale should be like.

As always, I encourage skeptics to spend more than 10 seconds on a product page, because most of the time there're humans behind it, and - in this case for sure - they are way too ambitious to be spending their lives simply cloning old designs.

Enjoy OnMetal, dear jberekw, it's built for critical thinkers (and skeptics! :-) like you and it's awesome - it's going to rock your world.

toomuchtodo• 12 years ago

* Lets provision as quickly as VMs (as opposed to 1hr+ on SL)

How many Rackspace customers need a full machine in under an hour?

* Lets engineer hardware to deliver maximum uptime via no-moving-parts design (as opposed to vanilla SuperMicro on SL)

So just replace spinning disk with SSDs. Unless you're replacing the last moving parts (CPU, PSU, Chassis Fans) with something solid state.

* Lets design hardware to deliver maximum unit of work per dollar (like DB transactions/second per dollar, or requests/second/dollar) as opposed to average value elsewhere.

This is fair for RAM intensive workloads. Everyone else is already giving you instance SSD access.

* Deriving from the above, lets just give RAM away nearly for free, and put dual 10Gig network in place, because modern apps should be mostly RAM-based.

Again, perfect for RAM intensive workloads.

* Lets adopt standard OpenStack provisioning API, with myriad of pre-existing tools, community and ecosystem (like auto-scaling, orchestration, etc) as opposed to proprietary API.

Also another fair point. OpenStack (and its open platform design) is all Rackspace has to compete against AWS and Google.

I don't want to say OnMetal is their "Hail Mary", but Rackspace is exploring their options in the marketplace with regards to an acquisition: http://www.bloomberg.com/news/2014-05-15/rackspace-hires-mor...

oasisbob• 12 years ago

The pricing (on the compute flavor especially) is appealing -- can certainly see uses for it.

Looking forward to OnMetal being available in other regions, especially ORD.

I'm one of the skeptics -- but that's because I've had very few problems with Rackspace cloud instance performance in general; rather, it's the control plane reliability which has caused 99% of the pain.

As an aside, I find the Cloud Servers SLA disappointing, as it defines control plane availability as 1 – (Total API Errors)/(Total Valid API Requests) . Can't launch instances on Super Bowl Sunday? Tough. The failed POSTs to /servers will never trigger a violation, so long as GET /servers is working:

http://www.rackspace.com/information/legal/cloud/sla

Most SLAs remedies are weak ("we break the SLA you get a free t-shirt"), but this one is broken to the point of glossing over fundamental outages.

snewman4• 12 years ago

I want to want this, but the pricing just doesn't seem competitive with EC2. Am I missing something?

For example, compare the "I/O" server with an EC2 i2.4xlarge instance. The Rackspace server has 128GB RAM, 3.2TB disk, and 20 cores; i2.4xlarge has 122GB, 3.2TB, and 16 -- nearly comparable.

On EC2, I can buy a 3-year Light Utilization Reserved Instance for $3884, and then pay $828/month (based on 720 hours per month). After 12 months, my average cost has been $1152/month. I still have two years left on my reservation, which I can keep using, or possibly sell, so the effective cost is even lower.

If I'm more certain of a 12-month server lifetime, I can buy a 1-year Heavy Utilization Reserved Instance for $7280, and then pay $447/month, for a total cost of $1054/month.

On Rackspace, list price is $1800/month. Suppose my total spend is $10,000/month (list price) and I commit to 12 months. I get a 15% discount, or $1530/month. That's quite a bit more expensive than EC2, and with EC2 I'm committing less up front. A longer commitment would help, but it would also bring down the EC2 price.

Can anyone poke holes in my analysis?

hyperliner3• 12 years ago

You are not too far off. I would use 730 hours = 365 * 24 / 12 instead of 720. You could add little (or not so little) things like the cost of IOPS, bandwidth differential, etc. You could add a little more for the core diffs. But all that won't close the gap.

Regardless, if you want the cheapest, I would go with Digital Ocean, though it is a different kind of hosting. For Rackspace, you really go when you need their support people and not just a server.

I hear a lot more developers this year going to DO than last year, but I have never used them though, trying to stick with the "devil I know."

snewman4• 12 years ago

Digital Ocean is interesting, but they don't really come out cheaper for large, continuous-duty instances. Their tiny servers look great, if you don't need much storage. But on the larger instances, it's a straight $1/GB/month for SSD. With some commitment, Rackspace is more like $0.50, and Amazon around $0.35.

Digital Ocean looks roughly comparable to Amazon for RAM, and slightly ahead on price-per-core (if you assume all cores are equal), but way behind on SSD. Again, this is assuming you want large instances and are going to run them 24/7 for at least 6 to 12 months -- otherwise, DO pricing starts to look a lot better.

adrr• 12 years ago

Whats the reasoning for using light utilization? Never seen it used in terms of cost saving strategy. Usually its medium vs heavy vs ondemand.

snewman4• 12 years ago

Light utilization reserved instances IMHO is the best-kept secret in EC2. You get most of the savings of heavy utilization, with much less up-front commitment. Look at my figures above: light utilization costs only $98/month more than heavy utilization, for $3396 less up front. And those figures were for a three-year light utilization reservation, meaning I'd still have an asset at the end of the 12 months.

FireBeyond2• 12 years ago

I can pick a few holes...

EC2 i2.4xlarge: you get 16vCPU, whereas that Rackspace gives you a DUAL 10 core Xeon E5, 40vCPU - it's 40 cores, not 20.

Memory is much of a muchness.

The drives are 2 1.6TB OCZ PCIe devices that can be RAID 0'ed if you choose, and each has 400,000 IOPS, up to 800,000 combined, whilst the EC2 instance tops out at about 155,000.

brendangregg• 12 years ago

SysBench is ok when used properly, but UnixBench?

They provide instructions on how you can patch and run it, using "./Run", but no warnings about what this is actually doing. See http://www.brendangregg.com/blog/2014-05-02/compilers-love-m... . I'd like to write a lot more about UnixBench, but I really don't have the time. It takes a lot of energy to refute this stuff.

If I were benchmarking OnMetal vs HW virt, I'd be showing a spectrum of micro-benchmarks, from equal performance (CPU) to network I/O. I'd expect some of my results to show a ~10x difference. You would then choose/weight them depending on what matters for your intended application.

mrinterweb• 12 years ago

The pricing of OnMetal appears relatively competitive if not on the expensive side. I think the best way to make the case that OnMetal is worth the premium is with a series of system benchmarks comparing their solution to comparably priced AWS instances.

ColinCera3• 12 years ago

As near as I can figure, the OnMetal servers are 3x-5x what I'd pay for dedicated servers from, say, a Hurricane reseller, and the virtual servers are more than 2x as much as comparable Linode servers, with the Linode servers offering way more SSD storage, more bandwidth, etc.

Not to mention, Rackspace charges you $120 per terabyte of data transfer, while you'll get several terabytes of transfer free/included when buying from Linode or most dedicated server resellers.

That seems like a hefty premium for...what? The Rackspace name? Is there any reason to believe that Rackspace has better uptime/reliability than Linode? Any reason to believe Rackspace has better hardware than Linode? Given that neither company — as with most cloud providers — provides any truly meaningful transparency, it's impossible to say.

For my money, I think I'd rather spend less of it, or spend the same amount and get more/redundant servers.

I'm genuinely struggling to understand the value of Rackspace.

quacker• 12 years ago

I'm genuinely struggling to understand the value of Rackspace.

See [1]: "We don't offer raw infrastructure without service." That is, support is included in the cost. Lots of people don't need support or don't want to pay for it, particularly the startup-oriented crowd here on HN. But I would be interested in a comparison of Rackspace's support to others'.

Rackspace charges you $120 per terabyte of data transfer

Is this in the fine print somewhere? I wouldn't be surprised, but I don't see it mentioned in [1].

1: http://www.rackspace.com/cloud/servers/onmetal/

ColinCera3• 12 years ago

Actually, I didn't notice that support was required. I was basing my cost comparisons on Rackspaces's "Raw Infrastructure" pricing — the fact you are required to purchase support at additional cost makes their pricing even less competitive.

They have a more detailed pricing page, with bandwidth charges listed near the bottom, here: http://www.rackspace.com/cloud/servers/

snowwrestler• 12 years ago

Earlier this month Rackspace switched away from offering any servers without managed support, even in their cloud. So every server or VM you get from Rackspace now will come with 24/7/365 support, including phone calls with engineers.

That's the main reason their stuff is more expensive than AWS, Linode, Digital Ocean, etc. They just decided that their competitive edge is support, so they aren't going to compete with those guys on price any more. This will probably lose them customers in startups, but improve their margins overall.

http://www.rackspace.com/blog/newsarticles/rackspace-goes-al...

tszming• 12 years ago

So is rackspace now giving up the virtualized cloud market? (Because I remember they didn't follow the recent price drop of Google/AWS/Azure?)

OnMetal Performance In Early Benchmarks

Related Stories