Google Cloud Spanner is now half the cost of Amazon DynamoDB

https://cloud.google.com/blog/products/databases/announcing-cloud-spanner-price-performance-updates

311 362 3 years ago

cloud.google.com

mmanfrin• 3 years ago

Google also has a history of massively spiking the cost of its services. Vendor lockin is a dangerous thing.

xnx2• 3 years ago

This definitely happened with Google Maps, where Google was clearly the dominant player. Has it happened to other services? It seems far less likely to happen for business cloud services where they are a distance 2nd (3rd?) to AWS. I know of some examples (admittedly ancient) where they have reduced costs: https://cloudplatform.googleblog.com/2015/05/Pay-Less-Comput...

callalex2• 3 years ago

Before they offered Google cloud, they offered Google App Engine. After they introduced Google Cloud they got bored of App Engine and 10x’d the price. This was particularly painful because App Engine was a batteries-included solution with heavy vendor lock-in.

acdha2• 3 years ago

The last year has had multiple GCP cost increases:

https://cloud.google.com/storage/pricing-announce

https://cloud.google.com/blog/products/infrastructure/update...

https://cloud.google.com/blog/products/data-analytics/introd...

https://cloud.google.com/compute/pricing-announce

https://cloud.google.com/vpc/pricing-announce

logicchains• 3 years ago

Has it happened to other services?

BigQuery initially was a lot more powerful, then they started adding a bunch of resource limits on queries that you could only overcome by paying up. Not a direct fee increase, rather you paid the same fee for a worse product.

Tehnix• 3 years ago

Curious: have they ever increased prices of existing Google Cloud services?

As far as I know, AWS only ever decreases prices on services for example

jefftk• 3 years ago

AWS has increased prices, most recently when they started charging for static IPs (even ones attached to a running instance).

tpmx3• 3 years ago

GCP has seen price increases:

https://techcrunch.com/2022/03/14/inflation-is-real-google-c...

Discussion: https://news.ycombinator.com/item?id=30671997

rlpb2• 3 years ago

"Coders howl over Google's App Engine price hike (natch)" https://www.theregister.com/2011/09/02/google_app_engine_use...

I don't know if Google App Engine falls under Google Cloud services, but either way that's just a technicality; the sentiment remains the same.

Edit: more information here: https://github.com/stickfigure/blog/wiki/The-Unofficial-Goog...

bbu• 3 years ago

yes, massively over the last ~12 months. https://cloud.google.com/storage/pricing-announce

tessela• 3 years ago

BigQuery had a 25% price increase in July/23: https://cloud.google.com/blog/products/data-analytics/introd...

Freedom2• 3 years ago

Is there any evidence of vendor lock-in actually being a widespread issue?

holografix2• 3 years ago

Source?

andrewedstrom• 3 years ago

Not pictured: the cost of switching to DynamoDB when this service inevitably gets shut down in two years.

vlovich1233• 3 years ago

There’s no way spanner gets shut down. It’s critical to so much of Google’s internal infra.

johncessna• 3 years ago

That doesn't address GCP itself getting shut down in 2 years.

jeffbee4• 3 years ago

Engaging with comments that are this stupid only perpetuates the problem. Just look at this thread as a whole.

klodolph3• 3 years ago

I get the skepticism, but these core SaaS offerings tend to have a much longer support life than consumer products. Google’s Bigtable is still around as a cloud offering, and it’s almost 20 years old at this point.

Spanner is used for a lot of internal Google services, too. Spanner has basically been eating all the other databases Google uses internally. Nom nom nom, every database that used to be something else is now Spanner.

callalex2• 3 years ago

Remember AppEngine?

grogenaut2• 3 years ago

if they're cutting the price they are likely worried about the product... are they going to cancel it like every other product they've released?

nickstinemates• 3 years ago

They didn't cut the price. They increased performance and are claiming half price to a similar workload on Amazon. Titles a little disingenuous.

spullara• 3 years ago

Without an on-demand version of spanner that doesn't charge per node but per operation makes it not comparable to dynamodb for many use cases.

joshuanapoli• 3 years ago

Exactly: I have to provision for peak throughput on Spanner. Average throughput is much lower than the peak throughput, so I'm doubtful of seeing savings no Spanner.

(But I bet that Spanner is much easier than DynamoDB to develop with...)

rkeene22• 3 years ago

You can scale Spanner up/down based on demand although there is a lag time with it.

I built a system that relies on a high-performance database and tested with both AWS DynamoDB and Google Cloud Spanner (see disclaimer) and was able to scale Google Cloud Spanner much higher than AWS DynamoDB.

DynamoDB is limited to 1000 WRUs per node, and there isn't an obvious way to get more than 100 nodes per table, so you're limited to 100,000 WRUs per table (= 102400000 bytes/sec = 97 MiB/sec = 776 Mib/sec) -- even if you reserve more than 100,000 WRUs in capacity for the table. The obvious workaround would be to shard the data across multiple tables, but that would have made the software more difficult to use.

Google Cloud Spanner was able to do much more than 97 MiB/sec in traffic (though the exact amount isn't yet public), and also was capable of much larger transactions (100 MiB versus DynamoDB's 25 (now it is 100) items * 400KiB of ~10 MiB) which was a bonus.

Disclaimer: The work was funded by a former Google CEO and I worked with the Google Spanner team on setting it up, while I am a former AWS employee I didn't work with AWS on the DynamoDB part of it, though I did normal quota adjustments.

benmanns• 3 years ago

I wish I could play around with Spanner for personal/side projects, but a production ready instance starts at $65/mo. DynamoDB can run for ~$0.00/month with per-request pricing.

meowtimemania5• 3 years ago

This is the main reason I like DynamoDB. I can run side projects indefinitely for basically $0/month.

iends3• 3 years ago

Same as with lambda. I have a side project that costs $0.42/mo to run.

GabeWeiss_15• 3 years ago

You can! Spanner has a free trial: https://cloud.google.com/spanner/docs/free-trial-instance. Keep in mind, that per-request pricing isn't free unless you stay under the free tier. So just take a look at what those limits are because going above them means you're not free anymore.

michellegienow2• 3 years ago

if you are interested in spanner, you might take a look at cockroachdb. esp the production ready serverless offering which is pay for consumption only. crdb architecture is essentially spanner under the bonnet, GIFFE

https://www.cockroachlabs.com/get-started-cockroachdb/

brianolson2• 3 years ago

"as little as $65 USD/month" for GCP Spanner

vs AWS Free Tier:

"25 GB of data storage ... 2.5 million stream read requests ..."

https://aws.amazon.com/dynamodb/pricing/

So, there's probably somewhere the lines on the graph cross, but Google's headline seems misleading.

hdjjhhvvhga• 3 years ago

The Free Tier is completely irrelevant here, though. The very reason someone might use Spanner is its excellent scalability. I don't believe there is any reason to use it for smaller projects other than education. The customers who will use Spanners are those for whom CockroachDB is not enough, for example. For everybody with databases that are not that huge PostgreSQL will do just fine.

Vt71fcAqt72• 3 years ago

Very true, but most people do not yet no about scale-to-zero pay-for-what-you-use sql server clouds with a free tier like CockroachDB and neon. They think that you must pay $5 a month to run a sql server, which has been the case until very recently, so they go with no sql options to get the free tier.

Edit: actualy Spanner looks like another CockroachDB. You use sql to interact with it. In which case I can see many people who would want to use this with a free tier for hobby projects. ie. in between education and production development.

chx• 3 years ago

For everybody with databases that are not that huge PostgreSQL will do just fine.

Ha. Remember Gary Bernhardt of WAT fame? https://twitter.com/garybernhardt/status/600783770925420546

Consulting service: you bring your big data problems to me, I say "your data set fits in RAM", you pay me $10,000 for saving you $500,000.

ajross• 3 years ago

That seems nitpicky. The free tier is a marketing program, not a product.

"Google should offer intro discounts" is IMHO a very valid point (absolutely no idea why this doesn't exist), but it doesn't really speak to whether or not the real product is more or less expensive.

avereveard• 3 years ago

it's a bit different because the free tier for dynamodb is not like the other 12 month limited offer, it's marketed as free forever, so it's not just an intro product, it's something you can run a small business off for free.

catch22l5• 3 years ago

oh cmon. this is just 50 QPS. i mean yea obviously for someone having as little as 50QPS is not going to bother with the massive scale and availability in cloud spanner. there are a TON of applications today reaching 100M+ users in just a month. you are not dealing with 50QPS. oh and you forgot the crazy byte boundaries in DynamoDB. if you go over a single byte above 1kb, you are charged 2 Read units !

TheTaO• 3 years ago

That headline is half truth. Price of a cloud database depends on so many things. what is the I/O, what is the storage utilization, cross-region traffic, etc. Picking one scenario and claiming the cost to be half is too simplistic and a marketing gimmick.

idunno2462• 3 years ago

Also which dynamo price are they comparing to? On demand? Provisioned? Reserved provisioned? We had a huge spanner db with low throughput so had to add idle nodes just for storage which also ballooned costs for spanner(the increased storage size here helps)

nameless91212• 3 years ago

And for many projects, Postgres is still cheaper than both. Having used both, I would much, much rather do the work to fit my project in Postgres/CockroachDB than use either Spanner or DynamoDB, which have WAY more footguns. Not to mention sudden cost spikes, vendor lock in, and god knows what else.

AWS and GCP (and Azure, and Oracle cloud, and bare Kubernetes via an operator, and...) support Postgres really well. Just...use Postgres.

teaearlgraycold• 3 years ago

Postgres is the database God himself would have made.

nameless91212• 3 years ago

Like, I don't want to fanboy, but it's _hard_ to find a use case that postgres can't handle at small to medium (i.e. 90% of projects) scale.

hot_gril6• 3 years ago

It's the best, but it's far from perfect. Default mode is non-ACID, and going `serializable` mode makes it very slow. Spanner is always ACID... but always slow.

paxys• 3 years ago

Postgres is a piece of software. Cloud Spanner/Dynamo etc are managed services. It makes no sense to directly compare one with the other.

esafak• 3 years ago

Read "Cloud SQL for PostgreSQL"

nameless91212• 3 years ago

AWS and GCP (and Azure, and Oracle cloud, and bare Kubernetes via an operator, and...) support Postgres really well.

I think they're directly comparable with this context.

hatsix• 3 years ago

Sure, You can compare Cloud SQL vs Cloud Spanner and RDS vs Dynamo, but it makes more sense to just say "Postgres" and assume that the reader can figure out that it means "Whatever managed postgres service you want to use".

The entire point is that every cloud provider has a managed postgres offering, and there's no vendor lock-in. Though, technically, Dynamo does have a docker image you could run in other cloud providers if it came down to that, you'd get no support for it.

aketchum2• 3 years ago

just migrated off of PG to ddb as the main db for my application (still copying data to SQL for data analytics). Working with distributed functions and code hosted on lambdas, the connection management to SQL became a nightmare with dropped requests all over the place.

nameless91212• 3 years ago

A connection pooling proxy should fix this shouldn't it? I think both Google and AWS have this solved for functions as a service.

jpgvm2• 3 years ago

Sacrificing a real DB to use serverless is exactly why serverless makes zero sense.

emodendroket2• 3 years ago

I mean sure, NoSQL gives you more opportunities to screw stuff up because it's doing less for you. But it can be a reasonable tradeoff in some scenarios anyway

alisonkisk• 3 years ago

Spanner and Postgres both support both SQL and NoSQL

bananapub8• 3 years ago

And for many projects, Postgres is still cheaper than both.

ok? and sqlite3 in memory is even cheaper than postgres!

if you can use (and support correctly) postgres then you should use it, obviously there's no point using a globally scalable P-level database if you can just fit all your data on one machine with posthgres.

airstrike3• 3 years ago

Except for projects for which NoSQL is a better fit than a RDBMS, no?

If I'm writing a chat app with millions of messages and very little in the way of "relationships", should I use Postgres or some flavor of NoSQL? Honest question.

silisili2• 3 years ago

I've found it's pretty easy to massage data either way, depending on your preference. The one I'm working on now ultimately went from postgres, to mysql, to dynamo, the latter mainly for cost reasons.

You do have to think about how to model the data in each system, but there are very few cases IMO where one is strictly 'better.'

jpgvm2• 3 years ago

Golden Rule of data: Use PostgreSQL unless you have an extremely good reason not to.

PostgreSQL is extremely good at append-mostly data, i.e like a chat log and has powerful partitioning features that allow you to keep said chat logs for quite some time (with some caveats) while keeping queries fast.

Generally speaking though PostgreSQL has powerful features for pretty much every workload, hence the Golden Rule.

BoorishBears2• 3 years ago

This is going to feel like a non-answer: but if you need to ask this question in this format, save yourself some great pain and use Postgres or MongoDB, doesn't really matter which, just something known and simple.

Normally you'd make a decision like this by figuring out what your peak demand is going to look like, what your latency requirements are, how distributed are the parties, how are you handling attachments, what social graph features will you offer, what's acceptable for message dropping, what is historical retention going to look like...[continues for 10 pages]

But if you don't have anything like that, just use something simple and ergonomic, and focus on getting your first few users. There's a long gap between when the simple choice will stop scaling and those first few users.

ruuda• 3 years ago

Postgres; the schema is still structured. But even if you want something less rigid, Postgres has a jsonb type and great operators for querying json.

toast0• 3 years ago

Either way can work. Getting to millions of messages is going to be the hard part, not storing them.

As with all data storage, the question is usually how do you want to access that data. I don't have experience with Postgres, but a lot of (older) experience with MySQL, and MySQL makes a pretty reasonable key-value storage engine, so I'd expect Postgres to do ok at that too.

I'm a big fan of pushing the messages to the clients, so the server is only holding messages in transit. Each client won't typically have millions of messages or even close, so you have freedom to store things how you want there, and the servers have more of a queue per user than a database --- but you can use a RDBMS as a queue if you want, especially if you have more important things to work on.

Olreich2• 3 years ago

Postgres. NoSQL databases are specialized databases. They are best-in-class at some things, but generally that specialization came at great cost to their other options. DynamoDB is an amazing key-value store, but is severely limited at everything else. Elasticsearch is an amazing for search and analytics, but is severely limited at everything else. Other specialized databases that are SQL-full are also great at what they do, like Spark is a columnar database that has amazing capabilities for massive datasets where you need lots of cross-joins, but that severely limits it's ability to act in a lot of roles, because they traded latency for throughput and horizontal scalability, and you're restricted in what you can do with it.

The super-power of Postgres is that it supports everything. It's a best-in-class relational database, but it's also a decent key-value store, it's a decent full-text search engine, it's a decent vector database, it's a decent analytics engine. So if there's a chance you want to do something else, Postgres can act as a one-stop-shop and doesn't suck at anything but horizontal scaling. With partitioning improving, you can deal with that pretty well.

If you're writing fresh, there is basically no reason not to use Postgres to start with. It's only when you already know your scale won't work with Postgres that you should reach for a specialized database. And if you think you know because of published wisdom, I'd recommend you set up your own little benchmark, generate the volume of data you want to support, and then query it with Postgres and see if that is fast enough for you. It probably will be.

loxias2• 3 years ago

Millions is tiny. Toy even. (I work on what could be called a NoSQL database, unfortunately "NoSQL" is a term without specificity. There's many different ways to be a non-relational database!)

My advise to you is to use Postgresql or, heck, don't over think it, sqlite if it helps you get a MVP done sooner. Do NOT prematurely optimize your architecture. Whatever choice results in you spending less time thinking about this now is the right choice.

In the unlikely event you someday have to deal with billions of messages and scaling problems, a great problem to have, there are people like me who are eager to help in exchange for money.

Lots of people like to throw around the term "big data" just like lots of people incorrectly think that just because google or amazon need XYZ solution that they too need XYZ solution. Lots of people are wrong.

If there exists a motherboard that money can buy, where your entire dataset fits in RAM, it's not "big data".

sosodev• 3 years ago

Seems to me like there are still plenty of relationships in a chat app. Postgres can be used like a NoSQL database via JSONB too if you want.

I think the truth is that you should use the simplest, most effective tech possible until you are absolutely certain you need something more niche.

jopsen• 3 years ago

If I'm writing a chat app with millions of messages...

Once you have millions of messages, maybe consider moving the data intensive parts out if postgres, if necessary.

The criticism is often that people look for big data solutions, before they have big data.

If you scale out of postgres, you probably have enough users and money that you can fix it :)

But moving to a NoSQL before you have to, might just slow down development velocity -- also you haven't yet learned what patterns users have.

remus2• 3 years ago

I know the spanner marketing blurb says you can scale down etc. But I think in practice spanner is primarily aimed at use cases where you'd struggle to fit everything in a single postgres instance.

Having said that I guess I broadly agree with your comment. It seems like a lot of people like to plan for massive scale while they have a handful of actual users.

nameless91212• 3 years ago

I said this in another comment, but I have seen _two_ applications in my career that actually had a request load that might warrant something like one of these databases. One was an application with double digit million MAU and thousands of RPS on a very shardable data set, which fit Spanner's ideal access pattern and performance profile pretty well, but we paid an absolute arm and a leg for the privilege and ended up implementing a distributed cache in front of Spanner to reduce costs. The other just kept the data set in memory and flushed to disk/S3 backup periodically because in that case liveness was more important than completeness.

In the first case, the database created as many problems as it solved (which is true of any large application running at scale; your data store will _always_ be suboptimal). A fancy, expensive NoSQL database won't save you from solving hard engineering problems. At smaller scales (on the order of tens-hundreds of RPS), it's hard to go wrong with any established SQL (or open source NoSQL if that floats your boat) database, and IMO Postgres is the most stable and best bang for your engineering buck feature wise.

hot_gril6• 3 years ago

My team bought the "scale down" thing and got bit.

Using Spanner is giving up a lot for the scalability, and if you ever reach the scale where a single node DB doesn't make sense anymore, I don't know if Spanner is still the answer, let alone Spanner with your old design still intact. For one, Postgres has scaling options like Citus. Or maybe you don't need a scalable DB even at scale, cause you shard at a higher layer instead.

0xbadcafebee7• 3 years ago

Postgres and Spanner do different things, in different ways, with different costs, risks, and implications. You could "just use" anything that is completely different and slightly cheaper. You could use a GitHub repository and just store your records as commits, for free, that's plenty cheap and works for small projects. But not really the same thing, is it?

nameless91212• 3 years ago

My point is that I've seen very, very few situations (I can think of two in my entire career so far) where a "hyperscale NoSQL database" was actually the right choice to solve the problem. I find that a lot of folks turn to these databases for imagined scale needs, not actual hard problems that need solving.

supportengineer2• 3 years ago

Is there any company that hosts Postgres in the cloud (and does nothing else) and has great customer service?

LVB• 3 years ago

I've only kicked the tires, but https://neon.tech is a pure hosted Postgres play. I'd be curious to hear if anyone has used them for a real projects, and how that went.

M3t0r• 3 years ago

Give https://aiven.io/ a try. But know that I'm biased ;-)

Also https://www.postgresql.org/support/professional_hosting/

folmar2• 3 years ago

Elephantsql, I can't say much for the customer service as I never had any trouble.

GabeWeiss_15• 3 years ago

But that's kind of a moot point. I mean, if you're even looking at the likes of DynamoDB or Spanner, it's because you need the scale of those engines. PostgreSQL is fantastic, and even working for Google, I 100% agree with you. Just use PG...until you can't. Once you're in the realm of Spanner and DynamoDB, that's where this discussion becomes more of a thing.

silisili2• 3 years ago

Not necessarily true. DynamoDB on demand pricing is actually way cheaper than RDS or EC2 based anything for small workloads, especially when you want it replicated.

agonz2532• 3 years ago

It's not purely a matter of cost, right? Say you want or need a highly available, high performance distributed database with externally consistent semantics. Are you going to handle the sharding of your Postgres data yourself? What replication system will you use for each shard? How will you ensure strong consistency? Will you be able to do transactions across shards? These are problems that systems like Spanner, CockroachDB, etc solve for you.

YetAnotherNick2• 3 years ago

Just curious, why would distributed be design requirement? Is individual machine failure likely in AWS/GCP? The only failure I have seen in region level issues which spanner or dynamo don't help with AFAIK.

brianolson2• 3 years ago

but as always: Are you sure your data doesn't fit in PostgreSQL? You should probably try PostgreSQL first.

bananapub8• 3 years ago

that really should be the first heuristic for almost any systems design problem - if you can afford to buy a big enough pair of machines to fit your data in hot-swap postgres then just do that.

don't bother with mongo or mysql or dynamo or cassandra or bigtable or spanner or ... until your lack of profitability or size means you can't afford to just use postgres.

meowtimemania5• 3 years ago

What do you mean "can't afford to just use postgres"? I thought postgres cost per query in many cases is cheaper than competitors.

hot_gril6• 3 years ago

The more I deal with scalable relational DBMSes (Spanner in particular), the more I doubt their usefulness even at large scale. Relational + fully-consistent are always at odds with scalability. It seems like either you have a classic NoSQL use case and use that, or you shard at the application level rather than in the database.

Could someone share a use case where you truly benefited migrating from Postgres/MySQL to Spanner/Citus/Cockroach, and there was no better solution? I'd like my hunch to be wrong.

doyouevensunbro• 3 years ago

I wonder what the costs are compared to Aurora. I haven't been on AWS for a while but loved the service when I was.

TedDoesntTalk• 3 years ago

…until it’s canceled

aa_is_op• 3 years ago

But twice as complex to use, though.

That GCP interface is cancer. You need a Google-to-English dictionary to understand it.

icedchai2• 3 years ago

AWS is really no better. Both consoles are a mess in their own ways. CLIs are really what matters, though. In general, I have found the GCP command line (“gcloud”) easier to work with.

GabeWeiss_15• 3 years ago

Tell me more (bonus points if you find me on LinkedIn or other social because tracking comment responses on HN is really rough). I'd love feedback you have so I can bring it back to the product team!

dastbe2• 3 years ago

where’s the worked examples, forrestbrazeal

baridbelmedar• 3 years ago

I'm really excited about this as a customer. We're probably going to be able to save a lot of money because of it. So now, with the new Postgres compatibility layer and the "lower cost", it will be easier for me to choose Spanner when we start new projects.

GabeWeiss_15• 3 years ago

Really glad to hear! Please find me on social media or LinkedIn and let me know how it goes for you using the PG layer. I'd love to hear more feedback.

guluarte• 3 years ago

99% of the projects dont need dynamodb/spanner/ScyllaDB

theshrike79• 3 years ago

DynamoDB has a free tier. I've been running a semi-active app wholly on the free tier for a good 3-4 years now. Lambda is free too.

I think the only thing I pay for is API Gateway, and that's around $2 a month max.

meowtimemania5• 3 years ago

Have you considered doing CloudFront --> Lambda Function URL? Would that lower your costs?

PeterCorless• 3 years ago

DynamoDB and ScyllaDB are very different use cases than Spanner.

• Spanner is more in the domain of CockroachDB — distributed strong consistency and ACID compliance. Both are ANSI SQL.

• DynamoDB and ScyllaDB are in the NoSQL key-value store / wide column domain. ScyllaDB is API compatible with DynamoDB, but is also API compatible with Cassandra Query Language (CQL). These databases are for eventual consistency use cases.

As to the "99%" comment, there are over 415 databases currently tracked on DB-engines.com (https://db-engines.com/en/ranking). It is a very competitive and specialized industry. Very few databases have more than 1% marketshare these days.

According to this: https://6sense.com/tech/relational-databases

...only the top 9 options show >1% of marketshare.

MySQL being so far in the lead (42%) is far more likely due to it being baked into so many OEM deals (over 2,000 as per https://www.mysql.com/oem/). Like, every WordPress site in the world than anything else.

Yet that doesn't really make MySQL great for every use cases. It has obvious limitations.

We also have to note that different studies have far different results.

In this video: https://statisticsanddata.org/data/the-most-popular-database...

It shows a different set of top databases, and has 11 of them showing >2% of marketshare. It has MySQL at only 13.91% of marketshare, with Oracle being on top at 31.19%.

The source of this poll is TOPDB Top Database index:

https://pypl.github.io/DB.html

It's not based on money marketshare, nor on poll results, but simply is counting how often a database is searched on Google. Note that anything that could garner 1% of the market would suddenly catapult that database into the top 16th place on the list.

At the end of the day, database "market share" — however it is calculated — is not representative of exclusive percentages. Many companies run more than 1 type of database. There might even be multiple SQL and NoSQL databases, each designed for purpose, at large enterprises. OLTP, OLAP. I would not be surprisedi in the least to learn that large corporations had well over 100 different databases running at any given time.

So, back to your basic comment: if a database is useful for even 1% of the use cases, that would still place it in the top 20 databases in the industry.

Moreover, a lowest-common denominator database will not be able to support many critical use cases where you really do need a specialized data model, or index type, or query language, or workload type, or latency, or distribution, or scale of QPS/TPS/OPS, or total data size or query payload size, etc.

I have likened the database industry to the state of Christianity after the Reformation. Even if there are still plenty of "Catholics" (classic SQL adherent, like Oracle), there are also Reformed faiths ("NewSQL" / "Distributed SQL", e.g., PostgreSQL), plus any number of Protestant reformation alternatives (NoSQL). I'm not sure what the "Orthodox" in this analogy refers to. Maybe SQL data warehouses? The schism between OLTP and OLAP? Dunno.

Anyway, it's an analogy. Bound to break down at some point.

At the end of the day, my advice: use the database most closely aligned to the dataset and workload and use case you have at hand. Don't just throw something at a problem because it's a popular choice, or because it's the database you happen to be most familiar with.

lijok3• 3 years ago

Except dynamodb is easier to set up and use than pretty much any other db out there

JohnMakin• 3 years ago

Cool, too bad I can't rely on Google suddenly deprecating this service.

remus2• 3 years ago

An internal version has been used within Google since ~2012 and the GCP version has been available since 2017. It's used extensively within Google. It's not going to be deprecated any time soon.

jiggawatts4• 3 years ago

Narrator: it was turned off in 2025.

revel• 3 years ago

This thread is already a damning indictment of google cloud. Price cuts alone won't attract customers -- google has sustained significant reputational damage with their crappy customer service and support. That's hard to fix

clumsysmurf• 3 years ago

I've been doing Android development since 1.0, many Android developers are unhappy with the abusive "relationship" they have with Google, because of their control over the Play Store, your developer account, and resolving things if they come up. I'd pick any non-Google tech if there was an alternative.

airstrike3• 3 years ago

Are iOS developers happy with Apple's control over the App Store, their developer account, and resolving things if they come up?

kubb2• 3 years ago

Yes, but also every 3 out of 4 people here have applied to work for Google, and most got rejected, so that can contribute to the negative sentiment.

Spanner is a pretty solid database, it checks all the boxes: consistency, geographic replication and transactional updates are not present at the same time in most large scale db's out there.

joshe2• 3 years ago

A problem for me building on this is that Google Cloud has no coherent strategy. So the price could easily be double or quadruple Amazon in 2 years.

Google Maps is the key lesson here. 10 to 20 times price increase, just because someone had a meeting. No justification or coherent strategy, just "sorry here's a shiv to the gut".

At least with Amazon, as chaotic as it is, you know that they just mark stuff up to the margin they want and let the market sort out what gets used. Google is into secretive grand strategy that changes completely anytime 4 product managers get together in a room.

heliodor• 3 years ago

This! Google has shown many times they can't be trusted.

catch22l5• 3 years ago

such a biased comment. do you think AWS is sitting on 2012 prices ?

emodendroket2• 3 years ago

Yegge had an article saying that Google had really good tools to clean up uses of deprecated calls and the like and this had made them way too cavalier about breaking changes. Can't vouch for it but an interesting dynamic.

vlovich1233• 3 years ago

I mean, a common joke among ICs at Google is that the API or service you're calling is deprecated but the replacement system isn't ready yet. They have good tools, but the cavalierness about breaking changes would be more because teams can just say "not supported" anymore for internal APIs and services, a more thorough test suite, & really principled rollout strategies to catch issues before they get too big.

brycelarkin• 3 years ago

Not true anymore after AWS’s ipv4 pricing announcement.

sandrob57• 3 years ago

Oof, thanks for reminding me about the Google Maps pricing increase.

It was very difficult to understand their thought process, and we were pretty much forced to find alternative services that had a more reasonable pricing structure. The amount they wanted to charge us for a few million geocode requests per month was bananas.

Was there really no value in keeping a customer like us around at a more reasonable rate?

idunno2462• 3 years ago

The gcs change last year was also terrible, such an expensive increase

joshe2• 3 years ago

Yes! Saw that and was relieved I have nothing on them :-)

tregoning• 3 years ago

It's surprising how Google have shot themselves in the foot with their short term thinking. Nobody trust them for anything that involves long term support on any new services/products(and several already existing products).

goeldhru2• 3 years ago

If only someone could actually run and publish comparison benchmarks, but DeWitt clause by Spanner makes it impossible.

debatem1• 3 years ago

Can you go into more detail on this? I assumed almost everyone using systems like this that tout scalability was doing benchmarks.

goeldhru2• 3 years ago

Benchmarks vary quite a bit based on specific workloads. That is why open benchmarking helps where any person can validate the benchmarks. Google enforces De-Witt clause which makes it impossible for a third party to publish such benchmarks. Quite a few cloud providers don't restrict that now.

re• 3 years ago

Found the term: https://cloud.google.com/terms/service-terms

7. Benchmarking. Customer may conduct benchmark tests of the Services (each a "Test"). Customer may only publicly disclose the results of such Tests if (a) the public disclosure includes all necessary information to replicate the Tests, and (b) Customer allows Google to conduct benchmark tests of Customer's publicly available products or services and publicly disclose the results of such tests. Notwithstanding the foregoing, Customer may not do either of the following on behalf of a hyperscale public cloud provider without Google's prior written consent: (i) conduct (directly or through a third party) any Test or (ii) disclose the results of any such Test.

It looks like that is less restrictive than it used to be. I found a blog post from last year mentioning an additional requirement to obtain Google's prior written consent prior to publishing (for all customers, not just fellow cloud providers) which no longer is included. https://cube.dev/blog/dewitt-clause-or-can-you-benchmark-a-d...

0cf8612b2e1e• 3 years ago

Capitalism at work yet again. Which requires informed consumers. Obvious response is to keep users in the dark.

GabeWeiss_15• 3 years ago

The DeWitt clause is only there to prevent badly written performance data from getting attention it shouldn't. If anyone writes a good benchmark (good process, not good results, necessarily) to bring to us, our product teams absolutely will consider it.

ris• 3 years ago

One of the main reasons I'm uneasy about cloud databases is the sheer absurdity of trying to meaningfully compare offerings and their value for money.

FredPret4• 3 years ago

But a droplet with a Postgres db is nearly free, and seriously performant.

And for 65/month, you can get a VERY beefy Hetzner server.

You’ll have to wade through the crazy thicket that is the menu of cloud offerings.

I gave that one look, and decided I might as well give up and learn the basics of Linux admin once and apply it for life.

klodolph3• 3 years ago

Yeah. I think the whole point of Spanner is to handle larger, larger, larger workloads and databases, and if you can fit everything on a single server, you definitely should.

Comparing Postgres to Spanner is kind of like comparing a delivery van to a train. The train is always going to have higher overhead costs.

Linux admin is a useful skill, but I know my Linux admin skills can’t compete with the reliability, availability, and scalability of cloud systems… like Dynamo, S3, Spanner, etc.

0xbadcafebee7• 3 years ago

Or you could use DynamoDB for basically free. One month of 1GB of storage, 1kb item size, 100,000 writes, and 100,000 reads, would be $0.39 on DynamoDB on-demand. A million writes and reads respectively would be $1.63. Strongly consistent reads'd make that $1.75, and transactional writes would make it $3.00

FredPret4• 3 years ago

I get it but I feel like it isn't really mine, and learning this new db/console/product/vendor that won't be around in 10-20-30 years is a waste of very limited time.

Linux admin + hosting a server = my data, on my terms, until I keel over, and possibly long after that.

HDThoreaun• 3 years ago

Why use dynamo for so few reads?

rurp• 3 years ago

decided I might as well give up and learn the basics of Linux admin once and apply it for life.

Yeah I think this raises an underappreciated drawback of working on heavily AWS/GCP native projects. So much of the time ends up being spent on service level config and troubleshooting that has little relevance elsewhere.

daft_pink• 3 years ago

Does anyone believe it will stay this way for long?

makestuff4• 3 years ago

I will say pretty crazy spanner is doing 20x the RPS at peak. I thought 126m from dynamoDB was insane, but 2b RPS is just a whole different world

gregdoesit3• 3 years ago

“ According to the Amazon Prime Day blog post, DynamoDB processes 126 million queries per second at peak. Spanner on the other hand processes 3 billion queries per second at peak, which is more than 20x higher, and has more than 12 exabytes of data under management.”

This comparison seems to be not exactly fair? Amazon’s 126 million queries per second was purely for Amazon-related services serving Prime Day generating this on DynamoDB, and not all of AWS is my read.

What would have perhaps been a more fair comparison is to share the peak load that Google services running Cloud Spanner, and not the sum of all Spanner services across all of GCP and all of Google (Spanner on non-GCP infra).

I will say that it would show a massive of confidence to say that Photos, Gmail and Ads heavily rely on GCP infra: which would be brand new information for me! It would add to confidence to learn more on how they use it, and if Cloud Spanner is on the critical path for those services.

What is confusing, however, is how in this article "Cloud Spanner" is consistently used... except for when talking about Gmail, Ads and Photos, where it's stated that "Spanner" is used by these products, not "Cloud Spanner!". Like if they were not using the Cloud Spanner infra, but their own. It would help to know what is the case, and what the load of Cloud Spanner is: and not Spanner running on internal Google infra that is not GCP.

At Amazon, practically every service is built on top of AWS - a proper vote of confidence! - and my impression was that GCP had historically been far less utilised by Google for their own services. Even in this post, I'm still confused and unable to tell if those Google products listed use Cloud Spanner or their own infra running Spanner.

forrestbrazeal• 3 years ago

We shared some details about Gmail's migration to Spanner in this year's developer keynote at Google Cloud Next [0] - to my knowledge, the first time that story has been publicly talked about.

[0] https://www.youtube.com/watch?v=268jdNwH6AM

gregdoesit3• 3 years ago

I tried to find it in this video, but failed. Could you please share a time stamp on where to look?

It’s a pretty big deal if Gmail migrated to GCP-provided Spanner(not to an internal Spanner instance) and sounds like he kind of vote of confidence GCP and Cloud Spanner could benefit from: might I suggest to write about it? It’s easier to digest and harder to miss than an hour-long keynote video with no time stamps.

And so just to confirm: Gmail is on Cloud Spanner for the backend?

Vt71fcAqt72• 3 years ago

Thanks! Looks really interesting.

link with time-stamp:

https://www.youtube.com/watch?v=268jdNwH6AM?&t=3020

vxNsr2• 3 years ago

Somehow I thought you were at Amazon/AWS because of how much you push it in your book. Cool to see you’re at GCP.

jeffbee4• 3 years ago

Wow, almost content-free presentation! How obnoxious!

This wasn't the first time Gmail has replaced the storage backend in-flight. The last time, around 2011, they didn't hype it up, they called it "a storage software update" in public comms. And that other migration is the origin of the term "spannacle", because during that migration the accounts that resisted moving from [[redacted]] to [[redacted]] we called barnacles.

dmoy2• 3 years ago

I will say that it does show a vote of confidence to say that Photos, Gmail and Ads use GCP infra,

I'm not sure? I guess I'm mostly not sure what "gcp infra" means there. The blog post says

"Spanner is used ubiquitously inside of Google, supporting services such as; Ads, Gmail and Photos."

But there's google-internal spanner, and gcp spanner. A service using spanner at Google isn't necessarily using gcp. (No clue about photos, Gmail, etc)

Granted, from what I gather, there's a lot more similarity between spanner & gcp spanner than e.g. borg and kubernetes.

gregdoesit3• 3 years ago

Surely in a post about Google Cloud Spanner, all examples mentioned use Google Cloud Spanner? It would be moot listing them as examples if they would not: so my assumption is they are all using GCP infra already for Spanner.

I really want to give Google the benefit of the doubt: but it doesn't help that they did not write that eg Gmail is using "Cloud Spanner." They wrote that it uses Spanner.

bananapub8• 3 years ago

borg and k8s are completely unrelated bits of software with roughly similar goals.

gcp spanner and normal spanner are different deployments of the same code.

GabeWeiss_15• 3 years ago

Infra and Cloud Spanner are the same stack. Having those services run on infra is more about the legacy of tooling to shift it rather than anything around performance or ability to handle it.

Rapzid2• 3 years ago

Frankly it's a bit weird to see this kind of dick measuring in a product blog post from the "Director of Engineering" :/

ripper11382• 3 years ago

True and even worse, inaccurate dick measuring.

cbarrick• 3 years ago

s/the "Director of Engineering"/a "Director of Engineering"/

There are many engineering directors at Google.

brunoborges• 3 years ago

What would have perhaps been a more fair comparison is to share the peak load that Google services running on GCP generated on Spanner, and not the sum of their cloud platform.

Not necessarily about volume of transactions, but this is similar to one of my pet-peeves with statements that use aggregated numbers of compute power.

"Our system has great performance, dealing 5 billion requests per second" means nothing if you don't break down how many RPS per instance of compute unit (e.g. CPU).

Scales of performance are relative, and on a distributed architecture, most systems can scale just by throwing more compute power.

hangonhn• 3 years ago

Yeah I've seen some pretty sneaky candidates try that on their resumes. They aggregate the RPS for all the instances of their services even though they don't share any dependencies nor infrastructure. They're just independent instances/clusters running the same code. When I dug into those impressive numbers and asked about how they managed coordination/consensus the truth comes out.

BoorishBears2• 3 years ago

Put yourself in the shoes of who they're targeting with that.

Probably dealing with thousands of requests per seconds, but wants to say they're building something that can scale to billions of requests per second to justify their choices, so there they go.

GabeWeiss_15• 3 years ago

True, but one would hope that both sides in this case would be putting their best foot forward. Getting peak performance out of right sizing your DB is part of that discussion. I can't imagine AWS would put down "126 million QPS" if they COULD have provided a larger instance that could deliver "200 million QPS", right? We have to assume at some point that both sides are putting their best foot forward given the service.

tedivm2• 3 years ago

From the AWS blog post they referenced-

DynamoDB powers multiple high-traffic Amazon properties and systems including Alexa, the Amazon.com sites, and all Amazon fulfillment centers. Over the course of Prime Day, these sources made trillions of calls to the DynamoDB API. DynamoDB maintained high availability while delivering single-digit millisecond responses and peaking at 126 million requests per second.

Amazon was very, very clear on this. For Google to use that number without the caveat is just completely underhanded and dishonest. Whoever wrote this is absolutely lacking in integrity.

mk89• 3 years ago

They very well know that people don't read sh* anymore. Just throw numbers there, PowerPoint them and offer an "unbiased" comparison where Google shines - buy Google.

Worst case scenario, it's Google you're buying, not a random startup etc.

ljm• 3 years ago

I used DynamoDB as part of the job a few years ago and never got single-millisecond responses - it was 20ms minimum and 70+ on a cold-start, but I can accept that optimising Dynamo's various indexes is a largely opaque process. We had to add on hacks like setting the request timeout to 5ms and keeping the cluster warm by submitting a no-op query every 500ms to keep it even remotely stable. We couldn't even use DAX because the Ruby client didn't support it. At the start we only had a couple of thousand rows in the table so it would have legit been faster to scan the entire table and do the rest in memory. Postgres did it in 5ms.

If Amazon said they didn't use DAX that day I would say they were lying.

The average consumer or startup is not going to squeeze out the performance of Dynamo that AWS is claiming that they have achieved.

In fact, it might have been fairer in Ruby if they didn't hard-code the net client (Net/HTTP). I imagine performance could have been boosted by injecting an alternative.

GabeWeiss_15• 3 years ago

Just as a hand in the air...Be careful about what you're comparing here. # of API calls over a period of time is...largely irrelevant in the face of QPS. I can happily write a DDOS script that massively bombards a service, but if that halts my QPS then it doesn't matter. So sure, trillions of API calls were made (still impressive in the scope of the overall network of services, I'm not downplaying that), but ultimately, for DynamoDB and Spanner, it's the QPS that mattered to us in terms of comparisons of DB scaling and performance.

tw04• 3 years ago

This comparison seems to be not exactly fair? Amazon’s 126 million queries per second was purely for Amazon-related services serving Prime Day generating this on DynamoDB, and not all of AWS is my read.

There's no indication that google is talking about ALL of spanner either? The examples they list are all internal google services, and they specifically say "inside google".

I'm also dubious that even with all of the AWS usage accounted for that DynamoDB tops Spanner if Amazon themselves are only at 126 million queries per second on Prime Day.

g9yuayon3• 3 years ago

At Amazon, practically every service is built on top of AWS - a proper vote of confidence!

Not only this, but practically most, if not all, of the AWS services use DynamoDB, including use cases that are usually not for databases, such as multi-tenant job queues (just search "Database as a Queue" to get the sentiment). In fact, it is really really hard to use any relational DB in AWS. I mean, a team would have to go through a CEO approval to get exceptions, which says a lot about the robustness of DDB.

sharpy• 3 years ago

When I was at AWS, towards later part of my tenure, DynamoDB was mandated for control plane. To be fair, it worked, and worked well, but there were times when I wished I could use something else instead.

tacozilla• 3 years ago

Eh, this isn't accurate. Both Redshift and Aurora/RDS are used heavily by a lot of teams internally. If you're talking specifically about the primary data store for live applications, NoSQL was definitely recommended/pushed much harder than SQL, but it by no means required CEO approval to not use DDB

Edit: It's possible you're limiting your statement specifically to AWS teams, which would make it more accurate, but I read the use of "Amazon" in the quote you were replying to as including things like retail as well, etc.

jjtheblunt2• 3 years ago

At Amazon, practically every service is built on top of AWS

is that true finally? It sure wasn't in the 2020-2021 timeframe.

dastbe2• 3 years ago

it does depend on what you mean. By 2020/2021, effectively everything was on top of AWS VMs/VPC and perhaps LBs at that point? Most if not all new services were being built in NAWS.

szesiongteo• 3 years ago

Well, the thing with Google is whenever their service does not get enough users to reach their target revenue then they can suddenly shutdown in the following year. This is the reason why I would always go with AWS or Azure and GCP the last choice.

frankfrank13• 3 years ago

one of the best parts of DynamoDB are all of the patterns others have figured out (e.g https://www.dynamodbbook.com/), I'm not aware of the equivalent for GCP Spanner (besides an O'Reilly book I've never read)

supportengineer2• 3 years ago

How’s the customer service experience?

genmud• 3 years ago

That's a trick question, since there isn't any customer service.

ChicagoDave• 3 years ago

These are not the same data store solutions. Document stores like DynamoDB have a specific operational Write Model purpose whereas an RDBMS is better suited to analytics and reporting.

dchest• 3 years ago

"Organizations of all sizes and across all industries are increasingly looking to accelerate digital transformation and power AI-driven innovation."

How did Google become like this?

layer8• 3 years ago

Money.

kccqzy2• 3 years ago

The new leadership under Cloud that chases buzzwords.

holografix2• 3 years ago

By hiring VMWare, Dell and Oracle people

who-le-o• 3 years ago

Chances are you're not the audience and some exec is

Havoc• 3 years ago

All corporate-y? By becoming a big corporation

jdmg94• 3 years ago

They removed that line about not being evil

michellegienow2• 3 years ago

^^^ this

oars• 3 years ago

Google Cloud's current CEO spent 22 years at Oracle before taking this role.

hot_gril6• 3 years ago

Cloud services rely a ton on marketing, B2B relations, and customer support. Google has never exactly been about that stuff, and GCP was suffering. So they pulled in Oracle, MSFT, etc execs, which lame as that sounds was probably the right move for GCP in particular.

And I guess this is the kind of marketing that attracts the customers they want.

bambax• 3 years ago

DynamoDB is such a good name though; "Cloud Spanner" doesn't tell me anything about what this does...

naet• 3 years ago

I'm torn because I have really liked Google offerings in the past (I'm pretty locked in on gmail, I have different things running on GCP already, etc). But I've also been feeling burned a bit by Google suddenly ending services. I had all my domains happily in Google domains until they recently sold it suddenly to Squarespace, who I'm not interested in dealing with. My phone is a Google Pixel and I was using the Google podcast app, but just heard that too is being discontinued and moved to Youtube Music, which is a service I tried and really disliked, so now I need to find a replacement for that too. I didn't personally use some other services, but I know there have been many others ended (such as Stadia for gaming, which made a lot of press at the time).

Those are more minor services in the long run, but it makes me a little nervous to go in again on Google for a critical service. Before I invest my time and effort into using it I have to ask myself "Will Google someday sell off or end the cloud spanner service? Will I be in trouble if they do so?".

btown2• 3 years ago

As someone in the midst of transitioning an organization to GKE, Google Domains was the first shutdown that truly frightened me - AFAIK the first true B2B IT offering that was unceremoniously shuttered. Domain registration may be a regulatory/reputational minefield - but then so are many of their other cloud offerings, up to and including content distribution. I don't think it's indicative of a larger pattern of shutting down Google Cloud services yet, but it's certainly a yellow flag at least.

lijok3• 3 years ago

Oh you are in for a surprise

https://steve-yegge.medium.com/dear-google-cloud-your-deprec...

victor1062• 3 years ago

But I've also been feeling burned a bit by Google suddenly ending services.

The products/services that “Google” the search company launches are different than “Google Cloud”. While the discontinuation of Google products is annoying it has nothing to do with Google Cloud products/services. I don’t think Google Cloud abruptly announces discontinuing products/services as they have paid customers.

Regarding Google Domains that is a Google product. The equivalent product from Google is “Google Cloud Domains” which is available to Google Cloud customers.

5kg• 3 years ago

Regarding Google Domains that is a Google product. The equivalent product from Google is “Google Cloud Domains” which is available to Google Cloud customers.

Also sold: https://cloud.google.com/domains/docs/faq

dminor• 3 years ago

The domains from Google Cloud Domains are also going to squarespace

tyree731• 3 years ago

Jamboard had paying customers, and they discontinued that on short notice, so paying only gets you so far.

surgical_fire• 3 years ago

Stadia also had paid customers

BizarreByte• 3 years ago

At the end of the day this comes down to more than cost. I trust AWS to be a stable, long term foundation to build a product on, I don't trust GCP to be the same.

catch22l5• 3 years ago

why ?

cdelsolar2• 3 years ago

There is no problem PostgreSQL can't solve unless the problem involves massively distributed global databases that need to be incredibly fast and in sync with each other, and even then I think Slony can help.

hintymad2• 3 years ago

Does Google Cloud Spanner use the Spanner database per the 2013 paper? Or does Google simply use the brand and implement a cheaper and more performant db under the hood? I suspect it is the latter because most companies do not need global consistency anyway, so it may make sense to relax parts of what Spanner was originally built for.

smueller1234• 3 years ago

Yes, it's the same Spanner that's used internally. But obviously it's progressed hugely since 2013.

GabeWeiss_15• 3 years ago

More specifically, infra and cloud Spanner are the same stack. So they've progressed together hugely since 2013. :) The real differences between the two are more about the internal tooling we (Google) have around infra that's built up with our other services that consume it over the years that aren't relevant to anyone other than Google.

hintymad2• 3 years ago

Amazing. And thanks for clarification

vicpara2• 3 years ago

Just moved our infra from GCP to AWS. Kubernetes clusters, LB, storage, lambdas, KMS and all of it.

Google runs their tech stack as if it's a startup that builds their CV. Everything is immature, tons of hacks, undocumented features. If you are on their k8s there are tons of upcoming new versions and features that force you to revisit key hacks you put in your infra because of their misgivings. Our infra team keeps tinkering around our infra and it never ends. It's 50:50. 50% of time making sure we are prepared for their shit and 50 % our ambitious infra plans. Good luck with that.

With AWS our bill is 60% of what GCP used to be running 3 k8s clusters.

AWS support is so nice, you can't believe it.

Nah, I don't trust Google with anything. It's a scam. Google's support is horrendous. They refer you to idiots that drag you through calls until your will for life dies. And you're back to the mercy of some lost engineer that may comment on a github issue you opened 20 days ago. We have a bug reported back in 2020 that got closed recently without any action because it became stale and the API changed so much it doesn't really matter. It's that bad.

The billing day is a monthly reminder you're paying entitled devs to do subpar work other companies do a lot better.

No, we don't miss them already.

g9yuayon3• 3 years ago

AWS support is so nice, you can't believe it.

This reminds me of the fond days of having weekly customers calls. We develop AWS services, and we answer our customer-support calls directly. No middle man. Just techies to techies. And we made promises to customers on the fly, and customers sometimes project managed us.

kubb2• 3 years ago

Sounds like hell...

pirsquare• 3 years ago

AWS support is so nice, you can't believe it.

This! They even custom-coded their support portal better than those off-the-shelf vendor like Zendesk. I say this as a Zendesk paying customer.

GCP on the other hand, is a F-tier in support. Almost feel like I need to beg them to get any level of help.

mrtksn• 3 years ago

A GCP issue was the only time I had a human contact with Google, they did well. However high scale low touch is in their DNA and you can tell it.

cameronh90• 3 years ago

At one point, Google reached out to me to try and tempt us over from AWS. I had bad experiences with Google support in the past, but liked their AI stuff and was keen to give them another go.

We booked a follow up call in the calendar, I spent good time preparing my notes and requirements for the meeting... and then nobody on their side showed up or contacted me again.

Cthulhu_2• 3 years ago

Wouldn't Zendesk be one of those software things that has had too many features bolted on without oversight and/or a unified philosophy behind it?

I'm of the opinion that focused products created by smaller teams are better.

vismwasm• 3 years ago

I generally like GCP, however their sales and customer support just aren't any good. And some services like Vertex AI are extremely buggy while it's hard to actually report these bugs.

I think Google Cloud needs someone like Jeff Bezos as their head: Look what your customers actually want and need and understand their requirements. And they usually want good customer support and want a competent key account manager as well.

When we were looking to migrate our analytics database from on-premise to a cloud alternative we were looking at BigQuery and Snowflake. BigQuery is a great product and we were already deeply invested in GCP as well. However the GCP sales team just couldn't sell BigQuery - they just don't know what old corporations want to hear in a sales pitch. So we went with Snowflake in the end. Not because it's the better product but because their sales team is better.

I'm not sure if the cloud business is actually a priority at Google. If it is then I think they don't understand the mistrust Google is facing when it comes to stable long term support of their products.

ExoticPearTree• 3 years ago

Support wise, GCP is a joke run by entitled people. I had an issue some time ago with a VPN and after doing a lot of troubleshooting and having them agree the problem is on their end (packets would go in their VPN Gateway from the VPC, nothing would come out), the solution was to update my configuration on my end to workaround whatever they did because "it is how is going to be"...

TL;DR: they broke something and wouldn't fix it.

pojzon• 3 years ago

Doesnt help when GKEngine has constant issues and recent upgrade feature is on 10 days strike.

Recently was woken up by alert about DNS resolution issues.

GCP rolled out new version of SkyDNS and NodeLocalDNS, SkyDNS reports 99% miss, had to quickly hack it.

This is not the „out-of-the-box” experience you want to have.

sabellito• 3 years ago

Doing business with Google is a liability.

wiremine• 3 years ago

Much of the time GCP feels like a science project, and not a real business. AWS (and Azure) seem to be driven by customer requests, instead of Google, which feels very engineering-centric.

Which is on brand with Google. They have no problem launching stuff, and no problem killing stuff. But man, then just get out of the cloud business and focus on what you're good at.

dijit2• 3 years ago

Interesting, if you swap GCP and AWS in your post then thats exactly my experience.

I wonder what makes us different, I work in europe on video games; AWS’s handling of me when I was at Ubisoft left a really sour taste - when I moved into Tencent/Sharkmob I tried really hard to love AWS as it was the defacto industry standard and instead I was left with a feeling that most of it is inconsistent garbage papered over with lambda functions. I referred to these weird gotchas as “3am topics”; things that I don't have the mental capacity to deal with at 3am and convinced the studio to switch to GCP- which, incidentally they are still extremely grateful to me for doing.

cjaybo• 3 years ago

I was left with a feeling that most of it is inconsistent garbage papered over with lambda functions

This sounds more like an indictment of the system design than the cloud provider.

What are some of these “3am” topics that made GCP a better choice?

YetAnotherNick2• 3 years ago

Matches my experience. GCP has many better services than AWS but I am not going to run production workload with them after 2 years of experience in previous company. There are so many undocumented quirks that many times you could find better solution from some random person in stackoverflow than highest tier paid support.

acdha2• 3 years ago

That was my experience, too - a couple of things which were better than AWS but this constant stream of paper cuts hitting all of the problems which weren’t cool enough to get someone promoted.

falcolas• 3 years ago

We have an old "quiet part out loud" corporate story. It's about how one arm of Google using our service and wondering why it had so much downtime, only for us to point at their GAE arm and say "when they're down, we're down". They went and talked to GAE and - funny enough - were able to correlate the downtime they observed with GAE downtime.

GAE uptime improved, for a little while. Yeah, we're on AWS now too.

nerpderp82• 3 years ago

Does Google run on GCP?

mardifoufs• 3 years ago

I don't know. I like GCP. I have been in an Azure centric corporation for close to two years now and I dearly miss GCP almost every day.

My team has a sort of a sandbox where we can use almost any Azure product we want (our IT is supportive and permissive as far as that sandbox goes, which is a blessing), but even then it's just painful in comparison.

AWS is probably better though.

hot_gril6• 3 years ago

Azure seems like a nightmare, regardless of whether GCP or AWS is better.

doesnt_know• 3 years ago

AWS support is so nice, you can't believe it.

It's actually sort of ridiculous. AWS has the best support I have ever interacted with. I mean, our org certainly pays enough for it but it's so completely unusual in tech, or really any sector to get great support even when you're paying for it.

stouset• 3 years ago

Every time I run into an issue I’m reluctant to reach out to AWS support, because of my default expectation that it will be a terrible waste of time.

Every time, I am also proven wrong as someone competent on their side both actually understands my issue and finds a resolution.

insanitybit• 3 years ago

The horror stories of Google support, across all of their products, is enough for me to never trust GCP. Even if someone told me today "GCP is the exception, they have great support" I probably wouldn't care - they are so organizationally incapable of providing good support that, even if they did so today, I wouldn't believe that it could last.

softveda• 3 years ago

I worked in a Digital team 4 years back where the team was building voice channel apps for our customers on both Amazon Alexa and Google Dialogflow. Alexa NLP engine was less sophisticated we had to give it hundreds of prompts and intents. Dialogflow NLP engine required a handful of prompts for the same thing. But when it came to integration with backend APIs and support Alexa was far ahead. Despite having Dialogflow enterprise Google support would suggest to ask in StackOverflow. Amazon support on the other hand was excellent. We needed support for mTLS with the backend APIs, Amazon supported it as they understood enterprise. Google just shooed us away, their support wouldn’t even escalate this.

traceroute66• 3 years ago

We have a bug reported back in 2020 that got closed recently without any action because it became stale

One of my pet hates is the (ab)use by repo maintainers of the auto-close-when-stale feature on Github.

What useful purpose does it serve beyond making the repo maintainers look good because they have a low number of open issues ?

It doesn't actually address the issue. Its the virtual equivalent of brushing under the carpet.

DevKoala• 3 years ago

My experience too, GCP is frustrating. However, there is nothing like BigQuery to me, I love that DB.

sparc24• 3 years ago

It's amazing how people complain about GCP. We run a massive deployment across 100+ regions cross-cloud GCP, Azure, AWS and oh boy. GCP has good support if you are big enough. Azure though which has a much bigger share than GCP is horrendous. Absolutely garbage all around. Good luck ever getting anyone in Engineering even if you are paying for support. AWS on the other hand - Amazing. We have Ent Support so those guys in our slack channel. The TAMs are amazing. Need to get hold of someone in Route53 no problem they are on the call this week. Feature request for EKS - ok talk to the Product Manager this afternoon.

Azure is a dumpster fire from the ground up.

CommanderData• 3 years ago

Can you give Azure specifics, as you know Azure has a massive offering.

My experience has been the opposite though not without issues, Azure has some of the best corporate and security features of any cloud and it's only getting better. The zero trust model fits in so nicely with their identity platforms it's a sight to behold compared to other cloud providers which likely use some form of AAD or AD DS anyway.

Their support is responsive and they seem to know what they're talking about. (AKS)

Please provide some specifics on your experience?

catch22p• 3 years ago

There is no way this is true. Only explanation is you work for AWS :-). GCP strength is it's cost. Yes may be the support could be better. But can you care to explain what "hacks" are you talking about ? And the claim that K8S(from Google) is better on AWS than GCP is absolutely false

vicpara2• 3 years ago

We are a small startup, 12 strong.

Our reason for going all in with GCP was the k8s. We've been using GCP for 2+ years. The trouble we have is with stability and so many of the features being constantly rolled out.

Our experience was that K8s cost more on GCP than AWS.

Just on LoadBalancers alone, you have tons of tricks that are specific to GCP implementation. And we needed a few extra because you couldn't run all the features we wanted on 1-2 per cluster. For example, we have a 3rd party that required all our requests to always originate and respond back from a fixed IP address. We could only pick one not a range, not a list. This was a hard requirement. The service was important so we had to do it.

It took our team several days to find how to do it using online documentation and support. Tech support was useless. We had one guy in our team that spent 2 days on the phone with a paid, local GCP implementation partner trying to get this problem sorted. Nothing came out of it other than being pitched on our dime a lot of services and architecture we didn't need. Eventually we figure it out on our own. I don't even remember speaking about this when we transitioned to AWS.

pyuser583• 3 years ago

Did you consider your own bare-metal?

CodeWriter232• 3 years ago

Meh. Why am I going to sign up for a service that is surely to be canceled on a Google Whim™?

chickenpotpie• 3 years ago

Spanner is probably the least likely thing to ever get cancelled at google by a long shot. It powers basically every single product at google and has been around for many years. I can't think of another Google product that has been around for so long and used internally and externally so heavily besides Gmail (which uses spanner).

CodeWriter232• 3 years ago

It will be deprecated some day.

RainbowFriends• 3 years ago

I have a personal GCP account with an average spend of $12/month over the last year or so. The past week, I've been bombarded with messages and phone calls from a GCP saleswoman trying to get me to spend more. These business practices reek of desperation.

RandyRanderson• 3 years ago

Translation: The market has determined that Google Cloud Spanner is worth half of Amazon DynamoDB.

topicseed• 3 years ago

Pricing per operation would make this an no-brainer for cases where DynamoDB and Spanner are considered good options.

dangoodmanUT2• 3 years ago

But you have to start by paying like $1k/mo, it's not serverless (at least the last time I checked). Get CRDB instead.

dangoodmanUT2• 3 years ago

Shame I don't trust GCP anymore

thedougd2• 3 years ago

I look forward to the AWS pricing reduction.

awnion• 3 years ago

Half an infinity is still an infinity

Google Cloud Spanner is now half the cost of Amazon DynamoDB

Related Stories