HN user
Co-founder of Aiven cloud database service, see https://aiven.io/
I believe you're referring to our January 2020 Kafka incident where a logic bug caused data loss for a customer. It was a serious failure and a huge learning moment for us.
The platform we operate today is fundamentally different and far more resilient than it was five years ago. We've scaled significantly (recently passing $100M ARR) because we took those early lessons seriously and continue to prioritize reliability.
Noticed this as we at Aiven https://aiven.io also love crabs
My blog post from this March describes how we (founding team of 4 programmers) got started with Aiven:
https://aiven.io/blog/building-aiven-from-zero-to-usd800m-a-...
Cool! Congrats everyone @ Grafana Labs!
Aiven | Site Reliability Engineers & Leaders | Toronto, Berlin, Sydney | https://aiven.io/careers
Aiven is a series B startup with hundreds of customers creating fully managed cloud services from the best open source data technologies (e.g. Apache Kafka, Cassandra, PostgreSQL.)
Our cloud services allow clients to focus on building awesome applications instead of worrying about data infrastructure management. All our services are based on open source technologies and we're active open source contributors.
We're now looking for new SREs for our offices in Helsinki, Berlin and Sydney and a SRE leader to work on building a new SRE team in Toronto.
See https://aiven.io/careers for more information.
Aiven | Developer Advocates, Site Reliability Engineers, Support Engineers | Helsinki, Boston, Berlin, Sydney | ONSITE | https://aiven.io/careers
Aiven is a rapidly growing, well funded startup creating fully managed cloud services from the best open source data technologies (e.g. Apache Kafka, Cassandra, PostgreSQL.)
Our cloud services allow our clients to focus on building awesome applications instead of worrying about data infrastructure management. All our services are based on open source technologies and we're active open source contributors.
We're headquartered in Helsinki, Finland and also have offices in Berlin, Boston and Sydney. We're now looking for new team members for engineering and go-to-market positions.
See https://aiven.io/careers for more information.
Aiven | Site Reliability Engineers, Support Engineers, Solutions Architects | Helsinki, Boston, Berlin, Sydney | ONSITE | https://aiven.io/careers
Aiven is a rapidly growing, well funded startup creating fully managed cloud services from the best open source data technologies (e.g. Apache Kafka, Cassandra, PostgreSQL.)
Our cloud services allow our clients to focus on building awesome applications instead of worrying about data infrastructure management. All our services are based on open source technologies and we're active open source contributors.
We're headquartered in Helsinki, Finland and also have offices in Berlin, Boston and Sydney. We're now looking for new team members for engineering and go-to-market positions.
See https://aiven.io/careers for more information.
From the post:
"*With try free promotion for Confluent Cloud, receive up to $50 USD off your bill each calendar month for the first three months. New signups only. Offer ends December 31, 2019."
Free trial for a managed Kafka service in the cloud has been available from various other vendors including us (https://aiven.io) for a while.
Aiven | Site Reliability Engineers, Customer Success Engineers, Developer Advocates | Helsinki, Boston, Berlin, Sydney | ONSITE / REMOTE | https://aiven.io/careers
Aiven is a rapidly growing series A startup creating fully managed cloud services from the best open source database and event streaming technologies (e.g. Apache Kafka, Cassandra, PostgreSQL.)
Our cloud services allow our clients to focus on building awesome applications instead of worrying about data infrastructure management. All our services are based on open source technologies and we're active open source contributors.
We're headquartered in Helsinki, Finland and can help you relocate here, but we also have employees in other cities across European Union, United States and Australia and welcome remote applications. We're now looking for new team members for site reliability engineering, customer success and developer advocacy.
See https://aiven.io/careers for more information on our open positions.
Aiven | Site Reliability Engineers, Customer Success Engineers, Developer advocates | Helsinki / Boston | ONSITE / REMOTE | https://aiven.io/careers Aiven is a cloud technology startup creating fully managed cloud services from the best open source database and event streaming technologies.
Our cloud services allow our clients to focus on building awesome applications instead of worrying about data infrastructure management. All our services are based on the best open source technologies, and we're also active open source contributors.
We're headquartered in Helsinki, Finland and can help you relocate here, but we also have employees in other cities across European Union and United States and welcome remote applications. We're now looking for new team members to work on site reliability engineering, customer success and developer advocacy.
https://thehub.fi/jobs/company/aiven lists more of our open positions. Please note that while the site lists the positions in Helsinki, many of them are also available for remote employees in other locations across EU and US.
Integration into GCP console sounds interesting, but a cloud-native Apache Kafka service has already been available for more than three years with enterprise SLAs, elasticity and access to an ecosystem of Kafka & other open source tooling.
Our managed Kafka service has no artificial limits to throughput as shown in a recent blog post comparing price & performance across different clouds: https://aiven.io/blog/benchmarking-kafka-write-throughput-pe...
FWIW, Aiven PostgreSQL (http://aiven.io/postgresql) runs latest PG versions and is available in HIPAA compliant configurations on AWS and GCP. We don't charge extra for it, but have a minimum monthly commitment to justify the small setup overhead.
The "copy from program" feature allows executing a program by design, and is pretty self documenting at that.
There are various other ways you can access the system outside PG once you're a superuser which is why most hosted PG providers (like us) don't allow superuser access.
Will the same amount of cores result in the same tps? No.
I gave a talk on this subject at PostgresConf NYC a couple weeks ago, my slides are here: https://postgresconf.org/conferences/2019/program/proposals/...
I'll follow up with a blog post in the near future.
I don't think "keft join" is the same as "left join".
"select * from table1 keft join table2 using (somecol)" is an inner join of table1 and table2, but table1 is assigned the alias "keft", because "AS" between table and its alias is optional.
Aiven | Site Reliability Engineers, Customer Success Engineers, Developer advocates | Helsinki / Boston | REMOTE | https://aiven.io/careers
Aiven is a cloud technology startup creating fully managed cloud services from the best open source database and event streaming technologies.
Our cloud services allow our clients to focus on building awesome applications instead of worrying about data infrastructure management. All our services are based on the best open source technologies, and we're also active open source contributors.
We're headquartered in Helsinki, Finland and can help you relocate here, but we also have employees in other cities across European Union and United States and welcome remote applications. We're now looking for new team members to work on site reliability engineering, customer success and developer advocacy.
https://thehub.fi/jobs/company/aiven lists more of our open positions. Please note that while the site lists the positions in Helsinki, many of them are also available for remote employees in other locations across EU and US.
Feature sets of all the recent backup and restore systems are becoming more and more alike, but when we started working on PGHoard there were no good options that were built to efficiently utilize different cloud object stores (S3 + GCS, Azure, Swift, etc.)
Our original announcement of PGHoard at https://aiven.io/blog/postgresql-cloud-backups-with-pghoard/ lists some of the reasons we had for building a new system from scratch.
Nowadays there are many good options for handling basebackups and WAL, and one of the largest remaining issues is the lack of parallel WAL apply in PostgreSQL itself, which limits restore throughput quite severely.
One of the PGHoard authors will be talking about PostgreSQL backups in the cloud in a couple of weeks in PostgresConf NYC: https://postgresconf.org/conferences/2019/program/proposals/...
FWIW, PGHoard (https://github.com/aiven/pghoard/) is another PostgreSQL backup daemon that works with S3, GCS, Azure and Swift.
Implementing a SFTP backend using e.g. paramiko in PGHoard should be pretty simple.
I'm not sure of Sweden, but here in neighbouring Finland it's pretty quick and easy to get a visa if you have a job with a local technology company. Our applications have been processed in 2-4 weeks after completing the online application.
You can find startup jobs in Nordics from e.g. https://thehub.fi (Finland) or https://thehub.se (Sweden)
Not sure if this comment was about the data corruption bug in Cloud SQL's PostgreSQL version, but the benchmarks we ran at https://aiven.io/blog/postgresql-cloud-performance/ used Aiven's PostgreSQL service on top of VMs from the cloud infrastructure providers and weren't affected by Cloud SQL issues.
The same Linux, PostgreSQL, etc versions were used on all platforms. We didn't use RDS, CloudSQL or other managed services from the infrastructure providers, but the PDF version of the presentation does include comparison of our managed PostgreSQL service with RDS PG and Aurora PG if you're interested.
Unfortunately we were not able to offer a concrete workaround in this case, but as mentioned to the author of the post, we were and are in contact with our friends at Timescale to resolve this, and an update with the fix will be available in Aiven shortly.
We are not the upstream for any of the engines running in Aiven, so we work with the upstream developers and communities to resolve any issues found. Often our involvement in fixing the issues is through providing logs, stack traces and other debugging information to the original authors of the code, but in some cases we also fix the issues ourselves and always contribute such fixes back upstream, see e.g. this commit for a PostgreSQL bug that was found by our customers and fixed by us: https://github.com/postgres/postgres/commit/07ef035129586ca2...
This is Oskari from Aiven - wanted to mention that we posted a brief blog post about the licensing changes in the Kafka ecosystem at https://aiven.io/blog/aiven-statement-on-kafka-license/
The summary is that we're committed to open source software and this change won't affect our users. We'll follow-up with a more details about our plans in early January.
We've just added support for the new region in our Aiven DBaaS platform. You can launch managed Kafka, Cassandra, PostgreSQL & other clusters in AWS Stockholm at https://aiven.io/
Our services utilize T3, M5, R5 and I3 instance types, so we offer e.g. 4GB RAM PostgreSQL service which isn't available in RDS, but right now we don't have instances smaller than that in AWS.
We've just added GCP Finland to our Aiven database service so you can have managed Kafka, Cassandra, PostgreSQL etc clusters up and running in a few minutes in the new region https://aiven.io/blog/google-cloud-now-over-finland/
Kafka allows clean decoupling of event producing and consuming logic unlike typical message queues. Your clients can keep pushing new messages to Kafka's persistent logs without having to know who and what will process those messages.
This makes it possible to easily update your event processing logic or add new components to the mix while maintaining a clean architecture.
I gave a talk about this at PostgresConf US a few weeks ago, the talk's not yet available as an article, but you can get the slides from https://aiven.io/blog/aiven-talks-in-postgresconf-us-2018/ if you're interested.
The post and linked slides focus on comparing different clouds, but the slides actually have a couple of comparisons of AWS Aurora, RDS and Aiven PostgreSQL performance at the end.
We'll update that with other managed services soon.
We compared PostgreSQL performance on virtual machines from 5 different cloud providers a while back, the results are on our blog at https://aiven.io/blog/postgresql-cloud-performance/ and show that there's quite a bit of variance between them.
TimescaleDB is now available as a part of Aiven PostgreSQL version 10. Aiven PostgreSQL is a fully-managed & hosted PostgreSQL service available in all AWS, Google Cloud, Microsoft Azure, DigitalOcean and UpCloud regions: https://aiven.io/postgresql
We compare PostgreSQL 10 performance in two regions for all five IAAS providers with a couple of VM sizes. Local NVMe SSDs are also compared to network disks in AWS and GCP.