Hey HN, we recently released a new search implementation at Rollbar. It combines different kinds and scales of data across Clickhouse, MySQL and Elasticsearch. The results are that Rollbar's item search is now much faster and also supports many many more searches. Hope you find the technical details interesting - questions welcome.
HN user
brianr
Co-founder at Rollbar. https://rollbar.com
Drop me a line: brian@rollbar.com
http://twitter.com/brianrue
http://www.linkedin.com/in/brianrue
Rollbar | https://rollbar.com | Remote Europe, Budapest | Engineering
About Rollbar:
* We're a ~30-person team (SF, Budapest, remote US and Europe) with a mission to help developers build software quickly and painlessly
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our customers are some of the best engineering teams in the world, including Twilio and Shipt
* Our values are honesty, transparency, pragmatism, and dependability
* Our tech stack includes Python, Node.js, TypeScript, and React; MySQL, Kafka, ClickHouse, Elasticsearch, and Redis; Kubernetes, Terraform, and Google Cloud Platform.
We're currently hiring for:
- Senior Software Engineer, Full-stack (Europe)
Please apply via: https://rollbar.com/careers/
Rollbar | https://rollbar.com | Remote Europe, Budapest | Engineering
About Rollbar:
* We're a ~30-person team (SF, Budapest, remote US and Europe) with a mission to help developers build software quickly and painlessly
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our customers are some of the best engineering teams in the world, including Twilio and Shipt
* Our values are honesty, transparency, pragmatism, and dependability
* Our tech stack includes Python, Node.js, TypeScript, and React; MySQL, Kafka, ClickHouse, Elasticsearch, and Redis; Kubernetes, Terraform, and Google Cloud Platform.
We're currently hiring for:
- Senior Software Engineer, Full-stack (Europe)
Please apply via: https://rollbar.com/careers/
Rollbar | https://rollbar.com | Remote US, Remote Europe, Budapest | Engineering, Technical Solutions
About Rollbar:
* We're a ~30-person team (SF, Budapest, remote US and Europe) with a mission to help developers build software quickly and painlessly
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our customers are some of the best engineering teams in the world, including Twilio and Shipt
* Our values are honesty, transparency, pragmatism, and dependability
* Our tech stack includes Python, Node.js, TypeScript, and React; MySQL, Kafka, ClickHouse, Elasticsearch, and Redis; Kubernetes, Terraform, and Google Cloud Platform.
We're currently hiring for:
- Senior Software Engineer, Full-stack (Europe)
- Senior Software Engineer, Front-end (US)
- Product Solutions Architect (US)
Please apply via: https://rollbar.com/careers/
Fixed, thanks!
Rollbar | https://rollbar.com | Remote US, Remote Europe, Budapest | Engineering, Technical Solutions
About Rollbar:
* We're a ~30-person team (SF, Budapest, remote US and Europe) with a mission to help developers build software quickly and painlessly
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our customers are some of the best engineering teams in the world, including Twilio and Shipt
* Our values are honesty, transparency, pragmatism, and dependability
* Our Tech stack includes Python, Node.js, TypeScript, and React; MySQL, Kafka, Clickhouse, Elasticsearch, and Redis; Kubernetes, Terraform, and Google Cloud Platform.
We're currently hiring for:
- Senior Software Engineer, Full-stack (Europe)
- Senior Software Engineer, Front-end (US)
- Product Solutions Architect (US)
Please apply via: https://rollbar.com/careers/
Tech stack includes Python, Node.js, TypeScript, and React; MySQL, Kafka, Clickhouse, Elasticsearch, and Redis; Kubernetes, Terraform, and Google Cloud Platform.
Rollbar | https://rollbar.com | Budapest, remote Europe | Senior Software Engineer, Full-stack
About Rollbar:
* We're a ~30-person team (SF, Budapest, remote US and Europe) with a mission to help developers build software quickly and painlessly
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our customers are some of the best engineering teams in the world, including Twilio, Salesforce, and Twitch
* Our values are honesty, transparency, pragmatism, and dependability
We're currently hiring for:
- Senior Software Engineer
Please apply via: https://rollbar.com/careers/
Rollbar | https://rollbar.com | Budapest, remote Europe | Senior Software Engineer, Full-stack
About Rollbar:
* We're a ~30-person team (SF, Budapest, remote US and Europe) with a mission to help developers build software quickly and painlessly
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our customers are some of the best engineering teams in the world, including Twilio, Salesforce, and Twitch
* Our values are honesty, transparency, pragmatism, and dependability
We're currently hiring for:
- Senior Software Engineer
Please apply via: https://rollbar.com/careers/
Hi, Brian from Rollbar here. We believe that the items listed comprise the entirety of the scope. We will be able to state definitively once forensic analysis is complete.
GitHub tokens are not exposed. More specifically: customer credentials stored for third party integrations (i.e. GitHub, Slack, JIRA) are stored encrypted using a key that is not stored in the database, so those are not exposed.
No, just those US states at this time.
Oops, thanks!
Reading every error is a great idea, but you don't need to read them all yourself - let the computer read them for you.
This is what error aggregators (e.g. Rollbar) do. Now you've got 10-1000x leverage on your time because you're reading unique errors instead of every occurrence, and you've got more data to debug with because you've got data about the aggregates ("when did it start? what request params are common? what servers is it on?") in addition to data about the individual occurrences. You can still commit to solving them all ("Rollbar Zero"). It's just a whole lot easier.
Agree about synthetic data. My point is that AI-powered applications that are deployed in production generate more _real_ data which can be used for training. For example, self-driving cars generate tons of data about how their models perform, as a result of the cars driving around. Similarly, code-writing AI applications will generate feedback in the form of errors, logs, etc. which is can be fed back into the models as training data.
This analysis misses the impact of AI models being deployed, like is happening rapidly right now. Production applications built on AI will provide ample (infinite?) additional training data to feed back into the underlying models.
Climbing is two-dimensional, not three - on any given part of a wall or tree, you can move left-right and up-down but not in-out.
Sounds interesting. What's a use case for this?
I love the GitHub Actions play here - keeping the deployment system right next to the code it's deploying.
Rollbar | https://rollbar.com | San Francisco, Barcelona, Budapest ONSITE or REMOTE | Engineering, Customer Success
About Rollbar:
* We're an ~80-person team (SF, Barcelona, Budapest, and remote) with a mission to help developers build software quickly and painlessly
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our open source libraries are used by some of the best engineering teams in the world, including Twilio, Affirm, Salesforce, and Twitch
We're currently hiring for:
- Senior Data Engineer
- Senior Customer Success Manager
- Senior Technical Account Manager
Please apply via: https://rollbar.com/jobs
I like this idea a lot. In a sense it's thinking of your application as a spreadsheet, where the database is a data tab and the frontend is the summary tabs. If there's a change to the data tab, the "spreadsheet engine" (or "materialized view engine" in your case) walks the dependency graph and updates all the relevant parts of the summary tabs.
In the Rollbar UI, we implemented a lot of this type of logic by hand to make our real-time aggregated Items list work (i.e. each time an Item has a new occurrence, we update its stats in the database and push the diff to connected clients). It would save an immense amount of code to have had a solution that did this out of the box.
The closest thing I'm aware of to this is BigQuery's materialized views ( https://cloud.google.com/bigquery/docs/materialized-views-in... ), which take care of making otherwise expensive queries cheap fast, but they are rather limited (i.e. no subqueries or joins), and don't have the "streaming output of changes" you describe.
About Rollbar:
* Our mission is to help developers build software quickly and painlessly.
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our open source libraries are used by some of the best engineering teams in the world, including Twilio, Affirm, Calm, Zendesk, and Twitch
* We're an 80-person team (SF, Barcelona, Budapest, and remote) with a mission to help developers build software quickly and painlessly
We're currently hiring for:
- Frontend/Full-stack Engineer (SF / US)
- Data Engineer (Barcelona / Budapest)
Please apply via https://rollbar.com/jobs
About Rollbar:
* Our mission is to help developers build software quickly and painlessly.
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our open source libraries are used by some of the best engineering teams in the world, including Twilio, Instacart, Heroku, Zendesk, and Twitch
* We're a 90-person team (SF, Barcelona, Budapest, and remote) with a mission to help developers build software quickly and painlessly
We're currently hiring for:
- Frontend/Full-stack Engineer
- Technical Lead Engineer
- Security Operations Engineer
- Salesforce Developer
- VP of Finance
- Many more - please apply via https://rollbar.com/jobs
About Rollbar:
* Our mission is to help developers build software quickly and painlessly.
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our open source libraries are used by some of the best engineering teams in the world, including Twilio, Instacart, Heroku, Zendesk, and Twitch
* We're well-capitalized - we closed our Series B financing this January
* We're a 90-person team (SF, Barcelona, Budapest, and remote) with a mission to help developers build software quickly and painlessly
We're currently hiring for:
- Frontend/Full-stack Engineer
- Technical Lead Engineer
- Security Operations Engineer
- Salesforce Developer
- VP of Finance
- Many more - please apply via https://rollbar.com/jobs
Rollbar | https://rollbar.com | San Francisco, Barcelona, Budapest ONSITE or REMOTE | Engineering, PM, Design
About Rollbar:
* Our mission is to help developers build software quickly and painlessly.
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our open source libraries are used by some of the best engineering teams in the world, including Twilio, Instacart, Heroku, Zendesk, and Twitch
* We're well-capitalized - we closed our Series B financing this January
* We're an ~78-person team (SF, Barcelona, Budapest, and remote) with a mission to help developers build software quickly and painlessly
We're currently hiring for:
- SDK Engineer
- Security Operations Engineer
- Backend/Full-stack Engineer
- VP Finance
- Many more - please apply via https://rollbar.com/jobs
Rollbar | https://rollbar.com | San Francisco, Barcelona, Budapest ONSITE or REMOTE | Engineering, PM, Design
About Rollbar:
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our open source libraries are used by some of the best engineering teams in the world, including Twilio, Instacart, Heroku, Zendesk, and Twitch
* We're well-capitalized - we closed our Series B financing this January
* We're a ~70-person team (SF, Barcelona, Budapest, and remote) with a mission to help developers build software quickly and painlessly
We're currently hiring for:
- SDK Engineer
- Security Operations Engineer
- Backend/Full-stack Engineer
- Director, Solutions Engineering
- VP Finance
- Many more - please apply via https://rollbar.com/jobs
Rollbar | https://rollbar.com | San Francisco, Barcelona, Budapest ONSITE or REMOTE | Engineering, PM, Design
About Rollbar:
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our open source libraries are used by some of the best engineering teams in the world, including Twilio, Instacart, Heroku, Zendesk, and Twitch
* We're well-capitalized - we closed our Series B financing this January
* We're a ~60-person team (SF, Barcelona, Budapest, and remote) with a mission to help developers build software quickly and painlessly
We're currently hiring for:
- Technical PM - DX
- Site Reliability Engineer
- Product Designer
- IT Technical Lead
- VP Finance
- Many more - please apply via https://rollbar.com/jobs
Rollbar | https://rollbar.com | San Francisco, Barcelona, Budapest ONSITE or REMOTE | Engineering, Product Design, Sales
About Rollbar:
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our open source libraries are used by some of the best engineering teams in the world, including Twilio, Instacart, Heroku, Zendesk, and Twitch
* We're well-capitalized - we closed our Series B financing this January
* We're a ~60-person team (SF, Barcelona, Budapest, and remote) on a mission to help developers build software quickly and painlessly
* Benefits and perks: competitive salary and stock options, medical, dental and vision insurance, 401k, annual conference budget, generous hardware and software allowance, casual work environment, inclusive team-oriented culture, rapid career growth opportunities, have fun and have an impact.
We're currently hiring for:
- Site Reliability Engineer
- Engineering Manager
- Full-stack Engineer
- Product Designer
- IT Manager
- Many more - please apply via https://rollbar.com/jobs
Rollbar | https://rollbar.com | San Francisco, Barcelona, Budapest ONSITE or REMOTE | Product Design, Customer Success About Rollbar:
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our open source libraries are used by some of the best engineering teams in the world, including Twilio, Instacart, Kayak, Heroku, Zendesk, and Twitch
* We closed our Series B financing in January, so we're well-capitalized for growth
* We're a ~60-person team (SF, Barcelona, Budapest, and remote) on a mission to help developers build software quickly and painlessly
* Benefits and perks: competitive salary and stock options, medical, dental and vision insurance, 401k, annual conference budget, generous hardware and software allowance, casual work environment, inclusive team-oriented culture, rapid career growth opportunities, have fun and have an impact.
We're currently hiring for:
- Product Designer
- Full-stack Engineer
- Solutions Engineer (Post-Sales)
To get in touch, please apply via https://rollbar.com/jobs
Rollbar | https://rollbar.com | San Francisco, Budapest ONSITE or REMOTE | Product Design, Customer Success
About Rollbar:
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our open source libraries are used by some of the best engineering teams in the world, including Twilio, Instacart, Kayak, Heroku, Zendesk, and Twitch
* We closed our Series B financing in January, so we're well-capitalized for growth
* We're a ~60-person team (SF, Barcelona, Budapest, and remote) on a mission to help developers build software quickly and painlessly
* Benefits and perks: competitive salary and stock options, medical, dental and vision insurance, 401k, annual conference budget, generous hardware and software allowance, casual work environment, inclusive team-oriented culture, rapid career growth opportunities, have fun and have an impact.
We're currently hiring for:
- Product Designer
- Customer Success Engineer (Budapest)
To get in touch, please apply via https://rollbar.com/jobs
Rollbar | https://rollbar.com | San Francisco, Barcelona, Budapest ONSITE or REMOTE | Product Management, Product Design, Data, Marketing, Customer Success
About Rollbar:
* We help tens of thousands of developers find and fix errors faster.
* Our backend handles billions of errors with low latency and high reliability
* Our front-end allows developers to discover and drill down across millions of errors in real-time
* Our open source libraries are used by some of the best engineering teams in the world, including Twilio, Instacart, Kayak, Heroku, Zendesk, and Twitch
* We closed our Series B financing in January, so we're well-capitalized for growth
* We're a ~50-person team (SF, Barcelona, Budapest, and remote) on a mission to help developers build software quickly and painlessly
* Benefits and perks: competitive salary and stock options, medical, dental and vision insurance, 401k, annual conference budget, generous hardware and software allowance, casual work environment, inclusive team-oriented culture, rapid career growth opportunities, have fun and have an impact.
We're currently hiring for:
- Senior Product Manager (Growth / DX)
- Senior Product Designer
- Team Lead - Customer Success Engineering
- Growth Marketing Manager
And more - to get in touch, please apply via https://rollbar.com/jobs