HN user

akbar501

490 karma

Founder. Eminate.io (coming soon)

Posts27
Comments266
View on HN
news.ycombinator.com 9y ago

Ask HN: What's the state of the job market in data engineering?

akbar501
3pts0
www.digitalocean.com 10y ago

Block Storage coming to DigitalOcean

akbar501
6pts0
news.ycombinator.com 10y ago

Link in Apply HN is wrong

akbar501
6pts3
medium.com 10y ago

Node.js Foundation to Add Express as an Incubator Project

akbar501
1pts1
news.ycombinator.com 10y ago

Ask HN: Setup for podcasting interview

akbar501
1pts0
powerapps.microsoft.com 10y ago

Microsoft PowerApps

akbar501
3pts0
www.foxbusiness.com 10y ago

SEC Gives OK to Online Investor Crowdfunding

akbar501
1pts0
medium.com 11y ago

Modern Design Tools: Adaptive Layouts

akbar501
1pts0
en-maktoob.news.yahoo.com 11y ago

5 Things I Learned About Successful Startups from Steve Jobs

akbar501
2pts0
news.ycombinator.com 11y ago

Ask HN: Good tech recruiters in SV?

akbar501
1pts1
exponential.io 11y ago

Big Data SQL

akbar501
1pts0
learn.exponential.io 11y ago

Show HN: (FREE) Course on Python REST API Development

akbar501
1pts2
exponential.io 11y ago

REST APIs must guarantee strong data integrity

akbar501
2pts0
news.ycombinator.com 11y ago

Ask HN: Which algorithms do you use on a regular basis?

akbar501
5pts7
exponential.io 11y ago

Should you pick Node.js or io.js?

akbar501
1pts0
learn.exponential.io 11y ago

Consistency in Apache Cassandra (free course)

akbar501
2pts0
mobilesyrup.com 11y ago

Microsoft handwriting keyboard for Android Wear

akbar501
3pts0
www.aclu.org 11y ago

Apple Throws Down Privacy Gauntlet

akbar501
1pts0
www.reuters.com 11y ago

Apple says its systems not to blame for celebrity photo breach

akbar501
1pts0
venturebeat.com 11y ago

Successful founders don’t drop out

akbar501
6pts0
github.com 12y ago

Go Continuous Delivery source now on GitHub

akbar501
1pts0
www.ibm.com 12y ago

Girls and Big Data (by my sister in-law) – Real-time data analytics

akbar501
1pts0
blogs.apache.org 12y ago

Apache Spark is now a top-level project

akbar501
1pts0
news.ycombinator.com 12y ago

Ask HN: How much progress do YC companies make in 3 months?

akbar501
1pts0
news.ycombinator.com 12y ago

Ask HN: What tools are you using for customer development experiments?

akbar501
1pts0
tech.exponential.io 12y ago

Business terminology: Startup vs. Company; Founder vs. Entrepreneur

akbar501
2pts0
tech.exponential.io 12y ago

You submitted an application to Y Combinator. What next?

akbar501
2pts1

Was about to say the exact same thing. Housing constraints are not limited to "near Nvidia HQ". It's the entire Bay Area.

For those not from the area, it's city after city after city in the Bay Area. 60 miles up the peninsula (from San Jose to San Francisco), and 60 miles up the East Bay, the vast majority of which has inventory and affordability challenges.

TL;DR Give Blitz a try.

I've been developing my app with Blitz. It has been an extremely productive framework to work with.

The following are a few of the productivity boosts that I like:

1. It includes authentication plus there's a good library for authorization (blitz-guard) so auth is a breeze.

2. The generator is helpful when I started with Blitz, but use it less now.

3. The community is friendly and helpful. ex. Check out this post on skeleton loaders https://andreas.fyi/engineering/nextjs-auth-skeleton-loaders

4. The integration with Prisma is buttery smooth. In your UI code you call a function that has the database access. Blitz converts the function calls into API calls and runs your database code on the server. When Prisma is not enough you can drop to `db.$queryRaw` to write SQL directly.

5. Personally, I dislike fiddling with 800 libraries to get a project up and running. Blitz includes Jest, Prettier, and everything else you need so on so that you're productive from day 1.

One request I would have for SUS is to add the ability to add a weekly update in the past.

More than once I was working late Sunday and well into Monday morning. When this happens I can no longer provide an update for the prior week so it looks like I've done nothing for that week.

Tenable | SF / Bay Area | ONSITE or REMOTE | Sr. Software Engineer and Principal Engineer positions open

Tenable is a rapidly growing network security company. We’re expanding our engineering team to keep up with our rapid customer and revenue growth.

Tenable.io is the first comprehensive cyber exposure platform. You will be joining a team that is building our data management capabilities, streaming data pipelines using Kafka, ingest APIs, and various other parts of our data infrastructure. This is a great opportunity to have a significant impact.

In terms of skills, you should be able to develop, deploy and maintain a microservice written in Java/Kotlin or another JVM language, experience with databases (PG, C*, Elastic, etc), and expertise managing data at scale. If you already know Kafka that's a plus. AWS, GCP or Azure experience is needed.

I'm the Sr. Director of Engineering, Data Services. You can reach me at aahmed @ tenable.com. Please put "HN" in the subject line.

Tenable | SF / Bay Area | ONSITE or REMOTE Software Engineer, Principal Engineer

Tenable is a rapidly growing network security company. We’re expanding our engineering team to keep up with our rapid customer and revenue growth.

Tenable.io is the first comprehensive cyber exposure platform. You will be joining a team that is building a streaming data pipeline using Kafka and Java/Kotlin. We are also building connectors to 3rd party applications using a FaaS (aka serverless). This is a great opportunity to have a significant impact.

In terms of skills, you should be able to develop, deploy and maintain a microservice written in Java/Kotlin or another language that runs on the JVM, that exposes a REST API, calls other REST APIs, parses and produces JSON, reads/writes to/from a data store (PG/Aurora...). It's a plus if you understand how to instrument your code (telemetry, logs, etc.), and ideally understand retries with backoffs, ideally circuit breakers, etc. If you already know Kafka that's a plus. AWS, GCP or Azure experience is needed.

I'm the Sr. Director of Engineering, Data Services (Data Science and Data Engineering). You can reach me at aahmed @ tenable.com. Please put "HN" in the subject line.

Tenable | SF / Bay Area | ONSITE or REMOTE Software Engineer, Sr. Software Engineer, Principal Engineer, Engineering Manager

We're hiring at all skill levels.

Tenable is a rapidly growing network security company. We’re expanding our engineering team to keep up with our rapid customer and revenue growth.

Tenable.io is the first comprehensive cyber exposure platform. You will be joining a team that is building a streaming data pipeline using Kafka and Java/Kotlin. This is a great opportunity to have a significant impact.

In terms of skills, you should be able to develop, deploy and maintain a microservice written in Java/Kotlin or another language that runs on the JVM, that exposes a REST API, calls other REST APIs, parses and produces JSON, reads/writes to/from a data store (PG/Aurora, or whatever). If you're applying to one of the more senior roles, then you should also understand how to instrument your code (telemetry, logs, etc.), and ideally understand retries with backoffs, ideally circuit breakers, etc. If you already know Kafka that's a plus. AWS, GCP or Azure experience is needed.

Interview process

We interview quickly. Our goal is 5-10 business days for the entire process.

  - Cultural fit with Director Engineering (i.e. me)
  - Technical interview with 2 peers
  - Coding challenge (practical exercise similar to what you'll actually do)
  - Decision
I'm the Director of Engineering, Ingest and Pipelines. You can reach me at aahmed @ tenable.com. Please put "HN" in the subject line.

Tenable | SF / Bay Area | ONSITE or REMOTE Software Engineer, Sr. Software Engineer, Principal Engineer, Engineering Manager

We're hiring at all skill levels.

Tenable is a rapidly growing network security company. We’re expanding our engineering team to keep up with our rapid customer and revenue growth.

Tenable.io is the first comprehensive cyber exposure platform. You will be joining a team that is building a streaming data pipeline using Kafka and Java/Kotlin. This is a great opportunity to have a significant impact.

In terms of skills, you should be able to develop, deploy and maintain a microservice written in Java/Kotlin or another language that runs on the JVM, that exposes a REST API, calls other REST APIs, parses and produces JSON, reads/writes to/from a data store (PG/Aurora, or whatever). If you're applying to one of the more senior roles, then you should also understand how to instrument your code (telemetry, logs, etc.), and ideally understand retries with backoffs, ideally circuit breakers, etc. If you already know Kafka that's a plus. AWS, GCP or Azure experience is needed.

Interview process

We interview quickly. Our goal is 5-10 business days for the entire process. - Cultural fit with Director Engineering (i.e. me) - Technical interview with 2 peers - Coding challenge (practical exercise similar to what you'll actually do) - Decision

I'm the Director of Engineering, Ingest and Pipelines. You can reach me at aahmed @ tenable.com. Please put "HN" in the subject line.

Amazon is a huge threat for any infrastructure company using Apache 2.0. If you gain popularity, then Amazon will be a direct competitor once they host your project. Given that Amazon's services benefit from the IE effect, it's not irrational for an open source infrastructure company to eliminate such a threat via licensing.

It's comparable to LevelDB and RocksDB. However, Badger is not comparable to Cassandra, ScyllaDB or DynamoDB as they are distributed database management systems.

Cassandra, for example, has it's own storage engine that's responsible for writing bits to disk.

Redis is a database management system (DBMS). Badger is a storage engine.

An application developer would not choose Badger, but instead would pick a DBMS such as Redis.

A database engineer would use Badger to develop a DBMS that the application engineer could use. If the database engineer so chooses they could expose a Redis compatible API.

The terminology can be a bit confusing. Database Management System is what people often call a database. Unfortunately, the storage engine is also called a database.

Badger, RocksDB, LMDB, etc. are storage engines. A process uses these storage engines to write data to memory (note: the storage engine may support persistent, volatile, or both types of memory).

A database management system (DBMS) is a higher level concept that often has multiple processes either on a single server or distributed across multiple servers. Simply stated, each process within a DBMS uses the storage engine to read/write to/from memory (persistent or volatile).

It's important to note that storage engines are a specialized area and require different skills from writing a DBMS. It's a big deal when other people write high quality storage engines because it makes it a lot easier to write a DBMS.

In my experience, your points about communication and onsite visits are key. Also, communication should be centralized and managed on both sides so there is not only a communication channel, but also clear lines of responsibility. Of course, communication is not just phone and email, but also well defined specs.

However, getting involved in another company's hiring process is rarely a good idea. Most offshore projects are results oriented, so getting involved in hiring is too low level (i.e. micro-management). In other words, manage the output, not the process.

With the above said, involvement in hiring can be effective when 1.) you're using the offshore firm to acquire very specialized, high-end talent, and 2.) you're paying a substantial premium above local market to ensure hiring is a rare event.

There is simply no factual basis for this comment.

Every American Muslim I have met believes in the 1st Amendment.

Perhaps more than many Americans, American Muslims are acutely aware of how our laws keep them safe. Reducing these laws would make them more of a target then they already are.

AWS becomes interesting when you want to automate your infrastructure (i.e. infrastructure as software). When you're not orchestrating your infrastructure, then its probably overkill.

DO, as you rightly mentioned, is a lot closer to a straight forward Linux or whatever instance (easier to use). And the prices are very attractive.

I use both and split based on the above. DO is great for hosting web apps / dynamic web sites at a reasonable price. AWS is great for orchestrated clusters / large scale production, or for very low cost static hosting via S3.

Compose.io is owned by IBM. I had a chance to meet both the Compose team and a few people from IBM at the DataLayer conference. They are passionate and smart.

Compose is in a sweet spot right now. They run with the speed of a startup, but have access to IBM's massive resources. Really the best of both worlds.

Yes, I was a speaker at DataLayer.

There are two answers to your first question.

1. Dynomite pairs well with Cassandra. At scale, Cassandra is not a speed deamon when it comes to reads. Dynomite helps to improve Cassandra's read performance.

2. The use case for Dynomite as the primary database is for workloads that require high throughput and low latency. In other words, Dynomite delivers consistently lower latency at any scale.

https://github.com/Netflix/dynomite

Dynomite for production proven, limitless scale for Redis.

Provides ability to Redis for both in-memory and on-disk workloads.

Dynamo-inspired linearly scalable, shared nothing multi-master architecture. Pairs well with Cassandra.

Supports pluggable backends (ex. RocksDB).

Been in production 2+ years. One of the larger clusters handles over 3.6 million sustained ops/sec in production, every day.

Company town 10 years ago

The monopsony, which is infrequent in today's markets, is what caused these types of cities/towns. Specifically, a labor market monopsony.

What is the scale out process with Prometheus? Is sharding/replication a manual setup process or is it automated? What's involved in scaling out?

There is a lot of discussion going on currently around OSS business models. The general consensus is that support contracts / professional services / support do not monetize well enough to grow a large business.

Hosted services is a viable business model. The risk here is to ensure that your product, if successful, cannot simply be deployed by Amazon. Dual licensing has been one response to the Amazon risk.

Admin tools alone are also thought to be difficult to monetize at sufficient value to grow a large business.

While DataStax has a nice UI, they have built a data platform with Cassandra the core, much like Cloudera has built a data platform with HDFS/HBase at the core. Personally, I view the data platforms as prepackaged and productized SI (which is very valuable..

Trump 10 years ago

Flip this around. Would you be okay with a presidential candidate saying that a white judge was unable to do his job b/c of his color? What if a ban of additional white immigrants was being proposed? Would you be okay with a female candidate stating that women are clearly superior to the inferior male?

I hope you would stand up and speak out against such actions, because I know I would.

If the media loves writing articles about Trump, they could at least put a modicum of thought into topics. There are so many easy topics.

Far from Trump taking over the GOP, the GOP has taken over Trump and now literally dictates his policy.

Bankers contributed money and bought Trump's support for financial deregulation.

Trump energy and coal policy are literally being written by GOP governors. The GOP now coordinates with Trump's speak writer to determine what is said.

Starting a trade war with China would have a direct negative impact on real estate prices in the US, which would affect Trump...and therefore will never happen.

A Trump presidency would basically be characterized by substantial benefits accruing to the wealthy while his middle class and lower class supporters will be further subjugated. In other words, just write about the effects of his policy suggestions...which does not take much effort.

And perhaps the biggest one, instead of writing articles that Trump will somehow magically take over every American institution, the reality much more mundane. US institutions are strong and his ability to get anything done will be mired in the same red tape that every President faces. Thus, campaign promises to build walls, undo numerous trade deals, ban Muslims, deport Hispanics etc. are empty promises that simply will not occur.

@antirez, is Redis 4.0 going to be part of the more rapid release schedule (will we see it in 3, 6 months) or are major upgrades still annual releases (we'll see 4.0 in 12 months)?