HN user

ironchef

640 karma
Posts2
Comments302
View on HN

"Here’s why: There is absolutely no benefit for you to gain by talking in an exit interview, and plenty of negative consequences to come out of it. At best you’ll be remembered as a complainer, and you may make enemies."

I guess I would counter with if I have friends there, I would like their lives to be better. If my exit interview is able to do that, then I would take that as a net positive.

It's at least CUI. At _least_. I would suggest material that is operational in those regards would be secret or top secret. It had:

* timelines of kinetic resource missions * conops including order of battle, etc.

Per normal ODNI bits, it's pretty clearly within bounds for classification.

Lots of folks out there use evidence.dev. It's a simple way to get some BI up and running without needing to deal with licensing / corporate IT, etc.

Remember all it takes is 1 employee to put that claim up there (although I do like evidence.dev).

Elixir at Ramp 3 years ago

The libraries out there lack the breadth and maturity of some of the other ecosystems (as a simple example).

Or at least they did for some of my corners of the world.

Look into datalake architectures.

Yup .. comfy with iceberg/delta/hudi

RDBMS based data warehousing is obviously not economical at the petabyte scale.

I never said it was .. I'm simply responding to "I simply cannot understand how anyone chooses this over running your own Spark clusters with Jupyterlab". I'm trying to help you understand why folks would choose a SaaS over run your own.

But storing all that data in S3 with Delta Lake/Iceberg format and querying with Spark changes things entirely. You only pay for object storage, and S3 read costs are trivial.

No. You don't just pay for object storage + minor S3 read costs.

You pay for operations You pay for someone setting up conventions You pay to not have to optimize data layouts for streaming writes You pay to not have to discover race conditions in s3 when running multiple spark clusters writing to same delta tables You pay to not have to discover that your partitions/clustering needs have changed based on new data or query patterns

But look .. I get it. You have chosen to optimize for cost structures in one way .. and I've chosen to optimize in a different way. In the past I've done exactly as you've said as well. I think being able to seeking to see _why_ folks may have chosen a different path may help you understand other areas to consider in operations.

Here was my situation. Occasional queries. Over a couple petabyte of data. Customer facing so response in seconds per SLA but > 95 percent of the time the warehouse isn’t running. Cached queries from within 24 hours which don’t require the warehouse to even spin up. Our snowflake costs were significantly less than an FTE.

Would that potentially be a situation which “running your own” doesn’t make sense?

“I can’t imagine being a traditional teacher, and having to teach kids that don’t care.”

What I’ve seen is igniting that spark and moving folks from not caring to caring (or realizing they can affect change) can be even more rewarding than the other mentoring being discussed

RedisRaft 3 years ago

There are some huge deployments out there. Snowflake (the database) has a big dependency on it for how they do metadata (for example)

Let’s say you work for a SaaS doing analytics. Your boss says “hey! We need to start reporting on new logos. Can you snag those from the DB?”

But what counts as a new logo? Does a pro serve engagement that doesn’t use the product count? What about a business using the SaaS but still in a trial period? Etc.

A semantic layer helps provide common agrees upon definitions to the business. So any one looking for common data entities can just look those things up… and can come to published definitions (which are backed by queries to databases, data lakes, etc).

Does that help? Another example of this would be dbt for example

Yeah. The frameworks solve the 80 percent problem quite well but once you start trying to be as specific as the business often wants, I would find them lacking and end up popping JSON to d3 (or some such)

There's a lot of ... sub par BI devs who want to point and click through horrendous PowerBI interfaces and such. Personally i find that style to hamper my ability to express what the business units need out of data products.

It's just considered "data" these days. We just look at the Vs of the data and adjust based on those. High velocity? Do X. High volume? Accommodate Y. High variety? ... The other side of things is the underlying data quality often had tons of issues, so there's been a lot of focus on the data observability (which isn't sexy at all).

Still tons of folks out there using Hadoop (ew), Snowflake, etc. New technologies coming out include things like Trino, Apache Iceberg, etc. So it's there ... just no one cares about the moniker .. just getting things done.

If I recall, the language that's used in situations like these is something along the lines of "Personal electronic devices will be governed under this policy when such devices are attached to the CPS network." So .. it's a "as long as you're going to connect to the CPS controlled network / resources, you must have software protections / controls in place".

It’s probably worth going somewhere specifically for testing giftedness so you can see if your child (on that day) is more likely gifted, highly gifted, profoundly gifted, etc. Also it can be helpful to find out if there’s other 2E (twice exceptional) things at play such as ADHD, etc.

We took our kiddo on a trip to Colorado to the Gifted Development Center which was a good helpful first step (and connected a lot of dots for us). More than happy to share experiences at matt at mindvault dot com.

Midwest Developer 5 years ago

As to Buddy’s just make your own. Snag a blue steel pan, learn the basic dough recipe, snag some decent ingredients and you’re good to go.

Zingermans has a pretty decent virtual class to teach the Detroit style pizza :)

I think it’s getting there... but I also think a lot of the impact are things we don’t see. Top of mind would be: * autonomous driving * language translation * salience mapping * fraud detection

I guess I’m somewhat on the opposite side of the fence. I see it everywhere... although yes I think Big Bang things are probably a few years off

No. You’re spot on. When in doubt read Harold McGee. Conduction is “direct contact”. (Vs convection and radiation)

Maybe the documentation you've written hasn't been good?

I've found well-written documentation to be a good way to avoid having folks bother me. I tend to treat it as a first class citizen artifact of my work (along with tests). Have it be as auto generated as possible. The above being said, I've also sometimes struggled to put myself in the user's shoes to understand what are the things I should emphasize in the documentation.

Snowflake S-1 6 years ago

Which part don’t you like? We’ve used snow pipes and it seems to work quite well.

Most folks I know are doing this (1 and 2) by testing against a replica (or in the case of snowflake just copying the DB or schema) ... then running data tests locally and downstream (great expectations, DBT tests, or some airflow driven tests).

Is the value prop “you don’t need all they grunt work” as opposed to above direction?