cdbattags

Thanks! Did you give the `@` referencing a try too?

But I think when you actually structure memory in the right form based on "workload" (i.e. Google Spreadsheet, Microsoft Word XML, coding lang AST/DAGs), then this is truly possible to have additive "unforgetting".

Edit:

I truly believe this is solvable just like we're doing for natural language but with code/schema/etc! Relational, document, graph, vector!

I just posted this on HN this morning and was looking through "new" but I'm trying to solve this exact problem:

https://annealit.ai

Use Blacksmith. I promise you won't regret it.

Definitely, but it's neat nonetheless because more and more things are "structured Markdown" these days. Extremely useful for AI reasoning and outputs.

I worked for an education technology company that made curriculum for K-8. There are long sales cycles in this space and different departments of ed have different rules. Think "vote every 4 years because our books are out of date or just old". The technology wave came fast and most of this curriculum from incumbent providers was formatted to fit in a book with maybe some of the most cutting edge people having a large InDesign file as the output.

The edtech company I worked for was "web first" meaning students consumed the content from a laptop or tablet instead of reading a book. It made sense because the science curriculum for example came with 40+ various simulations that helped explain the material. A large metropolitan city was voting on new curriculum and we were in the running for being selected but their one gripe was that they needed N many books in a classroom. Say for a class of 30 they wanted to have 5 books on backup just in case and for the teachers that always like a hardcopy and don't want to read from a device.

The application was all Angular 1.x based that read content from a CMS and we could update it in realtime whenever edits needed to be made. So we set off to find a solution to make some books. The design team started from scratch going page by page seeing how long it would take to make a whole book in InDesign but the concept of multiple editing doesn't really exist well in this software. Meanwhile, my team was brainstorming a code pipeline solution to auto-generate the book directly from the code that was already written for the web app.

We made a route in the Angular app for the whole entire "book" that was a stupid simple for loop to fetch each chapter and each lesson in that chapter that was rendered out on a stupidly long page. That part was more less straightforward but then came the hard part of trying to style that content for print. We came across Prince XML which fun fact was created by one of the inventors of CSS. We snagged a license and added some print target custom CSS that did things like "add blank page for padding because we want new chapter to start on the left side of the open book". But then came the devops portion that really messed with my head.

We needed a headless browser to render out all of this and then we needed the source with all the images, etc to be downloaded into a folder and then passed to Prince XML for rendering. Luckily we had a ECS pipeline so I tried to get it working in a container. I came up with a hack to wait for the end of the rendering for loop for the chapters/lessons to print something to console and then that was the "hook" for saving the page content to the folder. But then came the mother of all "scratching my head" moments when Chromedriver started randomly failing for no reason. It worked when we did a lesson. It worked when we did a chapter. But it started throwing up a non-descript error when I did the whole book. Selenium uses Chromedriver and Chromedriver is direct from Google and Chromium repo. This meant diving into that C++ code in order to trace it down when I finally found the stack trace. Well yeehaw I found an overflow error in the transport protocol that happens from Chrome devtools as it talks to the "tab/window" it's reading from. I didn't have the time to get to the bottom of the true bug so I just cranked the buffer up to like 2 GB and recompiled Chromium with the help of my favorite coworker and BOOM it worked.

But scaling this thing up was now a nightmare because we had a Java Dropwizard application reading a SQS queue that then kicked off the Selenium headless browser (with the patched Chromedriver code) which downloaded the page but now the server needed a whopping 2 GB per book which made the Dropwizard application a nightmare to memory manage and I had to do some suuuuper basic multiplication for the memory so that I could parallelize the pipeline.

I was the sole engineer for this entire rendering application and the rest of the team assisted on the CSS and styling and content edits for each and every "book". At the end of the day, I calculated that I saved roughly 82,000 hours of work because that was the current pace of how fast they could make a single chapter in a book multiplied by all the chapters and lessons for all the different states because Florida is fucked and didn't want to include certain lines about evolution, etc and so a single book for a single grade but for N many states that all have different "editions".

82,000 hours of work is 3,416.6667 days of monotonous, grueling, manual, repetitive design labor. Shit was nasty but it was so fucking awesome.

Shoutout to John Chen <zhanliang@google.com> for upstreaming the proper fix.

69 billion*

No?

So which open source routing project do we believe they're using along with it? Valhalla?

Edit:

I'm co-founder and CTO of a heavy haul/oversize routing SaaS called Triple Axle (https://tripleaxle.com). We using OSM and Valhalla.

The other being a network socket in this case? But that socket might be two servers over? Meh, ideally they've optimized that as well.

So absolutely it is a network problem which means custom fiber?

That's a good take. I wonder if those engineers have hopped around and said similar when Apple or others tried to implement the same?

Ahhhh, this is the real answer!

Edit:

Holy shit, IO rings released on Windows Preview in 2021...

But that would be 1 layer up in a network of that size, no? Edit:

Let's call it "Ring -1"

Wow, that is actually an amazing performance curiousity adding parallelism to the mix. I guess this would depend on the M.2 spec?

So that means yes but also they've gone past that optimization?

Anyone else think maybe AWS (S3) has made this optimization already? Or would it just be a whole team of kernel engineers optimizing it there?

The overhead on CPU cycles this would save cloud storage systems... Can someone help me quantify the potential savings?

Edit:

They specifically don't list their storage medium on their marketing:

https://aws.amazon.com/s3/storage-classes/

+1 for PostHog currently using for https://tripleaxle.com

I still use https://chrome.google.com/webstore/detail/old-reddit-redirec...

New Reddit is awful

Just had one of these myself for a CTO position

I'd love a link to your content!

I think we've/they've been heading in this direction for a while. At least from a kernel perspective. All we need is a DirectX port now which is easy by kind of "reverse-reverse" engineering Wine and a compatibility layer.

I think behind the scenes this is WSL's true purpose.

If this merger does happen, my hope is RISC-V will win in 5-10+ years horizon. Which I think would be net-net better for the whole industry.

Not much more to say other than Noms was my favorite project (https://github.com/attic-labs/noms) for a while until acquisition and the engineers are now the ones behind Replicache (https://replicache.dev/).

I think this is going to be the next "Realm" that works everywhere.

Just got

  {"code":403,"errors":["Could not read cookie: are cookies enabled?"]}

This! Thank you for your service to category theory!

Comparisons like this are what is going to lead us into the next 100 years.

ReMarkable should hire this person and make a "v2.1".

Now someone do the same in Rust.

Such an underrated comment. I applaud.

This is the whole purpose for affine arithmetic, no?

Now someone please ELI5 how this compares to the algorithm Unreal Engine employs?

I believe this is the same reason why https://hey.com will win too.

Product engineering where the app/service is one big A/B test is how you truly figure out what your users want and need.