HN user

hedgehog

3,942 karma

Deep learning, security. I like puzzles.

hn at fastfin dot net

Posts51
Comments1,372
View on HN
parallelprogrammer.substack.com 1y ago

Asynchronous Error Handling Is Hard

hedgehog
43pts37
frame.work 1y ago

Framework Laptop 12 pre-orders open next week

hedgehog
25pts16
macroquad.rs 4y ago

Macroquad – Simple and easy to use game library for Rust programming language

hedgehog
1pts0
m.youtube.com 7y ago

Overwatch Gameplay Architecture and Netcode

hedgehog
1pts0
techcrunch.com 7y ago

Intel buys deep-learning startup Vertex.AI to join its Movidius unit

hedgehog
2pts0
vertex.ai 7y ago

Vertex.AI Is Now Part of Intel’s Artificial Intelligence Products Group

hedgehog
5pts0
techcrunch.com 8y ago

Kiwi’s robots deliver food to hungry Berkeley students

hedgehog
1pts0
vertex.ai 8y ago

Automatic Kernel Generation in PlaidML

hedgehog
4pts0
vertex.ai 8y ago

Tensor Compilers: Comparing PlaidML, Tensor Comprehensions, and TVM

hedgehog
36pts8
vertex.ai 8y ago

Fully Automatic Differentiation for Tensor Expressions

hedgehog
9pts5
vertex.ai 8y ago

Accelerated Deep Learning on MacOS with PlaidML's New Metal Support

hedgehog
5pts0
vertex.ai 8y ago

How to Deploy ONNX Models (almost) Anywhere, with PlaidML

hedgehog
6pts0
vertex.ai 8y ago

Deep learning with LLVM using PlaidML

hedgehog
4pts0
vertex.ai 8y ago

Tile: A New Language for Machine Learning

hedgehog
163pts36
vertex.ai 8y ago

GPU-Accelerated Deep Learning on Mac with Intel, AMD, and Nvidia

hedgehog
9pts0
news.ycombinator.com 8y ago

Show HN: PlaidML, open source deep learning for any GPU

hedgehog
52pts16
vertex.ai 8y ago

Benchmarking Deep Neural Nets for Real-Time Vision

hedgehog
4pts0
vertex.ai 8y ago

Open Source Deep Learning on AMD and Beyond

hedgehog
5pts4
vertex.ai 8y ago

Bringing Deep Learning to OpenCL

hedgehog
4pts0
www.forbes.com 9y ago

Intel Forms New AI Group Reporting Directly to CEO Brian Krzanich

hedgehog
1pts0
www.computing.co.uk 10y ago

Computer pioneer Gene Amdahl dies, aged 92

hedgehog
4pts0
www.fastcodesign.com 10y ago

How Apple Is Giving Design a Bad Name

hedgehog
10pts0
www.npr.org 11y ago

Transformer Paper Turns Itself Into A Robot. Cool

hedgehog
1pts0
apps.washingtonpost.com 12y ago

The depth of the problem

hedgehog
8pts0
www.samharris.org 14y ago

The Trouble with Profiling

hedgehog
4pts0
blog.regehr.org 14y ago

57 Small Programs that Crash Compilers

hedgehog
125pts13
github.com 14y ago

IRC Tail

hedgehog
3pts0
web.archive.org 14y ago

OS Strategy News (Apple 1997)

hedgehog
2pts0
dl.dropbox.com 14y ago

Clock

hedgehog
2pts0
androidcomplaints.tumblr.com 14y ago

The Galaxy Nexus

hedgehog
6pts0

Maybe enabling MTP causes some weights to be displaced to host memory? MTP itself doesn't do anything during prefill so that should be exactly unchanged, decode will vary depending on settings but with 2-4 proposals depending on workload I've never seen an overall slowdown.

edit: I recommend building recent llama.cpp from source, I've been updating about once a week, as there has been a fair amount of work related to MTP recently. If you're running a lot of tool calling on Qwen you might also benefit from one of the bugfixed chat templates like the Froggeric version.

Yes that's what I've read. As far as I know the approach should transfer well to hybrid model architectures like modern Qwen and sizes like 27B by using multiple chips. LoRA-steered Qwen 27B at 10K+ tokens per second would be transformative for some workflows.

For our purposes it has the mining/crafting/construction bits the kids care about so in that dimension there's no difference. From my perspective it's been simple to operate, and having all the source makes a good base for building tools and mods (some new pet/creature entities, simplified launcher, screenshot tools).

Luanti with Mineclonia plug-in works well if you are willing to move entirely to Mac/Windows/Linux clients. The whole stack is open source so it's easier to make changes etc if you want. No hacky binary patching of Java bytecode. Originally I was going to try Minecraft proper first since I'd already paid for that, but Microsoft doesn't honor old licenses and in the end the Luanti path probably works better.

https://content.luanti.org/packages/ryvnf/mineclonia/

I don't know about the overall breakdown but in my case longer runs are prototyping, bug hunting, reverse engineering, etc. For example Gnome Remote Desktop didn't work in my configuration due to a combination of hardware and codec bugs and settings. One drive to make it work, another to backport the current upstream packages to Debian stable, restack the patches, and push to my machines. Another sequence of long runs was writing a new client for a closed-source conferencing service I use to allow fixing some particularly irritating bugs. Exploit development has the same shape although that's not something I do personally. From what I've seen the amount of useful hands-off run time is directly related to how clearly it's possible to specify a concrete, verifiable standard by which to judge the outcome. For some tasks that might be days or weeks, for forward engineering on a software product that for me is usually under an hour.

I don't think the current subscription price is intended to be a money maker. It's the loss leader to get people invested in the companies' tooling, and make those people more willing to start paying higher enterprise rates as they grow.

It's what some more experienced users want and the companies are following the well-trod path of optimizing heavily for power users at the expense of complexity, only now it's gotten easier to add absurd amount of code to a project. Not necessarily to make it work right. Personally I have some tasks where sessions between one and five days are typical so I appreciate that it's possible.

Once native apps became important Microsoft didn't have a chance, the basis for Apple's success was in place back in 2003-2005. Apple had a big head start on what is now the standard phone template (always-on cell data, capacitive touch, etc), and based on the experience and success of the iTunes / iPod platform they found leverage to negotiate a unique deal where they controlled OS updates and the app store (instead of the carriers). They also had a lot of experience with OpenGL composited UI from OS X which translated to a (relatively) good GLES implementation on iPhone even though they didn't originally have any kind of public SDK. Very useful for games. Now I think there are some groups that are hoping LLM-based agents will upset the dominance of the app store model... I'm skeptical but we'll see.

I don't think that's quite accurate, the screens of the time were more like 480px wide and I don't think most people had a strong aesthetic opinion. Just look at Android. The major problem is that whatever app you cared about, whether it was your bank, Facebook, sport news, or Uber, or Google Maps, or whatever, it was on iOS and maybe Android. So at least in rich countries the decision tree was: buy iOS if you can afford it, buy Android if you can't. Apple basically got extremely lucky that the native app thing took off instead of their original vision of everything via the browser.

It wouldn't necessarily have been better, a major reason the Windows phone stuff failed is it didn't have market share to justify app development. Android barely made it work as a well-funded #2. Palm WebOS, MeeGo, there were various efforts that were better than Android and even iOS in a lot of ways but app availability seems to have been the biggest factor in the lack of platform diversity.

Edit: And consistent with sibling comment Microsoft was even paying companies to build apps for their platform, and it _still_ wasn't enough.

I don't have the experience, how high are Haskell compile times such that a switch like this is worth it? I have some experience with generated Python, Rust, and TypeScript, and I have not found that compile time is enough of a concern that it would offset additional safety of a stronger type system. Like some of the siblings I'm now starting to do experiments with Lean and other tools to get even stronger assurance about system behavior.

To start the transition you can build your own tooling, in this case maybe start with the whole app stack including browser in an emulator, emulator controlled over a socket (write a harness that exposes all the inner debuggers, framebuffer, snapshotting, etc). Then generate a component inventory and likely failures for each, and generate pixel-perfection + internal state checks for each. Then migrate one component out (this may be quite a large project due to all the glue you'll need to make this possible). Then do the rest one at a time.

The big problem with doing it this way is you end up with something structurally the same as what you started with, but potentially more code if you e.g. end up carrying your own reimplementation of Web Forms.

The "magic here somewhere" in the car is in the design that reference aspects of animal anatomy (facial features, stance) and in the millions of dollars of advertising that prime the public with expectations about how they'll feel driving it, or how to see other people in the car. There's a direct connection there to packaging LLMs as chatbots, it gives them a recognizable shape and behavior that a lot of people interpret as consciousness and personality.

I'll add a few bits. Commercial leases are typically "triple net" so taxes are passed pretty much directly through to tenants and land lords don't need to worry too much about them. A very visible part of the "dead downtown" effect is due to small businesses that have terrible margins, high fixed costs (including rent), and don't survive losing 20% of their customer base. And finally, anyone paying attention saw that Seattle core downtown is a highly concentrated bet on office rental to the exclusion of almost any other use of space or reason to go there.

A few years back I did an art installation in one of the storefronts at the 2+U building and in the process got to study up on some of the issues and talk to a few people, the general theme was that everyone had a vested interest in focusing on possible causes that were external and fixable within a short time. I don't think that's reality.