HN user

agentofoblivion

653 karma
Posts22
Comments159
View on HN
www.graphneuralnets.com 4y ago

Basics of Graph Neural Networks

agentofoblivion
4pts0
www.youtube.com 4y ago

Graph Attention Networks (GAT) in 5 minutes

agentofoblivion
2pts0
www.youtube.com 5y ago

Modeling Guitar Amps with Machine Learning (+ NeuralDSP Interview)

agentofoblivion
1pts0
blog.zakjost.com 5y ago

A journey into the world of guitar circuit modeling with ML

agentofoblivion
1pts0
youtu.be 5y ago

How DeepMind uses Graph Networks to learn physics simulators

agentofoblivion
2pts0
youtu.be 5y ago

How Uber Uses Graph Neural Networks to Power Eats Recommendations

agentofoblivion
2pts0
youtu.be 6y ago

OpenAI API Is Magical

agentofoblivion
1pts1
youtu.be 6y ago

Graph Convolutional Networks made easy [video]

agentofoblivion
1pts0
aws.amazon.com 6y ago

AWS Announces Amazon Fraud Detector

agentofoblivion
8pts2
www.justice.gov 6y ago

Singapore man indicted in scheme to steal cloud computing for crypto mining

agentofoblivion
2pts0
news.ycombinator.com 7y ago

Every HN headline: Think you know something? the opposite

agentofoblivion
3pts2
blog.zakjost.com 8y ago

More than Algorithms – Building models in industry

agentofoblivion
3pts0
towardsdatascience.com 8y ago

Deep Convolutional GANs – Gentle Overview

agentofoblivion
2pts0
medium.com 8y ago

A 5 minute, gentle intro to Generative Adversarial Networks

agentofoblivion
3pts0
news.ycombinator.com 8y ago

Ask HN: How to get to top of tech field?

agentofoblivion
7pts6
medium.com 9y ago

Getting Started with Python for Data Analysis

agentofoblivion
6pts1
zakjost.com 9y ago

A Python Data Science Workflow Using Remote Servers

agentofoblivion
3pts0
zakjost.com 9y ago

Scraping Flight Data with Python

agentofoblivion
2pts0
www.kdnuggets.com 9y ago

Tips to Improve Your Data Science Interview

agentofoblivion
3pts0
zakjost.com 9y ago

Use Google Tag Manager for Easy Code Injection on Your WordPress

agentofoblivion
2pts0
zakjost.com 9y ago

An Open Letter to Open Letters

agentofoblivion
2pts0
zakjost.com 9y ago

How Ants Can Pick Your Fantasy Baseball Team

agentofoblivion
1pts0

I’m sure you can, but you can qualify for loans that do not make for a happy life. You start calculating CA taxes and what that monthly house payment is with todays interest rates and I don’t think you’ll be feeling rich. Broad strokes: while salary is double compared to Seattle, home prices are triple or more.

Quick numbers: monthly take home on $800k in CA is $33k (40% tax rate!). Monthly payment on $3M according to Zillow is about $20k a month. That leaves $13k for all family expenses and saving for retirement. In Seattle, our credit card statement averages $8k, so I wouldn’t feel great about that margin.

$800k sounds like a lot of money, and it is of course. I considered chasing it, because it’s within the realm of possibility for me. But when I looked at housing in the area, I was shocked to find that $800k was not enough. Regular ol’ houses are $3M plus, and the schools are shockingly not that great. I live in Seattle, where I own a home that’s expensive compared to most other places, and still I couldn’t make the math work without taking a big drop in quality of life. You could, of course, just rent, but $800k is such a big number that I just assumed if that was my salary, I wouldn’t have to think twice about affording a nice house.

This article works hard to paint one picture, and then presents arguments and evidence to the contrary. It’s basically a sob story about local musicians and ski lift operators not being able to afford housing, as if that’s a new problem. Then:

Even as Summit County adds waves of remote workers, it has experienced net negative migration since 2020

You click the link of that data and it talks about how the local government is desperate to attract workers and full time residents, rather than having mostly vacant second homes.

I presume they want to attract wealthy workers, given the choice, since that spending will be local and help the economy. So, assuming they get what they want, which is an influx of wealthy, employed people, it’s entirely clear what will happen to real estate prices. I’m sorry, but no one ever said you’re entitled to only having to play guitar in coffee shops to support themselves. That’s what college kids do, who don’t own houses.

I remember reading plenty of thought pieces a few years ago saying this was impossible, and that Uber was a house of cards gaining market share by subsidizing rides with investor money. That there were no economies of scale to bring costs down, etc., etc. I would love to see a "what we got wrong, and what we still have right" post from one of these people, but I won't hold my breath.

Yes, pride -> fall, I get it. Although it's the celebration of the fall from the sidelines that I'm questioning. I can feel the spite in your words--towards me, towards Musk, and the "other side", which are a faceless group you call the Volunteer Musk Defense Brigade, of which I'm apparently an unknowing member, I guess because I don't think some technical glitch is that big of a deal. You seem to feel lots of spite for people you've never met. I think there are plenty of tragedies written of people destroyed by their spite--maybe Notes from the Underground qualifies.

And in an irony of ironies, you crawl through my post history and take objection to me expressing my lack of empathy for those that make repeated bad financial decisions, but you're not only defending that very sentiment, but taking it a step further: enjoyment of the suffering. I hope you find peace, brother. I'm going to put my robes back on and get those last few meditation hours in now.

I’m pretty sure those are supposed to be moral lessons, not misery porn. But hey, you seem to openly accept the idea of enjoying another’s suffering, and I admire that kind of honesty. I hope it doesn’t end up causing you misery.

That's not how science works though. You generate a hypothesis about how something works, and then you execute an experiment that's designed to directly test the hypothesis as much as possible. If we had to just rely on slicing existing data, we wouldn't get very far. You can find data to confirm or deny about anything. Predicting the results before the experiment, and then confirming it works out that way is the much harder, and more valuable, part.

OK, but for a rapidly emerging super intelligence to occur, it seems like all of the relevant problems would need to be of that second type, and that's far from obviously true, and I would argue is much more likely to not be true.

You hit the nail on the head, and I train transformers for a living. This pervasive axiom that intelligence can just scale exponentially at a rapid pace is rarely questioned or even stated as an assumption. It's far from clear that this is possible, and what you've outlined is a plausible alternative.

My primary argument is that we not only don't have the answers, but don't even really have well posed questions. We're talking about "General Intelligence" as if we even know what that is. Some people, like Yann Lecun, don't think it's even a meaningful concept. We can't even agree which animals are conscious, whatever that means. Because we have so little understanding of the most basic of questions, I think we should really calm down, and not get swept away by totally ridiculous scenarios, like viruses that spread all over the world and kill us all when a certain tone is rang, or a self-fabricating organism with crystal blood cells that blots out the sun, as were recently proposed by Yudkowsky as possible scenarios on Econtalk.

A much more credible threat are humans that get other humans excited, and take damaging action. Yudkowsky said that an international coalition banning AI development, and enforcing it on countries that do not comply (regardless of whether they were part of the agreement) was among the only options left for humanity to save itself. He clarified this meant a willingness to engage in a hot war with a nuclear power to ensure enforcement. I find this sort of thinking a far bigger threat than continuing development on large language models.

To more directly answer your question, I find the following scenarios equally, or more, plausible to Yudkowsky's sound viruses or whatever. 1/ we are no closer to understanding real intelligence as we were 50 years ago, and we won't create an AGI without fundamental breakthroughs, therefore any action taken now on current technology is a waste of time and potential economic value; 2/ we can build something with human-like intelligence, but additional intelligence gains are constrained by the physical world (e.g., like needing to run physical experiments), and therefore the rapid gain of something like "super-intelligence" is not possible, even if human-level intelligence is. 3/ We jointly develop tech to augment our own intelligence with AI systems, so we'll have the same super-human intelligence as autonomous AI systems. 4/ If there are advanced AGIs, there will be a large diversity of them and will at the least compete with and constrain one another.

But, again, these are wild speculations just like the others, and I think the real message is: no one knows anything, and we shouldn't be taking all these voices seriously just because they have some clout in some AI-relevant field, because what's being discussed is far outside the realm of real-life AI systems.

Maybe I'm not "the average HN commenter" because I am deep in this field, but I think the overlap of what these famous experts know, and what you need to know to make the doomer claims is basically null. And in fact, for most of the technical questions, no one knows.

For example, we don't understand fundamentals like these: - "intelligence", how it relates to computing, what its connections/dependencies to interacting with the physical world are, its limits...etc. - emergence, and in particular: an understanding of how optimizing one task can lead to emergent ability on other tasks - deep learning--what the limits and capabilities are. It's not at all clear that "general intelligence" even exists in the optimization space the parameters operate in.

It's pure speculation on behalf of those like Hinton and Ilya. The only thing we really know is that LLMs have had surprising ability to perform on tasks they weren't explicitly trained for, and even this amount of "emergent ability" is under debate. Like much of deep learning, that's an empirical result, but we have no framework for really understanding it. Extrapolating to doom and gloom scenarios is outrageous.

You’re drinking from the academic marketing koolaid. Please tell me: where are these methods being applied in AI systems today?

And I’m so tired of this “transformers are just GNNs” nonsense that Petar has been pushing (who happens to have invented GATs and has a vested interest in overstating their importance). Transformers are GNNs in only the most trivial way: if you make the graph fully connected and allow everything to interact with everything else. I.e., not really a graph problem. Not to mention that the use of positional encodings breaks the very symmetry that GNNs were designed to preserve. In practice, no one is using GNN tooling to build transformers. You don’t see PyTorch geometric or DGL in any of the code bases. In fact, you see the opposite: people exploring transformers to replace GNNs in graph problems and getting SOTA results.

It reminds me of people that are into Bayesian methods always swooping in after some method has success and saying, “yes, but this is just a special case of a Bayesian method we’ve been talking about all along!” Yes, sure, but GATs have had 6 years to move the needle, and they’re no where to be found within modern AI systems that this thread is about.

Give me a break. Very interesting theoretical work and all, but show me where it's actually being used to do anything of value, beyond publication fodder. You could also say MLPs are proved to be universal approximators, and can therefore model any function, including the one that maps sensory inputs to cognition. But the disconnect between this theory and reality is so great that it's a moot point. No one uses MLPs this way for a reason. No one uses GATs in systems that people are discussing right now either. GATs rarely even beat GCNs by any significant margin in graph benchmarks.

Not sure why you’re downvoted—the evidence is in your favor. This whole thread is basically about the EU not being brought along in what most consider a tech revolution, and it’s likely a direct response to their laws that are well intentioned, but practically onerous. Arguable, we recently saw the same thing with labor laws. The net result will be a smaller presence of American tech companies/jobs/services in Europe. Many self-identified Europeans here seem to be in support of that outcome—Godspeed!

This is the web privacy version of, “but that wasn’t REAL communism.” Look, you guys made a law, and what happened happened. When someone criticizes the law because of the consequences it led to, you don’t get to whine, “but it was the fault of the people responding in a way that we didn’t intend!” If your best argument is that the law was vague as to what compliance meant, then that sounds like a problem with the law.

If you have to finance it, in what way is it a modest car? It’s not as if people are financing $2000 junkers. I’ve paid cash for every car I’ve owned, including when I was a teenager flipping burgers. Why aren’t these 59% buying junkers instead of going into debt and paying interest on a depreciated asset? Are you just going to blame America and society, or do we blame the people signing the loan papers at some point?

That’s incoherent. If you want to buy a home, but cant right now, financing a vehicle is an issue. You’re not “spending your money elsewhere”, you’re taking major debt to drive something you can’t afford, and paying dearly for it at the cost of your real goal, which is now further away than it otherwise would have been.

In my experience/opinion, a major problem is people think in terms of monthly cash flow when trying to decide if they can afford something. That’s the fast lane for ending up in a place where you’re breaking even with monthly payments and never having much to show for it. Or, “the average person” I think you called them. The very same person that can’t come up with $600 in an emergency or whatever.

So 66% say homeownership is hopeless and 59% say they are focused on the goal of owning…a car? Yes, if you’re currently unable to own a car, I can see why home ownership would appear hopeless.

I’m sorry, but I just don’t have the empathy. I see the horrible financial decisions, and advice, all around me. I suppose this means the bulk of the 59% are financing their vehicles? If you have nothing to your name except debts, and want to change that, you should drive a POS. If you would like to own a home, but currently rent and have $40k in car debt, you’re not doing it right. I make quadruple what many of my friends and family make, and most of them have nicer vehicles and a driveway full of toys, like campers and motorcycles and boats. I went from making $65k in the Midwest to owning a million dollar home in Seattle in about 6-7 years and paying off all student debt, on a single income, while having multiple kids. I didn’t do anything crazy, I just saved more than I spent, invested in index funds, and never took on debt.

Similarly, I find it effective to simply writing down what the next step is, and what’s interesting/challenging about it in a couple sentences. It seems to directly solve the problem that this “trick” is indirectly solving, which is reducing the load of knowing how to get started next time.