codeisawesome

Would be great if there were more details on the costs of doing this work - especially when loading lots of tokens of context via repo mix and then generating code with context (context-loaded inference API calls are more expensive, correct?). A dedicated post discussing this and related considerations would be even better. Are there cost estimations in the tools like aider (vs just refreshing the LLM platform’s billing dashboard?)

The README is indeed clear, engaging and well-structured! The Screencap gifs are pretty helpful to immediately understand the scope of the project.

I’m not sure I’d agree with pivoting being a signal that prior work was discretionary. I think, in a lot of cases the strategic pressure from competition becoming more efficient or productive by capturing Internet traffic could have been a real reason as well.

It would be great if these questions also included a sub-question on distribution strategy, that's one of the hardest things to visualize as a developer from $0 to $500.

How does this compare to Agent Zero (frdel/agent-zero on GitHub)? Seems that provides similar functionality and uses docker for running the scripts / code generated.

I’d love to read a blog post from successful one person startups that are in the highly competitive spaces like DevOps tooling (uptime, analytics…) on how they go-to-market and differentiate.

Thank you so much for the detailed answer! I didn’t realize Ollama was OSS, I confused it with LMStudio’s licensing. I’ll try it out.

I would say I care a lot more about the perplexity performance than pure T(okens)PS… it’s good to be able to verbalize that.

Is there a tutorial on how to get that setup running step-by-step? I only found a GitHub issue (https://github.com/ggerganov/llama.cpp/issues/4439) that mentions that mainline llama.cpp isn't working for the model.

Bonus question if you have the time: there's a release by TheBloke for this on HuggingFace (TheBloke/Mixtral-8x7B-Instruct-v0.1-GGUF); but I thought his models were "quantised" usually - does that kneecap any of the performance?

I’m an immigrant. I’ll be the first in line to agree that all the demands (and the specifics of those demands: personal space, hygiene, clothing, noise etc) for assimilation by western societies that I’ve ever heard re: immigrants, are reasonable - assuming such luxuries can be afforded (nobody crams themselves 8 to a room by choice).

But, people aren’t robots whose movements are controlled by an on-off switch. The government introduced the means for people to arrive and work, and so the people arrived. They are continuing to arrive because the policies have not been updated yet. How is it the immigrants’ fault? Why the hate and the attacks on their dignity & humanity?

The nonstop online vitriol hurts me deeply to read - nowhere is “safe” - Reddit, HN, Instagram… the hate spewers seemingly spend all their time spewing on these platforms to manipulate opinions and tap into the fundamental atavistic psychological flaws of the human mind.

Thank you for sharing this openly, the content is personally useful for me.

Would be cool if there was a single site with an easy-to-use but comprehensive index of all such materials found in and around an average home that would make a chemist anxious, along with the safe alternative.

Thank you for typing out the explanation!

Thanks for the reply! Always been curious about this with various startups.

Wow, brand new product but already 'trusted by Oracle, Paypal, Amazon, Cisco' based on the logos I'm seeing on the home page. How was that achieved?

GPT-4 weights, the RLHF s/w & logs, data sources … if all of that were truly open, it would be incredible.

Young people also aren't rich, and live amongst the awful rent seeking economy built by those who came before. So it's not hypocritical to want to buy cheap, it's an unfortunate necessity. Also, the whole point of the push to make sustainability a mainstream concern is so that 'all those awful young people' can afford to buy sustainably produced products. Right now, unsustainable enterprises get to externalize the environmental costs on everyone else, and thus make sustainable & quality goods extremely pricey. It's a tax on morality - so let's eliminate that first and then point fingers about hypocrisy.

I would like to respectfully dissent, I like most of those things! Also Peter Jackson’s (first) trilogy wouldn’t be made…

Excited to see what positive changes are forthcoming for startup entrepreneurs!

Would be awesome for folks with irreparable damage or diseases like scoliosis if it could “just” be replaced though.

Ah, thanks for clarifying… I assumed nerve signals travel at the speed of light and the person responding to me was being sarcastic!

Would it be possible in a sci-fi near-future to transplant a new, lab-grown vertebral column, using something like this?

Yep, and what’s more, I’m sure that commenter is not referring to, say, ethnically German or French visa holders when disparaging “all those H1Bs” ;) I’ve learned to not be surprised by the persistent and nasty ‘community’ of these types of commenters here on HN, fortunately they’re not the majority.

The reason I use the term astroturfing is the complaint posts / comments all look & sound very similar with minor variations, like a “shaped charge” that detonates peoples’ emotional centers and taps into primal emotions like hatred and fear of the Other.

Very occasionally I see ‘real sounding’ and human sounding comments from every day people (instead of a professionally sharpened message). Those are now growing very slowly over time, which could just be a success of the propaganda.

So many people in this and every thread online (there’s a deluge on Reddit / Instagram even, almost feels like astroturfing) complaining about immigrants. Perhaps it’s convenient to blame other people.

Take a look at housing density and zoning, and fix the problems there. Get a more vibrant economy in the process: a society that aspires to be stuck in a ‘golden era’ is one that is chasing an illusion.

Julia, I agree with your take here, thank you for bringing this thought process into the mainstream. There are many other concepts this happens with and in other ways: people sing praises of the pedagogic excellence in Skiena’s & Sedgewick’s algorithm textbooks (and the awful EPI book by Aziz et al) but I hate reading them, they’re actually written horribly to explain things, IMO. I think this form of difficult writing on top of already difficult concepts is a weird type of gate keeping (perhaps sometimes unintentional?) and it should be tackled all over Computer Science by better writers who have an explanation style like yours.

I have to concur with this opinion with a comment because upvotes are not visible on HN: yes it’s absolutely alright to keep in touch with people (even at the cost of it looking like pretence at times) and then ask for help ‘out of the blue’. I have absolutely helped out when I’ve gotten such reach-outs and will do so again. We live in a society…

We should replace the term ‘trim fat’ with ‘cut flesh’ because it’s ridiculous and demonstrably wrong IME to assume management knows which resources are fat and which resources are actually crucial muscle that they would be (funnily) forced to re-hire for the sake of the health of the business.

Including but not limited to Apu, the pervasive caricaturing of brown skinned people in Western media as nothing but cringeworthy clowns or treacherous villains is hurtful to me personally. I’m sorry that the feelings of folks like myself “kills all the fun” for you, but I’m thankful that society is no longer held hostage to old fashioned tastes.

I don't know why but society appears to always need to over-correct. There is no middle.

This comment does not contain substantiation and only an opinion. So I’ll similarly state mine: this was not an overcorrection at all, it’s less action than is due to right the past wrongs.

Plenty of Indians thought that Apu was fine as he was.

An apology was due to the rest of the Indians & South Asians who didn’t think the caricature ‘Apu’ was “fine”, and one was issued; plus even better, the show runners have learned that you can actually make comedy without minimising or othering cultural / ethnic groups. Great outcome.