HN user

denimboy

189 karma
Posts14
Comments54
View on HN

I think the real story here is auto embeddings:

  https://manual.manticoresearch.com/Searching/KNN#Auto-Embeddings-(Recommended)
and hybrid search:
  https://manual.manticoresearch.com/Searching/Hybrid_search#Hybrid-search
With these two features you can set up RAG with hybrid search in about the time it takes to install the server and insert the documents.

Manticore is really performant and uses far fewer resources than similar search engines like elastic.

Mikula, 33 years old, spent more than a decade selling cars and auto financing at dealerships. Now he deploys his fluency in car-dealer speak and his encyclopedic knowledge of dealer inventory to try to talk down the sticker prices.

I may be over optimistic but "car-dealer speak" sounds like something an AI could be trained on and access to inventory might be a couple of tool calls to the appropriate APIs.

I knew a dog that had a decent vocabulary. He would visibly react to words like CAR, WALK, or PARK. He also understood PARTY and MEAT and would wag his tail for PART and lick his chops to MEAT. One time we were going to a BBQ so I explained to him we were taking the CAR to a MEAT PARTY and he got super excites, wagging his tail and going to the door all while frothing at the mouth. Anecdotal but it certainly looked like he could synthesize concepts and imagine what was going to happen in the near future.

I've done a few other experiments with my foreign speaking friends and it appeared to me that dogs understand the language their owners speak primarily.

This guide explores how to evolve Emacs into a robust Python IDE. Whether you’re writing simple scripts or managing large-scale projects, you’ll find a setup that aligns with your engineering needs and reflects the power of Emacs customization.

I ate at El grullense no 1 on middlefield almost every day in 1995. 5 dollars for 5 tacos at the time. No salsa bar but they put enough of the delicious ranchero salsa and pickled jalapeño for a perfect plate.

I think the ones on el Camino actually came a couple years later. One tiny one in front of Safeway and another down south a bit. I think this is the one he ranks as number one.

I really recommend trying anyone of these places if you can. Really the simple ranchero style is delicious and unlike other Mexican food you’ve had. Sorry not a lot of vegetables but you can skip the soda and get an agua Fresca or carrot juice to make up for it.

Privacy-focused search engine DuckDuckGo has a new optional artificial intelligence feature called DuckAssist. Users of DuckDuckGo's browser apps or extensions can access a beta version of the feature now, for free.

Smell is the thing that gets me a lot of the time with classic cars too.

I had a 1972 Triumph Bonneville which had a "tickler" button on each carb instead of a choke. That meant to start it up you would press each tickler button until a bit of gas shot out invariably on your hand but also the engine and the sometimes hot exhaust. Only after this ritual was performed could you jump on the kickstart (no electric start). So you end up smelling like gas.

Q: Why to the British drink warm beer? A: Because Lucas makes electrics.

914 had a type 4 engine which it shared with the type 2 VW bus. However the transmission was completely different from the bus. The 914 had 5 speeds and the bus only had 4.

A lot of the article is about "you'll never find 2nd" which is in large part to the weird shifting pattern. Reverse is where first usually is, first is where second usually is and the rest are in a kind of off by one pattern from there. This was actually considered a feature since supposedly it allows the driver to make the shift from first to second faster.

The vagueness of the stick is very true and something every 914 owner can relate to. Those first couple weeks you spend some time hunting for the right slot. I went from first to fifth many times before a muscle memory was developed and I didn't have to think about it.

StarSpace

StarSpace is a general-purpose neural model for efficient learning of entity embeddings for solving a wide variety of problems:

    Learning word, sentence or document level embeddings.
    Information retrieval: ranking of sets of entities/documents or objects, e.g. ranking web documents.
    Text classification, or any other labeling task.
    Metric/similarity learning, e.g. learning sentence or document similarity.
    Content-based or Collaborative filtering-based Recommendation, e.g. recommending music or videos.
    Embedding graphs, e.g. multi-relational graphs such as Freebase.
    Image classification, ranking or retrieval (e.g. by using existing ResNet features).
In the general case, it learns to represent objects of different types into a common vectorial embedding space, hence the star ('*', wildcard) and space in the name, and in that space compares them against each other. It learns to rank a set of entities/documents or objects given a query entity/document or object, which is not necessarily the same type as the items in the set.

OP calculates the Eigen Grandito, which is named after the Onion article, "Taco Bell's Five Ingredients Combined In Totally New Way", which, in more mathematical terms, asserts that Taco Bell's dishes are all linear combinations of the same ingredients.

Actual code is here

   http://www.limerent.com/projects/2020_11_EigenGrandito/
but discussion is surprisingly interesting.

A Django app for managing training data and active labeling would be a nice complement to this. Something similar to AWS GroundTruth.

We should start thinking about an ML life cycle were data is ingested, data labeled labeled, models trained, model tested, model deployed and monitored. Rinse, lather, repeat.

We lost something when the catalog was overtaken by the search engine. With a catalog you could aimlessly browse and passively learn a slice of what was possible and available in some space.

Of course a catalog is edited or curated which makes it biased but maybe more human editorial direction isn't such a bad thing in our current world of algorithmic optimized, SEO, echo chamber, click-bait choices.

Browse-ability allows non-focesed search and informs choices that are made at a later time from passive data gathering.

Couple of ideas for you

- Consider injecting information with "oracles" An oracle is a kind of virtual user that likes one thing and only one thing. For example they only watch movies that have been tagged sci-fi. This sci-fi oracle adds information about sci-fi-ness to your data which is useful for several things. It helps with the cold start problem as new items can be automatically tagged by the appropriate oracles and get past the zero information horizon quickly. Also you can measure a users sci-fi affinity by measuring that users similarity to the sc-fi oracle.

- Another way to think about co-occurrences is as connected nodes in a digraph. You have users and items and connections between them (user watched video). Start with an item and traverse all the links to the other side (all the users who watched this video) then for each user traverse to the items side (you can roll up the occurrences for a score) and you have similar items. Works equally as well for finding similar users.

- Create an "average user" and use that as a seed for new users. If we know nothing else we should expect a new user to be close to average. This means they will probably get recommended the most popular items but

- Find items with divisive scores or groups and ask new users their opinion on those items to find out about them. After a new user gets created consider asking them their opinion on five of these divisive items. Their ratings should swiftly put them in an informed space the way taking five steps down a binary tree does a lot to reduce search space.

- I like the way you use simple plus one smoothing for your scores. I'm not sure why this doesn't get used more often.

Good luck with the project!

ls -lR > INDEX for file names then use glimpse software to create a full text index.

Move these to the root of the volume you are backing up and burn dvd or whatever.

You can keep these indexes together on your live volume somewhere and search them all together

Glimpse indexes text files. Other files require preprocessing. There are solutions for this too but it’s more complicated.

I don't doubt this but do you have any documentation?

Asking for a friend who uses XFS on LVM for disk heavy applications like database, file server, etc.