HN user

learned

82 karma
Posts1
Comments29
View on HN

A big caveat mentioned in the article is that this experiment was done with a small set (N=47) of specific questions that they expected to have relatively simple relational answers:

The researchers developed a method to estimate these simple functions, and then computed functions for 47 different relations, such as “capital city of a country” and “lead singer of a band.” While there could be an infinite number of possible relations, the researchers chose to study this specific subset because they are representative of the kinds of facts that can be written in this way.

About 60% of these relations were retrieved using a linear function in the model. The remaining appeared to have nonlinear retrieval and is still a subject of investigation:

Functions retrieved the correct information more than 60 percent of the time, showing that some information in a transformer is encoded and retrieved in this way. “But not everything is linearly encoded. For some facts, even though the model knows them and will predict text that is consistent with these facts, we can’t find linear functions for them. This suggests that the model is doing something more intricate to store that information,” he says.

It’s totally possible to decouple these if your python outputs plain JSON/csv into the data/ directory that you commit into the repo or generate just before build time. Then you can import that raw json data into an Observable .md file.

But if you want dynamically generated data at build time and want to make use of Observable’s dataloader automatic execution of data/*.json.py, for instance, while still maintaining a custom virtualenv for the project rather than your system python, you’ll need some way to specify that virtualenv’s interpreter while observable executes the build for the dev server or the full dist/ output.

So for both options it’s largely a matter of taste. I personally like using the poetry virtualenv because it’s simple to manage dependencies and the venvs in one tool, while letting me use observable’s dataloaders with third-party or custom python packages. It sounded like the parent comment wanted to use this type of approach so I focused it to that scenario specifically. I like the simplicity of the single command to generate the data and build the site.

I have a setup with poetry that runs the python data loaders in the poetry-managed virtualenv.

I just created a python project and then instead of `yarn run dev` to start the dev server, just run `poetry run yarn run dev` so the python is executed within the virtualenv.

This setup also lets you use a custom python package to define reusable and unit-testable code for the dataloaders that you can import into the *.json.py files to keep those really simple.

Whenever Tipasa comes up, I always think of Camus's quote from "Return to Tipasa":

But in order to keep justice from shriveling up like a beautiful orange fruit containing nothing but a bitter, dry pulp, I discovered once more at Tipasa that one must keep intact in oneself a freshness, a cool wellspring of joy, love the day that escapes injustice, and return to combat having won that light. Here I recaptured the former beauty, a young sky, and I measured my luck, realizing at last that in the worst years of our madness the memory of that sky had never left me. This was what in the end had kept me from despairing. I had always known that the ruins of Tipasa were younger than our new constructions or our bomb damage. There the world began over again every day in an ever new light. O light! This is the cry of all the characters of ancient drama brought face to face with their fate. This last resort was ours, too, and I knew it now. In the middle of winter I at last discovered that there was in me an invincible summer.

Spaced Repetition 7 years ago

Very cool! What format/content does a typical card contain for this category of algorithm cards you use?

I usually keep Invoke globally installed that way I can use it for setting up and interacting with pipenvs externally. Most of my calls beside the initial setup make use of 'pipenv run <command>' that way I never actually have to navigate inside of the virtualenv for most cases.

I'll second invoke. I use it for all of my python projects now and I love working with it. It makes it very clean to manage more complex tasks that have a lot of conditionals involved.

Yanofsky and Manucci's "Quantum Computing for Computer Scientists" is a smooth intro if you come from a CS background.

Nielsen and Chuang's "Quantum Computation and Quantum Information" is more thorough and advanced from a mathematical point of view. But it contains a primer on the linear algebra required.

There is also some really interesting epigenetics research focusing on age-related disease.

For example, Steve Horvath's group at UCLA has been refining an "epigenetic clock" using DNA methylation data to predict all-cause mortality in several species with a relatively simple test. It has the potential to be an incredibly valuable metric in the field going forward.

I use Anki as well and it really is fantastic.

I use it for languages, math, and code (there is a really good markdown plugin).

15-30 minutes every morning is enough to keep many things fresh in memory.

Graduated college and finally broke into the software industry. Now I have a manager who respects what I bring to the team and lets me build whatever I want. I thought it would take me a few more years to land a job like this. I feel very fortunate.

I'm the same way, and for me I believe it is a combination of being extremely intrigued and gratefully removed from my own world. Meeting an interesting person (romantic or not) is a great experience for that dual effect of mental stimulation (your "figuring it out" description) and being confronted with another person's reality which may feel much more vibrant than your own.

Amazon Go 10 years ago

I got excited when I thought this would be about Go usage on AWS, but this is way cooler.

Could you elaborate a bit? I think curated lists like these are good resources for developers that are unfamiliar with certain aspects of Android.

Curious to hear your thoughts.

I understand the confusion, but the term "serverless" refers to the developer not having to provision and maintain a server like an EC2 instance themselves.

On AWS' side yes there are servers powering Lambda, but developers do not have worry about them at all. The code just runs.

(Hoping this is a satirical comment, in which case: well done. If not...)

Many, many millenials aren't as fortunate to have a high-paying software engineering position like yourself.

For them, $20 per dinner every night is simply impossible.

This is a truly well-written piece, and it accomplished everything it set out to describe without a diatribe or personal attack on the anonymous professor.

Considering how viciously accusations and personal vendettas can be carried out online, I think it's a great mark of character that she refrained from such tactics and explained the injustice she felt in a levelheaded way.

I really like the simplicity of this. I find myself doing the same thing sometimes, e.g. opening HN almost unconsciously and then closing the tab immediately. Who knows, this might help break the habit!

Edit: (A simple suggestion that comes down to personal taste) It would be cool if I could see if I have DistractOff set to 'Stop' by just looking at the icon (in a similar fashion to how adblock shows the status via its icon) so I don't have to click into the plugin to see if it's on. But like I said, that comes down to personal taste.