Apache Ozone has multiple 100+ petabyte clusters in production. The capacity is on HDDs and metadata is on SSDs. Updated docs (staging for new docs): https://kerneltime.github.io/ozone-site/
HN user
kerneltime
https://github.com/oneconcern/datamon Had written this git for data tool few years back (works with GCS but can be made to work with S3) 1. No server side 2. Immutable data (via GCS policies) 3. Ability to mount data sets as filesystems 4. Integrated with k8s. It was built to work for the needs of the startup funding it, but I would love it if it could be extended.
What the author is up to now https://www.silverthreadinc.com
That is the share of value capture from the market that they just made real. There are legitimate scenarios where first movers do not have an advantage.
The tag line within SDM was that it is a program for those who want to lead engineering and not leave engineering (MBA) I think the meta framework for thinking and being able to step away from the madness of releasing a v1 product and having tools for thinking about the bigger picture. Also, MIT.. it is a very rewarding ecosystem to be in.
ESD.34 ESD.342 16.863J 15.871 15.783J ESD.33 to name a few Also, 15.965 my favorite and offered by my thesis advisor Michael A. M. Davies: Based on which it is likely that OpenAI won't be walking away with the cake.
MIT has an amazing program for System Design and Management. Dan and I are both graduates of this program. Some of the courses I would recommend include System Architecture, System Safety, and System Dynamics. Most of the content is available on OCW.
What is taught is not software-specific, but is entirely applicable to software, outside of the world of 'throw everything on the wall and see what sticks' as long as the venture capitalist can be shown growth at all costs. I wish more software developers were mindful of complexity and architecture.
I came across this when investigating keto and lipid profile. Experiments such as this one and continuous monitoring impact makes me believe that the revolution in medicine to keep us healthy will come from tech innovations. https://cholesterolcode.com https://citizensciencefoundation.org https://ownyourlabs.com
Note the word competent.. Also, insurance companies will often have opinions on what tests were valid and might reject paying for tests. So if a DB admin spins up a cluster to debug his hunch of a SQL Compiler issue, that bill will be paid by the customer and not the insurance and might bankrupt the customer.. I had an apt with a cardiologist where he literally read a standard template of care and when I tried to see if he is interested diving deeper into inflammation causes, tests and ways to avoid the standard medications which only deal with symptoms he was least interested as it all dealt with metabolic issues and not the heart per se.. the system is run to see how can a patient be billed and who owns the organ. Insurance companies have swim lanes and medical practitioners are educated and trained to remain in those swim lanes.. as long as things are kept simple for prescribed cures and billing, the gravy train continues.. it not in their best interest to solve the problem. Have you ever been to a annual physical where god forbid you discuss issues that are not part of the normal annual health checkup? You will actually be asked to schedule a separate appointment as the billing for that is separate.. A lot of "functional medicine" happens outside of insurance payment coverage. Some more interesting things to follow: https://cholesterolcode.com/ https://cynthialimd.com/faqs/
Yeah don't talk to a DB admin about SQL compiler issues.. :-P
I recently came across a term "Functional Medicine" https://www.ifm.org which looks at the body as a whole and tries to root cause metabolic issues which can often result in IBS cures.. most older medicinal practices always considered the body as a unified system which make sense in terms of how it is engineered but modern medicine tries to break things down and often misses the cross specialization impacts. Best of luck!
Wow! Allegations without context or material. Who would have thought someone on twitter would sling mud!
If the Indian government is going to implement the Aadhaar card.. I rather would like folks such as Viral Shah on the team to make sure the implementation is headed in the right direction.. The scale and operational challenges faced are significant. The context for that twitter thread is a leak of private data that occurred. If competent engineers are not involved, it will only get worse.
This is analogous to the US Govt implementing a plan to provide universal healthcare but random developers getting angry when a competent engineer works to make sure it is done right..
I find this paper to be one of the earliest and one from which other consensus algos can be derived: https://en.wikipedia.org/wiki/Shared_register#Implementing_a...
Homepod are not trash! They sound amazing! I love them..
My LG washer dryer app needs to know my location... why? They won’t let me add it without giving app location access.. so does the YI camera now.. this is getting a bit out of hand.
Yes there are trade offs..
+1
I have been tracking luthiers and it is fascinating how detailed and varied each builder is.. the likelihood that the instrument will sound good is well correlated to how much time the luthier puts into refining his process. I don’t understand the rational for not wanting to learn DS/Algos this is just one part of it, there is also the whole business/customer side of writing code. There is a difference between never getting a demanding customer who understands the difference between a good instrument and something glued together and not wanting to know how to do something more than glueing it together is appalling. As a coder if you want to learn DS/Algos and you do not find a job the values that maybe there is more to learn so that find a job that values it. It will be competitive and you can fail but it is not wasted.
A good wood worker tends to know the tools of the trades and more importantly know when to not use a tool and when to invent a new one.. That said not every cabinet is a work of art some are just there to be functional for long enough to justify their creation. I feel system interviews that dive deep about decisions and insights are far more useful than hitting a leetcode jackpot. Though it puts a high bar on the interviewer as well.
I think this is the case of kettle self reflection? Unless any one who differs cannot be an American? The original author, many of us who comment here, are we reflecting on our own policies?
An excellent summary!
"What about"-ism is on the rise..
It is wise to improve our own self and not use others weakness as justification for our own.
Loss of reputation causes disastrous impacts one or the other and watching our own politics is similar to watching a self destructive person justifying their own actions.
Smugmug.. I love those guys..
Wow! no sign of this or any other thread from the front page..
Bringing in raw talent and nurturing them here has been successful for USA. That is the student visa route.. I think you are referring to H1B?
So instead of investigating visa mills, lets kick students out of US who are attending Georgia Tech? What was the saying about throwing the baby with the bath water..
During the 2008 crisis, EMC^2's CEO Joe Tucci announced a company-wide cut in salary instead of laying off people... I think that was a prudent decision. Keeps morale high, team culture intact and plans in place. They did change the ESPP rules (close price) but never restored the old ESPP (min of open and close) after they restored the pay :-P
From what I understand, a lot has to do with IP ownership, this was developed at MIT and any licensing deal is not as profitable as being able to sell a product. Thus, to make a VC/equity funded commercial venture of it they have to develop a product.
MAFANG!
At one point Yahoo was invincible.. I really need a way to find an alternative to gmail for email where I am in control and can replicate it when I like.
When I had a visual shield between my screen and people walking around.
When there is enough space that some one else's conversations did not cut through my headphones which do not play music by just cancel noise.
When what is the problem is articulated well (I do not mean details for a task, I am ok with a problem with no known solution but there needs to be a common articulation of success..)
When my co-workers are emotionally secure enough to have a discussion where any and every idea is open for a challenge. I hate to say this but "disagree but commit" is a good mantra as long as "disagreement" is not used against you, actively or passively. I burn more energy navigating my path around egg shells and consequently have less for what I need to do.