HN user

dbecker

1,340 karma

I help companies use LLM's.

Formerly: Data Scientist at Google, VP Product at DataRobot, ran consulting engagements for 6 companies in Fortune 500. Created `Kaggle Learn`

Posts14
Comments501
View on HN
Falcon 180B 3 years ago

Were you using the base model or the conversational model?

The post says:

The base model has no prompt format. Remember that it’s not a conversational model or trained with instructions, so don’t expect it to generate conversational responses—the pretrained model is a great platform for further finetuning, but you probably shouldn’t driectly use it out of the box.

I've tried AutoGPT agents about 10 times for tasks that seem like they'd be a good fit. That meaning they need to scrape current data, but otherwise they'd be possible for a person willing to put in some time to combine data sources.

An example is "create a table showing the current ratio of rental/sales prices (on a per square foot basis) for residential properties in the 10 most populated counties in Colorado."

I'm still yet to get a reasonable result from trying this.

I tried this a few times about a month ago. It sounded cool, and the experience of using it was even better than I expected.

I'm glad it was reposted so I get another chance at developing a habit of using it.

Streamlit is awesome.

It's nicer than sending someone static results, and it isn't much more effort.

And vastly better than sending a notebook to someone unless you expect them to modify the notebook a lot.

And learning time to make Streamlit useful for a small internal apps is probably ~15 minutes for most people.

The author starts with

The data science world may reject me and my lack of both experience and a credential above a bachelors degree

More likely the data science world will reject him because he is so confident a field he has so little experience or knowledge of.

Data scientist is a profession rather than the name of an academic field. So data scientists' job is to solve practical problems. That involves a lot more than class assignments, and in some cases involves using machine learning to maximize predictive accuracy (because common ML models like gradient boosting capture interactions and non-linearities in a richer way than the GLM models the author is familiar with).

Their argument "that's a garbage model because we can't reasonably interpret underlying parameters," is replacing their personal criteria above what is needed to solve some problems.

They can blame it on only having bachelor's degree. But the real problem is the belief that a bachelor's degree taught them everything there is to know, and those in the DS field are ~ idiots who got lucky enough to be paid more.

I'm the lead on the Kaggle Learn project, and the author of the deep learning track.

I'm happy to answer questions here.

I agree with the commenter saying you need to do your own projects to understand these topics.

Our deep learning track is meant to be the fastest path to knowing enough to do your own projects. You can do the entire track, including the hands-on exercises, in a single sitting.

We won't make you an expert in an afternoon, but you'll know enough to start doing your own projects. For most people that's also the point where Deep Learning becomes fun enough that you'll find time to keep learning.

Kaggle Learn is still in a very early stage. We'll add more lessons soon. But we'll stay committed to the goal of getting you up-to-speed quickly, so you can take on your own projects.

It's disappointing to see links to the abstracts on the front page of HN (given the paper itself is behind a paywall).

In this case, the find some non-zero effect, but call it zero because the difference was not statistically significant.

That's likely a reflection of their small sample size rather than evidence for the null hypothesis as the title suggests.

But it's hard to know, or even have an intelligent discussion about it, since the paper itself is behind a paywall.

This list seemed to miss almost all modern deep learning tools... with the exception of theano, for which the version info here is years out of date. But this small detail at the bottom of the page explains it:

This page was last modified on 10 November 2014

Economic research can be roughly divided into three subfields: Macroeconomics, Micro theory, and Empirical Micro.

The first 2/3 of an undergrad curriculum at most universities is all macro and micro theory. So, most of what an undergrad sees is prove this or solve that.

But far more econ faculty focus on empirical work for their personal research.

It's possible that we focus on theory because it spreads economic orthodoxy faster than empirical work. But economists spend much less time doing theory when they are outside undergraduate classrooms.

The myth that you can build a billion-dollar business without some shady dealings needs to die

Do you have an explanation for why Uber has been outed with so much more shadiness than most (if not all) other billion dollar tech companies?

Have they done more? Are they worse at PR? Something else? Do you dispute that they have been exposed for more shadiness?

I have an MBP and an iMac, both of which came with nvidia GPU's. The MBP is older, but I doubt either of these are atypical machines out there today.

We tried to mirror the original analysis as closely as possible - we did 5-fold cross validation but used the standard MNIST test set for evaluation (about 2,000 validation samples for 0s and 1s). We split the test set into 2 pieces. The first half was used to assess convergence of the training procedure while the second half was used to measure out of sample predictive accuracy.

Predictive accuracy is measured on 1000 samples, not 20.

if you try really hard and get lucky enough, you can probably do as well as a simple regression in this case.

Maybe you aren't familiar with deep learning: but this isn't "trying really hard." This is doing basic stuff that anyone using deep learning probably knows.

And deep learning doesn't just "do as well" as the simpler model. It does meaningfully better at all sample sizes.

If you are Google, Amazon, or Facebook and have near infinite data it makes sense to deep learn. But if you have a more modest sample size you may not be buying any accuracy

The author explores sample sizes up to 85, and then suggests this is the relevant range except at Google, Amazon, Facebook, etc.

But the VAST majority of people considering deep learning have sample sizes between those extremes. Results on small samples are interesting, but it's disingenuous to market this as typical of the world outside Google.

Solar Roof 9 years ago

The $80k roof is especially scary if you live in an area with any type of natural disaster risk.

The area I live in just had a huge hail storm. Most roofs in our neighborhood will require repairs. That's a bummer with asphalt shingles, but it would be a lot worse with an $80k roof.

Most people won't think about those risks, but over the time period you need to consider for a roof, it's a big risk in most places.