digitalzombie

Statistics is "the practice or science of collecting and analyzing numerical data in large quantities"

That's not true.

Statistic can analyze data in small quantities you can read up on it with nonparametric statistic. At least half of nonparametric statistic deal with small data (mostly through use of ranking). With Bayesian stat you can just assign a prior distribution.

I think the best way to describe statistic is that it uses data to infer the population. A subset data via sampling and infer a statistic (mean, median, whatever) about the population at large.

More often than not I'm just surprise as to why Data Science is so big when seemingly it seems like statistic does every freaking thing with data. From how to correctly sampling, designing experiment to collect the correct data to answer a hypothesis, making sure the data aren't bias, etc.. It deals with designing the data from inception to end, including either collecting the data or data given to you already. On top of dealing with problematic data such as missing data, imputation, etc..

Seriously Intel is already struggling after buying Nervana.

I went to their shing dig and they were working their butt off to wow the developers who were invited. When I asked for hard number they were very mum about that and very evasive.

The timeline for Nervana chip have been always seemingly in this mystical horizon that is never solidified to a real date but over yonder.

Google is going to pull this crap? They got better software expertise than Intel though they may be able to do it. But after that fiasco with Angular 1 to 2 I wouldn't trust Google with any early version number.

Their power cord keep on dying for my macbook 2013.

I had a temp iphone and it took over a lot of my texts by redirecting it toward apple's server first. When I got my android back I receive no text msgs from my friends who have iphone.

It also seem like they're making cheaper stuff so they can increase their margin via tech support and peripherals.

I agree they should invest more in software so they don't have to resort to these crappy tactic.

Also they should make a cheaper iphone region lock it to china and india only if they want to increase their margin. Their current strategy for these markets is stupid.

You can harvest data and anonymize it. My friend at Google supposedly is doing this via research at Google. I'm not going to say Google care about our privacy as much as Apple but they are researching this probably for medical and for when opportunity arises. To be perfectly honest I think Apple's stance on privacy is all marketing, there are cases where they refused to unlock phones for the FBI but there are other cases where they ship recordings of your talk to SIRI to a third party company.

Programmers should have a union.

Especially the ones that are working in the gaming industry.

It's just statistic.

How you collect your data can introduce bias and statistic have a whole range of topics on how to collect data without introducing bias and systematic techniques to sample data. Stratifying data if a certain group is under represented, random sample, etc... Survey analysis goes into hardcore details on how to sample a population to accurately do inference and it's an interesting statistic sub field if anybody is interested.

ML tends to be more here's the data already do something with it.

Statistic encompass everything about the data including how to sample, collect the data, and designing the experiment to collect the correct data to answer your hypothesis. Where as ML is usually here's the data, go figure out what you can get out of it.

anyone have a good strategy?

I left the industry for data science. Went back to school and fall in love with statistic. Going to try to get a biostat job. I'm trying to do side projects web app and not give a damn about the flavor flav of the month.

I don't know if that's a good strategy.. it's basically peacing out. I also move most of my tech stack to plain old stuff like a simple mvc framework and no frontend rendering.

More data is better.

You can reduce it via PCA one of the many techniques in multivariate statistic.

You can do anova to select your predictors.

In general you can use a subset of it using the tools that statistic have provided.

Complaining about messy data... welcome to the real world. As for complaining about non-reproducible models , choose a reproducible ones. I've only done mostly statistical models and forest base algorithms and they're all reproducible.

All I see in this post is complaints and no real solutions. The solution that's given is what? Have less data?

The results were consistent with asymptotic theory (central limit theorem) that predicts that more data has diminishing returns

CLT talks about sampling from the population infinitely. It doesn't say anything about diminishing returns. I don't get how you go from sampling infinitely to diminishing returns.

Elixir have better syntax because it's familiar.

I did play around with Erlang a few time. I really love the comma and period. It really nest and group the function patterns together.

For Elixir you just have to put them near each other. The function are enclose in a do/end block. And you put those similar pattern function next to each other. I believe you can move those pattern function around.

Other than that I can't recall much else. Prolog syntax is foreign but I'll admit I can see myself learning Erlang pretty fast since the language isn't "big" compare to Java or Scala. Like wise Elixir is a small language too with added macro (I don't recall Erlang got this) feature. Elixir also have better tooling baked in (mix/hex, doc, lint, etc...).

Also the Erlang community sucks. This is my personal experience but I vividly recall attending a meetup. The group meetup have a discussion about Erlang's adoption and how to get better adoption. I told them Ruby got popular because RoR other wise people would have chose Python and call it a day. Erlang should really have a killer framework like a web framework. Everybody thought it was ridiculous.

And you know what? Elixir came along and so did Phoenix. Phoenix may not be the only thing that got Elixir popular, Elixir got toolings from the get go. Jose and those people are from the industry they know what was needed. They came from Ruby.

No please.

I do not want a monopoly in x86.

Intel is very greedy in their cpu prices. Their consumer cpu never gave the option of ecc memory and have gimp certain things. AMD was more flexible. Having two company competing will be great for the consumers.

Uh... pretty close knit. There were no search engines. There were only directories with dedication toward search hobby/interesting.

I was pretty big into anime fanfic so anipike was the web directory I went to. The fan sites via xoom, geocities, tripod, angelfire are linked via web ring. Web ring is like a circle of website with similar interest and individual anime website would have a web ring to help find other similar website within the web ring. https://en.wikipedia.org/wiki/Webring

The ads weren't bad it was banners and it blinks or slide across like marquee html tag. The majority of the web ads felt like print paper ads less scientific like today. Today ads they got metric, funnel, and trying to get more eyeballs on it, very gamey to get your attention which I believe leads to addiction and click bait stuff.

The user involvement was less, social aspect seems to be around hobbies. Now a day you can try to catch up with your friends via facebook, snapchat, etc.. it seems like everybody is trying to get approval by online friends by having that awesome picture while traveling and doing stuff.

There was a famous newsletter I follow for my fanfiction too (rec.arts.anime.creative).

I tried reading Pearl once. I couldn't get over his tone.

Andrew Gelman summarize it pretty nicely his take on it.

Coming from a statistic background, casual inference is a growing thing now and several government sponsor research have been pushing for it.

Casual inference from statistic point of view is base on missing data, basically Rudin stuff. It's pretty dang interesting to me. I'm sure there are many ways of looking at the same thing. Linear regression you can look at it in more of a optimal math problem with cost function or you can look at it in statitic using maximum likelihood estimation. Both have it's pro and con, with MLE you get a confidence interval. In my bias opinion I feel that statistic is only about data and it's a great domain for casual inference.

There's no need to put a field down to make yours better. But if it's constructive criticism (pro/con, contrast) I think it make both fields better. Pearl attitude is off putting when you try to read his stuff. We're all human and have vary degree of ego, if you're going to try to convince us that do calculus and your ways is better be objective about it or word things better. If you don't want to convince people then just be blunt as hell.

averages Hide too much.

I had to read the article because of your comment.

You're wrong.

When competent researchers talk about salary/income they always do median because average doesn't account of skew like Bill Gates.

If you do a ctrl+f with mean or average you won't find it. But if you do ctrl+f and search for median you'll find it.

Considering they sold most of their hardware department, such as harddrive to Hitachi and thinkpad to Lenovo, and went focusing on patents, this is a change in their image. I had the view they were risk adverse, to be using Elm is interesting.

WeHarvest what is their product? Soylent green?

I dislike coding in javascript for large project. The language was originally for small stuff.

NodeJS bought it to backend and the language itself weren't meant for it. Since then ECMA5 and stuff tried to fix these shortcomings. But you can't expect me to love javascript's weakly type versus elixir or python's strong type (strong not static, as in it doesn't implicitly type convert stuff like javascript). It's a nightmare and concurrency model in NodeJS in my opinion is subpar compare to Elixir's.

I don't know if you're joking or not but:

Medicaid only help the poorest. You need to be at a certain income to get it. I am a graduate student that is currently on it.

Medicare-for-all helps everybody regardless of income. Everybody is entitle to it regardless if you're poor.

Mastodon is just twitter. I'm on it... unless I'm missing something.

It doesn't completely replace it at all and missing a lot of functionalities that FB have. The ones being, chat room, event invitation/planing, birthday reminder, photo albums, group, etc...

Nobody cares how long it takes to train a model.

That's a reckless generalization. I care.

My thesis would take forever if I didn't do any optimization. Also my data is 20 rows with ~6000 predictors.

There are models out there that can take months! I worked on one that took months. We had to tweak it and optimize it to see if we can get it to acceptable training time.

Most machine learning algorithms that aren't statistical base doesn't give a CI. From a statistical stand point it doesn't give a sense of how good your prediction is. You can get a general sense with just CV.

Also your parameter is not inferable like in statistical algorithm. This is where I see people saying Deep Learning isn't interprable and there are research into this area. If you compare time series stat forecast algorithm with deep learning you at least get a CI on stat algorithm.

Randomly dropping node is pretty magic in my mind.

While I don't know much about SVM I know it's mathematically proven so there should be a way to interpret SVM fitted model.

I sure as hell wouldn't use ML in clinical trial for drugs. That's why biostat is a thing.

That's just marketing speak.

Pretty sure it was the initial thinking when Neural Network was created and it have move beyond that. I think people who know surface level only repeating this tadbit that's out of dated.

It's even in the official wikipedia article (https://en.wikipedia.org/wiki/Artificial_neural_network).

Everything you've stated was basically a personal opinion that could have been verified via google...

"it is good enough that I can rely on it?"

It's called longitudinal analysis or survival analysis, depending on the question being asked.

We statistician got test and models for these.

You can rely on it if the people who are conducting the experiment are competent and know what they're doing.

I remember using Sabayon Linux way in the early days it came with or probably I tweaked it with Compiz and Beryl. The ATI drivers were something. So bleeding edge distro that it was crashing randomly. I had a 6 sides cube with each side representing a different desktop screen and wall paper. Fun times.

I've been through netscape, prodigy, aol, and IE5. Mozilla really made the web better during those days as IE5 dominance really stagnant the web scene at the same the current web dev pace seems crazy. I'm glad for innovation and for mozilla. Will always be a fan and will be using this over chrome any day. I trust Mozilla more than Google.

The article seems to imply Sandberg approved of anti semetic attacks against Soros, conveniently ignoring the fact that Sandberg (& Zuckerberg) is a Jew herself.

That doesn't mean anything and such terrible logic.

There are many cases of Neo Nazi that are Jewish. Just cause they're Jewish doesn't mean they can't hurt other Jewish people.

Well, he is an investor who has a history of causing financial damage to whole countries by betting against their currencies.

So you're judging him on the fact that he plays Forex and short?

If they didn't want that then it should be made illegal. This is a dubious statement.

Elixir is not statically typed. In 2018 for a new project its hard to justify not using a typed system to make code more likely to "run" properly out of the gate or increase your confidence while refactoring it. Even a simple type system like golang's will do. No need for something complex like C++/Java/Rust etc.

Elixir was inspired by Ruby iirc and it was a project started in 2012 according to the elixir documentary by Honey.

Scripting languages without static typing have its place.

I don't believe all languages even new one starting in 2018 should be type. It depends on the language goals.

If you want a actor concurrency model with type then try Pony.

In Erlang you only care about cases that you care about. The let it crash mentality. Pattern matching is also good here too.

In Go you have to write code to catch unwanted error and figure out what can go wrong.

So there are many things in Erlang where it soften this no type weakness.

How else is he supposed to discuss it?

Most Google employee that didn't like the China or Pentagon collab protest by leaving.

His memo from the get go divided people into groups. Is that really how to sell an idea? So the people reading this either going to like it or not. It made it so easy for the reader to fall into a group because it did it for them. Is being blunt a good thing at all? The things he said about women, whether or not I agree with it, being blunt about it is such a bad way of presenting his idea. Bringing up negative stuff over and over instead of positive is not a good way about trying to convince people to your side. You can just focus on whatever strength/positive your solution on your side and address little to none of the other side negative. There are books out there for persuasion; it's not some evil technique, it teaches you how not to come across as a social lunatic when talking about sensitive subject.

If you don't agree with it's fine because for me, it's not a mole hill worth dying for.

Do you have a source for that?

Because I've sourced my stuffs and showed how I base my discussion and form my thoughts on my subject with those sources. If I am wrong I would like to learn from it. Otherwise just posting this means I have to take your word for it without any evidence and I don't do that.