HN user

ScottWRobinson

5,608 karma

Twitter: @ScottWRobinson Github: https://github.com/scottwrobinson Web: https://unstack.io

Posts696
Comments28
View on HN
unstack.io 2d ago

What Is AI Good At?

ScottWRobinson
3pts0
unstack.io 12d ago

Write code like a human will maintain it

ScottWRobinson
354pts304
unstack.io 1mo ago

Mod Logs: Save every change, thank yourself later

ScottWRobinson
3pts0
unstack.io 1mo ago

Software companies are now like home builders

ScottWRobinson
2pts1
unstack.io 1mo ago

Theseus Slop

ScottWRobinson
2pts0
unstack.io 2mo ago

Halt and Catch Fire

ScottWRobinson
210pts109
stackabuse.com 1y ago

Using Proxies in Web Scraping

ScottWRobinson
2pts2
stackabuse.com 2y ago

Gracefully Handling Third Party API Failures

ScottWRobinson
1pts0
stackabuse.com 2y ago

Why Does Python Code Run Faster in a Function?

ScottWRobinson
12pts1
stackabuse.com 2y ago

Features of Python

ScottWRobinson
1pts0
stackabuse.com 3y ago

Guide to Fine-Tuning Open Source LLM Models on Custom Data

ScottWRobinson
1pts0
stackabuse.com 3y ago

Optimizing Models: Cross-Validation and Hyperparameter Tuning Guide

ScottWRobinson
2pts0
stackabuse.com 3y ago

What Does “2>&1” do on the Command Line?

ScottWRobinson
6pts0
stackabuse.com 3y ago

Instance Segmentation with YOLOv7 in Python

ScottWRobinson
2pts0
stackabuse.com 3y ago

Image Classification with Transfer Learning – Create Cutting Edge CNN Models

ScottWRobinson
1pts0
stackabuse.com 3y ago

Training NeRF Models with Keras/TensorFlow and DeepVision

ScottWRobinson
1pts0
stackabuse.com 3y ago

Implementing SVM and Kernel SVM with Python's Scikit-Learn

ScottWRobinson
1pts0
blog.gauravthakur.in 4y ago

How JavaScript Array Works Internally?

ScottWRobinson
8pts3
github.com 4y ago

Pointers.py: Bringing the hell of pointers to Python

ScottWRobinson
2pts1
www.perfecto.io 4y ago

How to Do Single User Performance Testing

ScottWRobinson
1pts0
programmingpercy.tech 4y ago

The Biggest Threat to Software Engineers

ScottWRobinson
2pts0
twitter.com 4y ago

Stay tuned for Kaspersky source code leak

ScottWRobinson
3pts0
www.tomshardware.com 4y ago

Leaked Nvidia Code-Signing Certificate Now Being Used by Malware

ScottWRobinson
6pts0
www.meziantou.net 4y ago

Executing code before Main in .NET

ScottWRobinson
2pts0
earthly.dev 4y ago

One Way Smart Developers Make Bad Strategic Decisions

ScottWRobinson
264pts75
www.scrapingbee.com 4y ago

HTML Parsing in Java

ScottWRobinson
1pts0
blog.logrocket.com 4y ago

The Fetch API is finally coming to Node.js

ScottWRobinson
2pts0
www.smashingmagazine.com 4y ago

New CSS Features in 2022

ScottWRobinson
1pts0
brooker.co.za 4y ago

Fixing retries with token buckets and circuit breakers

ScottWRobinson
2pts0
aikikode.me 4y ago

Senior SDE Interviews in Uber, Amazon, Booking and IMC Trading in Amsterdam

ScottWRobinson
2pts0
Halt and Catch Fire 2 months ago

Author here. I wasn't trying to imply that this is a commonly used phrase nowadays. You can see from the sources I linked, there is definitely history to HCF and even some truth to its phrase. But yes, it was mostly a joke

IIRC there are ways to give an authentic-looking fingerprint to browsers used for scraping. But as you said, it's a cat and mouse game

Can't tell if someone is unchecking/checking my boxes or if it's lag and my own previous (mistake) checks coming back from the server lol

I made a "bot" server for myself, which is really just a server and app framework to host a bunch of scripts. The framework handles:

- Running bots periodically - Receives webhooks - Handles OAuth - Provides a shared DB - Posts updates to and receives commands from Slack

It's not very innovative, but super helpful. I love that I can deploy a new script so easily and already have all the tools I need so I can just focus in the logic. A few bots I have running:

- I run a site with thousands of articles, so one bot checks 10-15 articles per day for spelling mistakes, broken links, broken images, poor formatting, etc. Tasks to fix these are then posted to Notion. - Monitor Hacker News and Reddit for mentions of the sites/apps that I run so I can respond. - Sync calendars between apps without having to make them public - Gather financials and reports from various sources for bookkeeping - Monitor all of the servers we run and sync their status to Notion

Probably at least half of the automations could work on something like Zapier, but this is more fun and I get a lot more control over them.

is Google just having trouble recognizing that these are using stolen content?

It's very possible. In general Google will penalize you for duplicate content, but that might not apply to code snippets since code is often re-used within projects or between projects.

The code snippet sites also typically have 2 or more snippets on the same page. When combined, it might then look unique to Google since their algorithm probably can't understand code as well as it understands natural text. Just a guess

For years now I've ran a programming site (stackabuse.com) and have closely followed the state of Google SERPs when it comes to programming content. A few thoughts/ramblings:

- The search results for programming content has been very volatile the last year or so. Google has released a lot of core algorithm updates in the last year, which has caused a lot of high-quality sites to either lose traffic or stagnate.

- These low-quality code snippet sites have always been around, but their traffic has exploded this year after the algorithm changes. Just look at traffic estimates for one of the worst offenders - they get an estimated 18M views each month now, which has grown almost 10x in 12 months. Compare that to SO, which has stayed flat or even dropped in the same time-frame

- The new algorithm updates seem to actually hurt a lot of high-quality sites as it seemingly favors code snippets, exact-match phrases, and lots of internal linking. Great sites with well-written long-form content, like RealPython.com, don't get as much attention as they deserve, IMO. We try to publish useful content, but consistently have our traffic slashed by Google's updates, which end up favoring copy-pasted code from SO, GitHub, and even our own articles.

- The programming content "industry" is highly fragmented (outside of SO) and difficult to monetize, which is why so many sites are covered in ads. Because of this, it's a land grab for traffic and increasing RPMs with more ads, hence these low-quality snippet sites. Admittedly, we monetize with ads but are actively trying to move away from it with paid content. It's a difficult task as it's hard to convince programmers to pay for anything, so the barrier to entry is high unless you monetize with ads.

- I'll admit that this is likely a difficult problem because of how programmer's use Google. My guess is that because we often search for obscure errors/problems/code, their algorithm favors exact-match phrases to better find the solution. They might then give higher priority to pages that seem like they're dedicated to whatever you searched for (i.e. the low-quality snippet sites) over a GitHub repo that contains that snippet _and_ a bunch of other unrelated code.

Just my two cents. Interested to hear your thoughts :)

Really curious how this compares to Cloudflare's analytics. I run a site for developers with decent traffic, and according to Cloudflare only about 25% of our readers block Google Analytics. I had always thought it would be a higher percentage, so this seems to make sense.

It's also odd that the clicks from Google Search Console line up very closely with what we see from Google Analytics. I had always thought this data would be more accurate since Google SERPs uses (used to use?) forwarding URLs to track this stuff.

Author here. You have a very good point. I tend to default to using Iris for articles like these because of its simplicity, ease of setup, etc., but you're right that it isn't as informative in showing readers the algorithm's capability. I'll have to try out some different datasets for upcoming articles :)

Flask vs. Django 9 years ago

Author here. Interesting to hear your perspective on this. I'm personally biased towards Flask, which I was trying to avoid when writing this article. Glad to see my thoughts on the two frameworks are reflected by other developers as well

Yup, it is. I didn't find out about Rosetta Code until over halfway through making this site, but I decided to keep working on it since Rosetta code lacks features I thought were helpful. Thought it would be nice to add voting, comments, editing, categories, etc.

Hard to compete with Rosetta's amount of code, though :)

While there's a lot of truth to this comic, I don't necessarily see it as a bad thing. I think it speaks to the flexibility of JavaScript. Sure, all of the tools and libraries can be hard to keep up with, but I'd rather have lots of community support than none.

I have to admit, I was a JavaScript hater for a long time, up until recently when I actually spent time to learn the language. Now its quickly becoming one of my favorite server-side languages. Isomorphic JS was too hard to resist :)