palewire

The site includes a CSV of everything I found. You could hand that to Claude Code and ask it to pull down the WARCs

Please give archive.org all the credit

I fixed that:

https://fivethirtyeightindex.com/graphics/ https://fivethirtyeightindex.com/illustrations/

FWIW, the site now indexes 13,000 graphics and 3,000 illustrations, which I clawed out of the Wayback Machine's HTML and preserved separately in an archive.org collection.

https://fivethirtyeightindex.com/graphics/ https://fivethirtyeightindex.com/illustrations/

The archive.org backend is at https://archive.org/details/fivethirtyeight-collection and will almost certainly outlive my site.

Thanks. I'm glad you found it interesting!

Today I'm happy to release "First Basemap," a free tutorial that shares one of our most valuable recent innovations at Reuters.

It's at https://palewi.re/docs/first-basemap/

Follow the step-by-step guide and you'll learn how to create a shockingly fast and virtually free interactive map of the world.

This type of map is often called a basemap because it provides the foundation for displaying data layers like weather conditions, election results, demographics or the location of newsworthy events.

Until recently, creating a basemap was a difficult task that required specialized skills and expensive servers. Rather than take on the challenge, many organizations chose to pay for commercial mapping services, which can be costly for applications that draw a lot of traffic.

Then open-source software changed the equation.

Partnering with Scott Reinhard, we used Protomaps, OpenStreetMap, MapLibre and other free tools to craft a stylized version that will serve as the foundation for all Reuters mapping projects going forward. Casey Miller has already used it to track hurricane activity and share the latest forecast with our readers.

Scott has written a detailed explanation of his design process on his site. While the fonts, styles and other customizations he tailored for Reuters are copyrighted, his underlying techniques are free for anyone to adapt.

That's at https://scottreinhardmaps.com/blogs/custom-mapping-projects/...

One challenge in creating a basemap is the size of the massive database containing almost every border, road, building and natural feature on the planet.

"First Basemap" walks you through how you can use inexpensive cloud computing tools to solve the problem. Follow along and you'll have a basemap of your own for less than $10. Where you go from there is up to you.

Has anyone else on HN had experience rolling their own basemap? I'd love to hear how you're making it happen, what's working and what isn't.

I edited this poll for Reuters, which was released today with this story.

https://www.reuters.com/world/us/americans-worry-musks-campa...

If you have any questions or critique, let's hear it.

The 392 news organizations listed at this URL have instructed OpenAI’s GPTBot to not scan their sites, according to a continual survey of 1,119 online publishers conducted by the homepages.news archive. That amounts to 35.0% of the total.

The artificial intelligence company has suggested it will not train future editions of ChatGPT using sites that opt out of GPTBot crawls via the robots.txt convention.

Our archiving system gathers each news organization’s robots.txt file twice per day. This page automatically updates with the latest results.

The sites we track are a best effort to cover a broad cross-section of news publishing.

That said, the sample is not comprehensive. It's also primarily focused on the English language market.

There's a state database compiled by CHP called SWITRS that tracks traffic accidents. You can find it here. http://iswitrs.chp.ca.gov/Reports/jsp/userLogin.jsp

We don't call it out by name in the story, but it's the kind of existing government system that could be expanded to provide a better, official count of street racing deaths.

Our Los Angeles Times team has mined SWITRS in the past for other stories, like these:

http://graphics.latimes.com/la-pedestrians/

http://graphics.latimes.com/la-bike-hit-and-runs/

Thanks!

If you're a Python person, I'd love to hear what you think of how I structured the notebook.

There isn't a set style for writing these and I've been experimenting with different forms lately.

In this case, I pushed back some of the bigger code chunks into separate Python modules.

I appreciate your effort to bring some context to the analysis.

However, as we unpack in the story, our total is likely an undercount due to the problems in tracking street racing related crashes.

I worked on the data analysis for this story, which was published at a Jupyter Notebook of Python code.

https://github.com/datadesk/street-racing-analysis/blob/mast...

If you have any questions, shoot.

I'm the author of this post. Glad to see it's been submitted here. If you have any questions, please fire away.

Thanks for the tip. This is something I was unaware of.

I hadn't considered that. It only accepts CSVs, not Excel files, right now. If you can provide an example of a dangerous file we can try testing against it.

I'm one of the organizers of the California Civic Data Coalition and this event.

If you have any questions about our work, or the state of California's crippled database tracking money in state politics we're aiming to improve please fire away.

I work at The Times on the team behind these stories and FYI we did a whole previous investigation focused on just that

http://www.latimes.com/projects/la-fi-electricity-capacity/

Thanks for passing this along. It's very interesting. I just gave it a go with a hefty SQL import to test its power. My database connection string to Amazon RDS, which works locally on my computer, failed. Any idea why?

Thanks. The Jupyter Notebook technology is great for us. It's nice that it helps us be transparent, and it's even better that it helps us keep our analysis readable, sharable and organized when it's in development.

I work at the LA Times and conducted the data analysis of wages included in this story. We published all the code behind it on GitHub. AMA. https://github.com/datadesk/california-crop-production-wages...

We brought buggy code, dozens of open tickets and a motherlode of Cali swag to NICAR 2015. You'll never guess what happened next

Hey, thanks for your thoughts. I like the idea of a data specific packaging platform. In our case, we're using the Django and Python system because it's one we're familar with, but I'm open to considering other options and would love to learn more about them.

I love dat, and find its broad promise very appealing though I'm not sure exactly how to pull off all the blocking and tackling necessary for our project limited to its framework.

In addition to downloading the daily file from the state, the file has to be unzipped and transformed before it's ready for loading. Any advice you have would be appreciated.

I agree that something more generic and less-Django specific has a lot of appeal, I'm just not sure I know exactly how to pull it off.

Our experiment in the post is based on our previous packaging experience, which is largely limited to pip and setup.py.

A humble suggestion from your friends at the California Civic Data Coalition

Yes. This is something that could be useful to data journalists, who often have to quickly grip and rip new datasets.

It might not be exactly what you're looking for, but check out some of the listings here https://source.opennews.org/en-US/jobs/ or here http://www.newsnerdjobs.com/

Today's Los Angeles Times features an investigative report that found wide geographic disparities in how quickly LAFD rescuers deliver aid in response to 911 calls. http://lat.ms/W8mXMy

It is accompanied by an interactive map that allows Angelenos to look up response times where they live. http://graphics.latimes.com/how-fast-is-lafd/

I work on the team behind the project. To coincide with the release we are open-sourcing our map's base layer, which was made using MapBox's TileMill. http://datadesk.latimes.com/posts/2012/11/introducing-quiet-...

I'm posting it here because I'd love to share the lessons we learned making our own tile set and hear from the HN community on how we might improve it and our development methods.

Thanks,

Ben.

Stay up to date on this pressing issue by following my pet robot, @questionheds. https://twitter.com/#!/questionheds

Thanks for this great information. I'm stuck at the jury duty cattle call this morning but will try to put this into action later.