bweber

This article doesn't even mention one of my favorite tools on GCP which is Dataflow. It's really easy to build batch and streaming workflows that can be used for data and machine learning pipelines. It really shows how well the different services within GCP are integrated, since it's trivial to set up PubSub or BigQuery as sources and sinks.

Sounds like the author is using a similar stack to me, markdown -> PDF, epub. I wrote a bit more about the writing process and consideration for traditional publishers here: https://news.ycombinator.com/item?id=22027026

Please leave a review if you purchased on Amazon.

For paper size, I decided to use 6x9 from the start. I also didn't consider the epub format until the end, and then used the "print replica" feature on Kindle Direct to create a kindle version, which lacks text resizing and a few other features. Once I settled on a page size, I wrote each chapter independently and made sure to avoid any widowed text or code samples. I decided that orphaned text would be fine, given that the size of the page is relatively small.

I didn't really need to write any scripts, beyond using the sample bookdown project. I did use a custom book class and made some tweaks for the code formatting, but these were mostly Latex changes.

Virtual environments are useful when setting up a single machine, but many of the tools covered in the book do not directly support venv, such as Lambda functions, Cloud Dataflow, and Databricks. In general, the goal is to get readers to explore tools beyond Conda for setting up environments and dependencies.

Marketing will be a challenge. There's been great reception here, but I expect sales to taper quickly and then paid sponsorship will be necessary to continue generating sales. I'm currently testing out Amazon Advertising, but I don't seem to have bids high enough to get to my target budget.

Thanks. I originally planned on covering more topics related to DevOps, such as CI/CD for model deployment, but felt that this might be a bit of a stretch for some readers, and it's any area where I have less experience. Glad to here it's useful from a full-stack perspective.

Sounds like there is a few requests for this, so I'll look to authoring a post on this. And also talk about motivation for going the self-publishing route.

You can follow me on Medium for this update: https://medium.com/@bgweber

Here's the complete source for the last text I authored using this pipeline: https://github.com/bgweber/StartupDataScience/tree/master/bo...

You can use the same tooling to create an epub output, but the formatting will be substantially different.

I might do one of the trade-offs between self-publishing and working with a publisher. With Kindle Direct Publishing, it's pretty straight forward. It's more about the tooling to produce the text and the process of using Kindle Direct.

There are approaches for using Spark to distribute hyperparameter tuning and cross validation: https://databricks.com/blog/2016/02/08/auto-scaling-scikit-l...

However, for the example in this post, I would recommended using the logistic regression provided by MLlib to scale up.

Non paywall link: https://medium.com/p/scalable-python-code-with-pandas-udfs-a...

Thanks for the feedback. As someone just getting started in this area, I was having trouble finding clear examples. Using the R interface probably isn't the best way to get started with custom loss functions, because the error messages you get from nested python calls are usually not too descriptive.

The reviews on Glassdoor show that the actual culture at Twitch is closer to what you described.

Data Scientist, Windfall Data: Full Time, Onsite

https://angel.co/windfall-data/jobs/335043-data-scientist

At Windfall, we're trying to determine the net worth of every person in the world. More Information about Data Science at Windfall:

https://medium.com/windfalldata/the-data-science-stack-at-wi...

https://medium.com/windfalldata/clustering-the-top-1-asset-a...

https://medium.com/windfalldata/governance-in-data-science-7...

Windfall Data | Data Scientist (Governance) | SF (Onsite) | $100k - $130k | 0.05% - 0.2%

At Windfall, we're trying to determine the net worth of every person in the world. Data governance is key to this mission, ensuring that we have high-quality data throughout our pipeline.

Job Page: https://angel.co/windfall-data/jobs/295441-data-scientist-go...

Windfall Data | Data Scientist (Governance) | SF (Onsite) | $100k - $130k | 0.05% - 0.2%

At Windfall, we're trying to determine the net worth of every person in the world. Data governance is key to this mission, ensuring that we have high-quality data throughout our pipeline.

Job Page: https://angel.co/windfall-data/jobs/295441-data-scientist-go...

All of the replay files will be made publicly available after the competition, see the rules page.

There are different tournaments for participants that want to focus on only a subset of the game. For example, you could hard code all locations for the tournament 3 contest and focus on macro.

The Mario competition was held at the CIG 2009 conference. There has been talk of holding a StarCraft competition at CIG 2010. http://www.ieee-cig.org/

The site has been transferred to a new sub-domain to handle the traffic

While you can't run the Broodwar API on battle.net, it is possible to run bots on ICCup. But dont expect anybody to join the game, since you will not be running the antihack.