HN user

hogu

798 karma
Posts51
Comments243
View on HN
sourcegraph.com 2y ago

A dev's thoughts on developer productivity (2022)

hogu
95pts53
www.msn.com 2y ago

Cancer Is Striking More Young People, and Doctors Are Alarmed and Baffled

hogu
23pts17
www.forbes.com 2y ago

VC Firm OpenView Collapsed Because Two Senior Leaders Quit

hogu
1pts0
docs.docker.com 5y ago

Docker hub download rate limit

hogu
2pts1
medium.com 5y ago

A wargame designer defines our four possible civil wars

hogu
13pts6
www.popularmechanics.com 6y ago

How an Inmate Serving a Murder Sentence Made a Math Discovery

hogu
7pts0
www.marketwatch.com 6y ago

Saturn Cloud secures 4M in funding to build DataBricks for Dask

hogu
1pts0
www.kaspersky.com 6y ago

Malicious Android app had more than 100M downloads in Google Play(CamScanner)

hogu
1pts0
www.nytimes.com 6y ago

Dear Tech Workers, U.S. Service Members Need Your Help

hogu
1pts1
www.marketwatch.com 7y ago

Google plans to acquire big-data company Looker for $2.6B

hogu
4pts0
www.edb.gov.sg 7y ago

Why the world's software engineers are moving to Singapore

hogu
8pts21
news.ycombinator.com 7y ago

Ask HN: Best Monitors for Coding?

hogu
3pts0
microconf.gen.co 7y ago

Microconf Recap - detailed notes on the conference for bootstrappers

hogu
2pts0
www.ibm.com 7y ago

Pushing the Frontiers of AI: Project Debater (video)

hogu
2pts0
hackernoon.com 7y ago

I’m Permanently Banned from Google AdWords

hogu
6pts0
www.nytimes.com 7y ago

Your Taxi or Uber Ride in Manhattan Will Soon Cost More

hogu
1pts0
news.ycombinator.com 7y ago

Ask HN: Which kubernetes cloud would you use (with decent customer service?)

hogu
1pts0
blog.sourcerer.io 7y ago

Why I left React for Vue

hogu
65pts77
hackernoon.com 7y ago

I’m Permanently Banned from Google AdWords

hogu
2pts0
www.opensourceanswers.com 7y ago

Best Practices with conda

hogu
1pts0
www.opensourceanswers.com 7y ago

Handy dandy guide to working with time in Pandas

hogu
2pts0
www.opensourceanswers.com 7y ago

You shouldn't use Python 3.7 for data science right now

hogu
2pts0
hackernoon.com 7y ago

I’m Permanently Banned from Google AdWords

hogu
4pts0
medium.com 7y ago

Rapidly Iterating on Landing Pages with Mechanical Turk

hogu
3pts0
medium.com 7y ago

Getting Banned from Google AdWords

hogu
2pts1
medium.com 7y ago

Building GroupMail, a group email service

hogu
1pts0
medium.com 7y ago

Entrepreneurship vs. Quantitative Finance – an experiment

hogu
1pts0
www.groupmail.in 7y ago

Turn an existing email thread into a email group

hogu
1pts0
news.ycombinator.com 8y ago

A coworking space wants me to sign a 2 year non compete just to be a member

hogu
5pts9
www.groupmail.in 8y ago

Show HN: Group mail – create email groups from forwards

hogu
4pts0
[dead] 8 months ago

We (Saturn Cloud) published a write-up on the architecture and setup process for running our platform on Nebius. The goal was to make it straightforward for teams to use GPU-backed environments without having to spend much time dealing with Kubernetes operations.

The article walks through how resources are provisioned, how environments are created, how GPU jobs are scheduled, and what abstractions we use to keep the system flexible while hiding most of the complexity of the underlying cluster. It also includes some of the design decisions we made along the way and a few of the tradeoffs we ran into.

Since we built the system, I’m happy to answer questions about the architecture, decisions, limitations, or areas we are still iterating on.

Can anyone comment on external displays? The last time I tried this was about 5 years ago. I had a Samsung chromebook which was a great little device, but the font rendering connected to an external display was too terrible.

At saturncloud.io we focus on helping data science teams move to the cloud (either in your AWS account or ours). One component we provide is hosted jupyter lab (along with SSH access so you can use PyCharm/VSCode or anything else.

Hobbyists often use our free tier (30 hrs of GPU per month) or pay for more compute ($0.69/hour) to do a variety of GPU workloads.

We do prohibit things like DDOS attacks and cryptocurrency mining.

The area that we've seen Dask shine the most is ML. This is because the Python ecosystem has more advantages when it comes to ML and there is better GPU support.

https://towardsdatascience.com/supercharging-hyperparameter-...

https://towardsdatascience.com/random-forest-on-gpus-2000x-f...

Disclaimer: We produced those benchmark. I'm a founder of Saturn (https://www.saturncloud.io/) and we focus on providing Databricks-like capabilities with Jupyter + Dask + Prefect, so I definitely have strong feelings in this area.

For some context on why this matters, if you're writing a library (like sklearn) and you want to support multiple array types, you might need to do stuff like

  if isinstance(x, ndarray):
      ...
  elif isinstance(x, other_array):
      ...
In the most ideal case having the standard means that scientific libraries can support all conforming implementations by default. Then sklearn would automatically support cupy/numpy/dask/jax/mxnet/pytorch/tensorflow arrays. Multiply that by all the scientific libraries and the effect is pretty profound.

Just to set some context - this is being driven by Quansight which is led by Travis Oliphant, who united Numeric and Numarray to create NumPy many years ago which lead to the entire python data science ecosystem as we know it. Yes it's ambitious, and they may not succeed, but it's not their first barbecue. Unifying communities and APIs is something they're good at.

We’re a team of 10 and we’ve also found that Cadence replaces our need for stand up meetings. In general, I’ve found that trusting my team to get their work done and unblock themselves has resulted in fewer synchronous meetings

Saturn Cloud | Remote (North/South america) | Senior Software Engineer | Full Time

Saturn Cloud is DataBricks for Dask. We're building an integrated data science platform leveraging Jupyter, Prefect and Dask. Our code base is in Python, Vue/TypeScript, and lots of k8s. We also have some roles that are 50% allocated for contributing to the scientific python ecosystem (mostly Dask, but also sklearn/pandas + friends). We only have 6 engineers right now, so you'll make a big impact.

Right now we're hiring people who can build Python web backends and are somewhat comfortable building UIs. Understanding/empathy of data scientists is a plus, as is understanding of devops/aws/azure/k8s.

The team is fully remote, but we keep to similar time zones. For most regions, our salaries are quite competitive.

Our interview process: Phone Screen, a few 30 minute chats with team members (to give you a sense of what we're like, and help you figure out if you want to work here), 2 hour take home project, 2 hour pair programming session. The take home project is time boxed so that we don't burn your time.

Please apply here:

https://www.saturncloud.io/s/careers/careers-list/?gh_jid=44...

There isn't a good way to know for sure that something is going to work, but there is alot of research you can do that will give you good information.

1. Cold email/linkedin message then speak to 100 potential customers. Attempt presales. You don't actually have to get presales, but that process should give you a good indication for willingness to pay / desired functionality, how people are currently working on the problem, and what language they use to describe their pain (quoting that back to customers is good marketing copy)

2. Build a landing page, run facebook / google ads, find out how much it costs to acquire an email address. Your real CAC will be higher of course, but this is a good starting point.

I'm a founder of https://www.saturncloud.io/. I started with #2, and found it cost 70 cents in advertising revenue to get a click, ~7$ for an email address, and ~$100-$200 to get someone to signup. When we started we were attempting a low touch sales model.

Since then we've started focusing on enterprise sales, because the willingness to pay is much higher. We did #1 when moving towards enterprise sales, but should have done that in the beginning.

I believe the specific incident is xpo logistics

https://www.nytimes.com/interactive/2018/10/21/business/preg...

For example, last October, a 58-year-old woman died of cardiac arrest on the warehouse floor after complaining to colleagues that she felt sick, according to a police report and current and former XPO employees. In Facebook posts at the time and in recent interviews, employees said supervisors told them to keep working as the woman lay dead.

It's a capitalistic market. When everyone does X you have to figure out what Y is which will differentiate yourself. When everyone uses linkedin to target then you have to find other channels.

Everyone should read Traction by Garbriel Weinberg. It's for startup marketing but job searching is basically marketing yourself in a world that has one dominant channel (recruiters). The efficacy of different channels is time varying as they get saturated- You have to find the one that works for you at any given time

JupyterHub 1.0 7 years ago

Depends on what your students are doing right? Also I'd bet your running out of ram before CPU. You should try doing the same workload without JH involved - I'd bet you'd still run out of ram. Also - I'd throw hardware at software problems all day long if I could. Hardware is cheap compared to developer time

JupyterHub 1.0 7 years ago

Are you running into scaling issues because all students are on a single box? I think the JupyterHub proxying service should be able to handle way more than 70 users, but I could see 70 users on a single machine being problematic. I'm doing a lot of work around JupyterHub - happy to help out if I can, I can be reached at hugo@saturncloud.io

JupyterHub 1.0 7 years ago

First of all, AWS SageMaker is really a ML system that happens to include Jupyter notebooks as a component. But if you are talking about just the Jupyter notebook part, then I would say - you could use JupyterHub to build your own implementation of SageMaker (you would want to use kubespawner and some deployment of kubernetes if you wanted to scale to multiple nodes). For example, I run https://www.saturncloud.io/, and we orchestrate JupyterHub to do just that.

JupyterHub is more flexible - for example, you could deploy JupyterHub to one beefy server and have Jupyter deployed for many users, which could all read data from a shared filesystem. that kind of thing is not easy to do with SageMaker since everything runs on a separate ec2 instance.

I can't comment on EMR notebooks.