HN user

zytek

229 karma
Posts8
Comments31
View on HN

Agree. From 6+ years of experience it seems that we got fouled by the multi-az promise of being able to survive datacenter outage.

You can survive datacenter (AZ) outage IF you have separate stacks per AZ and don't mix traffic. If you have Kafka cluster spread out in 3 AZ don't get surprised if you just LOWERED your availability because any issue in one AZ makes your stack unstable. And issues in single AZ are quite common.

Congrats to Grafana Team!

If you're looking at scaling your Prometheus setup - check out also Victoria Metrics.

Operational simplicity and scalability/robustness are what drive me to it.

I used to to send metrics from multiple Kubernetes clusters with Prometheus - each cluster having Prom with remote_write directive to send metrics to central VictoriaMetrics service.

That way my "edge" prometheus installations are practically "stateless", easily set up using prometheus-operator. You don't even need to add persistent storage to them.

From experience: after company grew to more than .. 200-300 people and user management/termination became a big burden we hired a person that would write tools to automate user management, and if something wasn't supporting SAML we did manage users via its API. If API was not available then we reverted to "Termination checklist" aka manual work.

Clarification: it wasn't that persons only responsibility, just one of many assignments to help automate Ops in the company.

To each of you guys having those extensive backup solutions (like NAS + cloud sync, second nas, etc)...

.. do you actually TEST those backups?

This questions comes from my experience as a system engineeer who found a critical bug in our MySQL backup solution that prevented them from restoring (inconsistent filesystem). Also, a friend of mine learned the hard way that his Backblaze backup was unrestorable.

If in need of serving current dir over HTTP I use

    python -m SimpleHTTPServer
works everywhere I need it to work.

Anyway, kudos for making a Go project shipped, which I fail to accomplish for several months now ;-)

Been there, done that. AWS re:Boot in September 2014 showed us how good it was to invest in Ansible roles for all parts of our infrastructure. Still, a lot of hassle for Ops Team, especially that it was done during DevOps Days Warsaw ;-) AWS also said '10%' then, but for us it was 81 out of ~300 instances.

What is sad is that we learn about it from Hacker News and not from AWS, even when we have premium support and our own account manager. :/

Let's see how many of us did their homework after previous "xen update", and how much "10%" is now ;-)

Some of it:

    todo: do not leave 15 year old todo lists in the tree.


    This code is the reason perl has a name as a write only language.


    Remove oh-so-important-from-a-security-pov OpenSSL_rtdsc() function.

    Do not feed RSA private key information to the random subsystem as entropy.  
    It might be fed to a pluggable random subsystem.... What were they thinking?!

    <RANT> Whoever thought that RAND_screen(), feeding the PRNG with the contents 
    of the local workstation's display, under Win32, was a smart idea, 
    ought to be banned from security programming. </RANT>

Edit: just noticed, there's a BLOG with it.. http://opensslrampage.org/

Notice how the answer starts with "From the <documentation>" ...

It's unfortunate that people no longer dive into original system/program documentation, but google/ask for quick answer. When I started my unix/linux journey some ~14 years ago I always found something more when reading docs and thought of guru's as "these guys that read more docs than I did".

Similarly you may noticed how you can no longer write code comfortably when being offline, because you cannot google "how to make dict() return default value for non existing key" etc.

I am now in the process of killing this bad habit of googling through my "coding" and sysadmin tasks, rather than reading docs and examples available on my system.

PS. sorry for my english

25 minutes of laying still in dark and quiet room also gives a lot of benefits. I rarely sleep during my "naps" but still find it very relaxing and refreshing.

So, you might start by doing that.

Good advice. EU citizens have it easy here.

Berlin and London being the obvious choice, I recommend you Poland if you are adventurous. The 'startup hub' here is Kraków (Cracow). Avoid Warsaw. Feel free to contact me for more tips for Poland.

Show HN: tyto 13 years ago

Does now work on Firefox 19 (yeah, I know..). The popup does not display. Only blank board.

How large is the "HN effects" that it brings so many sites down? Even those hosted on 'professional web hosting' and not on home computers?

Anybody has some stats?

Seems like a thing I could build in a couple of nights.. but I won't, so good to have someone who will DEDICATE themselves just for that. There are tons of stuff that can be added.

Unfortunately pricetag is too high. As this is most useful when you have multiple servers then it quickly rises to hundreds of dollars per month. So I would stick with Nagios/etc.

Don't want to discourage you - just my two cents.

What if the founders don't need money? They only want to be part of the program for experience, expertise, and networking?

This is an interesting question.