HN user
Did you try the Kubernetes Operator: https://github.com/arangodb/kube-arangodb? Should at least help with the k8s part... Also would be curious about your sharding challenges, feel free to ping me on the ArangoDB slack
One of the authors here: Feel free to checkout the meetup talk https://www.meetup.com/Knowledge-Graphs-Meetup/events/264962... and the corresponding slides: https://docs.google.com/presentation/d/1r4rLhjoDN_CWpjMUz29s...
cgroup limits can still be beneficial, consider for example contraining the (by default unlimited) metaspace.
IMO these are a great improvement but one still needs to be aware of the underlying container limits. E.g., understanding why setting MaxRAMFraction=1 might not be a good idea as the container might get killed...
One of the authors here: First of all thanks for the great disucssion here, it really motivated to write another follow-up article. There were some comments asking for more practical advice which is totally fair as this was supposed to be more informational and creating problem awareness. What else would you like to see covered in a follow-up?
One of the authors here: This is the OpenJDK 8 implementation: http://hg.openjdk.java.net/jdk8/jdk8/hotspot/file/tip/src/os...
"- Bundling-in the orchestration with docker make k8s or Mesos more inclined to fork docker and pull out unnecessary cruft."
Mesos 1.0 already introduced the universal containerizer, allowing to run many docker images natively without the docker daemon:
https://www.youtube.com/watch?v=rHUngcGgzVM&index=14&list=PL...