Data migration with Kubernetes and Flocker

https://clusterhq.com/blog/data-migration-kubernetes-flocker/

by lewq • 11 years ago

49 19 11 years ago

Well done, Kai! Cannot wait to try it out ;)

lewq5• 11 years ago

We're super excited about bringing portable volumes to lots of different orchestration frameworks, including Kubernetes. Any questions, we'll be hanging out here, so ask away ;)

mbreese4• 11 years ago

Are there any plans to migrate volumes that aren't ZFS backed? (or does it do this already?)

I'd think that the workflow would be similar to migrating ZFS snapshots, just extracting volumes from docker directly, and sending tarballs to the new node, as opposed to the built-in ZFS send/receive. It probably wouldn't be as efficient, but it would make Flocker an easier sell to more people.

Another question - about what size do you think portable volumes need to be before they stop making sense and you need to move to some other kind of either shared storage (NFS) or remote object storage?

lewq5• 11 years ago

We are working on block device backends which integrate Flocker with OpenStack, EBS and more, as well as ZFS on local storage.

Doing a tarball based export-import backend would be an interesting Flocker backend ;)

With regards large volumes, adding more backends to Flocker will definitely open up the scope for volumes then a ZFS pool (zpool) you'd want to have on a single node. Generally though, when you need to scale data up to larger scales, it's better to use a distributed data store which can shard your data across a larger number of smaller stateful containers, which can also be managed by Flocker, but of course that's application-dependent.

SEJeff2• 11 years ago

Any thoughts of flocker using hdfs?

lewq5• 11 years ago

This is definitely interesting. What is the use-case you have in mind for that?

DannoHung• 11 years ago

Have you considered making any integrations between Flocker and SmartDataCenter? It seems like it'd be a pretty nice pairing, especially given that SmartOS natively supports ZFS.

thinkersilver• 11 years ago

Any word on how far off Docker extensions/plugins are? Haven't seen much recent talk on the github issues raised around Dec.

The pace of Docker interoperability is frustratingly slow

weavenetwork• 11 years ago

Hoping to see something soon! We at Weaveworks are involved and mentioned progress on our blog this week.

Data migration with Kubernetes and Flocker

Related Stories