|
|
|
|
|
|
by blaze33
4545 days ago
|
|
|
1. Is there some open protocol for a distributed storage of this kind ? 2. Or a plan to open the space monkey protocol ? À la dotcloud giving us docker. I don't believe you can change "how the world stores data, forever" without opening it. I kinda like the idea but for it to really shines, I would like to see it survive the Space Monkey company. I would also see this more in line with the Internet design philosophy mentioned in kickstarter. ie. being able to plug whatever hard drives I happen to have, share a portion to backup peoples data and in exchange have the rest of the available space backuped, remote accessible, being able to bring and plug my ssd to work for fast access if needed (no doubt about who-owns-the-device there), etc. 3. How big is the space monkey HDD to store your 1TB plus bits of a resilient backup of the other devices ? How does it compare to a local RAID setup ? 4. How are reliability, availability, performance and capacity balanced ? |
|
|
2. yes, we're actually very interested internally in opening up large parts of the system long term. We're also very interested in creating a system that could outlive the company.
3. internal drives are currently 2-4TB. It's better than RAID. RAID is susceptible to correlated failures, does not survive fire, theft, or flood, and is much more labor intensive (swapping out failed drives within short windows, rebuilding arrays, etc).
4. Reliability/availability: all chunks of data are encrypted, chopped up into dozens of pieces with parity data added, and spread to dozens of locations (currently 40), only half of which need to be present for complete recovery. When availability of those pieces drops below a certain level, a self-healing process automatically recreates the missing bits. Performance: data can be streamed from the network at a high data rate, and we're currently at more than 10x the speed of competing cloud services for getting data into Space Monkey, but there's lots of room for improvement (we're not as fast as a local NAS yet, but soon will be)!