Hacker News new | ask | show | jobs
by didgetmaster 636 days ago
I have been of the opinion for a long time, that the basic architecture of file systems is antiquated and needs to be replaced. Any data organization technique you devise for organizing your files using a traditional hierarchical folder structure, will quickly break down once the number of files gets really large and are spread across many storage devices.

We need to move to an 'object store' architecture that can effectively manage hundreds of millions of files; attach a set of meaningful meta-data tags to each one; and find anything and everything in just a second or two of searching.

I created such a system that works exceptionally well that is currently in open beta.

1 comments

I assume it's the one linked on your profile. I'll check it out!
Great. Didgets is a general-purpose data management system that supports multiple data models. The object store features allow it to manage file data. The tagging system I designed to attach meta-data tags to each object also allow it to manage structured data like relational databases.

The website was designed to highlight its DB features and how it can be used to quickly analyze data in its tables. Don't let that distract you from its initial purpose as a file system replacement.