[georgewfraser]

Andy Pavlo talks about this in his class at CMU. You shouldn’t expect to get better performance by running a disk-optimized storage engine on memory, because you’re still paying all the overhead of locks and pages to work around the latency of disk, even though that latency no longer exists. Instead, you have to build a new, simpler storage engine that skips all the bookkeeping of a disk-oriented storage engine.

https://youtu.be/a70jRWLjQFk

[pocket_cheese]

For anyone interested in how a database works underneath the hood, I could not recommend a better MOOC than Andy Pavlo's database courses. His intro to database course is so freaking good.

[mackle_hair]

i believe there are other issues with SCM arent there, for instance if you flip the same bit over and over, you'll wear out the media.. so just like with SSD's there has to be some wear leveling algorithms, but because the media has gotten so fast, the wear leveling would theoretically become a larger % of the bottleneck of using the drive.

but i totally agree, rethinking how data is stored is going to be key to the adoption of these types of new media. there's a company called vast data that has built out a full storage solution utilizing the unique properties of SCM, very cool https://vastdata.com/