|
|
|
|
|
by simonw
1577 days ago
|
|
There's a SQLite virtual table mechanism for reading from CSV files on disk but I haven't seen the equivalent for JSON. In any case provided you have the disk space importing JSON is fast and the single resulting .db file is easy to tolerate in my opinion. Unless you're talking about 10+GBs of JSON I'd recommend importing them and seeing how far you get. Once the JSON has been loaded into tables the other things you want to do should all be very feasible. - Fuzzy text search can be done using SQLite trigram indexes https://www.sqlite.org/fts5.html#the_experimental_trigram_to... - I'd split JSON columns that you want to index out into indexed regular columns - there are a bunch of tricks in sqlite-utils for doing that, see https://simonwillison.net/2021/Aug/6/sqlite-utils-convert/ |
|
Have you looked at unqlite?