|
|
|
|
|
|
by kfk
1990 days ago
|
|
|
I have been working with small data few years. We built an internal library to move data in/out of systems and the schedule this into jobs. We mostly leverage S3 and Spectrum. The major complexities we found were in scheduling, proxies and fetching raw data from legacy applications. |
|
|