|
|
|
|
|
by zomglings
1588 days ago
|
|
While I respect your current intentions, I cannot take you at your word in perpetuity because I understand the pressures that come from: 1. Running such a business as an entrepreneur. 2. Running such a system as an engineer. As an entrepreneur, are you promising your customers clean data regardless of the source? Are you promising AI magic? Are you promising a maximum failure rate? From an engineering standpoint, how will you deal with portals changing their frontends and breaking your scrapers at any time? I cannot know what you will do in response to these pressures, but I do know that the temptation will exist to build a system that puts a human in the loop to manually collect data from portals, to manually evaluate scrapers, to manually sift through the data and figure out what kind of Machine Learning models you can use to make your business function more effectively. |
|