Hacker News new | ask | show | jobs
by pyxru 1258 days ago
last Updates:

1. Chromium support: it is means now we can scrape site with frontend rendering

2. Docker support: same as previous but more flexible and not required install binary

3. Binary released for different platforms

4. XPath parsing supported

5. CLI can copy in clipboard and provide pretty results

6. Add limiters for avoid DDOS block and memory consumptions

7. YAML support for configuration

CLI configuration examples for play: https://github.com/PxyUp/fitter/tree/master/examples/cli

Roadmap:

1. Fitter should parse with new different triggers like: Webhook/Queue

2. Website FAQ + playground: for test and run configuration

3. Cypress support + Docker: for some sites need authorization or etc, we will have scenarios which will be pre-runed during parsing

4. Add more notification method

5. Improve validation:

5.1 Config validation - for be able know issue during setup

5.2 Result validation - for be able omit result without mandatory fields

6. Config build - web app which will simplify building of configuration

Waiting for your feedback!