[pototo666]

I have some Nginx access logs. Not many logs. I need to parse those logs and analyse them.

Some questions I want to answer from my logs:

1. Which API is slow

2. Which API is broken, ie. returning 4xx or 5xx

3. Which API is called most often

I don't want to integrate some backend software into my code. At least not at this stage.

Hopefully there can be a website for me to upload my logs. After uploading, it would parse my logs and show me some plots. Google doesn't introduce me to such services. Maybe there are some.

At the end, I spent 2 hours parsing the data with Python and analizing them with R. To save myself 2 hours' life, I would pay for such a service.

I thought of making such a product myself. But I want to implement some other idea first.

If you know such kind of service, please let me know :)

[iosjunkie]

A few days ago came across the MIT-licensed GoAccess. It generates both terminal and HTML based reports that should address your needs. You run the tool from the command line, so doesn’t solve the website-to-upload-a-file requirement, but that could be a fun little project (if someone hasn’t already done that).

https://goaccess.io/

[ianthehenry]

I use GoAccess. Free, open source, run it from the command line and it can spit out an HTML file full of plots. Works in offline or incremental mode.

https://goaccess.io/

[genuine_smiles]

Microsoft’s Kusto database has a free tier and its query language has a “render” command for making plots.

dataexplorer.azure.com

[jasfi]

I searched Google for: analyze nginx logs for api stats

The Moesif and Datadog links look promising.

[pototo666]

Thanks. I've spent a few minutes on them while I did my research.

I got the impression that I need to install some software or integrate them into my backend. They are more like system monitor. Maybe I was wrong. That's not how I wanted do it.

I hope to upload my nginx logs and get the results immediately.