Web server log analyser

The brief

A small SaaS company only looks at its server logs after customers complain. The operations lead wants a tool that reads the raw access logs, counts errors by page and hour, and writes a short report on the worst incidents of the week. Good looks like: a parser that handles malformed lines, charts of errors over time, and a report a manager can read in two minutes.

What you will build

1. Parse raw access logs into a table (time, page, status, response size)
2. Count errors and slow responses by page and hour
3. Find the worst incident windows and what was failing
4. Chart traffic and errors over the week
5. Write a one-page incident report from the analysis

Free, open data to build it with

• Web server access logs ↗ Kaggle
• Loghub: system log datasets ↗ LogPAI (GitHub)

Check each dataset's licence before you publish your work. Your mentor gives your team its own version of the brief (data, scope or region), so every team's project is its own.