Hosting Service Manual
Logging & Debugging
Overview
We use several mechanisms to log events and debug our applications:
- Log shipping and centralised log aggregation is used to index and process log files
- Distributed tracing is used to collect request information across the application stack
Logging
Log files written locally to the servers are shipped to a central log aggregation cluster. This includes but is not limited to:
- Web server access and error logs
- Framework, iCM, API Server and other application logs
- Mail relay logs
- Windows events
We currently use Filebeat and Winlogbeat for this. Within ElasticSearch log files are indexed and split into specific indexes depending on the application, log file and permission requirements.
Select GOSS staff have access to search through and visualise the data through Kibana to troubleshoot issues.
Distributed Tracing
Our application stack implements Jaeger Tracing libraries to provide an implementation of OpenTracing. This helps us trace requests through our stack and narrow down where errors or latency are being introduced.
Select GOSS staff have access to search through the tracing data.