Commit 6772a21a authored by Amy Qualls's avatar Amy Qualls

Merge branch 'docs-review-gitlab-log-system' into 'master'

Docs review & improve administration/logs.html

Closes gitlab-com/support/support-team-meta#2304

See merge request gitlab-org/gitlab!34982
parents 4372ad35 8c679b74
...@@ -26,7 +26,7 @@ GitLab, thanks to [Lograge](https://github.com/roidrage/lograge/). Note that ...@@ -26,7 +26,7 @@ GitLab, thanks to [Lograge](https://github.com/roidrage/lograge/). Note that
requests from the API are logged to a separate file in `api_json.log`. requests from the API are logged to a separate file in `api_json.log`.
Each line contains a JSON line that can be ingested by services like Elasticsearch and Splunk. Each line contains a JSON line that can be ingested by services like Elasticsearch and Splunk.
Line breaks have been added to this example for legibility: Line breaks were added to examples for legibility:
```json ```json
{ {
...@@ -79,7 +79,7 @@ seconds: ...@@ -79,7 +79,7 @@ seconds:
User clone and fetch activity using HTTP transport appears in this log as `action: git_upload_pack`. User clone and fetch activity using HTTP transport appears in this log as `action: git_upload_pack`.
In addition, the log contains the originating IP address, In addition, the log contains the originating IP address,
(`remote_ip`),the user's ID (`user_id`), and username (`username`). (`remote_ip`), the user's ID (`user_id`), and username (`username`).
Some endpoints such as `/search` may make requests to Elasticsearch if using Some endpoints such as `/search` may make requests to Elasticsearch if using
[Advanced Global Search](../user/search/advanced_global_search.md). These will [Advanced Global Search](../user/search/advanced_global_search.md). These will
...@@ -227,7 +227,7 @@ It helps you see requests made directly to the API. For example: ...@@ -227,7 +227,7 @@ It helps you see requests made directly to the API. For example:
} }
``` ```
This entry shows an access to an internal endpoint to check whether an This entry shows an internal endpoint accessed to check whether an
associated SSH key can download the project in question via a `git fetch` or associated SSH key can download the project in question via a `git fetch` or
`git clone`. In this example, we see: `git clone`. In this example, we see:
...@@ -320,7 +320,7 @@ packages or in `/home/git/gitlab/log/kubernetes.log` for ...@@ -320,7 +320,7 @@ packages or in `/home/git/gitlab/log/kubernetes.log` for
installations from source. installations from source.
It logs information related to the Kubernetes Integration including errors It logs information related to the Kubernetes Integration including errors
during installing cluster applications on your GitLab managed Kubernetes during installing cluster applications on your managed Kubernetes
clusters. clusters.
Each line contains a JSON line that can be ingested by services like Elasticsearch and Splunk. Each line contains a JSON line that can be ingested by services like Elasticsearch and Splunk.
...@@ -362,7 +362,7 @@ After 12.2, this file was renamed from `githost.log` to ...@@ -362,7 +362,7 @@ After 12.2, this file was renamed from `githost.log` to
`git_json.log` and stored in JSON format. `git_json.log` and stored in JSON format.
GitLab has to interact with Git repositories, but in some rare cases GitLab has to interact with Git repositories, but in some rare cases
something can go wrong, and in this case you will know what exactly something can go wrong, and in this case you may need know what exactly
happened. This log file contains all failed requests from GitLab to Git happened. This log file contains all failed requests from GitLab to Git
repositories. In the majority of cases this file will be useful for developers repositories. In the majority of cases this file will be useful for developers
only. For example: only. For example:
...@@ -473,8 +473,8 @@ This file lives in `/var/log/gitlab/gitlab-rails/sidekiq_client.log` for ...@@ -473,8 +473,8 @@ This file lives in `/var/log/gitlab/gitlab-rails/sidekiq_client.log` for
Omnibus GitLab packages or in `/home/git/gitlab/log/sidekiq_client.log` for Omnibus GitLab packages or in `/home/git/gitlab/log/sidekiq_client.log` for
installations from source. installations from source.
This file contains logging information about jobs before they are start This file contains logging information about jobs before Sidekiq starts
being processed by Sidekiq, for example before being enqueued. processing them, such as before being enqueued.
This log file follows the same structure as This log file follows the same structure as
[`sidekiq.log`](#sidekiqlog), so it will be structured as JSON if [`sidekiq.log`](#sidekiqlog), so it will be structured as JSON if
...@@ -571,32 +571,45 @@ User clone/fetch activity using SSH transport appears in this log as `executing ...@@ -571,32 +571,45 @@ User clone/fetch activity using SSH transport appears in this log as `executing
## Gitaly Logs ## Gitaly Logs
This file lives in `/var/log/gitlab/gitaly/current` and is produced by [runit](http://smarden.org/runit/). `runit` is packaged with Omnibus and a brief explanation of its purpose is available [in the omnibus documentation](https://docs.gitlab.com/omnibus/architecture/#runit). [Log files are rotated](http://smarden.org/runit/svlogd.8.html), renamed in Unix timestamp format and `gzip`-compressed (e.g. `@1584057562.s`). This file lives in `/var/log/gitlab/gitaly/current` and is produced by [runit](http://smarden.org/runit/). `runit` is packaged with Omnibus GitLab and a brief explanation of its purpose is available [in the Omnibus GitLab documentation](https://docs.gitlab.com/omnibus/architecture/#runit). [Log files are rotated](http://smarden.org/runit/svlogd.8.html), renamed in Unix timestamp format, and `gzip`-compressed (like `@1584057562.s`).
### `grpc.log` ### `grpc.log`
This file lives in `/var/log/gitlab/gitlab-rails/grpc.log` for Omnibus GitLab packages. Native [gRPC](https://grpc.io/) logging used by Gitaly. This file lives in `/var/log/gitlab/gitlab-rails/grpc.log` for Omnibus GitLab packages. Native [gRPC](https://grpc.io/) logging used by Gitaly.
## `puma_stderr.log` & `puma_stdout.log` ## Puma Logs
This file lives in `/var/log/gitlab/puma/puma_stderr.log` and `/var/log/gitlab/puma/puma_stdout.log` for ### `puma_stdout.log`
Omnibus GitLab packages or in `/home/git/gitlab/log/puma_stderr.log` and `/home/git/gitlab/log/puma_stdout.log`
for installations from source. This file lives in `/var/log/gitlab/puma/puma_stdout.log` for
Omnibus GitLab packages, and `/home/git/gitlab/log/puma_stdout.log` for
installations from source.
### `puma_stderr.log`
This file lives in `/var/log/gitlab/puma/puma_stderr.log` for
Omnibus GitLab packages, or in `/home/git/gitlab/log/puma_stderr.log` for
installations from source.
## `unicorn_stderr.log` & `unicorn_stdout.log` ## Unicorn Logs
NOTE: **Note:** NOTE: **Note:**
Starting with GitLab 13.0, Puma is the default web server used in GitLab Starting with GitLab 13.0, Puma is the default web server used in GitLab
all-in-one package based installations as well as GitLab Helm chart deployments. all-in-one package based installations as well as GitLab Helm chart deployments.
This file lives in `/var/log/gitlab/unicorn/unicorn_stderr.log` and `/var/log/gitlab/unicorn/unicorn_stdout.log` for ### `unicorn_stdout.log`
Omnibus GitLab packages or in `/home/git/gitlab/log/unicorn_stderr.log` and `/home/git/gitlab/log/unicorn_stdout.log`
This file lives in `/var/log/gitlab/unicorn/unicorn_stdout.log` for
Omnibus GitLab packages or in `/home/git/gitlab/log/unicorn_stdout.log` for
for installations from source.
### `unicorn_stderr.log`
This file lives in `/var/log/gitlab/unicorn/unicorn_stderr.log` for
Omnibus GitLab packages or in `/home/git/gitlab/log/unicorn_stderr.log` for
for installations from source. for installations from source.
Unicorn is a high-performance forking Web server which is used for These logs contain all information about the state of Unicorn processes at any given time.
serving the GitLab application. You can look at this log if, for
example, your application does not respond. This log contains all
information about the state of Unicorn processes at any given time.
```plaintext ```plaintext
I, [2015-02-13T06:14:46.680381 #9047] INFO -- : Refreshing Gem list I, [2015-02-13T06:14:46.680381 #9047] INFO -- : Refreshing Gem list
...@@ -657,7 +670,7 @@ This log records: ...@@ -657,7 +670,7 @@ This log records:
- [Protected paths](../user/admin_area/settings/protected_paths.md) abusive requests. - [Protected paths](../user/admin_area/settings/protected_paths.md) abusive requests.
NOTE: **Note:** NOTE: **Note:**
From [%12.3](https://gitlab.com/gitlab-org/gitlab/-/issues/29239), user ID and username are also In GitLab versions [12.3](https://gitlab.com/gitlab-org/gitlab/-/issues/29239) and greater, user ID and username are also
recorded on this log, if available. recorded on this log, if available.
## `graphql_json.log` ## `graphql_json.log`
...@@ -686,7 +699,7 @@ installations from source. ...@@ -686,7 +699,7 @@ installations from source.
> [Introduced](https://gitlab.com/gitlab-org/gitlab/-/merge_requests/19186) in GitLab 12.6. > [Introduced](https://gitlab.com/gitlab-org/gitlab/-/merge_requests/19186) in GitLab 12.6.
This file lives in `/var/log/gitlab/mailroom/mail_room_json.log` for This file lives in `/var/log/gitlab/mailroom/current` for
Omnibus GitLab packages or in `/home/git/gitlab/log/mail_room_json.log` for Omnibus GitLab packages or in `/home/git/gitlab/log/mail_room_json.log` for
installations from source. installations from source.
...@@ -793,8 +806,8 @@ This file lives in `/var/log/gitlab/gitlab-rails/service_measurement.log` for ...@@ -793,8 +806,8 @@ This file lives in `/var/log/gitlab/gitlab-rails/service_measurement.log` for
Omnibus GitLab packages or in `/home/git/gitlab/log/service_measurement.log` for Omnibus GitLab packages or in `/home/git/gitlab/log/service_measurement.log` for
installations from source. installations from source.
It contain only a single structured log with measurements for each service execution. It contains only a single structured log with measurements for each service execution.
It will contain measurement such as: number of SQL calls, `execution_time`, `gc_stats`, `memory_usage`, etc... It will contain measurements such as the number of SQL calls, `execution_time`, `gc_stats`, and `memory usage`.
For example: For example:
...@@ -870,22 +883,46 @@ For example: ...@@ -870,22 +883,46 @@ For example:
} }
``` ```
## Mattermost Logs
For Omnibus GitLab installations, Mattermost logs reside in `/var/log/gitlab/mattermost/mattermost.log`.
## Workhorse Logs ## Workhorse Logs
For Omnibus installations, Workhorse logs reside in `/var/log/gitlab/gitlab-workhorse/current`. For Omnibus GitLab installations, Workhorse logs reside in `/var/log/gitlab/gitlab-workhorse/`.
## PostgreSQL Logs ## PostgreSQL Logs
For Omnibus installations, PostgreSQL logs reside in `/var/log/gitlab/postgresql/current`. For Omnibus GitLab installations, PostgreSQL logs reside in `/var/log/gitlab/postgresql/`.
## Prometheus Logs ## Prometheus Logs
For Omnibus installations, Prometheus logs reside in `/var/log/gitlab/prometheus/current`. For Omnibus GitLab installations, Prometheus logs reside in `/var/log/gitlab/prometheus/`.
## Redis Logs ## Redis Logs
For Omnibus installations, Redis logs reside in `/var/log/gitlab/redis/current`. For Omnibus GitLab installations, Redis logs reside in `/var/log/gitlab/redis/`.
## Mattermost Logs ## Alertmanager Logs
For Omnibus GitLab installations, Alertmanager logs reside in `/var/log/gitlab/alertmanager/`.
## Crond Logs
For Omnibus GitLab installations, crond logs reside in `/var/log/gitlab/crond/`.
## Grafana Logs
For Omnibus GitLab installations, Grafana logs reside in `/var/log/gitlab/grafana/`.
## LogRotate Logs
For Omnibus GitLab installations, logrotate logs reside in `/var/log/gitlab/logrotate/`.
## GitLab Monitor Logs
For Omnibus GitLab installations, GitLab Monitor logs reside in `/var/log/gitlab/gitlab-monitor/`.
## GitLab Exporter
For Omnibus installations, Mattermost logs reside in `/var/log/gitlab/mattermost/mattermost.log`. For Omnibus GitLab installations, GitLab Exporter logs reside in `/var/log/gitlab/gitlab-exporter/`.
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment