Commit 716ecdc9 authored by Marcia Ramos's avatar Marcia Ramos

Merge branch 'docs/object-storage-ee' into 'master'

Add info about artifacts object storage in docs

Closes #2311

See merge request !2147
parents 27ca209c 7b422de0
...@@ -140,7 +140,7 @@ production: &base ...@@ -140,7 +140,7 @@ production: &base
# path: shared/artifacts # path: shared/artifacts
# object_store: # object_store:
# enabled: false # enabled: false
# remote_directory: artifacts # remote_directory: artifacts # The bucket name
# connection: # connection:
# provider: AWS # Only AWS supported at the moment # provider: AWS # Only AWS supported at the moment
# aws_access_key_id: AWS_ACCESS_KEY_ID # aws_access_key_id: AWS_ACCESS_KEY_ID
......
...@@ -46,7 +46,10 @@ To disable artifacts site-wide, follow the steps below. ...@@ -46,7 +46,10 @@ To disable artifacts site-wide, follow the steps below.
After a successful job, GitLab Runner uploads an archive containing the job After a successful job, GitLab Runner uploads an archive containing the job
artifacts to GitLab. artifacts to GitLab.
To change the location where the artifacts are stored, follow the steps below. ### Using local storage
To change the location where the artifacts are stored locally, follow the steps
below.
--- ---
...@@ -82,41 +85,86 @@ _The artifacts are stored by default in ...@@ -82,41 +85,86 @@ _The artifacts are stored by default in
1. Save the file and [restart GitLab][] for the changes to take effect. 1. Save the file and [restart GitLab][] for the changes to take effect.
### Using object storage
>**Notes:**
- [Introduced][ee-1762] in [GitLab Enterprise Edition Premium][eep] 9.3.
- By enabling this feature the artifacts will **not** be [browsable] anymore
through the web interface. This limitation will be removed in one of the
upcoming releases.
If you don't want to use the local disk where GitLab is installed to store the
artifacts, you can use an object storage like AWS S3 instead.
This configuration relies on valid AWS credentials to be configured already.
**In Omnibus installations:**
_The artifacts are stored by default in
`/var/opt/gitlab/gitlab-rails/shared/artifacts`._
1. Edit `/etc/gitlab/gitlab.rb` and add the following lines by replacing with
the values you want:
```ruby
gitlab_rails['artifacts_enabled'] = true
gitlab_rails['artifacts']['object_store_enabled'] = false
gitlab_rails['artifacts']['object_store_directory'] = "artifacts"
gitlab_rails['artifacts']['object_store_connection'] = {
'provider' => 'AWS',
'region' => 'eu-central-1',
'aws_access_key_id' => 'AWS_ACCESS_KEY_ID',
'aws_secret_access_key' => 'AWS_SECRET_ACCESS_KEY'
}
```
1. Save the file and [reconfigure GitLab][] for the changes to take effect.
1. Migrate any existing local artifacts to the object storage:
```bash
gitlab-rake gitlab:artifacts:migrate
```
Currently this has to be executed manually and it will allow you to
migrate the existing artifacts to the object storage, but all new
artifacts will still be stored on the local disk. In the future
you will be given an option to define a default storage artifacts for all
new files.
--- ---
**Using Object Store** **In installations from source:**
The previously mentioned methods use the local disk to store artifacts. However, _The artifacts are stored by default in
there is the option to use object stores like AWS' S3. To do this, set the `/home/git/gitlab/shared/artifacts`._
`object_store` in your `gitlab.yml`. This relies on valid AWS
credentials to be configured already. 1. Edit `/home/git/gitlab/config/gitlab.yml` and add or amend the following
lines:
```yaml ```yaml
artifacts: artifacts:
enabled: true enabled: true
path: /mnt/storage/artifacts
object_store: object_store:
enabled: true enabled: true
remote_directory: my-bucket-name remote_directory: "artifacts" # The bucket name
connection: connection:
provider: AWS provider: AWS # Only AWS supported at the moment
aws_access_key_id: S3_KEY_ID aws_access_key_id: AWS_ACESS_KEY_ID
aws_secret_key_id: S3_SECRET_KEY_ID aws_secret_access_key: AWS_SECRET_ACCESS_KEY
region: eu-central-1 region: eu-central-1
``` ```
This will allow you to migrate existing artifacts to object store, 1. Save the file and [restart GitLab][] for the changes to take effect.
but all new artifacts will still be stored on the local disk. 1. Migrate any existing local artifacts to the object storage:
In the future you will be given an option to define a default storage artifacts
for all new files. Currently the artifacts migration has to be executed manually:
```bash ```bash
gitlab-rake gitlab:artifacts:migrate sudo -u git -H bundle exec rake gitlab:artifacts:migrate RAILS_ENV=production
``` ```
Please note, that enabling this feature Currently this has to be executed manually and it will allow you to
will have the effect that artifacts are _not_ browsable anymore through the web migrate the existing artifacts to the object storage, but all new
interface. This limitation will be removed in one of the upcoming releases. artifacts will still be stored on the local disk. In the future
you will be given an option to define a default storage artifacts for all
new files.
## Expiring artifacts ## Expiring artifacts
...@@ -181,6 +229,9 @@ When clicking on a specific file, [GitLab Workhorse] extracts it ...@@ -181,6 +229,9 @@ When clicking on a specific file, [GitLab Workhorse] extracts it
from the archive and the download begins. This implementation saves space, from the archive and the download begins. This implementation saves space,
memory and disk I/O. memory and disk I/O.
[reconfigure gitlab]: restart_gitlab.md "How to restart GitLab" [reconfigure gitlab]: restart_gitlab.md#omnibus-gitlab-reconfigure "How to reconfigure Omnibus GitLab"
[restart gitlab]: restart_gitlab.md "How to restart GitLab" [restart gitlab]: restart_gitlab.md#installations-from-source "How to restart GitLab"
[gitlab workhorse]: https://gitlab.com/gitlab-org/gitlab-workhorse "GitLab Workhorse repository" [gitlab workhorse]: https://gitlab.com/gitlab-org/gitlab-workhorse "GitLab Workhorse repository"
[eep]: https://about.gitlab.com/gitlab-ee/ "GitLab Enterprise Edition Premium"
[ee-1762]: https://gitlab.com/gitlab-org/gitlab-ee/merge_requests/1762
[browsable]: ../user/project/pipelines/job_artifacts.md#browsing-job-artifacts
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment