The registered runner will use the `ruby:2.1`docker image and will run two
The registered runner will use the `ruby:2.1`Docker image and will run two
services, `postgres:latest` and `mysql:latest`, both of which will be
services, `postgres:latest` and `mysql:latest`, both of which will be
accessible during the build process.
accessible during the build process.
## What is an image
## What is an image
The `image` keyword is the name of the docker image the docker executor
The `image` keyword is the name of the Docker image the Docker executor
will run to perform the CI tasks.
will run to perform the CI tasks.
By default the executor will only pull images from [Docker Hub][hub],
By default, the executor will only pull images from [Docker Hub][hub],
but this can be configured in the `gitlab-runner/config.toml` by setting
but this can be configured in the `gitlab-runner/config.toml` by setting
the [docker pull policy][] to allow using local images.
the [Docker pull policy][] to allow using local images.
For more information about images and Docker Hub please read
For more information about images and Docker Hub please read
the [Docker Fundamentals][] documentation.
the [Docker Fundamentals][] documentation.
## What is a service
## What is a service
The `services` keyword defines just another docker image that is run during
The `services` keyword defines just another Docker image that is run during
your job and is linked to the docker image that the `image` keyword defines.
your job and is linked to the Docker image that the `image` keyword defines.
This allows you to access the service image during build time.
This allows you to access the service image during build time.
The service image can run any application, but the most common use case is to
The service image can run any application, but the most common use case is to
...
@@ -60,6 +62,11 @@ run a database container, eg. `mysql`. It's easier and faster to use an
...
@@ -60,6 +62,11 @@ run a database container, eg. `mysql`. It's easier and faster to use an
existing image and run it as an additional container than install `mysql` every
existing image and run it as an additional container than install `mysql` every
time the project is built.
time the project is built.
You are not limited to have only database services. You can add as many
services you need to `.gitlab-ci.yml` or manually modify `config.toml`.
Any image found at [Docker Hub][hub] or your private Container Registry can be
used as a service.
You can see some widely used services examples in the relevant documentation of
You can see some widely used services examples in the relevant documentation of
[CI services examples](../services/README.md).
[CI services examples](../services/README.md).
...
@@ -73,22 +80,49 @@ then be used to create a container that is linked to the job container.
...
@@ -73,22 +80,49 @@ then be used to create a container that is linked to the job container.
The service container for MySQL will be accessible under the hostname `mysql`.
The service container for MySQL will be accessible under the hostname `mysql`.
So, in order to access your database service you have to connect to the host
So, in order to access your database service you have to connect to the host
named `mysql` instead of a socket or `localhost`.
named `mysql` instead of a socket or `localhost`. Read more in [accessing the
services](#accessing-the-services).
### Accessing the services
Let's say that you need a Wordpress instance to test some API integration with
your application.
## Overwrite image and services
You can then use for example the [tutum/wordpress][] image in your
`.gitlab-ci.yml`:
See [How to use other images as services](#how-to-use-other-images-as-services).
```yaml
services:
-tutum/wordpress:latest
```
## How to use other images as services
If you don't [specify a service alias](#available-settings-for-services-entry),
when the job is run, `tutum/wordpress` will be started and you will have
access to it from your build container under two hostnames to choose from:
You are not limited to have only database services. You can add as many
-`tutum-wordpress`
services you need to `.gitlab-ci.yml` or manually modify `config.toml`.
-`tutum__wordpress`
Any image found at [Docker Hub][hub] can be used as a service.
## Define image and services from `.gitlab-ci.yml`
>**Note:**
Hostnames with underscores are not RFC valid and may cause problems in 3rd party
applications.
The default aliases for the service's hostname are created from its image name
following these rules:
- Everything after the colon (`:`) is stripped
- Slash (`/`) is replaced with double underscores (`__`) and the primary alias
is created
- Slash (`/`) is replaced with a single dash (`-`) and the secondary alias is
created (requires GitLab Runner v1.1.0 or higher)
To override the default behavior, you can
[specify a service alias](#available-settings-for-services-entry).
## Define `image` and `services` from `.gitlab-ci.yml`
You can simply define an image that will be used for all jobs and a list of
You can simply define an image that will be used for all jobs and a list of
services that you want to use during build time.
services that you want to use during build time:
```yaml
```yaml
image:ruby:2.2
image:ruby:2.2
...
@@ -125,8 +159,8 @@ test:2.2:
...
@@ -125,8 +159,8 @@ test:2.2:
-bundle exec rake spec
-bundle exec rake spec
```
```
Starting with GitLab 9.4 and GitLab Runner 9.4 you can also pass an extended
Or you can pass some [extended configuration options](#extended-docker-configuration-options)
configuration options for image and services:
for `image` and `services`:
```yaml
```yaml
image:
image:
...
@@ -147,59 +181,70 @@ test:
...
@@ -147,59 +181,70 @@ test:
-bundle exec rake spec
-bundle exec rake spec
```
```
Read [Extended docker configuration options](#extended-docker-configuration-options) to
## Extended Docker configuration options
check what options you can use with `image` and `services` definitions.
## Extended docker configuration options
> **Note:**
This feature requires GitLab 9.4 and GitLab Runner 9.4 or higher.
> **Note: This feature is available with GitLab and GitLab Runner 9.4 or higher**
When configuring the `image` or `services` entries, you can use a string or a map as
options:
While configuring `image` or `services` entry you can use both string or a map of
- when using a string as an option, it must be the full name of the image to use
options. If you will use a string, then it must be the full name of the image to use
(including the Registry part if you want to download the image from a Registry
(including registry part if you wan't to download the image from a non-default
other than Docker Hub)
registry). If you will use a map of options, then it must contain at least the `name`
- when using a map as an option, then it must contain at least the `name`
option, which is the same name of image as used for a string setting.
option, which is the same name of the image as used for the string setting
For example, following definitions are equal:
For example, the following two definitions are equal:
```yaml
1. Using a string as an option to `image` and `services`:
image:"registry.example.com/my/image:latest"
services:
-postgresql:9.4
-redis:latest
```
```yaml
```yaml
image:
image: "registry.example.com/my/image:latest"
name:"registry.example.com/my/image:latest"
services:
services:
-name:postgresql:9.4
- postgresql:9.4
-name:redis:latest
- redis:latest
```
```
1. Using a map as an option to `image` and `services`. The use of `image:name` is
required:
```yaml
image:
name: "registry.example.com/my/image:latest"
services:
- name: postgresql:9.4
- name: redis:latest
```
### Available settings for `image`
### Available settings for `image`
> **Note:**
This feature requires GitLab 9.4 and GitLab Runner 9.4 or higher.
| Setting | Required | Description |
| Setting | Required | Description |
|------------|----------|-------------|
|------------|----------|-------------|
| name | yes | Full name of the image that should be used. It should contain the registry part if needed. |
| `name` | yes, when used with any other option | Full name of the image that should be used. It should contain the Registry part if needed. |
| entrypoint | no | Command or script that should be executed as container's entrypoint. It will be translated to Docker's `--entrypoint` option while creating container. The syntax is similar to `Dockerfile`'s `ENTRYPOINT` directive, where each shell token is a separate string in the array. |
| `entrypoint` | no | Command or script that should be executed as the container's entrypoint. It will be translated to Docker's `--entrypoint` option while creating the container. The syntax is similar to [`Dockerfile`'s `ENTRYPOINT`][entrypoint] directive, where each shell token is a separate string in the array. |
### Available settings for `services`
### Available settings for `services` entry
> **Note:**
This feature requires GitLab 9.4 and GitLab Runner 9.4 or higher.
| Setting | Required | Description |
| Setting | Required | Description |
|------------|----------|-------------|
|------------|----------|-------------|
| name | yes | Full name of the image that should be used. It should contain the registry part if needed. |
| `name` | yes, when used with any other option | Full name of the image that should be used. It should contain the Registry part if needed. |
| entrypoint | no | Command or script that should be used as container's entrypoint. It will be translated to Docker's `--entrypoint` option while creating container. The syntax is similar to `Dockerfile`'s `ENTRYPOINT` directive, where each shell token is a separate string in the array. |
| `entrypoint` | no | Command or script that should be executed as the container's entrypoint. It will be translated to Docker's `--entrypoint` option while creating the container. The syntax is similar to [`Dockerfile`'s `ENTRYPOINT`][entrypoint] directive, where each shell token is a separate string in the array. |
| command | no | Command or script and eventual arguments that should be used as container's command. It will be translated to arguments passed to Docker after image's name. The syntax is similar to `Dockerfile`'s `CMD` directive, where each shell token is a separate string in the array. |
| `command` | no | Command or script that should be used as the container's command. It will be translated to arguments passed to Docker after the image's name. The syntax is similar to [`Dockerfile`'s `CMD`][cmd] directive, where each shell token is a separate string in the array. |
| alias | no | Additional alias, that can be used to access service from job's container. Read [Accessing the services](#accessing-the-services) for more information. |
| `alias` | no | Additional alias that can be used to access the service from the job's container. Read [Accessing the services](#accessing-the-services) for more information. |
### Example usages
You can use this feature for different purposes:
#### Starting multiple services from the same image
### Starting multiple services from the same image
Before adding this feature following configuration will not work properly:
Before the new extended Docker configuration options, the following configuration
would not work properly:
```yaml
```yaml
services:
services:
...
@@ -207,38 +252,41 @@ services:
...
@@ -207,38 +252,41 @@ services:
-mysql:latest
-mysql:latest
```
```
Runner would start two containers using the `mysql:latest` image, but both
The Runner would start two containers using the `mysql:latest` image, but both
of them would be added to the job's container with the `mysql` alias. This
of them would be added to the job's container with the `mysql` alias based on
would end with one of services not being accessible.
the [default hostname naming](#accessing-the-services). This would end with one
of the services not being accessible.
Thanks to extended docker configuration we can change above configuration
After the new extended Docker configuration options, the above example would
to a following version:
look like:
```yaml
```yaml
services:
services:
-name:mysql:latest
-name:mysql:latest
alias:mysql-1
alias:mysql-1
-name:mysql:latest
-name:mysql:latest
aliase:mysql-2
alias:mysql-2
```
```
Runner will still start two containers using the `mysql:latest` image,
The Runner will still start two containers using the `mysql:latest` image,
but now each of them will be also accessible with the alias configured
but now each of them will also be accessible with the alias configured
in `.gitlab-ci.yml` file.
in `.gitlab-ci.yml` file.
#### Setting a command for the service
### Setting a command for the service
Let's assume we have a `super/sql:latest` image with some SQL database
Let's assume you have a `super/sql:latest` image with some SQL database
inside. We would like to use it as a service for your job. The problem
inside it and you would like to use it as a service for your job. Let's also
is that this image doesn't start the database process while starting
assume that this image doesn't start the database process while starting
the container. It have all installed and configured inside but user needs
the container and the user needs to manually use `/usr/bin/super-sql run` as
to manually use `/usr/bin/super-sql run` as command to start the database.
a command to start the database.
Previously we would need to create our own image based on the `super/sql:latest`
Before the new extended Docker configuration options, you would need to create
image, add the default command, and then use it in job's configuration, e.g.:
your own image based on the `super/sql:latest` image, add the default command,
and then use it in job's configuration, like:
```Dockerfile
```Dockerfile
# my-super-sql:latest image's Dockerfile
# my-super-sql:latest image's Dockerfile
FROM super/sql:latest
FROM super/sql:latest
CMD ["/usr/bin/super-sql", "run"]
CMD ["/usr/bin/super-sql", "run"]
```
```
...
@@ -250,8 +298,8 @@ services:
...
@@ -250,8 +298,8 @@ services:
-my-super-sql:latest
-my-super-sql:latest
```
```
With extended docker configuration we can now do this simple, setting
After the new extended Docker configuration options, you can now simply
only proper configuration in `.gitlab-ci.yml`, e.g:
set a `command` in `.gitlab-ci.yml`, like:
```yaml
```yaml
# .gitlab-ci.yml
# .gitlab-ci.yml
...
@@ -261,24 +309,29 @@ services:
...
@@ -261,24 +309,29 @@ services:
command:["/usr/bin/super-sql","run"]
command:["/usr/bin/super-sql","run"]
```
```
As you can see the syntax of `command` entry is similar to Dockerfile's `CMD`.
As you can see, the syntax of `command` is similar to [Dockerfile's `CMD`][cmd].
#### Overriding entrypoint of job's image
### Overriding the entrypoint of an image
Let's assume we have a `super/sql:experimental` image with some SQL database
Let's assume you have a `super/sql:experimental` image with some SQL database
inside. We would like to use it as base for our job, because we want to
inside it and you would like to use it as a base image for your job because you
execute some tests with this database binary. The problem is that this image
want to execute some tests with this database binary. Let's also assume that
is configured with `/usr/bin/super-sql run` as entrypoint. That means, that
this image is configured with `/usr/bin/super-sql run` as an entrypoint. That
when starting container without additional options it will run database's
means, that when starting the container without additional options, it will run
process, while Runner expects that image will have no entrypoint or at least
the database's process, while Runner expects that the image will have no
will start with a shell as entrypoint.
entrypoint or at least will start with a shell as its entrypoint.
Previously we would need to create our own image based on the
Previously we would need to create our own image based on the
`super/sql:experimental` image, set the entrypoint to a shell, and then use
`super/sql:experimental` image, set the entrypoint to a shell, and then use
it in job's configuration, e.g.:
it in job's configuration, e.g.:
Before the new extended Docker configuration options, you would need to create
your own image based on the `super/sql:experimental` image, set the entrypoint
to a shell and then use it in job's configuration, like:
```Dockerfile
```Dockerfile
# my-super-sql:experimental image's Dockerfile
# my-super-sql:experimental image's Dockerfile
FROM super/sql:experimental
FROM super/sql:experimental
ENTRYPOINT ["/bin/sh"]
ENTRYPOINT ["/bin/sh"]
```
```
...
@@ -289,8 +342,8 @@ ENTRYPOINT ["/bin/sh"]
...
@@ -289,8 +342,8 @@ ENTRYPOINT ["/bin/sh"]
image:my-super-sql:experimental
image:my-super-sql:experimental
```
```
With docker extended docker configuration we can now do this simple, setting
After the new extended Docker configuration options, you can now simply
only proper configuration in `.gitlab-ci.yml`, e.g:
set an `entrypoint` in `.gitlab-ci.yml`, like:
```yaml
```yaml
# .gitlab-ci.yml
# .gitlab-ci.yml
...
@@ -300,7 +353,8 @@ image:
...
@@ -300,7 +353,8 @@ image:
entrypoint:["/bin/sh"]
entrypoint:["/bin/sh"]
```
```
As you can see the syntax of `entrypoint` entry is similar to Dockerfile's `ENTRYPOINT`.
As you can see the syntax of `entrypoint` is similar to
[Dockerfile's `ENTRYPOINT`][entrypoint].
## Define image and services in `config.toml`
## Define image and services in `config.toml`
...
@@ -315,7 +369,7 @@ Look for the `[runners.docker]` section:
...
@@ -315,7 +369,7 @@ Look for the `[runners.docker]` section:
The image and services defined this way will be added to all job run by
The image and services defined this way will be added to all job run by
that runner.
that runner.
## Define an image from a private Docker registry
## Define an image from a private Container Registry
> **Notes:**
> **Notes:**
- This feature requires GitLab Runner **1.8** or higher
- This feature requires GitLab Runner **1.8** or higher
...
@@ -370,48 +424,6 @@ To configure access for `registry.example.com`, follow these steps:
...
@@ -370,48 +424,6 @@ To configure access for `registry.example.com`, follow these steps:
You can add configuration for as many registries as you want, adding more
You can add configuration for as many registries as you want, adding more
registries to the `"auths"` hash as described above.
registries to the `"auths"` hash as described above.
## Accessing the services
Let's say that you need a Wordpress instance to test some API integration with
your application.
You can then use for example the [tutum/wordpress][] image in your
`.gitlab-ci.yml`:
```yaml
services:
-tutum/wordpress:latest
```
When the job is run, `tutum/wordpress` will be started and you will have
access to it from your build container under the hostnames `tutum-wordpress`
(requires GitLab Runner v1.1.0 or newer) and `tutum__wordpress`.
When using a private registry, the image name also includes a hostname and port
of the registry.
```yaml
services:
-docker.example.com:5000/wordpress:latest
```
The service hostname will also include the registry hostname. Service will be
available under hostnames `docker.example.com-wordpress` (requires GitLab Runner v1.1.0 or newer)
and `docker.example.com__wordpress`.
*Note: hostname with underscores is not RFC valid and may cause problems in 3rd party applications.*
The alias hostnames for the service are made from the image name following these
rules:
1. Everything after `:` is stripped
2. Slash (`/`) is replaced with double underscores (`__`) - primary alias
3. Slash (`/`) is replaced with dash (`-`) - secondary alias, requires GitLab Runner v1.1.0 or newer
Starting with 9.4 You can also set additional alias using the `alias` setting of `services`
