Process LSIF document before sending it to GitLab

See merge request gitlab-org/gitlab-workhorse!492

LSIF document is converted into multiple JSON files and archived
as a ZIP file

https://gitlab.com/gitlab-org/gitlab/-/issues/212384

Delay PostUploadPack response until request is fully read

Closes #258

See merge request gitlab-org/gitlab-workhorse!494

Git and Gitaly stream upload-pack response data as soon as it is
available. Some HTTP clients do not support the response being streamed
back while the server is still reading from the request body. To avoid
this, the request was buffered in to a temporary file before passing it
to Gitaly for handling. The buffer had a maximum size of 10MB, which is
now reached by requests to large repositories. These requests were then
truncated, causing Git to fail.

This commit fixes the problem by removing the request buffering and the
maximum size. Instead, the response is buffered in to a temporary file
until the request body is fully read, thus avoiding the problem of
streaming the request and the response simultaneously.

Update make to generate `testdata/scratch` dir

See merge request gitlab-org/gitlab-workhorse!495

When running the gitaly tests for the first time to see an error message
to run `make prepare-tests` but then after running the tests again you
start seeing the following error message:

```
Error:  Received unexpected error:
listen unix testdata/scratch/gitaly-8674665223082153551.sock: bind: no
such file or directory
```

This is because the directory `testdata/scratch` is not created.

[ci skip]

Add a new JWT signed field for uploads

See merge request gitlab-org/gitlab-workhorse!490

It contains all the parameters generated by workhorse during a file upload

Refactor internal/artifacts/artifacts_upload_test.go

See merge request gitlab-org/gitlab-workhorse!491

Set default, workflow, and use rules in CI config

See merge request gitlab-org/gitlab-workhorse!489

Signed-off-by: Rémy Coutable <remy@rymai.me>

Sign artifact multipart fields in Workhorse

See merge request gitlab-org/security/gitlab-workhorse!7

This adds the `Gitlab-Workhorse-Multipart-Fields` HTTP header, which
contains a list of signed multipart keys, for the CI artifacts upload
endpoints. This is already done for multipart attachments but was
not done for the the CI artifacts case.

Without this header, Rails can't guarantee that the file attachments
were validated by Workhorse.

This is the Workhorse part of the solution for
https://gitlab.com/gitlab-org/gitlab/-/issues/213139. This needs to be
used by Rails:
https://gitlab.com/gitlab-org/security/gitlab/-/merge_requests/403

Add automatic changelog generation

See merge request gitlab-org/gitlab-workhorse!484

Include code-navigation block to CI

See merge request gitlab-org/gitlab-workhorse!482

Release v8.30.0

See merge request gitlab-org/gitlab-workhorse!483

Proxy ActionCable websocket connection

See merge request gitlab-org/gitlab-workhorse!454

Tests a single backend setup and a separate cable backend setup

Add a missing CHANGELOG entry

See merge request gitlab-org/gitlab-workhorse!481

This is to support running the ActionCable server in a separate
process from the web server

Had to use a simple proxy because the other ResponseWriter
wrappers do not support HiJack and we don't need those for
this route anyway

Release Workhorse v8.29.0

See merge request gitlab-org/gitlab-workhorse!480

Bump Labkit version to support profiler sample versioning

See merge request gitlab-org/gitlab-workhorse!479

This version bump refers to fac94cb42 in order to
support Go Continuous Profiling with versioning.

I.e. Workhorse will provide its build version to
the profiler and it'll be presented at the Stackdriver
Profiler UI.

CI: stop trying to rm -rf gitaly hooks in docker container

See merge request gitlab-org/gitlab-workhorse!477

Reject parameters that override upload fields

See merge request gitlab-org/security/gitlab-workhorse!3

When Workhorse intercepts file uploads, we store the files and send the
information about the temporary file in new multipart form values called
`file.path`, `file.size` etc.

Since we're also copying all other multipart form values from the
original client request, it was possible to override the values we
set in Workhorse, causing Rails to e.g. load the uploaded file from
an injected `file.path` parameter.

To avoid this, we check if client parameters have the same name as any
of our own added fields and reject the request.