Merge branch '50020-fe-allow-email-notifications-to-be-disabled-for-all-users-of-a-group' into 'master'

UI for disabling group/project email notifications

Closes #50020

See merge request gitlab-org/gitlab-ce!30961

- Adds UI to configure in group and project settings
- Removes notification configuration for users when
disabled at group or project level

Migrate legacy uploads rake tasks

See merge request gitlab-org/gitlab-ce!29409

Add new table to store email domain per group

See merge request gitlab-org/gitlab-ce!31071

In order to save user preferences regarding
user emails allowed to be invited to group

Add foreign_key and down method

Change adding foreign key

Add partial call to view

Add changelog entry

Fix schema

Embed specific metrics chart in issue

Closes #62971

See merge request gitlab-org/gitlab-ce!31644

This MR adds the styles for displaying a single
chart next to another one when embedding them
in an issue.

Fix starrers counts after searching

See merge request gitlab-org/gitlab-ce!31823

Look up upstream commits once before queuing ProcessCommitWorkers

Closes #65464

See merge request gitlab-org/gitlab-ce!31871

Optimize DB indexes for ES indexing of notes

See merge request gitlab-org/gitlab-ce!31846

Expire project caches once per push instead of once per ref

Closes #52046

See merge request gitlab-org/gitlab-ce!31876

Previously `ProjectCacheWorker` would be scheduled once per ref, which
would generate unnecessary I/O and load on Sidekiq, especially if many
tags or branches were pushed at once. `ProjectCacheWorker` would expire
three items:

1. Repository size: This only needs to be updated once per push.
2. Commit count: This only needs to be updated if the default branch
   is updated.
3. Project method caches: This only needs to be updated if the default
   branch changes, but only if certain files change (e.g. README,
   CHANGELOG, etc.).

Because the third item requires looking at the actual changes in the
commit deltas, we schedule one `ProjectCacheWorker` to handle the first
two cases, and schedule a separate `ProjectCacheWorker` for the third
case if it is needed. As a result, this brings down the number of
`ProjectCacheWorker` jobs from N to 2.

Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/52046

Fix Arel deprecation warning in clusters_hierarchy

See merge request gitlab-org/gitlab-ce!31916

To index notes, we exclude system notes and use `find_in_batches` to
load them in batches for submission to the ES bulk import API.
These queries often result in DB timeouts because the usage of
`ORDER BY id` results in the `notes_pkey` index being used.

This adds an optimized partial index, and removes the unused index
`index_notes_on_noteable_type` which is already covered for our
usage by the existing `index_notes_on_noteable_id_and_noteable_type`.

Newer versions of PostgreSQL (at least 11) are smarter about this and
use `index_notes_on_project_id_and_noteable_type` instead, so we might
be able to remove the partial index again in the future.

Instead of checking if a commit already exists in the upstream project
in its ProcessCommitWorker and bailing out if it does, we check the
existence of all commits in bulk in Git::BranchHooksService, so that we
can skip scheduling ProcessCommitWorker jobs for those commits
that already exist upstream entirely.

Remove Security Dashboard feature flag

See merge request gitlab-org/gitlab-ce!31820

This removes the group_overview_security_dashboard feature flag

As mentioned in https://github.com/rails/rails/pull/29619, this removes
this warning message:

```
Delegating join_sources to arel is deprecated and will be removed in
Rails 6.0. (called from project_clusters_base_query at
app/models/clusters/clusters_hierarchy.rb:62)
```

Part of https://gitlab.com/gitlab-org/gitlab-ce/issues/61451

Quarantining add_file_template_spec

See merge request gitlab-org/gitlab-ce!31908

Issue - https://gitlab.com/gitlab-org/quality/nightly/issues/127

Generate shareable link for specific metric charts

See merge request gitlab-org/gitlab-ce!31339

Adds a clipboard button to the metrics dashboard, that allows
copying a link to an individual chart.

Add `needs:` CI config option CE

Closes gitlab-ee#12334

See merge request gitlab-org/gitlab-ce!31346

fix handling of empty ref_name parameter string in commits api

Closes #64745

See merge request gitlab-org/gitlab-ce!31687

Removed duplicate Live preview entry for MR docs

See merge request gitlab-org/gitlab-ce!31763

Doc: sync ES updates

See merge request gitlab-org/gitlab-ce!31883

Expose finished_at for the Deployment entity

See merge request gitlab-org/gitlab-ce!31808

Merge branch '47003-user-onboarding-replace-current-email-confirmation-flow-with-a-soft-email-confirmation-flow' into 'master'

Soft email confirmation flow

Closes #47003

See merge request gitlab-org/gitlab-ce!31245

Add docs for rate limiter on raw endpoints

See merge request gitlab-org/gitlab-ce!31723

The section was included on security/raw_limits and on the admin area
settings.

Related to https://gitlab.com/gitlab-org/gitlab-ce/issues/48717

Adjust headers in /university

See merge request gitlab-org/gitlab-ce!31702

Update docs style for code blocks

Closes #65373

See merge request gitlab-org/gitlab-ce!31297

Clarify rules for code blocks, including spaces
above and below, and to use tilde when code blocks
contain triple backticks

Fix quarantined spec by waiting for requests

Closes #65329

See merge request gitlab-org/gitlab-ce!31862

Resolve "Web IDE uncommitted files use wrong icon in tree"

Closes #61335

See merge request gitlab-org/gitlab-ce!31560

- Uses vue-test-utils
- More complete coverage with parameterized tests

Document cleanup of feature flag after deploy

See merge request gitlab-org/gitlab-ce!31893