--setuptools-version and --buildout-version options in bootstrap script still have the priority.

One big issue in commit e129e187 is that the
initial value of buildout_and_setuptools_path can cause buildout to use a lot
of CPU at startup. The following change would help:

    def buildout_and_setuptools_path():
        r = [get_python_lib(standard_lib=1)]
        for d in pkg_resources.working_set:
            d = d.location
            if d not in r:
                r.append(d)
        return r[1:]
    buildout_and_setuptools_path = buildout_and_setuptools_path()

but initializing buildout_and_setuptools_dists also takes time to compute,
and it's only used for bootstrap.

Because the commit is not required anymore since setuptools 36, it's easier
for us to revert partially, so we can keep applying our patches.

(cherry picked from commit 18964211252e158f52c52152799cd4fcd34521ba)

(cherry picked from commit 73b1377c27d9b4c490792cbdcfc2a2e88d83d3d1)

PyPI redirects HTTP to HTTPS by default now so using HTTPS directly
avoids the potential for that redirect being modified in flight,
helping prevent MITM attacks.

Fixes #114.

(cherry picked from commit fac9979f516fe1b080258f9b367401a8cc1832e8)

[ci skip]

Fixes #326

Mainly to disable it when just trying to get distributions for
buildout and setuptools.

That I can no longer reproduce.

NFC

Fixed a bug introduced in 2.6.0:
zc.buildout and its dependeoncies were reported as picked even when
their versions were fixed in a ``versions`` section.  Worse, when the
``update-versions-file`` option was used, the ``versions`` section was
updated needlessly on every run.

[ci skip]

[ci skip]

Added a buildout option, ``abi-tag-eggs``

As suggested in: https://github.com/buildout/buildout/pull/325

Also simplified _setup_directories to not bother with the eggs
directory, since that's handled elsewhere.

that, when true, causes the `ABI tag
<https://www.python.org/dev/peps/pep-0425/#abi-tag>`_ for the buildout
environment to be added to the eggs directory name.

This is useful when switching Python implementations (e.g. CPython
vs PyPI or debug builds vs regular builds), especially when
environment differences aren't reflected in egg names.  It also has
the side benefit of making eggs directories smaller, because eggs
for different Python versions are in different directories.

Python 3.6

Update to work with setuptools 34

whatever

Editing while reading

[ci skip]

[ci skip]

Do not remove an existing egg.

After a dist is fetched and put into its final place, compile its
python files.  No longer wait with compiling until all dists are in
place.

This avoids calling redo_pyc at the same time by two parallel buildouts.
It might not be so bad, but it seems better (and faster) to avoid it.

See discussion at https://github.com/buildout/buildout/issues/307

When installing an egg to a location that already exists, keep the
current location (directory or file).

This can only happen when the location at first did not exist and this
changed during the buildout run.  We used to remove the previous
location, but this could cause problems when running two buildouts at
the same time, when they try to install the same new egg.

Fixes #307.

In the tests, filter out an invisible control character.

This avoids invisible control characters popping up in some terminals, like `xterm`.

Note that this may affect tests by buildout recipes.