slapos:72e886d99d947208af946309afd870cae1946b38 commitshttps://lab.node.vifib.com/nexedi/slapos/-/commits/72e886d99d947208af946309afd870cae1946b382019-01-18T17:35:20+01:00https://lab.node.vifib.com/nexedi/slapos/-/commit/72e886d99d947208af946309afd870cae1946b38Update Release Canditate2019-01-18T17:35:20+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/c67336567112c5bff7cf8f89b43a695735c7712eslapos.core version up: 1.4.162019-01-18T10:11:20+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/2a3328a11e6dc27e82032430e630c63d9994c7c9Update Release Candidate2019-01-17T13:40:59+01:00Lukasz Nowakluke@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/b1d87ee2f964fc61fda8ffeda75443d2d669da93caddy-frontend: Allow to globally disable HTTP22019-01-17T12:07:05+01:00Lukasz Nowakluke@nexedi.com
One of solutions for random 502 errors from caddy is to fully disable
HTTP2 protocol ( <a href="https://github.com/mholt/caddy/issues/1080" rel="nofollow noreferrer noopener" target="_blank">https://github.com/mholt/caddy/issues/1080</a> )
We run Caddy with HTTP2 enabled by default, as we can enable/disable it per
each slave, but in some environments it might be just better to fully avoid
HTTP2 codepaths in Caddy.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/495" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/495" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2678" data-project-path="nexedi/slapos" data-iid="495" data-mr-title="caddy-frontend: Allow to globally disable HTTP2" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!495</a>https://lab.node.vifib.com/nexedi/slapos/-/commit/00fa1f6c95b84480fd5aa449d52fd93b4d045170seleniumserver: Be catch-all on the frontend2019-01-16T21:19:53+01:00Lukasz Nowakluke@nexedi.com
The IP used by frontend can be different than the real endpoint, and unknown
for the frontend itself, so make it catch-all to allow access.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/497" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/497" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2684" data-project-path="nexedi/slapos" data-iid="497" data-mr-title="seleniumserver: Be catch-all on the frontend" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!497</a>https://lab.node.vifib.com/nexedi/slapos/-/commit/c1595baee84a75fd99a1fe2427f37d80e8506d5fcaddy-frontend: Correctly fix prefer-gzip-encoding-to-backend2019-01-16T21:18:55+01:00Lukasz Nowakluke@nexedi.com
Because of misleading tests (Accept-Encoding with gzip was always set by
requests, fixed in "caddy-frontend/test: Workaround requests issue with
Accept-Encoding") the original commit "Fix/caddy frontend prefer gzip type
zope" did not really fixed the issue for type:zope backend.https://lab.node.vifib.com/nexedi/slapos/-/commit/28b1abe971225c9860dea73b30056719eeefded6caddy-frontend/test: Workaround requests issue with Accept-Encoding2019-01-16T21:18:55+01:00Lukasz Nowakluke@nexedi.com
requests set Accept-Encoding header, but in the testr environment we
want to have full control over its behaviour, thus not setting any header if
not really wanted.
As there is not known way to avoid setting the header (skip_accept_encoding is
internal to httplib) set dummy Accept-Encoding header, which is enough for our
environment.https://lab.node.vifib.com/nexedi/slapos/-/commit/9d0de6e9cce7137b06a09da79969404f465ed194Updates on Selenium Server2019-01-16T12:34:48+01:00Jérome Perrinjerome@nexedi.com
Hopefully fix the random failure with:
```
test_connect (test.TestSSHServer) ... /srv/slapgrid/slappart3/srv/testnode/byx/soft/a452c8ac557f7eaea3c20f6cc373c390/eggs/paramiko-2.4.2-py2.7.egg/paramiko/client.py:822: UserWarning: Unknown ecdsa-sha2-nistp521 host key for [2001:67c:1254:e:4a::7bd5]:22222: 22c41f5090433152d1e5395a85d6cb4f
key.get_name(), hostname, hexlify(key.get_fingerprint())
FAIL
======================================================================
FAIL: test_connect (test.TestSSHServer)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/srv/slapgrid/slappart3/srv/testnode/byx/soft/a452c8ac557f7eaea3c20f6cc373c390/parts/slapos-repository/software/seleniumserver/test/test.py", line 357, in test_connect
self.assertIn("Welcome to SlapOS Selenium Server.", channel.recv(100))
AssertionError: 'Welcome to SlapOS Selenium Server.' not found in 'Attempt to write login records by non-root user (aborting)\r\r\n'
----------------------------------------------------------------------
```
Also publish the fingerprint of the server ssh key, which addresses this warning in the correct way (I feel) and since we can publish the fingerprint, why not.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/492" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/492" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2673" data-project-path="nexedi/slapos" data-iid="492" data-mr-title="Updates on Selenium Server" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!492</a>https://lab.node.vifib.com/nexedi/slapos/-/commit/74018d53576f65c8b04d9da26500600d995e753bUpdate Release Candidate2019-01-14T09:51:32+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/297a0dd9a78b63d06819a90b0d0f7d558ef0eb5dcaddy-frontend: Assert certificate-authority with hash2019-01-14T09:39:57+01:00Lukasz Nowakluke@nexedi.com
Since "stack/monitor: Add auto-restart on certificate-authority section"
certificate authority is correctly exposed in supervisor with its hash.https://lab.node.vifib.com/nexedi/slapos/-/commit/b9b40aa5131c52235aecec086727a0a8e90bcde3kvm-resilient: fix monitor password, use published password2019-01-11T18:03:18+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/f6283656726b97ce7639588090d54e9a5c50a066stack/monitor: Fix auto-restart (used bad variable name)2019-01-11T17:48:45+01:00Guillaume Hervierguillaume.hervier@nexedi.com
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/500" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/500" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2688" data-project-path="nexedi/slapos" data-iid="500" data-mr-title="stack/monitor: Fix auto-restart (used bad variable name)" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!500</a>https://lab.node.vifib.com/nexedi/slapos/-/commit/d36b2da713a4232d499caabdf091f8110bcc191bstack/monitor: Add auto-restart on certificate-authority section2019-01-11T16:28:09+01:00Guillaume Hervierguillaume.hervier@nexedi.com
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/499" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/499" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2687" data-project-path="nexedi/slapos" data-iid="499" data-mr-title="stack/monitor: Add auto-restart on certificate-authority section" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!499</a>https://lab.node.vifib.com/nexedi/slapos/-/commit/139a2d9c0b2b3b92aad4e3185f0ab03d65caffa4kvm: wait until novnc certificate is generated before start websockify service2019-01-11T15:36:59+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/6112dc229f41e460b9ccfb38be23e42cbaebbf84kvm: fixup after commit 7b399f952019-01-11T15:36:59+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/7d8b3029d0a421cc9ec262c8dccd3a4d5ae4651fstack/erp5: add check zope longrequest log promise2019-01-11T09:44:13+01:00Xiaowu Zhangxiaowu.zhang@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/aeaf212b32f207e247149ee7e72694a5d3d254edversion up: slapos.toolbox 0.852019-01-11T09:44:13+01:00Xiaowu Zhangxiaowu.zhang@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/7b399f9527955c4a68d52d4d7a8a371b80faae0ckvm: fix some parameters propagation, update parameter schema2019-01-10T15:33:38+01:00Alain Takoudjoualain.takoudjou@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/f38436a9091917835da914e3d16238334a9fea80[kvm SR] fixes after 9345c81b843b28505ea88281319d83186ba51a0c2019-01-10T15:33:38+01:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/574e1409f67193a6d910cc133aba614df7944fd0monitor-directory:promises and monitor-directory:reports are deprecated2019-01-10T12:11:49+01:00Thomas Gambierthomas.gambier@nexedi.com
Remove all references to deprecated directories. The promises inside monitor-directory:promises directory are not run anymore by slapgrid. The scripts inside monitor-directory:reports are not run either.
In this PR, we just update the directory location:
* promise directory is now etc/promise (${directory:promise})
* reports directory is now bin (${directory:bin})
/cc <a href="/alain.takoudjou" data-user="3" data-reference-type="user" data-container="body" data-placement="top" data-html="true" class="gfm gfm-project_member" title="Alain Takoudjou">@alain.takoudjou</a> <a href="/rafael" data-user="11" data-reference-type="user" data-container="body" data-placement="top" data-html="true" class="gfm gfm-project_member" title="Rafael Monnerat">@rafael</a>
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/490" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/490" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2669" data-project-path="nexedi/slapos" data-iid="490" data-mr-title="monitor-directory:promises and monitor-directory:reports are deprecated" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!490</a>https://lab.node.vifib.com/nexedi/slapos/-/commit/972c59fae65cd29ea4614cbd37e3323462a4c3ebremove promises and reports entries in monitor-directory section as they are ...2019-01-10T09:41:34+01:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/75ead4c630355cd176eb3a48c698590a44ead797[slaprunner SR] remove references to deprecated entries in monitor-directory ...2019-01-10T09:41:34+01:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/a182b49c309e41ee719764abc840544f449e3609[monitor SR] remove references to deprecated entries in monitor-directory sec...2019-01-10T09:41:34+01:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/ddf750081616b65058f94bb913418feb6ae25f86[caddy-frontend SR] remove references to deprecated entries in monitor-direct...2019-01-10T09:41:34+01:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/6a8a28376d0ea80e883eb3cb29225650b8deee9c[apache-frontend SR] remove references to deprecated entries in monitor-direc...2019-01-09T19:06:58+01:00Thomas Gambierthomas.gambier@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/ea259373ca3a443c6bbf644b159726768bf2ff18component/pure-ftpd: Add pure-ftpd component2019-01-09T14:49:18+01:00Rafael Monneratrafael@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/fe55b02233ce82dbe337b29ad6f0e01adc5530c4seleniumserver: publish ssh fingerprint2019-01-09T03:13:21+01:00Jérome Perrinjerome@nexedi.com
so that on first connection clients can check the fingerprint key
instead of blindly accepting it.https://lab.node.vifib.com/nexedi/slapos/-/commit/381f49e3602287fd4c4ca270ce7e3842977b4ae1seleniumserver: try to fix intermitent test failure2019-01-08T14:13:49+01:00Jérome Perrinjerome@nexedi.com
This seem to be needed "sometimes", apparently on the first connection
after server is started, but this was not investigated much.https://lab.node.vifib.com/nexedi/slapos/-/commit/fce3c74a11661349c82a8e596572d17491c53b94component/apache: increase Timeout for direct access case2019-01-08T07:45:28+01:00Jérome Perrinjerome@nexedi.com
In "direct zope access" ports, the shared frontend is not used, so
the argument that long timeout consume resources on shared server does
not apply here.
A timeout of one hour was choosen arbitrarily, a value that should be
large enough for normal requests and more than the default 60s timeout
that we hit in the "wait for activities" step when running zelenium
tests.https://lab.node.vifib.com/nexedi/slapos/-/commit/b2dcbd2f091f79aacf2802bfcf33046c755d7f63Make BUILDOUT-NEXT test suite use same setuptools version as master again2019-01-07T07:08:55+01:00Jérome Perrinjerome@nexedi.com
In <a href="/nexedi/slapos/-/commit/517409612b73a2e10c22f3609ba540dce43bca92" data-original="517409612b73a2e10c22f3609ba540dce43bca92" data-link="false" data-link-reference="false" data-project="15" data-commit="517409612b73a2e10c22f3609ba540dce43bca92" data-reference-type="commit" data-container="body" data-placement="top" data-html="true" title="Start testing new version of setuptools" class="gfm gfm-commit has-tooltip">51740961</a> we "started testing new version of setuptools" and `BUILDOUT-NEXT` test suite was set to use this `software/buildout-testing/software-next.cfg`.
In <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/425" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/425" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2447" data-project-path="nexedi/slapos" data-iid="425" data-mr-title="Update to jsonschema to support Draft 7 and fix some invalid json" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!425</a> we started to depend on very recent setuptools and updated to 40.4.3 .
This `software/buildout-testing/software-next.cfg` kept using this old setuptools and `BUILDOUT-NEXT` test suite failed to build in a loop.
The test suite was already changed to use `software/buildout-testing/software.cfg` (ie. it's same as `BUILDOUT` but testing slapos.buildout's `next` branch instead of `master` ), so I think this profile is not needed currently.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/488" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/488" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2657" data-project-path="nexedi/slapos" data-iid="488" data-mr-title="Make BUILDOUT-NEXT test suite use same setuptools version as master again" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!488</a>https://lab.node.vifib.com/nexedi/slapos/-/commit/6bae8d6668d89ebdfe28ad4bbd96294ae4be71e7slaprunner: dynamically guess table names in slapproxy database2019-01-07T07:04:34+01:00Jérome Perrinjerome@nexedi.com
Using `software11` breaks now that the version of the database was
increased in <a href="https://lab.nexedi.com/nexedi/slapos.core/merge_requests/76" data-original="https://lab.nexedi.com/nexedi/slapos.core/merge_requests/76" data-link="false" data-link-reference="true" data-project="77" data-merge-request="2615" data-project-path="nexedi/slapos.core" data-iid="76" data-mr-title="Implement Software Destruction in slapos proxy" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">slapos.core!76</a>
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/483" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/483" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2647" data-project-path="nexedi/slapos" data-iid="483" data-mr-title="slaprunner: dynamically guess table names in slapproxy database" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!483</a>https://lab.node.vifib.com/nexedi/slapos/-/commit/9d700b969d3ee20fc56a6473b869eaa0630d96e1caddy-frontend: Stabilise slashes (/) during rewrite2019-01-04T09:37:50+01:00Lukasz Nowakluke@nexedi.com
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/489" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/489" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2661" data-project-path="nexedi/slapos" data-iid="489" data-mr-title="caddy-frontend: Stabilise slashes (/) during rewrite" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!489</a>https://lab.node.vifib.com/nexedi/slapos/-/commit/9345c81b843b28505ea88281319d83186ba51a0c[kvm] Add information about IPv6 tap address when kvm uses tap2019-01-03T16:12:53+01:00Thomas Gambierthomas.gambier@nexedi.com
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/469" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/469" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2594" data-project-path="nexedi/slapos" data-iid="469" data-mr-title="[kvm] Add information about IPv6 tap address when kvm uses tap" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!469</a>https://lab.node.vifib.com/nexedi/slapos/-/commit/9fe041b498284cbd0df491b527966f4aee54f89cerp5: Re-add pin for erp5.recipe.w3validator2019-01-02T22:24:37+01:00Rafael Monneratrafael@nexedi.com
Before call uninstall, the pin is verified and it can cause error if picked version is mandatory.https://lab.node.vifib.com/nexedi/slapos/-/commit/ae6327836175f4cffbf7cdfcd1b4a5d1a5780670Remove W3Validator2019-01-02T11:43:35+01:00Bryton Lacquementbryton.lacquement@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/b137f9d55c3e85dbf6f570d9bcfa4a6fdf3a5026caddy-frontend: Assert and fix HTTP redirect codes2019-01-02T09:25:00+01:00Lukasz Nowakluke@nexedi.com
Just asserting Location header is not enough, as http status code value is
important for the implementation, so assert for its value.
Also fix https-only redirect status code value, which supposed to be FOUND,
not default MOVED_PERMANENTLY.
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/485" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/485" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2652" data-project-path="nexedi/slapos" data-iid="485" data-mr-title="caddy-frontend: Assert and fix HTTP redirect codes" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!485</a>https://lab.node.vifib.com/nexedi/slapos/-/commit/c8ef7db52335526b8630380593654fed5ab10ff0Feature/caddy frontend path normalization2018-12-30T14:56:03+01:00Lukasz Nowakluke@nexedi.com
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/487" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/487" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2654" data-project-path="nexedi/slapos" data-iid="487" data-mr-title="Feature/caddy frontend path normalization" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">!487</a>https://lab.node.vifib.com/nexedi/slapos/-/commit/dddb4d206859f4e5cf3d4cffce471e46ad7ef56aFix/caddy frontend monitor conf2018-12-30T14:54:32+01:00Lukasz Nowakluke@nexedi.com
/reviewed-on <a href="https://lab.nexedi.com/nexedi/slapos/merge_requests/486" data-original="https://lab.nexedi.com/nexedi/slapos/merge_requests/486" data-link="false" data-link-reference="true" data-project="15" data-merge-request="2653" data-project-path="nexedi/slapos" data-iid="486" data-mr-title="Fix/caddy frontend monitor conf" data-reference-type="merge_request" data-container="body" data-placement="top" data-html="true" title="" class="gfm gfm-merge_request">nexedi/slapos!486</a>https://lab.node.vifib.com/nexedi/slapos/-/commit/e156a5b3c6cabcaad417f126d3456157081dd175Update Release Candidate2018-12-28T17:03:12+01:00Rafael Monneratrafael@nexedi.comhttps://lab.node.vifib.com/nexedi/slapos/-/commit/203a32fcac462abb8d07b0b565b8fd3f9ac60311Release slapos.cookbook as 1.0.852018-12-28T17:01:33+01:00Rafael Monneratrafael@nexedi.com
The version 1.0.84 was used by an existing tag on the
version control, so it would be inconsistent to use this
version number.