See merge request nexedi/slapos!1300

Credit: This originally based on XU Lu's work
I rewrite it base on Romain's comment and add the tests

See merge request nexedi/slapos!1362

Since f48a06ec noVNC is broken: the
default port for websocket is 5700 + display (and not 5900 + display).

Fix this error and add a promise to test websocket.

This reverts commit f1f09628.

This causes mariadb crashes, maybe because of groonga:

mariadb_error.log:

  230306 11:55:00 [ERROR] mysqld got signal 11 ;

gdb:

  Thread 176 (Thread 0x7f92e02c0700 (LWP 59293)):
  #0  0x00007f9b9521871b in ?? () from /lib/x86_64-linux-gnu/libc.so.6
  #1  0x00007f9b951961bb in ?? () from /lib/x86_64-linux-gnu/libc.so.6
  #2  0x00007f9b951d88ca in fork () from /lib/x86_64-linux-gnu/libc.so.6
  #3  0x000055f8f620d510 in start_addr2line_fork (binary_path=0x7ffeb54a7f4e "/srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/bin/mysqld") at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/mysys/my_addr_resolve.c:192
  #4  start_addr2line_fork (binary_path=0x7ffeb54a7f4e "/srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/bin/mysqld") at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/mysys/my_addr_resolve.c:175
  #5  0x000055f8f620d644 in my_addr_resolve (ptr=0x55f8f61f886e <my_print_stacktrace+46>, loc=loc@entry=0x7f92e02bb840) at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/mysys/my_addr_resolve.c:241
  #6  0x000055f8f61f88c3 in print_with_addr_resolve (n=<optimized out>, addrs=0x7f92e02bb860) at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/mysys/stacktrace.c:159
  #7  my_print_stacktrace (stack_bottom=<optimized out>, thread_stack=<optimized out>, silent=silent@entry=0 '\000') at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/mysys/stacktrace.c:178
  #8  0x000055f8f5d075cd in handle_fatal_signal (sig=11) at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/sql/signal_handler.cc:230
  #9  <signal handler called>
  #10 0x00007f9b95194973 in ?? () from /lib/x86_64-linux-gnu/libc.so.6
  #11 0x00007f9b951971a2 in calloc () from /lib/x86_64-linux-gnu/libc.so.6
  #12 0x00007f9b903d7e3c in grn_calloc_default (ctx=0x7f90441927e8, size=112, file=0x7f9b907cd060 "hash.c", line=1981, func=<optimized out>) at alloc.c:761
  #13 0x00007f9b904cbd9f in grn_hash_init_wal_data (hash=0x7f904418bee0, ctx=0x7f90441927e8) at hash.c:2002
  #14 grn_hash_init (path=<optimized out>, key_size=<optimized out>, value_size=0, flags=64, hash=0x7f904418bee0, ctx=0x7f90441927e8) at hash.c:2002
  #15 grn_hash_init (ctx=0x7f90441927e8, hash=0x7f904418bee0, path=<optimized out>, key_size=<optimized out>, value_size=0, flags=64) at hash.c:1990
  #16 0x00007f9b904ce6b4 in grn_hash_create (ctx=ctx@entry=0x7f90441927e8, path=path@entry=0x0, key_size=key_size@entry=4, value_size=value_size@entry=0, flags=flags@entry=64) at hash.c:2043
  #17 0x00007f9b90733a59 in grn_table_all_columns (ctx=ctx@entry=0x7f90441927e8, table=table@entry=0x7f91c97c0480) at table.c:740
  #18 0x00007f9b903fc0fc in delete_reference_records (id=<optimized out>, table=0x7f91c97c0480, ctx=0x7f90441927e8) at db.c:4215
  #19 grn_table_delete_prepare (ctx=0x7f90441927e8, table=0x7f91c97c0480, id=2, key=0x0, key_size=0) at db.c:4246
  #20 0x00007f9b903fc8b7 in _grn_table_delete_by_id (ctx=0x7f90441927e8, table=0x7f91c97c0480, id=2, optarg=0x0) at db.c:4324
  #21 0x00007f9b903fca64 in grn_table_delete_by_id (ctx=0x7f90441927e8, table=0x7f91c97c0480, id=2) at db.c:4356
  #22 0x00007f9b910fe2de in mrn::Operations::finish (this=<optimized out>, id=<optimized out>) at mrn_operations.cpp:144
  #23 0x00007f9b910feecf in mrn::Operation::~Operation (this=<optimized out>, __in_chrg=<optimized out>) at mrn_operation.cpp:39
  #24 0x00007f9b910eb354 in ha_mroonga::storage_write_row (this=0x7f9044190fc0, buf=0x7f8f740309f0 "\376Fd\027") at ha_mroonga.cpp:7261
  #25 0x000055f8f5d11f9f in handler::ha_write_row (this=0x7f9044190fc0, buf=0x7f8f740309f0 "\376Fd\027") at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/sql/handler.cc:6495
  #26 0x000055f8f5af4379 in write_record (thd=thd@entry=0x7f9044000c08, table=table@entry=0x7f9044195198, info=info@entry=0x7f92e02bdb80) at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/sql/sql_insert.cc:1727
  #27 0x000055f8f5afaf49 in mysql_insert (thd=thd@entry=0x7f9044000c08, table_list=<optimized out>, fields=..., values_list=..., update_fields=..., update_values=..., duplic=<optimized out>, ignore=<optimized out>) at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/sql/sql_insert.cc:1077
  #28 0x000055f8f5b25abf in mysql_execute_command (thd=<optimized out>) at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/sql/sql_parse.cc:4505
  #29 0x000055f8f5b2a509 in mysql_parse (thd=0x7f9044000c08, rawbuf=<optimized out>, length=209, parser_state=0x7f92e02bf5c0, is_com_multi=<optimized out>, is_next_command=<optimized out>) at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/sql/sql_parse.cc:7855
  #30 0x000055f8f5b2c3a5 in dispatch_command (command=COM_QUERY, thd=0x7f9044000c08, packet=<optimized out>, packet_length=<optimized out>, is_com_multi=<optimized out>, is_next_command=<optimized out>) at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/sql/sql_class.h:1153
  #31 0x000055f8f5b2db02 in do_command (thd=0x7f9044000c08) at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/sql/sql_parse.cc:1398
  #32 0x000055f8f5c08986 in do_handle_one_connection (connect=connect@entry=0x55f9243d8b38) at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/sql/sql_connect.cc:1404
  #33 0x000055f8f5c08afd in handle_one_connection (arg=0x55f9243d8b38) at /srv/slapgrid/slappart15/srv/runner/instance/slappart7/tmp/shared/mariadb-10.3/59926e9bb7961f6ab1ae320e6286d63a/.build/mariadb-10.3.38/sql/sql_connect.cc:1309
  #34 0x00007f9b952dafa3 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
  #35 0x00007f9b9520b4cf in clone () from /lib/x86_64-linux-gnu/libc.so.6

Let's revert while we continue investigating

See merge request nexedi/slapos!1372

The instance-gitlab-test.cfg.in was removed.
We should test the cfg which used in production,
not a dedicated cfg for testing

See merge request !1368

Add missing libxcb to rpath

This reverts commit ca5ba490.

It's actually a good idea to update our pandas version (0.19.x is
already 7 years old, in one project we recently run into a bug of this
pandas version).

We only need to prepare erp5 with few changes so that it also support
those newer versions. This preperation was done in nexedi/erp5!1738.

/reviewed-on nexedi/slapos!1355

using ERP5: nexedi/erp5!1545

See merge request nexedi/slapos!1122

1) stack/erp5/zope-versions.cfg
2) stack/slapos.cfg
3) component/ZODB/buildout.cfg.

and remove stack/erp5/ztk-versions.cfg as we need only small part of it.

stack/slapos.cfg should be listed in the begining of software release extends list.

ERP5 now only supports WSGI

This needs a recent enough erp5, with the following commit:
zopewsgi: configure threads count and large_file_threshold with argparse

We only support wsgi now.

TODO: revert nexedi/slapos.package@63da524b

Only wsgi is supported with Zope 4

haufe.requestmonitoring already supports WSGI and Python3 and seems
used and maintainted.

For ZEO4, this was implemented as a monkey patch in ERP5, but this is
now supported in ZEO5, but not enabled by default.

The setting is only avaiable through ZEO's own ZConfig, but not with
ZODB's <zeoclient> so we also adjust the config to import ZEO and use
ZEO's <clientstorage>.

SIGUSR2 for reopening log files was handled by ZServer and waitress does not
handle signals at all, so we could handle this signal but Zope official
documentation recommends using logrotate `copytruncate`:
  https://zope.readthedocs.io/en/4.7/zopebook/MaintainingZope.html#log-rotation
  https://github.com/zopefoundation/Zope/issues/809

This was using `python` which is not always available

Also re-export package-lock.json for the format from npm we currently
have in theia

See merge request nexedi/slapos!1369

See merge request nexedi/slapos!1322

Compile xdpyinfo for use, in case of debug.

bash tests files (*..bash) was not included to nxdtest.