version up: persistent 4.5.0 (7256fe1d) · Commits · nexedi / slapos

@jerome I think we already discussed about the fact that buildout ignores setup_requires, which means that an egg being installed may install eggs on its own, in a temporary place and ignoring [versions]. Do you remember where ?

/cc @Sokhoyan

Maybe this ERP5 cannot install h5py forum thread ? /cc @Nicolas

In 2014 there was also some email discussion on vifib mailing list ( subject [Vifib] 'cliff==1.9.0' 404 not found error ). I don't know if we still have mailing list archive, but I read the thread again, it's not really clear. I remember it was a problem that during installation of cliff the setup "escapes" setuptools to install pbr.

cliff has a requirement.txt where pbr version is not fixed. Fixing in our buildout.cfg doesn't work because requirement.txt of cliff eggs has priority.

I'll open a bug in cliff bug tracker (i.e the same version of cliff can behave differently).

Even if it is fixed, I am not sure if it uses the cache mechanism of our buildout.

I think the fix was 303ce299 but the same day, Cédric also posted to that thread:

The problem has been fixed by the pbr maintainers yesterday, no need to do any hack to make it work.

BTW, is it a fix for this error ?

Installing neoppod.
networkcache: Downloading pypi-index-96af89cdde216340df5aec1e9a1392e0-BTrees==4.3.1...
networkcache: ignored unhandled exception at /srv/slapgrid/slappart35/srv/runner/instance/slappart0/srv/testnode/ayr/soft/ce7e56df4fd62c92aade4dac7d2dd77c/eggs/slapos.libnetworkcache-0.14.5-py2.7.egg/slapos/networkcachehelper.py:107
HTTPError: HTTP Error 404: Not Found
networkcache: Downloading pypi-index-99e2b3234a294248d07c2bb8e6698302-BTrees==4.3.1...
networkcache: ignored unhandled exception at /srv/slapgrid/slappart35/srv/runner/instance/slappart0/srv/testnode/ayr/soft/ce7e56df4fd62c92aade4dac7d2dd77c/eggs/slapos.libnetworkcache-0.14.5-py2.7.egg/slapos/networkcachehelper.py:107
HTTPError: HTTP Error 404: Not Found
networkcache: Downloading pypi-index-a46be9bd3756ada5c303353adbb6407f-BTrees==4.3.1...
networkcache: ignored unhandled exception at /srv/slapgrid/slappart35/srv/runner/instance/slappart0/srv/testnode/ayr/soft/ce7e56df4fd62c92aade4dac7d2dd77c/eggs/slapos.libnetworkcache-0.14.5-py2.7.egg/slapos/networkcachehelper.py:107
HTTPError: HTTP Error 404: Not Found
networkcache: Downloading pypi-index-af9619a05bbecc2eea9f185e22516ba2-BTrees==4.3.1...
networkcache: ignored unhandled exception at /srv/slapgrid/slappart35/srv/runner/instance/slappart0/srv/testnode/ayr/soft/ce7e56df4fd62c92aade4dac7d2dd77c/eggs/slapos.libnetworkcache-0.14.5-py2.7.egg/slapos/networkcachehelper.py:107
HTTPError: HTTP Error 404: Not Found
srv/slapgrid/slappart35/srv/runner/instance/slappart0/srv/testnode/ayr/soft/ce7e56df4fd62c92aade4dac7d2dd77c/eggs/setuptools-33.1.1-py2.7.egg/pkg_resources/__init__.py:184: RuntimeWarning: You have iterated over the result of pkg_resources.parse_version. This is a legacy behavior which is inconsistent with the new version class introduced in setuptools 8.0. In most cases, conversion to a tuple is unnecessary. For comparison of versions, sort the Version instances directly. If you have another use case requiring the tuple, please file a bug with the setuptools project describing that need.
networkcache: Downloading slapos-buildout-65d5df20a51bdd18f6074ed3592da4fb...
networkcache: ignored unhandled exception at /srv/slapgrid/slappart35/srv/runner/instance/slappart0/srv/testnode/ayr/soft/ce7e56df4fd62c92aade4dac7d2dd77c/eggs/slapos.libnetworkcache-0.14.5-py2.7.egg/slapos/networkcachehelper.py:107
HTTPError: HTTP Error 404: Not Found
Cannot download https://files.pythonhosted.org/packages/24/76/cd6f225f2180c22af5cdb6656f51aec5fca45e45bdc4fa75c0a32f161a61/BTrees-4.3.1.tar.gz#sha256=2565b7d35260dfc6b1e2934470fd0a2f9326c58c535a2b4cb396289d1c195a95 from network cache.
c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory
include <ffi.h>
^
compilation terminated.
error: Setup script exited with error: command 'gcc' failed with exit status 1
An error occurred when trying to install BTrees 4.3.1. Look above this message for any errors that were output by easy_install.
While:
  Installing neoppod.
Error: Couldn't install: BTrees 4.3.1

Yes, I confirm it was : https://www.erp5.com/group_section/forum/ERP5-cannot-install-h5py-5bLv84wkiM

h5py (or one of its dependencies) was fetching on its own more_itertools at the latest version, which was python3 only.

In the end, even if I commited some change, the needed fix was pushed upstream by the maintainers, as for Cedric's case. The fix consisted in forcing the version of more_itertools to something less recent if the interpreter was python2.

This change does not fix Eteri's SR and while debugging again this commit in ERP5-component-SLAPOS-component I found /tmp/easy_install-WvCYPy/persistent-4.5.0/temp/easy_install-XzS9Yp/cffi-1.12.3-cp27-cp27mu-manylinux1_x86_64.whl thanks to strace. Which would mean that recent setuptools finds a way to install.

New attempt at e43cc74d.

Please let me know if it works for you, I have this c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory and I have not started looking at the issue.

Hi all. Seems it's working! Thanks @jm a lot!

@@ -46,6 +46,9 @@ eggs = neoppod[admin, ctl, master]
   ${msgpack-python:egg}
   ${:adapter-egg}
   psutil
 # XXX: BTrees setup_requires persistent
   ${python-cffi:egg}
   persistent
   BTrees
   ZODB
   zope.testing
@@ -126,7 +129,7 @@ gitdb2 = 2.0.0
 msgpack = 0.5.6
 msgpack-python = 0.5.6
 mysqlclient = 1.3.12
 persistent = 4.2.3
 persistent = 4.5.0
 pycrypto = 2.6.1
 pycurl = 7.43.0
 setproctitle = 1.1.10
-...