Commits · d84b3ec89debe67fe13284e911d1e4f552bf3090 · Stefane Fermigier / neo

30 May, 2011 5 commits

Add script to quickly setup a NEO cluster for testing purpose · d84b3ec8
Julien Muchembled authored May 30, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2768 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
d84b3ec8

Julien Muchembled authored May 30, 2011

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2767 71dcc9de-d417-0410-9af5-da40c76e7ee4

0a20ca1f

Remove debugging code and comment about possible optimization with Python >= 2.5 · d3e07066
Julien Muchembled authored May 30, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2766 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
d3e07066

Fix 2 bugs in 'undo' implementation · 862b0ba4

Julien Muchembled authored May 30, 2011

- make 'undo' compatible with ZODB 3.9.x
- fix load of original version of object

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2765 71dcc9de-d417-0410-9af5-da40c76e7ee4

862b0ba4

client: add 'read-only' & 'verbose' config options · 769d309d
Julien Muchembled authored May 30, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2764 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
769d309d

27 May, 2011 4 commits

Update implementation of HasLock processing on client side · 22adbcd7
Julien Muchembled authored May 27, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2763 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
22adbcd7

connection: reimplement timeout logic and redefine pings as a keep-alive feature · 737e227a

Julien Muchembled authored May 27, 2011

- Previous implementation was not able to import transactions with many small
  objects, the client for faster to send a store request than to process its
  answer. If X is the difference of time for these 2 operations, the maximum
  number of objects a transaction could contain was CRITICAL_TIMEOUT / X.
  And HasLock feature can't act as a workaround because it is not working yet.
- Change API of 'on_timeout', which currently only used by HasLock.
- Stop pinging when we wait for an answer. This wastes resources and would
  never recover any bad state.
- Make client connections send pings when they are idle instead.
  This implements keep-alive feature for high availability.
  Start with an non-configurable period of 60 seconds.
- Move processing of ping/pong to handlers.

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2762 71dcc9de-d417-0410-9af5-da40c76e7ee4

737e227a

Remove overkill Packet.getType method · f7378a70
Julien Muchembled authored May 27, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2761 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
f7378a70

poll: data may be received when processing exception list · 86ce8602

Julien Muchembled authored May 27, 2011

For the moment, this only fixes a performance issue because in the worst case,
subsequent pings (every 6 seconds) would make _poll() check in the connection
has any pending message (while processing 'rlist').

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2760 71dcc9de-d417-0410-9af5-da40c76e7ee4

86ce8602

24 May, 2011 1 commit
- setup.py: define all features even if they have no dependency · 2a01e387
  Julien Muchembled authored May 24, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2759 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  2a01e387
23 May, 2011 6 commits

Revert to single-dist setup.py and use virtual dependencies instead · 6e1932bd

Julien Muchembled authored May 23, 2011

The only reason why we produced different eggs was because we may want to
install easily an admin node without caring about dependencies of neo.client.

Multi-dist setup.py contains hacks and was overkill for NEO.

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2757 71dcc9de-d417-0410-9af5-da40c76e7ee4
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2758 71dcc9de-d417-0410-9af5-da40c76e7ee4

6e1932bd

setup.py: do not call findall unconditionally · afa3a61e
Julien Muchembled authored May 23, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2756 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
afa3a61e
client: remove wrong assertion when connection is closed by peer · dad44f3b
Julien Muchembled authored May 23, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2755 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
dad44f3b

Clarify configuration of zope.conf · 6ffdf810

Julien Muchembled authored May 23, 2011

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2754 71dcc9de-d417-0410-9af5-da40c76e7ee4

6ffdf810

typo · 2049936e

Julien Muchembled authored May 23, 2011

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2753 71dcc9de-d417-0410-9af5-da40c76e7ee4

2049936e

setup.py: fix installed scripts and neoclient data · 1bcaed21
Julien Muchembled authored May 23, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2752 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
1bcaed21

20 May, 2011 2 commits

Ignore mock.py and build/ · 6f9c11bb

Julien Muchembled authored May 20, 2011

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2751 71dcc9de-d417-0410-9af5-da40c76e7ee4

6f9c11bb

Full review of packaging, with multi-eggs setup.py · 185dffa0

Julien Muchembled authored May 20, 2011

- multi-eggs setup.py because we really don't want to split the repository
  in several ones
- move 'components.xml' since namespace packages should not contain anything
- workaround python-mock.sf.net because not eggified:
  automatically get a copy of mock.py (license: BSD) when setting up 'neotests'

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2750 71dcc9de-d417-0410-9af5-da40c76e7ee4

185dffa0

02 May, 2011 2 commits

Remove all trailing whitespaces · f78f7339

Julien Muchembled authored May 02, 2011

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2749 71dcc9de-d417-0410-9af5-da40c76e7ee4

f78f7339

tests: add a TODO entry · df900556

Julien Muchembled authored May 02, 2011

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2748 71dcc9de-d417-0410-9af5-da40c76e7ee4

df900556

29 Apr, 2011 4 commits
- logs: fix race condition when resetting logger · 3d69e526
  Julien Muchembled authored Apr 29, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2747 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  3d69e526
- tests: fix TypeError in output log · 002558b6
  Julien Muchembled authored Apr 29, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2746 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  002558b6
- tests: fix file descriptor leak · 14d25043
  Julien Muchembled authored Apr 29, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2745 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  14d25043
- tests: fix boolean evaluation of Mock objects · 517fc5e6
  Julien Muchembled authored Apr 29, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2744 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
  517fc5e6
28 Apr, 2011 8 commits

Split testRestartWithMissingStorage into 1 passing and 1 failing tests · c21ad524

Julien Muchembled authored Apr 28, 2011

testRestartWithMissingStorage was failing randomly depending on whether the
cluster was started before or after the storage initializing connection
with the master.
Change to NEOCluster.start allows to test both scenarios explicitely.

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2743 71dcc9de-d417-0410-9af5-da40c76e7ee4

c21ad524

tests: slightly speed up cluster startup & expectXxx methods · dcace4ee
Julien Muchembled authored Apr 28, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2742 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
dcace4ee
tests: log started & killed processes · 3db30547
Julien Muchembled authored Apr 28, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2741 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
3db30547
Slightly reduce width of logs generated by packet logger · 8270d116
Julien Muchembled authored Apr 28, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2740 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
8270d116

tests: minor fixup to r2736 & r2738 · 4a50b1c3

Julien Muchembled authored Apr 28, 2011

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2739 71dcc9de-d417-0410-9af5-da40c76e7ee4

4a50b1c3

tests: output logs of parent process in temporary directory of current run · 5e9af25c
Julien Muchembled authored Apr 28, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2738 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
5e9af25c
Exceptions are not new-style classes in Python < 2.5 · 8a49145c
Julien Muchembled authored Apr 28, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2737 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
8a49145c
Fix storage exiting with non-zero status in testDropNodeThenRestartCluster · bb69f48b
Julien Muchembled authored Apr 28, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2736 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
bb69f48b

27 Apr, 2011 6 commits

storage: teach shutdown to close all connections · 15308c68
Julien Muchembled authored Apr 27, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2735 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
15308c68
storage: fix forward of parameter to DM in shutdown · d9bf64e1
Julien Muchembled authored Apr 27, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2734 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
d9bf64e1
replication: fix AttributeError when storage switches to another storage · bb146239
Julien Muchembled authored Apr 27, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2733 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
bb146239

connection: make close always call handler (connectionClosed or connectionFailed) · 4b6c1387

Julien Muchembled authored Apr 27, 2011

Main reason is that it's difficult to know in advance which side really closes
the connection. Network events can be chaotic and this could lead to many race
conditions.
Thus, handler can be used to update any database that is somewhat redundant
to the connection status, i.e. node status usually. Safely and less duplicated
code.

This change is motivated by recurrent random failures during election.
An example of race condition was that 2 fully connected master could close the
extra connection (the primary -> secondary one) at the same time.

In order to stabilize lower-level code and start with reliable election process,
code has also been simplified to not care about node states. All connections
without exception are closed at the end of the election and states are then
updated 1 by 1 by identification handler.
Note that during election, there may be 2 connection per node, which makes
difficult to update node states by connectionFailed/connectionClosed events.

timeoutExpired & peerBroken are dropped as they are unused for the moment.
A new API should be designed so that connectionClosed know the reason of the
close.
BROKEN state becomes unused.

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2732 71dcc9de-d417-0410-9af5-da40c76e7ee4

4b6c1387

storage: do not log all store event during normal run · 35f0a5bf
Julien Muchembled authored Apr 27, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2731 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
35f0a5bf
tests: enable packet logger only when a NEO test is run · ab6e1806
Julien Muchembled authored Apr 27, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2730 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
ab6e1806

21 Apr, 2011 2 commits

Update tests against r2728 (added assertion in Connection.abort) · b265df3e
Julien Muchembled authored Apr 21, 2011
```
git-svn-id: https://svn.erp5.org/repos/neo/trunk@2729 71dcc9de-d417-0410-9af5-da40c76e7ee4
```
b265df3e

Do not try to send notifications on closed connections · f9b5cea4

Julien Muchembled authored Apr 21, 2011

Now we can assert that abort is not called when it shouldn't be.

git-svn-id: https://svn.erp5.org/repos/neo/trunk@2728 71dcc9de-d417-0410-9af5-da40c76e7ee4

f9b5cea4