Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Z
ZODB
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Analytics
Analytics
CI / CD
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
Kirill Smelkov
ZODB
Commits
3b599ac4
Commit
3b599ac4
authored
Mar 15, 2002
by
Jeremy Hylton
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Merge changes from the zeo-1_0-branch onto the debug branch
parent
7f238e85
Changes
15
Show whitespace changes
Inline
Side-by-side
Showing
15 changed files
with
275 additions
and
188 deletions
+275
-188
src/ZEO/ClientCache.py
src/ZEO/ClientCache.py
+1
-1
src/ZEO/ClientStorage.py
src/ZEO/ClientStorage.py
+1
-2
src/ZEO/StorageServer.py
src/ZEO/StorageServer.py
+82
-115
src/ZEO/asyncwrap.py
src/ZEO/asyncwrap.py
+4
-1
src/ZEO/smac.py
src/ZEO/smac.py
+1
-1
src/ZEO/start.py
src/ZEO/start.py
+2
-5
src/ZEO/tests/Cache.py
src/ZEO/tests/Cache.py
+0
-1
src/ZEO/tests/__init__.py
src/ZEO/tests/__init__.py
+13
-0
src/ZEO/tests/forker.py
src/ZEO/tests/forker.py
+9
-12
src/ZEO/tests/multi.py
src/ZEO/tests/multi.py
+10
-13
src/ZEO/tests/stress.py
src/ZEO/tests/stress.py
+22
-25
src/ZEO/tests/testZEO.py
src/ZEO/tests/testZEO.py
+128
-9
src/ZEO/tests/winserver.py
src/ZEO/tests/winserver.py
+0
-1
src/ZEO/zrpc.py
src/ZEO/zrpc.py
+1
-1
src/ZEO/zrpc/smac.py
src/ZEO/zrpc/smac.py
+1
-1
No files found.
src/ZEO/ClientCache.py
View file @
3b599ac4
...
@@ -73,7 +73,7 @@ file 0 and file 1.
...
@@ -73,7 +73,7 @@ file 0 and file 1.
"""
"""
__version__
=
"$Revision: 1.2
1
$"
[
11
:
-
2
]
__version__
=
"$Revision: 1.2
2
$"
[
11
:
-
2
]
import
os
,
tempfile
import
os
,
tempfile
from
struct
import
pack
,
unpack
from
struct
import
pack
,
unpack
...
...
src/ZEO/ClientStorage.py
View file @
3b599ac4
...
@@ -13,8 +13,7 @@
...
@@ -13,8 +13,7 @@
##############################################################################
##############################################################################
"""Network ZODB storage client
"""Network ZODB storage client
"""
"""
__version__
=
'$Revision: 1.39 $'
[
11
:
-
2
]
__version__
=
'$Revision: 1.38 $'
[
11
:
-
2
]
import
struct
,
time
,
os
,
socket
,
string
,
Sync
,
zrpc
,
ClientCache
import
struct
,
time
,
os
,
socket
,
string
,
Sync
,
zrpc
,
ClientCache
import
tempfile
,
Invalidator
,
ExtensionClass
,
thread
import
tempfile
,
Invalidator
,
ExtensionClass
,
thread
...
...
src/ZEO/StorageServer.py
View file @
3b599ac4
#############################################################################
##############################################################################
#
# Zope Public License (ZPL) Version 1.0
# -------------------------------------
#
# Copyright (c) Digital Creations. All rights reserved.
#
# This license has been certified as Open Source(tm).
#
# Redistribution and use in source and binary forms, with or without
# modification, are permitted provided that the following conditions are
# met:
#
# 1. Redistributions in source code must retain the above copyright
# notice, this list of conditions, and the following disclaimer.
#
# 2. Redistributions in binary form must reproduce the above copyright
# notice, this list of conditions, and the following disclaimer in
# the documentation and/or other materials provided with the
# distribution.
#
# 3. Digital Creations requests that attribution be given to Zope
# in any manner possible. Zope includes a "Powered by Zope"
# button that is installed by default. While it is not a license
# violation to remove this button, it is requested that the
# attribution remain. A significant investment has been put
# into Zope, and this effort will continue if the Zope community
# continues to grow. This is one way to assure that growth.
#
# 4. All advertising materials and documentation mentioning
# features derived from or use of this software must display
# the following acknowledgement:
#
# "This product includes software developed by Digital Creations
# for use in the Z Object Publishing Environment
# (http://www.zope.org/)."
#
# In the event that the product being advertised includes an
# intact Zope distribution (with copyright and license included)
# then this clause is waived.
#
# 5. Names associated with Zope or Digital Creations must not be used to
# endorse or promote products derived from this software without
# prior written permission from Digital Creations.
#
# 6. Modified redistributions of any form whatsoever must retain
# the following acknowledgment:
#
# "This product includes software developed by Digital Creations
# for use in the Z Object Publishing Environment
# (http://www.zope.org/)."
#
# Intact (re-)distributions of any official Zope release do not
# require an external acknowledgement.
#
# 7. Modifications are encouraged but must be packaged separately as
# patches to official Zope releases. Distributions that do not
# clearly separate the patches from the original work must be clearly
# labeled as unofficial distributions. Modifications which do not
# carry the name Zope may be packaged in any form, as long as they
# conform to all of the clauses above.
#
#
# Disclaimer
#
# THIS SOFTWARE IS PROVIDED BY DIGITAL CREATIONS ``AS IS'' AND ANY
# EXPRESSED OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
# IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
# PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL DIGITAL CREATIONS OR ITS
# CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF
# USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
# ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
# OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT
# OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
# SUCH DAMAGE.
#
#
# Copyright (c) 2001, 2002 Zope Corporation and Contributors.
# All Rights Reserved.
#
#
# This software consists of contributions made by Digital Creations and
# This software is subject to the provisions of the Zope Public License,
# many individuals on behalf of Digital Creations. Specific
# Version 2.0 (ZPL). A copy of the ZPL should accompany this distribution.
# attributions are listed in the accompanying credits file.
# THIS SOFTWARE IS PROVIDED "AS IS" AND ANY AND ALL EXPRESS OR IMPLIED
# WARRANTIES ARE DISCLAIMED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
# WARRANTIES OF TITLE, MERCHANTABILITY, AGAINST INFRINGEMENT, AND FITNESS
# FOR A PARTICULAR PURPOSE
#
#
##############################################################################
##############################################################################
__version__
=
"$Revision: 1.3
4
$"
[
11
:
-
2
]
__version__
=
"$Revision: 1.3
5
$"
[
11
:
-
2
]
import
asyncore
,
socket
,
string
,
sys
,
os
import
asyncore
,
socket
,
string
,
sys
,
os
from
smac
import
SizedMessageAsyncConnection
from
smac
import
SizedMessageAsyncConnection
...
@@ -99,6 +28,7 @@ from thread import start_new_thread
...
@@ -99,6 +28,7 @@ from thread import start_new_thread
from
cStringIO
import
StringIO
from
cStringIO
import
StringIO
from
ZEO
import
trigger
from
ZEO
import
trigger
from
ZEO
import
asyncwrap
from
ZEO
import
asyncwrap
from
ZEO.smac
import
Disconnected
from
types
import
StringType
from
types
import
StringType
class
StorageServerError
(
POSException
.
StorageError
):
pass
class
StorageServerError
(
POSException
.
StorageError
):
pass
...
@@ -133,6 +63,8 @@ class StorageServer(asyncore.dispatcher):
...
@@ -133,6 +63,8 @@ class StorageServer(asyncore.dispatcher):
self
.
__storages
=
storages
self
.
__storages
=
storages
for
n
,
s
in
storages
.
items
():
for
n
,
s
in
storages
.
items
():
init_storage
(
s
)
init_storage
(
s
)
# Create a waiting list to support the distributed commit lock.
s
.
_waiting
=
[]
self
.
__connections
=
{}
self
.
__connections
=
{}
self
.
__get_connections
=
self
.
__connections
.
get
self
.
__get_connections
=
self
.
__connections
.
get
...
@@ -280,6 +212,7 @@ class ZEOConnection(SizedMessageAsyncConnection):
...
@@ -280,6 +212,7 @@ class ZEOConnection(SizedMessageAsyncConnection):
# This is the first communication from the client
# This is the first communication from the client
self
.
__storage
,
self
.
__storage_id
=
(
self
.
__storage
,
self
.
__storage_id
=
(
self
.
__server
.
register_connection
(
self
,
message
))
self
.
__server
.
register_connection
(
self
,
message
))
# Send info back asynchronously, so client need not ask
# Send info back asynchronously, so client need not ask
self
.
message_output
(
'S'
+
dump
(
self
.
get_info
(),
1
))
self
.
message_output
(
'S'
+
dump
(
self
.
get_info
(),
1
))
return
return
...
@@ -501,39 +434,76 @@ class ZEOConnection(SizedMessageAsyncConnection):
...
@@ -501,39 +434,76 @@ class ZEOConnection(SizedMessageAsyncConnection):
return
oids
return
oids
return
()
return
()
def
tpc_abort
(
self
,
id
):
# distributed commit lock support methods
t
=
self
.
_transaction
if
t
is
None
or
id
!=
t
.
id
:
return
r
=
self
.
__storage
.
tpc_abort
(
t
)
storage
=
self
.
__storage
# Only one client at a time can commit a transaction on a
try
:
waiting
=
storage
.
__waiting
# storage. If one client is committing a transaction, and a
except
:
waiting
=
storage
.
__waiting
=
[]
# second client sends a tpc_begin(), then second client is queued.
# When the first transaction finishes, either by abort or commit,
# the request from the queued client must be handled.
# It is important that this code be robust. If a queued
# transaction is not restarted, the server will stop processing
# new transactions.
# This lock is implemented by storing the queued requests in a
# list on the storage object. The list contains:
# a callable object to resume request
# arguments to that object
# a callable object to handle errors during resume
# XXX I am not sure that the commitlock_resume() method is
# sufficiently paranoid.
def
commitlock_suspend
(
self
,
resume
,
args
,
onerror
):
self
.
__storage
.
_waiting
.
append
((
resume
,
args
,
onerror
))
def
commitlock_resume
(
self
):
waiting
=
self
.
__storage
.
_waiting
while
waiting
:
while
waiting
:
f
,
args
=
waiting
.
pop
(
0
)
resume
,
args
,
onerror
=
waiting
.
pop
(
0
)
if
apply
(
f
,
args
):
break
try
:
if
apply
(
resume
,
args
):
break
except
Disconnected
:
# A disconnected error isn't an unexpected error.
# There should be no need to log it, because the
# disconnect will have generated its own log event.
onerror
()
except
:
LOG
(
'ZEO Server'
,
ERROR
,
"Unexpected error handling queued tpc_begin()"
,
error
=
sys
.
exc_info
())
onerror
()
self
.
_transaction
=
None
def
tpc_abort
(
self
,
id
):
self
.
__invalidated
=
[]
t
=
self
.
_transaction
if
t
is
None
or
id
!=
t
.
id
:
return
r
=
self
.
__storage
.
tpc_abort
(
t
)
self
.
_transaction
=
None
self
.
__invalidated
=
[]
self
.
commitlock_resume
()
def
unlock
(
self
):
def
unlock
(
self
):
if
self
.
__closed
:
return
if
self
.
__closed
:
return
self
.
message_output
(
'UN.'
)
self
.
message_output
(
'UN.'
)
def
tpc_begin
(
self
,
id
,
user
,
description
,
ext
):
def
tpc_begin
(
self
,
id
,
user
,
description
,
ext
):
t
=
self
.
_transaction
t
=
self
.
_transaction
if
t
is
not
None
:
if
t
is
not
None
:
if
id
==
t
.
id
:
return
if
id
==
t
.
id
:
return
else
:
else
:
raise
StorageServerError
(
raise
StorageServerError
(
"Multiple simultaneous tpc_begin requests from the same "
"Multiple simultaneous tpc_begin requests from the same "
"client."
"client."
)
)
storage
=
self
.
__storage
storage
=
self
.
__storage
if
storage
.
_transaction
is
not
None
:
if
storage
.
_transaction
is
not
None
:
try
:
waiting
=
storage
.
__waiting
self
.
commitlock_suspend
(
self
.
unlock
,
(),
self
.
close
)
except
:
waiting
=
storage
.
__waiting
=
[]
waiting
.
append
((
self
.
unlock
,
()))
return
1
# Return a flag indicating a lock condition.
return
1
# Return a flag indicating a lock condition.
self
.
_transaction
=
t
=
Transaction
()
self
.
_transaction
=
t
=
Transaction
()
...
@@ -552,9 +522,9 @@ class ZEOConnection(SizedMessageAsyncConnection):
...
@@ -552,9 +522,9 @@ class ZEOConnection(SizedMessageAsyncConnection):
if
storage
.
_transaction
is
None
:
if
storage
.
_transaction
is
None
:
self
.
try_again_sync
(
id
,
user
,
description
,
ext
)
self
.
try_again_sync
(
id
,
user
,
description
,
ext
)
else
:
else
:
try
:
waiting
=
storage
.
__waiting
self
.
commitlock_suspend
(
self
.
try_again_sync
,
except
:
waiting
=
storage
.
__waiting
=
[]
(
id
,
user
,
description
,
ext
),
waiting
.
append
((
self
.
try_again_sync
,
(
id
,
user
,
description
,
ext
))
)
self
.
close
)
return
_noreturn
return
_noreturn
...
@@ -572,24 +542,21 @@ class ZEOConnection(SizedMessageAsyncConnection):
...
@@ -572,24 +542,21 @@ class ZEOConnection(SizedMessageAsyncConnection):
return
1
return
1
def
tpc_finish
(
self
,
id
,
user
,
description
,
ext
):
def
tpc_finish
(
self
,
id
,
user
,
description
,
ext
):
t
=
self
.
_transaction
t
=
self
.
_transaction
if
id
!=
t
.
id
:
return
if
id
!=
t
.
id
:
return
storage
=
self
.
__storage
r
=
storage
.
tpc_finish
(
t
)
try
:
waiting
=
storage
.
__waiting
storage
=
self
.
__storage
except
:
waiting
=
storage
.
__waiting
=
[]
r
=
storage
.
tpc_finish
(
t
)
while
waiting
:
f
,
args
=
waiting
.
pop
(
0
)
if
apply
(
f
,
args
):
break
self
.
_transaction
=
None
self
.
_transaction
=
None
if
self
.
__invalidated
:
if
self
.
__invalidated
:
self
.
__server
.
invalidate
(
self
,
self
.
__storage_id
,
self
.
__server
.
invalidate
(
self
,
self
.
__storage_id
,
self
.
__invalidated
,
self
.
__invalidated
,
self
.
get_size_info
())
self
.
get_size_info
())
self
.
__invalidated
=
[]
self
.
__invalidated
=
[]
self
.
commitlock_resume
()
def
init_storage
(
storage
):
def
init_storage
(
storage
):
if
not
hasattr
(
storage
,
'tpc_vote'
):
storage
.
tpc_vote
=
lambda
*
args
:
None
if
not
hasattr
(
storage
,
'tpc_vote'
):
storage
.
tpc_vote
=
lambda
*
args
:
None
...
...
src/ZEO/asyncwrap.py
View file @
3b599ac4
...
@@ -11,7 +11,6 @@
...
@@ -11,7 +11,6 @@
# FOR A PARTICULAR PURPOSE
# FOR A PARTICULAR PURPOSE
#
#
##############################################################################
##############################################################################
"""A wrapper for asyncore that provides robust exception handling.
"""A wrapper for asyncore that provides robust exception handling.
The poll() and loop() calls exported by asyncore can raise exceptions.
The poll() and loop() calls exported by asyncore can raise exceptions.
...
@@ -32,6 +31,10 @@ it would be useful to extend this module with wrappers for those
...
@@ -32,6 +31,10 @@ it would be useful to extend this module with wrappers for those
errors.
errors.
"""
"""
# XXX The current implementation requires Python 2.0. Not sure if
# that's acceptable, depends on how many users want to combine ZEO 1.0
# and Zope 2.3.
import
asyncore
import
asyncore
import
errno
import
errno
import
select
import
select
...
...
src/ZEO/smac.py
View file @
3b599ac4
...
@@ -14,7 +14,7 @@
...
@@ -14,7 +14,7 @@
"""Sized message async connections
"""Sized message async connections
"""
"""
__version__
=
"$Revision: 1.1
4
$"
[
11
:
-
2
]
__version__
=
"$Revision: 1.1
5
$"
[
11
:
-
2
]
import
asyncore
,
string
,
struct
,
zLOG
,
sys
,
Acquisition
import
asyncore
,
string
,
struct
,
zLOG
,
sys
,
Acquisition
import
socket
,
errno
import
socket
,
errno
...
...
src/ZEO/start.py
View file @
3b599ac4
...
@@ -15,7 +15,7 @@
...
@@ -15,7 +15,7 @@
"""Start the server storage.
"""Start the server storage.
"""
"""
__version__
=
"$Revision: 1.
29
$"
[
11
:
-
2
]
__version__
=
"$Revision: 1.
30
$"
[
11
:
-
2
]
import
sys
,
os
,
getopt
,
string
import
sys
,
os
,
getopt
,
string
...
@@ -264,10 +264,7 @@ def rotate_logs():
...
@@ -264,10 +264,7 @@ def rotate_logs():
zLOG
.
log_write
.
reinitialize
()
zLOG
.
log_write
.
reinitialize
()
else
:
else
:
# Hm, lets at least try to take care of the stupid logger:
# Hm, lets at least try to take care of the stupid logger:
if
hasattr
(
zLOG
,
'_set_stupid_dest'
):
zLOG
.
_stupid_dest
=
None
zLOG
.
_set_stupid_dest
(
None
)
else
:
zLOG
.
_stupid_dest
=
None
def
rotate_logs_handler
(
signum
,
frame
):
def
rotate_logs_handler
(
signum
,
frame
):
rotate_logs
()
rotate_logs
()
...
...
src/ZEO/tests/Cache.py
View file @
3b599ac4
...
@@ -11,7 +11,6 @@
...
@@ -11,7 +11,6 @@
# FOR A PARTICULAR PURPOSE
# FOR A PARTICULAR PURPOSE
#
#
##############################################################################
##############################################################################
"""Tests of the ZEO cache"""
"""Tests of the ZEO cache"""
from
ZODB.Transaction
import
Transaction
from
ZODB.Transaction
import
Transaction
...
...
src/ZEO/tests/__init__.py
View file @
3b599ac4
##############################################################################
#
# Copyright (c) 2001, 2002 Zope Corporation and Contributors.
# All Rights Reserved.
#
# This software is subject to the provisions of the Zope Public License,
# Version 2.0 (ZPL). A copy of the ZPL should accompany this distribution.
# THIS SOFTWARE IS PROVIDED "AS IS" AND ANY AND ALL EXPRESS OR IMPLIED
# WARRANTIES ARE DISCLAIMED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
# WARRANTIES OF TITLE, MERCHANTABILITY, AGAINST INFRINGEMENT, AND FITNESS
# FOR A PARTICULAR PURPOSE
#
##############################################################################
src/ZEO/tests/forker.py
View file @
3b599ac4
...
@@ -11,7 +11,6 @@
...
@@ -11,7 +11,6 @@
# FOR A PARTICULAR PURPOSE
# FOR A PARTICULAR PURPOSE
#
#
##############################################################################
##############################################################################
"""Library for forking storage server and connecting client storage"""
"""Library for forking storage server and connecting client storage"""
import
asyncore
import
asyncore
...
@@ -62,7 +61,7 @@ if os.name == "nt":
...
@@ -62,7 +61,7 @@ if os.name == "nt":
args
=
(
sys
.
executable
,
script
,
str
(
port
),
storage_name
)
+
args
args
=
(
sys
.
executable
,
script
,
str
(
port
),
storage_name
)
+
args
d
=
os
.
environ
.
copy
()
d
=
os
.
environ
.
copy
()
d
[
'PYTHONPATH'
]
=
os
.
pathsep
.
join
(
sys
.
path
)
d
[
'PYTHONPATH'
]
=
os
.
pathsep
.
join
(
sys
.
path
)
pid
=
os
.
spawnve
(
os
.
P_NOWAIT
,
sys
.
executable
,
args
,
d
)
pid
=
os
.
spawnve
(
os
.
P_NOWAIT
,
sys
.
executable
,
args
,
os
.
environ
)
return
(
'localhost'
,
port
),
(
'localhost'
,
port
+
1
),
pid
return
(
'localhost'
,
port
),
(
'localhost'
,
port
+
1
),
pid
else
:
else
:
...
@@ -98,7 +97,6 @@ else:
...
@@ -98,7 +97,6 @@ else:
rd
,
wr
=
os
.
pipe
()
rd
,
wr
=
os
.
pipe
()
pid
=
os
.
fork
()
pid
=
os
.
fork
()
if
pid
==
0
:
if
pid
==
0
:
try
:
if
PROFILE
:
if
PROFILE
:
p
=
profile
.
Profile
()
p
=
profile
.
Profile
()
p
.
runctx
(
"run_server(storage, addr, rd, wr)"
,
globals
(),
p
.
runctx
(
"run_server(storage, addr, rd, wr)"
,
globals
(),
...
@@ -106,7 +104,6 @@ else:
...
@@ -106,7 +104,6 @@ else:
p
.
dump_stats
(
"stats.s.%d"
%
os
.
getpid
())
p
.
dump_stats
(
"stats.s.%d"
%
os
.
getpid
())
else
:
else
:
run_server
(
storage
,
addr
,
rd
,
wr
)
run_server
(
storage
,
addr
,
rd
,
wr
)
finally
:
os
.
_exit
(
0
)
os
.
_exit
(
0
)
else
:
else
:
os
.
close
(
rd
)
os
.
close
(
rd
)
...
...
src/ZEO/tests/multi.py
View file @
3b599ac4
...
@@ -11,7 +11,6 @@
...
@@ -11,7 +11,6 @@
# FOR A PARTICULAR PURPOSE
# FOR A PARTICULAR PURPOSE
#
#
##############################################################################
##############################################################################
"""A multi-client test of the ZEO storage server"""
"""A multi-client test of the ZEO storage server"""
import
ZODB
,
ZODB
.
DB
,
ZODB
.
FileStorage
,
ZODB
.
POSException
import
ZODB
,
ZODB
.
DB
,
ZODB
.
FileStorage
,
ZODB
.
POSException
...
@@ -70,7 +69,6 @@ def start_server(addr):
...
@@ -70,7 +69,6 @@ def start_server(addr):
def
start_client
(
addr
,
client_func
=
None
):
def
start_client
(
addr
,
client_func
=
None
):
pid
=
os
.
fork
()
pid
=
os
.
fork
()
if
pid
==
0
:
if
pid
==
0
:
try
:
import
ZEO.ClientStorage
import
ZEO.ClientStorage
if
VERBOSE
:
if
VERBOSE
:
print
"Client process started:"
,
os
.
getpid
()
print
"Client process started:"
,
os
.
getpid
()
...
@@ -80,7 +78,6 @@ def start_client(addr, client_func=None):
...
@@ -80,7 +78,6 @@ def start_client(addr, client_func=None):
else
:
else
:
client_func
(
cli
)
client_func
(
cli
)
cli
.
close
()
cli
.
close
()
finally
:
os
.
_exit
(
0
)
os
.
_exit
(
0
)
else
:
else
:
return
pid
return
pid
...
...
src/ZEO/tests/stress.py
View file @
3b599ac4
...
@@ -11,7 +11,6 @@
...
@@ -11,7 +11,6 @@
# FOR A PARTICULAR PURPOSE
# FOR A PARTICULAR PURPOSE
#
#
##############################################################################
##############################################################################
"""A ZEO client-server stress test to look for leaks.
"""A ZEO client-server stress test to look for leaks.
The stress test should run in an infinite loop and should involve
The stress test should run in an infinite loop and should involve
...
@@ -105,7 +104,6 @@ def start_child(zaddr):
...
@@ -105,7 +104,6 @@ def start_child(zaddr):
if
pid
!=
0
:
if
pid
!=
0
:
return
pid
return
pid
try
:
storage
=
ClientStorage
(
zaddr
,
debug
=
1
,
min_disconnect_poll
=
0.5
)
storage
=
ClientStorage
(
zaddr
,
debug
=
1
,
min_disconnect_poll
=
0.5
)
db
=
ZODB
.
DB
(
storage
,
pool_size
=
NUM_CONNECTIONS
)
db
=
ZODB
.
DB
(
storage
,
pool_size
=
NUM_CONNECTIONS
)
setup
(
db
.
open
())
setup
(
db
.
open
())
...
@@ -131,7 +129,6 @@ def start_child(zaddr):
...
@@ -131,7 +129,6 @@ def start_child(zaddr):
c
.
__count
+=
1
c
.
__count
+=
1
work
(
c
)
work
(
c
)
finally
:
os
.
_exit
(
0
)
os
.
_exit
(
0
)
if
__name__
==
"__main__"
:
if
__name__
==
"__main__"
:
...
...
src/ZEO/tests/testZEO.py
View file @
3b599ac4
...
@@ -11,7 +11,6 @@
...
@@ -11,7 +11,6 @@
# FOR A PARTICULAR PURPOSE
# FOR A PARTICULAR PURPOSE
#
#
##############################################################################
##############################################################################
"""Test suite for ZEO based on ZODB.tests"""
"""Test suite for ZEO based on ZODB.tests"""
import
asyncore
import
asyncore
...
@@ -27,6 +26,8 @@ import unittest
...
@@ -27,6 +26,8 @@ import unittest
import
ZEO.ClientStorage
,
ZEO
.
StorageServer
import
ZEO.ClientStorage
,
ZEO
.
StorageServer
import
ThreadedAsync
,
ZEO
.
trigger
import
ThreadedAsync
,
ZEO
.
trigger
from
ZODB.FileStorage
import
FileStorage
from
ZODB.FileStorage
import
FileStorage
from
ZODB.TimeStamp
import
TimeStamp
from
ZODB.Transaction
import
Transaction
import
thread
import
thread
from
ZEO.tests
import
forker
,
Cache
from
ZEO.tests
import
forker
,
Cache
...
@@ -35,7 +36,7 @@ from ZEO.smac import Disconnected
...
@@ -35,7 +36,7 @@ from ZEO.smac import Disconnected
# Sorry Jim...
# Sorry Jim...
from
ZODB.tests
import
StorageTestBase
,
BasicStorage
,
VersionStorage
,
\
from
ZODB.tests
import
StorageTestBase
,
BasicStorage
,
VersionStorage
,
\
TransactionalUndoStorage
,
TransactionalUndoVersionStorage
,
\
TransactionalUndoStorage
,
TransactionalUndoVersionStorage
,
\
PackableStorage
,
Synchronization
,
ConflictResolution
,
RevisionStorage
PackableStorage
,
Synchronization
,
ConflictResolution
from
ZODB.tests.MinPO
import
MinPO
from
ZODB.tests.MinPO
import
MinPO
from
ZODB.tests.StorageTestBase
import
zodb_unpickle
from
ZODB.tests.StorageTestBase
import
zodb_unpickle
...
@@ -56,8 +57,62 @@ class PackWaitWrapper:
...
@@ -56,8 +57,62 @@ class PackWaitWrapper:
self
.
storage
.
pack
(
t
,
f
,
wait
=
1
)
self
.
storage
.
pack
(
t
,
f
,
wait
=
1
)
class
ZEOTestBase
(
StorageTestBase
.
StorageTestBase
):
class
ZEOTestBase
(
StorageTestBase
.
StorageTestBase
):
"""Version of the storage test class that supports ZEO."""
"""Version of the storage test class that supports ZEO.
pass
For ZEO, we don't always get the serialno/exception for a
particular store as the return value from the store. But we
will get no later than the return value from vote.
"""
def
_dostore
(
self
,
oid
=
None
,
revid
=
None
,
data
=
None
,
version
=
None
,
already_pickled
=
0
):
"""Do a complete storage transaction.
The defaults are:
- oid=None, ask the storage for a new oid
- revid=None, use a revid of ZERO
- data=None, pickle up some arbitrary data (the integer 7)
- version=None, use the empty string version
Returns the object's new revision id.
"""
if
oid
is
None
:
oid
=
self
.
_storage
.
new_oid
()
if
revid
is
None
:
revid
=
ZERO
if
data
is
None
:
data
=
MinPO
(
7
)
if
not
already_pickled
:
data
=
StorageTestBase
.
zodb_pickle
(
data
)
if
version
is
None
:
version
=
''
# Begin the transaction
t
=
Transaction
()
self
.
_storage
.
tpc_begin
(
t
)
# Store an object
r1
=
self
.
_storage
.
store
(
oid
,
revid
,
data
,
version
,
t
)
s1
=
self
.
_get_serial
(
r1
)
# Finish the transaction
r2
=
self
.
_storage
.
tpc_vote
(
t
)
s2
=
self
.
_get_serial
(
r2
)
self
.
_storage
.
tpc_finish
(
t
)
# s1, s2 can be None or dict
assert
not
(
s1
and
s2
)
return
s1
and
s1
[
oid
]
or
s2
and
s2
[
oid
]
def
_get_serial
(
self
,
r
):
"""Return oid -> serialno dict from sequence of ZEO replies."""
d
=
{}
if
r
is
None
:
return
None
if
type
(
r
)
==
types
.
StringType
:
raise
RuntimeError
,
"unexpected ZEO response: no oid"
else
:
for
oid
,
serial
in
r
:
if
isinstance
(
serial
,
Exception
):
raise
serial
d
[
oid
]
=
serial
return
d
# Some of the ZEO tests depend on the version of FileStorage available
# Some of the ZEO tests depend on the version of FileStorage available
# for the tests. If we run these tests using Zope 2.3, FileStorage
# for the tests. If we run these tests using Zope 2.3, FileStorage
...
@@ -82,7 +137,6 @@ class GenericTests(ZEOTestBase,
...
@@ -82,7 +137,6 @@ class GenericTests(ZEOTestBase,
Cache
.
TransUndoStorageWithCache
,
Cache
.
TransUndoStorageWithCache
,
BasicStorage
.
BasicStorage
,
BasicStorage
.
BasicStorage
,
VersionStorage
.
VersionStorage
,
VersionStorage
.
VersionStorage
,
RevisionStorage
.
RevisionStorage
,
PackableStorage
.
PackableStorage
,
PackableStorage
.
PackableStorage
,
Synchronization
.
SynchronizedStorage
,
Synchronization
.
SynchronizedStorage
,
):
):
...
@@ -94,12 +148,16 @@ class GenericTests(ZEOTestBase,
...
@@ -94,12 +148,16 @@ class GenericTests(ZEOTestBase,
returns a specific storage, e.g. FileStorage.
returns a specific storage, e.g. FileStorage.
"""
"""
__super_setUp
=
StorageTestBase
.
StorageTestBase
.
setUp
__super_tearDown
=
StorageTestBase
.
StorageTestBase
.
tearDown
def
setUp
(
self
):
def
setUp
(
self
):
"""Start a ZEO server using a Unix domain socket
"""Start a ZEO server using a Unix domain socket
The ZEO server uses the storage object returned by the
The ZEO server uses the storage object returned by the
getStorage() method.
getStorage() method.
"""
"""
self
.
__super_setUp
()
self
.
running
=
1
self
.
running
=
1
client
,
exit
,
pid
=
forker
.
start_zeo
(
self
.
getStorage
())
client
,
exit
,
pid
=
forker
.
start_zeo
(
self
.
getStorage
())
self
.
_pid
=
pid
self
.
_pid
=
pid
...
@@ -114,13 +172,68 @@ class GenericTests(ZEOTestBase,
...
@@ -114,13 +172,68 @@ class GenericTests(ZEOTestBase,
self
.
_server
.
close
()
self
.
_server
.
close
()
os
.
waitpid
(
self
.
_pid
,
0
)
os
.
waitpid
(
self
.
_pid
,
0
)
self
.
delStorage
()
self
.
delStorage
()
self
.
__super_tearDown
()
def
checkTwoArgBegin
(
self
):
# XXX ZEO doesn't support 2-arg begin
pass
def
checkLargeUpdate
(
self
):
def
checkLargeUpdate
(
self
):
obj
=
MinPO
(
"X"
*
(
10
*
128
*
1024
))
obj
=
MinPO
(
"X"
*
(
10
*
128
*
1024
))
self
.
_dostore
(
data
=
obj
)
self
.
_dostore
(
data
=
obj
)
def
checkTwoArgBegin
(
self
):
def
checkCommitLockOnCommit
(
self
):
pass
# ZEO 1 doesn't support two-arg begin
self
.
_checkCommitLock
(
"tpc_finish"
)
def
checkCommitLockOnAbort
(
self
):
self
.
_checkCommitLock
(
"tpc_abort"
)
def
_checkCommitLock
(
self
,
method_name
):
# check the commit lock when a client attemps a transaction,
# but fails/exits before finishing the commit.
# Start on transaction normally.
t
=
Transaction
()
self
.
_storage
.
tpc_begin
(
t
)
# Start a second transaction on a different connection without
# blocking the test thread.
self
.
_storages
=
[]
for
i
in
range
(
3
):
storage2
=
self
.
_duplicate_client
()
t2
=
Transaction
()
tid
=
self
.
_get_timestamp
()
storage2
.
_call
.
sendMessage
(
'tpc_begin_sync'
,
tid
,
t2
.
user
,
t2
.
description
,
t2
.
_extension
)
if
i
==
0
:
storage2
.
close
()
else
:
self
.
_storages
.
append
((
storage2
,
t2
))
oid
=
self
.
_storage
.
new_oid
()
self
.
_storage
.
store
(
oid
,
None
,
''
,
''
,
t
)
self
.
_storage
.
tpc_vote
(
t
)
self
.
_storage
.
tpc_finish
(
t
)
for
store
,
trans
in
self
.
_storages
:
store
.
tpc_abort
(
trans
)
store
.
close
()
# Make sure the server is still responsive
self
.
_dostore
()
def
_duplicate_client
(
self
):
"Open another ClientStorage to the same server."
addr
=
self
.
_storage
.
_connection
new
=
ZEO
.
ClientStorage
.
ClientStorage
(
addr
)
new
.
registerDB
(
DummyDB
(),
None
)
return
new
def
_get_timestamp
(
self
):
t
=
time
.
time
()
t
=
apply
(
TimeStamp
,(
time
.
gmtime
(
t
)[:
5
]
+
(
t
%
60
,)))
return
't'
class
ZEOFileStorageTests
(
GenericTests
):
class
ZEOFileStorageTests
(
GenericTests
):
__super_setUp
=
GenericTests
.
setUp
__super_setUp
=
GenericTests
.
setUp
...
@@ -148,8 +261,11 @@ class WindowsGenericTests(GenericTests):
...
@@ -148,8 +261,11 @@ class WindowsGenericTests(GenericTests):
can't be created in the parent process and passed to the child.
can't be created in the parent process and passed to the child.
All the work has to be done in the server's process.
All the work has to be done in the server's process.
"""
"""
__super_setUp
=
StorageTestBase
.
StorageTestBase
.
setUp
__super_tearDown
=
StorageTestBase
.
StorageTestBase
.
tearDown
def
setUp
(
self
):
def
setUp
(
self
):
self
.
__super_setUp
()
args
=
self
.
getStorageInfo
()
args
=
self
.
getStorageInfo
()
name
=
args
[
0
]
name
=
args
[
0
]
args
=
args
[
1
:]
args
=
args
[
1
:]
...
@@ -169,6 +285,7 @@ class WindowsGenericTests(GenericTests):
...
@@ -169,6 +285,7 @@ class WindowsGenericTests(GenericTests):
## os.waitpid(self.test_pid, 0)
## os.waitpid(self.test_pid, 0)
time
.
sleep
(
0.5
)
time
.
sleep
(
0.5
)
self
.
delStorage
()
self
.
delStorage
()
self
.
__super_tearDown
()
class
WindowsZEOFileStorageTests
(
WindowsGenericTests
):
class
WindowsZEOFileStorageTests
(
WindowsGenericTests
):
...
@@ -192,6 +309,8 @@ class ConnectionTests(ZEOTestBase):
...
@@ -192,6 +309,8 @@ class ConnectionTests(ZEOTestBase):
start and stop a ZEO storage server.
start and stop a ZEO storage server.
"""
"""
__super_tearDown
=
StorageTestBase
.
StorageTestBase
.
tearDown
ports
=
[]
ports
=
[]
for
i
in
range
(
200
):
for
i
in
range
(
200
):
ports
.
append
(
random
.
randrange
(
25000
,
30000
))
ports
.
append
(
random
.
randrange
(
25000
,
30000
))
...
@@ -207,7 +326,6 @@ class ConnectionTests(ZEOTestBase):
...
@@ -207,7 +326,6 @@ class ConnectionTests(ZEOTestBase):
def
tearDown
(
self
):
def
tearDown
(
self
):
"""Try to cause the tests to halt"""
"""Try to cause the tests to halt"""
self
.
_storage
.
close
()
self
.
shutdownServer
()
self
.
shutdownServer
()
# file storage appears to create four files
# file storage appears to create four files
for
ext
in
''
,
'.index'
,
'.lock'
,
'.tmp'
:
for
ext
in
''
,
'.index'
,
'.lock'
,
'.tmp'
:
...
@@ -218,6 +336,7 @@ class ConnectionTests(ZEOTestBase):
...
@@ -218,6 +336,7 @@ class ConnectionTests(ZEOTestBase):
path
=
"c1-test-%d.zec"
%
i
path
=
"c1-test-%d.zec"
%
i
if
os
.
path
.
exists
(
path
):
if
os
.
path
.
exists
(
path
):
os
.
unlink
(
path
)
os
.
unlink
(
path
)
self
.
__super_tearDown
()
def
checkBasicPersistence
(
self
):
def
checkBasicPersistence
(
self
):
"""Verify cached data persists across client storage instances.
"""Verify cached data persists across client storage instances.
...
...
src/ZEO/tests/winserver.py
View file @
3b599ac4
...
@@ -11,7 +11,6 @@
...
@@ -11,7 +11,6 @@
# FOR A PARTICULAR PURPOSE
# FOR A PARTICULAR PURPOSE
#
#
##############################################################################
##############################################################################
"""Helper file used to launch ZEO server for Windows tests"""
"""Helper file used to launch ZEO server for Windows tests"""
import
asyncore
import
asyncore
...
...
src/ZEO/zrpc.py
View file @
3b599ac4
...
@@ -14,7 +14,7 @@
...
@@ -14,7 +14,7 @@
"""Simple rpc mechanisms
"""Simple rpc mechanisms
"""
"""
__version__
=
"$Revision: 1.2
1
$"
[
11
:
-
2
]
__version__
=
"$Revision: 1.2
2
$"
[
11
:
-
2
]
from
cPickle
import
loads
from
cPickle
import
loads
import
cPickle
import
cPickle
...
...
src/ZEO/zrpc/smac.py
View file @
3b599ac4
...
@@ -14,7 +14,7 @@
...
@@ -14,7 +14,7 @@
"""Sized message async connections
"""Sized message async connections
"""
"""
__version__
=
"$Revision: 1.1
4
$"
[
11
:
-
2
]
__version__
=
"$Revision: 1.1
5
$"
[
11
:
-
2
]
import
asyncore
,
string
,
struct
,
zLOG
,
sys
,
Acquisition
import
asyncore
,
string
,
struct
,
zLOG
,
sys
,
Acquisition
import
socket
,
errno
import
socket
,
errno
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment