relstorage

How to pack blobstorage with Plone and RelStorage

情到浓时终转凉″ 提交于 2021-02-10 05:31:19
问题 I have run zodbpack on my local build and reduced my data.fs and blobstorage significantly (like to <50%). When i run zodbpack on the test server the postgres 'zodb' database packs and comes down in size, but the blobstorage doesnt budge in size. I've tried running it with every combo of blob-dir /mnt/drbd/blobstorage I can think of, but it doesnt budge. Can it be packed? RelStorage = 1.5.1 I'm considering upgarding RelStorage to 1.6.0, not sure if that will help. Update: Now running

“Unhandled exception in thread started by Error in sys.excepthook” during relstorage zodb pack

和自甴很熟 提交于 2020-01-02 18:38:48
问题 We have a reasonably large Plone instance running on its own mount point. The ZMI interface lists the size of the database as 7101.4M. We run a weekly pack of the database using the Relstorage zodbpack.py script, removing objects older than 7 days. The last two weeks the cron job that runs the pack has output the following: Sun Jun 26 07:00:38 BST 2011 packing cms mount /home/zope/home/parts/zope2/lib/python/zope/configuration/xmlconfig.py:323: DeprecationWarning: zope.app.annotation has

How to improve performance of a script operating on large amount of data?

情到浓时终转凉″ 提交于 2019-12-10 11:39:00
问题 My machine learning script produces a lot of data (millions of BTree s contained in one root BTree ) and store it in ZODB's FileStorage , mainly because all of it wouldn't fit in RAM. Script also frequently modifies previously added data. When I increased the complexity of the problem, and thus more data needs to be stored, I noticed performance issues - script is now computing data on average from two to even ten times slower (the only thing that changed is amount of data to be stored and

“Unhandled exception in thread started by Error in sys.excepthook” during relstorage zodb pack

白昼怎懂夜的黑 提交于 2019-12-06 05:16:42
We have a reasonably large Plone instance running on its own mount point. The ZMI interface lists the size of the database as 7101.4M. We run a weekly pack of the database using the Relstorage zodbpack.py script, removing objects older than 7 days. The last two weeks the cron job that runs the pack has output the following: Sun Jun 26 07:00:38 BST 2011 packing cms mount /home/zope/home/parts/zope2/lib/python/zope/configuration/xmlconfig.py:323: DeprecationWarning: zope.app.annotation has moved to zope.annotation. Import of zope.app.annotation will become unsupported in Zope 3.5 __import__