• Do not register here on develop.twiki.org, login with your twiki.org account.
• Use View topic Item7848 for generic doc work for TWiki-6.1.1. Use View topic Item7851 for doc work on extensions that are not part of a release. More... Close
• Anything you create or change in standard webs (Main, TWiki, Sandbox etc) will be automatically reverted on every SVN update.
Does this site look broken?. Use the LitterTray web for test cases.

Item6841: Upgrade/restore is impossible for large twiki

Item Form Data

AppliesTo: Component: Priority: CurrentState: WaitingFor: TargetRelease ReleasedIn
Extension BackupRestorePlugin Normal Closed   n/a  

Edit Form Data

Summary:
Reported By:
Codebase:
Applies To:
Component:
Priority:
Current State:
Waiting For:
Target Release:
Released In:
 

Detail

There seems to be a size limit on what this can handle, at least on a 32-bit linux system (centos5.x). It goes through the motions and creates a zip file, but just gives a blank screen when trying to view it in the backuprestore console. unzip -t says:

# unzip -t /tmp/twiki-backup-2012-01-25-00-44.zip
Archive: /tmp/twiki-backup-2012-01-25-00-44.zip
End-of-central-directory signature not found. Either this file is not
a zipfile, or it constitutes one disk of a multi-part archive. In the
latter case the central directory and zipfile comment will be found on
the last disk(s) of this archive.
unzip: cannot find zipfile directory in one of /tmp/twiki-backup-2012-01-25-00-44.zip or
/tmp/twiki-backup-2012-01-25-00-44.zip.zip, and cannot find /tmp/twiki-backup-2012-01-25-00-44.zip.ZIP, period.

Could this use gnu tar as the backup engine instead? Or an alternative plan that correctly manages the parts (and ONLY the parts) that should be copied in a major-rev upgrade. As a user, I don't really want to know which files must be copied and which ones can't.

-- TWiki:Main/LesMikesell - 2012-01-25

Not sure, I am not aware of a size limit of the zip utility. Is there enough space in /tmp?

-- TWiki:Main.PeterThoeny - 2012-01-25

I did run out on the first attempt, but moved things around with the same problem afterwords (could some other file be corrupted?). However, there may be two different problems. A 'zip -r /path/to/test.zip twiki' competes with no errors but gives a file >4gigs that 'unzip -t' doesn't recognize. Much of the bulk is from attachments, and replacing twiki/pub with an empty directory gives a much smaller zip and good output from unzip -t. However, I'm still getting a blank page from the 'Details/Restore' button, both on the 4.3 system creating it and the 5.x where I want to restore. Where should I look for more information?

-- TWiki:Main.LesMikesell - 2012-01-25

I checked, it looks like you hit a limitation of the zip utility, see http://www.info-zip.org/FAQ.html#limits.

Wondering if there is a zip compatible utility that does not max out on 4GB.

-- TWiki:Main.PeterThoeny - 2012-01-25

http://sourceforge.net/projects/infozip/files/unreleased%20Betas/ has relatively recent beta releases of zip and unzip.

-- TWiki:Main.PeterThoeny - 2012-01-25

I am setting status to closed. The issue is listed in the limitation section of the plugin, including workaround.

-- TWiki:Main.PeterThoeny - 2013-11-08

ItemTemplate
Summary Upgrade/restore is impossible for large twiki
ReportedBy TWiki:Main.LesMikesell
Codebase 5.0.0, 4.2.3
SVN Range

AppliesTo Extension
Component BackupRestorePlugin
Priority Normal
CurrentState Closed
WaitingFor

Checkins

TargetRelease n/a
ReleasedIn

Edit | Attach | Watch | Print version | History: r5 < r4 < r3 < r2 < r1 | Backlinks | Raw View |  Raw edit | More topic actions
Topic revision: r5 - 2013-11-08 - PeterThoeny
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback