• Do not register here on develop.twiki.org, login with your twiki.org account.
• Use View topic Item7848 for generic doc work for TWiki-6.1.1. Use View topic Item7851 for doc work on extensions that are not part of a release. More... Close
• Anything you create or change in standard webs (Main, TWiki, Sandbox etc) will be automatically reverted on every SVN update.
Does this site look broken?. Use the LitterTray web for test cases.

Item3624: Add a delay between file uploads to TWiki.org (be nice to server) - and create load mitigation on the serverside

Item Form Data

AppliesTo: Component: Priority: CurrentState: WaitingFor: TargetRelease ReleasedIn
Extension BuildContrib Enhancement Closed TWiki:Main.SvenDowideit n/a  

Edit Form Data

Summary:
Reported By:
Codebase:
Applies To:
Component:
Priority:
Current State:
Waiting For:
Target Release:
Released In:
 

Detail

The build scripts uploads .zip, .tgz, .md5 and _installer one after another in rapid succession, without any delay. This can add load on the twiki.org server. It would be nice if the script sleeps for 30 sec or so between uploads. (BTW, this is the default of the TWiki:Plugins/UploadToTWikiAddOn script.)

-- TWiki:Main/PeterThoeny - 13 Feb 2007

Sven says he knows the answers

CC


<SvenDowideit> ah, ok, well, i recon his point is true
<SvenDowideit> twould be nice for the 'offical-ese' tools to be respectful 
<CDot> well, I blame upload, not the build contrib
<SvenDowideit> oh?
<CDot> fix the disease, not the symptom
<SvenDowideit> can you elaborate on why
<SvenDowideit> yep, i grok the sentiment
<SvenDowideit> but the imple - you want upload to pause a little before it tells the browser ok?
<CDot> because it farts about making a local copy of a file that is already on the server
<SvenDowideit> ah, yep, ok
<SvenDowideit> that does need thought
<CDot> then freezes it in a glacier and waits for it to melt
<CDot> all because of the stupid attachment handlers
<SvenDowideit> though really, the safe way to do upload is
<SvenDowideit> upload to tmp place
<CDot> that AFAICT no working plugin actually *uses*
<SvenDowideit> run virus checker on it
<CDot> CGI already uploads to a tmpdir
<SvenDowideit> then later hand it to the world
<SvenDowideit> ok, I'll C&P this into that bug, and change it a little
<CDot> great idea; /me awaits VirusCheckingBeforeSaveHandlingTeaAndToastMakingPlugin
<SvenDowideit> needs a new plugin handler

I agree, root cause analysis tells us that we won't succeed by just asking clients to be nice

so we should look at making the upload cgi more cost effective too.

-- SvenDowideit - 26 Apr 2007

I added a 20s pause.

-- TWiki:Main.CrawfordCurrie - 01 May 2007

ItemTemplate
Summary Add a delay between file uploads to TWiki.org (be nice to server) - and create load mitigation on the serverside
ReportedBy TWiki:Main.PeterThoeny
Codebase ~twiki4
SVN Range TWiki-4.1.1, Fri, 09 Feb 2007, build 12817
AppliesTo Extension
Component BuildContrib
Priority Enhancement
CurrentState Closed
WaitingFor TWiki:Main.SvenDowideit
Checkins TWikirev:13599
TargetRelease n/a
ReleasedIn

Edit | Attach | Watch | Print version | History: r6 < r5 < r4 < r3 < r2 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r6 - 2007-07-03 - TWikiUserMapping_CrawfordCurrie
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback