Mirrors slow to update, was: Re: [Imc-uk-features] RE: Hackney occupation photos

[Chris]

Hi

On Wed 30-Nov-2005 at 02:38:16PM +0000, Andrew wrote:
> 
> Hello, not sure what happened but the photos on the link
> are still unblurred.
> http://www.indymedia.org.uk/en/regions/london/2005/11/328666.html 

Do you mean the photos on flickr linked to from this post?

  http://www.flickr.com/photos/salimfadhley/sets/1467925/

If so I can dig up Salim Fadhley's email address...

There is an issue, that might last a week or so, whereby
old content isn't updating to the mirrors very fast -- all
articles with comments have been regenerated on the
publishing server but so far only the comment fragments up
to 2000/10/447.html have been rsynced onto the rsync
server (all the abstract's have been synced, content
fragments will go after the comment fragments, rsync works
alphabetically...). 

This seems to be because both the publishing server and
the rsync server are overloaded (adverage load adverage on
the publishing server today is 4.54 [1] and 6.7 [2] on the
publishing server, both machines have 1 processor so
anything over 1 isn't great...).

When we get around to spending the server fund on new
servers one idea is to get a dedicated rsync server and
also to set it up so that updates can be done using
subversion, and this should address this bottle neck... 

Chris


[1] http://volunteer.indymedia.org/munin/indymedia.org/traven.indymedia.org-load.html

[2] http://ahimsa-munin.indymedia.org/indymedia.org/ahimsa-rsync1.indymedia.org-load.html

-- 
Aktivix -- Free Software for a Free World