[Deskaheh-sysadmin] Re: [IMC-Tech] Can SFTP Speed on Deskaheh be increased?

[jb]

On Thu, 17 Feb 2005, john milton wrote:

> Hi:
>
> I am in the process of trying to backup IMC Hamilton's site from Deskaheh.
>
> Finnc made me a nice .tar file, but it is a bit on the large side (About 1.3 
> gigabytes)
>
> I am using SFTP (client is Data Freeway by Lukasoft) over a 5 Meg bit/sec 
> cable modem
>
> I am getting throughput rates of between 3.5 and 7 KBytes per second on the 
> transfer i.e. about 0.5 to 1.5 of a dial up connection rate.
>
> At the current rate my SFTP client tells me I'll need over 3 more days to 
> transfer the file.
>
> It is very rare these days for Deskaheh to go three days at a stretch without 
> crashing, so I am not optomistic about being able to complete the backup.
>
> Does anyone have any suggestions?

first check that parts of that data is not mirrored elsewhere...

if deskaheh is really such a mess in terms of uptimes, one solution could 
be to copy the data on the web part of it and use "wget -c [url]" to fetch
it.  the -c option helps restarting the transfert where it last failed.

if you want encryption of the stuff to do the same thing, use something
like that:

  openssl bf  < yourbigfile > webspace/result-file

and do the wget thing.  (for decrypting, do openssl bf -d < result-file)

there's a nice --limit-rate option in wget that can help you not take all
the bandwidth of deskaheh too.

you could also split the big file into tiny bits and see if that helps the
transfer over sftp or http.

good luck..
jb


> -- 
> Peace: John Milton
>
> Email: john at johhnmilton.ca
> Web: johnmilton.ca
>
> PGP encrypted mail is welcome, my key is here: 
> http://www.hwcn.org/~aa492/security.htm
>
> _______________________________________________
> imc-tech mailing list
> imc-tech at lists.indymedia.org
> http://lists.indymedia.org/mailman/listinfo/imc-tech
>