Boston Linux & UNIX was originally founded in 1994 as part of The Boston Computer Society. We meet on the third Wednesday of each month at the Massachusetts Institute of Technology, in Building E51.

BLU Discuss list archive


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Discuss] large log file transfer



Maybe he wants the file to appear smaller for other reasons?  It is ?restricted? to quote the op.

Eric Chadbourne
Nonprofit-CRM.org

> On Jun 23, 2015, at 11:17 AM, Mike Small <smallm at panix.com> wrote:
> 
> John Malloy <jomalloy at gmail.com> writes:
> 
>> I have a log file (325MB)  that I need to transfer from a restricted
>> network, that I cannot plug a USB into.
>> 
>> Is there an easy way to "split up" the log file into smaller chunks and Zip
>> it to get it over the net?
> 
> So Jerry and Jack have pointed you to split, but why do you want to
> split it into chunks?
> 
> I must admit I've not dealt with any networks lately that I couldn't
> reliably download a 300 MB file on, but is it not still possible to
> resume interrupted transfers?  Are you using vanilla ftp, http or scp?
> 
> If you're using scp, I'd be inclined not to zip it but to use ssh's
> compression so when it finally does arrive I wouldn't have to unzip and
> then again find something else to do while that happens. But I guess scp
> doesn't support resume (hmmm, maybe ssh dd and adjust the offset based
> on the file size after the failure? -- perhaps that's more trouble than
> splitting).
> 
> By "restricted network" do you mean that rsync is not an option?
> 
> -- 
> Mike Small
> smallm at panix.com
> _______________________________________________
> Discuss mailing list
> Discuss at blu.org
> http://lists.blu.org/mailman/listinfo/discuss




BLU is a member of BostonUserGroups
BLU is a member of BostonUserGroups
We also thank MIT for the use of their facilities.

Valid HTML 4.01! Valid CSS!



Boston Linux & Unix / webmaster@blu.org