wget question (batch one-directory downloading)

Need help with your Linux distro? All questions are good - not all answers are -but we try

Moderator: jkerr82508

User avatar
dedanna1029
Sound-Berserk
Posts: 8784
Joined: 14 Mar 2010, 20:29
Contact:

wget question (batch one-directory downloading)

Postby dedanna1029 » 04 Jul 2011, 16:59

If I use:

Code: Select all

wget -r http://www.someurl.com/pics/

... which is some 120 Gbs, why is it that wget stops at 75 Gbs, and doesn't get all of the pics in that link? Every time, someone has to delete the ones I've already gotten, so I can restart wget, and get the rest of the ones I didn't.

Thanks.
I'd rather be a free person who fears terrorists, than be a "safe" person who fears the government.
No gods, no masters.
"A druid is by nature anarchistic, that is, submits to no one."
http://uk.druidcollege.org/faqs.html

User avatar
viking60
Über-Berserk
Posts: 9351
Joined: 14 Mar 2010, 16:34

Re: wget question (batch one-directory downloading)

Postby viking60 » 04 Jul 2011, 19:52

Hmm that is strange you will have to look for limitations I guess. But I wouldn't know where to start.
Manjaro 64bit on the main box -Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz and nVidia Corporation GT200b [GeForce GTX 275] (rev a1. + Centos on the server - Arch on the laptop.
"There are no stupid questions - Only stupid answers!"

User avatar
dedanna1029
Sound-Berserk
Posts: 8784
Joined: 14 Mar 2010, 20:29
Contact:

Re: wget question (batch one-directory downloading)

Postby dedanna1029 » 05 Jul 2011, 18:39

Yeah, that's the problem... :(
I'd rather be a free person who fears terrorists, than be a "safe" person who fears the government.
No gods, no masters.
"A druid is by nature anarchistic, that is, submits to no one."
http://uk.druidcollege.org/faqs.html


Return to “Help”