Author Topic: Using wget to grab tgz's in an index  (Read 3554 times)

0 Members and 1 Guest are viewing this topic.

Offline Newby

  • Moderator
  • Hero Member
  • *****
  • Posts: 10877
  • Thrash!
    • View Profile
Using wget to grab tgz's in an index
« on: January 13, 2006, 06:00:09 pm »
ok, I have had no luck at ALL.

I want to grab the packages in this directory. Too bad I can't get wget to grab 'em.

Help please. I've tried almost everything. I want to grab them all in one swift command. :(
- Newby
http://www.x86labs.org

Quote
[17:32:45] * xar sets mode: -oooooooooo algorithm ban chris cipher newby stdio TehUser tnarongi|away vursed warz
[17:32:54] * xar sets mode: +o newby
[17:32:58] <xar> new rule
[17:33:02] <xar> me and newby rule all

I'd bet that you're currently bloated like a water ballon on a hot summer's day.

That analogy doesn't even make sense.  Why would a water balloon be especially bloated on a hot summer's day? For your sake, I hope there wasn't too much logic testing on your LSAT. 

Offline iago

  • Leader
  • Administrator
  • Hero Member
  • *****
  • Posts: 17914
  • Fnord.
    • View Profile
    • SkullSecurity
Re: Using wget to grab tgz's in an index
« Reply #1 on: January 13, 2006, 08:38:05 pm »
I know it's possible, just set a filename and a directory name match, both of which you can find on wget's manpage.  You also want to use -r for recursive, obviously.  I'd figure it out, since I've done that before, but I don't have time right now. 

Offline Newby

  • Moderator
  • Hero Member
  • *****
  • Posts: 10877
  • Thrash!
    • View Profile
Re: Using wget to grab tgz's in an index
« Reply #2 on: January 13, 2006, 09:09:32 pm »
I played around with practically every argument there was and to no avail.

I'll try again later.
- Newby
http://www.x86labs.org

Quote
[17:32:45] * xar sets mode: -oooooooooo algorithm ban chris cipher newby stdio TehUser tnarongi|away vursed warz
[17:32:54] * xar sets mode: +o newby
[17:32:58] <xar> new rule
[17:33:02] <xar> me and newby rule all

I'd bet that you're currently bloated like a water ballon on a hot summer's day.

That analogy doesn't even make sense.  Why would a water balloon be especially bloated on a hot summer's day? For your sake, I hope there wasn't too much logic testing on your LSAT. 

Offline Joe

  • B&
  • x86
  • Hero Member
  • *****
  • Posts: 10319
  • In Soviet Russia, text read you!
    • View Profile
    • Github
I'd personally do as Joe suggests

You might be right about that, Joe.


Offline iago

  • Leader
  • Administrator
  • Hero Member
  • *****
  • Posts: 17914
  • Fnord.
    • View Profile
    • SkullSecurity
Re: Using wget to grab tgz's in an index
« Reply #4 on: January 13, 2006, 10:36:36 pm »
wget -r http://mirror.cc.columbia.edu/pub/software/kde/stable/3.5/contrib/Slackware/10.2/

??

No, that'll download the entire site, mirror.cc.columbia.edu. 

I have a little time, I'll see if I can figure it out.

Offline iago

  • Leader
  • Administrator
  • Hero Member
  • *****
  • Posts: 17914
  • Fnord.
    • View Profile
    • SkullSecurity
Re: Using wget to grab tgz's in an index
« Reply #5 on: January 13, 2006, 10:43:07 pm »
You're right, that's a tricky problem.  I'm sure it wouldn't be hard to just save the filenames and script it in Perl or Bash or something. 

But an easy workaround is this command:

$ ncftpget mirror.cc.columbia.edu /tmp /pub/software/kde/stable/3.5/contrib/Slackware/10.2/*.tgz

I know that's cheating, but eh? :)

Offline Newby

  • Moderator
  • Hero Member
  • *****
  • Posts: 10877
  • Thrash!
    • View Profile
Re: Using wget to grab tgz's in an index
« Reply #6 on: January 13, 2006, 10:53:26 pm »
Awesome. iago for the win.
- Newby
http://www.x86labs.org

Quote
[17:32:45] * xar sets mode: -oooooooooo algorithm ban chris cipher newby stdio TehUser tnarongi|away vursed warz
[17:32:54] * xar sets mode: +o newby
[17:32:58] <xar> new rule
[17:33:02] <xar> me and newby rule all

I'd bet that you're currently bloated like a water ballon on a hot summer's day.

That analogy doesn't even make sense.  Why would a water balloon be especially bloated on a hot summer's day? For your sake, I hope there wasn't too much logic testing on your LSAT.