Author Topic: WebGrabber can mirror, copy, synchronize, or download a web site.  (Read 2012 times)

0 Members and 1 Guest are viewing this topic.

Software Santa

  • Administrator
  • *****
  • Posts: 4281
  • OS:
  • Mac OS X 10.6 Mac OS X 10.6
  • Browser:
  • Firefox 3.6.13 Firefox 3.6.13
WebGrabber is a utility that you can use to mirror, copy, synchronize, download, scrub or "steal" a web site.

Quote
What is WebGrabber?

WebGrabber is a utility that you can use to mirror, copy, synchronize, download, scrub or "steal" a web site.

WebGrabber is a simple wrapper around the gpl'd project pavuk (see http://www.idata.sk/~ondrej/pavuk/), a web grabber/spider (mailto:ondrej@idata.sk).

This UI is very "unfinished" and not all pavuk command line options are supported, but I wrapped the most useful and most common options first - if people want more - I can do more. ]

What can you use WebGrabber for?

    * You can use it to download entire web sites and even spider off of there.
    * You can download an entire directory of images without being able to "see it" (i.e. no ftp access).
    * You can use it for ftp downloads, it'll even split downloads across sessions and resume downloads.
    * All sorts of neat stuff.

Download

Mac OS X

You can Download the WebGrabber for OS X application and source - WebGrabber.0.7.tar.gz

ToDo

    * Integrate with OmniWeb a little better than just plain old services support
    * Add more options
    * Add proxy support (included in pavuk, just not wrapped)
    * Add a simple line for entering of "other" pavuk options (expert user stuff)

License

I release WebGrabber under the GPL, as is pavuk. I have slightly altered the pavuk source (added on fflush(stdout) in the tools.c method xprintf) to make it work better under X Server.

http://www.epicware.com/webgrabber.html