×

SparkFun Electronics will be closed in observance of memorial day on Monday, May 29th. We will resume normal business hours on Tuesday, May 30th. Any orders placed after 2pm Mountain Time on Friday, May 26th will process and ship out on Tuesday, May 30th.

Member #160628

Member Since: November 5, 2010

Country: United States

  • SPRAKFUN.Com ?!

  • opps I almost forgot…<br />
    “with great power comes great responsibility” ~ Ben Parker aka “Uncle Ben”

  • On second though<br />
    wget:<br />
    <br />
    btw the man pages uses the words robots hehe…<br />
    <br />
    GNU Wget is a free utility for non-interactive download of files from the Web. It supports HTTP, HTTPS, and FTP protocols, as well as retrieval through HTTP proxies.<br />
    <br />
    Wget is non-interactive, meaning that it can work in the background, while the user is not logged on. This allows you to start a retrieval and disconnect from the system,<br />
    letting Wget finish the work. By contrast, most of the Web browsers require constant user’s presence, which can be a great hindrance when transferring a lot of data.<br />
    <br />
    Wget can follow links in HTML, XHTML, and CSS pages, to create local versions of remote web sites, fully recreating the directory structure of the original site. This is<br />
    sometimes referred to as “recursive downloading.” While doing that, Wget respects the Robot Exclusion Standard (/robots.txt). Wget can be instructed to convert the links in<br />
    downloaded files to point at the local files, for offline viewing.<br />
    <br />
    Wget has been designed for robustness over slow or unstable network connections; if a download fails due to a network problem, it will keep retrying until the whole file has<br />
    been retrieved. If the server supports regetting, it will instruct the server to continue the download from where it left off.<br />
    <br />
    have fun<br />
    <br />
    macports:<br />
    <br />
    $port install wget

  • grab a copy of backtrack :<br />
    http://www.backtrack-linux.org/<br />
    and go to town fellas… ;)

No public wish lists :(