wget
http://users.ugent.be/~bpuype/wget/
WGET for Windows (win32) - current version: 1.11.4
updated February 18 2010
Read below to download and for some help with wget.
Downloads!
Latest version is 1.11.4, compiled with MS Visual C++ and linked with OpenSSL 0.9.8k. Page will be updated with new releases of wget. Wget tends to see a couple of incremental bugfix releases (i.e. 1.11.x). I am currently using wget 1.11.x on a daily basis.
>> wget.exe (401408 bytes) << : win32 binary with OpenSSL support.
MD5: bd126a7b59d5d1f97ba89a3e71425731
SHA1: 457b1cd985ed07baffd8c66ff40e9c1b6da93753
Where is 1.12?
Latest official version of wget is currently wget 1.12, however this version does not currently compile for Windows. I am looking into this, but a Windows version of wget 1.12 may still take some time. The suggested mingw32 compile path is not a viable option to me right now, mainly because of the lack of IPv6 and 64-bit support.
Previous versions
wget 1.10.2 (Dec 2 2005)
wget-1.10.2.exe (332800 bytes): win32 binary compiled with MS Visual C++ and with OpenSSL 0.9.7i support.
wget 1.9.1 (Jun 03 2004)
wget-1.9.1.exe (308736 bytes): win32 binary compiled with MS Visual C++ 6.0 and with OpenSSL 0.9.7c support.
Usage
wget is a command line program. You start it from the command prompt, either command.com in Windows 9x/Me or cmd.exe in Windows 2000/XP. The command prompt can be found in the Start Menu (Accessories).
wget.exe must be placed in your path (e.g. c:\windows) if you want to be able to run it from any directory.
To retrieve a file: wget http://users.ugent.be/~bpuype/wget/wget.exe
wget in action...
Basic options
First off, the official manual has all command line options and parameters.
Display all help: wget --help
Completely mirror a site: wget -mr http://...-m: mirror-r: recursive
Mirror without following links to other servers, parent directories: wget -mrnp http://...-np: no-parent
Retrieve a html file and convert relative links to absolute ones: wget -k http://users.ugent.be/~bpuype/wget-k: 'k'onvert links
Resume partially downloaded files (if supported by the server): wget -c http://...-c: continue
Read url's from a file and retrieve them: wget -i file_with_urls.txt-i: input-file
Ask for url's (read from stdin): wget -i -. Enter url's on the command line, press enter after each url, and terminate with ^Z (press CTRL-Z) on an empty line.
FTP
--glob=off
Don't treat (, *, ? etc. as globbing characters. Use when transfering files with names that contain these characters.
--passive-ftp
Use passive mode for data connection (try this if you're behind a firewall, NAT box...)
Proxy
To make wget use a proxy, you must set up an environment variable before using wget. Type this at the command prompt:
set http_proxy=http://proxy.myprovider.net:8080
...where you use the correct proxy hostname and port for your ISP or network. You can use ftp_proxy to proxy ftp requests.
--proxy=on --proxy=off
Turn proxy usage on/off once variable is set; default is on when variable is present.
Environment variables can be set permanently for the entire system, or on a per-user basis. Procedure for Windows XP (similar for NT, 2000, Vista, 7). For Windows 95, 98, ME, add them to autoexec.bat (use msconfig to do this easily).
Passwords
To retrieve with passwords (http or ftp), you can use the following url syntax:
wget http://username:password@www.example.net/somedir/somefilewget ftp://username:password@ftp.example.net/somedir/somefile
Additionally, you can also use --http-user, --http-password as well as --ftp-user, --ftp-password:
wget ftp://ftp.example.net/somefile --ftp-user=username --ftp-password=password
If username or password contain non-alphanumeric characters, you need to escape them when passing them in urls (rfc1738 %HH) syntax. For example, with a username of user@domainand password of pass, your url becomes http://user%40domain:[email protected]/somefile. When using escaped urls in batch files, remember that % itself is a special character, and needs to be escaped itself (by using %% instead of %).
SSL certificates
Current versions of OpenSSL do not come with root certificates. This means when trying to download over SSL, wget will give you errors such as
Unable to locally verify the issuer's authority. ERROR: certificate common name `dnsname' doesn't match requested host name `dnsname'.
Either you can use the suggested --no-check-certificate to skip authentication - only use this if you only need encryption functionality, and not authentication. The alternative is to get a set of root certificates and pass it to wget with --ca-certificate file.crt. The problem is then to get a correct root certificate bundle first. The following link has a perl script which will download root certificates from Mozilla and convert them to a wget usable certificate bundle (you'll need Perl, typically ActivePerl).
http://www.floodgap.com/software/ttytter/mk-ca-bundle.txt
Do not trust other people to give you a set of root certificates. This means you should not trust this site (but it no longer offers certificates anyway). Audit any sources you download root certificates from, audit the tools you use to process certificates (including the mk-ca-bundle.pl script linked above).
The official source for root certificates is your Windows install media and Windows Update (remember to update the root certificates regularly), though this set is not used by wget and many other Windows tools.
Furthermore, the Windows makefiles for wget refer to the certificate bundles available at http://curl.haxx.se/docs/caextract.html (which are extracted from Mozilla as well).
Default options (.ini file)
You can put either a wget.ini file in the same directory as wget.exe, or use an environment variable called wgetrc to point to the file if it is in another location (set wgetrc=\path\to\wget.ini). Syntax for wget.ini (or .wgetrc) can be found in the official documentation.
daily averages (estimated): 960 visits; 747 downloads; visitors coming from Google: 55%
visitors: 1563190 (Feb 2003 - Jan 2010)
[back]
Bart Puype