Using wget to recursively fetch a directory with arbitrary files in it

* remove robots.txt

* remove index.html

* check recursively (folders)

* Stop check parent folder

Command: 

wget -e robots=off --reject="index.html*" -r --no-parent http://ftp.alphamediazone.com/E-Books/