instal wget
apt-get install wget
Armandres
apt-get install wgetwget -e robots=off -r -np https://www.w3.org/History/19921103-hypertext/hypertext/The simplest way to use wget is to provide it with the location of a file to download over HTTP. For example, to download the file http://website.com/files/file.zip, this command:
$ wget http://website.com/files/file.zip
...would download the file into the working directory.
There are many options that allow you to use wget in different ways, for different purposes.wget --quiet http://www.mysite.com/sitemap.xml --output-document - | egrep -o "https?://[^<]+" | wget -i -#!/bin/bash
for itemx in $(cat all_list)
do
mkdir $itemx
cd $itemx
wget https://files.rcsb.org/download/$temx.pdb
cd ../
done
wget [options] [url]