[TriLUG] Mirror remote website

[Timothy A. Chagnon]

You can use curl or wget with the following options for http passwords

curl -u/--user <user:password>
wget --http-user=user --http-password=password

Both should have options to only get files that have changed
(date/size).  Curl supports files >2GB.  Wget is a little easier to do
globbing with, i.e. https://site.foo/*.bar

Tim

On 11/16/05, Douglas Ward <binaryflow at gmail.com> wrote:
> I would like to mirror a website secured by https to a local directory on my
> server. Does anyone know of a good way to do this? I have been using rsync
> rather heavily between servers internally but am not having any luck with it
> in this scenario. I also tried pavuk but to be honest I cannot seem to make
> sense of the man file. Here is what I need:
>
> Mirror remote https website (password protected) --> Local mirror of website
>
> Are there any relatively easy ways to do this?
> --
> TriLUG mailing list        : http://www.trilug.org/mailman/listinfo/trilug
> TriLUG Organizational FAQ  : http://trilug.org/faq/
> TriLUG Member Services FAQ : http://members.trilug.org/services_faq/
>