[TriLUG] Mirror remote website

[Douglas Ward]

Wget returns an error that says something to the effect of "You cannot get a
directory listing from the server." I suppose that means the server I am
trying to mirror is set up to prevent mirroring?

On 11/16/05, Timothy A. Chagnon <tachagnon at gmail.com> wrote:
>
> You can use curl or wget with the following options for http passwords
>
> curl -u/--user <user:password>
> wget --http-user=user --http-password=password
>
> Both should have options to only get files that have changed
> (date/size). Curl supports files >2GB. Wget is a little easier to do
> globbing with, i.e. https://site.foo/*.bar
>
> Tim
>
> On 11/16/05, Douglas Ward <binaryflow at gmail.com> wrote:
> > I would like to mirror a website secured by https to a local directory
> on my
> > server. Does anyone know of a good way to do this? I have been using
> rsync
> > rather heavily between servers internally but am not having any luck
> with it
> > in this scenario. I also tried pavuk but to be honest I cannot seem to
> make
> > sense of the man file. Here is what I need:
> >
> > Mirror remote https website (password protected) --> Local mirror of
> website
> >
> > Are there any relatively easy ways to do this?
> > --
> > TriLUG mailing list : http://www.trilug.org/mailman/listinfo/trilug
> > TriLUG Organizational FAQ : http://trilug.org/faq/
> > TriLUG Member Services FAQ : http://members.trilug.org/services_faq/
> >
> --
> TriLUG mailing list : http://www.trilug.org/mailman/listinfo/trilug
> TriLUG Organizational FAQ : http://trilug.org/faq/
> TriLUG Member Services FAQ : http://members.trilug.org/services_faq/
>