in reply to Re^3: Is there a simple way to archive/download all of PerlMonks?
in thread Is there a simple way to archive/download all of PerlMonks?

I didn't check all of the domains, no. I think the only valid archive would be an up to date database extract of node content (and some of the other metadata), rather partial snapshots of page impressions from a moment in time.

Update: I seem to recall different domains having different robots.txt rules to impact indexing.

  • Comment on Re^4: Is there a simple way to archive/download all of PerlMonks?

Replies are listed 'Best First'.
Re^5: Is there a simple way to archive/download all of PerlMonks?
by LanX (Saint) on Apr 29, 2024 at 13:15 UTC
    Otherwise I'd poll the XML per node.

    If edits are/were reflected in the timestamps of the http headers, this could also be quite efficient in fetching updates.

    Cheers Rolf
    (addicted to the Perl Programming Language :)
    see Wikisyntax for the Monastery

[reply]

In Section Perl Monks Discussion