Information
currently gathered by jcwren at the Perlmonks site about users,
experience, location, etc. is fun and interesting.
At some point, I'd like to gather information about Perlmonk network
statistics, where I mean network in the graph-theoretic sense. It
seems plausible to me, for instance, that for reasonable notions of
connectivity of node, Perlmonks forms a
small-world network . It would be fun to compute vertex degree
distributions, average distance, etc., and compare against other
online communities.
To do this, however, would require traversing all the nodes of the
Perlmonks site and recording threads and perhaps scores as edge
attributes.
Doing so in a simple-minded manner would
probably get me banned, and rightly so, as I would be torturing an
already overburdened server.
I ask for your advice on the gentlest manner in which to probe
Perlmonks. Some possibilities I have thought of are
- A slow spider that accesses the site every x number of minutes
- Access an off-site mirror of Perlmonks - is there one?
- Access the site only during off hours (as does jcwren)
- Download a snapshot archive of the perlmonks site - is there one?
It doesn't have to be current.
Or is such an idea simply ill-advised and should be dropped?
-Mark
Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
Read Where should I post X? if you're not absolutely sure you're posting in the right place.
Please read these before you post! —
Posts may use any of the Perl Monks Approved HTML tags:
- a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
| |
For: |
|
Use: |
| & | | & |
| < | | < |
| > | | > |
| [ | | [ |
| ] | | ] |
Link using PerlMonks shortcuts! What shortcuts can I use for linking?
See Writeup Formatting Tips and other pages linked from there for more info.