Re^2: How would you extract *content* from websites?

That sounds reasonable, but how do you programatically determine the starting and ending comments?

Comment on Re^2: How would you extract content from websites?

Replies are listed 'Best First'.
Re^3: How would you extract content from websites? by Popcorn Dave (Abbot) on Jun 18, 2005 at 18:27 UTC
Boy, I wish I knew the answer to that. Like I said, I looked at the page layouts of the web sites I was after and built my config file with the comments to look for - starting and ending. Along the lines of what you're after I suppose you could just parse for comments and build a list of comment tags to look for. You had mentioned doing a diff on the files you wanted to look at, so that may be the way to start. Useless trivia: In the 2004 Las Vegas phone book there are approximately 28 pages of ads for massage, but almost 200 for lawyers.	[reply]

Replies are listed 'Best First'.

Re^3: How would you extract *content* from websites?
by Popcorn Dave (Abbot) on Jun 18, 2005 at 18:27 UTC

Along the lines of what you're after I suppose you could just parse for comments and build a list of comment tags to look for. You had mentioned doing a diff on the files you wanted to look at, so that may be the way to start.

Useless trivia: In the 2004 Las Vegas phone book there are approximately 28 pages of ads for massage, but almost 200 for lawyers.

[reply]