Hey guys,
I have written a script that gets results from searches on craigslist, and then text messages me if there are any new results from the search. I run the script for two hours, kill it, start it back up again 20 minutes later. I want it to save the results from the first run and not notify me on the 2nd run of the results that were in the first run. I am currently writing results to a file if the result does not already exist in file, and I am just wondering if there is a better way to keep track of the results? If there is a new result, I am text messaged that there is a new result. Look below for code. Any critique is greatly appreciated!! Thank you fellow monks!
NOTE: I have replaced the phone number with x.
#!/usr/bin/perl
use strict;
use warnings;
use WWW::Mechanize;
use HTML::TokeParser;
use MIME::Lite;
while (1) {
my $msg;
my @search = ("broken hdtv","fix hdtv","does not work hdtv");
my $connection = WWW::Mechanize->new();
foreach my $term (@search) {
$connection->get("http://portland.craigslist.org/");
$connection->form_number(1);
$connection->field("query",$term);
$connection->click();
my @link = $connection->find_all_links(url_regex => qr/(ele|zip
+)\/[0-9]+/i);
foreach my $link (@link) {
my $tempLink=$link->url_abs;
chomp $tempLink;
my $check=`grep $tempLink craigslist`;
if ($check eq "") {
open OUTFILE,">>craigslist" or die $!;
print OUTFILE $tempLink . "\n";
$msg = MIME::Lite->new(
To =>'xxxxxxxxxx@vtext.com',
Subject =>'CL Link',
Type =>'text/plain; charset="iso-8859-1"',
Data =>"There is a new link on craigslist."
);
close OUTFILE;
}
}
}
if ( $msg ) {
$msg->send;
}
sleep(300);
}
Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
Read Where should I post X? if you're not absolutely sure you're posting in the right place.
Please read these before you post! —
Posts may use any of the Perl Monks Approved HTML tags:
- a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
| |
For: |
|
Use: |
| & | | & |
| < | | < |
| > | | > |
| [ | | [ |
| ] | | ] |
Link using PerlMonks shortcuts! What shortcuts can I use for linking?
See Writeup Formatting Tips and other pages linked from there for more info.