Friends,
I am trying to write a LWP script that I can use to download the search reults from
Dice's Metor search page. I am not sure if my script has a problem or if Dice is just making it difficult (or impossible) for my script to work. Here's what I have so far.
#!/usr/bin/perl -w
use strict;
...
my $debug_level = 1;
my $ACTIONURL="http://seeker.dice.com/jobsearch/servlet/JobSearch";
getopts( "U:d:h" );
if ( $opt_h ) { &usage(); exit 0; }
if ( $opt_d ) { $debug_level = $opt_d; }
my $browser;
my $rc = do_LWPsetup( \$browser );
if ($rc==0) {
die __FILE__ . "[" . __LINE__ . "] Failure: do_LWPStuff failed\n";
}
do_getSearchResults ( $browser );
sub do_getSearchResults {
my $browser = shift;
my $resp = $browser->post("$ACTIONURL",
[
'op' => '1000',
'METRO_SEARCH' => '1',
'rel_code' => '1102',
'metro_id' => '1',
'secret' => '1',
'FREE_TEXT' => 'Perl',
'SKILLS' => "",
'RADIO' => 'AND',
'RADIO' => 'OR',
'RADIO' => 'BOOL',
'AREA_CODES' => '408',
'TAXTERM' => 'ALL',
'SORT_TYPE' => "",
'REQ_TRAVEL' => '1',
'TELECOMMUTE' => "",
'SORTSPEC' => '0',
'DAYSBACK' => '30',
'NUM_PER_PAGE' => '50',
'DETAILED_RESULTS' => '1',
'HOTRESULTS' => ""
# 'Submit' => 'HOTRESULTS'
],
'Content_Type' => 'form-data'
);
if (do_errorcheck($resp,"Search")) { return 0; }
return 1;
}
...
This is all I get ...
$ getdice.pl -d2
Begin HTML:
End HTML
Can anyone give me a clue????
Thanks
| Plankton: 1% Evil, 99% Hot Gas. |
Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
Read Where should I post X? if you're not absolutely sure you're posting in the right place.
Please read these before you post! —
Posts may use any of the Perl Monks Approved HTML tags:
- a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
| |
For: |
|
Use: |
| & | | & |
| < | | < |
| > | | > |
| [ | | [ |
| ] | | ] |
Link using PerlMonks shortcuts! What shortcuts can I use for linking?
See Writeup Formatting Tips and other pages linked from there for more info.