in reply to using the web scraping proxy

I googled for wsp.pl and found a readme that doesn't mention a "-v" flag. Have you tried it without the "-v"?

Next, you should only use the "-p" only if you normally need another proxy to get to the websites you want to visit.
One way to simplify your problem might be to ignore the "-p proxy" bit for now and just try to goto internal websites that don't require a proxy. That should make it easier to learn to use wsp.pl.

Just out of curiosity, does this wsp.pl belong to a package or perl module or something?

This looks real bad: 

wsp.pl -v > filetosaveto -p proxy proxyport

[download]
wsp.pl does need redirection to do what you want, but it should be more like this: 
wsp.pl -v -p xyx 8080 > filetosaveto

[download]

Update: Added redirection hint.

andyford
or non-Perl: Andy Ford

Replies are listed 'Best First'.
Re^2: using the web scraping proxy
by coder57 (Novice) on Nov 05, 2006 at 22:01 UTC
    I did try it as: wsp.pl -v -p proxy proxyport > filetosaveto and wsp.pl -v -p proxy:proxyport > filetosaveto each time it simply said bad filename (ofcourse I did precede all those comands with perl ...), I used firefox as the proxy
[reply]

      Did wsp.pl work without the ">" redirection?
      Not sure what you mean by "use firefox as the proxy". Can you elaborate?
      Do you mean that you set up firefox to use the computer running wsp.pl as the proxy?
      The "bad filename" problem is probably a file permission issue or something similar. Are you in a directory where you can create files? Try "ls > filetosaveto" to verify that.

      andyford
      or non-Perl: Andy Ford

[reply]
        Did wsp.pl work without the ">" redirection? yes 
        Not sure what you mean by "use firefox as the proxy". Can you elaborat
+e? 
Do you mean that you set up firefox to use the computer running wsp.pl
+ as the proxy?

        [download]
        yes used firefox, and added the proxy with the -p flag The "bad filename" problem is probably a file permission issue or something similar. Are you in a directory where you can create files? Try "ls > filetosaveto" to verify that. still says bad filename
[reply]
[d/l]
[select]

In Section Seekers of Perl Wisdom