in reply to Re: Re: Re: Re: Faster Search Engine
in thread Faster Search Engine

Yes this is a program that you can currently run on your home computer (you'll need perl see New Monks to get it]. Ultimately any search program will need to be run on the server. It is not configured as a CGI at the moment but could easily be. What sort of results do you want the search to return? Domain name with links to that domain or something else? If you can not get scripts and modules installed on the server let me know if they have the modules 'CGI.pm' and 'HTML::Template' installed. Ask the systems administrator.

cheers

tachyon

s&&rsenoyhcatreve&&&s&n.+t&"$'$`$\"$\&"&ee&&y&srve&&d&&print

  • Comment on Re: Re: Re: Re: Re: Faster Search Engine

Replies are listed 'Best First'.
Re: Re: Re: Re: Re: Re: Faster Search Engine
by drewboy (Sexton) on Jul 23, 2001 at 08:52 UTC
    i went ahead right after i read your prior, prior message and downloaded activeperl. i dunno if i did the right thing. anyway i installed it along with other required files for windows 98 but until there i'm stuck. i dunno how to run a perl script using active perl. i tried to but all i got was an odd ms-dos window that pops up for .001 of a second and disappears in a blink of an eye. i did all the file associations necessary but maybe not(?).

    what i thought about your script was to somehow speed up my current search.cgi file. i already paid a bunch of money for it so i would like to stick to it as much as possible. the mysql version (aptly called links mysql 2.0)is incredibly out of my league at the moment (costs $400!). i'm just trying to find a way to avoid having to worry about my search engine's performance in the future as my database or 'flat file' builds up. i would also want it to have an edge over other search engines who use this software, wherein it is faster and more efficient in bringing up search results. from what i've noticed with other sites is that they can be extremely slow.

    as i've mentioned before i read at the gossamer threads (the company that made links 2.0) forum about using the grep function or perl core dump or whatnot to speed up the search. i believe that you also used grep in the script that you made for me (appreciate it very much). i wonder if i could use this same idea for my current search.cgi file.

    thanks tachyon!!!!

    p.s. -- can you give me a link that gives a good explanation of grep?

    drewboy
    c",)
[reply]

      Congrats on getting Perl - definitely the first step to becoming a perl hacker. To run a perl program under Win32 and active perl do this. Save a perl script to say C:\test.pl. This script will do (just use notepad type this text in and use save as c:\test.pl) 

      print "Hello drewboy!\n";

      [download]

      Get a dos window. Click on the MS-DOS Prompt icon under Start|Program Files. You will have the prompt c:\windows> indicating you are in the c:\windows dir. Type cd .. This command stands for Call Directory and the .. means one directory up in the tree. You could also use cd c:\ which means call the dir c:\ Anyway you will then have the c:\> prompt. Type perl test.pl and your first perl prog will run. You need to hit enter at the end of each command if you have been totally born in the age of point and click. If it does not and gives an error see CGI Help Guide - the first bit on running scripts from the command line. In short the PATH var needs to be set so that the shell (DOS) can find the Perl exe to run your script with.

      Sorry I will help you with perl problems but will not rewrite slow perl scripts (for free anyway :-). If you paid good money you deserve good service.

      As your flat file gets bigger you will need a RDBMS (Rellational Database Management System) like MySQL, Oracle... if you want speed. Period. Certainly you can encode a lot of the functionality in Perl using flat files but it will never be as fast as RDBMS using custom C/C++ compiled code and proprietary alogirithms to generate their speed. Databases exist to address this speed issue amongst others.

      To find out about grep type grep into the search text field on the top left of Perl Monks.

      I will not answer any more questions on this thread as we are now RE:RE:RE:RE:RE:RE:RE which no one except us reads so no one except you benefits. Post a new thread with spcific issues as they occur. I'll probably answer if I have a moment - if not others will.

      cheers

      tachyon

      s&&rsenoyhcatreve&&&s&n.+t&"$'$`$\"$\&"&ee&&y&srve&&d&&print

[reply]
[d/l]
[reply]

In Section Seekers of Perl Wisdom