in reply to Re: Need a solution to Expect.pm 's single line regex matching limitation
in thread Need a solution to Expect.pm 's single line regex matching limitation

Dear Monks,

Thanks for the quick responses. :)

Now I understand that I am not clear. Please let me explain the problem in detail.

Also, I am sorry if this explaination goes a bit detail or lengthy.

Pictiorilly:

Installation Script <----> Perl Script(Automation Script) <---- Configuration File (storing question and their answers)

I have an installation script that installs a software on UNIX.

This script while in execution prompts for many (more than 200) questions and the user has to answer them. All the questions are not asked in a linear/serial way such that, say if a question asks for:
"which database to use?"

(supported are Oracle, DB2, MySql), and if the user selects MySql, the questions that follow are different than those that would have been asked for Oracle DB selection.

In Programming's terms, it is like:

if (DB == 'ORACLE') { ask Oracle set of questions } else if (DB == 'MySql') { ask another set of questions related to MySql DB. (These questions are different than those asked by Oracle's select +ion) }

Hence, in short, there are multiple code paths to follow, based upon the selection of database, OS (Linux, Solaris, AIX ...) and so on...

So, if I write the Perl automation script in a way that all the prompts (more than 200) are literally written to expect the prompts, my automation perl script would go beyond 5000 lines and would be cumbersome/hard to modify and maintain.

Also all the questions/prompts are not literal.

For example:
----------------------------------------------------------------------------
If I respond to a question:

What is the Unix username? [root]
as: "deepblue" the following question(s) would have this "deepblue" into its text as:
What is the home directory for deepblue? [/users/deepblue]
------------------------------------------------------------

and if I send the response as "deepfritz"

the question would have "deepfritz" into it's text as:

What is the home directory for deepfritz? [/users/deepfritz]
----------------------------------------------------------------------------

So I cannot expect on literal strings here. This is another limitation that I cannot do a simple:

$object->Expect(<Some Text>);

in my Perl Automation script. Hence, I must do a Regular Expression matching.

So I thought of organising this whole perl automation program such that:

1. All the generic prompts/question are written into a single file like:
PROMPT 1 = DEFAULT_Answer1
PROMPT 2 = DEFAULT_Answer2
PROMPT 3 = DEFAULT_Answer3
PROMPT 4 = DEFAULT_Answer4
PROMPT 5 = DEFAULT_Answer5

By generic prompts I mean: The fixed text in a prompt/question.

2. The Perl automation script would read this file and load it into the memory.

3. Then this perl automation script would scan/extract the question using Expect's RegEx facility from the installer script using $object->Expect() and do a reqular expression matching with the PROMPTs loaded into memory and then send the corresponding DEFAULT_Answer to the installer script (invoked using $object->Spawn())

This would make the Perl script quite small and easy to understand, modify and maintain.

Also, all the data would be clubbed together into one place (in the Prompt's file) and the code in the Perl Automation script.

So, a pseudo code for the script would now look like:
--------------------------------------------------------------

Spawn(Install Script);

Load the PROMPT's file into memory;

while (Install Script does not complete execution)
{
Read the questions from the install script;
Do a regular matching with the PROMPTs stored;
Send the corresponding ANSWER to the Install Script;
}

Instead of many consecutive prompts for each and every question like:

--------------------------------------------------------------
Spawn(Install Script);

Load the PROMPT's file into memory;

expect (Prompt 1);
send (Answer to Prompt 1);

...
...

if (expect (Prompt 100))
send (Answer to Prompt 100);

# And follow a different code path.

if (expect (Prompt 150))
send (Answer to Prompt 150);

# And follow a different code path.

expect (Prompt 200);
send (Answer to Prompt 5);

END;

--------------------------------------------------------------

Also, all the prompts are always in the last line of the multiple line text from the install script.

To summarise:
1. The prompts/questions are not literally/exactly the same always. Questions contain some variable text that is formed at runtime.
2. Expecting on literal strings would make the Perl Automation Script un-necessarily very lengthy, hard to understand, modify and maintain.

Does this make sense to all of the Monks there ?

If there is some other efficient way to handle this, suggestions are a great WELCOME!!!

Please help me in solving this.

Eagerly waiting for your replies... :)

Regards,
~DeepBlue

Replies are listed 'Best First'.
Re^3: Need a solution to Expect.pm 's single line regex matching limitation
by shmem (Chancellor) on Nov 17, 2007 at 23:49 UTC
    It's all in the Expect documentation.

    Sample install script:

    #!/usr/bin/perl my %questions = ( 'Path for package: ' => <<EOH, So we are poing to install The Best All-Purpose Compiler ever. It groks perl, java, c#, haskell, forth and lisp and many more all at the same time. Big deal. EOH 'do you want Visual Basic support? ' => <<EOH, The next abomination is optional. PLEASE think again if you are inclined to install support for that cruft. EOH 'What is your nick? ' => <<EOH, We want some sensitive information from you to harrass you on every IRC channel in which you talk bad of our product. Yes, we monitor them all. EOH ); for (keys %questions) { print $questions{$_}; sleep 1; print; chop ($foo = <STDIN>); sleep 1; print "you said: '$foo', good. We'll come back to that.\n"; } print "Thank you for using The Great Foo.\n";

    expect script to deal with that install script:

    #!/usr/bin/perl use Expect; my %answers = ( 'Path for package: ' => '/foo/bar/quux', 'do you want Visual Basic support? ' => 'NO!', 'What is your nick? ' => 'shmem', 'Thank you' => '', ); my $exp = Expect->new(); $exp->spawn( 'perl', 'install.pl') or die; my $prompts = join('|', map {qr{\Q$_\E} } keys %answers); $exp->expect(120, -re => $prompts, sub { my $exp = shift; my $matched = $exp->match; my $answer = delete $answers{$matched}; $exp->send( $answer."\n"); $exp->exp_continue if keys %answers; } ); print "All done.\n";

    Output:

    So we are poing to install The Best All-Purpose Compiler ever. It groks perl, java, c#, haskell, forth and lisp and many more all at the same time. Big deal. Path for package: /foo/bar/quux you said: '/foo/bar/quux', good. We'll come back to that. We want some sensitive information from you to harrass you on every IRC channel in which you talk bad of our product. Yes, we monitor them all. What is your nick? shmem you said: 'shmem', good. We'll come back to that. The next abomination is optional. PLEASE think again if you are inclined to install support for that cruft. do you want Visual Basic support? NO! you said: 'NO!', good. We'll come back to that. Thank you for using The Great Foo. done.

    That's how it works, basically. Of course, you'll have to tweak your regexes well.

    --shmem

    _($_=" "x(1<<5)."?\n".q·/)Oo.  G°\        /
                                  /\_¯/(q    /
    ----------------------------  \__(m.====·.(_("always off the crowd"))."·
    ");sub _{s./.($e="'Itrs `mnsgdq Gdbj O`qkdq")=~y/"-y/#-z/;$e.e && print}
      Dear shmem,

      Thanks a lot for the response.
      You were instrumental in understanding me the working

      You saved my day!!! :)

      Could you please put some light on how did you managed to get only a single instance of the answers in your run that we are sending to the installation script?

      I am getting either 3 (when ran your script as is) or none (when I have: $expObj->raw_pty(1)).

      Sample output:

      bash-3.00# ./installPerl.pl So we are poing to install The Best All-Purpose Compiler ever. It groks perl, java, c#, haskell, forth and lisp and many more all at the same time. Big deal.

      # ========= 3 instances in OUTPUT BELOW =========

      Path for package: /foo/bar/quux /foo/bar/quux /foo/bar/quux you said: '/foo/bar/quux', good. We'll come back to that. We want some sensitive information from you to harrass you on every IRC channel in which you talk bad of our product. Yes, we monitor them all. What is your nick? shmem shmem shmem you said: 'shmem', good. We'll come back to that. The next abomination is optional. PLEASE think again if you are inclined to install support for that cruft. do you want Visual Basic support? NO! NO! NO! you said: 'NO!', good. We'll come back to that. Thank you for using The Great Foo. All done. bash-3.00#

      Code showing no instances of the answers:
      modified this single line in install.pl:

      print "you said: '$foo', good. We'll come back to that.\n";
      to include a newline character as:
      print "\nyou said: '$foo', good. We'll come back to that.\n";

      Sample run:
      ----------------------------------------

      bash-3.00# ./installPL.pl So we are poing to install The Best All-Purpose Compiler ever. It groks perl, java, c#, haskell, forth and lisp and many more all at the same time. Big deal.

      # ========= NO instances in OUTPUT BELOW =========

      Path for package: you said: '/foo/bar/quux', good. We'll come back to that. We want some sensitive information from you to harrass you on every IRC channel in which you talk bad of our product. Yes, we monitor them all. What is your nick? you said: 'shmem', good. We'll come back to that. The next abomination is optional. PLEASE think again if you are inclined to install support for that cruft. do you want Visual Basic support? you said: 'NO!', good. We'll come back to that. Thank you for using The Great Foo. All done. bash-3.00#
      Regards,
      ~DeepBlue