Anonymous Monk has asked for the wisdom of the Perl Monks concerning the following question:
This question is based on
My objective is simple. Install all modules into a local::lib.local::lib * install all modules into a local::lib controlled directory, push + this directory to all of the hadoop cluster boxes (rsync, app instal +ler, nfs mount ), explicitly include this directory in a use lib or u +se local::lib line in your mapper/reducer/combiner files.
Tar up the directory and use a bootstrap script to copy over to each data node on Elastic Map Reduce ( amazon ) cluster.
Untar and use the use lib or use local::lib to use these modules in my Mapper/Reducer etc.
What I am against is that when I untar and try using the modules, I have an unsattified link error
Can't locate loadable object for module Sub::Name in @INC...
I can get to the pm file but a shared object needed by Name.pm is missing.This of of course points to a missing shared object and is pbly b’coz of the fact that I copied the local::lib controlled directory, rather than installing as one would normally do if working standalone.
I was wondering how did you folks get this to work. ( You guys obviously have this working as else that would not be one of the alternatives you suggested )
|
|---|
| Replies are listed 'Best First'. | |
|---|---|
|
Re^5: Hadoop and perl
by Anonymous Monk on May 28, 2011 at 12:36 UTC |