Dear folks,

I have an address matching app. Runs on Linux and AIX.

On AIX it uses a reasonably fixed amount of memory.

F S UID PID PPID C PRI NI ADDR SZ RSS WCHAN TTY + TIME CMD 240001 A 352 3567696 3465364 119 119 20 201d28be 30256 29960 + - 2299:11 /lapps/perl32a/bin/perl ./match_nearest.pl addresses.c +sv

On Linux the exact same app uses up all available memory and then segvs - signal 11.

Any ideas why?

Uses the following modules:

use Text::Soundex; use Text::Metaphone; use Text::Compare; use Text::LevenshteinXS qw(distance); use String::KeyboardDistance qw(:all);
Here's how things are built: AIX:
Summary of my perl5 (revision 5 version 8 subversion 8) configuration: Platform: osname=aix, osvers=5.3.0.0, archname=aix-thread-multi uname='aix portia 3 5 000d043d4c00 ' config_args='' hint=previous, useposix=true, d_sigaction=define usethreads=define use5005threads=undef useithreads=define usemulti +plicity=define useperlio=define d_sfio=undef uselargefiles=define usesocks=undef use64bitint=undef use64bitall=undef uselongdouble=undef usemymalloc=n, bincompat5005=undef Compiler: cc='cc_r', ccflags ='-D_ALL_SOURCE -D_ANSI_C_SOURCE -D_POSIX_SOURC +E -qmaxmem=-1 -qnoansialias -DUSE_NATIVE_DLOPEN -DNEED_PTHREAD_INIT - +I/usr/local/include -q32 -D_LARGE_FILES -qlonglong', optimize='-O', cppflags='-D_ALL_SOURCE -D_ANSI_C_SOURCE -D_POSIX_SOURCE -DUSE_NAT +IVE_DLOPEN -DNEED_PTHREAD_INIT -I/usr/local/include -D_ALL_SOURCE -D_ +ANSI_C_SOURCE -D_POSIX_SOURCE -DUSE_NATIVE_DLOPEN -DNEED_PTHREAD_INIT + -I/usr/local/include -D_LARGE_FILES -D_ALL_SOURCE -D_ANSI_C_SOURCE - +D_POSIX_SOURCE -DUSE_NATIVE_DLOPEN -DNEED_PTHREAD_INIT -I/usr/local/i +nclude -D_LARGE_FILES' ccversion='7.0.0.5', gccversion='', gccosandvers='' intsize=4, longsize=4, ptrsize=4, doublesize=8, byteorder=4321 d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=8 ivtype='long', ivsize=4, nvtype='double', nvsize=8, Off_t='off_t', + lseeksize=8 alignbytes=8, prototype=define Linker and Libraries: ld='ld', ldflags =' -brtl -bdynamic -bmaxdata:0x80000000 -L/usr/lo +cal/lib -b32' libpth=/lapps/local/lib /usr/local/lib /lib /usr/lib /usr/ccs/lib libs=-lbind -lnsl -lgdbm -ldbm -ldb -ldl -lld -lm -lcrypt -lpthrea +ds -lc -lbsd perllibs=-lbind -lnsl -ldl -lld -lm -lcrypt -lpthreads -lc -lbsd libc=/lib/libc.a, so=a, useshrplib=false, libperl=libperl.a gnulibc_version='' Dynamic Linking: dlsrc=dl_aix.xs, dlext=so, d_dlsymun=undef, ccdlflags=' -bE:/lapp +s/perl32a/lib/5.8.8/aix-thread-multi/CORE/perl.exp -bE:/lapps/perl32a +/lib/5.8.8/aix-thread-multi/CORE/perl.exp -bE:/lapps/perl32a/lib/5.8. +8/aix-thread-multi/CORE/perl.exp' cccdlflags=' ', lddlflags='-bhalt:4 -bexpall -G -bnoentry -lpthrea +ds -lc -L/usr/local/lib' Characteristics of this binary (from libperl): Compile-time options: MULTIPLICITY PERL_IMPLICIT_CONTEXT PERL_MALLOC_WRAP USE_ITHREADS USE_LARGE_FILES USE_PERLIO USE_REENTRANT_API Built under aix Compiled at Dec 21 2006 14:17:17 %ENV: PERL_USERNAME="Derek Jones - CTG" @INC: /lapps/perl32a/lib/5.8.8/aix-thread-multi /lapps/perl32a/lib/5.8.8 /lapps/perl32a/lib/site_perl/5.8.8/aix-thread-multi /lapps/perl32a/lib/site_perl/5.8.8 /lapps/perl32a/lib/site_perl .
Linux:
Summary of my perl5 (revision 5 version 8 subversion 8) configuration: Platform: osname=linux, osvers=2.6.12-12mdkcustomvm, archname=-linux-thread- +multi-64int-ld uname='linux headnode1.uspa.ibm.com 2.6.12-12mdkcustomvm #3 smp mo +n mar 13 20:23:24 est 2006 i686 intel(r) xeon(tm) cpu 3.20ghz unknown + gnulinux ' config_args='' hint=previous, useposix=true, d_sigaction=define usethreads=define use5005threads=undef useithreads=define usemulti +plicity=define useperlio=define d_sfio=undef uselargefiles=define usesocks=undef use64bitint=define use64bitall=undef uselongdouble=define usemymalloc=n, bincompat5005=undef Compiler: cc='cc', ccflags ='-D_REENTRANT -D_GNU_SOURCE -DTHREADS_HAVE_PIDS +-fno-strict-aliasing -pipe -Wdeclaration-after-statement -I/usr/local +/include -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -I/usr/include/gd +bm', optimize='-O2', cppflags='-D_REENTRANT -D_GNU_SOURCE -DTHREADS_HAVE_PIDS -fno-stri +ct-aliasing -pipe -Wdeclaration-after-statement -I/usr/local/include +-I/usr/include/gdbm -D_REENTRANT -D_GNU_SOURCE -DTHREADS_HAVE_PIDS -f +no-strict-aliasing -pipe -Wdeclaration-after-statement -I/usr/local/i +nclude -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -I/usr/include/gdbm + -D_REENTRANT -D_GNU_SOURCE -DTHREADS_HAVE_PIDS -fno-strict-aliasing +-pipe -Wdeclaration-after-statement -I/usr/local/include -D_LARGEFILE +_SOURCE -D_FILE_OFFSET_BITS=64 -I/usr/include/gdbm' ccversion='', gccversion='4.0.1 (4.0.1-5mdk for Mandriva Linux rel +ease 2006.0)', gccosandvers='' intsize=4, longsize=4, ptrsize=4, doublesize=8, byteorder=12345678 d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=1 +2 ivtype='long long', ivsize=8, nvtype='long double', nvsize=12, Off +_t='off_t', lseeksize=8 alignbytes=4, prototype=define Linker and Libraries: ld='cc', ldflags =' -L/usr/local/lib' libpth=/usr/local/lib /lib /usr/lib libs=-lnsl -lndbm -lgdbm -ldl -lm -lcrypt -lutil -lpthread -lc perllibs=-lnsl -ldl -lm -lcrypt -lutil -lpthread -lc libc=/lib/libc-2.3.5.so, so=so, useshrplib=false, libperl=libperl. +a gnulibc_version='2.3.5' Dynamic Linking: dlsrc=dl_dlopen.xs, dlext=so, d_dlsymun=undef, ccdlflags='-Wl,-E' cccdlflags='-fpic', lddlflags='-shared -L/usr/local/lib' Characteristics of this binary (from libperl): Compile-time options: MULTIPLICITY PERL_IMPLICIT_CONTEXT PERL_MALLOC_WRAP THREADS_HAVE_PIDS USE_64_BIT_ +INT USE_ITHREADS USE_LARGE_FILES USE_LONG_DOUBLE USE_PERLIO USE_REENTRANT_API Built under linux Compiled at May 25 2006 10:19:17 @INC: /lapps/perl32/lib/5.8.8/-linux-thread-multi-64int-ld /lapps/perl32/lib/5.8.8 /lapps/perl32/lib/site_perl/5.8.8/-linux-thread-multi-64int-ld /lapps/perl32/lib/site_perl/5.8.8 /lapps/perl32/lib/site_perl .

In reply to AIX vs. Linux memory use by scunacc

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.