Re^2: Weird memory leak in Catalyst application using Catalyst::Model::KiokuDB

Test::LeakTrace might have put me on the right track, and it looks like I can narrow it further down to KiokuDB:

use strict;
use warnings;
use Test::More;
use Test::Exception;
use Test::LeakTrace;
use KiokuX::Model;

my $model;
eval { $model = KiokuX::Model->new(dsn => 'couchdb::uri=http://127.0.0
+.1:5984/lb-local'); };
plan skip_all => 'Cannot connect to CouchDB' if ($@);

{
    no_leaks_ok {
        {
            my $scope = $model->new_scope;
        }
    } 'new_scope must not leak';
}

done_testing;
[download]

gives me:

ot ok 1 - new_scope must not leak (leaks 2 <= 0)
#   Failed test 'new_scope must not leak (leaks 2 <= 0)'
#   at KiokuX_Model.t line 17.
#     '2'
#         <=
#     '0'
# leaked SCALAR(0x4159810) from /usr/lib64/perl5/vendor_perl/5.12.4/Ki
+okuDB/LiveObjects.pm line 191.
#  190:
#  191:    $known->remove($scope);
#  192:
# SV = IV(0x4159808) at 0x4159810
#   REFCNT = 1
#   FLAGS = (IOK,pIOK)
#   IV = 0
# leaked ARRAY(0x4201180) from /usr/lib64/perl5/vendor_perl/5.12.4/Kio
+kuDB/LiveObjects.pm line 260.
#  259:
#  260:    $self->_known_scopes->insert($child);
#  261:
# SV = PVAV(0x4578968) at 0x4201180
#   REFCNT = 2
#   FLAGS = ()
#   ARRAY = 0x4580b40
#   FILL = 0
#   MAX = 3
#   ARYLEN = 0x0
#   FLAGS = (REAL)
#     Elt No. 0
#     SV = IV(0x4159808) at 0x4159810
#       REFCNT = 1
#       FLAGS = (IOK,pIOK)
#       IV = 0
1..1
# Looks like you failed 1 test of 1.
[download]

Valgrind also complained about something in Set::Object, so it might be the source of the problem. I'll keep digging.

Comment on Re^2: Weird memory leak in Catalyst application using Catalyst::Model::KiokuDB Select or Download Code

Replies are listed 'Best First'.
Re^3: Weird memory leak in Catalyst application using Catalyst::Model::KiokuDB by parmus (Novice) on Aug 02, 2011 at 18:08 UTC
I think I got my leak narrowed down now, and it looks like Set::Object::Weak is the problem. I've written the following short test script: use strict; use warnings; use Config; use Test::More; use Test::LeakTrace; use Set::Object; { package Foo; use Moose; 1; } { no strict; note join ' ', map {$Config{$_}} qw(osname archname); note 'perl version ', $]; note $_,'-',${"${_}::VERSION"} for qw{Moose Set::Object Test::Leak +Trace}; } my $set; { $set = Set::Object->new; no_leaks_ok { { my $obj = Foo->new; $set->insert($obj); $set->remove($obj); } } 'Testing Set::Object for leaking'; } { $set = Set::Object::Weak->new; no_leaks_ok { { my $obj = Foo->new; $set->insert($obj); $set->remove($obj); } } 'Testing Set::Object::Weak for leaking'; } done_testing; [download] which gives me: # linux x86_64-linux # perl version 5.012004 # Moose-2.0202 # Set::Object-1.28 # Test::LeakTrace-0.13 ok 1 - Testing Set::Object for leaking (leaks 0 <= 0) not ok 2 - Testing Set::Object::Weak for leaking (leaks 2 <= 0) # Failed test 'Testing Set::Object::Weak for leaking (leaks 2 <= 0)' # at Set_Object.t line 39. # '2' # <= # '0' # leaked SCALAR(0xdad3a0) from Set_Object.t line 37. # 36: $set->insert($obj); # 37: $set->remove($obj); # 38: } # SV = IV(0xdad398) at 0xdad3a0 # REFCNT = 1 # FLAGS = (IOK,pIOK) # IV = 0 # leaked ARRAY(0x1163cd0) from Set_Object.t line 36. # 35: my $obj = Foo->new; # 36: $set->insert($obj); # 37: $set->remove($obj); # SV = PVAV(0x1394b00) at 0x1163cd0 # REFCNT = 2 # FLAGS = () # ARRAY = 0x13ac740 # FILL = 0 # MAX = 3 # ARYLEN = 0x0 # FLAGS = (REAL) # Elt No. 0 # SV = IV(0xdad398) at 0xdad3a0 # REFCNT = 1 # FLAGS = (IOK,pIOK) # IV = 0 1..2 # Looks like you failed 1 test of 2. [download] Can anyone else here verify this? And if not, could I kindly ask you to post the top 5 lines of the output (the os, arch and versions)?	[reply] [d/l] [select]

Replies are listed 'Best First'.

Re^3: Weird memory leak in Catalyst application using Catalyst::Model::KiokuDB
by parmus (Novice) on Aug 02, 2011 at 18:08 UTC

I think I got my leak narrowed down now, and it looks like Set::Object::Weak is the problem. I've written the following short test script:

use strict;
use warnings;
use Config;
use Test::More;
use Test::LeakTrace;
use Set::Object;

{
    package Foo;
    use Moose;
    1;
}

{
    no strict;
    note join ' ', map {$Config{$_}} qw(osname archname);
    note 'perl version ', $];
    note $_,'-',${"${_}::VERSION"} for qw{Moose Set::Object Test::Leak
+Trace};
}

my $set;
{
    $set = Set::Object->new;
    no_leaks_ok {
        {
            my $obj = Foo->new;
            $set->insert($obj);
            $set->remove($obj);
        }
    } 'Testing Set::Object for leaking';
}

{
    $set = Set::Object::Weak->new;
    no_leaks_ok {
        {
            my $obj = Foo->new;
            $set->insert($obj);
            $set->remove($obj);
        }
    } 'Testing Set::Object::Weak for leaking';
}

done_testing;
[download]

which gives me:

# linux x86_64-linux
# perl version 5.012004
# Moose-2.0202
# Set::Object-1.28
# Test::LeakTrace-0.13
ok 1 - Testing Set::Object for leaking (leaks 0 <= 0)
not ok 2 - Testing Set::Object::Weak for leaking (leaks 2 <= 0)
#   Failed test 'Testing Set::Object::Weak for leaking (leaks 2 <= 0)'
#   at Set_Object.t line 39.
#     '2'
#         <=
#     '0'
# leaked SCALAR(0xdad3a0) from Set_Object.t line 37.
#   36:            $set->insert($obj);
#   37:            $set->remove($obj);
#   38:        }
# SV = IV(0xdad398) at 0xdad3a0
#   REFCNT = 1
#   FLAGS = (IOK,pIOK)
#   IV = 0
# leaked ARRAY(0x1163cd0) from Set_Object.t line 36.
#   35:            my $obj = Foo->new;
#   36:            $set->insert($obj);
#   37:            $set->remove($obj);
# SV = PVAV(0x1394b00) at 0x1163cd0
#   REFCNT = 2
#   FLAGS = ()
#   ARRAY = 0x13ac740
#   FILL = 0
#   MAX = 3
#   ARYLEN = 0x0
#   FLAGS = (REAL)
#     Elt No. 0
#     SV = IV(0xdad398) at 0xdad3a0
#       REFCNT = 1
#       FLAGS = (IOK,pIOK)
#       IV = 0
1..2
# Looks like you failed 1 test of 2.
[download]

Can anyone else here verify this? And if not, could I kindly ask you to post the top 5 lines of the output (the os, arch and versions)?

[reply]
[d/l]
[select]