Try using the following syntax:

my $sth = $dbh->prepare ("SELECT * from timestamp_testing where start 
+= ?::timestamp");
[download]

BTW, the PostgreSQL client library libpq does not use ? but $1, $2, $3, etc. as placeholders (the DBD::Pg driver makes the conversion internally), that's why you see a $1 on the error string.