According to Using command redirection operators, the correct syntax is

perl -le" warn 1; print 2; " >one 2>&1
[download]

It works

C:\>perl -le" warn 1; print 2; " >one 2>&1

C:\>cat one
1 at -e line 1.
2

C:\>
[download]