perl -i -ape 's/^>//g' file.txt

The '-a' is unnecessary, since there's no need to auto-split anything. Replacing it with a '-w', though, might be of benefit since mistypes happen. :)