If you are really trying to get plain-text output from man, you should use the standard method of doing so:

$ man ls | col -b > man-ls.txt
[download]