0xB0 itself ("°") is invalid UTF-8; the proper encoding is 0xC2 0xB0 ("°"). Therefore, the file was not properly written to as UTF-8, and thus the error when you try to open it as such.
Thanks for your help both the solutions described here worked. The "°" and the setting the file-encoding setting, which I guess achieved the same thing.