My distant memory is that if you check the time of a file that is referenced by a symbolic link, you get the time of the referenced file, not the link. I really don't know what happens if you try to modify the time, but you might need to de-reference it to the target file.