You will have to "work around". Even if readdir would work the way you think, there'd be no guarantee that new entries would be put "at the end".

And anyway, you haven't specified what you want to do about modified files.