I had exactly the same problem in Ashfield, NSW (Sydney suburb) as a schoolboy.
Close to the Parramatta River, perhaps ?
Back in the 70's that river could get pretty ripe.
I think they've significantly improved it now, by simply reducing the amount of pollutants that enter it.
Are you still in the Hunter ?