sed and awk cannot handle large amount of data, because they try to load the entire file at once into the memory and then apply the changes on them

That is quite some assertion. I'd be interested (and very surprised) to see any evidence which backs this up.