Check out vterm if you're using a recent emacs with loadable module support. Anecdotal but I've noticed differences (I still do most normal work in iTerm but the things I do do within emacs straight seem peppier).