I don't believe there's any way that a program that sits on a pty (like Expect.pm) can ever distinguish where the data is coming from.
This is the blessing and curse of Unix I/O.
So, no, I think you're just gonna have to consider the various things to wait for,
some of which will be error-like messages coming at unexpected times.