I'm not aware of any book on reverse engineering. Reverse engineering is to me not unlike debugging, except that you have no access to the source code of either end of the communication. You will need to monitor all communication between the two parts of your program, and try to associate the communication with certain actions that you can identify, like "if I press this button, it sends the following byte sequence". Then you will need to try to replay that communication on your own.

So far, you haven't even told us what application you are trying to automate, and what setting it is, so we can't likely help you further.

I'm not aware of any book on reverse engineering

"Reversing: Secrets of Reverse Engineering" by Eldad Eilam is available on Amazon.

However, you do need low-level skills. Maybe you should discuss this with the manager who set you this task. If the socket stream you need to read is undocumented then the first thing to look for is the source code of the program that is generating it. Presumably the data stream is aimed at a program at the other end - where is the source code for that?

That`s exactly what I'm up to. I need to know what it`s sending and/or receiving so I can automate it.

The fact I am new to this and have no idea why they use binary data in socket communications and how the request is assembled that`s why I am asking about some kind of tutorial/book/guide or anything that gets me started