On Linux, I guess you could create a Tk window, get the window id, then use mplayer with the -wid <window id> option to tell mplayer to display the video in your window.
But for Windows, I have no clue. Perhaps there is similar mechanisms to specify the ouput window for the WindowsMediaPlayer ?

Just my 0.02 € ...