I have no knowledge whatsoever of OLE, but it is my understanding it would be easier to access from C or C++. Couldn't you create an extention in C, bypassing Win32::OLE altogether?

Flame notes that he has no experience with XS either.