Try putting this in your XS interface:

char *
do_funky_xs_thang( file )
  FILE * file
[download]

Or you can get a file descriptor for any open filehandle using fileno, and pass that (as a simple integer) to your C (or whatever) function, if that's what it needs.