At the very least, using Inline::C adds another layer of subroutine call around the c function. Depending upon what parameters the sub takes and whether you declare them using C types or XS types, the translations in and out can add conversions and casts that can be unnecessary.

Try comparing the post processed C with your original C function. It can be quite an eye opener.