CORE contains some perl header files. When you compile modules that link to Perl you may (or may not) need some of these header files available. The headers provide the stub functionality that the compiler needs to do its job.

There is a lot to be said for compiling your own perl. It is not that hard. You get the latest version. Things tend to just work. You can have a try without breaking anything.