I suspect you need to install some X *-devel package to get the headers. Most consumer Linux distros don't install those by default.