Don't ask me for the details, but it seems to me you should be able to load the Excel file into MS Access---assuming you have the whole Office package installed. It might involve saving the file as comma-separated values, and then using Access to connect to MySQL. At my last job we used Access as a desktop DB client, but while I configured my machine, I never understood the details.

Sorry for an unhelpful answer, but perhaps checkign the Access manual will provide the info you need.