For a free, fast, awesome (etc.) database, look no further then
mysql I seriously doubt you can embed the datase in the application, but
mysql will run in windows very happily, (with all of windows problems though). Specifically, look at
this section for interfacing with perl.
mysql would be best for a web, or atleast remote access, type application. If your looking for something small, your best bet might be flatfiles.