You can do that with
Cygwin, a heavyweight Unix-in-a-Windows solution including a package managemer and a lot of doodads, or
Gnu/Win32, a less involved collection of GNU software ports for Win32 platforms. If you just want a
tar and
gzip /
bzip2, stuff from the latter project is far easier to get going.
Makeshifts last the longest.