I have no opinion on what you should use, but I do have one on what you shouldn't. Don't use MatLab - and not because it cost money. It is just a horrible environment - and don't get me started on what it takes to distribute standalone apps.

There is also Statistics::R, though I know you're asking for a gui.