I understand that you already know basic mathematics, but have you tried the Trachtenberg Speed System of Basic Mathematics ? Im not sure if this will be of much help in your quest, but I found this system to be refreshingly simple.