this will leak and it will be slow. the best way is to directly manipulate the hash tied to the tablematrix widget. for images and tags extra work is required though.
its too bad this wonderful module hasn't been "leak fixed" (I still have hopes though ;).