Tried defining a column attribute to have a border but that created an infinite number of cells with borders

From my experience, that's the same what Excel does, (well, not an infinite number, but 65536 or 1048576 rows, depending on version) resulting in Megabyte-sized files for just a few hundred numbers …

You'll have to define these attributes on the cell level.