Another way to help your process is to use a hash to accumulate all IP addresses, and each <unit of time> swap the hash with a blank one. Then, while you're accumulating the new hash of IP addresses, you can bulk load the list of IP addresses into a temporary table and integrate the table into your production table.

...roboticus