If all you're doing is counting the unique lines, sorting the file first and then counting the consecutively similar lines will require very little memory and probably be quicker than loading the data into a db.
Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.