I end up getting diverted by having to learn some new skill first

That is a very common experience. One of the things I like best about software development is that I get to learn about and work with many things that are outside my degrees, but are "touched" by software.

It seems the more I learn, the less I feel like I know

It is a wise person who realizes just how little they actually know. Of course, that's because they realize just how much there is to know. Congratulations.