Well, it scales like N! which is exponential. Which doesn't scale well at all. It basically means that if your CPU speed doubles, you can increase your problem space by 1 to get an answer in the same time.
And I don't think you can avoid a brute force approach. This sounds very much like an NP complete problem.