Hands down, the most difficult problem I encounter is lack of a customer (or customer proxy) available to give feedback on the project. Without a consumer, stakeholder, or whattayacallem to compare the solution to the demand, it's difficult to say when the project is headed in the right direction, let alone when it's done.