I had to make this choice recently. And garden size and aspect were the two things I was most likely to compromise on if the house was right. It's the difference between being able to move in in June, or potentially waiting another two years. That's an easy choice. It'll still get plenty enough sun despite being NNE, facing in my opinion.