Definitely not supposed to stick out like that, as shown below, mine doesn't. (bad quality photo on the first pic, just grabbed my phone which was as hand.
Another note, here's what I did for a little bit of extra GPU cooling, while at the same time keeping the window I just secured it squarely...