The Crowmarsh roundabout is a bit of an odd one. Going south, for all exits other than turning right into Crowmarsh/Wallingford, the general consensus seems to be that you have to use the left lane.
They've added a little sign below the main sign to try to clarify, but it isn't fully clear...