I also had trouble with some of the newer nvidia drivers so I removed the newer ones and use the older 385.41
Some of the newer ones were losing performance after being on a while.
Might be worth a try if you haven't already.
Will give this a try and report back.
I thought about reseating everything, but seems pointless when all the benchmark apps show amazing performance!