The GTX 970 has an issue with the "last" 512MB of VRAM, as you may know. Maybe try a number in-between 2048 and 4096, just make sure it's a multiple of two. I did as you said and it looks like 3068 is the sweet spot for me. Thanks for the help :) Hopefully I wont need to come back.