Driving a CVT is going to be a very different experience from a manual. From what I've heard /read the CVT on the WRX is very nice... For a cvt. But it is a very different experience. That doesn't mean its a bad experience but definitely different.
For most enthusiasts though, not having a manual transmission on a car like the WRX is practically blaspheme because a driving experience that feels most connected to the car and road is usually most desirable. If that's your passion than most likely the CVT will not provide the best experience. If that's not your passion (as it seems for you since you're not very interested in learning manual) then that is why they make the cvt and will likely provide you with the best experience.
Most folks who can drive manual will drive manual on a WRX given the choice. The exceptions would normally be you share the car with your significant other who won't drive manual, you daily drive where the traffic is horrendous and dread the shifting in bumper to bumper traffic, or you're just not really a man.

p just kidding about the last one)
I think you certainly should go test drive a cvt WRX and see what you think because that's the only way you will know for sure. It's definitely worth a try though.