I wear contacts through everything right now. Haven't had any issues. Though if you've already made the investment in the prescription Oakley's you may want to try the prescription goggles first.

I've worn contacts for quite a few years at this point and to be honest I probably wouldn't be able to find the transition area if I didn't have them in. You may want to get fitted for them at your next eye doctor appointment. The appointment is a few bucks extra for the extra work to fit you for them, but you usually score a free trial pair. That way you get a try before you buy kind of deal. And if you don't like them the prescription from the exam is still good for glasses.