I was in the same boat as you. I wanted to improve conditioning without sacraficing size or strength.
I was skeptical at first because it's the hardcore metcon workouts that stand out, but the more you read, the more you learn, the more you realize the WOD is just an example of Crossfit principles. How you apply those principles depends on your strengths, weaknesses, and goals.
Anyway, after toying around with the ideas, I decided to jump in. Ten months later my weight and body fat are the same, my strength is through the roof, and my conditioning has been making great strides. And I could go on for days about the progress my girlfriend Jodi has made. It blows my mind.
Bottom line, we are here to stay!