Well, I wouldn't say it's harder...it's just different. You'll have to accept a certain learning curve before you will be comfortable with the yoke.
I had a yoke before, and I felt much more in control when performing precision rolls and landing corrections. Too bad my yoke lacked the amount of buttons found on many sticks, so I switched back to a joystick again:)