1) I would test the servo to see if the ground and power line are shorted. Use a multimeter to determine continuity.
2) How much stuff do you have plugged into the arduino. You could be drawing too much current.
3) Servos normally spaz when they are first plugged in. This is what I think smash was reffering to.
4) How do you have the servo hooked up?