So I'm currently using a cheap swivel caster that came in a four pack, and it doesn't seem to be swiveling as intended on my differential drive robot. The caster wheel is hard plastic and doesn't appear to produce much friction. However, the wheel angle when it does swivel has a noticeable effect on the direction my robot travels.
Does anyone have any tips to correct this besides switching to a ball caster or omni-wheel?