Steering via the front wheels like a regular car (which is what I think you mean by differential drive) is a complex mechanical task. The electronics of it is easy, it's just a servo that turns back and forth, but the mechanics needed to actually turn the wheels the way you want them is hard.
If you're talking about differential drive, like spinning the right wheel forwards and the left wheel backwards to turn left, that is really easy to program and make. With 4 wheels its a bit more difficult, and you won't get as smooth control as you would with 2 wheels and a castor wheel.
Using a castor wheel with 4 wheels doesn't make sense to me... What did you have in mind for the wheel base?