icoms8, your best bet IMO would be to just get four 7 segment LED displays (2 for each teams score) and just use an MCU to turn on or off each segment using the same principle as the $50 robot uses for its LED indicator light. You would need an MCU with only about 30 controllable pins to be able to control each individual segment of each display. Then you could store the on-off combinations for each number(0-9). So lets say they scored 1 point. Now they have '1'. In the MCU it would say "hey, whats the combination(could be hex, binary, or decimal) for '1' on displayOne? Ok cool, run that combination!" and then presto! you have a '1' being displayed on displayOne. displayTwo through displayFour would be running the '0' combination.
See what I mean?
Another possibility that might cost you more and isnt really that efficient is to have 5 MCUs for the whole thing. The first will be the entire brains keeping track of the scores and all that jazz. The other four would be specifically to control the segments so they would only need like 7 or 8 data pins. I think the trickiest part of that would be just getting the four slave MCUs to talk to the one master MCU which really isnt that hard I dont think.
Hope this helps!