So just connect the charging ports wires directly to the positive and negative terminal on the battery?
Yes, only way to charge, unless you include a charger circuit between this "port" (connector) and the battery, but you need a charger made for a "24V" battery.
It's not the best way to charge, but with a correctly adjusted charger and good connections it will work.
It seems to be a 3 pole connector...
And you might wanna connect the remaining contact (fused!) to the connection point of the two batteries (the 12V point), to make it easier to balance and/or check the batteries - you could get an extra connector and some 4mm jacks and make a measuring lead to make life easier.
However, do consider using 3-pin XLR connectors...(The female socket should be used at the battery side of things, to make it harder to short circuit the battery)
They have a click-lock rather than the dreadful screw-lock on the one you linked to and they have proved their ruggedness in pro-audio, where they usually see a lot of physical abuse.
Whichever you use, fuse the line(s).