Voltage regulator is unlikly to be burnt (untill plugged incorrectly). What programmer are You using? If it is selfmade nothing can be said without schematic. Main project schematic is also strongly welcome. Without that only common recommendations can be told: check voltage on VCC pin of the MCU, search for short cirquits (with DMM), check wiring of ISP cable.
Also ponyprog docs contain following:
---------
Q: My PC doesn't have any LPT/COM port, can I use a USB2COM or USB2LPT adapter?
A: Some USB adapters don't work at all while other adapters are very slow. So I suggest to avoid USB adapter
and buy COM/LPT PCMCIA or PCI adapters that emulates 100% native LPT and COM ports.
----------