Hi,
Sounds like waltr was right, you are using the port as input.
Output ports don't need pullups.
Change the direction register and the problem should go away.
I'd recommend reading up on microcontrollers, perhaps read and follow a few beginners tutorials to get the gist of it.