Yay for learning stuff. Ok, first off, thanks for the info paulstreats. I was doing something similar to that. I did find out why it was not working. After trying a few times and getting zero results, I completely took apart the joystick and removed the pots to test them. While doing this I noticed one thing they had in
common.. the red wire. Hmm, a common wire. Isn't that a ground? Well, tested it out, and yes, it was. So, for those dismantling things, remember, colors aren't always what they seem. So the wires colors listed above are incorrect. Black is ground for the buttons,
red is the ground for pots, and
purple is the +5V for the Y axis trim. Hope someone learns from my mistake