Yes, you probably got either the gate-drain or the drain-source welded together internally.
A large-ish current through it might reveal which, by the voltage drop over it - drain-source welded would give a ~0V drop, gate-drain would have a slightly higher drop (but you may need to compare it with a good one by connecting the gate and drain).