As far as I know, when a ball is THROWN then it is moving, and therefore it has KINETIC ENERGY - due to the motion.
Potential energy is the energy objects possess because of their position.
Hence, the objects that are on highest ground level have the most potential energy.
If the rule of potential energy applies to your case with the throwing of the ball, then the potential energy will be the highest on the tip of the parabola.