Matching Is Not Enough: A Two-Stage Framework for Category-Agnostic Pose Estimation