Hello,
You can try to below options to remove the users
1.Ask the Policy approver to send policy for rework and you can approver from roles tab of policy and then re submit for review and Approval
2.check if the approver still exist as default approver for policy
3.Check the fallback recipients for policy approval which comes from selected organization in policy scope tab
Hope it helps you
Regards
Baithi