In my opinion you are too accepting with A.

Rather than asking A not to contact you, block her on all media.

Don't talk to or touch A at all while you are in a relationship with P.

Don't go to A when there are problems with P.

Have one relationship at a time, and be totally faithful (physically and emotionally) to that relationship.