I don't think you can have a 'just' physical relationship, not at this point. You are still emotionally caught up with her. She probably has her own emotional confusion around your break up. Adding the physical component back adds even more confusion to the mix.

If you want to reconcile, it sounds like you are moving in the right direction. If you want to get over her, it may be better to introduce more distance.