If it's in your pdocs opinion that the Valium is of benefit to you now, and you trust your pdoc's judgment, I think that given your current circumstances, this is fine.

Dosage / lowering / tapering down can be considered in consultation with you and your pdoc in due time.

Hang in there.