I learnt something in leadership. It was about 'coaching' people but I think applies to those times it's difficult to make an apology. We called it the **** sandwich. State something positive, state the bad, then close with something positive again.

ex. "I'm glad that computer is working again"
"I'm sorry I buggered it"
"I'll remember not to play with it"