Do you tell them ahead of time ie when you first set a date, that if it rains, you'll have to give them a raincheck?
That i think makes it more clear that its like "take your kid to work day", and the invitation applies only if youre working. Otherwise you have other work to do, its not playtime just cuz its raining - cuz thats how you roll.