No, sounds like you should be fine: http://www.ivf.com/laprscpy.html

I had my appendix burst and was in the hospital only a couple days, was operated on Friday morning, out of the hospital Saturday afternoon and knew of others who'd been operated on that same day by my surgeon who went back to work that Monday!

That's an idea, can you schedule it near a weekend so you have an extra day or two off if it worries you?