I would never be able to take 20 mg. Like you 5mg knocked me out quickly for the night. I found taking it about 8:30PM and heading to bed put me to sleep about 9:00PM and that gave me about 9 hours of very nice sleep a night with no hangover in the morning. Are you allowing yourself enough sleep time during the night after taking it?