My personal opinion is that what is most important is for you, yourself, to be happy and satisfied with the way you're living your life. If you do not feel anything is missing, don't mind what the world out there expects of you.

With that said, given that you live in a small town, maybe you just haven't met the 'right guy' for you yet - someone you can see yourself with while simultaneously continuing to live life with the freedom you currently have. A pleasant addition to your life, not someone who is going to turn around an already great life.

To adress your question, if I am understanding it correctly, in my opinion having a really casual attitude towards casual sex in a small town is not a good idea because chances are people will gossip and this may end up hurting you in some way.

Is dating still a possibility in your small town, like how 'small' is it? Do you have opportunities to go to other places when you have time off from work, maybe even move elsewhere? Have you considered it or do you feel that where you live is where you'd like to live forever? Change could be good sometimes to give you a fresh perspective.