IMO, one should NOT settle. If you can't stand the thought of not being with him, I think you should wait. If education and/or career can take you away from that small town for a while, it might be a good way to grow as a person and establish your own identity and comfort zone. And, and some point, you will meet someone who is both a friend and inspires passion.
You CAN have it all, IMO.
