The beauty of staying where you are is that no one second judges you. No one thinks you are silly. If they did nothing will change that and you can be ignored. When you try to knock on new doors you get profiled. They want to know if you are serious and they sometimes openly laugh at your ideas.
I think every business has its customers. But I wonder why people are so quick to put you into a box and be impolite. Yet this is normal and should not stop you from what you want to do.