No one can keep you in a place you don’t want to be.
If you believe others have that power, then you are the one limiting your choices. No one has the power to stop you from creating the life you want. No one can stop you but yourself. When you defeat yourself because of what others might think, it is not them, but you who is stopping you. It is you who is making other people’s opinions a priority over your own.