If you don't so something eventually they will all move in and take over, all it takes is for one pigeon to locate a great spot and the rest will follow.