Bees can find a cozy space between walls, causing issues for homeowners. How do you tell them to leave? We all know the value that bees have for ecosystems so simply gassing them should not really bee and option.
They can cause damage and mold though, especially if they are honey bees, so should be removed. Call a professional beekeeper to come and take the hive away, don't attempt it yourself!