Like many wasp species, they are important pollinators ... you should consider having them removed. Yellow jacket nest removal isn’t a DIY project because it can require special equipment ...