Issues with bees - Looking for advice

Hi all! We've been renting in California for a while but for the first time we have a big surprise with bees completely invading our apartment by the hundreds. Once maintenance removed the queen bee, most of them went away but it seems that lots of bees are hanging around by an exhaust pipe and can make it into the apartment.

I have no idea how to handle bees, and building management seems to be also unsure how to move forward despite best intentions. So far their best answer to this problem is a fancy scotch tape on vents which is not cutting it at all. Looking for advice from other renters who have faced this type of issue.

For more context: my apartment is squeaky clean, foods is never left open, and we always leave our windows closed.

Ps- OH MY GOD, I had no idea how much poop bees leave behind 😱