Deb has a great point there, regarding brood boxes.
I was thinking you were just starting, don't know where that came from.
If you are in double deeps for brood it may take some time for them to fill the upper and move back down to the lower. If the lower box is still empty I'd not be worried about risk of swarming. You did not say you rotated so I assume not, which is I believe best to let the bees manage their own space. The only time I would rotate is if there was Zero brood in the lower. This is because any brood in the lower will be at the top, and the brood in the upper will be below a cap of honey. So if you rotate and have brood in the lower you will isolate that brood in the top of the hive with stores between them and the main brood area.
Once that second box is 3/4 full that would be the time to add a super. So have your gear ready.
If you have a double deep and 2 full boxes (lots of brood) already you might consider working towards a small split for a resource hive or to sell. Do you have any drone brood yet?
My very small colony finally woke up and it looks like they are growing maybe faster than I thought, I'm going to have to take inventory, should have done it today....