I've heard theories that one person can act as a sort of magnet to another. If we break it down, Raimu arrived first, followed by you some time later. I followed soon after, and later that day, Neku and Daisukenojo showed up, with Minamimoto following a month after.

It also makes me wonder, though, why some leave and others stay.