It seems there is no limit for FB but there is for in-game. So look for FB groups to add from if you hit that limit. A fair amount of my friends are via FB, so maybe that's why I can still add in-game.

Nice you have a server group, that's cool!