Delete them from the game using the red minus button BUT if they are a facebook friend then you need to delete them from facebook.