Top Eleven draws friends from your Facebook profile, so you'd need to unfriend said person from your Facebook friend list to remove them from Top Eleven.