Click on that player to open his profile window. When that window pops up, on the right side of his name there is (-), click on that - to remove him from list. Number of shortlist solts increases with league level. For example on lvl1 max. number is 2. If you want to add 3rd, you have to bid on that player to put him on shortlist, but limit won't increase.