I am not watching my games as I don't think is necessary but I don't think or count myself as an inactive manager. I do log in every day, take care of formation, tactic, condition, moral and so on. Punishing me for what reason? Some of the managers have their games at some very unusual hours so would be very hard for them to watch their games.
Even in my case for example, most of my games are at the time I am at work so why should I be punished?
As I've said above, being online at the game is already a bonus for you: extra pack/packs , ability to control better the game, better possession and so on.