My theory is that Alfonso Cuaron decided to use him in POA because of course he's Crazy Gary Oldman, of course he's going to try to kill Harry Potter--so the people who don't read the books were totally convinced and so they never saw it coming that he would actually be the good guy. And then when people saw that he actually played a good guy really, really well, his second career in cuddliness took off.