You may not be aware of this but in this world there is a spirit of murder towards children. I believe that Count Olaf (A Series of Unfortunate Events) is a metaphor for that spirit. And just like the adults of this world are largely clueless to the spirit of murder, so to the adults around Count Olaf are clueless to his machinations.