Perhaps his desire to protect his family of his gave him all the more reason to be wary. Perhaps he'd had experience with such things before, those who were not as trustworthy as they seemed. There are many reasons why he could have seen what you did not.

[He's matter-of-fact about that, just in case Qubit is thinking of blaming himself for having not foreseen the future.]