I think Jesus is more frustrated with the people as a whole. In verse 44 he gives a prophesy of his crucifiction.I think his comment about them being faithless has to do with him knowing they are about to reject him as their King. I feel like Jesus is out there performing these miracles and the people take but are not willing to give him his rightful place as King and that is why he is harsh with the group not the individual. 

I don't think He was mad at this dad. He was just frustrated with the people's lack of faith.