Brahmanas are not so very strict following the brahminical principles. So there is chance of falling down. But if you keep yourself on the transcendental platform, aprakrti, that is, beyond the material world, then there is no falldown