All of these nondevotees (fruitive actors and jnanis) are lusty (kami). Because they desire something, they cannot have peace. The peace formula is given by Krsna in the Bhagavad-gita - BG 5.29