Of course if one thinks that Bhagavad-gita and the Hare Krsna mantra are part of the Hindu system and doesn't want to accept them because of this, he can nonetheless attend the Christian church and sing there