Revelations 18:21 And a mighty angel took up a stone like a great millstone, and cast it into the sea, saying, Thus with violence shall that great city Babylon be thrown down, and shall be found no more at all.

Hear Harold Camping tell us how he interprets Babylon as the Church today (all denominations all churches no exceptions) and what will be the fate of ALL church-goers. 
                                 Foot note on when we do leave a Church

Verse to keep in mind

Mathew 18:6 But whoso shall offend one of these little ones which believe in me, it were better for him that a millstone were hanged about his neck, and that he were drowned in the depth of the sea.