Yet not altogether with the fornicators of this world, or with the covetous, or extortioners, or with idolaters; for then must ye needs go out of the world.

I was not including the sexually immoral of this world, or the greedy and swindlers, or idolaters. In that case you would have to leave this world.