Atheists can be considered Jewish, indeed. But being atheist isn't the same as becoming christian or something.
Being atheist doesn't stop you from being Jewish. Being Christian, or Catholic, or Muslim or a JW or whatever, does stop you from being Jewish.
I know you might not agree, but that's how the religion works.