I find it very depressing that no matter how many times I scrub my shower, the black mildew on the caulk persists. It is stained, permanent, tattooed on there. Doesn't matter how hard I scrub.
Maybe the trick is to just let it be. Don't fret or obsess about it. And if you can't live with it... move.