As you are obviously distro-hoping-kinda guy, I wonder; have you ever gone to the extreme? I mean full LFS route, the way of true enthusiasts? It is actually surprisingly easy and you will get exactly what fits your needs, and can be on the bloodiest bleeding edge ever if you so desire