OK, so according to qwerty, the x-server is not needed by android since it uses the framebuffer instead.

I also found that killing browserd frees up about 2mb of memory. Its hard to tell though since the numbers seem to jump all over the place.

Another way to improve performance is to go into dev-tools and disable window animations.