Remove ehcache (at least temporarily)

The fact that it was still there on the classpath means it needs to
be configured (and fails silently if you don't). Removed to give
us some tmie to reconsider.