Draft: Fix #314 - Avoid storing simple and complex filters as objects

This MR does what the issue describe, and it reduces between 5% and 10% heap memory consumption.

I am working on these changes incrementally, but more MR will follow improving other maps in a similar way, where possible.