An interesting tangle.  The hash table was getting
allocated before processing the config file so it
was sized for the default parameters.  That was 8K
hash slots so there was a lot of list walking if you
set things up for a large number of addresses.