Make handler.Config a plain struct rather than an interface

Make handlers methods on the Primary and Secondary types, we can then delete the config argument, used only to get the that object via a type assertion.