If I live with my husband in an EU country for a minimum of 3 months, and I am a British citizen, are we required to work there and not be on benefits?

I'm trying to understand how the Surinder Singh route would apply to me and my husband. He is a non-EU national living in Germany on a 3-year residence permit as a refugee.