The first thing is to make sure your power adapter outputs AC voltage, not DC — especially if you are using your own adapter, it’s a common mistake to find a 24VDC adapter, since they are easier to find than AC adapters.
Next, if you have a AC adapter, when a zone is off, it’s common to see some stray voltage — the stray voltage should be gone when you have an actual solenoid connected.