OK, I tested the voltage a few further ways:
1. Voltage directly at the board
Switches On, Switches Off, behaves as expected
2. Voltage at the end of the cable
Switches On,m Switches Off, behaves as expected
3. Voltage at end of the cable with valve connected
Switches On, won’t switch off, keeps supplying voltage at 23v until I shutdown the board.