Hi Tom Hitchcock,
You can send in an appeal against the penalty giving your reasons but there is no guarantee it will be accepted.
This should be sent to:
HMRC PAYE & Self Assessment BX9 1AS.
It is likely the same charges will apply to your wife.
Guidance here:
Appeal against a penalty
Thank you.