Baroness Hoey said 1,000 people a week are prosecuted for non-payment, with seven in ten of those being women, with the elderly and disabled also affected.
Move comes as the number of households holding TV licences fell by 400,000 last year.