Lead Scoring - Reducing score over time

I have lead scoring set up.

I have selected that the score reduces by 25% each week if there is no activity from that record.

The issue is, the score isn't reducing. So my visitor scores in CRM are a mass of records and I can't tell which ones are recent and which ones are old (and just cluttering up the module)