Didn't watch the show religiously, but the same as anything else, things go downhill when you don't replace central characters with strong alternatives.
Losing James Bolam and Michael French was the eventual death knell of the show, although I agree Richard Wilson did make a fair effort to fill the gap.