In some ways I agree with everyone, but its been like this every couple of years. Everytime someone important leaves, there is a contingent of people that say, "now its just really gone downhill." I am sure there are still people saying that it really tanked when Chevy Chase left, or Bill Murray. Or for you mid-90's folks, when Dana Carvey, Mike Myers or Phil Hartman left.
Hell, there may even be some people who think the show went down hill once GE Smith left the band.