I think you could probably get away with it, though there’s no guarantee that you’ll get the same response as the plan intended. But my hunch is that it’d probably be fine.
I would probably move the recovery ride to the 3rd ride of the week, so it’s immediately before the two hard rides at the end of the week. I took a look at what the high volume SSB plans were doing, and they’d run 2-3 days of sweet spot in a row, with a recovery day, and then one off day a week. I think that same approach would work for you, with two days off, a hard first ride of the week, SS, recovery, hard 4th ride, and more SS.
I’m not sure if you’re on SSB 1 or 2. They’re mostly similar, except on SSB2 the first ride of the week is harder. I think the same workout structure should work fine for both though.