Patriots quarterback Matt Cassel walked off the field prior to the start of Sunday's game.