.Google's Gary Illyes shows Googlebot collects web links as opposed to "observing" all of them, opposing official information.Googlebot gathers web links as opposed to following them in real-time.Gary Illyes discussed this details in Google.com's 'Explore Off The Report' podcast.Google's documents negates the actual spider actions.