AliceMA to Lemmy Gone WildEnglish · 2 years agoSo what are they talking about here?external-linkmessage-square8linkfedilinkarrow-up14arrow-down10
arrow-up14arrow-down1external-linkSo what are they talking about here?AliceMA to Lemmy Gone WildEnglish · 2 years agomessage-square8linkfedilink
minus-squareAliceOPMAlinkfedilinkEnglisharrow-up2·2 years agoI’m retarded what is a web crawler? Like a bot that crawls the web for certain search terms?
minus-squareairrowlinkfedilinkEnglisharrow-up2·2 years agoi didn’t expect you to know but did expect you to look it up lol: https://infogalactic.com/info/Web_crawler it sounded like they were just trying to make a program that would basically copy the contents of a site to archive it or save the site. like you might see on the wayback machine on archive.org
minus-squareAliceOPMAlinkfedilinkEnglisharrow-up2·2 years agoI should have. I’m being lazy sorry 😞 but why do they wanna do that though is my question
minus-squareairrowlinkfedilinkEnglisharrow-up2·2 years agomany uses. for going back to (like keeping back up copies). sometimes they use the data for different projects. idk
minus-squareAliceOPMAlinkfedilinkEnglisharrow-up1·2 years agoCome on. Tell me the cheese man O_O You guys know stuff ●_●
I’m retarded what is a web crawler? Like a bot that crawls the web for certain search terms?
i didn’t expect you to know but did expect you to look it up lol: https://infogalactic.com/info/Web_crawler
it sounded like they were just trying to make a program that would basically copy the contents of a site to archive it or save the site. like you might see on the wayback machine on archive.org
I should have. I’m being lazy sorry 😞 but why do they wanna do that though is my question
many uses. for going back to (like keeping back up copies). sometimes they use the data for different projects. idk
Come on. Tell me the cheese man O_O
You guys know stuff ●_●