AliceMA to Lemmy Gone WildEnglish · 10 months agoSo what are they talking about here?external-linkmessage-square8fedilinkarrow-up14
arrow-up14external-linkSo what are they talking about here?AliceMA to Lemmy Gone WildEnglish · 10 months agomessage-square8fedilink
minus-squareAliceOPMAlinkfedilinkEnglisharrow-up2·10 months agoI’m retarded what is a web crawler? Like a bot that crawls the web for certain search terms?
minus-squareairrowlinkfedilinkEnglisharrow-up2·10 months agoi didn’t expect you to know but did expect you to look it up lol: https://infogalactic.com/info/Web_crawler it sounded like they were just trying to make a program that would basically copy the contents of a site to archive it or save the site. like you might see on the wayback machine on archive.org
minus-squareAliceOPMAlinkfedilinkEnglisharrow-up2·10 months agoI should have. I’m being lazy sorry 😞 but why do they wanna do that though is my question
minus-squareairrowlinkfedilinkEnglisharrow-up2·10 months agomany uses. for going back to (like keeping back up copies). sometimes they use the data for different projects. idk
minus-squareAliceOPMAlinkfedilinkEnglisharrow-up1·10 months agoCome on. Tell me the cheese man O_O You guys know stuff ●_●
I’m retarded what is a web crawler? Like a bot that crawls the web for certain search terms?
i didn’t expect you to know but did expect you to look it up lol: https://infogalactic.com/info/Web_crawler
it sounded like they were just trying to make a program that would basically copy the contents of a site to archive it or save the site. like you might see on the wayback machine on archive.org
I should have. I’m being lazy sorry 😞 but why do they wanna do that though is my question
many uses. for going back to (like keeping back up copies). sometimes they use the data for different projects. idk
Come on. Tell me the cheese man O_O
You guys know stuff ●_●