• AliceOPMAEnglish
    2·
    1 year ago

    I’m retarded what is a web crawler? Like a bot that crawls the web for certain search terms?

    • airrowEnglish
      2·
      1 year ago

      i didn’t expect you to know but did expect you to look it up lol: https://infogalactic.com/info/Web_crawler

      it sounded like they were just trying to make a program that would basically copy the contents of a site to archive it or save the site. like you might see on the wayback machine on archive.org

      • AliceOPMAEnglish
        2·
        1 year ago

        I should have. I’m being lazy sorry 😞 but why do they wanna do that though is my question

        • airrowEnglish
          2·
          1 year ago

          many uses. for going back to (like keeping back up copies). sometimes they use the data for different projects. idk

          • AliceOPMAEnglish
            1·
            1 year ago

            Come on. Tell me the cheese man O_O

            You guys know stuff ●_●