• airrowEnglish
    2·
    1 year ago

    just a simple web crawler it sounds like

    • AliceOPMAEnglish
      2·
      1 year ago

      I’m retarded what is a web crawler? Like a bot that crawls the web for certain search terms?

      • airrowEnglish
        2·
        1 year ago

        i didn’t expect you to know but did expect you to look it up lol: https://infogalactic.com/info/Web_crawler

        it sounded like they were just trying to make a program that would basically copy the contents of a site to archive it or save the site. like you might see on the wayback machine on archive.org

        • AliceOPMAEnglish
          2·
          1 year ago

          I should have. I’m being lazy sorry 😞 but why do they wanna do that though is my question

          • airrowEnglish
            2·
            1 year ago

            many uses. for going back to (like keeping back up copies). sometimes they use the data for different projects. idk

            • AliceOPMAEnglish
              1·
              1 year ago

              Come on. Tell me the cheese man O_O

              You guys know stuff ●_●