• airrow
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    i didn’t expect you to know but did expect you to look it up lol: https://infogalactic.com/info/Web_crawler

    it sounded like they were just trying to make a program that would basically copy the contents of a site to archive it or save the site. like you might see on the wayback machine on archive.org

    • AliceOPMA
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 year ago

      I should have. I’m being lazy sorry 😞 but why do they wanna do that though is my question

      • airrow
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 year ago

        many uses. for going back to (like keeping back up copies). sometimes they use the data for different projects. idk

        • AliceOPMA
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          Come on. Tell me the cheese man O_O

          You guys know stuff ●_●