• dustycups@aussie.zone
      link
      fedilink
      arrow-up
      32
      ·
      2 天前

      …making AI/LLMs consume the entire Linux kernel README and associated documentation would increase token consumption

      • red_tomato@lemmy.world
        link
        fedilink
        arrow-up
        3
        arrow-down
        1
        ·
        2 天前

        Not necessarily. Input tokens is far cheaper than output tokens. The alternative is to have the LLM derive the documentation from code each session, which is expensive due to the amount of output tokens it produces.

        • dustycups@aussie.zone
          link
          fedilink
          arrow-up
          3
          ·
          2 天前

          Are people using LLMs to derive readme’s from source code!? I think they might be the target audience here.

          • red_tomato@lemmy.world
            link
            fedilink
            arrow-up
            3
            arrow-down
            1
            ·
            2 天前

            More like indirectly. For an LLM to effectively work with a codebase it needs to know how the project is structured and where to find stuff. Instead of having it derive this information each session, it can just read about it in the available documentation. It’s more token efficient.