Agent memory needs its OpenTelemetry moment

(lorekit.io)

13 points | by mthines 1 hour ago

11 comments

  • Fordec 19 minutes ago
    On the general premise, I agree. But I don't think that moment is today, not yet anyway. I don't think we understand the right way to approach context and memory yet or how long they should last for, never mind standardizing on an abstraction prematurely that ends up being like SOAP or SGML.
  • imgyuri 25 minutes ago
    The need for a unified format or spec is greatly reduced in the case of Agent memory because by definition it is read by agents, and agents are already instructed / programmed to read memory files of different formats. Even if such instructions did not exist, agents are extremely good at traversing files to get the necessary context it needs.
    • jstanley 21 minutes ago
      This is true and it probably is actually fine, but in a way you don't want it to be wasting its reasoning abilities and context window on figuring out which text files to read.

      It would be like trying to accomplish something as a human but all your reference material is always in a different format, it would be maddening.

  • hagen8 16 minutes ago
    Well, coding agents are smart, they can use all kinds of memory. A simple skill on how and when to access it is enough...
  • Implicated 18 minutes ago
    I decided long ago to not wait for you all to figure this out.

    Index it all. Embed it all. Give your agents the ability to query it all. Eval different configurations to figure out what works best for you.

  • slopinthebag 27 minutes ago
    at this point i'm pretty convinced agent memory is strictly harmful. it remembers the wrong things, and then turns them into an inane focus for each task. i disable it universally on every harness. if i want memory, i specifically instruct the agent to record findings into a file.
    • SwellJoe 24 minutes ago
      Same. Everybody builds one, and then eventually realizes it makes the model stupid and confused. The right solution is pretty much always developer documentation in the repo, in roughly the same shape you'd make developer docs for humans that you want to be able to get up to speed about your codebase really quickly.

      This has the benefit of being something you can easily read over every now and then to make sure the model hasn't baked in some random comment you made about a specific circumstance a month ago and made a weird religion out of it.

  • te_chris 30 minutes ago
    So we need another complicated format to store information so that the machines which read unstructured text can work with it?
  • monster_truck 20 minutes ago
    it's called a markdown file
  • drix10 2 minutes ago
    [dead]
  • ph4rsikal 3 minutes ago
    [flagged]
  • mthines 1 hour ago
    [flagged]