Claude Code reads AGENTS.md only when telemetry is on

(blog.szypowi.cz)

171 points | by pszypowicz 1 hour ago

22 comments

  • mpoteat 50 minutes ago
    Sorry folks, this is a rollout artifact, we needed a way to turn this off remotely via feature flags if it broke something, and with telemetry off you don't get those. It's already been fixed as part of v2.1.281 releasing today.

    The mod is source available here: https://github.com/anthropics/claude-code/tree/main/mods/age...

    Apologies again folks, this was a fully human error on my part - I should've found a better way to launch with a kill-switch.

    • mpoteat 45 minutes ago
      The AGENTS.md support was implemented via our new extensibility system for CC, called Mods, which is launching soon-ish. A mod is a plugin with a new type of hook, which we call a function hook.

      If folks play around with it, I would love feedback on the relevant issue: https://github.com/anthropics/claude-code/issues/91870

      Mods allow quite a bit more customizability and control. I really believe in the idea.

      • rickette 37 minutes ago
        The only difference between CLAUDE.md and AGENTS.md is the filename. Do you really need a whole plugin system to support that use case? Feels like this could have been a one line change.
        • xandrius 19 minutes ago
          Don't you run bizantine ralph loops on remote environments with codex security checks, coupled with jev, grok, open router and a fully independent openclaw (on a maxed out mac mini inside a caveau in an undisclosed location, with open telegram) to change constants? You're going to be left behind.
          • doublerabbit 12 minutes ago
            You sound like my type. hey, wanna come over to myspace so I could twitter your yahoo till you google all over my facebook?
        • pdpi 3 minutes ago
          The plugin system itself was probably already in the making, and they just chose to implement this tiny feature as a plugin to try it out.

          As for the only difference being the file name, that's an untested assumption. Up until now, Claude hadn't supported AGENTS.md, and it's a simple application of Hyrum's Law that somebody, somewhere, was taking advantage of that to give one set of instructions to Claude, and a different set of instructions to some other provider. The correct behaviour in the presence of both files is not obvious, either.

          Having a kill switch for the change is a perfectly reasonable safety measure in case something goes horribly wrong.

        • stingraycharles 23 minutes ago
          Yes, but at the same time, it’s also a good, simple use case to test a new plugin system. I can totally understand that.
        • locknitpicker 26 minutes ago
          > The only difference between CLAUDE.md and AGENTS.md is the filename. Do you really need a whole plugin system to support that use case? Feels like this could have been a one line change.

          I don't think this is a reasonable assumption. The document format in CLAUDE.md is whatever Anthropic specifies, where AGENTS.md is a common ground format that is expected to be supported by any agent, be it from Anthropic or not.

          https://agents.md/

          You might argue that differences are small or negligible, but that is just an expectation.

          • ljm 23 minutes ago
            It's not a format though is it? it's literally just an extension to the system prompt in plain markdown.

            There is no rhyme or reason to the structure of this file, just like with most things in AI. It's best effort human language.

          • BowBun 23 minutes ago
            I think you're giving these files too much credit. There are no specs, they are freeform text. In this sense they are the same. The expectation of what could be in it by each vendor means nothing unless it's enforced.
          • logifail 19 minutes ago
            > The document format in CLAUDE.md is whatever Anthropic specifies

            Q: Do Anthropic actually specify a document format?

        • oblio 29 minutes ago
          One line change? Pffft. That means you're still looking at the code, you're behind the times.
      • d5lt5 21 minutes ago
        Sounds like you've read the deepseek harness paper.
    • piltdownman 49 minutes ago
      Much respect for the prompt response, humility, and frank disclosure.
    • michaellee8 38 minutes ago
      Really loved this Tibo-level responsiveness, if Anthropic can keep it up with this level of service, I am pretty sure a lot of people will just ditch their ChatGPT subscription and just move to Claude.
      • d5lt5 25 minutes ago
        On the other hand, if Anthropic is to follow the industry standards, this would never have happened in the first place. It's not like the feature gates are the frontier of software development.
      • BowBun 22 minutes ago
        Because they respond to HN threads about their products? Which are likely Claude hooks monitoring for activity in the first place? Come on...

        At least make an argument for switching vendors based on the quality or price of their service.

      • irregularbowels 12 minutes ago
        [dead]
    • aviperl 35 minutes ago
      Ouch.

      I've had to send such messages, but internally at work, not on HN!

      Have a great day, human.

    • OtherShrezzing 33 minutes ago
      >Apologies again folks, this was a fully human error on my part

      Blink twice if you need help

    • senko 11 minutes ago
      I hope disabling /r if telemetry is disabled is also unintentional...
    • fg137 28 minutes ago
      > a fully human error

      Would be interesting to know how much time you/your team spent on that design decision

      • rachr 16 minutes ago
        The correct design was in the AGENTS.md but they didn't have telemetry on
    • grim_io 37 minutes ago
      The same guy writing readme's for my vibeslopped toy projects is also the readme writer at Anthropic, what a coincidence ;)
    • Maxion 37 minutes ago
      Well now, this is how you do community outreach
    • ndbe 45 minutes ago
      I don't understand, isn't coding solved already?
    • mort96 10 minutes ago
      "Rollout artifact"? This is Claude-speak isn't it? I have never ever heard anyone call a bug like this a "rollout artifact" before.
      • ako 7 minutes ago
        I was probably an agent that made the change, and the same agent that commented here on HN.
  • sandrello 59 minutes ago
    Based on my experience with these tools so far, this seems exactly the kind of subtle but extremely severe bug that sneaks in when you start piling up layers of AI generated patches to a codebase without caring too much about the code.
    • hgoel 53 minutes ago
      Yep, especially with long contexts (and moreso if the last thing you were working on in the same context involved telemetry too). AI sneaks in weird conditions like this and then does the entire "You're absolutely right" thing if you're paying enough attention to catch it.
    • HotHotLava 7 minutes ago
      "extremely severe" - aren't we laying it on a bit thick here? The whole impact seems to be that users who have telemetry turned off got this feature ~2 days later, when the bug was noticed.
    • Agentlien 30 minutes ago
      I used to actively use Msty for local models because it just worked and had a lot of nice advanced features. A few months ago they released their beta version of a Claw-like UI and mentioned using a version of it to develop Msty itself. Well, that was around the time I stopped using Msty because every update started breaking things and two updates in a row included bugs which wiped all my configs, chats, and history.
    • crazygringo 43 minutes ago
      It seems to be exactly the opposite, a "fully human error":

      https://news.ycombinator.com/item?id=49815363

      Nothing to do with AI patches at all, nor was it a bug. It was intentional human behavior, a temporary rollout setting, that seems to have made sense.

      But I guess that doesn't fit the "narrative".

      • fg137 2 minutes ago
        One thing I do know is that an Anthropic employee is definitely NOT going to blame this on the model they are using.
      • q3k 22 minutes ago
        > It seems to be exactly the opposite, a "fully human error"

        "LLMize the succeses, humanize the failures." is the PR strategy at play here. Anything goes well it's because AI did it, anything goes bad it's because a human didn't catch it.

      • ndbe 25 minutes ago
        [dead]
    • tpurves 30 minutes ago
      Except that, and this I find slightly amusing, is a situation where they definitely don't want to publicly blame the ai model when there are mistakes.
  • lucfranken 56 minutes ago
    Isn't that how they just release all features? So they can do progressive roll outs and telemetry on issues with it?

    Not sure if they later move the code from inside the flag check to the main code or that they keep the flag check.

    But if they would keep all features behind a flag that would not make most sense as you then would have not many features without telemetry.

    • nijave 8 minutes ago
      It's been like this at least months. I turned telemetry off a few months ago and it basically prevented all stages rollouts of new features from working.

      Anthropic commonly gates behind feature flags that require telemetry until they're "promoted" and defaulted on.

      A little bit annoying you can't manually control the flags without telemetry but I think the title is a bit click bait.

    • fg137 25 minutes ago
      This is what's written in their release notes for 2.1.277:

      > Added AGENTS.md support: in a project with no CLAUDE.md, Claude Code reads AGENTS.md instead

      My dumb brain tells me none of this is rolled out progressively (as of that version). You either have it or not.

  • fg137 3 minutes ago
    This in some way sounds like VSCode's bug of always adding Copilot as a co-author of git commit regardless of user settings.

    If people only glance over the code agents generate for them and don't bother to spend even half a minute thinking through what's actually happening, this is inevitable.

    Certainly this kind of things happened before LLMs existed. But I'm not optimistic about the direction of how things are going.

  • arrowsmith 46 minutes ago
    Claude Code also doesn't read AGENTS.md by default if there's a CLAUDE.md it can read instead. This isn't limited to your repo, e.g. if you have a ~/CLAUDE.md then no AGENTS.md will be read.

    To always read both, you have to switch the 'Project instructions' setting to the non-default `claude-md-and-agents-md`.

    Just in case anyone is wondering why their AGENTS.md still isn't being read.

  • nfRfqX5n 1 hour ago
    Crazy part is: can’t tell if this intended or a bug
    • serial_dev 59 minutes ago
      Someone on the Claude Code team is probably wondering the same...
    • kennethops 1 hour ago
      I like to give my graces to people and the companies who are typically not trillions of dollars. Have an incredible amount of resources that many countries would like to have, with fewer of the obligations. I'm going to chalk this up to its intended
    • vaylian 1 hour ago
      Can you think of a bug that makes sense in this case?
      • hgoel 1 hour ago
        Vibe coding
        • thejazzman 55 minutes ago
          It is most certainly the kind of subtle bug the LLMs love to slip in and burn you in production

          Not sure what y’all are thinking with these unwritten conspiracy theories that begin and end with “it’s intentional”

      • jpitz 1 hour ago
        Assuming that it's intentional, what's the motivation?
        • kriro 24 minutes ago
          Get more people to turn on telemetry.
    • Razengan 59 minutes ago
      Claude/Anthropic has been sus from the start:

      https://www.thatprivacyguy.com/blog/anthropic-spyware/

      + not letting users change their email, or remove their payment methods, etc.

      • nibbleyou 40 minutes ago
        I cannot set a password for login, on logging in it says we've sent a login code but it's a link instead...
      • jaapz 42 minutes ago
        many of these can also be chalked up to the fact that all of their products are extremely vibed
  • vorticalbox 55 minutes ago
    I use cursor and claude, its kinda annoying having to have the same skills in both so I made a ~/.agents/skills folder then ln both cursor and claude skills to point to that folder.

    which works except that claude uses .skills/synced which is uses to sync changes to skills from claude servers into the skills folder.

    every other agent I have used just directly syncs into .skills so it ends up duplicating skills

  • msp26 29 minutes ago
    Claude Code Remote control only works with telemetry enabled too.
  • tjoff 1 hour ago
    Nice find, though I'd rather read the prompt that was used to write this article. It is about ten times longer than it needs to and is quite painful to read.
  • teekert 51 minutes ago
    Uhm I turned off everything there is to turn off in my Pro plan, and Claude just read my agents.md with no issue? So... What telemetry am I missing? Or did they JUST update? (I updated my docker image 40 minutes ago to get Opus 5.5, am on version 2.1.280, so not the mentioned 2.1.277, so it's fixed?)
  • 0m13 54 minutes ago
    can i ask claude to change these settings for me, and will it enable telemetry as implied checkpoint when i ask it to enable AGENTS.md?
  • mgaldys4 47 minutes ago
    Even if this was an honest rollout mistake, the design is indefensible. Reading a local file should never depend on a remote feature flag, and silently skipping it with no warning is worse. I've tried to give Claude Code the benefit of the doubt, but this crosses a line.
    • tehlike 37 minutes ago
      Not everything is malicious. The author of the feature already responded on why this happened
  • cowpig 32 minutes ago
    The number of people raw-dogging software that executes arbitrary instructions on their machine coming from a 3rd party server just absolutely baffles me.

    The same people who've spent years of their career making sure that never happens.

  • pmlnr 31 minutes ago
    Urm... no tests caught this? How?
  • rvz 53 minutes ago
    I am once again (for the third time) [0] asking you to stop using a closed-source harness.

    [0] https://news.ycombinator.com/item?id=49760449

    • pbasista 23 minutes ago
      I understand the motivation for such a concern. But Claude Code in particular has its source code available on GitHub [0].

      So I am unsure if it is fitting to call it a "closed source" harness.

      [0] https://github.com/anthropics/claude-code

      • wccrawford 19 minutes ago
        It's not open source. It's more "source available", since it's published, but you legally can't do anything with it. Other than maybe build it yourself, for yourself, I guess.
  • chrisjj 1 hour ago
    Vibe-coding at its best.
  • lightchaser08 49 minutes ago
    [dead]
  • Ajjayaade 12 minutes ago
    [flagged]
  • Ajjayaade 13 minutes ago
    [flagged]
  • Traubenfuchs 57 minutes ago
    Issue 95690, opened 3 days ago, 500k+ engineers, a simple CLI...

    AGI was reached like 2 weeks ago, latest claude 5.x models rule supreme and oftware engineering is solved?

  • gmponyo 37 minutes ago
    This is not the only case where Anthropic has done stuff silently without giving users any information about changes that would hurt them.