[Audit] Re: Individual draft on resource accounting for agent runs: draft-arsentev-agent-run-metrics
Evgenii Arsentev <arsevgen22@gmail.com> Sun, 11 October 2026 09:35 UTC
Received: from mail-yw1-x112f.google.com (mail-yw1-x112f.google.com [IPv6:2607:f8b0:4864:20::112f]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by mx.ietf.org (Postfix) with ESMTPS id 6BDE546 for <audit@ietf.org>; Sun, 11 Oct 2026 09:35:21 +0000 (UTC)
Authentication-Results: mx.ietf.org; dkim=pass header.d=gmail.com header.s=20251104 header.b=OurUQLs3; arc=pass ("google.com:s=arc-20260327:i=1"); spf=pass (mx.ietf.org: domain of arsevgen22@gmail.com designates 2607:f8b0:4864:20::112f as permitted sender) smtp.mailfrom=arsevgen22@gmail.com; dmarc=pass (policy=none) header.from=gmail.com
Received: by mail-yw1-x112f.google.com with SMTP id 00721157ae682-8ad98c3fb15so6186367b3.2 for <audit@ietf.org>; Sun, 11 Oct 2026 02:35:21 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; t=1791711315; cv=none; d=google.com; s=arc-20260327; b=nQGI06k0gDoQ7LhFsOnsZubBL4fK9GzbfgKHfczvKx/iD/mYOpIgtGDWA/b4UvF+O/ Ne654lDPRFPOUiFhqwKnFRYlgSkwL4vCGvYkZ9bzqzi4kgzudDYGI81jtW6khmEeK6dO CSTbDVv3lfsKN09dZBEYTnNnPjxa6n30kdD/hADPwpdU+XRGryb+zOPKPlraMBzrpXV4 aUoLmrbtOk4bb0+bNkpYN2kX00AS5WsVOqrCESSI80OsSXqdHAKAqwfiGCyFrveSAO8T xNl4MbSv0Gn5Remz/bsArW7yzLx4TW/0ZdaPfnz4iVmm0IZIG2DAADsxKPDcdXdy5rqN 9wyA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=j1ULqM6JES9p/F/3mE6CrYq5j7z+LrKbndOjvm1W+6c=; fh=zyF0vWvfbhR8JuSorwSVRu2QP+CQyCYEo6obkxav0BA=; b=gg+cDjQ51Qra++PHS/46U0d4Bku7M3mVZK0syzZiZdsWA3MMNctAwheuybyBK6/+Ek 47AdvzOIYwgluTWmuHexIxjwvz2/CEDmityW88yemGdfiG64mXFEzo3iFikA//FtiFTF qaA6aEG+K4PK+cLXeVBCRhUfP5vkwW9iTz5IDrNe07hHXUMIqsgTs+151B6ggzt2ignF CZHgzN2bOL/2GlGxaWJl10rZPOnyy61ReHxwTzXdhM47J6YMgXDJ05NiIK5QUEbfJaS/ BcVdB3ZRxgwv8NIfbuXYBHy8K4On2XscylNH7QAaVJpq7FkAJawinY/O/0IdfERr35WW c9QA==; darn=ietf.org
ARC-Authentication-Results: i=1; mx.google.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1791711315; x=1792316115; darn=ietf.org; h=content-transfer-encoding:content-type:cc:to:subject:message-id :date:from:in-reply-to:references:mime-version:from:to:cc:subject :date:message-id:reply-to:content-type; bh=j1ULqM6JES9p/F/3mE6CrYq5j7z+LrKbndOjvm1W+6c=; b=OurUQLs3LI/X+95zOrDa7mKLZ1Iqip96FOrHPQPlfcbkniTrK8XHrkSfYQLhGfWIOt YpGdb9M+WGRxKiTFNaAv/bL6saRNR6z+6GA6W/cZcjGZ7b19MTZ1jvoW5/wYLXNhIaY4 hwBUbuffoVJCt6LR0atrgq+CQgBSLEWrgefYmh+kh2VMRl3lLyJHyeP1KbggVtBSG2I8 wwQjv8ox0/ZgDBxPZJvIoAQIplxy88bGPm5ho4z1ye2jBpY7V45/HWdvqI5/pOo8lHjl fHSg6sc4yTducmuTqN4J4pU8hl+ucpqicKCzRaj4ATsJ21MBU3rXS8A77rNPbuvSxZI6 obiA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20260707; t=1791711315; x=1792316115; h=content-transfer-encoding:content-type:cc:to:subject:message-id :date:from:in-reply-to:references:mime-version:x-gm-gg :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to :content-type; bh=j1ULqM6JES9p/F/3mE6CrYq5j7z+LrKbndOjvm1W+6c=; b=MugrhEItwScTZ8tvCOodaQhPwXoPaMPnKH5hGA27R3M2UhUJeuFPcuFwhJLWELIPEZ WB3ti/5lrBPOGJU9AGQtSZi8nnJ8ZB9GBShjcWy6BuTSnp9+SCZz4Hive22ByeMxlhfH +v/wU9Orjuyrc+TxkZoURU7VVi2wwkKksEFNoT6Yr9tk3Vk5H4srVVONUi0nD3Eoujtt VtJokujGP44rPWb4+xkZyvhcTgG5RBAa/d7D8jdIzItFM//f8J1MmSYzqdAPe9GqFURY pDYFZ+eN1rldrh+Cxs0kIAFbl7LFfvSllc3D/rKemCDCDAreAHubO3NsUjtHsNhVsdDi l8IA==
X-Gm-Message-State: AFq9FYIzKhgas2StVMjqsl+yVuAKLzH644pPfLIzbbSgmalIFWgpN1Bu 1QS0NIQl3d7HsoRY9kaG3b3LJyXOoFbLTWf+xUnvrIZ9NIvUMwKkKbtc3CbFUqLDYseu5QsOPxh GZT/zg1lTSQQhBVGCBX8Wb+kS/dA/rF0v7rhS
X-Gm-Gg: AYBFou0dUhmT5LbWs8ds55qzJPijk2PHKYrhxvs9WtBs9EADnIauQrj3PhHo2SG3XHI kEYO4TjBrhWU0DckK7jjC5I0S2yoa5C/F5/FrzD4Dyv21ssT3veFActjRhn4Ow6iIJFKkphRzbJ AiAbD+J67VSR+Q3S2C8btIUnpcwn93hqPpH5eT7X+PRgb7h7L+Yl4P1s1wGQrcErkvcQM33hq1I iHYCZ9prT6wUbENziCNHOIMSdB2eZgmvyw/D35iPKyKpactwyQPtFxU88BjTfHymTjCDWwvz7QZ a6pNyI09NzmWHjIZobG57qHlMiHVChcTcGAXPO7kna13qELivopCStpiuPkZRqoEsf2obP3oN6C MS2jyn9hUdQPkSfOtjdHHReyGVFQk86KyhJ/p0zZoYbimH/fpZ91GHhJtONTyi8Xn+QYGVQ==
X-Received: by 2002:a05:690c:387:b0:8a9:aa18:84ad with SMTP id 00721157ae682-8b07ee493a8mr27530747b3.32.1791711314795; Sun, 11 Oct 2026 02:35:14 -0700 (PDT)
MIME-Version: 1.0
References: <RD6CFDHBJUU4.BS0YPIMZWAB03@mailcore-bdb8b5d5f-f4kts>
In-Reply-To: <RD6CFDHBJUU4.BS0YPIMZWAB03@mailcore-bdb8b5d5f-f4kts>
From: Evgenii Arsentev <arsevgen22@gmail.com>
Date: Sun, 11 Oct 2026 12:35:04 +0300
X-Gm-Features: AclHuK8Clz9ju9VHsAxOzg-2xx_Fh4qng_Oh2opg2miTNqjOlHLbI64TmTrq3FA
Message-ID: <CAFF7QG=rgxfgmn5z7xfDXAfGRX1MrDdUqhqDpzVSQgwRJ-mt5w@mail.gmail.com>
To: Nicholas Templeman <nicholas@csoai.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Spamd-Bar: ---------------------------
Message-ID-Hash: H2JNKGZL5MW72TYY6ADZTJIH32DTKQ6X
X-Message-ID-Hash: H2JNKGZL5MW72TYY6ADZTJIH32DTKQ6X
X-MailFrom: arsevgen22@gmail.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; loop; banned-address; emergency; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: audit@ietf.org
X-Mailman-Version: 3.3.10
Precedence: list
Subject: [Audit] Re: Individual draft on resource accounting for agent runs: draft-arsentev-agent-run-metrics
List-Id: "Agent Use of Delegation and Interaction Traceability (AUDIT)" <audit.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/audit/kOaav_WJ-MUcKxs8C_sQLnoSH7c>
List-Archive: <https://mailarchive.ietf.org/arch/browse/audit>
List-Help: <mailto:audit-request@ietf.org?subject=help>
List-Owner: <mailto:audit-owner@ietf.org>
List-Post: <mailto:audit@ietf.org>
List-Subscribe: <mailto:audit-join@ietf.org>
List-Unsubscribe: <mailto:audit-leave@ietf.org>
Hi Nicholas, Thanks, this is helpful. I agree with all three points and I'll fold them into -02. On 3.6 - parent_run_id and root_run_id only say where a run's consumption is counted. They don't show that the child was allowed to act, and -02 will say so (that is a question for audit records, not for this format). The non-transitive totals stay as they are. A child that the parent's delegation step points to, but that has no report, will be treated as missing, not as zero. A collector that sums totals then has to mark the tree incomplete and list the missing run_ids. One thing I'd add - if the totals it does have already exceed the root's subtree_totals, that assertion is wrong whatever the missing child holds. On 9.1 - agreed. A signature binds the bytes and who signed them. It doesn't make the numbers checked. -02 will say that a signed report is still the reporter's statement, and that reconciliation with the provider (or an independent measurement) is a separate check. I'm thinking of an optional member that only points to a detached signed record (the format wouldn't define the record itself). Does that fit what you had in mind? On the example - yes, I think it would help, and I'd like to do it together. I can write the first version: a complete parent/child pair, a missing child report, an attempted double count and a namespace mismatch, each with the expected collector finding. I'll post it here as plain JSON first. If it holds up, it goes into -02 as an appendix with test vectors. The signed-record references I'd leave to you (I don't want to guess your format). I'd like to have -02 out before the IETF 127 draft deadline. Evgenii Arsentev On Sun, Oct 11, 2026 at 6:40 AM Nicholas Templeman <nicholas@csoai.org> wrote: > > Evgenii, all, > > The parent/root identifiers are useful for correlating a delegated run, but ancestry alone does not establish that the child had authority to perform an action. > > For accounting, I would preserve the distinction in section 3.6 between a run's own non-transitive totals and a root's subtree totals. A consumer should not add a root's subtree totals to the descendant reports again. A missing child report should remain missing coverage rather than be silently treated as a zero. > > Section 9.1 also matters: the report's values remain assertions of the reporter. A detached signed record can bind the asserted bytes and issuer, while provider reconciliation and independent measurement are separate checks. A signature alone cannot turn an asserted resource total into a verified provider bill. > > Would a small synthetic two-agent example help test these boundaries? The proposed cases would include a complete parent/child pair, a missing child report, an attempted double count, and a namespace mismatch, with explicit expected findings and detached signed-record references. That would be an interoperability proposal, not a claim that we have implemented or run it. > > Best, > > Nicholas Templeman > > Council of AI / CSOAI > > nicholas@csoai.org > > _______________________________________________ > Audit mailing list -- audit@ietf.org > To unsubscribe send an email to audit-leave@ietf.org -- Evgenii Arsentev, PhD Chief Executive Officer, digital health ORCID 0000-0002-9120-7298 · https://arsentev.ai
- [Audit] Individual draft on resource accounting f… Evgenii Arsentev
- [Audit] Re: Individual draft on resource accounti… Nicholas Templeman
- [Audit] Re: Individual draft on resource accounti… Evgenii Arsentev
- [Audit] Re: Individual draft on resource accounti… Nicholas Templeman
- [Audit] Re: Individual draft on resource accounti… Mirja Kuehlewind (IETF)
- [Audit] Re: Individual draft on resource accounti… Tom Sato