Re: [CDNi] [E] Cache management interface | Triggers v2

Alan Arolovitch <alan@2you.io> Mon, 30 October 2023 09:22 UTC

Return-Path: <alan@2you.io>
X-Original-To: cdni@ietfa.amsl.com
Delivered-To: cdni@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8655DC14CE42 for <cdni@ietfa.amsl.com>; Mon, 30 Oct 2023 02:22:56 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.905
X-Spam-Level:
X-Spam-Status: No, score=-1.905 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=2you-io.20230601.gappssmtp.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ZzuKab-L-bLz for <cdni@ietfa.amsl.com>; Mon, 30 Oct 2023 02:22:52 -0700 (PDT)
Received: from mail-lf1-x132.google.com (mail-lf1-x132.google.com [IPv6:2a00:1450:4864:20::132]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4C2D9C1522D7 for <cdni@ietf.org>; Mon, 30 Oct 2023 02:22:48 -0700 (PDT)
Received: by mail-lf1-x132.google.com with SMTP id 2adb3069b0e04-507bd644a96so6089692e87.3 for <cdni@ietf.org>; Mon, 30 Oct 2023 02:22:48 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=2you-io.20230601.gappssmtp.com; s=20230601; t=1698657766; x=1699262566; darn=ietf.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=KISj89+akUO+04Z031mN/2ZXhulZMhWbTPgtTiOAnrA=; b=RREg9Am+Nzu8v0t9FzfHFV4BgR4LUxTb0XaHsmo6kf3D+gC1tXwvgDzhHDKaX6V2gj JquYn8s4HwZoftNu6vDMZmlR2Lr/5dNP11HClFsa0xkDU0fFKkOpE1lIRmdX7bw+DTWZ qI0eoqABFTZ9ruOk1JImO5PPos6bjiGAxpa9+5o0k2V87B0WDZYeWfejt/c5pN72J9uX TRA5qbNZnxgkPwY7/rIIlcIz1GUuG85NgWTZaelolNI9Io5mYu6BYdYeD0AV3FZtWUEf JtJxVEacvHhQBO5mifDEHaucZY2m0y9k+3rAVuVwLZkEZH52TqSiSaEZPMPFgM5ypSXe fZxA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1698657766; x=1699262566; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=KISj89+akUO+04Z031mN/2ZXhulZMhWbTPgtTiOAnrA=; b=DSWCrE5H0XxjK346AEfvQmmuXVwt4dlwedjL52siCQc/d2x1yLpr3A+HX1M05eeoUz NCIE+/tCz0Pw/z/tNiD8S2s5vzMrF8ldDSI3VB0DfSOd8LJFw6gz8grLhDlSD7G8bk0A enclgWe6nTHAb+JdlGpUaGe4IfHGsHSxrXIBPBaWutQ/N/1usSSMU2iflqVCg5C12hWZ DkjLdFgQNpD63D+t8fSeuhC11TDF3lhRaA0AjUV9cF0gFFp9jOwn3LprkJA5Ho+/+PIq BcyYrbW9PLYXgNCtqQlNZlhoi3gJ2lVL6WtSpGbXSxtOVRyXlDmV6ryJFNI8xYZJRxhL QDdQ==
X-Gm-Message-State: AOJu0YyFMe/J9g6Z8zv1e15Hu2pRUiETifNv12IoUM542Nojzd4gccSy 3LLumnl4dZfsyEHzEdaHkenC0tTzQZf6f66BbrTavA==
X-Google-Smtp-Source: AGHT+IGyRdID4j0obkcUsjuBXAhNIrfTSdfSz8YRGwo99ZJ0PJvKQRoU/JelN567J00m5+Rj93gp2VAJnUyJfRfOm30=
X-Received: by 2002:a05:6512:2525:b0:507:b7b7:e740 with SMTP id be37-20020a056512252500b00507b7b7e740mr11250195lfb.43.1698657765780; Mon, 30 Oct 2023 02:22:45 -0700 (PDT)
MIME-Version: 1.0
References: <F2A083C3-CD48-4D76-A27A-91F53717C99B@2you.io> <CA+EbDtAuzHP6MyGuotQn8jfRb+VAoFR6-4ai5KJVVq5Ef0DZeQ@mail.gmail.com>
In-Reply-To: <CA+EbDtAuzHP6MyGuotQn8jfRb+VAoFR6-4ai5KJVVq5Ef0DZeQ@mail.gmail.com>
From: Alan Arolovitch <alan@2you.io>
Date: Mon, 30 Oct 2023 05:22:34 -0400
Message-ID: <CANv64+5ZzmZRDPxEKY4f5Xw6xvHdR+7tBd6RcNiJLEiPWmkffQ@mail.gmail.com>
To: "Mishra, Sanjay" <sanjay.mishra@verizon.com>
Cc: cdni@ietf.org, Nir Sopher <nirsopher@gmail.com>
Content-Type: multipart/alternative; boundary="000000000000b983820608eb9407"
Archived-At: <https://mailarchive.ietf.org/arch/msg/cdni/Qfh9hZTQZlF-oJDW6OhWZins6Bw>
Subject: Re: [CDNi] [E] Cache management interface | Triggers v2
X-BeenThere: cdni@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: "This list is to discuss issues associated with the Interconnection of Content Delivery Networks \(CDNs\)" <cdni.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/cdni>, <mailto:cdni-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/cdni/>
List-Post: <mailto:cdni@ietf.org>
List-Help: <mailto:cdni-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/cdni>, <mailto:cdni-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 30 Oct 2023 09:22:56 -0000

Sanjay, Nir,
Thanks, see my comments below

Best regards
Alan

On Sun, Oct 29, 2023 at 5:09 PM Mishra, Sanjay <sanjay.mishra@verizon.com>
wrote:

> Hi Alan - Nir and I discussed your email below, and recommend the
> following:
>
>
>    1. For items 1 to 3 are new extensions you are proposing and those may
>    be just easy to define in a new draft.
>
> Sounds good, I'll work on the draft once we finalize the cache management
spec at SVTA.


>    1. For #4, this appears a heavy lift in the current draft as some of
>    the capabilities such as duration and recurrence and the RFC7265 brings
>    added complexity for dCDN and some dCDN may not support. It may be best to
>    leave Timepolicy as is defined in v2 but JCAL policy can be added in the
>    new draft.
>
> I can see that JCAL/iCalendar support can be somewhat of a lift, even
though there's a number of JCAL libraries out there.
At the same time, the TimePolicy extension in its current form is a partial
ad-hoc scheduling implementation, and should be obsoleted by RFC7265,
which is a well-established IETF standard with implementation base.
Do we want to release CI/T v2 that is obsolete at the time of release?
If dCDN doesn't support some advanced JCAL scheduling features like
recurrence, there's ample room to manage that using eextension error code
in Error.V2

>
>    1.  Items 5 & 6 to generalize playlist to an object list is reasonable
>    and we can add those in the next revision (v10) early Dec.
>
> Great, please let me know what is the best way to add those
In the spirit of iterative changes, I propose to consider three minor
features that may belong in the core CI/T v2 spec, rather than the cache
management extension:
- add trigger execution priority in Trigger.v2, to allow uCDN to introduce
urgent triggers
- add an optional object list to Trigger Status v2; this is to show to uCDN
how dCDN resolved playlist (aka objectlist) provided to it via
content.playlist(objectlist) spec
- add an optional object list to Error.v2
- update trigger spec objects that use URLs (which is all trigger specs
except for CCID) to add a field that indicates the type of URL to use -
published URL vs. cache key URL

If we do that, we can have a clean break between the core CI/T v2 draft on
hand, and 2 new drafts to be submitted later - cache management trigger
extensions and
cache management interface.
Also, this would be a higher priority than adding JCAL support to v10.

   1. For #7, can you provide more information as to what changes to error
   codes you are considering?

The only error code that we have for now is etimeout, to support TimePolicy

> Thanks
> Sanjay/NIr
>
> On Thu, Oct 26, 2023 at 1:26 PM Alan Arolovitch <alan@2you.io> wrote:
>
>>
>> Hello
>>
>> I'm leading the cache management interface project at SVTA. The scope is
>> to define a full-fledged CDNi-compliant cache management interface as part
>> of the open caching architecture
>> We are heading towards completion of the initial spec draft, and I would
>> like to share my thoughts on how to best bring this work into CDNi.
>> The current high-level scope includes:
>> - Trigger-based cache data operations that rely on and extend CDNi
>> triggers v2 as currently defined in CDNI CI/T 2nd edition
>> - Additional CDNi metadata objects allowing uCDN to assign cache objects
>> in configuration hierarchy to cache buckets; tag cache objects for use in
>> triggers via content.ccid trigger type; indicate cache object priority
>> - Cache bucket management API
>>
>> The current thinking is to split the work into two documents - one that
>> specifies extensions to triggers v2, and the other that pertains to cache
>> management specific metadata and related API.
>>
>> If so, would it make sense to incorporate the triggers v2 changes into
>> the current draft - all or some of them, or introduce them as a separate
>> document?
>>
>> The proposed triggers v2 change scope is as follows:
>> 1. New trigger extension PrepositionPolicy, per paragraph 8 of CDNI CI/T
>> v2, governing prepositioning policies like retry, patrial retrieval,
>> preposition methods, concurrency and bandwidth, and use of CDNi metadata
>> 2. New trigger extension PurgePolicy, governing purge semantics
>> 3. New trigger extension CommonPolicy, governing trigger execution
>> priority and type of URLs referenced in triggers (published vs. cache-key
>> URLs)
>> 4. Changes to trigger extension TimePolicy (8.2 in CDNi CI/T v2), adding
>> trigger execution scheduling, based on JSON-based iCAL [RFC7265], allowing
>> specifying start, stop, recurrence, duration, timezone etc.
>> 5. Changes of new content.playlist trigger spec(7.5.1 in CDNi CI/T v2) to
>> content.objectlist spec, in conjunction of introducing new types of object
>> list, in addition to hls, dash and mss types per 7.5.2 in CDNi CI/T v2,
>> allowing specifying lists of objects for trigger in JSON-encoded and plain
>> text formats
>> 6. Changes to Trigger Status Resource v2 (6.1.3 in CDNi CI/T v2) to
>> specify objectlists that were derived from content.objectlist triigger spec
>> 7. Changes to error codes in Error v2 to support the new extension
>> functionality
>>
>> One possible option is to incorporate changes to existing objects (items
>> 4-7) in the current draft, and defer the new trigger extensions (1-3) to a
>> separate document.
>>
>> Sanjay, Kevin,
>> I would appreciate some time in the open mic section in Prague to talk
>> about this
>>
>> Kind regards
>> Alan
>>
>>
>> _______________________________________________
>> CDNi mailing list
>> CDNi@ietf.org
>>
>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ietf.org_mailman_listinfo_cdni&d=DwIGaQ&c=udBTRvFvXC5Dhqg7UHpJlPps3mZ3LRxpb6__0PomBTQ&r=XniVbishGiO2Ao9hKqSc-hTVIWCi3T-x6GdHR4ZTgoM&m=klLmU7WL8P8gyd8m8z7YB4NCt4EbVkWgNY8xAAHx_jHe9zZVF9x85ykXTw7n3KgG&s=9VNsXLtJaYQ0fxZWKYHdXOx9VLDAIzhrpd1OxV4QrR8&e=
>>
>