Re: [Tsv-art] Tsvart telechat review of draft-ietf-sfc-oam-framework-13

"Frank Brockners (fbrockne)" <fbrockne@cisco.com> Fri, 22 May 2020 07:57 UTC

Return-Path: <fbrockne@cisco.com>
X-Original-To: tsv-art@ietfa.amsl.com
Delivered-To: tsv-art@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 281323A07CE; Fri, 22 May 2020 00:57:06 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -9.598
X-Spam-Level:
X-Spam-Status: No, score=-9.598 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=OO8hLwjK; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=OiQydBxk
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NRP6j8wpSf_B; Fri, 22 May 2020 00:57:02 -0700 (PDT)
Received: from rcdn-iport-1.cisco.com (rcdn-iport-1.cisco.com [173.37.86.72]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7D3233A0A13; Fri, 22 May 2020 00:57:02 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=46800; q=dns/txt; s=iport; t=1590134222; x=1591343822; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=hU4hRBw29bWAakARM+O8/qn8QEjJOokvi1Cvd8ieXS4=; b=OO8hLwjKk3ApURciXwnOTwG2EQ6oJ/LttjJF/guLMwH4p8rwXGEWkyVI CNzmmWPoxdTsBQ/aySSYJuuro0IhuMXFxud9CNm06NwOhhv7FQZHInIdD DuDmIz6oD5j0pEqLaZXtqLFLMF3DEhkRzp28GQgbgSBk+OM4eT1mfFN/9 E=;
IronPort-PHdr: 9a23:Cx97uB1aj5oFR3unsmDT+zVfbzU7u7jyIg8e44YmjLQLaKm44pD+JxWGuadmjUTCWsPQ7PcXw+bVsqW1X2sG7N7BtX0Za5VDWlcDjtlehA0vBsOJSCiZZP7nZiA3BoJOAVli+XzoOklOE8G4bFrX8TW+6DcIEUD5Mgx4bu3+Bo/ViZGx0Oa/s53eaglFnnyze7R3eR63tg7W8MIRhNhv
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0ChBQD/hMde/5NdJa1mHAEBAQEBAQcBARIBAQQEAQFAgUeBVFEHb1gvLAqEGoNGA41AgQGXO4FCgRADVQsBAQEMAQEjCgIEAQGERAIXggUkOBMCAwEBCwEBBQEBAQIBBQRthSoBBiUMhXIBAQEBAxIICQQNDAEBNwELBAIBCBEBAwEBAQICFQIPAgICMBUCBggCBAENBQgTB4MFgksDLgEOokoCgTmIYXZ/M4MBAQEFgTYCg2sYgg4JgQ4qgmOJXxqBQT+BEAFDgU9JNT6CZwEBAgGBOQ8cBR8SAiQCgjQzgi2ONAERBgkJKIJeiSOXI30KglSIKYYNikCCY4ESg2mEBpAYggKQTYFciBGTdAIEAgQFAg4BAQWBaSKBVnAVO4JpCUcYDYl9hC6CFQwXg0+FFIVCdAI1AgYBBwEBAwl8P4oCAiYHgQYBMF8BAQ
X-IronPort-AV: E=Sophos;i="5.73,420,1583193600"; d="scan'208";a="762777777"
Received: from rcdn-core-11.cisco.com ([173.37.93.147]) by rcdn-iport-1.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 22 May 2020 07:56:59 +0000
Received: from XCH-RCD-002.cisco.com (xch-rcd-002.cisco.com [173.37.102.12]) by rcdn-core-11.cisco.com (8.15.2/8.15.2) with ESMTPS id 04M7ux6J018442 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Fri, 22 May 2020 07:56:59 GMT
Received: from xhs-rtp-001.cisco.com (64.101.210.228) by XCH-RCD-002.cisco.com (173.37.102.12) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Fri, 22 May 2020 02:56:59 -0500
Received: from xhs-rtp-002.cisco.com (64.101.210.229) by xhs-rtp-001.cisco.com (64.101.210.228) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Fri, 22 May 2020 03:56:58 -0400
Received: from NAM10-MW2-obe.outbound.protection.outlook.com (64.101.32.56) by xhs-rtp-002.cisco.com (64.101.210.229) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Fri, 22 May 2020 03:56:58 -0400
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=O28SJp57ELq3TYH/04nMjD2WX2QRF6S02eV4d2tcSvlHfKusKjKXU0DAtLtDlNoKFALISvzZNtNnbAC9tBCF9iUgb2KL17lTQuijzb8sbUhM9noMda59YXytx1bZbVsfLuZFtMU5vsPrlmAhf+AdESv/Y8UN1geZGovBgSX8FXBiJjQVv69oibm+nARRXmsxlXPF3pauuRFm6ctNtJllFDNzVDHr314U7o2ahQqeTORZkpzxZI0nszFm909xIE+ecWKSEUCoXsRDDtEKzrGvUkGpvfymN9GXCvr2AJnxrcTEPtOiw5CsHCDvgpp1EtG27WRM8aC20oXQFeLSLM++6w==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=hU4hRBw29bWAakARM+O8/qn8QEjJOokvi1Cvd8ieXS4=; b=n5mjV98TeYFGJU/58pl9JOmX7+GfveEollDdoKJ9YPo0kAgq44NfRixc25CufrG4S4ED5qYEPx/0QYYW1Pa2ehLDCySqlOjDLJ+s3XBFyDt92jipZ79Sgsng+w1SWS00tlqN1+xp9svC+/elVPOpquUe/F4Kgb5WwS5lqGvaWMYeHaUMiWvILmoTOB+QL8K01DtWkKjs8XdQSAZGDVszA95Rbe0m1NcHqEpM+x38IXb9v3nekzUfNrXcnvOTW/YvBoyk/G1OqUL3c2bI2xnEn6LdyEoKBHs4FEK0sGiMI+zLWDP31zWaP5FDYFAdhrI+Cd5y/Oe4MYP3Lk+4L0VD9Q==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cisco.com; dmarc=pass action=none header.from=cisco.com; dkim=pass header.d=cisco.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector2-cisco-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=hU4hRBw29bWAakARM+O8/qn8QEjJOokvi1Cvd8ieXS4=; b=OiQydBxkJpnFmRC5V5y6kHIV4xnamRwvUUscqabCQ82QmpU9qDUCEmW1A+AufsEPK8nKZWjJF7FOH+N707x//x5iQ0W1KSXoBKZivI9M6sgkqlID+rVNbL8vLZFT2pB8RzRbKJ1f6DHyrsZTB+HbnMV4xOo1oBHxYlNiTSqJf4k=
Received: from BYAPR11MB2584.namprd11.prod.outlook.com (2603:10b6:a02:c8::31) by BYAPR11MB3798.namprd11.prod.outlook.com (2603:10b6:a03:b3::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3021.24; Fri, 22 May 2020 07:56:56 +0000
Received: from BYAPR11MB2584.namprd11.prod.outlook.com ([fe80::d8d7:dbc7:25a8:a4bd]) by BYAPR11MB2584.namprd11.prod.outlook.com ([fe80::d8d7:dbc7:25a8:a4bd%3]) with mapi id 15.20.3021.024; Fri, 22 May 2020 07:56:56 +0000
From: "Frank Brockners (fbrockne)" <fbrockne@cisco.com>
To: "Nagendra Kumar Nainar (naikumar)" <naikumar@cisco.com>, "tsv-art@ietf.org" <tsv-art@ietf.org>
CC: "sfc@ietf.org" <sfc@ietf.org>, "last-call@ietf.org" <last-call@ietf.org>, "draft-ietf-sfc-oam-framework.all@ietf.org" <draft-ietf-sfc-oam-framework.all@ietf.org>
Thread-Topic: Tsvart telechat review of draft-ietf-sfc-oam-framework-13
Thread-Index: AQHWK4yQC3PtyMib00yLrf+zBdIUqaixLdAQgABOAwCAAkULcA==
Date: Fri, 22 May 2020 07:56:55 +0000
Message-ID: <BYAPR11MB25849074354037D3E2C9B21BDAB40@BYAPR11MB2584.namprd11.prod.outlook.com>
References: <158861910132.5213.12389985411421411727@ietfa.amsl.com> <B12ACAA0-BFBC-40D6-85D2-A7E056027C68@cisco.com> <BYAPR11MB2584D5A59E020682810099EFDAB60@BYAPR11MB2584.namprd11.prod.outlook.com> <C365E033-24A0-43D0-A02B-573E58C5107E@cisco.com>
In-Reply-To: <C365E033-24A0-43D0-A02B-573E58C5107E@cisco.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: cisco.com; dkim=none (message not signed) header.d=none;cisco.com; dmarc=none action=none header.from=cisco.com;
x-originating-ip: [173.38.220.51]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 71276aa0-3799-4210-7826-08d7fe25b2b3
x-ms-traffictypediagnostic: BYAPR11MB3798:
x-ms-exchange-transport-forked: True
x-microsoft-antispam-prvs: <BYAPR11MB379876A6861666500841E500DAB40@BYAPR11MB3798.namprd11.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:9508;
x-forefront-prvs: 04111BAC64
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: taj8mS612J7T0pAI43GdfF7vLMiijrUjL0wynYj/95Q2Jr1G5V3+C+25oC+Nsrvfbeg5snAiBPbKd2eYF7uynHRIMF9UljPlhQUgypC0oMePkT7o/Rluh8Fc1jNhk3HO/q7D8SbbrksIdqMd/3cR0Evn9m8JfJzDjIMmB1OdtFrYSdlU2rCnjKXLgBHnpiTnQ/IojNjsgU9HLOzXVXlrgXQI22zA1+I5OWrkIoox45mSiew10CfhRL759EWUgmRKWJTKbcHeLk6ulADCaf2+7Pq2O0w8Z9zaqWLOFfnY02Z40QV7qZsf7tlk6IDxtdRqoL3a2VQu+oPAC8uuuwSGhfPBmrJ7eCdkkYxPC/fmLZnBaVqGUFWvvXlPNXbHnifycvF+mWwvNSoPetDMhWYRDA==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BYAPR11MB2584.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(4636009)(396003)(376002)(346002)(136003)(39860400002)(366004)(5660300002)(86362001)(8676002)(83080400001)(7696005)(26005)(316002)(53546011)(30864003)(110136005)(8936002)(186003)(54906003)(6506007)(33656002)(66476007)(71200400001)(66946007)(52536014)(64756008)(478600001)(66446008)(55016002)(966005)(450100002)(4326008)(76116006)(2906002)(9686003)(66556008)(579004)(559001); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata: qmlqXhwbZwqV5R2myIBvsN9QzNSAxJRMsygUzovT7mDwGWXhJDoFIxX757cAWINotdRllHKJs7PQA0WzLS1FCNyKIEO8fcRWTPcgmyEtZ8D7S3vfBmZLl6qcT4M96VDsvrONzM8UhlvWhJbZFl0lGfPKrMzCOrx5QudnHGIcq544w5Avy/WyoN7kLDuaKYpXO4pqrnRd0MDTcAFtItzlDJIKUMOueBKoX7DRvzMGAREY2ihJFSowCbtSUMfbI1UaGLSVcmgP4muSVd2WsoRKWwJAhuZL7BXx9hc4J4+KOfhOZ8ObmAb9QAK1w/hpkaGRkZ889X0yBeY66+/c/AYq8pLiWX6vR5jjJtqWJQ2iHlFoPUNu8JkT4y/aMrk2sToGp4uYGnoaHOf3vFwlfiqLBDId0JCZ7QsI/uikeUDQ/aMW2+O1q3Okm1LtoeJGGfnPbBKS1lUjbEux+0QcEnjR8bcqeMjbK2BmyYwm7ZzVqyg=
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 71276aa0-3799-4210-7826-08d7fe25b2b3
X-MS-Exchange-CrossTenant-originalarrivaltime: 22 May 2020 07:56:55.8867 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: DFrcA8oUOJYmBpBatXvfoFaJLfDv1CBjrjjeFX9KB1DbWEkK6Qn3S3OF3Jm2zD0VTJxpkZN3Fddx24gHUrJW1w==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR11MB3798
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.37.102.12, xch-rcd-002.cisco.com
X-Outbound-Node: rcdn-core-11.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/tsv-art/mTM8LwunRSWJ2s7PzCiSM-2JLNc>
Subject: Re: [Tsv-art] Tsvart telechat review of draft-ietf-sfc-oam-framework-13
X-BeenThere: tsv-art@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Transport Area Review Team <tsv-art.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tsv-art>, <mailto:tsv-art-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tsv-art/>
List-Post: <mailto:tsv-art@ietf.org>
List-Help: <mailto:tsv-art-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tsv-art>, <mailto:tsv-art-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 22 May 2020 07:57:07 -0000

Hi Nagendra,

Thanks - please see inline (...FB2)

> -----Original Message-----
> From: Nagendra Kumar Nainar (naikumar) <naikumar@cisco.com>
> Sent: Mittwoch, 20. Mai 2020 22:59
> To: Frank Brockners (fbrockne) <fbrockne@cisco.com>; tsv-art@ietf.org
> Cc: sfc@ietf.org; last-call@ietf.org; draft-ietf-sfc-oam-framework.all@ietf.org
> Subject: Re: Tsvart telechat review of draft-ietf-sfc-oam-framework-13
> 
> Hi Frank,
> 
> Thank you for the response. Please see inline for <Nagendra2>
> 
> On 5/20/20, 1:10 PM, "Frank Brockners (fbrockne)" <fbrockne@cisco.com>
> wrote:
> 
>     Hi Nagendra,
> 
>     Thanks for the detailed reply. Please see inline (..FB).
> 
>     > -----Original Message-----
>     > From: Nagendra Kumar Nainar (naikumar) <naikumar@cisco.com>
>     > Sent: Samstag, 16. Mai 2020 16:16
>     > To: Frank Brockners (fbrockne) <fbrockne@cisco.com>; tsv-art@ietf.org
>     > Cc: sfc@ietf.org; last-call@ietf.org; draft-ietf-sfc-oam-
> framework.all@ietf.org
>     > Subject: Re: Tsvart telechat review of draft-ietf-sfc-oam-framework-13
>     >
>     > Hi Frank,
>     >
>     > Thank you for the review. Please see inline for the response..
>     >
>     >
>     >     Reviewer: Frank Brockners
>     >     Review result: Ready with Nits
>     >
>     >     This document has been reviewed as part of the transport area review
> team's
>     >     ongoing effort to review key IETF documents. These comments were
> written
>     >     primarily for the transport area directors, but are copied to the
> document's
>     >     authors and WG to allow them to address any issues raised and also to the
>     > IETF
>     >     discussion list for information.
>     >
>     >     When done at the time of IETF Last Call, the authors should consider this
>     >     review as part of the last-call comments they receive. Please always CC
>     >     tsv-art@ietf.org if you reply to or forward this review.
>     >
>     >     This document provides a reference framework for OAM for SFC.
>     >
>     >     Comments:
>     >
>     >     Section 3.1.1 SF availability: The text makes explicit reference to multiple
>     >     instances of a SF. Consequently, it should be defined how availability of a
> SF
>     >     is computed/determined in case multiple instances are deployed.
>     >
>     > <Nagendra> This is already clarified in the section as below:
>     >
>     > "For cases where
>     >    multiple instances of an SF are used to realize a given SF for the
>     >    purpose of load sharing, SF availability can be performed by checking
>     >    the availability of any one of those instances, or the availability
>     >    check may be targeted at a specific instance."
>     >
>     > This further
>     >     leads to the question, whether availability is always a "binary" state
>     >     (available / not-available), or could a SF be e.g. 99% available?
>     >
>     > <Nagendra>The availability is measured as binary state. I am not sure what
> is
>     > 99% available. If it means getting 99 responses for 100 probes sent, I think it
>     > falls under packet loss category which in turn is performance measurement.
> 
>     ...FB: Thanks. Though I'm still not entirely following. If availability is binary and
> I put the statements above together, what would be the availability of the
> following setup: There is an SF that is made up of 100 instances. 99 of these
> instances are powered down entirely. And the 1 instance that is "up" is
> alternating between servicing requests for 10min followed by not servicing
> requests for 10min. Would the SF be considered "available"?
> 
> <Nagendra2> As mentioned in the draft, SF availability can be performed by
> checking the availability of any one instance (if the intention is to verify if there
> is at least one instance of the SF is up) or to one or more specific instances of
> the SF. If you intend to verify all 100, the availability should be performed for
> each such specific instance.
> 
>     >
>     > Section 3.1.2
>     >     SF performance: What is the impact of a "multiple instance SF
> deployment" on
>     > SF
>     >     performance measurement?
>     >
>     > <Nagendra>I think we covered this in SF availability but not here. Does the
>     > below updated text look better?
>     >
>     > OLD:
>     > On the one hand, the performance of any specific SF can be quantified
>     >    by measuring the loss and delay metrics of the traffic from SFF to
>     >    the respective SF, while on the other hand, the performance can be
>     >    measured by leveraging the loss and delay metrics from the respective
>     >    SFs.  The latter requires SF involvement to perform the measurement
>     >    while the former does not.
>     >
>     > NEW:
>     > On the one hand, the performance of any specific SF can be quantified
>     >    by measuring the loss and delay metrics of the traffic from SFF to
>     >    the respective SF, while on the other hand, the performance can be
>     >    measured by leveraging the loss and delay metrics from the respective
>     >    SFs.  The latter requires SF involvement to perform the measurement
>     >    while the former does not. For cases where
>     >    multiple instances of an SF are used to realize a given SF for the
>     >    purpose of load sharing, SF performance can be quantified by measuring
>     >    the metrics for any one instance of SF or by measuring the metrics for
>     >    a specific instance.
>     >
>     > The section only talks about loss and delay as
>     >     performance criteria. It would be good to state that other performance
>     > criteria
>     >     (e.g. specific to the SF, throughput, etc.) exist.
>     >
>     > <Nagendra> We can add the below to Section 3.1.2:
>     >
>     > NEW:
>     > "The metrics measured to quantify the performance of the SF component is
> not
>     > just limited to loss and delay. Other metrics such as throughout also exist
> and
>     > the choice of metrics for performance measurement is outside the scope of
> this
>     > document."
>     >
>     > Section 3.2.1 SFC
>     >     availability: The current definition is very focused on connectivity
>     >     verification, i.e. it tries to answer the question: "Does my SFC transport
>     >     packets?". IMHO we should also ask the question "Does my SFC process
> the
>     >     packets correctly?" - because if packets are not processed per the SFC
>     >     definition, we might not call the SFC available.
>     >
>     > <Nagendra> I think this is already handled by SF availability. The end-to-end
> SFC
>     > availability is verified by steering the OAM packet over the ordered set of SFs
>     > within the SFC. This is more like daisy chaining the availability of SFs within
> the
>     > SFC to determine end-to-end SFC availability. If the derived solution verifies
> the
>     > SF availability not just based on the uptime but based on the service
> treatment, it
>     > also answers the question "Does my SFC process the packets correctly". Let
> us
>     > know if there is any further clarity required.
>     >
>     > While 3.2.2 states that "any
>     >     SFC-aware network device should have the ability to make performance
>     >     measurements" a similar statement isn't found in 3.2.1. IMHO the ability
> for
>     >     availability checks is probably a prerequisite for performance
> measurement.
>     >
>     > <Nagendra> The ability to perform end-to-end or partial SFC availability
>     > verification is already mentioned in section 3.2.1 as below:
>     >
>     > " In order to perform service connectivity verification of an SFC/SFP,
>     >    the OAM functions could be initiated from any SFC-aware network
>     >    devices of an SFC-enabled domain for end-to-end paths, or partial
>     >    paths terminating on a specific SF, within the SFC/SFP"
>     >
>     > Please let us know if you have any suggestion to improve if there is a lack of
>     > clarity.
>     >
>     >     Section 3.2.2 SFC performance measurement: The section only mentions
> the
>     > need
>     >     for performance measurement. It misses the definition of what SFC
>     > performance
>     >     measurement is.
>     >
>     > <Nagendra>
> 
>     ...FB: Thanks for the suggested updates, which would definitively improve the
> text. One problem about SFC performance remains though IMHO.
>     All the text so far is focused on the connectivity within a SFC - not the service
> itself. I.e. If you'd consider a "laundry service" - we focus a lot on how long it
> takes to get the clothes shipped to and from the washing machine, but we don't
> focus on how well the washing machine washes the clothes.
>     IMHO we should either expand on the performance of the SFC and SF wrt/ the
> service (especially given that you define a service layer in section 2) - or clearly
> state that the framework would just focus on connectivity between SFs.
> 
> <Nagendra2> I am skipping this as this point is being discussed in a different
> thread.
> 
> 
>     >
>     > Section 3.3. Classifier component: The section mentions the
>     >     need for the ability to perform performance measurement of the classifier
>     >     component. What is performance measurement of the classifier? What
> does
>     >     performance measurement of the classifier component comprise?
>     >
>     > <Nagendra>We can add the below text:
>     >
>     > OLD:
>     > Any SFC-aware network device should have the ability to perform
>     >    performance measurement of the classifier component for each SFC.
>     >
>     > NEW:
>     > Any SFC-aware network device should have the ability to perform
>     >    performance measurement of the classifier component for each SFC.
>     >     The performance can be quantified by measuring the performance metrics
> of
>     > the
>     >      traffic from the classifier for each SFC/SFP.
>     >
>     > Section 3.4. /
>     >     3.5. Availability/PM of the underlay and overlay network: It would be
> good to
>     >     add a sentence that states that the mechanisms for availability/PM which
> are
>     >     offered by the technologies used by the overlay/underlay are used, rather
>     > than
>     >     new methods specifically for SFC would be defined.
>     >
>     > <Nagendra>Yes, that makes sense. Please check the below text:
>     >
>     > OLD:
>     > Any SFC-aware network device may have the ability to perform
>     >    availability check or performance measurement of the overlay network.
>     >
>     > NEW:
>     > Any SFC-aware network device may have the ability to perform
>     >    availability check or performance measurement of the overlay network.
> Any
>     >    existing OAM tools and techniques can be leveraged for this purpose.
>     >
>     > Section 4. SFC OAM
>     >     Functions: It would be good, if examples in section 4 could also include
> more
>     >     "recent" methods such as OWAMP/TWAMP (RFC4656, RFC 5357).
>     >
>     > <Nagendra>
>     >
>     > OLD:
>     > Delay within an SFC could be measured based on the time it takes for
>     >    a packet to traverse the SFC from the ingress SFC node to the egress
>     >    SFF.  As SFCs are unidirectional in nature, measurement of one-way
>     >    delay [RFC7679] is important.  In order to measure one-way delay,
>     >    time synchronization MUST be supported by means such as NTP, PTP,
>     >    GPS, etc.
>     >
>     > NEW:
>     > Delay within an SFC could be measured based on the time it takes for
>     >    a packet to traverse the SFC from the ingress SFC node to the egress
>     >    SFF.  Measurement protocols such as One-way Active Measurement
>     >     Protocol (OWAMP) [RFC4656], Two-way Active Measurement Protocol
>     >    (TWAMP) [RFC5357] can be used to measure the characteristics. As
>     >    SFCs are unidirectional in nature, measurement of one-way
>     >    delay [RFC7679] is important.  In order to measure one-way delay,
>     >    time synchronization MUST be supported by means such as NTP, Precision
>     > Time Protocol (PTP),
>     >    GPS, etc.
>     >
>     > Section 4.4.
>     >     Performance Measurement: Focus is entirely on the PM of the
> connectivity,
>     >     rather than on the SF. How about covering PM for the SF as well?
>     >
>     > <Nagendra> I am not sure I understand what is missing. Do you have any
>     > suggestion for the text improvement?.
> 
>     ...FB: See above. This would be about adding a capability to assess how well
> the washing machine washes my laundry.
> 
>     >
>     > Section 5.1
>     >     OAM Tool Gap Analysis:
>     >      - Not sure what "NVo3 OAM" refers to. Could that be explained below the
>     > table
>     >      and in section 1.2.1?
>     >
>     > <Nagendra> Combining this with other below queries as they appears to be
>     > related.
>     >
>     > - E-OAM needs to be detailed. Is seems that CFM
>     >      (802.1ag) and not 802.3ah is refered to here.
>     >
>     > <Nagendra> Per my understanding, 802.ah is 1-hop while 802.3ag can be
> more
>     > than 1 hop and both uses Ethernet frames. So I think both are applicable
> here.
>     > My response regarding E-OAM details in this section is combined below.
> 
>     ...FB: Maybe I missed it - but I don't see text that refers to CFM or EFM OAM.
> Where is this covered? IMHO we would need references to IEEE standards to
> avoid confusion.
> 
> <Nagendra2>Ok. Instead of defining the specific clauses, we can refer Y1731.
> Hope that is fine with you.

...FB2: We can add Y.1731 as well. But let's make sure we also refer to the related IEEE standards.


> 
>     >
>     > - "Trace" in the "Trace" column
>     >      need to be extended on. Is this traceroute? Paris-Traceroute? IOAM-
>     > Loopback?
>     >
>     >      IPPM needs to be detailed, because IPPM is not a tool as such but an IETF
>     > WG.
>     >      Does this refer to OWAMP/TWAMP/etc. as defined by IPPM?
>     >
>     > <Nagendra> Combining the above queries.
>     >
>     > OLD:
>     > There are various OAM tool sets available to perform OAM functions
>     >    within various layers.  These OAM functions may be used to validate
>     >    some of the underlay and overlay networks.  Tools like ping and trace
>     >    are in existence to perform connectivity check and tracing of
>     >    intermediate hops in a network.  These tools support different
>     >    network types like IP, MPLS, TRILL, etc.  There is also an effort to
>     >    extend the tool set to provide connectivity and continuity checks
>     >    within overlay networks.  BFD is another tool which helps in
>     >    detecting data forwarding failures.  Table 3 below is not exhaustive
>     >
>     > NEW:
>     > There are various OAM tool sets available to perform OAM functions
>     >    within various layers.  These OAM functions may be used to validate
>     >    some of the underlay and overlay networks.  Tools like ping and trace
>     >    are used to perform connectivity check and tracing of
>     >    intermediate hops in a network.  These tools are already available for
>     >    different types of networks such as IP, MPLS, TRILL, etc.
>     >
>     > E-OAM offers OAM mechanisms such as an Ethernet continuity check for
>     > Ethernet links. There is an effort around NVO3 OAM to provide connectivity
> and
>     > continuity checks for networks that use NVO3.  BFD is used for the detection
> of
>     > data plane forwarding failures.
> 
>     ...FB: Check whether NVO3 WG will indeed deliver a solution and "NVO3
> OAM" indeed existis. If in doubt, it might be better to avoid forward looking
> references. Per my note above, it would be good to explicitly refer to IEEE
> standards as opposed to introducing a new term like "E-OAM".
> 
> <Nagendra2> Ok. Noted.
> 
>     >
>     > The IPPM framework [RFC 2330] offers tools such as OWAMP [RFC4656]
> and
>     > TWAMP [RFC5357] (collectively referred as IPPM in this section) to measure
>     > various performance metrics. MPLS Packet Loss Measurement (LM) and
> Packet
>     > Delay Measurement (DM) (collectively referred as MPLS_PM in this section)
>     > [RFC6374] offers the ability to measure performance metrics in MPLS
> network.
>     >
>     > Table 3 below is not exhaustive.
>     >
>     > Section 6.4.3 IOAM:
>     >     - The section states that IOAM "may be used to perform various SFC OAM
>     >     functions as well". It would be good to expand on this statement: E.g.
> IOAM
>     >     Trace-Option Type could be leveraged for SFC tracing. IOAM Direct-Export
>     > Option
>     >     Type could be leveraged. - How would we deal with the IOAM Active Flag
>     >     (draft-ietf-ippm-ioam-flags-01) when used with SFC OAM?
>     >
>     > <Nagendra> The intention of the section is to highlight the applicability of
>     > different OAM toolsets for OAM functions at service layer. I am not sure if
> we
>     > really should try explaining all the possible options within each tool. But I
> agree
>     > that it is worth clarifying the availability of IOAM options for tracing. think
> we
>     > can clarify that different IOAM Option-Types are available for OAM
> functions
>     > such as SFC tracing. Can you check if the below looks ok?
>     >
>     > OLD:
>     > [I-D.ietf-sfc-ioam-nsh] defines how In-Situ OAM data fields are
>     >    transported using NSH header.  [I-D.ietf-sfc-proof-of-transit]
>     >    defines a mechanism to perform proof of transit to securely verify if
>     >    a packet traversed the relevant SFP or SFC.  While the mechanism is
>     >    defined inband (i.e., it will be included in data packets), it may be
>     >    used to perform various SFC OAM functions as well.
>     >
>     > NEW:
>     > [I-D.ietf-sfc-ioam-nsh] defines how In-Situ OAM data fields are
>     >    transported using NSH header.  [I-D.ietf-sfc-proof-of-transit]
>     >    defines a mechanism to perform proof of transit to securely verify if
>     >    a packet traversed the relevant SFP or SFC.  While the mechanism is
>     >    defined inband (i.e., it will be included in data packets), IOAM Option-Types
>     >   such as IOAM Trace Option-Types can also be used to perform other SFC
> OAM
>     > function
>     >   such as SFC tracing.
>     >
>     > - The text states
>     >     "In-Situ OAM could be used with O bit set": Why would IOAM be used with
> the
>     >     overflow bit set for SFC OAM? For details on IOAM's O-bit, see section
> 4.4.1 in
>     >     https://tools.ietf.org/html/draft-ietf-ippm-ioam-data-09.
>     >
>     > <Nagendra> The O bit referred here is not the O bit in IOAM but the one in
>     > NSH/Overlay header. To avoid any confusion, this can be updated as below:
>     >
>     > OLD:
>     > In-Situ OAM could be used with O bit set to perform SF availability
>     >    and SFC availability or performance measurement.
>     >
>     > NEW:
>     > In-Situ OAM could be used with O bit in the overlay header set, to perform
> SF
>     > availability
>     >    and SFC availability or performance measurement.
> 
>     ... FB: Ah, ok. Given that this section is about IOAM and not NSH, I'd rather
> explicitly refer to NSH here. E.g. If SFC is realized using NSH, then the O-bit in the
> NSH header could be used to indicated OAM traffic. You could refer to
> https://tools.ietf.org/html/draft-ietf-sfc-ioam-nsh-03#section-4.2 explicitly.
> 
> <Nagendra2> Ok. Below is the updated text capturing the same:
> 
> NEW:
> In-Situ OAM could be used with O bit in the overlay header set, to perform SF
> availability  and SFC availability or performance measurement. For example, if
> SFC is realized using NSH, the O-bit in the NSH header could be set to indicate
> the OAM traffic as defined in Section 4.2 [I-D.ietf-sfc-ioam-nsh].

...FB2: IMHO the first sentence is still confusing, because you implicitly assumes that the overlay has an "O-Bit" (which is the case if you use NSH - but that does not have to be the case). Plus, the fact that IOAM also has an O-Bit with a very different definition, adds to potential confusion (you at least confused me).

How about:

In-Situ OAM could be leveraged to perform SF availability  and SFC availability or performance measurement. For example, if SFC is realized using NSH, the O-bit in the NSH header could be set to indicate the OAM traffic as defined in Section 4.2 [I-D.ietf-sfc-ioam-nsh].



> 
>     >
>     > Section 6.4.4 SFC
>     >     Traceroute: - This section refers to an expired draft (even calling out the
>     >     fact that the draft has exipred), but also mentions that functionality is
>     >     available and implemented in OpenDaylight. Consider removing the
> references
>     > to
>     >     the expired draft and rather add references to OpenDaylight documents. -
>     > IOAM
>     >     Loopback (see draft-ietf-ippm-ioam-flags-01) could apply SFC Traceroute
> as
>     > well.
>     >
>     > <Nagendra>Ok. Let me check if I can find some reference for ODL.
>     >
>     >     Detailed set of nits that I encountered while reading through the
> document
>     > ([x]
>     >     references line number x) – hope that they are helpful in further improving
> the
>     >     doc:
>     >
>     > <Nagendra> Yes of course (.
>     >
>     >     [global] s/an SF/a SF/ -- and similarly SFC/SFF
>     >
>     > <Nagendra>Other RFCs uses "an SF/SFF". So the draft is updated
> accordingly. If
>     > your suggestion is to substitute "a SF" to "an SF",  it is done (.
>     >
>     >     [176] "OAM Controller" not defined
>     >
>     > <Nagendra>We can change it as below:
>     >
>     > OLD:
>     > OAM controllers are assumed to be within the same administrative
>     >    domain as the target SFC enabled domain.
>     >
>     > NEW:
>     > OAM controllers are SFC-aware network devices that are capable of
> generating
>     > OAM packets. They are assumed to be within the same administrative
> domain as
>     > the target SFC enabled domain.
>     >
>     >     [202] Why just Virtual Machines and no containers? Suggest to make
> things
>     >     generic and talk about virtual and physical entities.
>     >
>     > <Nagendra> We changed this as virtual entities.
>     >
>     >           This comment applies throughout the document.
>     >     [216] Ethernet OAM: Add reference. Do you refer to physical layer
> Ethernet
>     > OAM
>     >     (802.3ah) or CFM (802.1ag)?
>     >
>     > <Nagendra> The response was provided in the above comment section.
>     >
>     > [243] s/uses the overlay network/uses the overlay
>     >     network layer/
>     >
>     > <Nagendra> Done.
>     >
>     > [246] Could we add a few examples of "various overlay network
>     >     technologies"? For the underlay network layer several examples are listed.
>     >
>     > <Nagendra> Ok.
>     >
>     >     [248] What does "mostly transparent" mean?
>     >
>     > <Nagendra> The data plane elements connecting the overlay layer nodes
> may
>     > not always process the overlay header.
> 
>     ...FB: How about we explain this in the document?
> 
> <Nagendra2>Below is the updated text:
> 
> OLD:
> This layer is mostly
>       transparent to the SFC data plane elements .
> 
> NEW:
> This layer is mostly
>       transparent to the SFC data plane elements as not all the data plane
> elements process the overlay header.
> 
>     >
>     > [254] What does "tight coupling"
>     >     between the link layer and the physical technology mean?
>     >
>     > <Nagendra>I am not sure I understand the nit here. Do you see any difficulty
> in
>     > parsing the sentence?
> 
>     ...FB: Not sure what "tight coupling" means here. Could you clarify what is
> "tight coupling" vs. "not tight coupling"?
> 
> <Nagendra2> "tightly vs loosely" coupled normally denotes the dependency (.
> Based on another reviewer's comment, we agreed to modify the relevant text as
> shown below. Does it look better?
> 
> NEW:
> o  The link layer, which is tightly coupled with the physical layer
>       technology used.  Ethernet is a popular choice for this layer, but
>       other alternatives are deployed (e.g.  POS, DWDM).  In a virtual environment,
>       virtualized I/O technologies such as SR-IOV or similar are applicable for this
> layer.
>       The same or distinct link layer technologies may be used in each leg shown in
>       Figure 1.

...FB2: Hmm. We're again back to using terms such as "popular". Per my earlier note, popularity might change, standards stay.

How about:
The link layer, which is associate to the physical layer technology used.  Example technologies for this layer include Ethernet, 
POS, DWDM.  In a virtual environment, virtualized I/O technologies such as SR-IOV or similar are applicable for this layer.


> 
>     >
>     > [255] Suggest to avoid
>     >     terms like "popular" - popularity can change, standards stay
>     >
>     > <Nagendra> Ok. This is changed as "Ethernet is one such choice..."
>     >
>     > [256] Acronyms
>     >     "POS" and "DWDM" are not defined
>     >
>     > <Nagendra> Added.
>     >
>     > [274] Link start/end-points don't seem to
>     >     always align with the underlay network in the diagram
>     >
>     > <Nagendra> Fixed it.
>     >
>     > [287] s/may comprise
>     >     of/may consist of/
>     >
>     > <Nagendra>We fixed it as "may comprise"..
>     >
>     > [288] s/but not shown/but is not shown/
>     >
>     > <Nagendra> We fixed this as "intermediate nodes not shown...:
>     >
>     > [307]
>     >     s/devices/device/
>     >
>     > <Nagendra> Done.
>     >
>     > [308] What is a "controller"?
>     >
>     > <Nagendra> We discussed this in the above comment section.
>     >
>     > [314] s/includes/include/
>     >
>     > <Nagendra>Done.
>     >
>     > [319]
>     >     Add hSFC to list of acronyms in section 1.2.1
>     >
>     > <Nagendra> This is expanded in the respective section. We added it in the
>     > acronym section as well.
>     >
>     > [320] Add IBN to list of acronyms
>     >     in section 1.2.1
>     >
>     > <Nagendra> Ok, Done.
>     >
>     > [325] s/includes/include/
>     >
>     > <Nagendra> Done.
>     > [359] The function/term "controller"
>     >     requires definition.
>     >
>     > <Nagendra> Done, as mentioned in the above comment section.
>     >
>     > [383] s/?./?/
>     >
>     > [398] s/get the got/got/
>     >
>     > <Nagendra> Done.
>     >
>     >  [461]
>     >     s/devices/device/
>     >
>     > <Nagendra> Done.
>     >
>     >  [469] Does it have to be equal cost multipath at the service
>     >     layer, or could unequal cost multipath also be an option for load-
> balancing?
>     >
>     > <Nagendra>I didn’t see any discussion specific to ECMP/UCMP in the
>     > architecture RFC.
> 
>     ...FB: Hmm. I did not see that RFC7665 is only about equal cost multipath.
>     >
>     >  [521] Not sure whether the overlay network establishes the service plane.
> Isn't
>     >     it that the overlay network establishes connectivity for the SFC-related
>     >     functions in the service plane?
>     >
>     > <Nagendra> The service layer is established over the overlay network layer. I
> am
>     > not sure if it is right to say overlay network provides connectivity for service
>     > layer (.
> 
>     ...FB: Overlay network is one component of the service layer, isn't it. So it is
> required but not sufficient.
> 
> <Nagendra2> Ok. We can modify as below:
> 
> OLD:
>   The overlay network establishes the service plane between the SFC
>    components and are mostly transparent to the SFC data plane elements.
> 
> NEW:
>   The overlay network provides connectivity for service plane between the SFC
>    components and are mostly transparent to the SFC data plane elements.
> 
>     >
>     > [531] s/components/component/ [545] remove
>     >     "underlay"
>     >
>     > <Nagendra> Done.
>     >
>     > [595] s/devices/device/
>     >
>     > <Nagendra> Done.
>     >
>     > [600] s/action/an action/
>     >
>     > <Nagendra> Done.
>     >
>     > [601] Expand on
>     >     "TTL or other means" (TTL also needs to be added to acronyms in 1.2.1). Is
> this
>     >     specific to NSH? Or specific to IPv4?
>     >
>     > <Nagendra> TTL is listed as well-known abbrev in https://www.rfc-
>     > editor.org/materials/abbrev.expansion.txt and so we left it as it is. TTL in
> this
>     > document refers to NSH TTL field.
> 
>     ...FB: Let's ensure we refer to NSH TTL in this case. Given that SFC can be done
> with other means than NSH, implicit reference to NSH might be a problem.
> 
> <Nagendra2>Ok.
> 
>     >
>     >  [630] Mention that for "approximation of
>     >     packet loss for a given SFC can be derived" to be applicable, SFC OAM
> packets
>     >     would need to be forwarded the same as live user traffic.
>     >
>     > <Nagendra> As it is intending to derive the approximate loss value, I am not
> sure
>     > if we need this additional consideration that the OAM packet would need to
>     > follow the live user traffic. Let me know if you think otherwise.
> 
>     ...FB: IMHO we should - given that it is one potential complication.
> 
> <Nagendra2> Ok. We can update as below:
> 
> OLD:
> 
> SFC OAM should provide the ability to measure packet loss for an SFC.
>    On-demand measurement can be used to estimate packet loss using
>    statistical methods.  Measuring the loss of OAM packets, an
>    approximation of packet loss for a given SFC can be derived.
> 
> NEW:
> SFC OAM should provide the ability to measure packet loss for an SFC.
>    On-demand measurement can be used to estimate packet loss using
>    statistical methods.  Measuring the loss of OAM packets that share the fate
> with data traffic, an approximation of packet loss for a given SFC can be derived.

...FB: Hmm. Not sure that this really covers the case where the OAM packets are treated differently than the customer data packets.

How about:
SFC OAM should provide the ability to measure packet loss for an SFC. On-demand measurement can be used to estimate packet loss using statistical methods.  To ensure accurate estimations, one needs to ensure that OAM packets are treated the same and also share the same fate as regular data traffic. 

Cheers, Frank

>     >
>     >  [636] Is uppercase
>     >     "MUST" applicable to an informational document? Especially given that
>     >     RFC2119/RFC8174 is explicitly referenced by the draft.
>     >
>     > <Nagendra> Based on various reviewer comments, we removed the use of
> any
>     > normative statement.
>     >
>     > [666] Add MPLS, TRILL to
>     >     acronyms in 1.2.1
>     >
>     > <Nagendra> Ok. Done.
>     >
>     > [678] s/exhaustive/exhaustive./
>     >
>     > <Nagendra> Done.
>     >
>     > [720] Is uppercase "SHOULD" applicable to an informational document?
>     >     Especially given that RFC2119/RFC8174 is explicitly referenced by the
> draft.
>     >
>     > <Nagendra> Based on various reviewer comments, we removed the use of
> any
>     > normative statement.
>     >
>     > [722] Is uppercase "MAY" applicable to an informational document?
> Especially
>     >     given that RFC2119/RFC8174 is explicitly referenced by the draft.
>     >
>     > <Nagendra> Based on various reviewer comments, we removed the use of
> any
>     > normative statement.
>     >
>     > [754]
>     >     s/packet/packets/
>     >
>     > [755] s/to next node/to the next node/
>     >
>     >  [771] How does this
>     >     requirement align with the earlier paragraph, e.g. in case a node sends an
>     > ICMP
>     >     reply? It would probably make sense to scope the statement to e.g. NSH.
>     >
>     > <Nagendra> As mentioned in the statement, the node that initiates the OAM
>     > packet must set the marker and so this statement is applicable for the
> initiating
>     > node.
>     >
>     > [806]
>     >     s/function/functions/
>     >
>     > <Nagendra> Done
>     >
>     > [809] s/from relevant node/from the relevant node/
>     >
>     > <Nagendra> Done
>     >
>     > [810]
>     >     s/generate ICMP/generate an ICMP/
>     >
>     > <Nagendra> Done
>     >
>     > [812] s/from last/from the last/
>     >
>     > <Nagendra> Done
>     >
>     > [830]
>     >     s/perform continuity/perform the continuity/
>     >
>     > <Nagendra> Done
>     >
>     >  [834] s/with relevant/with the
>     >     relevant
>     >
>     > <Nagendra> Done
>     >
>     > [835] s/perform partial SFC availability./perform a partial SFC
>     >     availability check./
>     >
>     > <Nagendra> Done
>     >
>     > [851] For "In-Situ OAM data fields" add a normative
>     >     reference to draft-ietf-ippm-ioam-data
>     >
>     > [905] Add "CLI" to section 1.2.1
>     >     acronyms
>     >
>     > <Nagendra> Done
>     >
>     > [920] Add a reference for NETCONF ->RFC6241
>     >
>     > <Nagendra> Done
>     >
>     > Once again, thanks a lot for the great comments.
>     >
>     > Regards,
>     > Nagendra
> 
>     Thanks again for considering the comments in great detail. Much appreciated.
> 
>     Cheers, Frank
>     >
>     >
>     >
> 
>