IETF Logo Mail Archive

[bmwg] Fwd: New Version Notification for draft-vpolak-bmwg-plrsearch-02.txt

"Maciek Konstantynowicz (mkonstan)" <mkonstan@cisco.com> Mon, 08 July 2019 22:26 UTC

Return-Path: <mkonstan@cisco.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id DAB28120342; Mon, 8 Jul 2019 15:26:40 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.499
X-Spam-Level:
X-Spam-Status: No, score=-14.499 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=mjabUufr; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=uYkmvyyG
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Lq5Z8K6OgcHm; Mon, 8 Jul 2019 15:26:37 -0700 (PDT)
Received: from rcdn-iport-8.cisco.com (rcdn-iport-8.cisco.com [173.37.86.79]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B6F3A120314; Mon, 8 Jul 2019 15:26:36 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=11954; q=dns/txt; s=iport; t=1562624796; x=1563834396; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=jUp4TgjdKm+CD7thahw1EHjXKRuh+j0sXShCpbio3es=; b=mjabUufrWYSOHTbtV/dooOTIUVqEtopgV03hVZaWr7NHsBcuqKgRPKKK WIJJkAi01QlGWww6EjCFQO07qXdhO9HJ0qkeRnGfpXhZzovKOcEjZgtrS 8Et3Z0EH9xUIhg3x20fa7IdKTxM2QQ1oQJNMOr8CJrEbl5eFPci2Hu4yy I=;
IronPort-PHdr: 9a23:Zy5DbxxX3zGi5JXXCy+N+z0EezQntrPoPwUc9psgjfdUf7+++4j5YhWN/u1j2VnOW4iTq+lJjebbqejBYSQB+t7A1RJKa5lQT1kAgMQSkRYnBZuACkr9N+LjaQQxHd9JUxlu+HToeUU=
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0ASAACfwiNd/5JdJa1lGgEBAQEBAgEBAQEHAgEBAQGBUwUBAQEBCwGBQ1ADalUgBAsoCoR0gmUDhFKJdoJbknKEVIEuFIEQA1QJAQEBDAEBIwoCAQGBS4E+gTcCgjgjNAkOAQMBAQQBAQIBBW2KNwELhUoBAgEDEi4BATUCAQ8CARkDAQIoBzIUBwIIAgQOBSKDAAGBHU0DHQECDJ8vAoE4iGCCI4J5AQEFgTYCDkGCdhiCEgmBNAGEcYZtF4FAP4ERJx+CTD6CYQEBAgEBFoEPWA0JCIJ+giaMTYcgI4hEjRVtCQKCF4ZWjS4bgixthjSOMY0wh0CPfQIEAgQFAg4BAQWBPRM4gVhwFRpLAYJBCYI4g3GFFIU/cgGBKIp0K4EEAYEgAQE
X-IronPort-AV: E=Sophos;i="5.63,468,1557187200"; d="scan'208,217";a="589743933"
Received: from rcdn-core-10.cisco.com ([173.37.93.146]) by rcdn-iport-8.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 08 Jul 2019 22:26:35 +0000
Received: from XCH-ALN-015.cisco.com (xch-aln-015.cisco.com [173.36.7.25]) by rcdn-core-10.cisco.com (8.15.2/8.15.2) with ESMTPS id x68MQZMf030382 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Mon, 8 Jul 2019 22:26:35 GMT
Received: from xhs-rtp-001.cisco.com (64.101.210.228) by XCH-ALN-015.cisco.com (173.36.7.25) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Mon, 8 Jul 2019 17:26:34 -0500
Received: from xhs-rcd-001.cisco.com (173.37.227.246) by xhs-rtp-001.cisco.com (64.101.210.228) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Mon, 8 Jul 2019 18:26:32 -0400
Received: from NAM04-SN1-obe.outbound.protection.outlook.com (72.163.14.9) by xhs-rcd-001.cisco.com (173.37.227.246) with Microsoft SMTP Server (TLS) id 15.0.1473.3 via Frontend Transport; Mon, 8 Jul 2019 17:26:32 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector2-cisco-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=V50on/D5ppxrGTGePRcQbR1DtLmtSRE6ER0foijSYNY=; b=uYkmvyyGAD9qBg8m7YvA9MAk1TpIabeg//o8CDQT1tRc2wFC2hP3jUdJ7QDrB2wbfDtpjwY2yPvcT7HWAwPmZemB70/JbETS9ob+uCUN+1BFNKvu85p5ZpQEpghMolgLxOzvTIX5YFUFzCsHVsel3pQ0sZGyjut+HIdp/7u8oNM=
Received: from MN2PR11MB3856.namprd11.prod.outlook.com (20.178.251.203) by MN2PR11MB4000.namprd11.prod.outlook.com (10.255.181.97) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2052.19; Mon, 8 Jul 2019 22:26:31 +0000
Received: from MN2PR11MB3856.namprd11.prod.outlook.com ([fe80::50b1:97d3:404f:1bb5]) by MN2PR11MB3856.namprd11.prod.outlook.com ([fe80::50b1:97d3:404f:1bb5%5]) with mapi id 15.20.2052.020; Mon, 8 Jul 2019 22:26:31 +0000
From: "Maciek Konstantynowicz (mkonstan)" <mkonstan@cisco.com>
To: "bmwg@ietf.org" <bmwg@ietf.org>
CC: "bmwg-chairs@ietf.org" <bmwg-chairs@ietf.org>, "Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco)" <vrpolak@cisco.com>
Thread-Topic: New Version Notification for draft-vpolak-bmwg-plrsearch-02.txt
Thread-Index: AQHVNdwxyzRWqZ4Rd06FqaHUOMrQDw==
Date: Mon, 08 Jul 2019 22:26:31 +0000
Message-ID: <DC2D11A7-B6B1-4FEE-BB79-2966003D775D@cisco.com>
References: <4D7F4AD313D3FC43A053B309F97543CF6C002BBF@njmtexg5.research.att.com> <4D7F4AD313D3FC43A053B309F97543CF6C0038DA@njmtexg5.research.att.com> <946C06D0-1578-48EE-9D99-1865491424BE@cisco.com> <8F716912-D639-48FC-B1C4-644DA3B85B75@cisco.com>
In-Reply-To: <8F716912-D639-48FC-B1C4-644DA3B85B75@cisco.com>
Accept-Language: en-GB, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=mkonstan@cisco.com;
x-originating-ip: [173.38.220.50]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 44bfd2d8-dba1-4c8e-78b4-08d703f35419
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600148)(711020)(4605104)(1401327)(2017052603328)(7193020); SRVR:MN2PR11MB4000;
x-ms-traffictypediagnostic: MN2PR11MB4000:
x-ms-exchange-purlcount: 6
x-ld-processed: 5ae1af62-9505-4097-a69a-c1553ef7840e,ExtAddr
x-microsoft-antispam-prvs: <MN2PR11MB400079DBF363C862E547E2B4CFF60@MN2PR11MB4000.namprd11.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-forefront-prvs: 00922518D8
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(979002)(4636009)(136003)(376002)(396003)(346002)(39860400002)(366004)(51874003)(189003)(199004)(316002)(478600001)(4326008)(76176011)(6916009)(3846002)(68736007)(2501003)(966005)(2906002)(413944005)(66446008)(66946007)(73956011)(6116002)(6512007)(66556008)(76116006)(91956017)(66476007)(2473003)(54896002)(8676002)(236005)(53386004)(6306002)(25786009)(15650500001)(2420400007)(6436002)(5640700003)(6486002)(36756003)(53936002)(107886003)(256004)(64756008)(66574012)(33656002)(99286004)(450100002)(229853002)(14444005)(606006)(7736002)(446003)(2351001)(66066001)(11346002)(2616005)(486006)(7110500001)(476003)(26005)(71200400001)(186003)(14454004)(6506007)(54906003)(53546011)(102836004)(5660300002)(71190400001)(86362001)(81166006)(81156014)(1730700003)(8936002)(969003)(989001)(999001)(1009001)(1019001); DIR:OUT; SFP:1101; SCL:1; SRVR:MN2PR11MB4000; H:MN2PR11MB3856.namprd11.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: jApS/nqrkI0TYw/Lx+//BHQnCa2rLIx+LJhOOYwuJa/A6Jm59QsR1AQHer9Ki4Y0Lz15Fz512+BVfgTdgIBCBHDELeDhVWUArbEVHdYo732B9kI0GdpU38u2DSM9UTsvRu4f0G4SnlAw0V9dNqyjckfmOepJ1BsE7dx8jPp8dicPorSgglNjPBRoDGuFyfxiyBjV16tD7UKjSrIAD4ZgDIlvWJosXal+XjV6+vhYY9KphhsAxToZgHD/ktTMOvlYKI/0YsjEvys68GL3mvXfplD+FT1e2nR36q9rmxvlMO1dVGEkLQTZQprr1t1klE3QKnTJmSpYmqZXNXN81lVKAc9FZpih2itkqk2FXhw54OkjBeEZ/FzlDtFwFmjVMJKidU0aVB1vL4bPX3L3QmbOufnfDKJLZIP0WDe/VlRaZHg=
Content-Type: multipart/alternative; boundary="_000_DC2D11A7B6B14FEEBB792966003D775Dciscocom_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 44bfd2d8-dba1-4c8e-78b4-08d703f35419
X-MS-Exchange-CrossTenant-originalarrivaltime: 08 Jul 2019 22:26:31.7577 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: mkonstan@cisco.com
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR11MB4000
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.36.7.25, xch-aln-015.cisco.com
X-Outbound-Node: rcdn-core-10.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/cJucDwlwO590V27xUHUB6WP1tWk>
Subject: [bmwg] Fwd: New Version Notification for draft-vpolak-bmwg-plrsearch-02.txt
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 08 Jul 2019 22:26:52 -0000

Dear BMWG,
We have just posted updated version of plrsearch draft.
We are looking for comments and adoption of the draft as BMWG document.

Dear BMWG Chairs,
We would like to ask for a slot during the upcoming IETF105 meeting,
to present this work and ask for BMWG adoption. We will be presenting
remotely. Thanks in advance for accommodating.

Regards,
-Maciek (on behalf of draft authors)

Begin forwarded message:

From: <internet-drafts@ietf.org<mailto:internet-drafts@ietf.org>>
Subject: New Version Notification for draft-vpolak-bmwg-plrsearch-02.txt
Date: 8 July 2019 at 23:24:12 BST
To: Vratko Polak <vrpolak@cisco.com<mailto:vrpolak@cisco.com>>, Maciek Konstantynowicz <mkonstan@cisco.com<mailto:mkonstan@cisco.com>>


A new version of I-D, draft-vpolak-bmwg-plrsearch-02.txt
has been successfully submitted by Maciek Konstantynowicz and posted to the
IETF repository.

Name: draft-vpolak-bmwg-plrsearch
Revision: 02
Title: Probabilistic Loss Ratio Search for Packet Throughput (PLRsearch)
Document date: 2019-07-08
Group: Individual Submission
Pages: 22
URL:            https://www.ietf.org/internet-drafts/draft-vpolak-bmwg-plrsearch-02.txt
Status:         https://datatracker.ietf.org/doc/draft-vpolak-bmwg-plrsearch/
Htmlized:       https://tools.ietf.org/html/draft-vpolak-bmwg-plrsearch-02
Htmlized:       https://datatracker.ietf.org/doc/html/draft-vpolak-bmwg-plrsearch
Diff:           https://www.ietf.org/rfcdiff?url2=draft-vpolak-bmwg-plrsearch-02

Abstract:
  This document addresses challenges while applying methodologies
  described in [RFC2544] to benchmarking software based NFV (Network
  Function Virtualization) data planes over an extended period of time,
  sometimes referred to as "soak testing".  Packet throughput search
  approach proposed by this document assumes that system under test is
  probabilistic in nature, and not deterministic.




Please note that it may take a couple of minutes from the time of submission
until the htmlized version and diff are available at tools.ietf.org<http://tools.ietf.org>.

The IETF Secretariat

On 27 Mar 2019, at 09:30, Maciek Konstantynowicz (mkonstan) <mkonstan@cisco.com<mailto:mkonstan@cisco.com>> wrote:

Hello BMWG!

We would like to gather feedback for PLRsearch draft, specifically
related to its applicability to throughput soak test:

1. PLRsearch can be used for a soak test with specified total test
duration. What are the common soak test criteria that need to be met?

2. How does one validate the critical load (maximum throughput) found by
a discovery test (e.g. with PLRsearch)? For example single trial with
long duration and measuring total loss, or multiple shorter trials
looking at maximum loss per trial.

3. Assuming a single test methodology combines critical load discovery
and validation, what would be the quantitive criteria to communicate
reliable vs. not reliable results?

Looking forward to the discussion in the meetings later today...

Cheers,
Vratko&Maciek

v2.23.0 | Report a Bug | By Email