IETF Logo Mail Archive

[bmwg] Feedback request for draft-vpolak-bmwg-plrsearch-01

"Maciek Konstantynowicz (mkonstan)" <mkonstan@cisco.com> Wed, 27 March 2019 09:30 UTC

Return-Path: <mkonstan@cisco.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 059AE12028A for <bmwg@ietfa.amsl.com>; Wed, 27 Mar 2019 02:30:33 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.501
X-Spam-Level:
X-Spam-Status: No, score=-14.501 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com header.b=CMDivGqD; dkim=pass (1024-bit key) header.d=cisco.onmicrosoft.com header.b=QI4QTjxv
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id y9sI6J7b1def for <bmwg@ietfa.amsl.com>; Wed, 27 Mar 2019 02:30:30 -0700 (PDT)
Received: from rcdn-iport-3.cisco.com (rcdn-iport-3.cisco.com [173.37.86.74]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 97D3F120288 for <bmwg@ietf.org>; Wed, 27 Mar 2019 02:30:30 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=20921; q=dns/txt; s=iport; t=1553679030; x=1554888630; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=RjskaU5Sh9PTAcmKKIgsrVTNo4vNtHT9f1LBSI8gxXw=; b=CMDivGqDF7+BIUU1676Cna7yKZcLYxe62pkR3vtBjydIvSXF/RbcDAOi WquXAXA4J6t7EZ/4VVYO6X37B4lAi/2I+GI87PhDEA2C9v8tP9zWOYt2K aoRCsOLnVb5Df0O9QzjZgWmo5MbvgQjGdiYrKKZ8/0nOjn+f0PTPCjcPh A=;
IronPort-PHdr: 9a23:3K/ZHhyZTVOfY/7XCy+N+z0EezQntrPoPwUc9psgjfdUf7+++4j5YhWN/u1j2VnOW4iTq+lJjebbqejBYSQB+t7A1RJKa5lQT1kAgMQSkRYnBZuACkr9N+LjaQQxHd9JUxlu+HToeUU=
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0AHAAAYQptc/4wNJK1kGQEBAQEBAQEBAQEBAQcBAQEBAQGBUwIBAQEBAQsBgQ4vUANodAQLJ4dVA48tgleXDoEugSQDVA0BARgBCgmEQAKFKyI2Bw0BAQMBAQkBAwJtHAELhUoBAQEEAQE+AQEsCwELBAIBGQQBASEHBycLFAkIAgQOBYMiAYERTAMVAQIMnnsCihSCIIJ4AQEFgTEBAwICgQ6CQBiCDAiBLwGEXIZVF4FAP4ERJx+DdRkBRIEYAQECAReBdBGCfYIminWGKYdKi2ZgCQKCAYVpi1salAyLLIYJjTECBAIEBQIOAQEFgVQKJ4FWcBU7KgGCQQmCARgLg0uCZIIwhT9ygSiMAiuCIAEB
X-IronPort-AV: E=Sophos;i="5.60,276,1549929600"; d="scan'208,217";a="529600814"
Received: from alln-core-7.cisco.com ([173.36.13.140]) by rcdn-iport-3.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 27 Mar 2019 09:30:29 +0000
Received: from XCH-ALN-011.cisco.com (xch-aln-011.cisco.com [173.36.7.21]) by alln-core-7.cisco.com (8.15.2/8.15.2) with ESMTPS id x2R9UTYP022184 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL) for <bmwg@ietf.org>; Wed, 27 Mar 2019 09:30:29 GMT
Received: from xhs-rcd-003.cisco.com (173.37.227.248) by XCH-ALN-011.cisco.com (173.36.7.21) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Wed, 27 Mar 2019 04:30:28 -0500
Received: from xhs-rcd-002.cisco.com (173.37.227.247) by xhs-rcd-003.cisco.com (173.37.227.248) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Wed, 27 Mar 2019 04:30:28 -0500
Received: from NAM01-BN3-obe.outbound.protection.outlook.com (72.163.14.9) by xhs-rcd-002.cisco.com (173.37.227.247) with Microsoft SMTP Server (TLS) id 15.0.1473.3 via Frontend Transport; Wed, 27 Mar 2019 04:30:27 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector1-cisco-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=GHsQmweyRqLcux+Aifx22MWAoqu5hIS6g5BHePwXHpo=; b=QI4QTjxvx/OyJKHZsqwNJUxDJh+1vzYLd1nmufwcgTVowOVus4bFRhxRSmJZmIca1faUo4kIzJehf5i/HfXZjrh7HmI0LT8v1dWfLpAUpkQDzG+7k77OxfJPCVTk8vEFsfC/C4aKCZe2Hj14D4gAftjUmcWpEYXBijqrEayzb34=
Received: from BYAPR11MB3847.namprd11.prod.outlook.com (20.178.239.207) by BYAPR11MB3768.namprd11.prod.outlook.com (20.178.238.206) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1750.15; Wed, 27 Mar 2019 09:30:26 +0000
Received: from BYAPR11MB3847.namprd11.prod.outlook.com ([fe80::597b:b276:2acb:b1f5]) by BYAPR11MB3847.namprd11.prod.outlook.com ([fe80::597b:b276:2acb:b1f5%4]) with mapi id 15.20.1750.014; Wed, 27 Mar 2019 09:30:26 +0000
From: "Maciek Konstantynowicz (mkonstan)" <mkonstan@cisco.com>
To: "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: Feedback request for draft-vpolak-bmwg-plrsearch-01
Thread-Index: AQHU5H+2VHrLz8b2OUyN32W6+TqS7w==
Date: Wed, 27 Mar 2019 09:30:26 +0000
Message-ID: <8F716912-D639-48FC-B1C4-644DA3B85B75@cisco.com>
References: <4D7F4AD313D3FC43A053B309F97543CF6C002BBF@njmtexg5.research.att.com> <4D7F4AD313D3FC43A053B309F97543CF6C0038DA@njmtexg5.research.att.com> <946C06D0-1578-48EE-9D99-1865491424BE@cisco.com>
In-Reply-To: <946C06D0-1578-48EE-9D99-1865491424BE@cisco.com>
Accept-Language: en-GB, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=mkonstan@cisco.com;
x-originating-ip: [2001:420:c0c0:1001::15b]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: e0d70e8b-81f5-4015-ea8f-08d6b296d891
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(5600127)(711020)(4605104)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7153060)(7193020); SRVR:BYAPR11MB3768;
x-ms-traffictypediagnostic: BYAPR11MB3768:
x-ms-exchange-purlcount: 8
x-ld-processed: 5ae1af62-9505-4097-a69a-c1553ef7840e,ExtAddr
x-microsoft-antispam-prvs: <BYAPR11MB37686A86BE3B23F963FBC7ACCF580@BYAPR11MB3768.namprd11.prod.outlook.com>
x-forefront-prvs: 0989A7979C
x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(376002)(396003)(136003)(366004)(39860400002)(346002)(497574002)(189003)(199004)(13464003)(54164003)(54896002)(316002)(6506007)(2616005)(76176011)(53546011)(102836004)(33656002)(99286004)(36756003)(11346002)(446003)(25786009)(2906002)(4326008)(2501003)(14444005)(256004)(86362001)(476003)(53376002)(236005)(6306002)(53936002)(6512007)(107886003)(6916009)(82746002)(486006)(6436002)(6486002)(5640700003)(7736002)(186003)(83716004)(81166006)(5660300002)(81156014)(71200400001)(71190400001)(97736004)(966005)(8936002)(106356001)(46003)(105586002)(606006)(478600001)(2351001)(68736007)(8676002)(14454004)(6116002)(1730700003); DIR:OUT; SFP:1101; SCL:1; SRVR:BYAPR11MB3768; H:BYAPR11MB3847.namprd11.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info: 5BWukanSykIV9fSpQyK3jKymB1XXYY6QfcM4ch+UsUZQMsm6gRCRDkG64QSya8LOb5QjxpeKvUP8GVSzxmDSe9AtC61sKuMCp4dKQWs+dmzMauJ+sCPh02yOPNsAgN6T+Ai/KlHWS+/+vgl5DY6gUDP4o9wijsa2ZQPF9T6kIhaqOSr40/jWP1yATrbiZD6suxQoJa1pVag0AIpelT+4AUZt3FmmaGsLl+t9ipVVVJ6RYdz/3FzhiDsCOA0f3wYBd/MJ1yQO0JMPD91es+xXuTxIKw5WAC8661pSGF4hRIQNoLxLQPWDINNB5LQrG001jhAcBSjqCt5l/TVlDnHu6pagEYvSZcBTSYn1u4COqZGWGo9EQYRwVZYumfuUQbtev0s/vcozZBt1iQT5yZcHxfCd3i+rkM8UuhxUh2WmIfs=
Content-Type: multipart/alternative; boundary="_000_8F716912D63948FCB1C4644DA3B85B75ciscocom_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: e0d70e8b-81f5-4015-ea8f-08d6b296d891
X-MS-Exchange-CrossTenant-originalarrivaltime: 27 Mar 2019 09:30:26.6793 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR11MB3768
X-OriginatorOrg: cisco.com
X-Outbound-SMTP-Client: 173.36.7.21, xch-aln-011.cisco.com
X-Outbound-Node: alln-core-7.cisco.com
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/Cjuc5kLVqglnmT-sCmZ2ZpQH3W8>
Subject: [bmwg] Feedback request for draft-vpolak-bmwg-plrsearch-01
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 27 Mar 2019 09:30:33 -0000

Hello BMWG!

We would like to gather feedback for PLRsearch draft, specifically
related to its applicability to throughput soak test:

1. PLRsearch can be used for a soak test with specified total test
duration. What are the common soak test criteria that need to be met?

2. How does one validate the critical load (maximum throughput) found by
a discovery test (e.g. with PLRsearch)? For example single trial with
long duration and measuring total loss, or multiple shorter trials
looking at maximum loss per trial.

3. Assuming a single test methodology combines critical load discovery
and validation, what would be the quantitive criteria to communicate
reliable vs. not reliable results?

Looking forward to the discussion in the meetings later today...

Cheers,
Vratko&Maciek


On 12 Mar 2019, at 14:03, Maciek Konstantynowicz (mkonstan) <mkonstan@cisco.com<mailto:mkonstan@cisco.com>> wrote:

Hi Al,

We would like ask for the following to be added to BMWG IETF-104 agenda:

Continuing Proposals:

  Probabilistic Loss Ratio Search for Packet Throughput (PLRsearch)
    (includes test results from FD.io<http://fd.io/> CSIT)
    Presenters: Vratko Polak, Maciek Konstantynowicz
    Related Draft:
    https://tools.ietf.org/html/draft-vpolak-bmwg-plrsearch-01

  Multiple Loss Ratio Search for Packet Throughput (MLRsearch)
    (includes test results from FD.io<http://fd.io/> CSIT)
    Presenters: Vratko Polak, Maciek Konstantynowicz
    Related Draft:
    https://tools.ietf.org/html/draft-vpolak-mkonstan-bmwg-mlrsearch-00


NEW Proposals:

  NFV Service Density Benchmarking
    (includes test results from FD.io<http://fd.io/> CSIT and CNCF CNF Testbed)
    Presenter: Maciek Konstantynowicz
    Related Draft:
    https://tools.ietf.org/html/draft-mkonstan-nf-service-density-00

Cheers,
-Maciek

On 12 Mar 2019, at 12:24, MORTON, ALFRED C (AL) <acm@research.att.com<mailto:acm@research.att.com>> wrote:

I received many new inputs for the agenda
after posting the first draft, yesterday.

Thanks to everyone who helped!

the revised agenda is now posted:
https://datatracker.ietf.org/meeting/104/materials/agenda-104-bmwg-01

Al
bmwg co-chair

-----Original Message-----
From: bmwg [mailto:bmwg-bounces@ietf.org] On Behalf Of MORTON, ALFRED C
(AL)
Sent: Monday, March 11, 2019 9:40 AM
To: bmwg@ietf.org<mailto:bmwg@ietf.org>
Subject: [bmwg] Draft Agenda for BMWG at IETF-104


BMWG,

The draft agenda is available here:
https://datatracker.ietf.org/meeting/104/materials/agenda-104-bmwg-00

Any early Agenda Bashes?
Are there more drafts coming today?
More requests for agenda slots to discuss drafts?

Reply to the list and let us know,
Al and Sarah
bmwg co-chairs


_______________________________________________
bmwg mailing list
bmwg@ietf.org<mailto:bmwg@ietf.org>
https://urldefense.proofpoint.com/v2/url?u=https-
3A__www.ietf.org_mailman_listinfo_bmwg&d=DwICAg&c=LFYZ-
o9_HUMeMTSQicvjIg&r=OfsSu8kTIltVyD1oL72cBw&m=Og8hOg_64kFu5yY21eZNl9822ORRh
tsTfOGRDpWyF5A&s=kJ5FOt6agLT5txZCGVTC-h-Oiz8JlR9_QRkG-r42HSc&e=

_______________________________________________
bmwg mailing list
bmwg@ietf.org<mailto:bmwg@ietf.org>
https://www.ietf.org/mailman/listinfo/bmwg

v2.23.0 | Report a Bug | By Email