Re: [ippm] WGLC for draft-ietf-ippm-responsiveness

Christoph Paasch <cpaasch@apple.com> Wed, 17 January 2024 18:45 UTC

Return-Path: <cpaasch@apple.com>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id DCC60C14F609 for <ippm@ietfa.amsl.com>; Wed, 17 Jan 2024 10:45:24 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.093
X-Spam-Level:
X-Spam-Status: No, score=-2.093 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H5=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_NONE=0.001, T_REMOTE_IMAGE=0.01, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=apple.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id T3rRrMFsZ6LH for <ippm@ietfa.amsl.com>; Wed, 17 Jan 2024 10:45:20 -0800 (PST)
Received: from rn-mailsvcp-mx-lapp02.apple.com (rn-mailsvcp-mx-lapp02.apple.com [17.179.253.23]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 8A58BC14E513 for <ippm@ietf.org>; Wed, 17 Jan 2024 10:45:20 -0800 (PST)
Received: from rn-mailsvcp-mta-lapp01.rno.apple.com (rn-mailsvcp-mta-lapp01.rno.apple.com [10.225.203.149]) by rn-mailsvcp-mx-lapp02.rno.apple.com (Oracle Communications Messaging Server 8.1.0.23.20230328 64bit (built Mar 28 2023)) with ESMTPS id <0S7F002F75FJBW00@rn-mailsvcp-mx-lapp02.rno.apple.com> for ippm@ietf.org; Wed, 17 Jan 2024 10:45:20 -0800 (PST)
X-Proofpoint-GUID: YE7kiVHatoYz1nrZ9UgZRZ8auJB1cWf3
X-Proofpoint-ORIG-GUID: YE7kiVHatoYz1nrZ9UgZRZ8auJB1cWf3
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.619, 18.0.997 definitions=2023-12-06_16:2023-12-05, 2023-12-06 signatures=0
X-Proofpoint-Spam-Details: rule=interactive_user_notspam policy=interactive_user score=0 phishscore=0 malwarescore=0 spamscore=0 mlxscore=0 adultscore=0 bulkscore=0 mlxlogscore=999 suspectscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2311290000 definitions=main-2312060141
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=apple.com; h=from : message-id : content-type : mime-version : subject : date : in-reply-to : cc : to : references; s=20180706; bh=GuWAO3SjYGZPgl1FStxwP4V/hR5gdXDttP67pLecEX4=; b=F+4Q+sEp6kVtMwL7nf7tMmoMNboiQ5lzVCa4FJdoKETnBasNz6mnX1P4ONlxrC2qyY+u jKxLRaPpXflJNgxntTPeEPps4+17htI3EHQpTL3GyLwI1D3NB/1Gu+j8l9h4ZHMfF+k2 NvLVZlzHZFQ3FFLNIPkqjqQSvRzW9bDhYLhqaDyBALSenxkYBFiSle14FAn9ncT0RxW4 /meMAxadsWd37IVpjP3OixtmVV392bNiefHmChQaj7YRSnBQYCZeyCq+76Cnv8PCmHAL rIOwpEU6PR6+U2iswjWH4EogLCocVnuI/X6/fAmOv47NPPxXRZbbNutOk/0tPsMhU0u/ dQ==
Received: from rn-mailsvcp-mmp-lapp02.rno.apple.com (rn-mailsvcp-mmp-lapp02.rno.apple.com [17.179.253.15]) by rn-mailsvcp-mta-lapp01.rno.apple.com (Oracle Communications Messaging Server 8.1.0.23.20230328 64bit (built Mar 28 2023)) with ESMTPS id <0S7F00NQT5FH1491@rn-mailsvcp-mta-lapp01.rno.apple.com>; Wed, 17 Jan 2024 10:45:17 -0800 (PST)
Received: from process_milters-daemon.rn-mailsvcp-mmp-lapp02.rno.apple.com by rn-mailsvcp-mmp-lapp02.rno.apple.com (Oracle Communications Messaging Server 8.1.0.23.20230328 64bit (built Mar 28 2023)) id <0S7F00F005C0EH00@rn-mailsvcp-mmp-lapp02.rno.apple.com>; Wed, 17 Jan 2024 10:45:17 -0800 (PST)
X-Va-A:
X-Va-T-CD: 55d3d287fc2d56d2abec24354c3fc2a4
X-Va-E-CD: 842877e7db852f0855a0a3aa400dcaa0
X-Va-R-CD: 6f5e469cdd67fb51d84db0a635efcf38
X-Va-ID: d44eec1a-2848-405d-be0b-d0395e8a464d
X-Va-CD: 0
X-V-A:
X-V-T-CD: 55d3d287fc2d56d2abec24354c3fc2a4
X-V-E-CD: 842877e7db852f0855a0a3aa400dcaa0
X-V-R-CD: 6f5e469cdd67fb51d84db0a635efcf38
X-V-ID: 75ad36bf-cd6d-4d4f-9732-6320f846594c
X-V-CD: 0
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.619, 18.0.997 definitions=2024-01-17_12:2024-01-17, 2024-01-17 signatures=0
Received: from smtpclient.apple ([17.192.155.119]) by rn-mailsvcp-mmp-lapp02.rno.apple.com (Oracle Communications Messaging Server 8.1.0.23.20230328 64bit (built Mar 28 2023)) with ESMTPSA id <0S7F00UEO5FGKS00@rn-mailsvcp-mmp-lapp02.rno.apple.com>; Wed, 17 Jan 2024 10:45:16 -0800 (PST)
From: Christoph Paasch <cpaasch@apple.com>
Message-id: <83BA097B-A16C-4EB5-867B-1C32F55D3DE1@apple.com>
Content-type: multipart/alternative; boundary="Apple-Mail=_F0EF0B29-9867-4A47-A340-F4D4E79F2541"
MIME-version: 1.0 (Mac OS X Mail 16.0 \(3774.300.61.1.2\))
Date: Wed, 17 Jan 2024 10:45:06 -0800
In-reply-to: <CAKf5G6KfNMM6BsZqSccFUNa3038WLWrnytQaULSbV73jbeCKhw@mail.gmail.com>
Cc: "IETF IPPM WG (ippm@ietf.org)" <ippm@ietf.org>
To: Bjørn Ivar Teigen <bjorn@domos.no>
References: <VI1PR07MB4142AB4694BB044E939DCD7BE285A@VI1PR07MB4142.eurprd07.prod.outlook.com> <CAKf5G6KfNMM6BsZqSccFUNa3038WLWrnytQaULSbV73jbeCKhw@mail.gmail.com>
X-Mailer: Apple Mail (2.3774.300.61.1.2)
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/3gZvKDYbhMzdY5NIMTMQiB1hEVI>
Subject: Re: [ippm] WGLC for draft-ietf-ippm-responsiveness
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Jan 2024 18:45:25 -0000

Hello Bjorn,



> On Dec 21, 2023, at 2:40 AM, Bjørn Ivar Teigen <bjorn@domos.no> wrote:
> 
> Hello IPPM,
> 
> I've read draft-ietf-ippm-responsiveness-03. The draft is well-written and easy to read in my opinion. I consider the contribution novel and useful.
> 
> Please find my comments and questions inline below:
> 
> 
> IP Performance Measurement                                     C. Paasch
> Internet-Draft                                                  R. Meyer
> Intended status: Standards Track                             S. Cheshire
> Expires: 22 April 2024                                        Apple Inc.
>                                                               W. Hawkins
>                                                 University of Cincinnati
>                                                          20 October 2023
> 
>                 Responsiveness under Working Conditions
>                    draft-ietf-ippm-responsiveness-03
> 
> Abstract
> .....
> 
> 4.1.1.  Single-flow vs multi-flow
> 
> .....
> 
>    One of the configuration parameters for the test is an upper bound on
>    the number of parallel load-generating connections.  We recommend a
>    default value for this parameter of 16.
> 
> Question: What is the rationale for choosing 16 as the upper bound?

No specific rationale. It just needs to be reasonably high to allow full link utilization without exceeding client/server resources.

> 
> .....
> 
> 7.  Responsiveness Test Server Discovery
> 
>    .....
> 
>    Consider this example scenario: A user has a cable modem service
>    offering 100 Mb/s download speed, connected via gigabit Ethernet to
>    one or more Wi-Fi access points in their home, which then offer
>    service to Wi-Fi client devices at different rates depending on
>    distance, interference from other traffic, etc.  By having the cable
>    modem itself host a Responsiveness Test Server instance, the user can
>    then run a test between the cable modem and their computer or
>    smartphone, to help isolate whether bufferbloat they are experiencing
>    is occurring in equipment inside the home (like their Wi-Fi access
>    points) or somewhere outside the home.
> 
> Comment: It might be useful to add some reflections about how measurements to different points can be compared.
> For arguments sake, let's say we measure towards two hypothetical servers and get RPM to an ISP-hosted server of 500, and RPM to the cable modem of 3000. 
> How can those values be compared or otherwise reasoned about?

Good point. I think that would fit very well in Section 5.2:

Beyond the difference in the latency of the load-generating connections and the separate connections another element can provide additional information. Namely testing against different servers located in different places along the path will allow to some extent to separate the network’s path in different segments. For example, if the cable modem and a further away ISP server are hosting responsiveness measurement endpoints, some localization of the issue can be done. If the RPM to the cable modem is very high, it means that the network segment from the client endpoint to the cable modem does not have responsiveness issues, thus allowing the user to conclude that possible responsiveness issues are beyond the cable modem.
It must be noted though that due to the high level approach to the testing (including HTTP), a low responsiveness to the cable modem does not necessarily mean that the network between client and cable modem is the problem (as outlined in the above previous paragraphs).


Does this sound good to you?


Thanks,
Christoph

> 
> 
> Best regards,
> Bjørn Ivar Teigen
> 
> On Tue, 5 Dec 2023 at 19:10, Marcus Ihlar <marcus.ihlar=40ericsson.com@dmarc.ietf.org <mailto:40ericsson.com@dmarc.ietf.org>> wrote:
>>  
>> 
>> Hello IPPM,
>> 
>>  
>> 
>> This email starts a Working Group Last Call for " Responsiveness under Working Conditions”, draft-ietf-ippm-responsiveness.
>> 
>>  
>> 
>> https://datatracker.ietf.org/doc/draft-ietf-ippm-responsiveness/
>> 
>> https://www.ietf.org/archive/id/draft-ietf-ippm-responsiveness-03.html
>> 
>>  
>> 
>> Please review the document and send your comments in response to this email, along with whether you think the document is ready to progress.
>> 
>>  
>> 
>> Please send your reviews and feedback by Friday, December 22.
>> 
>>  
>> 
>> BR,
>> 
>> Marcus & Tommy
>> 
>>  
>> 
>> _______________________________________________
>> ippm mailing list
>> ippm@ietf.org <mailto:ippm@ietf.org>
>> https://www.ietf.org/mailman/listinfo/ippm
> 
> 
> --
> Bjørn Ivar Teigen, Ph.D.
> Head of Research
> +47 47335952 | bjorn@domos.ai <mailto:bjorn@domos.ai> | www.domos.ai <http://www.domos.ai/>
>  <https://www.understandinglatency.com/>
> _______________________________________________
> ippm mailing list
> ippm@ietf.org
> https://www.ietf.org/mailman/listinfo/ippm