[ippm] Re: Quality of Outcome measurement results for gaming, video conferencing and streaming
Bjørn Ivar Teigen <bjorn@domos.no> Wed, 18 September 2024 13:30 UTC
Return-Path: <bjorn@domos.no>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7057AC14F711 for <ippm@ietfa.amsl.com>; Wed, 18 Sep 2024 06:30:43 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.886
X-Spam-Level:
X-Spam-Status: No, score=-1.886 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_KAM_HTML_FONT_INVALID=0.01, T_REMOTE_IMAGE=0.01, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=domos-no.20230601.gappssmtp.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id IqJwGv4g1d1l for <ippm@ietfa.amsl.com>; Wed, 18 Sep 2024 06:30:38 -0700 (PDT)
Received: from mail-lf1-x129.google.com (mail-lf1-x129.google.com [IPv6:2a00:1450:4864:20::129]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id D0715C14F5FC for <ippm@ietf.org>; Wed, 18 Sep 2024 06:30:38 -0700 (PDT)
Received: by mail-lf1-x129.google.com with SMTP id 2adb3069b0e04-5367ae52a01so6259909e87.3 for <ippm@ietf.org>; Wed, 18 Sep 2024 06:30:37 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=domos-no.20230601.gappssmtp.com; s=20230601; t=1726666236; x=1727271036; darn=ietf.org; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=aTndKklO+zY1uA6YmBBd17L7dyn6ot0dL5o/YGECIfU=; b=ylJoOVAGjTIC9A/m7YMb1Dr5rJ21N9mQVTzgCrKJTgtlfEc+6HvltMMcWT6RA33P97 D+SB9vh9lrScgRTxse3Y72fvBIWSvRPobTg8/aSZVhDLsfmZFP4tO6uqqocYtEc4rm3N TrSWxVFozNWV9MpBXXdy/Moy0cbiIEdE2C3gcNUXHOZClBpMnQhW193dYaZFsIaLj7sM cRaRKsWyYvJ7yosV5vpYs11WCF0oW4u3oXYaPA7OEn9MGswXLyJ6bROibzL407STZas2 YWhPg2CTfYfN9zT9yrQO2i62vmkQFKQhj7lNHMvW0XyZN2OtC2VMcBm+js98OqbmFs8J hH+Q==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1726666236; x=1727271036; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=aTndKklO+zY1uA6YmBBd17L7dyn6ot0dL5o/YGECIfU=; b=hbeYJmsbkCoxuopcNmSEhia6mg197gZrAqppAgWm2IsnmR0Xhi7jrMKwOQZerJBK3q U6Pv/A8isfHW5pFPqDm8Mo+PqSKSGlRxWNgmjEF40ANZQg5IBxajNkdLZ4NJLMtDkdgX irBvNfT9Mr0cpiJjBV6ZDp5qqFBIS4kFDpb2MS2OSPZVyvVnGdADNpgvyyMb7SslJXYU qvLQTWQ9AtgdNwshvr7Ju1OM1up8H2yWcLQxq6WMCC/gP+brFuK4OyaRawikrW8mgWqG SfN+iwegZYFupUfxg4a6o1R/Lq/ydICs4s0fEWqGA0nQyfUL1c0S26gj09joZiYGsR1h bLcg==
X-Gm-Message-State: AOJu0Yz87gt26VR18eW/evPjszjpA9Y8AmIBSSw4SOYUBnWEL+oop3Kq GVTwF6IzEOquMkIPRz5nobZYxsEsfLLO57svFqIQK+bLuFzomjfTd8ftFGqdyR9nbOwm+eSQAly GukSrfiKeHoLm/ZbsF2q98W6bl+ViIx+NwLGQFylnazh+t6z9DPY=
X-Google-Smtp-Source: AGHT+IEF/toYyI6oSlrZQjmTKU89oywkfFLvF4b6l4TVR2+UQvaZU2+R/EjWhKgcV5fVwTGk12s7JJXTkgqAOlilyb8=
X-Received: by 2002:a05:6512:224f:b0:530:aa09:b6bf with SMTP id 2adb3069b0e04-5367fee270emr9745197e87.24.1726666235578; Wed, 18 Sep 2024 06:30:35 -0700 (PDT)
MIME-Version: 1.0
References: <CAKf5G6+k8NdNSvPvDXc=fksDq4e2gKM7yhMXhKg8WU3UFQBMqw@mail.gmail.com>
In-Reply-To: <CAKf5G6+k8NdNSvPvDXc=fksDq4e2gKM7yhMXhKg8WU3UFQBMqw@mail.gmail.com>
From: Bjørn Ivar Teigen <bjorn@domos.no>
Date: Wed, 18 Sep 2024 15:30:24 +0200
Message-ID: <CAKf5G6KhqCQJC6u2OfZPPOVY8ET7imH_2kphJvTAJCr7EsTtCg@mail.gmail.com>
To: "IETF IPPM WG (ippm@ietf.org)" <ippm@ietf.org>
Content-Type: multipart/alternative; boundary="0000000000009e256f062264cf0c"
Message-ID-Hash: 3ECJNUDT35LUQWXA6MRFNUQCSPCZVSLN
X-Message-ID-Hash: 3ECJNUDT35LUQWXA6MRFNUQCSPCZVSLN
X-MailFrom: bjorn@domos.no
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-ippm.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [ippm] Re: Quality of Outcome measurement results for gaming, video conferencing and streaming
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/MutKKbj3_Qtef8c-_tRR-UMy7sI>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Owner: <mailto:ippm-owner@ietf.org>
List-Post: <mailto:ippm@ietf.org>
List-Subscribe: <mailto:ippm-join@ietf.org>
List-Unsubscribe: <mailto:ippm-leave@ietf.org>
Dear IPPM members, We've just concluded a research project measuring QoO in home networks and collecting user feedback on the QoO scores. Key Findings: 1. QoO Feedback from Participants: - Quality of Outcome resonated strongly with participants, who found it easier to understand than traditional network metrics. - Participants report that the QoO metrics align closely with their subjective experiences of network performance 2. WiFi Latency and Performance: - 5GHz WiFi consistently provided better performance than 2.4GHz, especially in terms of latency and reliability. 3. Root Cause Analysis Results: - The root cause analysis performed through QoO composability identified WiFi congestion, signal strength, and access link variability as the leading contributors to low QoO scores for real-time applications. 4. User Satisfaction and Engagement: - The post-trial survey indicated that users found the QoO-based feedback to be actionable and meaningful, with a majority expressing that they felt more in control of their network performance after reviewing the QoO diagnostics. The full report can be found here: https://assets.ycodeapp.com/assets/app24919/Documents/LaiW4tJQ2kj4OOTiZbnf48MbS22rQHcZQmCriih9-published.pdf Thanks to the Comcast innovation fund for supporting the project! Best regards, Bjørn On Wed, 11 Sept 2024 at 16:25, Bjørn Ivar Teigen <bjorn@domos.no> wrote: > Dear IPPM members, > > As mentioned in our Vancouver session, my colleagues and I have been > working on how QoO maps to application performance. I want to share with > you this report which describes the results in more detail: > https://assets.ycodeapp.com/assets/app24919/Documents/U6TlxIlbcl1dQfcNhnCleziJWF23P5w0xWzOARh8.pdf > > I've also written a more accessible version of the gaming results for > Domos' blog, which can be found here: > https://domos.ai/blog/proving-qoo-captures-complex-network-requirements-a-call-of-duty-case-study > > Cheers, > Bjørn > > -- > Bjørn Ivar Teigen, Ph.D. > Head of Research > +47 47335952 | bjorn@domos.ai | www.domos.ai > [image: https://understandingnetworkapis.com/] > <https://understandingnetworkapis.com/> > -- Bjørn Ivar Teigen, Ph.D. Head of Research +47 47335952 | bjorn@domos.ai | www.domos.ai [image: https://understandingnetworkapis.com/] <https://understandingnetworkapis.com/>
- [ippm] Quality of Outcome measurement results for… Bjørn Ivar Teigen
- [ippm] Re: Quality of Outcome measurement results… Bjørn Ivar Teigen
- [ippm] Re: Quality of Outcome measurement results… Ruediger.Geib
- [ippm] Re: Quality of Outcome measurement results… Bjørn Ivar Teigen