Re: [rmcat] NADA Implementation in Mozilla

Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com> Tue, 08 December 2020 16:03 UTC

Return-Path: <sergio.garcia.murillo@gmail.com>
X-Original-To: rmcat@ietfa.amsl.com
Delivered-To: rmcat@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 108DF3A0FF6 for <rmcat@ietfa.amsl.com>; Tue, 8 Dec 2020 08:03:13 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.098
X-Spam-Level:
X-Spam-Status: No, score=-2.098 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, NICE_REPLY_A=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id oqjM_8ezx-va for <rmcat@ietfa.amsl.com>; Tue, 8 Dec 2020 08:03:11 -0800 (PST)
Received: from mail-wm1-x329.google.com (mail-wm1-x329.google.com [IPv6:2a00:1450:4864:20::329]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E8C5E3A0FF0 for <rmcat@ietf.org>; Tue, 8 Dec 2020 08:03:10 -0800 (PST)
Received: by mail-wm1-x329.google.com with SMTP id q75so2832074wme.2 for <rmcat@ietf.org>; Tue, 08 Dec 2020 08:03:10 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language; bh=Sftw4hEENgGgm2Jm8uZCIY3ln7KSljV4lYZvYLVnWAw=; b=tkgeOLnRw2cOl18dbJgmGDE9s1MdNNndQWGPpsjnoyWOERUlEHBLRlHCvMChqRJc8N LmK8iwOcnxvmd3RI4mQdrhssd5zKRitOLIWJ5J/osTrB2JABYtiu/jo1X7QptXlLN86R NkCGKq3NEtqBsWj0rSiGD9KeIyinryTacH70uCFl74KDH9fEIJsyivep6Ri6zsk90OnJ lGSQOwemEdZ27CTb/D7d+2eo9LNXJvpje6H2RAy+scG7fddCGhzS1zCYP1qxVc/5pf3c 1orXjrDGj/7PsgYYc9R0WlFh/bFCLIX3Jqd32iU0vtxYBeiKcaP5cuFjZzKaH5dKfhoO Uxzw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language; bh=Sftw4hEENgGgm2Jm8uZCIY3ln7KSljV4lYZvYLVnWAw=; b=UGCJJmOZfx2trHvOL0L2PlM7OJDjCzin5izBMTek/xatC8RxB4xG8A2sA+gWe+WsgW tBxvy9I0e1fIzxCIBBc70VHo62ZXvpD52GMzlMUzq810bwimb1T3lgwmhDkvnGeMHinf DE7TLPRARu565bBluX3CcvT8uO9iVUBIBbBdo4IuOTTgvmCax2uMsuiuH1XsKVPwZCcA bNy5AHkBW2pBggyfwun8/VFxMBiMg+WEWdPduBxZDJekFIxl01eNeTtm+hjJ/AAPErYl dCM4kQmIFKQDmCpSMIIFIRDKZI/9BiBPGqd4xONRkGmGR1LM2Xso7ltYdIp4FbvzKmwl QLGQ==
X-Gm-Message-State: AOAM5314/VykhKrm+/bOG0GMnRFCskt0JOcWLaGoGuRutLSrB/yhq4pi F5mgJkfA5Rl29ODy3ZcbO3o=
X-Google-Smtp-Source: ABdhPJxmYAVvfAscwrRrbzWs/bZ1Okvk3W+VVzIc5C7cBVFOmPhqmNSXJFvescjJuAwtL2EYVcrR2g==
X-Received: by 2002:a1c:6689:: with SMTP id a131mr4445126wmc.33.1607443389249; Tue, 08 Dec 2020 08:03:09 -0800 (PST)
Received: from [192.168.0.11] (79.108.125.160.dyn.user.ono.com. [79.108.125.160]) by smtp.googlemail.com with ESMTPSA id s8sm20141950wrn.33.2020.12.08.08.03.08 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 08 Dec 2020 08:03:08 -0800 (PST)
To: "Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu=40cisco.com@dmarc.ietf.org>, "rmcat@ietf.org WG" <rmcat@ietf.org>
Cc: "Sergio Mena de la Cruz (semena)" <semena@cisco.com>, "zhuxq@alumni.stanford.edu" <zhuxq@alumni.stanford.edu>
References: <DM5PR11MB14507C955C53880ADCB0C70FC9CD0@DM5PR11MB1450.namprd11.prod.outlook.com>
From: Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com>
Message-ID: <b11e706f-3ef4-f407-9022-80e097e560e5@gmail.com>
Date: Tue, 08 Dec 2020 17:03:18 +0100
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.5.1
MIME-Version: 1.0
In-Reply-To: <DM5PR11MB14507C955C53880ADCB0C70FC9CD0@DM5PR11MB1450.namprd11.prod.outlook.com>
Content-Type: multipart/alternative; boundary="------------CCA8B85EF0BC754BF1C4092D"
Content-Language: en-US
Archived-At: <https://mailarchive.ietf.org/arch/msg/rmcat/OYhkIk_xw6orwZNtFUgKaN6tv-c>
Subject: Re: [rmcat] NADA Implementation in Mozilla
X-BeenThere: rmcat@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "RTP Media Congestion Avoidance Techniques \(RMCAT\) Working Group discussion list." <rmcat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rmcat>, <mailto:rmcat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rmcat/>
List-Post: <mailto:rmcat@ietf.org>
List-Help: <mailto:rmcat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rmcat>, <mailto:rmcat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 08 Dec 2020 16:03:13 -0000

Hi Xiaoqing and Sergio,

Great to see you are still working on it.

I proposed a while back the use of a common logging format for being 
able to create tools for measuring the performance and comparing the 
behavior of the different bwe algorithms:

https://github.com/medooze/bwe-stats-viewer

Would you consider adding support to it on your source code? If you are 
still using the transport wide cc feedback messages the information 
dumped would be quite straight forward.

Also, it would be interesting knowing how did you perform the testing 
scenarios and if we could create a set of scripts to replicate them 
easily, what do you think?

Best regards
Sergio

On 08/12/2020 16:24, Xiaoqing Zhu (xiaoqzhu) wrote:
>
> Hi all,
>
> A while back we presented some initial evaluation results of the NADA 
> implementation in the open-source Mozilla browser under various 
> real-world settings at IETF-106 
> <https://www.ietf.org/proceedings/106/slides/slides-106-rmcat-nada-update-01>. 
> After further tinkering, we are happy to share a cleaned-up version of 
> our implementation rebased to a recent version of the Mozilla code:
>
> https://github.com/sergio-mena/gecko-dev/tree/nada 
> <https://github.com/sergio-mena/gecko-dev/tree/nada>
>
> It supports the use of either one-way-delay (OWD) or round-trip-time 
> (RTT) as the congestion signal for NADA, and includes all algorithmic 
> features for congestion control as described in the corresponding RFC 
> <https://tools.ietf.org/html/rfc8698>. Some illustrative results from 
> running the modified Firefox Nightly browser using the default 
> algorithm, or OWD/RTT-based NADA can be found here 
> <https://www.dropbox.com/s/g3idujywj573gax/2020-12-07-nada-eval-in-mozilla.pdf?dl=0>. 
>
>
> For your convenience, this branch also contains a folder. It contains 
> brief instructions and a utility python script for post-processing the 
> logsand plotting the graphs (as shown in the link above):
>
> https://github.com/sergio-mena/gecko-dev/tree/nada/nada_eval 
> <https://github.com/sergio-mena/gecko-dev/tree/nada/nada_eval>
>
> Since this effort has spanned over multiple years, we’ve rebased our 
> code twice along the way to catch up with major changes in the Mozilla 
> base code.Those rebases required us to squash our commit history. So 
> we are also sharing two branches below for archiving the original 
> commit history:
>
> https://github.com/sergio-mena/gecko-dev/tree/nada_rebase_0 
> <https://github.com/sergio-mena/gecko-dev/tree/nada_rebase_0>
>
> https://github.com/sergio-mena/gecko-dev/tree/nada_rebase_1 
> <https://github.com/sergio-mena/gecko-dev/tree/nada_rebase_1>
>
> Please feel free to check out the above. Let us know if you are 
> interested inintegrating it in your WebRTC-based app ortesting it out 
> in the real-world – always happy to jump on a call for that😊
>
> Thanks,
>
> Sergio and Xiaoqing
>