Re: [Wish] Conformance test scripts

Jonas Birme <jonas.birme@eyevinn.se> Wed, 25 January 2023 10:33 UTC

Return-Path: <jonas.birme@eyevinn.se>
X-Original-To: wish@ietfa.amsl.com
Delivered-To: wish@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6989DC14F739 for <wish@ietfa.amsl.com>; Wed, 25 Jan 2023 02:33:28 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.897
X-Spam-Level:
X-Spam-Status: No, score=-6.897 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=unavailable autolearn_force=no
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id UVarKtupeaQz for <wish@ietfa.amsl.com>; Wed, 25 Jan 2023 02:33:23 -0800 (PST)
Received: from NAM06-BL2-obe.outbound.protection.outlook.com (mail-bl2nam06on2102.outbound.protection.outlook.com [40.107.65.102]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1595EC14F74B for <wish@ietf.org>; Wed, 25 Jan 2023 02:33:21 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=keBTHpH6BBC8PN2oQ4apFEAau/pVKDlqiNp8eZYc+XEaHYCpYNKaRc3qHiLy3oCVbekJvAWms3mniIenU/YyMwK6ohYtBE7OXIZF4Qun4YCKJILIXuLFbZlVkq2Og4ZqTOt3Mb9AzwJixjsse2gd33MpyIu1Xp0ljBzjFaGX+7tG6faYSscmLcL61Rzdsa/P1S/0JTVEB2TuPbesvWYlaO5zfJujaUu6Qhdwwny10n33a+Z+8S4AiblQhuDGbGzoKNDiu5n8qZ8Ij1jgUrQtHVMBi0xUuPdD18JGWlN0Q79EpeSFz+FqJ64GA4zMbcT1hy3fGL5PW5x4GO89ZuIDPw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=uS3K7ElJPB4YCilO5JtcM/RTzbCNNRSUYC+6e/N2c9Q=; b=UPMgpNX/kv1rq2s8elrFyLkazGs0JaO56sEGIUXnG3z270k0MclIetCXhl17mCe7y46DNgJTU+f+6NuDxgGveKa5DhjFwzKLnsvCt3taNouB0ep8w9TmGsYtko168qHmEv4Qm4ylXVOmiMe8vp8q1IpP+io5F6D3Y3EpXFGJ6r4YsN8TNd1IyRfV1R80E/xfpP4E4QMRPb2HCSeYNEMgmf+cFtiUBfNLsce3npConkd1TkiNFhEB6i9wFLpVw8UdZvtjOQOAs6c8Wa7nqZY3v8B1wh3bShX6NHXCZYxF1rI7iSJ6HOtnfUeQ+wfpRFX1sZibGBhF3L6DldjjspHFyw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=eyevinn.se; dmarc=pass action=none header.from=eyevinn.se; dkim=pass header.d=eyevinn.se; arc=none
Received: from MM0P280MB0248.SWEP280.PROD.OUTLOOK.COM (2603:10a6:190:f::11) by GV2PPF4EF2CC52E.SWEP280.PROD.OUTLOOK.COM (2603:10a6:144::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6002.24; Wed, 25 Jan 2023 10:33:17 +0000
Received: from MM0P280MB0248.SWEP280.PROD.OUTLOOK.COM ([fe80::268:a5df:f7d3:65d2]) by MM0P280MB0248.SWEP280.PROD.OUTLOOK.COM ([fe80::268:a5df:f7d3:65d2%6]) with mapi id 15.20.6002.033; Wed, 25 Jan 2023 10:33:17 +0000
From: Jonas Birme <jonas.birme@eyevinn.se>
To: Sean Turner <sean@sn3rd.com>, Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com>
CC: Jonas Birme <jonas.birme=40eyevinn.se@dmarc.ietf.org>, WISH List <wish@ietf.org>, Nils Ohlmeier <nils.ohlmeier@8x8.com>
Thread-Topic: [Wish] Conformance test scripts
Thread-Index: AQHZESU8QiGBjrXxskGsW2Ft65W+3K52juiAgAAx9cmAK6y314AABVAAgAOVyACAB3LRAIAAbHIAgADeyACAAGe7DA==
Date: Wed, 25 Jan 2023 10:33:17 +0000
Message-ID: <MM0P280MB0248D2ABAB1A3E4D2E29F17E82CE9@MM0P280MB0248.SWEP280.PROD.OUTLOOK.COM>
References: <MM0P280MB0248369814BF8C3B43CC29CD82E69@MM0P280MB0248.SWEP280.PROD.OUTLOOK.COM> <CA+ag07ZtYB3jHRDjJYtT5fx8E5021LUnjSDRsMoWcyTAsoX9zQ@mail.gmail.com> <MM0P280MB0248C0B7759CB0FB5EDABAF482EA9@MM0P280MB0248.SWEP280.PROD.OUTLOOK.COM> <BBE58ADB-FECE-4AE5-AEF1-9C2043897CD5@eyevinn.se> <CA+ag07YHRAdwZwxBHWavJoEddEPxt_S7Uc8Gn0Jsx0B41ua5ig@mail.gmail.com> <3F1A8E2F-F899-44BD-ADEE-4D664D996612@sn3rd.com> <CA+ag07Y2HupamGt9QfafQ-O_+GsvwA_YjHrWMbtQrmo2iP6OYA@mail.gmail.com> <350DC47A-4FAD-4F45-8EED-7212667369F9@sn3rd.com> <6BD5E14C-E368-481B-AD62-0F9AF1AFF0BC@sn3rd.com>
In-Reply-To: <6BD5E14C-E368-481B-AD62-0F9AF1AFF0BC@sn3rd.com>
Accept-Language: sv-SE, en-US
Content-Language: sv-SE
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=eyevinn.se;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: MM0P280MB0248:EE_|GV2PPF4EF2CC52E:EE_
x-ms-office365-filtering-correlation-id: b7bd5396-afac-4790-0ffd-08dafebf9275
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: 1NRfl4EL2ZTDmh56AldabflOW/lhYWMD640EDQnqIEmcH50oaHy7zT2RbT5OkGBHr1UPpXrZIGfDIKLBZDv7w87feG7FhsqUtUpl8BLsVZ0bi3jIbNrJFc4PwcKaXjJ2A1pQlUe9Mj3te/uZSTPBK5+RpFz/GwpPwao3AK7gaf7GHBojguh6Dm/iQCx5a3M/73F29B7iraFIxFTb7gLyCT6zhDXJ/3IsVYIN5NaDwjHvLtXMUYMdXO8U9KvuqmByMvYGj70w6gCIveMxbQASLOp5Z1PcquwEEwUc/ow8Zc1qpMwgJWJjZjdZcWT3SoFJ+O6EfdswxeKd1mem54flWMJVKh+8PtsaCOwq6+hKFXuNmAgoWuUoA8bXF1RZ6rFIfrmksuZh132QO/GQMnm5ogC1jfKWLuxiQ+BkEgmHoFkYEgpdG9DLOLiYtXFvcdUOAAXP2BJOV54VUgP9UsbJlKdEDbl/FLxzzEtBdbprpt2OYHa3Dt4OE6Q788JxdEEbK96fPX5bTeEMekGMfCf7gr+M3BTMVFQGiBdWJ+cMY17+dwJN/WNXlSS4ltXHLvx5oo/d2lF3bCHwsLB6IUw7FH7R/h7Dh/3oinrNy+x7wCsN8geP6+UB9aMxe+dH7w4knGPbWGCzbntTgbAWJ3mT8sIiTY1eVCprKDx0UNI8HvPP6JSeiyJLSIfGB83W2ASQUH2IFhSKybEHNda3I08YmUTi9sFg24hxSHSorMNRDz0=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:MM0P280MB0248.SWEP280.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230025)(4636009)(396003)(346002)(376002)(366004)(136003)(39830400003)(451199018)(55236004)(186003)(26005)(53546011)(44832011)(54906003)(122000001)(38070700005)(8936002)(5660300002)(38100700002)(316002)(55016003)(166002)(478600001)(9686003)(71200400001)(6506007)(86362001)(33656002)(110136005)(64756008)(66476007)(7696005)(2906002)(66556008)(966005)(41300700001)(91956017)(66446008)(8676002)(52536014)(4326008)(66574015)(66946007)(83380400001)(76116006); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: RLR9yF3x9aOiD00Uch5//F/eED3F0V4yEHFEjpHNbFu7+MKTXGX2hJyQ7Ww/fKJWSPK+nb7nWvGtmr5WPlaGL//XVhGsXMFItjx/BIZnIalSYJ+1HyvDwW/ZbZTdnVf+0kTYZwMNX4TnhPDD8wUafhqFdXa6X/5Z/cPYU5v3S2RVxvUaeF3AuabkKAWJ3KBpIuI9xwAfv/usx7gzdbXAR8Pst/pUkhBONbUuSWHIR3237O0K75F8aMoS6P/4FE2Pj4npWIo0LL4NVutNqE0GmuteZbRP7Oy+ywIv4dfdZ1av8kKls6yZYQD+NsaNDGjPyPP9zQYSE83jGD2N2J7V+9fO4U1DfAFe+d8D38N3fIbWYHegzrj0AIusJG5gD5kf52oq8OzOY/yfN2O9fpJrl3GZVM0xgnpOWhqdvQxf+cW+rrEb12op8FQmyTWH0cqBhTnubaJX3EHSjyJWa34bkDdFHHmHa/gh/ACw5WmAMhglQYfiXUWPY6aYaT/fPB8dCP/ba1KPNV6hdUMsEJLb1VHuaREAkl/syEq2VKIR9Q4LvIib4T1nW0xfGVIvGzjSOLQ3Di0mufR9CJU6IoaNYkkEg+lhIt2ILMVbzNL3iwiXRY527/HYwooLz0/yGsWw+odLZPOIr08Zl5Um3G1Qihigo4n8S8QN9yebjrmMU+tovkQuRT50zT8JzswPNr2Hr4W8Mk5HXWAn41NIgeFWGi6yY9H3nEEXRHPFxbTl9BUj8gNUjWm1cSZYb7Y2ni2odnPQW/SM/Me7C4fkeQspU4+suRNmbg9W4ncU5JVuIrY4Ykzz1NTe51fmvVWyFAyKdLgCbKTBgWJeC5hNH/y31iNrGQsfomfyl7yZVb2IeXfn0cKewm/Cv7g/IzIAkKhINwuCtxo/GYZD0BAHt286eF62I5oJ1XtHp8DeAFN59YstZI1uJlU3VyMO3Tf5O3lVq/FUP6PhDRcanWiSEPjuCNQTli2jJwpTeRQnaZfGgpm0D+W5CcW2X/PF6QFDWLfVfqZGiiE39vzYh797fMpcbLT7PoD3ic1dBTvr2HPD/MY9OIhn+09yh0Efd7GPWr1B7yBo3Edow7nRs8hp1gJEfcKwkWsJ7HBfiD8QdK7xwrZz2wH4Iuqa1RoW4R37fVt1dnXhsbokgNTnKAP2ptM1b6pEHk3Q6EnOLnPXHiGSdYSLHqZUdPD+WCDLUOUvgy56SPC4o+1VY3jY1SwMYPvfmMHX0AaLKO1vKKfpAnymtfRblrBqZQiBLtkXI2ig2IXFl7QSdyrfm0z5t14XpOGj/zplA9fdFPKLd4UlqqPGUdCMGIOhnCP+MzvXLPtmHd8jgFFSzf5dhUHdLt9vA4AJBRLAuzuXmjD8P6t+s3zBj0khJgVk4n3+ifMY33Na5uVoUDYQ1wEcmgxmaqhXTJ1dezihNV7HbdLinU4jjNjyFUWucvBmSw31PSoYDg+7IdBQhHGrdyhdIvEZJlREzAqMwq+UL+JNDcLr567/Fg5bciLu/R9dlh5KrwilcUjse/tOUMy1c/YGK+P81hCvrmw1qpPioXGYZ0q0nkliVykHK2lt3M4v4HWHornrAYaGoWBVv+LGdwCCRMoJRHmpwhxpcw==
Content-Type: multipart/alternative; boundary="_000_MM0P280MB0248D2ABAB1A3E4D2E29F17E82CE9MM0P280MB0248SWEP_"
MIME-Version: 1.0
X-OriginatorOrg: eyevinn.se
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: MM0P280MB0248.SWEP280.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-Network-Message-Id: b7bd5396-afac-4790-0ffd-08dafebf9275
X-MS-Exchange-CrossTenant-originalarrivaltime: 25 Jan 2023 10:33:17.5544 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 6598d485-58c0-4a92-8db7-945e389ee6c1
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: LzRziXFudnpSmUSLK/1JZsReyJV1DYZbflCVTGHjH1wtKlCwq8aJDtV1dsWQDVTBNaJzy58jpwlnmocuJV4A+g==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: GV2PPF4EF2CC52E
Archived-At: <https://mailarchive.ietf.org/arch/msg/wish/FpT0tFqvH3vL4qqIXmpFmafbCc0>
Subject: Re: [Wish] Conformance test scripts
X-BeenThere: wish@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: WebRTC Ingest Signaling over HTTPS <wish.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/wish>, <mailto:wish-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/wish/>
List-Post: <mailto:wish@ietf.org>
List-Help: <mailto:wish-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/wish>, <mailto:wish-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 25 Jan 2023 10:33:28 -0000

Thanks,

I’ve opened a PR with what I have done so far related to conformance test scripts: https://github.com/wish-wg/resources/pull/1

Best regards,
   Jonas
--
Jonas Birmé
VP R&D Eyevinn Technology
M: +46 70 304 7660

Från: Sean Turner <sean@sn3rd.com>
Datum: onsdag, 25 januari 2023 05:21
Till: Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com>
Kopia: Jonas Birme <jonas.birme@eyevinn.se>, Jonas Birme <jonas.birme=40eyevinn.se@dmarc.ietf.org>, WISH List <wish@ietf.org>, Nils Ohlmeier <nils.ohlmeier@8x8.com>
Ämne: Re: [Wish] Conformance test scripts
Done:
https://github.com/wish-wg/resources

spt

> On Jan 24, 2023, at 10:04, Sean Turner <sean@sn3rd.com> wrote:
>
> I will put it on my list!
>
> spt
>
>> On Jan 24, 2023, at 03:36, Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com> wrote:
>>
>> I think "resources" will be fine for now. We can rename later if we feel that it should have a different name.
>>
>> Best regards
>> Sergio
>>
>> On Thu, Jan 19, 2023 at 3:51 PM Sean Turner <sean@sn3rd.com> wrote:
>> Yeah that would be fine. Which name would you prefer?
>>
>> spt
>>
>>> On Jan 17, 2023, at 03:06, Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com> wrote:
>>>
>>> Nils, Sean,
>>>
>>> Is it ok to create a "tools" (or "resources") repository so we could host those scripts?
>>>
>>> Also, I think it could be useful to maintain a list of clients/servers that are currently supporting WHIP/WHEP to encourage the adoption of the standard, what do you think?
>>>
>>> Best regards
>>> Sergio
>>>
>>> On Tue, Jan 17, 2023 at 8:47 AM Jonas Birme <jonas.birme@eyevinn.se> wrote:
>>> Hi,
>>>
>>> Just wanted let you all now that I have started with this work. Is there a GitHub repository where I can push my work and for feedback?
>>>
>>> Best regards,
>>>   Jonas
>>>
>>>> 20 dec. 2022 kl. 13:52 skrev Jonas Birme <jonas.birme@eyevinn.se>:
>>>>
>>>> 
>>>> Hi,
>>>>
>>>>
>>>>
>>>> I was thinking both but would start with scripts to verify server endpoints. My GitHub username is birme if you want to invite me to the github repo once created.
>>>>
>>>>
>>>>
>>>> Best regards,
>>>>
>>>>   Jonas
>>>>
>>>> --
>>>>
>>>> Jonas Birmé
>>>>
>>>> VP R&D Eyevinn Technology
>>>>
>>>> M: +46 70 304 7660
>>>>
>>>>
>>>>
>>>> Från: Wish <wish-bounces@ietf.org> för Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com>
>>>> Datum: tisdag, 20 december 2022 10:52
>>>> Till: Jonas Birme <jonas.birme=40eyevinn.se@dmarc.ietf.org>
>>>> Kopia: wish@ietf.org <wish@ietf.org>, Nils Ohlmeier <nils.ohlmeier@8x8.com>, Sean Turner <sean@sn3rd.com>
>>>> Ämne: Re: [Wish] Conformance test scripts
>>>>
>>>> Hi Jonas,
>>>>
>>>>
>>>>
>>>> The scripts would be for testing server side implementation, client side, or both? I think it would be great to have this kind of resources,
>>>>
>>>>
>>>>
>>>> Nils, Sean, should we create a new repo under the wish wg github org for hosting this?
>>>>
>>>>
>>>>
>>>> Best regards
>>>>
>>>> Sergio
>>>>
>>>>
>>>>
>>>> On Fri, Dec 16, 2022 at 9:07 AM Jonas Birme <jonas.birme=40eyevinn.se@dmarc.ietf.org> wrote:
>>>>
>>>> Hi,
>>>>
>>>>
>>>>
>>>> If not anyone has already started the imitative to develop conformance test scripts for WHIP (and WHEP) I’d be happy to contribute with that. In that case, is there any GitHub repo where I can provide a PR to?
>>>>
>>>>
>>>>
>>>> Best regards,
>>>>
>>>>   Jonas
>>>>
>>>> --
>>>>
>>>> Jonas Birmé
>>>>
>>>> VP R&D Eyevinn Technology
>>>>
>>>> M: +46 70 304 7660
>>>>
>>>> --
>>>> Wish mailing list
>>>> Wish@ietf.org
>>>> https://www.ietf.org/mailman/listinfo/wish
>>>>
>>
>