Re: [Wish] Conformance test scripts

Sean Turner <sean@sn3rd.com> Tue, 31 January 2023 15:23 UTC

Return-Path: <sean@sn3rd.com>
X-Original-To: wish@ietfa.amsl.com
Delivered-To: wish@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BDB3BC1526FB for <wish@ietfa.amsl.com>; Tue, 31 Jan 2023 07:23:34 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.097
X-Spam-Level:
X-Spam-Status: No, score=-7.097 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=unavailable autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=sn3rd.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Bbh_6HaMtA49 for <wish@ietfa.amsl.com>; Tue, 31 Jan 2023 07:23:29 -0800 (PST)
Received: from mail-yw1-x112a.google.com (mail-yw1-x112a.google.com [IPv6:2607:f8b0:4864:20::112a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B5B1FC1516EA for <wish@ietf.org>; Tue, 31 Jan 2023 07:23:29 -0800 (PST)
Received: by mail-yw1-x112a.google.com with SMTP id 00721157ae682-50aa54cc7c0so180145957b3.8 for <wish@ietf.org>; Tue, 31 Jan 2023 07:23:29 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sn3rd.com; s=google; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=Xu8fnRZRFXt1KDKk2tgSLgI11GEUmtyZLkgp+B4bons=; b=jKSUjuspj0HAisxM7U+5wtkAj2hcK/ebP1bu6EY5vxjZXufnoj76OMyyehY0l7hE8U LEkv1Mry7/4hBMhySzWgWYSVP4Ow3SFUU/aHl6q6sWx5hnbrKONRZp8svVIuPww0tPdw qXhkbBvLOq1sHeOIe17m4X2e63Yf+Z5WWin9w=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=Xu8fnRZRFXt1KDKk2tgSLgI11GEUmtyZLkgp+B4bons=; b=B97e1bUFjOzPRCTw1JegET1Mmw9cbHOo5VxsvinYMns+Rj1CjpJvRaBw8stW6SDaFd ez+xcPuHsqgwW4q/VsrF/dnVkFysNa+1I4Q4r1TS4HIcG2YmYyW3fAcE/p/a5A+ST7Oa XSnx6k0oAcofx2Fy4cjZ4MYxmV1qikWpZ56UZABPhuoG5nBi8Et4dzCRfRskredROajN E76gEZeKiL5jNYCHg6kO7g0IJTJC/pgIEb+q06+kh0CczTjRhcpnaqsLOxBeTHX5rvIw 9Ly1mOukxWLhMHjHXemJQES7FWwIe7NSxPWpXIwjSHiDVptdz3u8JDrm4m4RX0koQp0T I/FQ==
X-Gm-Message-State: AO0yUKVFrjFYO5g7BpJxjUPJiIAqGHl0wPpjEOAwxkf/Qg4L5DV8TEs1 nMCFWoyzAoIaNcm6UfdrCzGdOjOvmDVhMzPw
X-Google-Smtp-Source: AK7set9hqZpTUUypfMoVQSAkQ+TjcvL68oF0sisvQURc6P1JnZU+bpI885KITZw/kC3MtZtnpTekJA==
X-Received: by 2002:a81:4f06:0:b0:514:beff:dd59 with SMTP id d6-20020a814f06000000b00514beffdd59mr6820048ywb.43.1675178608839; Tue, 31 Jan 2023 07:23:28 -0800 (PST)
Received: from smtpclient.apple ([2600:4040:253b:7300:3d35:7f90:cff0:1e39]) by smtp.gmail.com with ESMTPSA id x27-20020a05620a099b00b006fcb77f3bd6sm2797820qkx.98.2023.01.31.07.23.28 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 31 Jan 2023 07:23:28 -0800 (PST)
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.14\))
From: Sean Turner <sean@sn3rd.com>
In-Reply-To: <MM0P280MB0248D2ABAB1A3E4D2E29F17E82CE9@MM0P280MB0248.SWEP280.PROD.OUTLOOK.COM>
Date: Tue, 31 Jan 2023 10:23:27 -0500
Cc: Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com>, Jonas Birme <jonas.birme=40eyevinn.se@dmarc.ietf.org>, WISH List <wish@ietf.org>, Nils Ohlmeier <nils.ohlmeier@8x8.com>
Content-Transfer-Encoding: quoted-printable
Message-Id: <FEA07D91-AF58-4F7E-A1A3-7877DDA7FE71@sn3rd.com>
References: <MM0P280MB0248369814BF8C3B43CC29CD82E69@MM0P280MB0248.SWEP280.PROD.OUTLOOK.COM> <CA+ag07ZtYB3jHRDjJYtT5fx8E5021LUnjSDRsMoWcyTAsoX9zQ@mail.gmail.com> <MM0P280MB0248C0B7759CB0FB5EDABAF482EA9@MM0P280MB0248.SWEP280.PROD.OUTLOOK.COM> <BBE58ADB-FECE-4AE5-AEF1-9C2043897CD5@eyevinn.se> <CA+ag07YHRAdwZwxBHWavJoEddEPxt_S7Uc8Gn0Jsx0B41ua5ig@mail.gmail.com> <3F1A8E2F-F899-44BD-ADEE-4D664D996612@sn3rd.com> <CA+ag07Y2HupamGt9QfafQ-O_+GsvwA_YjHrWMbtQrmo2iP6OYA@mail.gmail.com> <350DC47A-4FAD-4F45-8EED-7212667369F9@sn3rd.com> <6BD5E14C-E368-481B-AD62-0F9AF1AFF0BC@sn3rd.com> <MM0P280MB0248D2ABAB1A3E4D2E29F17E82CE9@MM0P280MB0248.SWEP280.PROD.OUTLOOK.COM>
To: Jonas Birme <jonas.birme@eyevinn.se>
X-Mailer: Apple Mail (2.3654.120.0.1.14)
Archived-At: <https://mailarchive.ietf.org/arch/msg/wish/uQO81ECjBrlxcyavEZAzTa82W5M>
Subject: Re: [Wish] Conformance test scripts
X-BeenThere: wish@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: WebRTC Ingest Signaling over HTTPS <wish.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/wish>, <mailto:wish-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/wish/>
List-Post: <mailto:wish@ietf.org>
List-Help: <mailto:wish-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/wish>, <mailto:wish-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 31 Jan 2023 15:23:34 -0000

I went ahead and merged that. If that was a mistake please let me know.

spt

> On Jan 25, 2023, at 05:33, Jonas Birme <jonas.birme@eyevinn.se> wrote:
> 
> Thanks,
>  
> I’ve opened a PR with what I have done so far related to conformance test scripts:https://github.com/wish-wg/resources/pull/1
>  
> Best regards,
>    Jonas
> -- 
> Jonas Birmé
> VP R&D Eyevinn Technology
> M: +46 70 304 7660
>  
> Från: Sean Turner <sean@sn3rd.com>
> Datum: onsdag, 25 januari 2023 05:21
> Till: Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com>
> Kopia: Jonas Birme <jonas.birme@eyevinn.se>, Jonas Birme <jonas.birme=40eyevinn.se@dmarc.ietf.org>, WISH List <wish@ietf.org>, Nils Ohlmeier <nils.ohlmeier@8x8.com>
> Ämne: Re: [Wish] Conformance test scripts
> 
> Done:
> https://github.com/wish-wg/resources
> 
> spt
> 
> > On Jan 24, 2023, at 10:04, Sean Turner <sean@sn3rd.com> wrote:
> > 
> > I will put it on my list!
> > 
> > spt
> > 
> >> On Jan 24, 2023, at 03:36, Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com> wrote:
> >> 
> >> I think "resources" will be fine for now. We can rename later if we feel that it should have a different name.
> >> 
> >> Best regards
> >> Sergio
> >> 
> >> On Thu, Jan 19, 2023 at 3:51 PM Sean Turner <sean@sn3rd.com> wrote:
> >> Yeah that would be fine. Which name would you prefer?
> >> 
> >> spt
> >> 
> >>> On Jan 17, 2023, at 03:06, Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com> wrote:
> >>> 
> >>> Nils, Sean,
> >>> 
> >>> Is it ok to create a "tools" (or "resources") repository so we could host those scripts?
> >>> 
> >>> Also, I think it could be useful to maintain a list of clients/servers that are currently supporting WHIP/WHEP to encourage the adoption of the standard, what do you think?
> >>> 
> >>> Best regards
> >>> Sergio
> >>> 
> >>> On Tue, Jan 17, 2023 at 8:47 AM Jonas Birme <jonas.birme@eyevinn.se> wrote:
> >>> Hi,
> >>> 
> >>> Just wanted let you all now that I have started with this work. Is there a GitHub repository where I can push my work and for feedback?
> >>> 
> >>> Best regards,
> >>>   Jonas
> >>> 
> >>>> 20 dec. 2022 kl. 13:52 skrev Jonas Birme <jonas.birme@eyevinn.se>:
> >>>> 
> >>>> 
> >>>> Hi,
> >>>> 
> >>>> 
> >>>> 
> >>>> I was thinking both but would start with scripts to verify server endpoints. My GitHub username is birme if you want to invite me to the github repo once created.
> >>>> 
> >>>> 
> >>>> 
> >>>> Best regards,
> >>>> 
> >>>>   Jonas
> >>>> 
> >>>> -- 
> >>>> 
> >>>> Jonas Birmé
> >>>> 
> >>>> VP R&D Eyevinn Technology
> >>>> 
> >>>> M: +46 70 304 7660
> >>>> 
> >>>> 
> >>>> 
> >>>> Från: Wish <wish-bounces@ietf.org> för Sergio Garcia Murillo <sergio.garcia.murillo@gmail.com>
> >>>> Datum: tisdag, 20 december 2022 10:52
> >>>> Till: Jonas Birme <jonas.birme=40eyevinn.se@dmarc.ietf.org>
> >>>> Kopia: wish@ietf.org <wish@ietf.org>, Nils Ohlmeier <nils.ohlmeier@8x8.com>, Sean Turner <sean@sn3rd.com>
> >>>> Ämne: Re: [Wish] Conformance test scripts
> >>>> 
> >>>> Hi Jonas,
> >>>> 
> >>>> 
> >>>> 
> >>>> The scripts would be for testing server side implementation, client side, or both? I think it would be great to have this kind of resources,
> >>>> 
> >>>> 
> >>>> 
> >>>> Nils, Sean, should we create a new repo under the wish wg github org for hosting this?
> >>>> 
> >>>> 
> >>>> 
> >>>> Best regards
> >>>> 
> >>>> Sergio
> >>>> 
> >>>> 
> >>>> 
> >>>> On Fri, Dec 16, 2022 at 9:07 AM Jonas Birme <jonas.birme=40eyevinn.se@dmarc.ietf.org> wrote:
> >>>> 
> >>>> Hi,
> >>>> 
> >>>> 
> >>>> 
> >>>> If not anyone has already started the imitative to develop conformance test scripts for WHIP (and WHEP) I’d be happy to contribute with that. In that case, is there any GitHub repo where I can provide a PR to?
> >>>> 
> >>>> 
> >>>> 
> >>>> Best regards,
> >>>> 
> >>>>   Jonas
> >>>> 
> >>>> -- 
> >>>> 
> >>>> Jonas Birmé
> >>>> 
> >>>> VP R&D Eyevinn Technology
> >>>> 
> >>>> M: +46 70 304 7660
> >>>> 
> >>>> -- 
> >>>> Wish mailing list
> >>>> Wish@ietf.org
> >>>> https://www.ietf.org/mailman/listinfo/wish
> >>>> 
> >> 
> > 
>