Re: [fdt] [Webtransport] Standards for protocol headers?

Stephen McQuistin <Stephen.McQuistin@glasgow.ac.uk> Sat, 13 June 2020 12:08 UTC

Return-Path: <Stephen.McQuistin@glasgow.ac.uk>
X-Original-To: fdt@ietfa.amsl.com
Delivered-To: fdt@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 212AF3A0840; Sat, 13 Jun 2020 05:08:05 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.894
X-Spam-Level:
X-Spam-Status: No, score=-1.894 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=gla.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id C_bqTgPvhaxC; Sat, 13 Jun 2020 05:08:02 -0700 (PDT)
Received: from plockton.cent.gla.ac.uk (plockton.cent.gla.ac.uk [130.209.16.75]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1A5003A0845; Sat, 13 Jun 2020 05:08:00 -0700 (PDT)
Received: from cas08.campus.gla.ac.uk ([130.209.14.165]) by plockton.cent.gla.ac.uk with esmtp (Exim 4.72) (envelope-from <Stephen.McQuistin@glasgow.ac.uk>) id 1jk4x4-0007Ad-7t; Sat, 13 Jun 2020 13:07:58 +0100
Received: from CAS08.campus.gla.ac.uk (130.209.14.165) by cas08.campus.gla.ac.uk (130.209.14.165) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Sat, 13 Jun 2020 13:07:56 +0100
Received: from GBR01-LO2-obe.outbound.protection.outlook.com (104.47.21.51) by CAS08.campus.gla.ac.uk (130.209.14.165) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Sat, 13 Jun 2020 13:07:56 +0100
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=JQZRVJ9yodpVBiY5nnGQ7xQnAhXGwNxTlzHOC+6KhvJq1Ati0ZeudW3zwx6vpNy28usN3i+H+G/UpgxQccBV+3YnpeVV7+P506QfgguhOWmH43iatrnQQ2IoMqKzFyg8nXauSIp6r32UXfSphi2KSfwoPhH5HLbCQklhkrlRngPuBUF3A8/WVOI8/zNfD1zwvQYQMpycy5RWM7i0c5RGQ7esnfd7hnR1XmLoZCbF222E2bZKcr2bQ+/mBxnPHhG723tZ6r4VQk69/KlDo2vYdWQdsqniq4bd1cil270hYwBYDhDJH/f//rTpz4w1qZxoKKmlnAQNR23kutazlzGwTA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=R7vv3T+SPrJDQ/mISJ2bSgy8sg2mFzhEJclZw61sswA=; b=acnEeJSPMgsTBJNxvbqSyZdZDp7f+UnAC1d4RUUaAdy/5T10HzYV5OBBDtXC28wnuBs/nLKAmPDtqOnKvLfn6QdS9hdQ1jUThRrvVZC6GGL3nGDl/lydddUyLEgQLNaX8czGnLgbrf7S8WkIQoeeTc/w4PQxuC0vMBoA2m6gejqzMjR8MBLu7B4ObWfmhiunKqNx/nR0EkDeLExdl5n5Uk9WkeFQKGe5CdH+q10AJYPpt1FjenxCmz/SUGTfMcXMM35SoHT1O1tXeFNClER3E6hgsI4SaX8zD/6YxtCDaimMaLNzWwDvhF9izloBnggkG6xwcfgHmMwOSvWnmegCTw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=glasgow.ac.uk; dmarc=pass action=none header.from=glasgow.ac.uk; dkim=pass header.d=glasgow.ac.uk; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gla.onmicrosoft.com; s=selector2-gla-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=R7vv3T+SPrJDQ/mISJ2bSgy8sg2mFzhEJclZw61sswA=; b=oJ4DLkZmFm8BAA+Fj5RR2+0ioCg2cbD9YYetistbFWvss6bFfh5yl+8mfECPkFevBIPsA942/kxrJYoxS0ELqc6+sVffyF2kuN0BpqerbTztlgfZ9JOcYUc0uAFenUA6Yt+4FZ6eC0XKWg5H4aNGHmxHE/Tdctq4dOr+Nu9iWsE=
Received: from LNXP265MB0827.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:1d::22) by LNXP265MB0314.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:1d::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3088.24; Sat, 13 Jun 2020 12:07:56 +0000
Received: from LNXP265MB0827.GBRP265.PROD.OUTLOOK.COM ([fe80::3190:f704:b62f:7371]) by LNXP265MB0827.GBRP265.PROD.OUTLOOK.COM ([fe80::3190:f704:b62f:7371%7]) with mapi id 15.20.3088.025; Sat, 13 Jun 2020 12:07:56 +0000
From: Stephen McQuistin <Stephen.McQuistin@glasgow.ac.uk>
To: Scott Morgan <scott@adligo.com>
CC: "fdt@ietf.org" <fdt@ietf.org>, "webtransport@ietf.org" <webtransport@ietf.org>
Thread-Topic: [fdt] [Webtransport] Standards for protocol headers?
Thread-Index: AQHWQXtF2VgPKOyIBkShMpks519YkA==
Date: Sat, 13 Jun 2020 12:07:55 +0000
Message-ID: <9796F6C9-ABB9-4AD4-ADA0-A6E275DAE3EE@glasgow.ac.uk>
References: <CANEdHmhypZE01SHw--UgrpG1yuOU67cKXHv0Jbecyb7sJzYPZA@mail.gmail.com> <2804eb55-e79a-3383-9ebf-cd4f495b273a@petit-huguenin.org> <CANEdHmhPWwO-pO7D_biTQ1_b5oh3xCsdXEi7Urf8sXJQcvVVGw@mail.gmail.com> <ecabce9e-d09f-6ce1-cd17-dea1e793a4cf@acm.org> <CANEdHmiZVdx93Sj1xf6wKPhoBxWGTB9q_WbesJx5FJ26Q0Jzjg@mail.gmail.com>
In-Reply-To: <CANEdHmiZVdx93Sj1xf6wKPhoBxWGTB9q_WbesJx5FJ26Q0Jzjg@mail.gmail.com>
Accept-Language: en-GB, en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: adligo.com; dkim=none (message not signed) header.d=none;adligo.com; dmarc=none action=none header.from=glasgow.ac.uk;
x-originating-ip: [81.157.158.157]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 2b01b35b-dbef-44b4-21c6-08d80f92682c
x-ms-traffictypediagnostic: LNXP265MB0314:
x-microsoft-antispam-prvs: <LNXP265MB0314615BA44E97B427E66164BC9E0@LNXP265MB0314.GBRP265.PROD.OUTLOOK.COM>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-forefront-prvs: 0433DB2766
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: gTbwpSF0vpVqX1SSJCyx0FfwZF9kghv/rMuT3x1daPC0BG8t7MphRa+75avgsUTJn+U0J5GJr3X1sRQBaK8XctHWNqNwZqV+o3ASPvPyUdap7lZiYXPzIYrrIvHWdJEdCr8rP4Ism8dpolHqzjiIOR7nQ4VBDRTw1Hb7v6oZ7/nDLaVesv4SoXKXpJvvv7nOiVVzOkBUtODJQzLncJBOKq5/g7bazzcQfzy9q7nRxHW+zFRfhCkB4tVbqO/3WDePxb+UXVfNdQzSHzzO8cPqJf10DiWNCAogz5W4Q0OPtQFPXrlCS+wp7zrIGeiLQgSynC/imTep+aLXcZeLNu6mPHdZ8DxSDeKN+Qj4a0NOASbob4cBS8foPRwFDZxzXcVDGZTUh3dh1IdkIlFG86LPtA==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:LNXP265MB0827.GBRP265.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFTY:; SFS:(136003)(396003)(366004)(39860400002)(346002)(376002)(66476007)(66556008)(26005)(53546011)(6506007)(45080400002)(66946007)(6512007)(64756008)(66446008)(316002)(166002)(33656002)(76116006)(8936002)(36756003)(4326008)(786003)(83380400001)(54906003)(6916009)(6486002)(478600001)(2906002)(8676002)(86362001)(71200400001)(966005)(186003)(2616005)(5660300002); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata: K406omGpKaT+wRRzNkkvmba4Xki/Qwy2CFRTkxF3ZyuypBVcvRomYQLlU4POcT0pQ5Q36Vz6n6qzSFqN5oc3m5XgDiD63VhPmdEV9LqrS0zRiO33iSjsRMbQTtfR8iI4tdUY2mVJcN4dFNa6zkbB1Wd3j5KELno9CM28Vzv1fvb/CQHQOs7XXywKYD5T+cR4UjVzQiIa2mpS9co3W7JhRuNQ58fsvoyc/G54f353DfagtlJHDT40PbLkiBO7X9uwY512fUPXw2UndWNM6h3BvjGIyKDGS88m/scaabDD5UlhEXvP1MBhJro8Rd5i30rfmruDKhLbZmIesymT3cmhq+u+tkTu9ToLBYjPw7e+rvt/DZrH5gynqmsWpFpSAmzC/69FHhj/hYrA5NbC5vzZ19ZPdS7QWoXc4bAtSY5ShBHe50woOHSAc/JbDsaueJ2UIYjlxTbyhL5kVQDnVRDXSJgAevk84Iaaf9UFs6f0W/v/VAJFzp5r3JeZW26fVbwl
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_9796F6C9ABB94AD4ADA0A6E275DAE3EEglasgowacuk_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 2b01b35b-dbef-44b4-21c6-08d80f92682c
X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Jun 2020 12:07:55.8680 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 6e725c29-763a-4f50-81f2-2e254f0133c8
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: B8Yf9OJPtYQ5U9kqlGJrdapCpreHLmZ1pKN2LUnp0xpoJ5e3vnzcaVlpsF5SdvbiIbQ4wnE5KyhY46sDsuMQOCN/ZQnNEbg0wVOxkxSFRaw=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: LNXP265MB0314
X-OriginatorOrg: glasgow.ac.uk
Archived-At: <https://mailarchive.ietf.org/arch/msg/fdt/xWg1oh6_eZdDRmw_12X0LnEK3KA>
Subject: Re: [fdt] [Webtransport] Standards for protocol headers?
X-BeenThere: fdt@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Mailing list for the discussion of the use of formal description techniques in IETF documents <fdt.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/fdt>, <mailto:fdt-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/fdt/>
List-Post: <mailto:fdt@ietf.org>
List-Help: <mailto:fdt-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/fdt>, <mailto:fdt-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 13 Jun 2020 12:08:05 -0000

Hi Scott,

We have a draft (draft-mcquistin-augmented-ascii-diagrams) that is looking to add tooling (e.g., to generate parser code) around “traditional” packet header diagrams, by using a consistent format for both the diagram and the text that accompanies it.

In terms of other PDU description languages, the recent QUIC drafts have replaced packet diagrams with a bespoke description language: https://tools.ietf.org/html/draft-ietf-quic-transport-29#section-1.3.

These are both much simpler than the languages that Marc mentioned, and only deal with PDU description rather than data layout description more generally, but might be worth a look.

Thanks,

Stephen

On 13 Jun 2020, at 01:53, Scott Morgan <scott@adligo.com<mailto:scott@adligo.com>> wrote:

Hi Marc,

   Thanks, I'm not trying to be intentionally confusing :)  In an attempt to clarify, I'm trying to create a new structured PDU format that could be used to define PDU description languages (not a primary concern) as well as larger data structures like files or bytes in datagrams.
https://en.wikipedia.org/wiki/Protocol_data_unit

Lets continue @ fdt@ietf.org<mailto:fdt@ietf.org> !

Cheers,
Scott

---------- Forwarded message ---------
From: Marc Petit-Huguenin <petithug@acm.org<mailto:petithug@acm.org>>
Date: Fri, Jun 12, 2020 at 10:03 AM
Subject: Re: [Webtransport] Standards for protocol headers?
To: Scott Morgan <scott@adligo.com<mailto:scott@adligo.com>>, <webtransport@ietf.org<mailto:webtransport@ietf.org>>


Hi Scott,

I still find your terminology confusing.  I am not sure if you are proposing to design a new PDU description language (ala ASN.1, ABNF, RBNF, CDDL, XML RELAX, etc..) or a new structured PDU format (ala DER, BER, XML, JSON, CBOR, etc...).  If it is the former, I would suggest to resend your email to fdt@ietf.org<mailto:fdt@ietf.org>, where we discuss this kind of things.

Thanks.

On 6/12/20 7:25 AM, Scott Morgan wrote:
> Hi Marc,
>
>    Thanks for responding!  I meant 'protocol header' in the broadest
> sense.  I have implemented some protocols in the past (Web Socket v13, SMTP
> etc) and work a lot with JSON and XML as I mentioned previously.  Here are
> some general frustrations (i.e. problem statement) that I'm looking to
> overcome;
>
> 1) JSON and XML generally lack support for binary data (there are some
> workarounds but nothing is super great).
> 2) JSON and XML both now have the concept of a Schema
>          Note I think the concept of a Schema is a good thing but also feel
> that Schemas often don't cover all
>      Metadata that needs to be covered.  Perhaps the concept of a Schema
> needs to be enhanced by UsageMetadata information.
>          Also note I am frustrated with JSON's inability to provide human
> readable schemas (multi line text in the .json file (not /n)).
>          I also have frustrations with XML schemas and XML (like everyone
> else who now favors JSON over XML)
> 3) Protocol's often have Headers and other information which act in a
> similar fashion to Schemas (i.e. they describe / specify data structures)
>
>   I'm wondering if it's time for a new markup language that can support
> binary data and assist in specifying protocol byte segments in addition to
> more general purpose transport and storage data (like JSON & XML do).
>   I'm thinking about calling it 'Classification Markup Notation'.
>
>   I messaged this to the group just to throw the idea out there, to get
> feedback and also to find collaborators.
>
>
> On Thu, Jun 11, 2020 at 7:53 AM Marc Petit-Huguenin <marc@petit-huguenin.org<mailto:marc@petit-huguenin.org>>
> wrote:
>
>> Hi,
>>
>> On 6/10/20 5:14 PM, Scott Morgan wrote:
>>> Hi All,
>>>
>>>    I have been working with JSON, XML and some protocol headers recently
>>> and I am wondering...
>>> Why are there no real standard text formats for protocol headers, or am I
>>> missing something?
>>>
>>> It seems to me that a slightly more streamlined/optimal binary/markup
>>> standard could help protocols attain POCs and adoption much quicker and
>>> help reduce some of the work defining protocols.
>>>
>>> Any thoughts on this topic?
>>>
>>>
>>
>> Can you please elaborate on what you mean by "protocol header"?  My
>> understanding of that term is the fixed part at the beginning of a PDU, PDU
>> that also contains a variable length part after it (as in UDP Header, TCP
>> Header, RTP Header, HTTP, SIP, SMTP etc...), but that definition does not
>> seem to apply to JSON or XML (as a whole).
>>

--
Marc Petit-Huguenin
Email: marc@petit-huguenin.org<mailto:marc@petit-huguenin.org>
Blog: https://marc.petit-huguenin.org<https://marc.petit-huguenin.org/>
Profile: https://www.linkedin.com/in/petithug



--
Regards,
Scott Morgan
President & CEO
Adligo Inc
http://www.adligo.com<http://www.adligo.com/>
https://www.linkedin.com/in/scott-morgan-21739415
A+ Better Business Bureau Rating<https://www.bbb.org/chicago/business-reviews/computer-software-publishers-and-developers/adligo-inc-in-chicago-il-88381256>
https://github.com/adligo

By Appointment Only:
1-866-968-1893 Ex 101
scott@adligo.com<mailto:scott@adligo.com>
skype:adligo1?call
Send Me Files Securely:
https://www.sendthisfile.com/f.jsp?id=ewOnyeFQM18IDRf7MMIdolfI



<signature.asc>--
FDT mailing list
FDT@ietf.org<mailto:FDT@ietf.org>
https://www.ietf.org/mailman/listinfo/fdt