Re: [Detnet] Question about using blockchain as DetNe use case

"Grossman, Ethan A." <eagros@dolby.com> Sat, 15 December 2018 00:27 UTC

Return-Path: <eagros@dolby.com>
X-Original-To: detnet@ietfa.amsl.com
Delivered-To: detnet@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1131C131394 for <detnet@ietfa.amsl.com>; Fri, 14 Dec 2018 16:27:45 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.999
X-Spam-Level:
X-Spam-Status: No, score=-1.999 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=dolby.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id WVK9dHDuzOPN for <detnet@ietfa.amsl.com>; Fri, 14 Dec 2018 16:27:41 -0800 (PST)
Received: from NAM03-BY2-obe.outbound.protection.outlook.com (mail-eopbgr780125.outbound.protection.outlook.com [40.107.78.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2352C130EED for <detnet@ietf.org>; Fri, 14 Dec 2018 16:27:41 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dolby.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=c/NQA9ngSX4dOkpaBXyGBZc0zZRy6ogATNj2CB7Fh9U=; b=BYrZrNDn8TWBJOdEYV8bPKvQqAio1EylsdNDgh3x0l2Ic8+4xJl4DVElSlRAjv2bR5szIQYRgb37pnUyo/CCaN2BnrTv7yieQXEOz+jWnczN1J4FHlu9YQoJkdcsEhBnO+T4LKrMr9T5BSSbBnZiLvQMamROVbafWgneNb668wE=
Received: from CY1PR0601MB1408.namprd06.prod.outlook.com (10.163.21.157) by CY1PR0601MB1353.namprd06.prod.outlook.com (10.161.212.11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1404.22; Sat, 15 Dec 2018 00:27:37 +0000
Received: from CY1PR0601MB1408.namprd06.prod.outlook.com ([fe80::cd6:dfe5:24c1:757d]) by CY1PR0601MB1408.namprd06.prod.outlook.com ([fe80::cd6:dfe5:24c1:757d%4]) with mapi id 15.20.1425.021; Sat, 15 Dec 2018 00:27:37 +0000
From: "Grossman, Ethan A." <eagros@dolby.com>
To: "huang.guangping@zte.com.cn" <huang.guangping@zte.com.cn>
CC: "detnet@ietf.org" <detnet@ietf.org>, Ben Campbell <ben@nostrum.com>
Thread-Topic: Re: [Detnet] Question about using blockchain as DetNe use case
Thread-Index: AdNefTmgyaH4TMSNTWe00bGvTTMiegASjfkAACGLhdEAEldgAE0cQYmg
Date: Sat, 15 Dec 2018 00:27:37 +0000
Message-ID: <CY1PR0601MB14080E94FF2631C4DEC5AC3BC4A20@CY1PR0601MB1408.namprd06.prod.outlook.com>
References: 3DF0466E9510274382F5B74499ACD6F8CEA56F@DFWPML704-CHM.exmail.huawei.com, 201711161041226835920@zte.com.cn, 3DF0466E9510274382F5B74499ACD6F8CEA750@DFWPML704-CHM.exmail.huawei.com <201711171127025317974@zte.com.cn>
In-Reply-To: <201711171127025317974@zte.com.cn>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-dg-ref: PG1ldGE+PGF0IG5tPSJpbWFnZTAwMS5naWYiIHA9IiIgc3o9IjAiIHQ9IjAiIGg9IiIgaWQ9IiIgYmw9IjAiIGJvPSIwIi8+PGF0IG5tPSJpbWFnZTAwMi5naWYiIHA9IiIgc3o9IjAiIHQ9IjAiIGg9IiIgaWQ9IiIgYmw9IjAiIGJvPSIwIi8+PGF0IG5tPSJpbWFnZTAwMS5naWYiIHA9ImM6XHVzZXJzXGVhZ3Jvc1xhcHBkYXRhXGxvY2FsXG1pY3Jvc29mdFx3aW5kb3dzXHRlbXBvcmFyeSBpbnRlcm5ldCBmaWxlc1xjb250ZW50Lm91dGxvb2tcb3c4cXI2cHJcaW1hZ2UwMDEuZ2lmIiBzej0iMCIgdD0iMTMxODkzMDYyMjE5NjE2NDg0IiBoPSJReU52Y2tCZGFGTjJ1M1ZCTDFTd2dmRVpQYzA9IiBpZD0iIiBibD0iMCIgYm89IjAiLz48YXQgbm09ImltYWdlMDAyLmdpZiIgcD0iYzpcdXNlcnNcZWFncm9zXGFwcGRhdGFcbG9jYWxcbWljcm9zb2Z0XHdpbmRvd3NcdGVtcG9yYXJ5IGludGVybmV0IGZpbGVzXGNvbnRlbnQub3V0bG9va1xvdzhxcjZwclxpbWFnZTAwMi5naWYiIHN6PSIwIiB0PSIxMzE4OTMwNjIyMTk4MTY0ODIiIGg9InJUTk5lQjlTN2pNSm96WUlNZlNTQ2tZb1NPaz0iIGlkPSIiIGJsPSIwIiBibz0iMCIvPjxhdCBubT0iYm9keS5odG1sIiBwPSJjOlx1c2Vyc1xlYWdyb3NcYXBwZGF0YVxyb2FtaW5nXDA5ZDg0OWI2LTMyZDMtNGE0MC04NWVlLTZiODRiYTI5ZTM1Ylxtc2dzXG1zZy0zMjI3ZTI1Yy0wMDAwLTExZTktODIwOS1hY2JjMzI3YTUxYzZcYW1lLXRlc3RcMzIyN2UyNWQtMDAwMC0xMWU5LTgyMDktYWNiYzMyN2E1MWM2Ym9keS5odG1sIiBzej0iMjcxMTYiIHQ9IjEzMTg5MzA3MjUxOTE4NDg2NyIgaD0iQ3hmVjg4ZFhWQ2QyK1VRUXRxRGtTdkMwVzhFPSIgaWQ9IiIgYmw9IjAiIGJvPSIxIi8+PC9tZXRhPg==
authentication-results: spf=none (sender IP is ) smtp.mailfrom=eagros@dolby.com;
x-originating-ip: [136.179.10.143]
x-ms-publictraffictype: Email
x-microsoft-exchange-diagnostics: 1; CY1PR0601MB1353; 6:87KJSyQ7svyRhYMVyFglBS5+dZ/B0VBZwSCCtDHWtLCC0pxkhm8txBy9T6mqaVxu/3gq6+Qz3Srm9Pt9z/UNZQlQXFwCJVud7GzsCmAlrnhFUhIQRGt8cmsm/YGhweN1E1Q6LQ0KhOq4VH53C+j66tmrz5nGaa6Ojiqu1fiVIGVQ3m26eYg7EyQZz7ix6CSefG8d/HAEA8qnHtrzr6G7LnRCyMc+zs6JnhtruT8aDlZfip97aRMVghQxjNkx5Ef4LfJxMUTOzdCdTBwTESehwZfpW/3KwAMJF1I5ULP3o5IHFUcNvbNz+LDOvOhUislcUMVa6Ej8M3uu/XA8yNGvqbcCCB/X721bolSbZsQUFYnKByNG94J51B94mtGnqnxWYQQLJQZH5Ya5ia4YoagZpPuMi7zbDCrK1A+x51U097VhzjjnLVDzWBTjJ32E22VOO5qCDTawW/s6b05Xhm8lhoK5BN/k9z97WiWU7yJocZg=; 5:1Oxt1vlsGSkaJuu+0COvCO1DdXsvHZ2s/X5m2s6zvu/4oxHJIuxrE+aEvz8MCsA/WLNeoMHK5bwSTcNrCX1byQLrYEq4/FQ72kkYe+9/lLhixaqwfiY7naU4bFynR5yYsuqhDxPGS+bnJLbKtK8sybcA85DDu1lz4JRff3fbZqE=; 7:6UNussCvC01WaIR2xhdTY0EtdTvG/rsjSSKQEyN5LIoTSV/4mvGophQArVl0Z0x3X/5sN+hN8suQdgDaJqVR0UeT+JhAltEeasY+mGgtpf71KnFL6GRz6YEWSR+5MGG2Z+z2cJ25KBC+GRzkeTewGw==
x-ms-exchange-antispam-srfa-diagnostics: SOS;
x-ms-office365-filtering-correlation-id: 5b542fda-acc0-4a69-51c6-08d662241db6
x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600074)(711020)(2017052603328)(7153060)(49563074)(7193020); SRVR:CY1PR0601MB1353;
x-ms-traffictypediagnostic: CY1PR0601MB1353:
x-microsoft-antispam-prvs: <CY1PR0601MB13531FD9E57FACC0BF3422A7C4A20@CY1PR0601MB1353.namprd06.prod.outlook.com>
x-ms-exchange-senderadcheck: 1
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(3230021)(999002)(102415395)(6040522)(2401047)(5005006)(8121501046)(3231475)(944501520)(4983020)(52105112)(93006095)(93001095)(10201501046)(3002001)(148016)(149066)(150057)(6041310)(20161123560045)(20161123562045)(20161123564045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123558120)(201708071742011)(7699051)(76991095); SRVR:CY1PR0601MB1353; BCL:0; PCL:0; RULEID:; SRVR:CY1PR0601MB1353;
x-forefront-prvs: 088751B4D4
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(396003)(136003)(366004)(346002)(376002)(39860400002)(189003)(199004)(51914003)(6116002)(3846002)(790700001)(6506007)(105586002)(53546011)(6306002)(54896002)(54556002)(55016002)(74316002)(14454004)(99936001)(102836004)(486006)(2906002)(26005)(236005)(9686003)(106356001)(446003)(2351001)(551934003)(6916009)(7696005)(54906003)(11346002)(316002)(97736004)(2501003)(7736002)(93886005)(33656002)(76176011)(5640700003)(14444005)(256004)(25786009)(186003)(86362001)(9326002)(81166006)(8936002)(4326008)(81156014)(66066001)(8676002)(606006)(99286004)(6436002)(476003)(5660300001)(478600001)(53936002)(68736007)(733005)(229853002)(71200400001)(71190400001)(66574012)(6246003); DIR:OUT; SFP:1102; SCL:1; SRVR:CY1PR0601MB1353; H:CY1PR0601MB1408.namprd06.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1;
received-spf: None (protection.outlook.com: dolby.com does not designate permitted sender hosts)
x-microsoft-antispam-message-info: 6ALVU1X0mimolIryRJWmEo4NFnjT/iYRMfFav6Jj+OrGngET+MhZaWbEGecOUijiiN6f1J0T8PzE8KRmCazjWMpxxe1fZIZDx11sqYuz8QAUrIskGaZQny7OB2TzPnSVdEg3VJlMMK5PRO1QE0elh2me60CLtzQ6r+Tk8RB7JCgHjVaqwlhEx05mLK2bIrICQrLVbLtn1z6shmunZ0kgr/jpWXQmRIufvcdBcYKi4Ss8TwiC6H820XBDhhTlTZOdkOGRDhWtSrBTOXCjgOu0HEpl5H89nMhRcTsZDRJ2vLBOWyxNseCRZ2tuxPVRC5fj
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/related; boundary="_005_CY1PR0601MB14080E94FF2631C4DEC5AC3BC4A20CY1PR0601MB1408_"; type="multipart/alternative"
MIME-Version: 1.0
X-OriginatorOrg: dolby.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 5b542fda-acc0-4a69-51c6-08d662241db6
X-MS-Exchange-CrossTenant-originalarrivaltime: 15 Dec 2018 00:27:37.3523 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 05408d25-cd0d-40c8-8962-5462de64a318
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY1PR0601MB1353
Archived-At: <https://mailarchive.ietf.org/arch/msg/detnet/D8bcixsLqX0S7sOps6kw8z-Wa1c>
Subject: Re: [Detnet] Question about using blockchain as DetNe use case
X-BeenThere: detnet@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Discussions on Deterministic Networking BoF and Proposed WG <detnet.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/detnet>, <mailto:detnet-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/detnet/>
List-Post: <mailto:detnet@ietf.org>
List-Help: <mailto:detnet-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/detnet>, <mailto:detnet-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sat, 15 Dec 2018 00:27:45 -0000

Hi Daniel,
In the IESG review of the DetNet Use Cases draft there is a question about whether bounded worst case latency is critical to the blockchain consensus process, so I would like your view.

We understand that the consensus process will have higher throughput if the average transmission time is minimized, but is it critical that the worst case packet transmission delay (latency) be minimized and/or bounded? For example, would you rather have:

  1.  A network in which the latency values for most packets was very low, but occasionally there was a “worst case latency packet”, such that the average latency over time (i.e. including many short and a few long) was “shortest” (compared to option B below).
Or

  1.  A network in which the worst case latency was bounded, and shorter than the “worst case latency packet” time (from option A above) but the average latency over time was longer than “shortest” (from option A above). That is, this network provides lower worst-case latency but higher average latency (compared to option A above).
If your answer is “B” then please explain why. If you answer is “A” then I will modify the draft text to make this point clearer, i.e. that it is important to minimize average latency in order to optimize this application (as opposed to optimizing (and bounding) worst case latency as is the case for some of the other use cases).

The text from the draft is:
The challenge of blockchain network operation is not overall data
rates, since the volume from both block and item stays between
hundreds of bytes to a couple of mega bytes per second, but is in
transporting the blocks with minimum latency to maximize efficiency
of the blockchain consensus process.

Thanks,
Ethan.

From: huang.guangping@zte.com.cn <huang.guangping@zte.com.cn>
Sent: Thursday, November 16, 2017 7:27 PM
To: norman.finn@mail01.huawei.com
Cc: detnet@ietf.org; Grossman, Ethan A. <eagros@dolby.com>
Subject: 答复: Re: [Detnet] Question about using blockchain as DetNe use case


Norm,

Thanks for your comment.

I understand the fact the blockchain traffic is bursty would inevitably bring some waste to the reserved bandwith, which would happen in all of the scenarios where the data rate is variate.

but fortunately it's inherent in blockchain the metadata size (both the "transaction" and "blocks") is fixed or could at least be pre-calculated, so in a running blriockchain the bw reserved could be set strictly as the specified datarate rather than a maximum covering a variaty of datarates.

thanks again.











黄光平 huangguangping



预研标准部/有线研究院/有线产品经营部 Standard Preresearch Dept./Wireline Product Operation Division


[cid:image001.gif@01D493C7.3EC52730]

[cid:image002.gif@01D493C7.3EC52730]
南京市雨花区软件大道50号中兴通讯1号楼
R&D Building, ZTE Corporation Software Road No.50,
Yuhua District, Nanjing, P..R.China, 210012
M: +86 13770311052
E: huang.guangping@zte.com.cn<mailto:huang.guangping@zte.com.cn>
www.zte.com.cn<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.zte.com.cn_&d=DwMGaQ&c=lI8Zb6TzM3d1tX4iEu7bpg&r=o70oZ2kUSjKLvmrL51To4giAVx8MYGkodiHsSU6toJ4&m=99jed747zh_TTHHoFTD9ikRT6orzqEGIQ8WmUphR4XU&s=adhAU3RHBRY8ulDKY-esA7IUaEYE5h-WUuoVByw2-i4&e=>

原始邮件
发件人: <norman.finn@mail01.huawei.com<mailto:norman.finn@mail01.huawei.com>>;
收件人:黄光平10039714;
抄送人: <detnet@ietf.org<mailto:detnet@ietf.org>>; <ethan.grossman@dolby.com<mailto:ethan.grossman@dolby.com>>;
日 期 :2017年11月17日 11:08
主 题 :Re: [Detnet] Question about using blockchain as DetNe use case


Guangping,

Thanks for the reply.  Let me explain a little better what and why I'm asking:

It's not possible to guarantee both bounded latency and reliable delivery to an arbitrarily high load with a finite number of buffers in the network.  The way that DetNet can assure reliable delivery to bitcoin is:

  1. Every point-to-point bitcoin connection has a certain bandwidth reserved for its use.
  2. A bitcoin host must not transmit data faster than its reserved bandwidth; any excess packets are discarded.
  3. Unused bandwidth on a bitcoin reservation is NOT available to any other reserved flow, bitcoin or not; it is available only to non-DetNet traffic.
  4. Reservations can never oversubscribe a link.

What this means is that, if a burst of bitcoin activity would exceed the bandwidth of a reservation, the bitcoin application has to buffer its transmissions and meter them out at no more than the contracted rate.  This adds to the latency, of course.  How much  it adds would depend on the size of the burst.  It would take some analysis to look at the transmission rate as a function of time and the worst-case acceptable latency, in order to come up with the optimal value for a bandwidth contract.  The bigger the bandwidth,  the more expensive the reservation, because of points 3 and 4.

In reading the use cases draft, I understood that reliable delivery is attractive to bitcoin, but the description of the application did not make me confident that the fixed bandwidth aspect would be acceptable.  I'm always glad to find a new application of  DetNet, but if the activity of bitcoin is bursty, it might not be a good fit.  I certainly hope it is.

How bursty is bitcoin?

-- Norm
________________________________
From: huang.guangping@zte.com.cn<mailto:huang.guangping@zte.com.cn> [huang.guangping@zte.com.cn]
Sent: Wednesday, November 15, 2017 6:41 PM
To: Norman Finn
Cc: ethan.grossman@dolby.com<mailto:ethan.grossman@dolby.com>; detnet@ietf.org<mailto:detnet@ietf.org>
Subject: 答复: [Detnet] Question about using blockchain as DetNe use case

hi Norm,

bitcoin is actually a public blockchain which is running in the open internet. here we're address specifically the private blockchain.

blockchain runs in a mode of p2mp among its participating nodes while it's actually running p2p in the level of network (L3/L4)  based upon best-effort under current scenario. its consensus mechanism demands strictly  every transmission of the data be delivered successfully on each node, otherwise the failed (packet-loss, expiry delivery etc)transmission has to tranported again.

the unreliability and the latency incurred is especially intolerable in the private blockchain applications.

so far as the fixed bw is concerned, blockchain actullay would not consume too much for its quite limited metadata transmission.







黄光平 huangguangping



预研标准部/有线研究院/有线产品经营部 Standard Preresearch Dept./Wireline Product Operation Division


[cid:image001.gif@01D493C7.3EC52730]

[cid:image002.gif@01D493C7.3EC52730]
南京市雨花区软件大道50号中兴通讯1号楼
R&D Building, ZTE Corporation Software Road No.50,
Yuhua District, Nanjing, P...R.China, 210012
M: +86 13770311052
E: huang.guangping@zte.com.cn<mailto:huang.guangping@zte.com.cn>
www.zte.com.cn<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.zte.com.cn_&d=DwMGaQ&c=lI8Zb6TzM3d1tX4iEu7bpg&r=o70oZ2kUSjKLvmrL51To4giAVx8MYGkodiHsSU6toJ4&m=99jed747zh_TTHHoFTD9ikRT6orzqEGIQ8WmUphR4XU&s=adhAU3RHBRY8ulDKY-esA7IUaEYE5h-WUuoVByw2-i4&e=>



发件人: <norman.finn@mail01.huawei.com<mailto:norman.finn@mail01.huawei.com>>;
收件人:黄光平10039714; <ethan.grossman@dolby.com<mailto:ethan.grossman@dolby.com>>;
抄送人: <detnet@ietf.org<mailto:detnet@ietf.org>>;
日 期 :2017年11月16日 10:03
主 题 :[Detnet] Question about using blockchain as DetNe use case


I know little about the applications bitcoin.  I can easily appreciate its need for reliability, but I have a question about bandwidth.

Are bitcoin applications comfortable with the fixed bandwidth aspect of DetNet?

That is, an app cannot exceed the BW of a flow, and unused BW is not available to other DetNet flows.  So, I take it that bitcoin is either not bursty, or can afford wasted bandwidth.

-- Norm