Re: [MBONED] A concern about draft-acg-mboned-multicast-models recommendations

Stig Venaas <stig@venaas.com> Fri, 09 March 2018 17:17 UTC

Return-Path: <stig@venaas.com>
X-Original-To: mboned@ietfa.amsl.com
Delivered-To: mboned@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BF1B9126DFB for <mboned@ietfa.amsl.com>; Fri, 9 Mar 2018 09:17:18 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.599
X-Spam-Level:
X-Spam-Status: No, score=-2.599 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_LOW=-0.7, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=venaas-com.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id WvErZkCzTWWn for <mboned@ietfa.amsl.com>; Fri, 9 Mar 2018 09:17:16 -0800 (PST)
Received: from mail-qk0-x231.google.com (mail-qk0-x231.google.com [IPv6:2607:f8b0:400d:c09::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 37168126DD9 for <mboned@ietf.org>; Fri, 9 Mar 2018 09:17:16 -0800 (PST)
Received: by mail-qk0-x231.google.com with SMTP id d8so2209016qkc.13 for <mboned@ietf.org>; Fri, 09 Mar 2018 09:17:16 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=venaas-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=L9ZYq6ACzHx0I2P2YF5BUTjkpVGT2YW3fuvJnDjkkVU=; b=o/lRv51IIeeOkMrg7+bygXMIMqjr2Bq8GqrNHygcvPyC+dPKJUMEl1UINMXpC8b2Hs qPhJZG7ge85bhoesKVWPxZnGQ6Ut5HvdbsBVp8uRn3gDjxYzWB5xyXkeaCxP3sow+SJf ps8PGenjMjoAS7xR8S1UCf3EY1J9qSpS9fQgDnTAd1g62DZOeMfPBVjgJoaSypv0beRB l3C9MkWDCcb+VRR3I/6wFu0CoEnx3fmGLjIr4dyft/zdCFC21K8NuWtd1RU6yQ7tPBMt qpowO207WfU2Kj5LYam8cRGQ7ri9uBafSgrg5qPDh3oV9bFhNDPHtyCG0w70QetKDp8U qtvw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=L9ZYq6ACzHx0I2P2YF5BUTjkpVGT2YW3fuvJnDjkkVU=; b=URC9+W+uMbjM4/mApZXb+2NQwrYDO/b9q3KYNLmmEh/gPNnpszJNFCIQa1LnkdZfuo vPikRzeFv9thWhmMjYdg5H5sN3Ks4dWVscUBcVFGWEp1cTdzAL1KT8tOiWUiQ6SboKPs JGEc0TOH9FeC0rnIKdw3vpJ8fzJM+RyGKtTVPb/EBsPvekIvghZ39C9jsWEtJ7t6DbKI w6NoHJRZcmWWxdawxYF7tR2HbTO6KEq1A2Ap/g6twMtv8qDDPdvflYr0+WRnvJ3RJ5h4 fcfcQkgD7ZNW+jfLJ8pOJxU/cbeyxHm+FAGDi0L26s1uoG8ASU7CdmLvN3O1HTVRkkSG FwvQ==
X-Gm-Message-State: AElRT7GJ9evEYn+8b9IPpKATTpitTlAArDIF3RYM5y5QXqM1/+j1zqdD PrNI9Ib0cro9CzmfShBy5isyK++gAJLal/Wsb/+nmw==
X-Google-Smtp-Source: AG47ELvZXVWnClnqyYH7+3cXMFPVqEfJUNfSaixRMsr6u1FuHsW1LikcQmLl3sTOnGKCaPfj7BfsyGrl1b+s+3by0wA=
X-Received: by 10.55.19.232 with SMTP id 101mr45656692qkt.198.1520615835141; Fri, 09 Mar 2018 09:17:15 -0800 (PST)
MIME-Version: 1.0
Received: by 10.140.94.235 with HTTP; Fri, 9 Mar 2018 09:17:14 -0800 (PST)
In-Reply-To: <20180309131452.GB28408@faui40p.informatik.uni-erlangen.de>
References: <CAH8Jh6DikQa-9Kft0WdyGZYCPjWLScNVtYce2=EyL1q+0rAYVg@mail.gmail.com> <20180227231838.GI67472@cs-it-6805697.local> <CD402244-A3B3-4988-AB45-404B87DBEA94@jisc.ac.uk> <CAH8Jh6CRvvREZXoXH4mw8WecdHCzsvbPt5tHoNQwPGLauCoXOg@mail.gmail.com> <510DB303-A90E-45A8-A2AF-0366FD57122F@jisc.ac.uk> <e16f2a5580ec4e0e8977489680b14b49@XCH15-01-07.nw.nos.boeing.com> <alpine.DEB.2.20.1803020852220.20609@uplift.swm.pp.se> <F6BAE481-D871-4BF7-9940-45A5AABB3B1B@jisc.ac.uk> <20180309131452.GB28408@faui40p.informatik.uni-erlangen.de>
From: Stig Venaas <stig@venaas.com>
Date: Fri, 09 Mar 2018 09:17:14 -0800
Message-ID: <CAHANBtL9pSPHGgjbSo0PKzuApJJkx7DpVvxsiMoJm=nVH+LD4g@mail.gmail.com>
To: Toerless Eckert <tte@cs.fau.de>
Cc: Tim Chown <Tim.Chown@jisc.ac.uk>, "mboned@ietf.org" <mboned@ietf.org>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Archived-At: <https://mailarchive.ietf.org/arch/msg/mboned/7LELfHy0arMQlK32L88FfhxFqw8>
Subject: Re: [MBONED] A concern about draft-acg-mboned-multicast-models recommendations
X-BeenThere: mboned@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Mail List for the Mboned Working Group <mboned.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/mboned>, <mailto:mboned-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/mboned/>
List-Post: <mailto:mboned@ietf.org>
List-Help: <mailto:mboned-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/mboned>, <mailto:mboned-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 09 Mar 2018 17:17:19 -0000

When it comes to policy, that is something we can decide in the IETF,
we aren't exactly running out of IPv4 multicast addresses though.
Maybe we would eventually, but with the transition to IPv6, maybe
there will mostly be requests for IPv6 in a few years, where we won't
run out.

We had some discussions in mboned about trying to come up with some
alternative way for applications to do discovery, other than each
using a unique address, about 10 years ago. I think the issue is
mainly that application developers are lazy, or avoid what they see as
unnecessary complexity. Which means that standardized libraries, new
socket APIs etc. could make a difference.

Of course it also helps if big companies that want to deploy an
application tells application vendors that they do not want to deploy
ASM and that they will choose another application if they cannot make
it work with SSM.

Stig


On Fri, Mar 9, 2018 at 5:14 AM, Toerless Eckert <tte@cs.fau.de> wrote:
> SSM is always simpler for the network than ASM. The question is rather when it
> is inacceptable more difficult for the application.
>
> Let me summarize 3 categories of ASM use:
>
> a)
>
> One example of "needs" ASM application is the classical situation awareness (SA),
> where a distributed ssytem (for example a battlefield) consists of various
> units/subunits (soldiers, tanks, weapons) and you need some subset of those
> units receive telemtry of other units for decision making. What was mention
> here on this thread in before reminded me of the typical parameters of such an
> application.
>
> Distributed simulations are similar.
>
> b)
>
> I would not necessarily count the multi-party video conference as a "needs"
> ASM application unless it is meant to be "peer-to-peer" multi-party video conference
> with no centralized server. Thats how the original mboned apps where built
> (vic, vat, wb) - peer-to-peer. Before 1995 == before you would start to build
> out every networked app through a web-server/cloud-server as the obvious
> application layer rendesvous point. Just look at all those RTCweb apps that
> have emrged from tht IETF groups work. To me the most obvious best scalable/
> most easy solution (and typical RTCweb is of course interdomain) is unicast
> from participant to rendesvous point, and then SSM back from that rendesvous
> point. Of course helped by AMT to transit any non-SSM enabled paths in between.
>
> Even if you want to get a central point out of the picture (delay,...),
> it would for these apps IMHO still be better to use SSM and only use the
> app-server as the rendesvous point to learn the source addresses.
>
> The main issue with this second class of apps is tht we can document all day
> long, but to make any impact on actuall app deveopment, you better have an
> open source library that apps could use. Just having seen the URL for SSM
> support in node.js i think we're ccloding in being able to do this in the
> typical web-application environment - javascript/web-udp-sockets. But
> someone would have to write it. Could even be proposed as an extension to
> e.g.: RTCweb as a typical use case.
>
> c)
>
> The difficult part is service discovery. I think thats a real bad example
> of ASM. Some app developer wants to develop a client-server app, asks
> Stig, oops: IANA multicast address expert for an IP multicast address,
> and then codes his own private discovery; server or client sends multicast
> packets using this address to find the other side.
>
> In sheer volume of assigned addresses for this crap, thats probably the
> most successful use of IP multicast.
>
> I don't want to get through all the arguments how/why/where/what DNS-SD
> with various degrees of multicast (mDNS), but rather:
>
> Service discovery with multicast is a slippery slope unfortunately,
> which makes the classification more difficult:
>
> Consider a typical "shop" web-page you see where you see many different frames,
> lets say one with product description, another one with pictures of the
> product, another for your cart, what others bought, reviews, etc. pp.
> Consider each of these frames to be an app provided by a large cluser
> of nodes in a DC. The app that renders your web-page requests for
> each of these frames a worker to render that frame - so each frame
> type has a multicast group with all workers listening - but responding
> based on load. This effectively is a somewhat more intelligent service
> discovery - let least loaded worker reply first, select it. This was
> done with IP multicast even before hadoop was a thing. And lead to the
> development of Bidir-PIM because PIM-SM couldn't scale to the tenths
> of thousands of parallel web-page renderers that would send those
> requests to the hundreds of workers for fifty rr so apps. This reduced
> stte from eg: 100,000 (S,G) to maybe 200 (*,G).
>
> So, i would say that its easy to see how you don't want to discount
> all variants of service discovery, but at least you shouldn't allocate
> static multicast addresses for this anymore. These apps must use
> locally managed multicast-apps. Which magically (IMHO) disables the use
> of ASM where DNS-SD would be better, but does not hurt the other example
> (distributed app, e.g.: DC/web). Alas, i think IANA has never managed to
> come up with a policy to push back against these address allocations,
> so i think thats been going on for 25 years now with just little pushback.
> Stig would know more about this.
>
> Cheers
>     Toerless
>
> On Fri, Mar 02, 2018 at 08:38:13AM +0000, Tim Chown wrote:
>> On 2 Mar 2018, at 07:57, Mikael Abrahamsson <swmike@swm.pp.se<mailto:swmike@swm.pp.se>> wrote:
>>
>> On Thu, 1 Mar 2018, Manfredi, Albert E wrote:
>>
>> I get that inter-domain, with PIM-SM, that simplicity cannot exist. So inter-domain, SSM is actually simpler. It removes that rendezvous point complication, and then having to find a better route around it, for the multicasts.
>>
>> It makes it easier for the network, but it might make it harder for the applications.
>>
>> Personally I do not know enough about what multicast applications are out there and why it might make their lives much easier if ASM exists, but I imagine these exist. The classic case was a many-user video conference where you had no application layer protocol to understand who might be sending video to you. I remember the 90ties where there was a multicast group with lots of webcams in it, so you could get real time glimpses of the world. There you just pointed your client to the multicast group and it split up each camera into a separate window, without any need for a source discovery protocol in the client.
>>
>> I remember that too. In around 2001/02 many of us in the European NRENs and universities were in a project called 6NET, where we had multicast conferencing tools running over IPv6 multicast, using UCL's vic and rat clients, and tools like ssmping and dbeacon for debugging, and also Stig's v4/v6 gateway (which I recall was written up as an IETF draft but didn't get adopted).  But that was over an ASM group on the 'm6bone' with a single RP; it was that project that then came up with the idea of Embedded-RP, in part from trying to run applications such as these were clients could join/leave at any time. It was a lot of fun, and hard to think it was now 16+ years ago!
>>
>> A piece of history attached; this was a screenshot of a session where I was demoing the tools at the IST2002 conference. Stig was joined via IPv4, to demonstrate his gateway, the rest over IPv6.  Hopefully a 100K image isn't breaking list etiquette :)
>>
>> Tim
>> [cid:05F0B5D3-AD5E-4A02-9A51-217CF8D02FD6]
>
>
>
>> _______________________________________________
>> MBONED mailing list
>> MBONED@ietf.org
>> https://www.ietf.org/mailman/listinfo/mboned
>
>
> --
> ---
> tte@cs.fau.de
>
> _______________________________________________
> MBONED mailing list
> MBONED@ietf.org
> https://www.ietf.org/mailman/listinfo/mboned