Re: [Bier] DISCUSS? SI vs. sub-domains - draft-ietf-bier-architecture-02

Caitlin Bestler <caitlin.bestler@nexenta.com> Tue, 13 October 2015 20:48 UTC

Return-Path: <caitlin.bestler@nexenta.com>
X-Original-To: bier@ietfa.amsl.com
Delivered-To: bier@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 895DB1A8ADE for <bier@ietfa.amsl.com>; Tue, 13 Oct 2015 13:48:15 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.6
X-Spam-Level:
X-Spam-Status: No, score=-2.6 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id c6XqW5OdR9Uq for <bier@ietfa.amsl.com>; Tue, 13 Oct 2015 13:48:14 -0700 (PDT)
Received: from mail-pa0-f46.google.com (mail-pa0-f46.google.com [209.85.220.46]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id D473A1A8ADA for <bier@ietf.org>; Tue, 13 Oct 2015 13:48:04 -0700 (PDT)
Received: by pabrc13 with SMTP id rc13so31495871pab.0 for <bier@ietf.org>; Tue, 13 Oct 2015 13:48:04 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to:content-type; bh=XEJ5a9MzFScrKRCBo6/ey0JvEweTCFYJIwWrWFF/eEk=; b=hlgqBun3jjwSYipC3ob8w8My2Xo/MK8M1tOKm12txQSkQuPfk9V4UII5/4uPKmnOsy 6wEPugJKS1lz+hU/eniTk6J38EeB3t/YWHH0QNe2vE+MSf0vVoAHhYh/xSj3UvKVAWQb VM1Xbm6cdmb9XIyGrAF7by/h8ybr3C7cEPtY/Wlg9IFErWZ92Ohw53t5plGSIRIetMsp Cbrg2LJ00DMqO+z053ab8IoulwjozsvUeE8g3lG1OxIsR65v81Z+JUQMGfJAfIJFwkR0 mww6539ZWhlu269mkNedw0E/a+kidz2otluSnnmjiRk0Pt8wpNCAqrplx+lM+hXxYolK hzQg==
X-Gm-Message-State: ALoCoQmXN/YzttGXOX7ikzEOrb7r0d2yRprQVzLCSCbb31me9aR+7VSFeS3eofNd6v8J8ou/+SlK
X-Received: by 10.66.219.195 with SMTP id pq3mr42300073pac.98.1444769284500; Tue, 13 Oct 2015 13:48:04 -0700 (PDT)
Received: from Macintosh.local (67-207-110-172.static.wiline.com. [67.207.110.172]) by smtp.googlemail.com with ESMTPSA id xm9sm5514765pbc.32.2015.10.13.13.48.02 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 13 Oct 2015 13:48:03 -0700 (PDT)
To: Toerless Eckert <eckert@cisco.com>
References: <20151013173739.GX13294@cisco.com>
From: Caitlin Bestler <caitlin.bestler@nexenta.com>
Message-ID: <561D6E01.1070101@nexenta.com>
Date: Tue, 13 Oct 2015 13:48:01 -0700
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:38.0) Gecko/20100101 Thunderbird/38.3.0
MIME-Version: 1.0
In-Reply-To: <20151013173739.GX13294@cisco.com>
Content-Type: multipart/alternative; boundary="------------040008060508060303040907"
Archived-At: <http://mailarchive.ietf.org/arch/msg/bier/4duv6dJIKToJsLOBbWKO1mdcI8w>
Cc: "bier@ietf.org" <bier@ietf.org>, Antoni Przygienda <antoni.przygienda@ericsson.com>, Eric C Rosen <erosen@juniper.net>
Subject: Re: [Bier] DISCUSS? SI vs. sub-domains - draft-ietf-bier-architecture-02
X-BeenThere: bier@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "\"Bit Indexed Explicit Replication discussion list\"" <bier.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bier>, <mailto:bier-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bier/>
List-Post: <mailto:bier@ietf.org>
List-Help: <mailto:bier-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bier>, <mailto:bier-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 13 Oct 2015 20:48:15 -0000


On 10/13/15 10:37 AM, Toerless Eckert wrote:
> > Is this the full answer for your use-case, DC ? Not quite i think.
>     Would be good to discuss more, but i don't see you coming to Yokohama ?
>
>     Eg: AFAIK, DCs have huge (>> 2^16) VMs. Each user/application will
>     most likely have much less than 2^16  receivers. Creating per-app
>     sub-domains sounds like the obvious starting point. SIs would come
>     into the process automatically, as soon as an applicatin requires more
>     than Bitstringlength possible receivers. BUT:
>
>     1. AFAIK, we have not defined for BIER any automated schemes to assign unique
>     BFR-id to receivers. Doing it once for eg: the physcial topology - manually
>     is a well known process for operators (like allocation of loopback addresses).
>     Doing this repeatedly for multiple apps IMHO requires an automated
>     scheme. This would be a good (potentially DC centric) signaling
>     problem to look into.

Yes, a typical intra-DC application will map a VLAN or VXLAN to a Bier 
Domain.
The membership in this virtual cluster may be for the duration of a job, or
indefinite. But the VLANs/VXLANs will probably be set up by cluster 
management
rather than by hand

Further, the desired forwarding path for a given virtual cluster is 
intended to
be very short. It might be longer if you are forced to allocate nodes in 
a large
number of racks, but that is not what the scheduler will be trying to do.

That also means you are unlikely to see BIER in datacenters until it is 
implemented
in commodity forwarding chips that are deployed in edge servers. 2-hops with
old fashioned multicast groups will beat 4 hops with BIER.

We rejected emulating what we wanted switches to do in edge switches for our
storage cluster because you can't make the latencies required when you 
add extra
physical hops to your path.