Re: [ippm] Is loopback/direct export amplification worse than linear?

Haoyu Song <haoyu.song@futurewei.com> Wed, 25 November 2020 21:00 UTC

Return-Path: <haoyu.song@futurewei.com>
X-Original-To: ippm@ietfa.amsl.com
Delivered-To: ippm@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 342533A1D85 for <ippm@ietfa.amsl.com>; Wed, 25 Nov 2020 13:00:40 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.989
X-Spam-Level:
X-Spam-Status: No, score=-1.989 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=0.1, RCVD_IN_MSPIKE_H2=-0.001, T_SPF_PERMERROR=0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=futurewei.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id vYjWw-q17I_v for <ippm@ietfa.amsl.com>; Wed, 25 Nov 2020 13:00:38 -0800 (PST)
Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12on2133.outbound.protection.outlook.com [40.107.244.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3FFB93A1D83 for <ippm@ietf.org>; Wed, 25 Nov 2020 13:00:38 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=ahJXr3hwBJNGEZo4rFK72EKnU1ulBX8WhkrYWcBHP6ZMUubvsHT+kR66WgY4CaRPNiGbIVYZIRUDgnoeBzWj7ly3b6dkeEELJRVAxrJ2w/Eq3a+hjG3PtdhSN1TXJdVrsQQmngN6pfF5cC0ESXudEsVSxQquOGguKBcI5pH8ZwUgQPb1HxCK39VERGgn2TkLDf+t7fDZl/0aSUUgY4EPMoyZVjuvboaIMpA/9i2yMkGWe9Ro4hCRvO/ZOgqc4EIGzRMHDbrzytnPh+5+/HPMx5Hm3ZFGC5YxqGvCTpwQ79q30mvZIUXBHDj1bD0z/4adFkXhfA9WIQepiaTaSEaLag==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1Py70/WPRk+BVqu8Q8zk60pAM1PUZalIyMh71g55gk0=; b=Xz9trnGgFSTSGSd2R07WaYVTqMFtdPmp1lKsd8wQlSuEmgc6W473BbMR7LxTmgksOWF9+viGENHbCnC+zLxxHHn6TjTb/HjhJZjPH1WBWme0NrDAfrEm5V9RLqXT4papTXAGTK2S+gaC4ClPrBKhBR/PWyiVGUw1PsEP3LautlQIbnBFfF+SeIyl0AKXKS0gD5qaSnV7tWVELRhWH1lqnlReoacvxfEf1zvfvq0S0ZdMVXFu9frfPvK6nBq4rITsZ19gfrzOXNeBQym2QMC+DSawsCMUhjqLAtCIPzcG6i62+u4rCVC6DtfIkJnI2pHozCRPF8plv5sEZa6E/lfrOg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=futurewei.com; dmarc=pass action=none header.from=futurewei.com; dkim=pass header.d=futurewei.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Futurewei.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1Py70/WPRk+BVqu8Q8zk60pAM1PUZalIyMh71g55gk0=; b=PbuEhbgmHuZdF4gognJ2OmfEVs1jN3odDphOwTPYPsZ0gKuYusziG5ENE/gX6oGxh+Ek8bPd4raxI/bXInmkwQDmq4oZx/XiNrjsuU1qp62qSwQGt7uFLelOj3VFY79VhybqOI3R/PRtQn8QvTHrSNW8wpfwRPDN1kNDenpCpT8=
Received: from DM6PR13MB2762.namprd13.prod.outlook.com (2603:10b6:5:13c::13) by DM5PR13MB1740.namprd13.prod.outlook.com (2603:10b6:3:12f::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3611.19; Wed, 25 Nov 2020 21:00:36 +0000
Received: from DM6PR13MB2762.namprd13.prod.outlook.com ([fe80::a1c9:9c66:9b62:e314]) by DM6PR13MB2762.namprd13.prod.outlook.com ([fe80::a1c9:9c66:9b62:e314%3]) with mapi id 15.20.3611.020; Wed, 25 Nov 2020 21:00:35 +0000
From: Haoyu Song <haoyu.song@futurewei.com>
To: Martin Duke <martin.h.duke@gmail.com>, Tal Mizrahi <tal.mizrahi.phd@gmail.com>
CC: IETF IPPM WG <ippm@ietf.org>
Thread-Topic: [ippm] Is loopback/direct export amplification worse than linear?
Thread-Index: AQHWu9vD3OkwcfBtwk280F6zf98F/6nYpHIAgACTogCAACqEgA==
Date: Wed, 25 Nov 2020 21:00:35 +0000
Message-ID: <DM6PR13MB2762AE0748E97B715B87351F9AFA0@DM6PR13MB2762.namprd13.prod.outlook.com>
References: <CAM4esxQiaRoCb9-7eBMy4yoCv28=St2XN-8AF7DwPiC2HU_Fzw@mail.gmail.com> <CABUE3Xm5A+6Jrw64ZnxUbu_avy5UNi3m2cUsiKzMJ-_BviiNrg@mail.gmail.com> <CAM4esxQpymtFa4OkGXG2QojLi9NXGWjMzj=TWfeGAxCaeaZkeQ@mail.gmail.com>
In-Reply-To: <CAM4esxQpymtFa4OkGXG2QojLi9NXGWjMzj=TWfeGAxCaeaZkeQ@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: gmail.com; dkim=none (message not signed) header.d=none;gmail.com; dmarc=none action=none header.from=futurewei.com;
x-originating-ip: [2600:1700:38c4:650:7d2d:218:feaf:f6f6]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: cd6505b3-eb07-4d1e-a254-08d8918527d4
x-ms-traffictypediagnostic: DM5PR13MB1740:
x-microsoft-antispam-prvs: <DM5PR13MB174099C6C639C2AF3383712E9AFA0@DM5PR13MB1740.namprd13.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: L9GjMD1NQlQO98bvMwfq5szZ0tH7UYsdypY6MywkV3S7XmfEHwIZb/UQPsmfzcJ3IgUKD+tTgP/scb7lvwp+5EhaHHapnKE0xTAzrN5K6dZJqoxuu3F7DWbu6GPZOC21Fqjm93gR6aen4Xer7MFuN9cTYtp3tCq1Wf/rQO0NhLVN5hGdWeDnKp8WbM6tLVv+wGwsYfMZ8tIvmAYMcfVwI+9Oi/RCmxBvjymUii5A/CcFT7EUeGTNptblUYvtYlRJ5/jYaweOxDPLd6TnYxwLgiNms1Sc6yQbqLubQhpcbx7LFft/YyesEg4PtjTJgNQ3Ij6xZ2LhWp1YFVkH7a4xu4Dr9waDnup2L5J1Ww6cQO05+x8xGBUxxfJLf2rKhehEymsGoJ+bfTd9HyrSDdPVGA==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DM6PR13MB2762.namprd13.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(396003)(366004)(376002)(346002)(136003)(39840400004)(66946007)(76116006)(66476007)(66446008)(9686003)(66556008)(110136005)(66574015)(64756008)(316002)(44832011)(83380400001)(478600001)(2906002)(966005)(8936002)(166002)(186003)(8676002)(55016002)(7696005)(4326008)(6506007)(5660300002)(71200400001)(52536014)(86362001)(9326002)(53546011)(33656002); DIR:OUT; SFP:1102;
x-ms-exchange-antispam-messagedata: vu0ZMiFsAK6UzVCCPkhwGfH52tqI/GlU2EkyJ/Qp4NRr+nyfRIKGmABSIaMUYig8U5MIdi7SErr3yBS0ysa6BS4D16hkl5T92J/xm66EZ9clnrwntbnSoYBHGwthtc+Lhu3OIhhmSWI52IFCfJSE0yK4hujIbdR3hRlcBo68palRrbt1h8RWpFw0VL7M8xHfYDgLdloJTEE1u0Yg33yqxUzgiLlUyNefF/Au4QBEcbbvSRPzTnDrIKHF3hCUYYMUg3QUUqWwIccr/G1N8nToU53E4S3pSHMsZLKca9OFXNa6IUXAQdlKnW4n7UeYLZocLvxkicBIubT/xaQcOM0MvDSQ/pdXZBUxFYodEUQsnDddYTPd8SL0leKekFWE3oFb1oD1TUJCzKyR9Gokb201sqqIojDLkKZ8XuaXtuMPtYkSELwQxqdHJTnHeQ2SwIF4E5TXo+jI+6FnDWg2o7dMh5nVFIw1t9PNBkzUPVh11YnSe7SxkI9Z3jLZRw9Gc4iMzC1jCt83OB3GEf79WK3VaXdEsx5eMBZsDSBlUNyyyhSJH2/zzIduWFUaFyeQlRe+W/rcxeTefirO68bgkS4fMCRQ8MerZxO4IJvlvKOhkOby+1Rk5Hutc8kVLFFNVi2Mzc/WO6L82E9dtdkcOjEQwZLCoO8Sm6mNZQSLWt7XarsUDg12CS+qHYgFhMgh8gGo1Lvq+d46nMB3MMTikwH2TgmpqiX+hGT6ovxNo9dht/y2/0iOWVLKN6iHGaADlJBoAmyrLrdXAyH8p9pMQ6HKnog2+2yll6ajk/XjPG0aqyiP6/8CFI3XD86Lm9JmzRXxkMknl0ZZ6BFkvXnW/jClvKAQ5anOXWB1GiFPivakr14lUpV9w3AogEJcpHiY19IXVjbDTnGiNIWOFpOnERZUvWaIokTidHb+D0wnADViikHy0CmjQruOnx5q8rekTSBPwb4tN0JxgiFoxVnp20LV/mMMSyaE0tEf7GV5y1714rY+yHzp9phn/A2fZejasbQPfqzWk1v1i67NpN/Nlro3Oa5SKGdh/UbML7lBa42KWDc=
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_DM6PR13MB2762AE0748E97B715B87351F9AFA0DM6PR13MB2762namp_"
MIME-Version: 1.0
X-OriginatorOrg: Futurewei.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: DM6PR13MB2762.namprd13.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: cd6505b3-eb07-4d1e-a254-08d8918527d4
X-MS-Exchange-CrossTenant-originalarrivaltime: 25 Nov 2020 21:00:35.6670 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 0fee8ff2-a3b2-4018-9c75-3a1d5591fedc
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: rrYRvzF6B7AN6djjA6GwJ5mTlYTUQqX3wbR4wxUB1d1JRpIorqHHjPF19JansR4EBPtDpFSJfHh3aUiSbN98rw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM5PR13MB1740
Archived-At: <https://mailarchive.ietf.org/arch/msg/ippm/CoO_J_hDyK85X2mEWUQvXSJPJNA>
Subject: Re: [ippm] Is loopback/direct export amplification worse than linear?
X-BeenThere: ippm@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IETF IP Performance Metrics Working Group <ippm.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ippm>, <mailto:ippm-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ippm/>
List-Post: <mailto:ippm@ietf.org>
List-Help: <mailto:ippm-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ippm>, <mailto:ippm-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 25 Nov 2020 21:00:40 -0000

Hi Martin,

I don’t understand the DEX amplification scenario. We don’t specify the export packet format yet but conceivably those packets are not like the original packets and just for the purpose of data export, so they shouldn’t trigger any data collection and export anymore. If I misunderstood something, could you please clarify your concerns? Thanks!

Best regards,
Haoyu

From: ippm <ippm-bounces@ietf.org> On Behalf Of Martin Duke
Sent: Wednesday, November 25, 2020 10:22 AM
To: Tal Mizrahi <tal.mizrahi.phd@gmail.com>
Cc: IETF IPPM WG <ippm@ietf.org>
Subject: Re: [ippm] Is loopback/direct export amplification worse than linear?

Hi Tal,

I believe this text adequately describes my concerns, so you've done what you can in terms of updating the draft. Thanks.

I am increasingly skeptical that protocols with these dynamics are a good thing to deploy in the internet, regardless of what we put in the Security Considerations. I would certainly like to hear the opinions of other people in the WG on this topic.

Martin

On Wed, Nov 25, 2020 at 1:34 AM Tal Mizrahi <tal.mizrahi.phd@gmail.com<mailto:tal.mizrahi.phd@gmail.com>> wrote:
Hi Martin,

Thanks for raising these points.
We have discussed these points today at the IOAM design team meeting,
and we suggest to mention these scenarios in the drafts.
We believe the reader should be aware of these scenarios, but that the
mitigations that are already described in the draft are sufficient at
this point.

Regarding issue (1) the following  text is proposed to be added to the
security considerations section of the flag draft:

Some of the security threats that were discussed in this document may
be worse in a wide area network in which there are nested IOAM
domains. For example, if there are two nested IOAM domains that use
loopback, then a looped-back copy in the outer IOAM domain may be
forwarded through another (inner) IOAM domain and may be subject to
loopback in that (inner) IOAM domain, causing the amplification to be
worse than in the conventional case.


Regarding issue (2), the following text is proposed for the DEX draft:

The amplification effect of DEX may be worse in wide area networks in
which there are multiple IOAM domains. For example, if DEX is used in
IOAM domain 1 for exporting IOAM data to a receiving entity, then the
exported packets of domain 1 can be forwarded through IOAM domain 2,
in which they are subject to DEX. The exported packets of domain 2 may
in turn be forwarded through another IOAM domain (or through domain
1), and theoretically this recursive amplification may continue
infinitely.

Thanks,
Tal.

On Mon, Nov 16, 2020 at 7:45 AM Martin Duke <martin.h.duke@gmail.com<mailto:martin.h.duke@gmail.com>> wrote:
>
> I recognize that the loopback and direct export drafts discuss potential amplification results, as a path of length N will generate N packets for each IOAM packet -- a linear relationship. As these are discussed in the draft with proposed mitigation, in an editorial sense the job is done. Whether giving people this kind of foot gun is a good idea is a separate question, but reasonable people can disagree.
>
> However, if I understand correctly, certain pathological combinations of IOAM namespaces could result in amplification far worse than linear.
>
> 1) Loopback loops
> Imagine there is an IOAM namespace that covers the path from Hop A to Hop D. There is a separate namespace entirely contained in A-D, from hop B from hop C. Both namespaces enable loopback.
>                            A --------------------------------------------------------D
>                                              B-------------------------------C
>
> So a user packet is traveling from A to D. There will be (D-A) loopback packets headed towards A. The (D - C) loopback packets that generated between C and D will travel through the encapsulating node at C and then trigger further loopbacks to C. Thus the total number of packets generated by the single user packet is
> (D - A) + (D - C)(C - B)
> and obviousy there could be several of these smaller namespaces, or nested namespaces, that aggravate the amplification further.
>
> 2) Direct Export
> Direct Export potentially has even worse properties. Suppose namespace A, N_A hops across, direct exports to a node that is reachable across namespace B. Namespace B, N_B hops across, direct exports to a node reachable across namespace A.
>
> Thus a single user packet sent over namespace A will generate N_A packets that traverse Namespace B. This will, in turn, generate N_A * N_B packets that traverse namespace A, which in turn triggers N_A ^ 2 * N_B packets, and so on.
>
> In fact, if the namespaces direct export with probability exactly,1/N_A and 1/N_B, the same level of traffic will ping-pong infinitely. Any more than that, and the traffic will steadily increase to infinity. If the probability is 1, the growth is exponential.
>
> ****************
>
> This analysis, if correct, raises three questions that I can think of:
> - Are these corner cases plausible?
> - If so, and they occurred, would the namespace administrators necessarily be aware of each other? If not, I'm concerned that this is unsafe to deploy.
> - Do phenomena like this indicate that the design is brittle and putting in some "considerations" doesn't really mitigate the dangers here?
>
> Martin
>
>
>
>
> _______________________________________________
> ippm mailing list
> ippm@ietf.org<mailto:ippm@ietf.org>
> https://www.ietf.org/mailman/listinfo/ippm<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ietf.org%2Fmailman%2Flistinfo%2Fippm&data=04%7C01%7Chaoyu.song%40futurewei.com%7Cb41ad88d7d6e4241b3af08d8916f275e%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C0%7C637419253886492031%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=iBoKLaGtRDisqs2lhtByByAW%2FVMPpTOeQL%2BZ307%2BTAk%3D&reserved=0>