Re: [BEHAVE] Port Management To Reduce Logging In Large-Scale NATs

Jacni Qin <jacniq@gmail.com> Tue, 14 September 2010 16:21 UTC

Return-Path: <jacniq@gmail.com>
X-Original-To: behave@core3.amsl.com
Delivered-To: behave@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id AFE143A6898 for <behave@core3.amsl.com>; Tue, 14 Sep 2010 09:21:42 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.298
X-Spam-Level:
X-Spam-Status: No, score=-2.298 tagged_above=-999 required=5 tests=[AWL=-0.300, BAYES_00=-2.599, HTML_MESSAGE=0.001, J_CHICKENPOX_81=0.6]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id vg435hERWN9k for <behave@core3.amsl.com>; Tue, 14 Sep 2010 09:21:41 -0700 (PDT)
Received: from mail-wy0-f172.google.com (mail-wy0-f172.google.com [74.125.82.172]) by core3.amsl.com (Postfix) with ESMTP id E78FC3A683A for <behave@ietf.org>; Tue, 14 Sep 2010 09:21:40 -0700 (PDT)
Received: by wyi11 with SMTP id 11so8382386wyi.31 for <behave@ietf.org>; Tue, 14 Sep 2010 09:22:06 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:cc:content-type; bh=R2kY0CBh+mA5h4QgUmgjYUETQlPEBaFIwPXgKsu6H28=; b=hEiYYwQRyN4vbeENOqQ4m8bHr3d6zH54OgGDR9fXZZpSnvWL3Yc8VYYpZ4yP2WhQWv /ItQ1b643V0x8b161OVdsUU7Dkq0LxDd4XFDpfeTJu57XY4PPoOgAOee9gPFFX9p0hC+ h27V1FG0ZrOOmx2h8JImYVcpEtQAHpSzU2L7k=
DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=hU2Pane6zGyL3dBN7ZPi+QxLw4LxYeMMZHzFR3/xyyKXGMi2QSwi3z4kLjzu14QCgM beG/GF8qfzsHzLrIzy/W6PpxzEH4s7gkuP3REUymma2mpVkjJhsgkLONsymydAY+NL6Y 4SsxFe08RiTE7gQVOAArvv7JPTHoEEtrVUXfM=
MIME-Version: 1.0
Received: by 10.216.45.16 with SMTP id o16mr4096859web.45.1284481326127; Tue, 14 Sep 2010 09:22:06 -0700 (PDT)
Received: by 10.216.15.213 with HTTP; Tue, 14 Sep 2010 09:22:05 -0700 (PDT)
In-Reply-To: <25053_1283750532_4C847A84_25053_19298_1_94C682931C08B048B7A8645303FDC9F31C501E70A4@PUEXCB1B.nanterre.francetelecom.fr>
References: <979A43C06A7B488B93D6FFBA8395A033@china.huawei.com> <9245BF3C-D02C-4C91-8690-C6261758701A@nokia.com> <17006_1283515801_4C80E599_17006_1679467_1_94C682931C08B048B7A8645303FDC9F31C501E6E33@PUEXCB1B.nanterre.francetelecom.fr> <55DD09BB-C144-4124-8080-332E8B4C0F7B@nokia.com> <26667_1283517256_4C80EB48_26667_79086_1_94C682931C08B048B7A8645303FDC9F31C501E6E60@PUEXCB1B.nanterre.francetelecom.fr> <84600D05C20FF943918238042D7670FD36D96A7BA1@EMBX01-HQ.jnpr.net> <25053_1283750532_4C847A84_25053_19298_1_94C682931C08B048B7A8645303FDC9F31C501E70A4@PUEXCB1B.nanterre.francetelecom.fr>
Date: Wed, 15 Sep 2010 00:22:05 +0800
Message-ID: <AANLkTi=75YBavh2FXAZNiCO-WvNkDpb9z7vncMK46Vvf@mail.gmail.com>
From: Jacni Qin <jacniq@gmail.com>
To: mohamed.boucadair@orange-ftgroup.com
Content-Type: multipart/alternative; boundary="0016367b6c302a1b5404903a9d02"
Cc: "behave@ietf.org" <behave@ietf.org>, Olivier Vautrin <ovautrin@juniper.net>, Tina TSOU <tena@huawei.com>
Subject: Re: [BEHAVE] Port Management To Reduce Logging In Large-Scale NATs
X-BeenThere: behave@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: mailing list of BEHAVE IETF WG <behave.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/behave>, <mailto:behave-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/behave>
List-Post: <mailto:behave@ietf.org>
List-Help: <mailto:behave-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/behave>, <mailto:behave-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 14 Sep 2010 16:21:42 -0000

On Mon, Sep 6, 2010 at 1:22 PM, <mohamed.boucadair@orange-ftgroup.com>wrote:

> Dear Olivier, all,
>
> Compression is needed whatever the scheme adopted for the port assignment,
> especially to reduce the amount of exchanges between the mediation platform
> (responsible for collecting legal storage data from several location in the
> network) and the CGN device.
>
> BTW, I agree with Joel's position: The way logs are built does not need to
> be standardised and this is implementation-specific.
>

Agree with this point. We can not unify the format and operation of logging
on the NAT box, we also don't know what the log analyser(a throng of
servers) will do ;-)


> The interest I see in draft-tsou is it documents a way for optimisation
> (which is already supported by various vendors) and encourages the servers
> to store the source port information. This second point can be encouraged
> further if (as already suggested by Dan Wing) it has shown that the
> integration of the source port number is an easy task to handle by servers
> and this modification has no (or minor) impact on existing tools used to
> manipulate logs stored by the servers.
>

Yes, if the source addresses with timestamp are recorded on the server side,
the storage needed for logs around NAT can be vastly reduced.

Regards,
Jacni



> Cheers,
> Med
>
>
> -----Message d'origine-----
> De : Olivier Vautrin [mailto:ovautrin@juniper.net]
> Envoyé : dimanche 5 septembre 2010 08:41
> À : BOUCADAIR Mohamed NCPI/NAD/TIP; Lars Eggert
> Cc : behave@ietf.org; Tina TSOU
> Objet : RE: [BEHAVE] Port Management To Reduce Logging In Large-Scale NATs
>
> Hello Med,
>
> Does that mean you don't expect providers to Compress/Optimize the logs
> information sent per CGN device at all?
>
> In my understanding, this proposition will have an effect on the storage of
> log files only if the logs are kept *as is*. This is because the ports are
> randomly choosen in draft-tsou-behave-natx4-log-reduction-01, range are not
> created with contiguous ports so the amount of information sent by the CGN
> is not decreasing only the syslog message has changed.
>
> Regards,
> Olivier.
>
> > > (3) As an aside effect, when port ranges are used the size of the log
> > file is optimised (FWIW, see http://tools.ietf.org/html/draft-
> > boucadair-port-range-02#section-15.2 for a simplified exercise). Of
> > course this optimisation depends on length of the port range.
> >
> > I understand that ranges shorten the log file. The point I was trying
> > to make is that even on very large CGNs (large enough so that they'd
> > need an insane amount of bandwidth to forward all the traffic they're
> > seeing), the log sizes are not unmanageable. Sure, they can always be
> > reduced, but that's an optional optimization.
> >
> > Med: When the factor is 1000, then optimisation can not be seen as a
> > luxe.
>
> *********************************
> This message and any attachments (the "message") are confidential and
> intended solely for the addressees.
> Any unauthorised use or dissemination is prohibited.
> Messages are susceptible to alteration.
> France Telecom Group shall not be liable for the message if altered,
> changed or falsified.
> If you are not the intended addressee of this message, please cancel it
> immediately and inform the sender.
> ********************************
>
> _______________________________________________
> Behave mailing list
> Behave@ietf.org
> https://www.ietf.org/mailman/listinfo/behave
>