Re: [BEHAVE] Port Management To Reduce Logging In Large-Scale NATs

Rémi Després <remi.despres@free.fr> Fri, 10 September 2010 14:46 UTC

Return-Path: <remi.despres@free.fr>
X-Original-To: behave@core3.amsl.com
Delivered-To: behave@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 910A43A6835 for <behave@core3.amsl.com>; Fri, 10 Sep 2010 07:46:36 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -0.063
X-Spam-Level:
X-Spam-Status: No, score=-0.063 tagged_above=-999 required=5 tests=[AWL=-0.714, BAYES_50=0.001, HELO_EQ_FR=0.35, MIME_8BIT_HEADER=0.3]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id X3pVP90hIsuP for <behave@core3.amsl.com>; Fri, 10 Sep 2010 07:46:35 -0700 (PDT)
Received: from smtp21.services.sfr.fr (smtp21.services.sfr.fr [93.17.128.2]) by core3.amsl.com (Postfix) with ESMTP id B605D3A659A for <behave@ietf.org>; Fri, 10 Sep 2010 07:46:34 -0700 (PDT)
Received: from filter.sfr.fr (localhost [127.0.0.1]) by msfrf2107.sfr.fr (SMTP Server) with ESMTP id B788A7000086; Fri, 10 Sep 2010 16:47:01 +0200 (CEST)
Received: from [192.168.0.20] (per92-10-88-166-221-144.fbx.proxad.net [88.166.221.144]) by msfrf2107.sfr.fr (SMTP Server) with ESMTP id 634827000093; Fri, 10 Sep 2010 16:47:01 +0200 (CEST)
X-SFR-UUID: 20100910144701406.634827000093@msfrf2107.sfr.fr
Mime-Version: 1.0 (Apple Message framework v1081)
Content-Type: text/plain; charset="utf-8"
From: Rémi Després <remi.despres@free.fr>
In-Reply-To: <4C8A3A91.4050201@cernet.edu.cn>
Date: Fri, 10 Sep 2010 16:47:01 +0200
Content-Transfer-Encoding: quoted-printable
Message-Id: <DF828F0A-20CB-4FE7-BCA9-1F3E67A058D3@free.fr>
References: <979A43C06A7B488B93D6FFBA8395A033@china.huawei.com> <9245BF3C-D02C-4C91-8690-C6261758701A@nokia.com> <17006_1283515801_4C80E599_17006_1679467_1_94C682931C08B048B7A8645303FDC9F31C501E6E33@PUEXCB1B.nanterre.francetelecom.fr> <4C8A3A91.4050201@cernet.edu.cn>
To: Mohamed Boucadair <mohamed.boucadair@orange-ftgroup.com>
X-Mailer: Apple Mail (2.1081)
Cc: Xing Li <xing@cernet.edu.cn>, Behave WG <behave@ietf.org>, Tina Tsou <tena@huawei.com>
Subject: Re: [BEHAVE] Port Management To Reduce Logging In Large-Scale NATs
X-BeenThere: behave@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: mailing list of BEHAVE IETF WG <behave.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/behave>, <mailto:behave-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/behave>
List-Post: <mailto:behave@ietf.org>
List-Help: <mailto:behave-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/behave>, <mailto:behave-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 10 Sep 2010 14:46:36 -0000

Hi Med,

+1, provided it applies more generally, i.e. to "port sets", instead of just "port ranges".
(draft-despres-softwire-sam-01 sec 2.1, describes a solution where port sets derived from extended IPv4 addresses are more optimized if comprising up to 4 continuous port ranges.)

Thoughts?

Cheers,
RD
    
Le 10 sept. 2010 à 16:02, Xing Li a écrit :

> mohamed.boucadair@orange-ftgroup.com 写道:
>> Dear Lars, all,
>> 
>> The use of port ranges instead of assigning individual port in CGNs has several effects, not only optimising the logs:
>> 
>> (1) The performance of the device are not impacted due to the writing operation (of each individual binding). For some implementations, we have seen a severe degradation when the device (in our case, it is a CGN DS-Lite) must log each individual entry. Note that, we have seen some implementations which loss packets when the port range bindings are not yet in place. But, I guess this is implementation-specific. 
>> (2) The amount of new sessions to be handled per second are drastically enhanced when a port range scheme is used instead of individual port assignment.
>> (3) As an aside effect, when port ranges are used the size of the log file is optimised (FWIW, see http://tools.ietf.org/html/draft-boucadair-port-range-02#section-15.2 for a simplified exercise). Of course this optimisation depends on length of the port range.
>> 
>> (4) The drawback of assigning port ranges in the CGN is that the destination address is not kept by the device. This may not be convenient in early stages of deployment of shared IP mechanisms in SPs domains. Indeed: 
>> (a) If a high address sharing ratio (e.g., 1:1000) is used, to avoid revealing the identity of all subscribers sharing the same address to answer to an abuse complaint by the authorities, we may rely on the destination address as an indicator to identify a/the concerned customer. In the meantime, we need to encourage servers to log the source port number in addition to the destination IP address. (b) If a small address sharing ratio (e.g., 1:5) is used, storing the destination address in the CGN may not be useful. 
>> 
>>  
> 
> +1.
> 
> xing


+1, provided it applies more generally to "port sets", instead of just port"ranges".
(draft-despres-softwire-sam-01 sec 2.1, deriving a solution where port sets derived from extended IPv4 addresses are more optimized if comprising up to 4 continuous port ranges.    
> 
> 
>> Cheers,
>> Med 
>> -----Message d'origine-----
>> De : behave-bounces@ietf.org [mailto:behave-bounces@ietf.org] De la part de Lars Eggert
>> Envoyé : vendredi 3 septembre 2010 10:49
>> À : Tina TSOU
>> Cc : behave@ietf.org
>> Objet : Re: [BEHAVE] Port Management To Reduce Logging In Large-Scale NATs
>> 
>> Hi,
>> 
>> On 2010-8-28, at 12:18, Tina TSOU wrote:
>>  
>>> http://tools.ietf.org/html/draft-tsou-behave-natx4-log-reduction-01
>>> 
>>> It is a short, straight forward I-D. I would like to hear your opinion and more comments. What's the next step for it?
>>>    
>> 
>> I'm struggling a bit to understand the motivation for this draft. In the introduction, it says:
>> 
>>  
>>>  Some high performance NAT devices may need to create a large amount
>>>  of new sessions per second.  If logs are generated for each mapping
>>>  entry, the log traffic could reach tens of megabytes per second or
>>>  more, which would be a problem for log generation, transmission and
>>>  storage.
>>>    
>> 
>> Let's run some numbers. How large is a log entry? Let's assume two IPv4 addresses plus two ports numbers, which is 12 bytes, plus a timestamp, which is maybe 4 bytes, plus some random bytes of stuff. Say, in total 32 bytes.
>> 
>> At a rate of     1,000 bindings/sec, that causes  32 KB/sec of log traffic.
>> At a rate of    10,000 bindings/sec, that causes 320 KB/sec of log traffic.
>> At a rate of   100,000 bindings/sec, that causes   3 MB/sec of log traffic.
>> At a rate of 1,000,000 bindings/sec, that causes  32 MB/sec of log traffic.
>> 
>> So we're really only going to his the "tens of megabytes per second" range for CGNs that see a million bindings per second. You'd need an awfully big box to handle this, and a significant amount of IPv4 space to number it.
>> 
>> As for storage, with a million bindings per second and 32 MB/sec of log traffic, you need about 2GB/min, i.e., 2.7 TB/day. And this is without compression - these logs should be highly compressable.
>> 
>> All in all, I'm not fully convinced we have a problem here. Or maybe I'm missing something?
>> 
>> Lars
>> *********************************
>> This message and any attachments (the "message") are confidential and intended solely for the addressees. Any unauthorised use or dissemination is prohibited.
>> Messages are susceptible to alteration. France Telecom Group shall not be liable for the message if altered, changed or falsified.
>> If you are not the intended addressee of this message, please cancel it immediately and inform the sender.
>> ********************************
>> 
>> _______________________________________________
>> Behave mailing list
>> Behave@ietf.org
>> https://www.ietf.org/mailman/listinfo/behave
>> 
>> 
>>  
> 
> _______________________________________________
> Behave mailing list
> Behave@ietf.org
> https://www.ietf.org/mailman/listinfo/behave