Re: [bmwg] draft-cprjgf-bmwg-powerbench-01

LUIS MIGUEL CONTRERAS MURILLO <luismiguel.contrerasmurillo@telefonica.com> Tue, 05 March 2024 22:52 UTC

Return-Path: <luismiguel.contrerasmurillo@telefonica.com>
X-Original-To: bmwg@ietfa.amsl.com
Delivered-To: bmwg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 20BE2C14F61D for <bmwg@ietfa.amsl.com>; Tue, 5 Mar 2024 14:52:38 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.105
X-Spam-Level:
X-Spam-Status: No, score=-7.105 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_NONE=0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=telefonica.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id m9Sq6FZVG4eK for <bmwg@ietfa.amsl.com>; Tue, 5 Mar 2024 14:52:33 -0800 (PST)
Received: from EUR03-DBA-obe.outbound.protection.outlook.com (mail-dbaeur03on2074.outbound.protection.outlook.com [40.107.104.74]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 594AFC14F618 for <bmwg@ietf.org>; Tue, 5 Mar 2024 14:52:32 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Rp3lAuoEU/3MpvjuJbQzHw79naTTr/TnO04PfcjJx8anCj3kouTYwsP8aao5pPCvyRobOg+pKSFAGe+44gZ/2DY3lXOXY6bvhUchQF00atHjhJ8xvpEe+2S6PIBBId23krbbbvhakeIBjQMvG0LHgmlA0oiU9rovVNrwzYFAJlfJvHsEdQD4nla3uV1kjZt19pRqEAHLvH5QVAbfDokv1nNByqRtu+S/7d2cTmxsoRD4PwPBiLXcCErVCnUVdCYQ7B5jcHtmzvwNVkSa5me5kMVlv8kX7dbWoJwh8xPZ6MJpZt6+fvDDWvoXOYHAYZAxNdnyGdz3UBu4dQtxCb9HMg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=ZHWZnMZjyITWaVImA7EkCY6eLk934QlpnWuSkSST1S0=; b=HZXazu5COPSh2F0ny8eTXRuOkpxDRR0oLcHi5yYnXGcDmSEybuzLM2bvTcinM6uZD/pL5R4rw6mR5eymMDFcfqylp2ymJfv65JqDbvxmnUDaszcCH5xcLbiQO5aAuxCRtiCDPsNN769fbeOyt3rYrELY6bsEJCDZ2uoAP+4dzgtmAPbbvfPfAAjBAvVTkXRGGVVwSkU+Gcq7QLDHuuGj5wGHp0MxwYWcMJhSLg7NO9UIRPs7IadGum/DH5bCLualJn3LTU2MrL6qWgHm6IlxK+TxMGtdMkKXk2EpHJuRjYy4vyVn9wf7D97MbzrokOtPPNnvYHEIWP5olQu1D/T/nQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=telefonica.com; dmarc=pass action=none header.from=telefonica.com; dkim=pass header.d=telefonica.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telefonica.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ZHWZnMZjyITWaVImA7EkCY6eLk934QlpnWuSkSST1S0=; b=VEFC60CZhx+Ndd0/pZzNsaFQEQFg6gDSSQiyT/MAwcO9/IpxmfmOmId09QKBL0JVz32ZDfhci5tPBUjnYDJSq5qt42L8MmgwDHHLOcK727mTxXGKV6jzVEHVgQZH3SLMUcBmuZueDkkauyB2+lokJOZKSD/6maz+ESuvBPq2WGY=
Received: from DB9PR06MB7915.eurprd06.prod.outlook.com (2603:10a6:10:291::14) by VE1PR06MB7104.eurprd06.prod.outlook.com (2603:10a6:800:1a8::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7362.24; Tue, 5 Mar 2024 22:52:30 +0000
Received: from DB9PR06MB7915.eurprd06.prod.outlook.com ([fe80::ec61:9e32:46c:babb]) by DB9PR06MB7915.eurprd06.prod.outlook.com ([fe80::ec61:9e32:46c:babb%4]) with mapi id 15.20.7362.019; Tue, 5 Mar 2024 22:52:30 +0000
From: LUIS MIGUEL CONTRERAS MURILLO <luismiguel.contrerasmurillo@telefonica.com>
To: Carlos Pignataro <cpignata@gmail.com>, "bmwg@ietf.org" <bmwg@ietf.org>
Thread-Topic: [bmwg] draft-cprjgf-bmwg-powerbench-01
Thread-Index: AQHabobFj9H6oul9sUi2aj7PIuiwELEptRsg
Date: Tue, 05 Mar 2024 22:52:29 +0000
Message-ID: <DB9PR06MB7915A0A9A762D1C9A3D9A1529E222@DB9PR06MB7915.eurprd06.prod.outlook.com>
References: <CACe62Mn31EDpkpQ3cCX+mLTtq-czqnkc1e+SjeOOSChcTgFVhA@mail.gmail.com>
In-Reply-To: <CACe62Mn31EDpkpQ3cCX+mLTtq-czqnkc1e+SjeOOSChcTgFVhA@mail.gmail.com>
Accept-Language: es-ES, en-US
Content-Language: es-ES
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=telefonica.com;
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: DB9PR06MB7915:EE_|VE1PR06MB7104:EE_
x-ms-office365-filtering-correlation-id: 095b7bd5-c728-4983-44c3-08dc3d66efdf
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: JVJfy6yDbvAp9/f+VYbMKhtL4kcGg7pyFMCmdWY6mdWxiYFpj+ogbXwq1eiY43C33Ui6zq+wusc38X3Bdbuwx4C9bR00iUkU+YV/USUgCUFda71j39C7m6YbG0ipfC/v2ANi3063K6I3NjGvU8vmHRt/eSnFxvk5rj7uSULEd4OcxScnodgZ2IYshPg1ox7OCXfZcfK8N6Fzl370gQFxQM7GyZtTp3bUUC6ujcjl0WNV/NslYvhAi+bu6jNagyCOtvzmLq1ALekKorQOz2hcZM0m98bpirTUgpk/5pJGiUiE7VQP6JId1jAeGA8Ag9VxAIXanAYKl0kRjm7ngpR/w+aDaD44l7MEqWYrJ7duec8hB5BT/ZAcmSIJ5sUOCHEscVUbbPbuKGrElX0jrd4QWD1SD02hdH6CKmrYHZsbRYwGkufG+4l0dQt2fP31bf2Q44gJmtBOgKr3Au+R0jWAVZwqJ4k/0+kRYg2NjScVrqWO0jPw0Q8vuaWIpUi7bu5DL69dCzw+h3ft8qozSpnH+KW5BP3lcYlXU0EyvXepOZnvYAbfSMydrG2mv4QYupuQvClbqiLkKnGXMrwTmlHw7V3Pzqdf58pWTf2kQTK9+MfVUGP1GUiI3yNADpRtCgmzvgQdKZjokB4XGptpHqdCaMg/3mhD+76IbU5GAMZopC0=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DB9PR06MB7915.eurprd06.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(376005)(38070700009); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: wMuu0na/QJol781Gb5bj02o9L5Puc8qZo6bTC+tidtOhv3gzH1XIs+tj6e4CENvUTNogaGjxLTEtZhb0WGxMGMabjPU9WXBynxv3pGVqeGkg3aWxXc/Tk/w8+CWUYxayProvqzyFgdFibCcae76x9N0pF/3lcseU3Ipx2D4LcxIZLl8fhxrHDetnX061b7vk6VDo5Eo5qnzWImy39j22LcYC+3VgHmYyMhbi1WnaE35WWm9ivNC2L/vdwZIdZkO4Nn+pqyY2uM4xjm7MZy/4cONOLliZ+o5bDyJc8YOi72o9g0ZiSyeTJC+yxa6mDg/2sJs4yacFhhfesHM8oqTmQyk8jieuAWbnDhBVK810jiYdLkXxvVn15KVbfqROYPn196MIl6AAa980WZMN47um7WWzID/V2cKNfMDaxN3g0Rof2ad6EyhYvbBrUSAigrA4xJgSrL5R/PLED9u1/7K4kO+LVzy9MhldyQbJXvQtk/16TjLW96lxqVNSPe0fIx0svO2GFireutvwJ0fNUAHCXnldClltCd70na/L5VCMNdgBs9WNjo7sk7Xh+mAdmf1Y4bZzD+qjEnQN7BQWxKCFyGnCXOXMWzb4BSl8Kouzv4x89uG5bCtKG4jAvbXZFljkkGAXSb4h0gacp3iwYn+4Gt9eRMs5OzGZdU5wIzlUH1+8rgAygFkZHnGSVzMhePQPl7MliPhg/Kkesf5voyNfnO7B+t2dHngOSDigk1TZUBAcpt/mv3aYAIjfWCDxkX753e84gskNgFBtlW2e0HC7q33MOHanhSW5XJIUyqIvLj/wtC2/Q9Yj1GX4r4ug3pt8aN4cZ3YIKAGYmXpf2jhNkXUc4PmBUlBxj50Uf4gDK4CMFfFMIpEHoWVYyylIRAfMZNqC8ub+gJ+MlF0lNMZ3fvBovFq68/AozmSVR0ZG2Bq6nZLeN1JbgMrfCYCBtHK0zQRY5/gPiUFzSlzpwCcEqF3CBHoyAQXpe5canDbUhN66VM0L3TuefCsHOXGQBp0NV9/au4huG6rsOX+ZEbzaE84tUGplaUGbsvSZHtij71KgUDSKd1OiZ7JeFMJAlv7Ui/bfFRdZWB8RRP0U5p3YaWDz0AWfPAPnphYfn36xyJk4zeFnLkCnq/5tM0V8AFa+69DtPZdAd5i7b/vYXGDYey2vDn7qf0fkqQVS1nbQqZhy/gWnKefkI/4+ocyeHHgbM3P+iIR6UEnf7zrRx++qpVB+UsUZpD8dU+znz87mXE9p0sfM1TKRqFM4TqEv0+JmxUDmn2SHAJsAEjhDbLD7Ri4WnZsUkYKKt32L507syrHpVdexEzst1N6utz/EEW0aUbfrcUET1vQV6RojnKsfqyyS3Th/38oaeLGipRp5LwOW8hOu9M2rOU1ey+7aAzv1gmSKXpmkikwHDKkee4UIHQgFowvkRkr0vM09/E2eCNiEM8HTs40UV8Y+AalN4PeUenB3esYJc8SgEIRIzewInFwB1jpFEWzHTUbFKymD0/YVnUGemsE49RpAFL91iuhB7TbeczALXgmKBc1rVL2sWZAfC6Tb2CEnDxTE9YbMiTpbGH3EL8dVrUbfpeTNYLI/E5aIR6lkXdZmL7XC0pv41eztDtRBKsoCSE6gaYWI9rtf33awp95lXqbZvHCydG+m
Content-Type: multipart/alternative; boundary="_000_DB9PR06MB7915A0A9A762D1C9A3D9A1529E222DB9PR06MB7915eurp_"
MIME-Version: 1.0
X-OriginatorOrg: telefonica.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: DB9PR06MB7915.eurprd06.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 095b7bd5-c728-4983-44c3-08dc3d66efdf
X-MS-Exchange-CrossTenant-originalarrivaltime: 05 Mar 2024 22:52:29.9869 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 9744600e-3e04-492e-baa1-25ec245c6f10
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: v8SzH4PF6lUOsbGMFGb67rpD5InAq5LIIt2s01Jw0tGSQdglscdwNR+Y5G8166SZnLqgLTqHcmjynejnX+8sr91nbD81xiAnciIe6cPBKbblmaXXTDTbaBfg9ik/OAds0SvWHBpZidC/Aih1jt4lRw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: VE1PR06MB7104
Archived-At: <https://mailarchive.ietf.org/arch/msg/bmwg/E99Ph-diiX6kivXzS-E0ouGvHlE>
Subject: Re: [bmwg] draft-cprjgf-bmwg-powerbench-01
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/bmwg/>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 05 Mar 2024 22:52:38 -0000

Dear authors,

I have gone through the document. Some few comments from my side:


  *   I find the formulation in 2.1 and 2.2 a bit confusing. I understand that Ti represents each of the active interfaces in the router. What is not evident for me is the applied weights for each interface, the Bi values. What is represented by these weights? All sum up 1, but the weights of the ingress interfaces is equivalent to the egress ones?
  *   The value “m”, identified as number of traffic load levels, I assume is different from the “m” suffix used for Ti and Bi, right?
  *   I think 2.1 and 2.2 would benefit from a numerical example.
  *   Regarding traffic loads it is proposed to consider 100%, 30% and 0%. Thinking on operational situations, I think some values are informative but not useful at all. Let me explain. As rule of thumb, operational networks are usually kept to a maximum load of 50% (roughly speaking) in a way that if some link or node fails, the protection paths / nodes can absorb the excess traffic. This should be something exceptional, and I think that the in such circumstances is more critical to guarantee no traffic losses than being efficient in terms of energy consumption, assuming that situations are temporal. So probably is better to concentrate in what would be the typical working regimes in terms of network occupancy (peak, valley and average values) rather than consider the extreme cases (which are good to know but less relevant in the day-by-day operation).
  *   Interestingly, you count on a power meter as reference system or ground truth of the energy consumption. I think a missing benchmarking test is the one assessing the validity of the energy / power values reported by the node sensors. I mention this because thinking on possible ways of automating optimization actions in the network, the sensors’ information is the one that can be retrieved automatically from production nodes. So understanding how close / far are those from the reference provided by the power meter is quite interesting.
  *   In section 6.2 you comment about the base power. Here we can find different situations. On one hand, the monolithic routers / switches, and on the other hand, the modular ones. For monolithic equipment section 6.2 is fine. For modular ones, probably it would be a good practice to determine on one hand the base power of the basic elements (processors, fans, etc) and then the increments due to each of the used cards, without and with traffic.
  *   It is described the fact of heat dissipation. Maybe temperature of the equipment could be also a interesting data to be reported, taking into account that some equipment should work under extreme temperature conditions in certain environments.
  *   While the benchmarking is performed determining common traffic load levels, other common principles should probably apply: usage of transceivers of the same kind, same set of protocols / configuration, etc.

Thanks, best regards

Luis

De: bmwg <bmwg-bounces@ietf.org> En nombre de Carlos Pignataro
Enviado el: lunes, 4 de marzo de 2024 23:53
Para: bmwg@ietf.org
Asunto: [bmwg] draft-cprjgf-bmwg-powerbench-01

Hi, BMWG,

Today, we posted a new revision of:
https://datatracker.ietf.org/doc/html/draft-cprjgf-bmwg-powerbench-01
https://www.ietf.org/archive/id/draft-cprjgf-bmwg-powerbench-01.html

and we welcome your review, feedback, suggestions, and input!

Thanks!

Carlos, Romain, Giuseppe, and Qin.

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is confidential and privileged information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição