[nmrg] IETF98/NMRG42 - Draft minutes

Laurent Ciavaglia <Laurent.Ciavaglia@nokia-bell-labs.com> Tue, 04 April 2017 09:21 UTC

Return-Path: <laurent.ciavaglia@nokia-bell-labs.com>
X-Original-To: nmrg@ietfa.amsl.com
Delivered-To: nmrg@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 354A61273B1 for <nmrg@ietfa.amsl.com>; Tue, 4 Apr 2017 02:21:55 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.696
X-Spam-Level:
X-Spam-Status: No, score=-4.696 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-2.796, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id X16cLBuEpJWm for <nmrg@ietfa.amsl.com>; Tue, 4 Apr 2017 02:21:51 -0700 (PDT)
Received: from EUR01-VE1-obe.outbound.protection.outlook.com (mail-ve1eur01on0113.outbound.protection.outlook.com [104.47.1.113]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 06F8E126BFD for <nmrg@irtf.org>; Tue, 4 Apr 2017 02:21:50 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector2-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=sJeF4rHcKzNlNtW2P1RwN+7nSA8QrfeQRTGfUGwFkXU=; b=FRLd946JJTjgIqrJ9iYTjgYgpYdYisso4H9MmgyegVwQOnmGV0Bm/kGcL+qnIoFrk9TvIOhhaqSF/YNw7an0h0t1NTe6JFLEEMv1ooPPXvkBGrCEj+lryTWSRyus9rviyfTb45wq7aYMNP1zW42QwANC4nXtiFcciG6StNaYsxA=
Authentication-Results: irtf.org; dkim=none (message not signed) header.d=none;irtf.org; dmarc=none action=none header.from=nokia-bell-labs.com;
Received: from [172.27.205.111] (135.245.212.15) by HE1PR0701MB2204.eurprd07.prod.outlook.com (10.168.36.135) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1019.8; Tue, 4 Apr 2017 09:21:48 +0000
From: Laurent Ciavaglia <Laurent.Ciavaglia@nokia-bell-labs.com>
To: "nmrg@irtf.org" <nmrg@irtf.org>
Organization: Nokia Bell Labs
Message-ID: <1626d5cb-8eae-7cab-94e3-1b7e394d88a0@nokia-bell-labs.com>
Date: Tue, 4 Apr 2017 11:21:44 +0200
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="------------F1F7314F1AB291FAB26EDD86"
X-Originating-IP: [135.245.212.15]
X-ClientProxiedBy: DB6PR0802CA0027.eurprd08.prod.outlook.com (10.172.252.141) To HE1PR0701MB2204.eurprd07.prod.outlook.com (10.168.36.135)
X-MS-Office365-Filtering-Correlation-Id: 8bb3a5f6-6dd2-4c5d-7e7d-08d47b3c056a
X-MS-Office365-Filtering-HT: Tenant
X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001)(48565401081)(201703131423075)(201703031133081); SRVR:HE1PR0701MB2204;
X-Microsoft-Exchange-Diagnostics: 1; HE1PR0701MB2204; 3:6rDvN/UurpIQB05oITaHPapi+Lc0TYwMa770BLqaNgG5EOUwYa+MrFysvP7+BGLdvi7ZKK9IIoh7oQZB++YGVuRhXkPAHldoxh51pjIwDUJZVUaz0P2afX2BouPJevmL829Autt4llxY3d5HHLGlP275OcryhcAH70Is74hZ8tRVaCX9DPN/QszHXYaU4pF08k4robGYflX1rP7lFwfDaJz6nB+LJJsBiDzuh6R5l7Z8YMMyQLfuB4hpYygjA6lvbOIiDJmR/cWHPRCuvWEgt7jWw/Bu8Gn+TzeESTYkOCOF3UDII1KXIIKiJcWePKZYYmIqE4jH4J6d0XvTlg/BC6Q8jKI61Fsyirc4DTBoIdw=; 25:5im/YTH2/Xhwr4+15ZagjvWaxVjUqBKsGyX27RXGAy6tUumU/hdmz1ukk26RV8G6jIHBgXq6FCcho6FSsHRXmducV9Zt0pPiOtjeGxjx+iScalPN7tcVPWBX8zcLahbF0669k27wHCf9XNPebFmeVIDWuPjpPs0cqCrayLzlvSKx46Vd150l6g7D4Fd0Zwy7YNDBXKkQJX91BNJYGCKZG6lqaLULR5EgGwkduqSgwR6zygHiVWp+GKgkEv6AorHvOrUhEsKmX8wXNQuIRT+ufGL72m5VYaugr1lcMp6XCepLl8OUAcRQVh9z/GUCV85skPU0KCFICRWQIqNoL2OpV24LOyftVY99fuNv7oMZlXtoDL4X5I9sKRoVDvddsDXGGxfqA2zVYsEiIEPn7+OyxbHZnkLnjrUWcsYjmn3GZ8P4VdSz0WqXrF/xdh8e8TqhojrqBXEyqrE4QBAucC5bHg==
X-Microsoft-Exchange-Diagnostics: 1; HE1PR0701MB2204; 31:zrfXAh2CzKcES4RjirFtyLEgtTen8HtIvdYo/UjRj/S6XNgm9KNSsCh2h4joq3pQ75Z4XBm8nkPsTofg3tHH8oBoc673O3oIcz1kJbVqWt7s4XkX0m6bRprn1OgYg5lL2/06qd5B+dsJGKKyc31h4j2MpMT+USEZdP8lWepa2uy57FjiTAbNoVuywFwLgdeb2RFUERwdxhfUjU6xIRok4prcBZElbr9didVMCFSiCd0dYPRtWUoS7LBvjiYfnThFQtF0S7OBh9y0YJpgKiMpew==; 20:cxmm30QS0ojp31GijK6+HK9ATU/ifj/gJSbGeguVDoNFRZuwtkhyV1Srl1vN7/epY2+1dQgtnJQ6f0XURbisr28uFVdtNTZ/QRuULRomwluTzgnECxOgAZx2YEScJuu2wm6+xq0ArVNR8liv0wpg2gCRflhft5Y0GTVS9Huwx6G6eQkQWeEGa7YhEj0wTvbsr2I2z5BW54+JfVnqre66sC2toduvG0fO6wtBxE01QYh593oJ+i1pedLvMduHp0ChZ1Zl+O0a8dnWV7N2WoHfUdrNjoT0bvTz7uQB5KLr4955k2XTyzJ7xtXTPYkLC8GR+qhzCRNUov5OxCFLT0PpvCWjwQg38YaMq3pIAC3SJ11un00aKZBTL8THm55zht36w7YylNGDfuX2ONRyBViuQMsbJ1/PaThdvHeRB9WYoUf+JsTfqJhi50RCN+RppnCRpPUKvJMW6trGPgXcWtZBXxMyRA+Qu7S1RyyIMaPz02frCqrDSEAxvZjM8RHRP73U
X-Microsoft-Antispam-PRVS: <HE1PR0701MB2204F6869FC7754643CA9CD8E80B0@HE1PR0701MB2204.eurprd07.prod.outlook.com>
X-Exchange-Antispam-Report-Test: UriScan:(192374486261705)(131327999870524);
X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040450)(601004)(2401047)(8121501046)(5005006)(3002001)(10201501046)(93006095)(93001095)(6055026)(6041248)(20161123560025)(20161123555025)(20161123564025)(201703131423075)(201702281528075)(201703061421075)(20161123562025)(6072148); SRVR:HE1PR0701MB2204; BCL:0; PCL:0; RULEID:; SRVR:HE1PR0701MB2204;
X-Microsoft-Exchange-Diagnostics: 1; HE1PR0701MB2204; 4:lVrJXqeHlUfbIgSH0uyJeed0qUjYgmaahggfU7o0o0UXgZ6HwQaJYT6ehyp4rpifVO3Ftw9xYMV377jOTt0np7cINcxxCeVTV2QbMS/xjw5MwEQdX9hIqSg3x6ymvBh8eTdYD69ajv6IloUiGDK1VYuIWLpwQqHMMS7wW3WdejO11p3zNM6NEYqFZAYogiOBSMq3aua7DwrdThPURdZWLojRhaVDUYEQwPnCpndJ/K2sZls2soNhNJ9TOjfRbCrybZ/JjIueaGyAcnCTh/cDMm6bKRb3oiECuKSasewOQhHrF2s9aS+nSKbE6f5+Yhjyfin5aE2XVaejwVPdl+c8/SKAPmCunt9dL9fE7xfKzSpSVRBLBg3S+T54Gv6X5PXMic8SLJPnEIAyJhwehWagaItpey9AjucNwvzjbv24Zl4qN6x3CDawyrPmPNYJNi/XEfnoWwYAKJ9p5VVv1tW/KSoqtA9pPdmtfw0V7OgmZSqu2WsRLCYWYUVfDr89QzRHHJrQgya127zz7irjVJ/PpWeBoVO5O16PeimkGGwU4TbDTb3FLvS7xe2ypUUyYXvmDfrZN/ZsbwtY5H+54XfE5iVO/LUBxIc2xNIu9MTiffFiMpzK7YepkeLIBExy5XdJu/qQfZ8hmYzyg3nnRhyqgPQBy6S6e9V/+7t+oOdK8CGlYhxyPbX9Llg2ErGf4fjIixe+XOU/ho2wwyuefkMc4vhXRcesUhaJs1rwKyXeJ/KxnP7ZPoT+g6AqYLRns8X7T4pOKa/NtGg0Ax9gbl9VOR0rkN5raKxCHaDrx0xPPGRKT1mBo6LOGFuc/QIG3Ogf
X-Forefront-PRVS: 0267E514F9
X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10019020)(4630300001)(6049001)(39850400002)(39840400002)(39410400002)(39450400003)(39400400002)(39860400002)(497574002)(6306002)(90366009)(54896002)(84326002)(2906002)(31686004)(53936002)(236005)(6486002)(606005)(86362001)(83506001)(77096006)(31696002)(7736002)(36756003)(5640700003)(81166006)(65826007)(65806001)(65956001)(66066001)(6116002)(3846002)(33646002)(50986999)(8676002)(54356999)(5660300001)(4001350100001)(2351001)(25786009)(189998001)(38730400002)(6916009)(42186005)(2501003)(110136004)(512874002)(6666003)(1730700003)(7906003)(90052001); DIR:OUT; SFP:1102; SCL:1; SRVR:HE1PR0701MB2204; H:[172.27.205.111]; FPR:; SPF:None; MLV:sfv; LANG:en;
X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; HE1PR0701MB2204; 23:3w7dDwgxrG6IYJ8bDns8BhgsZ6fPmo67GioBKMB?= =?us-ascii?Q?C8+iHdajq7uxAvaBg2RLELZuvRsm9mWEtPfQtAWUcrfDEgEd7aNe7c+bJieg?= =?us-ascii?Q?drn9zYw3WchCD6CFO59j7z22EdazIWykFIKb7b0Xv/rjnlp6IV+dXjwY2Xuk?= =?us-ascii?Q?/SHS3ZvQMFoAIrLZg5Om91EfdrQrMpIqRtwMGqukPUMBfdEP+5wUlgedV9LJ?= =?us-ascii?Q?SKdWcbPksmD10p+71Q+N3B+ZrzspJ4SnkB7+p3MpkkRngP5sP/zZmCKuSecp?= =?us-ascii?Q?II8wLvH4pDW7QKnz1YGK5yPYzNIodFSBTbXO47xLWFHlRe4d9q5pDS1j66cl?= =?us-ascii?Q?HNQovvDySthLZhAUnAYq8ym4VuvDpeB4gi1i4ZDm7LTDXBDfWC3X65OSQl5u?= =?us-ascii?Q?Hiiwhw2wcBPw7468LOYqHJukgCCOQ2zgRIprr9FYch4Z7igyDWuetRRvzloc?= =?us-ascii?Q?SM8b51O22IaNByVXSsgYKHLhgujHSRDtrs/x+uJScGV+wfZPBRBU0kx7+syg?= =?us-ascii?Q?a438RwFnAOBFQljzuS3Yn978j26iqPDw673UE3T15g6fSIpsuM+zD0kfs6fL?= =?us-ascii?Q?pvBFGtjRT3t36l58CBT37u9HosjVRUcgOvuayhGV/fsgoMNFX0St7Ms3sZ0E?= =?us-ascii?Q?OdhcFXAOCQ5Pv72XaLntWDp1KlaNYlSxoivBhZJmpWnG8bXk9qfGVpSSYzjP?= =?us-ascii?Q?dZlJgCN8Vn4EGlxa6hS2hd9pYlgLyO0LuXbvWUGsUEIbKxXt1b0tsDRmGXWW?= =?us-ascii?Q?6tP8vfX0Q6N9OQuBWUmKpTOmZES/CoLLstaNCpLIUux6yErTVtcGT3ZSwTRC?= =?us-ascii?Q?xeJR6qOmphau0ZdIKI4ecHY6McuVVJuZv1Md8W57PsxpDl0oUAZT2DZPdEdu?= =?us-ascii?Q?fbR0Kt/KruZKH6ougTgoXsi1ZFWu9tb4O7Qp9sYE5xcWRsM4Qv0R3fD/W2Ca?= =?us-ascii?Q?GcRDV99iPDoFgpXMTMt750mByAsuORvv8g9w2V6OotGz5Gv5oA1MkVjIM6E0?= =?us-ascii?Q?OvQmnPMzeW4K+1Vf0RTcZqAISztRAFVPOqhkbOq5D8ucgX23YpjWiMlltn5H?= =?us-ascii?Q?iVSd140yoPs0GX6I96x86pMypcV5PPHLCUANFFpEs4DfN4Ws7IM+BUIoNPmO?= =?us-ascii?Q?IB9qUvqi6YZjbDWzqPnxYKMU4Gliq/RPUErwCCtuexbnb09gwoxpp32UvPT9?= =?us-ascii?Q?mInA5ALgvPSLqldz7EnG/xdnbd1IXbH32mTjbMorSXkULCRvdu5G8z3zKAQm?= =?us-ascii?Q?FCIGuwiVHE9ms4+D7y5kzpOPcmGjFJ4xzt/dwtt1JNcmcoJg8+1bPtrnDH5P?= =?us-ascii?Q?Xmw=3D=3D?=
X-Microsoft-Exchange-Diagnostics: 1; HE1PR0701MB2204; 6:52gPv1qd8vlOSE9gD8QgSGkRulh5ZH92aidskmAt4mmrd5Vebw3HFN5RL9iNDcazO0DqS4AC6qrweSHanxpTE2ZNDKoI2q/20ycWZFEc+USB35x1oCNo9msEHRCxhswPi8zUDaq7yQS4xDpX+A2Fu53k2uTrvBtORXTDe7e5JPyAxQvO5JDB/GsWWFraDB00WNGwCOuJEOEJSwxBg9Kf3XiHIUFYuaDNdl7/U9a1JrfYtG2ZvupCN8tHoK3tG0yp5xHT9PgWfaEdY8mUeb5IsH8ujqHpYaMcYakKH4N+uBz6D/gnViEvEw8ub982aM29rlvUTJEa3zanozayiqt6gd+6/54gGGjc+V3SiOCePgLO7zda9DPoYYppknl0OdJht7CuNPIkuOFpH1oH31n9FrfTILVCwjbs1ksoyjsvGb8=; 5:niwT2+fVAxZDEJFlMoDoHkrORABlNTpO0REWSYKRxyUV8Y2wBnOPCGT2OdLdfy9GSnu6ShAMOrt9zf6Y2RpD8fyLtEdDKVN5b90REQauHZUNyUXdUgIiIUWgsVywIv8ZggOHm7DM9YFk/LdE7TK8Gw==; 24:7K7R25EApNEsgI7DuXV6XUnLLUkrPHF4Ap03puk2xT92HisJqM3ev3SfOv2UAuCAYPlwKOzcd4IMX6uunPnwysAunXz1NrKyrs0uRvE1TBY=
SpamDiagnosticOutput: 1:99
SpamDiagnosticMetadata: NSPM
X-Microsoft-Exchange-Diagnostics: 1; HE1PR0701MB2204; 7:qPZd3N2HHMTfishv5j+6HGavXrr+DMOtvyVZgrbFme+DmhLz/O165ZOJox15kVcMPhEP/NdgpVQDlL6IRgIA3Gm10lTRrphh4homVsOjfetv2iN1PNmlRVjOOqEZ681B4n9kAaQ2cRZC1f/Wj8T0tviFWzlnAPdWF+mtbaw06IuSFrTLhS2gTA8ugEyQcBDoXNB+9gbOn4nq1/LAjHrrDeSoinoD/4UMOuE1o2jPxFAIz8vXXqZ3At92pcX2jVT5xOascZajYVhjqcds+Or0EZhaLPyqsI+gilioM85z8Rnim3cbkfM/O/36UxoZk4VARCojw0PIsJFE3jYmw+R9hg==
X-OriginatorOrg: nokia-bell-labs.com
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 04 Apr 2017 09:21:48.2389 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR0701MB2204
Archived-At: <https://mailarchive.ietf.org/arch/msg/nmrg/qdqyP-QUqhdloS3YH0PpTxAuKvo>
Subject: [nmrg] IETF98/NMRG42 - Draft minutes
X-BeenThere: nmrg@irtf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Network Management Research Group discussion list <nmrg.irtf.org>
List-Unsubscribe: <https://www.irtf.org/mailman/options/nmrg>, <mailto:nmrg-request@irtf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/nmrg/>
List-Post: <mailto:nmrg@irtf.org>
List-Help: <mailto:nmrg-request@irtf.org?subject=help>
List-Subscribe: <https://www.irtf.org/mailman/listinfo/nmrg>, <mailto:nmrg-request@irtf.org?subject=subscribe>
X-List-Received-Date: Tue, 04 Apr 2017 09:21:55 -0000

Dear NMRG,

Please find at 
https://www.ietf.org/proceedings/98/minutes/minutes-98-nmrg-00 and 
below, the draft minutes of the 42nd NMRG meeting held at IETF98, Chicago.

Please let us know if you have any comments or corrections.

Thanks to John Strassner for the excellent minutes!

Best regards,
Lisandro and Laurent.

---

42nd NMRG meeting, Monday, 3/27
Topic: Next steps in Autonomic Networking

Thanks to John Strassner (minutes taker) and Jéferson Campos Nobre (jabber scribe)!

Agenda:
   1. Meeting introduction, NMRG chairs
   2. Self-driving networks, Kireeti Kompella
   3. Autonomic networking retrospective, Jéferson Campos Nobre
   4. Open discussion: gaps, challenges, and propositions for an actualized road-map towards Autonomic Networking

This meeting is part of the series on defining a new research agenda for the RG.

Main conclusion of the meeting:
   - Initiate a new ID defining the actualized challenges, gaps, and document research directions and an action plan for AN (towards IRTF, IETF and beyond).

1.  NMRG Chair Discussion
1.1.  RG Status
   - draft-irtf-nmrg-autonomic-sla-violation-detection passed RGLC,
     ready for IRSG review
   - draft-irtf-nmrg-location-ipfix-07 passed IESG conflict review,
     needs to go through IETF review and IESG approval

1.2.  Next Meetings
   - Will meet at IM2017 (Lisbon, 5/8-12), topic TBDIETF99
   - IETF99 (Prague), workshop on measurement-based network management
   - IETF100 (Singapore), full-day workshop on intent-driven networking

1.3, Research Agenda
   - Need your input and feedback about what to focus on!


2.  Self-Driving Network, Kireeti Kompella
Made a presentation at the MPLS World Congress a year ago. This was the first public presentation of this concept. It made an analogy to self-driving cars, which took 10 years from vision to prototype.
Note that the first attempt in 2004 FAILED. This talk is about the vision required to realize a self-driving network.

A self-driving network is different than a self-driving car. The self-driving network needs to do the following:
   - Accept “guidance” from a network operator
   - Self-discover its constituent parts
   - Self-organize and self-configure
   - Self-monitor using probes and other techniques
   - Auto-detect and auto-enable new customers
   - Automatically monitor and update service delivery
   - Self-diagnose using machine learning and self-heal
   - Self-report periodically

There are five key technologies required to realize this challenge. However, the realization of these technologies differs for a self-driving car compared to a self-driving network:
   - Telemetry
   - Multi-dimensional Views
   - Automation
   - Declarative Intent (important for removing human from the loop)
   - Decision-Making
     - Rule-based
     - Machine learning

Telemetry
   - Various sensors (e.g., speedometer, gas gauge) assist the user.
   - Self-driving requires more, so Google added LIDAR, which can do a
     360 degree scan. Note that Car is $70K and Lidar is $80K
   - Look at slide 7. You have a producer and a consumer. You do NOT
     want to have to poll for these data. Data should be provided in a
     real-time, streaming format that is optimized for
     machine consumption.

Multi-Dimensional Views
   - Cars have different types of sensors; rely on human to interpret
   - Networks today have specific views that provide specific types of
     data for specific purposes. Tends to be siloed.
   - Future networks will need different views that enable data to be
     correlated across multiple domains, spanning multiple geographies

Automation
   - Where we are today: Chassis and Line Cards; on top of this, you
     have an OS.
   - On the top you have various solutions (e.g., Python, Chef,
     Ansible, Puppet)
   - In the middle, you have various communication mechanisms (e.g.,
     RPC) that in the IETF case, support Netconf and Restconf; then
     you have a framework connecting this to the top layer.
   - Didn't describe automation for the future

Declarative Statement of Intent
   - For Cars, state where you want to go, with hints (e.g., fastest
     time vs shortest distance vs. most efficient use of battery)
   - Next, have the car talk to your phone to see where you need to be
   - For Networks, we want to state a high-level, declarative
     specification of service requirements
   - Parse this, and produce config changes
   - For Future Networks, we need to do this better

Decision-Making:  Rule-based vs. Machine Learning
   - Rule-based: simple, straightforward, but doesn't scale (basically,
     a set of IF-THEN production rules that grows with number of decisions to be made)
   - Machine Learning: fastest way to learn complex behavior, but
     - can come to strange conclusions
     - hard to know what it knows
   - Typically, you pair these two approaches to build a system

Five Stages of Self-Driving
   - Manual
   - Visualization (where we currently are)
   - Analysis and Prediction
   - Recommendation
   - Autonomous Decisions

We are at the second level (visualization); we can augment to level 4 (recommendation). This can be easily analyzed by an experienced human to help.

How do we get this kicked off? Shown in slide 15.
We really need to fix telemetry. Telemetry needs to be optimized for machine consumption, not for humans! Then we need to optimize how to assist in decision making. We really need standardized data models and interactions to help collect the right data at the right time, and correlate them to produce actionable results.

The hypothesis is to position this similar to DARPA's Grand Challenge that was given to self-driving cars.

Note, however, that there is a huge skill set change required to realize this vision. For example, you don't need to set OSPF metrics, but you do need to be able define high-level, declarative policies that can specify what you want. The network is not programmed, node by node; rather, it is told what to do, and has the intelligence to do its tasks.

Summary
   - there is a compelling vision that has strong economic implications (reducing OpEx, reducing time to market, increasing efficiency)
   - the ability to predict what is needed in the future, and anticipate what is needed and adapt the infrastructure to support those needs, is critical for supporting future business models.
   - this will also help security, not just management

Giovane Moura: what is really new here? Isn't this just autonomics?
Kiretti: I haven't really followed autonomic networking. What I want to do is to automate actions in the NOC or POP. How can you reduce the burden on the user?

Pedro Martinez-Julia: How much have you played with or implemented? Is there a testbed?
Kiretti: I started playing with bandwidth, but I lack data of sufficient
size. I want to be able to do (long-term) trend analysis, so that I can predict where problems will be. As another example, if I see traffic on a port is vastly different than normal, this should trigger an alarm.
We have the data available but no good way to get at it. Syslog analysis using rule-based analysis is too hard.
Pedro Martinez-Julia: have you looked at other, more complex, systems?
Kiretti: I don't care as much about implementation as I do about the challenge itself. When DARPA made the challenge, they did not say "use a specific implementation or technology".

Dan Druta (AT&T): Interesting vision, good analogy. There are probably networks that are fairly self-sufficient. It all comes down to legacy.
In the self-driving car case, it is usually the human that causes the problem. But legacy is a big issue because of the economic investments present. Hence, the deterrent is scale and legacy interworking.
Kiretti: Yes and no. The big problem is not the bits and pieces that exist, but rather, enabling a car to drive itself.

Diego: It is not just about the availability of data, the data must be shared. This is bogged down in arguments.  Then, you have to sift through the data. You need to be able to not just generate good data, but also noise, to perfect how we identify the good data.
Kiretti: I don't want to polish a diamond. Rather I want multi-modal learning, where I can combine different data (e.g., visual and audio).

LuYuan, eBay: deep learning allows pooling of different types of knowledge. We have a lot of work to do before we get to the point of choosing an algorithm.


3.  Autonomic Networking Retrospective, Jeferson Campos Nobre
We have been focused on specifying a minimal set of properties for an autonomic system. Rather than focus on things like self-CHOP, we think that applying autonomics to manage the complete network lifecycle is more important.

Reviewed simplified figure of FOCALE, emphasizing its use of two different control loops.

Many efforts, such as ANA, UMF, and GANA, as well as recent efforts (e.g., SUPA, HOMENET, SDNRG, NFVRG), exist. Autonomic networking is usually addressed by the Network Management community (e.g., with IM, NOMS, and CNSM); NMRG coordinates with these and other communities.

Previous editions of Autonomic Networking in the NMRG led to:
   - overview of technologies and terminology for autonomics applied to networking and network management
   - gap analysis, lessons used, and real world experiences
   - two RFCs (7575 and 7576)

The UCAN BoF was popular, and resulted in the chartering of ANIMA. The focus of this WG is professionally managed networks. ANIMA has 4 major deliverables:
   - discovery of autonomic nodes (GRASP)
   - negotiation for autonomic nodes (GRASP)
   - bootstrapping a trust infrastructure (BRSKI)
   - definition of a separate autonomic control plane (ACP)
However, other work items exist, and can either be satisfied by rechartering or as NMRG submissions
   - intent policy, ASAs, coordination of autonomic nodes

Perhaps NMRG is a good home for these types of discussions:
   - definitions, goals, and gap analysis needs additional work
   - in particular, intent policies are controversial and out of scope
   - draft-pentikousis-nmrg-andr is an example
   - machine learning, and how this set of technologies can be used by autonomics
   - intent (e.g., pentikousis-supa-mapping)
   - how new paradigms, such as NFV and SDN, affect programmability and autonomics
   - fully programmable network elements and functions

4.
Laurent: What are our next steps?
Diego: there are many places where we have many touch points. Maybe we should start by identifying gaps and challenges. Also, note that there is a distinct difference between software-based networking vs. software-based network management. Diego would be happy to be a part of this.
Kiretti: standardized data models. This needs to evolve as we understand data better. Can we have a shared data repository for our experiments?
John: Actually, we need a standardized information model, or at least, fragments of one. Data models are platform-, language-, and/or protocol-specific. An information model defines the concepts independent of these parameters. If we don't have common concepts, then data models will fail.