[Idnet] Uses case for ML -- automating traffic prioritisation

grenville armitage <garmitage@swin.edu.au> Thu, 30 March 2017 00:02 UTC

Return-Path: <garmitage@swin.edu.au>
X-Original-To: idnet@ietfa.amsl.com
Delivered-To: idnet@ietfa.amsl.com
Received: from localhost (localhost []) by ietfa.amsl.com (Postfix) with ESMTP id F3578128616 for <idnet@ietfa.amsl.com>; Wed, 29 Mar 2017 17:02:50 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.199
X-Spam-Status: No, score=-4.199 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_MED=-2.3, RP_MATCHES_RCVD=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Received: from mail.ietf.org ([]) by localhost (ietfa.amsl.com []) (amavisd-new, port 10024) with ESMTP id h6cOtMGc_szP for <idnet@ietfa.amsl.com>; Wed, 29 Mar 2017 17:02:48 -0700 (PDT)
Received: from gpo2.cc.swin.edu.au (gpo2.cc.swin.edu.au []) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B1387126DEE for <idnet@ietf.org>; Wed, 29 Mar 2017 17:02:47 -0700 (PDT)
Received: from [] (garmitage.caia.swin.edu.au []) by gpo2.cc.swin.edu.au (8.14.3/8.14.3) with ESMTP id v2U02guh027386 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Thu, 30 Mar 2017 11:02:43 +1100
From: grenville armitage <garmitage@swin.edu.au>
To: idnet@ietf.org
Message-ID: <58DC4B22.6090307@swin.edu.au>
Date: Thu, 30 Mar 2017 11:02:42 +1100
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.7.1
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="------------040908060607080004060600"
Archived-At: <https://mailarchive.ietf.org/arch/msg/idnet/7j5a7Yoq0uKEFQKzysv_21jGreI>
Subject: [Idnet] Uses case for ML -- automating traffic prioritisation
X-BeenThere: idnet@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: "The IDNet \(Intelligence-Defined Network\) " <idnet.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/idnet>, <mailto:idnet-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/idnet/>
List-Post: <mailto:idnet@ietf.org>
List-Help: <mailto:idnet-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/idnet>, <mailto:idnet-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 30 Mar 2017 00:02:51 -0000

Apologies for some repetition here -- I sent an earlier version of the below note to nmlrg@irtf.org in October last year, but then ran out of cycles to further engage in discussion. Just in case the idnet@ list has slightly expanded membership, here's a lightly-expanded version of the information again:

Between ~2005 and ~2012 my group explored the application of machine learning to the task of classifying application flows. One of the specific use cases was to classify traffic that required different QoS treatment, and automate the subsequent configuration of bottleneck home gateways to achieve said QoS treatment. A more topical variant might be to use ML for recognising traffic you wish to de-prioritise (e.g. protection from DoS, enforcing scavenger-class service, etc)

Our top-level DIFFUSE project page: http://caia.swin.edu.au/urp/diffuse/
A proof-of-concept implemented in OpenWRT: http://caia.swin.edu.au/urp/diffuse/openwrt/
(pre-cursor to DIFFUSE: http://caia.swin.edu.au/sitcrc/angel, and even earlier work on statistical traffic classification: http://caia.swin.edu.au/urp/dstc)

Some past academic papers that might be of (historical) interest:

Thuy T. T. Nguyen, Grenville Armitage, Philip Branch and Sebastian Zander.
Timely and Continuous Machine-Learning-Based Classification for Interactive IP Traffic
IEEE/ACM Transactions on Networking, vol. 20 no. 6 pp. 1880-1894, December 2012

Thuy Nguyen and Grenville Armitage.
A Survey of Techniques for Internet Traffic Classification using Machine Learning
IEEE Communications Surveys & Tutorials, vol. 10 no. 4 pp. 56-76, 2008

Jason But, Grenville Armitage and Lawrence Stewart.
Outsourcing Automated QoS Control of Home Routers for a Better Online Game Experience
IEEE Communications Magazine, vol. 46, no. 12, pp.64-70, December 2008