Re: [alto] Pub-sub interfaces

"Diego R. Lopez" <diego@tid.es> Wed, 01 January 2014 21:44 UTC

Return-Path: <diego@tid.es>
X-Original-To: alto@ietfa.amsl.com
Delivered-To: alto@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A4A721ADDD3 for <alto@ietfa.amsl.com>; Wed, 1 Jan 2014 13:44:34 -0800 (PST)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.028
X-Spam-Level:
X-Spam-Status: No, score=-2.028 tagged_above=-999 required=5 tests=[BAYES_50=0.8, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_MED=-2.3, RP_MATCHES_RCVD=-0.538, SPF_PASS=-0.001, T_FILL_THIS_FORM_SHORT=0.01] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xDffnGe9Cl3s for <alto@ietfa.amsl.com>; Wed, 1 Jan 2014 13:44:31 -0800 (PST)
Received: from tidos.tid.es (tidos.tid.es [195.235.93.44]) by ietfa.amsl.com (Postfix) with ESMTP id AD5FD1ADDD1 for <alto@ietf.org>; Wed, 1 Jan 2014 13:44:29 -0800 (PST)
Received: from sbrightmailg01.hi.inet (sbrightmailg01.hi.inet [10.95.64.104]) by tid.hi.inet (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTP id <0MYQ00GJ9SDSER@tid.hi.inet> for alto@ietf.org; Wed, 01 Jan 2014 22:44:16 +0100 (MET)
Received: from dequeue_removeroute (tid.hi.inet [10.95.64.10]) by sbrightmailg01.hi.inet (Symantec Messaging Gateway) with SMTP id 49.FC.03314.03C84C25; Wed, 01 Jan 2014 22:44:16 +0100 (CET)
Received: from correo.tid.es (mailhost.hi.inet [10.95.64.100]) by tid.hi.inet (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTP id <0MYQ00GJ5SDSER@tid.hi.inet> for alto@ietf.org; Wed, 01 Jan 2014 22:44:16 +0100 (MET)
Received: from EX10-MB2-MAD.hi.inet ([169.254.2.204]) by EX10-HTCAS5-MAD.hi.inet ([::1]) with mapi id 14.03.0158.001; Wed, 01 Jan 2014 22:44:16 +0100
Date: Wed, 01 Jan 2014 21:44:16 +0000
From: "Diego R. Lopez" <diego@tid.es>
In-reply-to: <CANUuoLp6n-=Fedktn0Bbb9D6kxkUWZUNt9AiSiRpc5nsC5+dcg@mail.gmail.com>
X-Originating-IP: [10.95.64.115]
To: "Y. Richard Yang" <yry@cs.yale.edu>
Message-id: <A33455F9-C173-4260-AFA5-40498E3755E2@tid.es>
MIME-version: 1.0
Content-type: multipart/alternative; boundary="Boundary_(ID_7okx9FGPBjCW+pfVNn4Wnw)"
Content-language: en-US
Accept-Language: en-US, es-ES
Thread-topic: [alto] Pub-sub interfaces
Thread-index: AQHPAxxst12elKh7j0usAdu5KoPD8JptgosAgAEeswA=
X-AuditID: 0a5f4068-b7fe58e000000cf2-02-52c48c30f0d6
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFprIIsWRmVeSWpSXmKPExsXCFe/ApWvQcyTI4NkHBYuH2/eyOjB6LFny kymAMYrLJiU1J7MstUjfLoEr49yknILe/IoNz+ewNjBujOti5OSQEDCR+H/jJxuELSZx4d56 IJuLQ0jgAKNE86ttYAkhgW+MEleWVUIkZjJKtNw7zgySYBFQlfg7sYcFxGYDsh81/2YHsYUF 1CRevnkIVsMpECyx5ORMZogNChJ/zj0GqufgEBFQl3j51x8kzCygIdG9uI8VxOYVsJToa9rJ BmELSvyYfI8FoiZaYsuCr0wQtrhEc+tNsDijgKzEu/nzwXpBRh5uucEIYVtJ3Oz5A7VWQGLJ nvNQtqjEy8f/WCF+aWCUWP9nHdMERrFZSPbNQrJvFpJ9ELaexI2pU9ggbG2JZQtfM0PYuhIz /h2CqjGT+LX5LyOymgWMHKsYxYqTijLTM0pyEzNz0g0M9TIy9TLzUks2MUKiMWMH4/KdKocY BTgYlXh4F4QfCRJiTSwrrsw9xCjBwawkwnuvHSjEm5JYWZValB9fVJqTWnyIkYmDU6qB8ZTS t9tiF4Onfb3GlrfGVflVyeG21AvH8o9entoQJNjD90/mdsg7z1nfF8YV/NN/e/TV7HsspSUs /j/lstn/X8wRm9v8jet7z5bZnEes3baYWIeYXF+15uvNgiV+27zdux98uNPSuXeS1OMThRa9 P+55+Sfdm7N929+jWSLG94qmzWjyEpTQLVNiKc5INNRiLipOBACulavcpAIAAA==
References: <4DFA6345-8D80-4205-B1A7-C91FDF15AA1C@tid.es> <CANUuoLp6n-=Fedktn0Bbb9D6kxkUWZUNt9AiSiRpc5nsC5+dcg@mail.gmail.com>
Cc: "alto@ietf.org ALTO" <alto@ietf.org>
Subject: Re: [alto] Pub-sub interfaces
X-BeenThere: alto@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "Application-Layer Traffic Optimization \(alto\) WG mailing list" <alto.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/alto>, <mailto:alto-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/alto/>
List-Post: <mailto:alto@ietf.org>
List-Help: <mailto:alto-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/alto>, <mailto:alto-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 01 Jan 2014 21:44:34 -0000

Hi Richard,

A Message Broker is a general construct in pub-sub environments, acting as mediator for publishers and subscribers, matching interests and announcements, and enforcing access policies. I'd think of it as an essential part of the pub-sub middleware, not necessarily as a central server or a bottleneck.

I agree the document is rather general: bear in mind it is a first statement addressed to a WG like I2RS, with very broad goals and in its initial stages. My intention was precisely to provide it as an initial reference for the ALTO crowd to consider and discuss on use cases. The one you mention is the one I had in mind. More complicated ones could include hierarchical aggregation, composition of information from different servers, or data filtering driven by policies. I guess this could be applicable in inter-domain scenarios.

Be goode and have an Extremely Goode New Year,

On 31 Dec 2013, at 03:05 , Y. Richard Yang wrote:

Hi Diego,

Thanks a lot for posting the link. I read the document and it was a well-written document. If the document provides more text to review the two pub-sub models and how they may apply to I2RS, it will be more self-contained.

A key proposal from the document, I see, is the introduction of a Message Broker. A main motivation appears to be scalability, i.e., to avoid the P * S problem, where P is the number of publishers and S the number of subscribers.

One problem of the document is that it appears to be quite broad, where either applications or routers can publish and subscribe (not sure if routers will subscribe though), and many types (e.g., router/device status changes, app info changes? policy changes) are mentioned. This may imply that the schema of the pub-sub system can be quite complex or very generic. We know generic, well-used systems such as Google Chabby (Zookeeper), and hence I will wait to see the details of any specific proposals, on whether they will apply to ALTO. A concrete issue that I will look for is on how to encode updates of a large data set, e.g., a Network/Cost Map.

As a simple, related use case of their scheme, an ALTO Server can be a publisher to push any incremental updates to the Media Broker, who can then handle a large number of subscribers. More complicated use cases or ALTO should develop its own sub-pub mechanism?

Happy New Year!

Richard




On Fri, Dec 27, 2013 at 10:58 AM, Diego R. Lopez <diego@tid.es<mailto:diego@tid.es>> wrote:
Hi,

Some time ago we discussed about the pros and cons of using Websockets for implementing server-to-client notifications and I mentioned the possibility of using a pub-sub schema for creating a general notification framework.

While reviewing some messages during my end-of-year tidying I came through this draft:
http://tools.ietf.org/html/draft-camwinget-i2rs-pubsub-sec-00
contributed to I2RS, that discusses the application of the model in the access to a programmatic interface to the routing system. I think it provides a good overview of the model, and that many of the considerations are applicable to ALTO notifications, and even more to a generalized topology service.

Be goode,

--
"Esta vez no fallaremos, Doctor Infierno"

Dr Diego R. Lopez
Telefonica I+D
http://people.tid.es/diego.lopez/

e-mail: diego@tid.es<mailto:diego@tid.es>
Tel:    +34 913 129 041<tel:%2B34%20913%20129%20041>
Mobile: +34 682 051 091<tel:%2B34%20682%20051%20091>
-----------------------------------------


________________________________

Este mensaje se dirige exclusivamente a su destinatario. Puede consultar nuestra política de envío y recepción de correo electrónico en el enlace situado más abajo.
This message is intended exclusively for its addressee. We only send and receive email on the basis of the terms set out at:
http://www.tid.es/ES/PAGINAS/disclaimer.aspx
_______________________________________________
alto mailing list
alto@ietf.org<mailto:alto@ietf.org>
https://www.ietf.org/mailman/listinfo/alto



--
--
 =====================================
| Y. Richard Yang <yry@cs.yale.edu<mailto:yry@cs.yale.edu>>   |
| Professor of Computer Science       |
| http://www.cs.yale.edu/~yry/        |
 =====================================


--
"Esta vez no fallaremos, Doctor Infierno"

Dr Diego R. Lopez
Telefonica I+D
http://people.tid.es/diego.lopez/

e-mail: diego@tid.es
Tel:    +34 913 129 041
Mobile: +34 682 051 091
-----------------------------------------


________________________________

Este mensaje se dirige exclusivamente a su destinatario. Puede consultar nuestra política de envío y recepción de correo electrónico en el enlace situado más abajo.
This message is intended exclusively for its addressee. We only send and receive email on the basis of the terms set out at:
http://www.tid.es/ES/PAGINAS/disclaimer.aspx