Re: [ipwave] traffic lights status displayed in the car, and the latency problem

"Mr. Jaehoon Paul Jeong" <jaehoon.paul@gmail.com> Fri, 30 August 2019 09:56 UTC

Return-Path: <jaehoon.paul@gmail.com>
X-Original-To: its@ietfa.amsl.com
Delivered-To: its@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 790EC120810 for <its@ietfa.amsl.com>; Fri, 30 Aug 2019 02:56:45 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.987
X-Spam-Level:
X-Spam-Status: No, score=-1.987 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_HK_NAME_FM_MR_MRS=0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qJCCMcyM-mOy for <its@ietfa.amsl.com>; Fri, 30 Aug 2019 02:56:42 -0700 (PDT)
Received: from mail-wm1-x336.google.com (mail-wm1-x336.google.com [IPv6:2a00:1450:4864:20::336]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A1253120807 for <its@ietf.org>; Fri, 30 Aug 2019 02:56:41 -0700 (PDT)
Received: by mail-wm1-x336.google.com with SMTP id k2so5198841wmj.4 for <its@ietf.org>; Fri, 30 Aug 2019 02:56:41 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=2SGNGw7+3Q3qncIFozUCdpMA/Qzh7KiHESd2gsKFenM=; b=KncaEAG+WdPl6NAd6kT/BQhZ27tMo2MPAaARqytc4sDA6yEaLXNKEJ/NOI4LTVMW/u kFtVuKZa39Z6+hgTtZ5R2/kcgdwgduY6TkGbyUib/BXGagImVzkW2U/eCO2G2nsMGVVL l4RI+Ds02qhCPlgFDwWq+5oIJCtdHJN7AkdT+weSF7ADRSlY4FvwIe9MC2WjPtZWDGHy 9hA97OtGThcAaAmG4YWSzGv61xE+jjQuLsz4rNVb87RkAL+ftdnPzYGVadOeSz3RGL8i vgEXwLam1vcwVUgQRVq9XtAQgjCfEVX7VKRjwAXnE8/hmX40GWl8YAyZeJGNyUu/xhdR nrxg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=2SGNGw7+3Q3qncIFozUCdpMA/Qzh7KiHESd2gsKFenM=; b=A85PWcgODD/9r9gtMUpj68q0QFfEBk+XEuDi1EH23ILD87tPlC5sHoCCXTNKMZ6oDA QkoUqQpv1cFZnPNM59HDjDZ272NCuxHo5TRJrSVOqamwtHfeMXwEBuqs1WXQjlV57uAN ujWeC9aLeIKr3OU2fEZBDZX4jVFhWS1cizg/iyFY0nY7Rdrmoo27hi1a3QMN6mRfZOei qNddCgeCfGfrUo0R4yi3B8FXyS7oP9hXRch2ky+DHArn28Qf2XoVyPUmdlUM0bdUEAuv 0J+uGXMMTka7lUblB7uhtyHLJiy5LOk9k+LjqDu2BF0UvEWrJAXW+FQJsLbRlAgMeym1 83AQ==
X-Gm-Message-State: APjAAAUOk6AIi0pSheH3idwIbUJ1ZhJXzNcCbU4GEgSNI1Qwmbu8oZub WLuFGSNVPFu2qNmjinanUV2+mPQhzs2o5BxqhjM=
X-Google-Smtp-Source: APXvYqzT4ctDXEWG5a0yPHgxs9iHyoliZzaBPp4iYLNt6X8kAIV59fbwQkInyLO/gn+cxmkH5RcQrzXsSbGc9KP6ryw=
X-Received: by 2002:a7b:cf19:: with SMTP id l25mr1535506wmg.11.1567158999855; Fri, 30 Aug 2019 02:56:39 -0700 (PDT)
MIME-Version: 1.0
References: <b1f427f0-6ddc-89c9-1822-0bca8ce6185b@gmail.com> <CAL1T1NHp+rem4ioXHbyWF4v+-LVudU-EbL6Z9jTjKLV-wVhKNQ@mail.gmail.com> <e2f966fb-19b8-6744-cc72-1d1143146ded@gmail.com>
In-Reply-To: <e2f966fb-19b8-6744-cc72-1d1143146ded@gmail.com>
From: "Mr. Jaehoon Paul Jeong" <jaehoon.paul@gmail.com>
Date: Fri, 30 Aug 2019 18:56:02 +0900
Message-ID: <CAPK2Dew_poeFFRBwhjuajnW164b0Af7W3FuSB3Au3+7n2fN_0A@mail.gmail.com>
To: Alexandre Petrescu <alexandre.petrescu@gmail.com>
Cc: Chris Shen <shenyiwen7@gmail.com>, "its@ietf.org" <its@ietf.org>, skku_iotlab_seminar@googlegroups.com, "Mr. Jaehoon Paul Jeong" <jaehoon.paul@gmail.com>
Content-Type: multipart/alternative; boundary="0000000000007e360d059152a3ea"
Archived-At: <https://mailarchive.ietf.org/arch/msg/its/h5-i2F3Mv1p7pefYoVOQMPUSvP0>
Subject: Re: [ipwave] traffic lights status displayed in the car, and the latency problem
X-BeenThere: its@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IPWAVE - IP Wireless Access in Vehicular Environments WG at IETF <its.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/its>, <mailto:its-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/its/>
List-Post: <mailto:its@ietf.org>
List-Help: <mailto:its-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/its>, <mailto:its-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 30 Aug 2019 09:56:45 -0000

Alex,
The detour path through the VPN server using LTE links experiences such a
long delay.
This is why IPWAVE is required to allow a vehicle and a traffic light
controller to communicate directly with each other
using IEEE 802.11-OCB links.

Did you measure the response time from a laptop to a traffic light
controller using 802.11-OCB?

We need to break down the delay components to analyze the bottleneck in
this traffic light control scenario.

Thanks.

Paul



On Fri, Aug 30, 2019 at 6:17 PM Alexandre Petrescu <
alexandre.petrescu@gmail.com> wrote:

> Hi Chris,
>
> Le 30/08/2019 à 10:52, Chris Shen a écrit :
> > Hi Alex,
> >
> > Thanks Alex, it is good to see this experiment.
> >
> > About the latency, it seems that you use a shared cloud server for
> > both car and traffic light to access. That is the traffic light
> > updates its status to the cloud server, and the car queries the
> > cloud server if there is any update. There is no direct
> > communication between the traffic light and the car. So how do you
> > measure the E2E latency from car to traffic light?
>
> Thank you for the reply.
>
> Do you consider a cloud server that stores the status of traffic lights?
>
> We measure the E2E latency in two manners: the RTT displayed by ping
> command between laptop and traffic lights controller, and the time
> difference between the UDP DIASER request and response recorded on the
> laptop.  See the points 1 and 2 below.
>
> The car does not query the cloud server, but it queries the traffic
> lights controller through VPN.  The traffic lights controller does not
> send its status periodically to a server, but it responds to requests
> issued by the laptop through VPN.  We do not store the traffic lights
> status on the server. If we did this, then it would add up to the latency.
>
> 1. the VPN server in the cloud is a rendez-vous point.  It runs OpenVPN
> software.  The car laptop opens an openvpn connection to this server.
> Also the router-modem of the traffic lights controller opens such a
> connection to the same VPN server.  Once the two VPN connections are
> open, the car laptop can ping the router-modem of the traffic light
> controller and thus note the RTT reported by ping command.  This ping
> gets through the VPN server.
>
> 2. the laptop originates an UDP DIASER request for status of traffic
> lights.  This request is captured by the wireshark in the laptop.  This
> UDP DIASER request is sent on the Internet, arrives at VPN server and
> gets forwarded to the router-modem attached to the traffic lights
> controller.  The router-modem does port forwarding and forwards the
> request to the controller.  The controller sends back the UDP DIASER
> reply containing the status.  This UDP DIASER reply is captured by the
> wireshark in the laptop.  The time difference between those two messages
> makes for the E2E latency.
>
>
> Alex
>
> >
> > Thanks! Chris.
> >
> > On Fri, Aug 30, 2019 at 5:15 PM Alexandre Petrescu
> > <alexandre.petrescu@gmail.com <mailto:alexandre.petrescu@gmail.com>>
> > wrote:
> >
> > Hi,
> >
> > Has someone else filmed a demo of displaying the traffic lights
> > status in the car?  (a communicated status, not a camera recognized
> > status).
> >
> > We filmed recently several such trials.  We noticed a systematic
> > problem with latency.  This problem lies in the difference between
> > the color displayed by the traffic light bulb and the color
> > displayed in the car.
> >
> > Ideally, at no time should a human perceive a difference between
> > what the light bulb displays and what the laptop displays in the
> > car.
> >
> > https://youtu.be/RR5hpL29-vk
> >
> > At point 3 second, the bulb displays green whereas the laptop
> > displays red.  This undesirable situation lasts for 1 second.  It is
> >  an enormous time lapse.  It is sufficient for the driver to loose
> > confidence in the laptop display, and it is ample time for a
> > self-driving car to do many undesirable things.  A typical reason
> > for human loosing confidence in laptop display is that during such
> > lapse of time (1 second) in many places in Paris area one gets
> > honked (klaxonned) if one is first in line and does not leave at a
> > moment's notice; because the last in line risks having to wait a
> > second cycle - everyone in line knows that and at least one will honk
> > (klaxon). It is forbidden to klaxon in city.
> >
> > For this video, we did our best to reduce the latency.  The
> > communication path between the traffic lights controller and the car
> >  was set with 4G.  There are two 4G links in sequence: one between
> > the traffic lights controller and the VPN server in the cloud, and
> > another between the VPN server and the car.  The measured end-to-end
> >  latency from laptop to traffic lights controller averages 100ms.
> > The queries to obtain the status of lights are sent with a frequency
> > of approx. 20 Hertz, which is approx. each 50ms. (DIASER on UDP on
> > IPv4).  The laptop is a recent thinkpad with python doing queries
> > and display.  The traffic lights controller is an Aximum Maestro with
> > a Motorola MC-something.
> >
> > We could put 802.11-OCB there, to further gain on the communication
> > latency.
> >
> > We could try recent pre-5G chipsets.
> >
> > We could try the ITS-G5 SPAT-EM technology which relies on DIASER
> > still.
> >
> > But we are not sure the 1s delay exposed above will get any
> > improvement by any of these steps.
> >
> > This is why I am asking if this situation of latent display of
> > traffic lights in car was witnessed elsewhere, and which paths could
> >  be explored to improve the latency?
> >
> > Alex
> >
> >
> > _______________________________________________ its mailing list
> > its@ietf.org <mailto:its@ietf.org>
> > https://www.ietf.org/mailman/listinfo/its
> >
> >
> >
> > -- Yiwen (Chris) Shen, Ph.D. Candidate
> >
> > Homepage: https://chrisshen.github.io IoT Lab:
> > _http://iotlab.skku.edu <http://iotlab.skku.edu/>_ Sungkyunkwan
> > University, Suwon, South Korea Mobile:+82-(0)10-6871-8103 Email:
> > chrisshen@skku.edu <mailto:chrisshen@skku.edu>
>
> _______________________________________________
> its mailing list
> its@ietf.org
> https://www.ietf.org/mailman/listinfo/its
>


-- 
===========================
Mr. Jaehoon (Paul) Jeong, Ph.D.
Associate Professor
Department of Software
Sungkyunkwan University
Office: +82-31-299-4957
Email: jaehoon.paul@gmail.com, pauljeong@skku.edu
Personal Homepage: http://iotlab.skku.edu/people-jaehoon-jeong.php
<http://cpslab.skku.edu/people-jaehoon-jeong.php>