Re: [ipwave] traffic lights status displayed in the car, and the latency problem
"Mr. Jaehoon Paul Jeong" <jaehoon.paul@gmail.com> Fri, 30 August 2019 09:56 UTC
Return-Path: <jaehoon.paul@gmail.com>
X-Original-To: its@ietfa.amsl.com
Delivered-To: its@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 790EC120810 for <its@ietfa.amsl.com>; Fri, 30 Aug 2019 02:56:45 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.987
X-Spam-Level:
X-Spam-Status: No, score=-1.987 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_HK_NAME_FM_MR_MRS=0.01, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qJCCMcyM-mOy for <its@ietfa.amsl.com>; Fri, 30 Aug 2019 02:56:42 -0700 (PDT)
Received: from mail-wm1-x336.google.com (mail-wm1-x336.google.com [IPv6:2a00:1450:4864:20::336]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A1253120807 for <its@ietf.org>; Fri, 30 Aug 2019 02:56:41 -0700 (PDT)
Received: by mail-wm1-x336.google.com with SMTP id k2so5198841wmj.4 for <its@ietf.org>; Fri, 30 Aug 2019 02:56:41 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=2SGNGw7+3Q3qncIFozUCdpMA/Qzh7KiHESd2gsKFenM=; b=KncaEAG+WdPl6NAd6kT/BQhZ27tMo2MPAaARqytc4sDA6yEaLXNKEJ/NOI4LTVMW/u kFtVuKZa39Z6+hgTtZ5R2/kcgdwgduY6TkGbyUib/BXGagImVzkW2U/eCO2G2nsMGVVL l4RI+Ds02qhCPlgFDwWq+5oIJCtdHJN7AkdT+weSF7ADRSlY4FvwIe9MC2WjPtZWDGHy 9hA97OtGThcAaAmG4YWSzGv61xE+jjQuLsz4rNVb87RkAL+ftdnPzYGVadOeSz3RGL8i vgEXwLam1vcwVUgQRVq9XtAQgjCfEVX7VKRjwAXnE8/hmX40GWl8YAyZeJGNyUu/xhdR nrxg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=2SGNGw7+3Q3qncIFozUCdpMA/Qzh7KiHESd2gsKFenM=; b=A85PWcgODD/9r9gtMUpj68q0QFfEBk+XEuDi1EH23ILD87tPlC5sHoCCXTNKMZ6oDA QkoUqQpv1cFZnPNM59HDjDZ272NCuxHo5TRJrSVOqamwtHfeMXwEBuqs1WXQjlV57uAN ujWeC9aLeIKr3OU2fEZBDZX4jVFhWS1cizg/iyFY0nY7Rdrmoo27hi1a3QMN6mRfZOei qNddCgeCfGfrUo0R4yi3B8FXyS7oP9hXRch2ky+DHArn28Qf2XoVyPUmdlUM0bdUEAuv 0J+uGXMMTka7lUblB7uhtyHLJiy5LOk9k+LjqDu2BF0UvEWrJAXW+FQJsLbRlAgMeym1 83AQ==
X-Gm-Message-State: APjAAAUOk6AIi0pSheH3idwIbUJ1ZhJXzNcCbU4GEgSNI1Qwmbu8oZub WLuFGSNVPFu2qNmjinanUV2+mPQhzs2o5BxqhjM=
X-Google-Smtp-Source: APXvYqzT4ctDXEWG5a0yPHgxs9iHyoliZzaBPp4iYLNt6X8kAIV59fbwQkInyLO/gn+cxmkH5RcQrzXsSbGc9KP6ryw=
X-Received: by 2002:a7b:cf19:: with SMTP id l25mr1535506wmg.11.1567158999855; Fri, 30 Aug 2019 02:56:39 -0700 (PDT)
MIME-Version: 1.0
References: <b1f427f0-6ddc-89c9-1822-0bca8ce6185b@gmail.com> <CAL1T1NHp+rem4ioXHbyWF4v+-LVudU-EbL6Z9jTjKLV-wVhKNQ@mail.gmail.com> <e2f966fb-19b8-6744-cc72-1d1143146ded@gmail.com>
In-Reply-To: <e2f966fb-19b8-6744-cc72-1d1143146ded@gmail.com>
From: "Mr. Jaehoon Paul Jeong" <jaehoon.paul@gmail.com>
Date: Fri, 30 Aug 2019 18:56:02 +0900
Message-ID: <CAPK2Dew_poeFFRBwhjuajnW164b0Af7W3FuSB3Au3+7n2fN_0A@mail.gmail.com>
To: Alexandre Petrescu <alexandre.petrescu@gmail.com>
Cc: Chris Shen <shenyiwen7@gmail.com>, "its@ietf.org" <its@ietf.org>, skku_iotlab_seminar@googlegroups.com, "Mr. Jaehoon Paul Jeong" <jaehoon.paul@gmail.com>
Content-Type: multipart/alternative; boundary="0000000000007e360d059152a3ea"
Archived-At: <https://mailarchive.ietf.org/arch/msg/its/h5-i2F3Mv1p7pefYoVOQMPUSvP0>
Subject: Re: [ipwave] traffic lights status displayed in the car, and the latency problem
X-BeenThere: its@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: IPWAVE - IP Wireless Access in Vehicular Environments WG at IETF <its.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/its>, <mailto:its-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/its/>
List-Post: <mailto:its@ietf.org>
List-Help: <mailto:its-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/its>, <mailto:its-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 30 Aug 2019 09:56:45 -0000
Alex, The detour path through the VPN server using LTE links experiences such a long delay. This is why IPWAVE is required to allow a vehicle and a traffic light controller to communicate directly with each other using IEEE 802.11-OCB links. Did you measure the response time from a laptop to a traffic light controller using 802.11-OCB? We need to break down the delay components to analyze the bottleneck in this traffic light control scenario. Thanks. Paul On Fri, Aug 30, 2019 at 6:17 PM Alexandre Petrescu < alexandre.petrescu@gmail.com> wrote: > Hi Chris, > > Le 30/08/2019 à 10:52, Chris Shen a écrit : > > Hi Alex, > > > > Thanks Alex, it is good to see this experiment. > > > > About the latency, it seems that you use a shared cloud server for > > both car and traffic light to access. That is the traffic light > > updates its status to the cloud server, and the car queries the > > cloud server if there is any update. There is no direct > > communication between the traffic light and the car. So how do you > > measure the E2E latency from car to traffic light? > > Thank you for the reply. > > Do you consider a cloud server that stores the status of traffic lights? > > We measure the E2E latency in two manners: the RTT displayed by ping > command between laptop and traffic lights controller, and the time > difference between the UDP DIASER request and response recorded on the > laptop. See the points 1 and 2 below. > > The car does not query the cloud server, but it queries the traffic > lights controller through VPN. The traffic lights controller does not > send its status periodically to a server, but it responds to requests > issued by the laptop through VPN. We do not store the traffic lights > status on the server. If we did this, then it would add up to the latency. > > 1. the VPN server in the cloud is a rendez-vous point. It runs OpenVPN > software. The car laptop opens an openvpn connection to this server. > Also the router-modem of the traffic lights controller opens such a > connection to the same VPN server. Once the two VPN connections are > open, the car laptop can ping the router-modem of the traffic light > controller and thus note the RTT reported by ping command. This ping > gets through the VPN server. > > 2. the laptop originates an UDP DIASER request for status of traffic > lights. This request is captured by the wireshark in the laptop. This > UDP DIASER request is sent on the Internet, arrives at VPN server and > gets forwarded to the router-modem attached to the traffic lights > controller. The router-modem does port forwarding and forwards the > request to the controller. The controller sends back the UDP DIASER > reply containing the status. This UDP DIASER reply is captured by the > wireshark in the laptop. The time difference between those two messages > makes for the E2E latency. > > > Alex > > > > > Thanks! Chris. > > > > On Fri, Aug 30, 2019 at 5:15 PM Alexandre Petrescu > > <alexandre.petrescu@gmail.com <mailto:alexandre.petrescu@gmail.com>> > > wrote: > > > > Hi, > > > > Has someone else filmed a demo of displaying the traffic lights > > status in the car? (a communicated status, not a camera recognized > > status). > > > > We filmed recently several such trials. We noticed a systematic > > problem with latency. This problem lies in the difference between > > the color displayed by the traffic light bulb and the color > > displayed in the car. > > > > Ideally, at no time should a human perceive a difference between > > what the light bulb displays and what the laptop displays in the > > car. > > > > https://youtu.be/RR5hpL29-vk > > > > At point 3 second, the bulb displays green whereas the laptop > > displays red. This undesirable situation lasts for 1 second. It is > > an enormous time lapse. It is sufficient for the driver to loose > > confidence in the laptop display, and it is ample time for a > > self-driving car to do many undesirable things. A typical reason > > for human loosing confidence in laptop display is that during such > > lapse of time (1 second) in many places in Paris area one gets > > honked (klaxonned) if one is first in line and does not leave at a > > moment's notice; because the last in line risks having to wait a > > second cycle - everyone in line knows that and at least one will honk > > (klaxon). It is forbidden to klaxon in city. > > > > For this video, we did our best to reduce the latency. The > > communication path between the traffic lights controller and the car > > was set with 4G. There are two 4G links in sequence: one between > > the traffic lights controller and the VPN server in the cloud, and > > another between the VPN server and the car. The measured end-to-end > > latency from laptop to traffic lights controller averages 100ms. > > The queries to obtain the status of lights are sent with a frequency > > of approx. 20 Hertz, which is approx. each 50ms. (DIASER on UDP on > > IPv4). The laptop is a recent thinkpad with python doing queries > > and display. The traffic lights controller is an Aximum Maestro with > > a Motorola MC-something. > > > > We could put 802.11-OCB there, to further gain on the communication > > latency. > > > > We could try recent pre-5G chipsets. > > > > We could try the ITS-G5 SPAT-EM technology which relies on DIASER > > still. > > > > But we are not sure the 1s delay exposed above will get any > > improvement by any of these steps. > > > > This is why I am asking if this situation of latent display of > > traffic lights in car was witnessed elsewhere, and which paths could > > be explored to improve the latency? > > > > Alex > > > > > > _______________________________________________ its mailing list > > its@ietf.org <mailto:its@ietf.org> > > https://www.ietf.org/mailman/listinfo/its > > > > > > > > -- Yiwen (Chris) Shen, Ph.D. Candidate > > > > Homepage: https://chrisshen.github.io IoT Lab: > > _http://iotlab.skku.edu <http://iotlab.skku.edu/>_ Sungkyunkwan > > University, Suwon, South Korea Mobile:+82-(0)10-6871-8103 Email: > > chrisshen@skku.edu <mailto:chrisshen@skku.edu> > > _______________________________________________ > its mailing list > its@ietf.org > https://www.ietf.org/mailman/listinfo/its > -- =========================== Mr. Jaehoon (Paul) Jeong, Ph.D. Associate Professor Department of Software Sungkyunkwan University Office: +82-31-299-4957 Email: jaehoon.paul@gmail.com, pauljeong@skku.edu Personal Homepage: http://iotlab.skku.edu/people-jaehoon-jeong.php <http://cpslab.skku.edu/people-jaehoon-jeong.php>
- [ipwave] traffic lights status displayed in the c… Alexandre Petrescu
- Re: [ipwave] traffic lights status displayed in t… Chris Shen
- Re: [ipwave] traffic lights status displayed in t… Alexandre Petrescu
- Re: [ipwave] traffic lights status displayed in t… Mr. Jaehoon Paul Jeong
- Re: [ipwave] traffic lights status displayed in t… Alexandre Petrescu
- Re: [ipwave] traffic lights status displayed in t… fygsimon
- Re: [ipwave] traffic lights status displayed in t… Mr. Jaehoon Paul Jeong
- Re: [ipwave] traffic lights status displayed in t… Alexandre Petrescu
- Re: [ipwave] traffic lights status displayed in t… Alexandre Petrescu