Re: [rmcat] Video sequences for emulation tests

Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com> Sun, 19 July 2015 21:31 UTC

Return-Path: <zaheduzzaman.sarker@ericsson.com>
X-Original-To: rmcat@ietfa.amsl.com
Delivered-To: rmcat@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 284041B2D7E for <rmcat@ietfa.amsl.com>; Sun, 19 Jul 2015 14:31:53 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.2
X-Spam-Level:
X-Spam-Status: No, score=-4.2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id OW8iBp_7ROfE for <rmcat@ietfa.amsl.com>; Sun, 19 Jul 2015 14:31:51 -0700 (PDT)
Received: from sessmg22.ericsson.net (sessmg22.ericsson.net [193.180.251.58]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 981321B2D80 for <rmcat@ietf.org>; Sun, 19 Jul 2015 14:31:50 -0700 (PDT)
X-AuditID: c1b4fb3a-f79356d000006281-a6-55ac1744c66b
Received: from ESESSHC017.ericsson.se (Unknown_Domain [153.88.253.124]) by sessmg22.ericsson.net (Symantec Mail Security) with SMTP id 8A.BD.25217.4471CA55; Sun, 19 Jul 2015 23:31:48 +0200 (CEST)
Received: from ESESSMB307.ericsson.se ([169.254.7.7]) by ESESSHC017.ericsson.se ([153.88.183.69]) with mapi id 14.03.0210.002; Sun, 19 Jul 2015 23:31:48 +0200
From: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>
To: Varun Singh <vsingh.ietf@gmail.com>
Thread-Topic: [rmcat] Video sequences for emulation tests
Thread-Index: AdDCA1w2Kk90mXvXQlq2XhRN8ptByAAUuAuAAATr6kA=
Date: Sun, 19 Jul 2015 21:31:48 +0000
Message-ID: <E0F7A68B07B53F4FBD12DABD61CBA90E129ACFEF@ESESSMB307.ericsson.se>
References: <E0F7A68B07B53F4FBD12DABD61CBA90E129ABEC5@ESESSMB307.ericsson.se> <CAEbPqrz7xoAnFqRacD2F+Fiwq9=O6jFt-2ktLdyrdng2Hq4c5Q@mail.gmail.com>
In-Reply-To: <CAEbPqrz7xoAnFqRacD2F+Fiwq9=O6jFt-2ktLdyrdng2Hq4c5Q@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [153.88.183.154]
Content-Type: multipart/alternative; boundary="_000_E0F7A68B07B53F4FBD12DABD61CBA90E129ACFEFESESSMB307erics_"
MIME-Version: 1.0
X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFmpmkeLIzCtJLcpLzFFi42KZGfG3RtdFfE2owdMWG4vVNz+wWext8ndg 8tg56y67x5IlP5kCmKK4bFJSczLLUov07RK4MvY/ns1asKqbseJfu1ID45l2xi5GTg4JAROJ TTNXskDYYhIX7q1nA7GFBI4ySjSf1+9i5AKyFzFKfL+wjrWLkYODTcBG4vFiPxBTREBd4uAN H5ByZgFZietvd4K1CgtYSGxuWsAEYosIWEpMvneAEcK2kph9+jdYDYuAqsSBOV/A4rwCvhKL dh9jglg1hVFixuKtzCAJToFAiZubp7CC2IxAt30/tYYJYpm4xK0n85kgbhaQWLLnPDOELSrx 8vE/VghbSWLR7c9Q9fkSnTdeQC0TlDg58wnLBEbRWUhGzUJSNgtJ2SygN5kFNCXW79KHKFGU mNL9kB3C1pBonTOXHVl8ASP7KkbR4tTi4tx0IyO91KLM5OLi/Dy9vNSSTYzAWDu45bfVDsaD zx0PMQpwMCrx8C5gWR0qxJpYVlyZe4hRmoNFSZx3xua8UCGB9MSS1OzU1ILUovii0pzU4kOM TBycUg2M4dPv5xR9s7j49AT35KSiiabrwzOuaGw7sMKrwkJH/t012/IQ4dk5ObJvWSdGLN7n dmjhDXFNzoMm3/XbL+9OsD/+UuxUS/2ZHc/3zFTgtJdKjmXOZP1b+c/nVqrwUm29TRf732fv X2BfLWzBefn/09dpL6Tc9y9/usP082TpkOcn2+X77oleU2Ipzkg01GIuKk4EAH+/XjGWAgAA
Archived-At: <http://mailarchive.ietf.org/arch/msg/rmcat/PT3Tb8x1Etk4kc_IIqQmHfzpyIs>
Cc: rmcat WG <rmcat@ietf.org>
Subject: Re: [rmcat] Video sequences for emulation tests
X-BeenThere: rmcat@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "RTP Media Congestion Avoidance Techniques \(RMCAT\) Working Group discussion list." <rmcat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rmcat>, <mailto:rmcat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rmcat/>
List-Post: <mailto:rmcat@ietf.org>
List-Help: <mailto:rmcat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rmcat>, <mailto:rmcat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 19 Jul 2015 21:31:53 -0000

Hi Varun,

Yes, we haven’t explicitly said which videos. But now I think it would be good to pick up couple of them if not one.

BR

Zahed

From: Varun Singh [mailto:vsingh.ietf@gmail.com]
Sent: den 19 juli 2015 23:08
To: Zaheduzzaman Sarker
Cc: rmcat WG
Subject: Re: [rmcat] Video sequences for emulation tests


Hi zahed,

We didn't explicitly say which videos, but the feast points to a URL with sequences. These sequences were shared by Stephan Wenger a few IETF meetings ago. IIRC, Foreman was used before that.  And the complete list is at the url.

Cheers

[HEVC-seq] HEVC, , "Test Sequences", http://<http://www.netlab.tkk.fi/~varun/test_sequences/>www.netlab.tkk.fi<http://www.netlab.tkk.fi/~varun/test_sequences/>/~varun/test_sequences/<http://www.netlab.tkk.fi/~varun/test_sequences/>
On Jul 19, 2015 9:44 PM, "Zaheduzzaman Sarker" <zaheduzzaman.sarker@ericsson.com<mailto:zaheduzzaman.sarker@ericsson.com>> wrote:
Hi,

As RMCAT congestion control algorithms are getting implemented, we will see more test results where real video encoder will be used.
We have seen results for GCC in the emulated network where a video sequence has been used. The evaluation results of SCReAM implementation we will also use some video sequences.

The eval-test (https://tools.ietf.org/html/draft-ietf-rmcat-eval-test-01) draft points to sources of the video sequences to use in the tests but does not pick any particular one(s). However, as the contents of the video sequences have impact on the encoder output, I believe it will be better if we can agree on the video sequences to use in the tests. This will make the results more comparable.

Any comments on that?

BR

Zahed

===============================================================================
ANM ZAHEDUZZAMAN SARKER
Senior Researcher
Services, Media and Network Features

Ericsson
Laboratoriegränd 11
97128 Luleå, Sweden
Phone +46 10 717 37 43<tel:%2B46%2010%20717%2037%2043>
Mobile +46 76 115 37 43<tel:%2B46%2076%20115%2037%2043>
Office +46 76 115 37 43<tel:%2B46%2076%20115%2037%2043>
Fax +46 920 996 21<tel:%2B46%20920%20996%2021>
zaheduzzaman.sarker@ericsson.com<mailto:zaheduzzaman.sarker@ericsson.com>
www.ericsson.com<http://www.ericsson.com>
===============================================================================