IETF Logo Mail Archive

Re: [rmcat] Video sequences for emulation tests

"Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com> Sun, 19 July 2015 22:38 UTC

Return-Path: <xiaoqzhu@cisco.com>
X-Original-To: rmcat@ietfa.amsl.com
Delivered-To: rmcat@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 46D171B2DE1 for <rmcat@ietfa.amsl.com>; Sun, 19 Jul 2015 15:38:04 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.51
X-Spam-Level:
X-Spam-Status: No, score=-14.51 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id evmY77SWD6rS for <rmcat@ietfa.amsl.com>; Sun, 19 Jul 2015 15:38:02 -0700 (PDT)
Received: from rcdn-iport-8.cisco.com (rcdn-iport-8.cisco.com [173.37.86.79]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id D157C1B2DE0 for <rmcat@ietf.org>; Sun, 19 Jul 2015 15:38:01 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=16125; q=dns/txt; s=iport; t=1437345481; x=1438555081; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=kA8w7TLEfW9I1Eer2dQOg8HfWZrwsCZB3QPX3FB9GwE=; b=dDbvrzF8eDl25aEnlsqNDC7YaW6rI0duD71h1mle8U2rdzjZs/OKI8xM 0vexeB4HjDmQjNwImQdIeg/ceG96/vVe1h4GrVT3KGy5PKGUFtufeZR3B 2dWyOmL1UR6fk4nHnVIWj+AcTEKUMT9DDOizamZhEWKsHZR34G7VFNJJ3 s=;
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0CFBQC6JaxV/4MNJK1cFoIwTVRpBoUmuDeFdwKBHTsRAQEBAQEBAYEKhCMBAQEELRwwDgICAQgRAwEBASgHFgUGERQJCAEBBAENBYgZAxINvlkNhS4BAQEBAQEBAQEBAQEBAQEBAQEBAQEXBItIgk2CKA0EBgEJhCIFlFIBhG6FSoFokV+HKCaCDRyBU2+BR4EEAQEB
X-IronPort-AV: E=Sophos; i="5.15,504,1432598400"; d="scan'208,217"; a="11170533"
Received: from alln-core-1.cisco.com ([173.36.13.131]) by rcdn-iport-8.cisco.com with ESMTP; 19 Jul 2015 22:38:00 +0000
Received: from xhc-aln-x11.cisco.com (xhc-aln-x11.cisco.com [173.36.12.85]) by alln-core-1.cisco.com (8.14.5/8.14.5) with ESMTP id t6JMc08c030718 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=FAIL); Sun, 19 Jul 2015 22:38:00 GMT
Received: from xmb-rcd-x01.cisco.com ([169.254.1.72]) by xhc-aln-x11.cisco.com ([173.36.12.85]) with mapi id 14.03.0195.001; Sun, 19 Jul 2015 17:38:00 -0500
From: "Xiaoqing Zhu (xiaoqzhu)" <xiaoqzhu@cisco.com>
To: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>, Varun Singh <vsingh.ietf@gmail.com>
Thread-Topic: [rmcat] Video sequences for emulation tests
Thread-Index: AdDCA1w2Kk90mXvXQlq2XhRN8ptByAAjYyOAAADUWAAABoCbgA==
Date: Sun, 19 Jul 2015 22:38:00 +0000
Message-ID: <D1D1F2FE.2405F%xiaoqzhu@cisco.com>
References: <E0F7A68B07B53F4FBD12DABD61CBA90E129ABEC5@ESESSMB307.ericsson.se> <CAEbPqrz7xoAnFqRacD2F+Fiwq9=O6jFt-2ktLdyrdng2Hq4c5Q@mail.gmail.com> <E0F7A68B07B53F4FBD12DABD61CBA90E129ACFEF@ESESSMB307.ericsson.se>
In-Reply-To: <E0F7A68B07B53F4FBD12DABD61CBA90E129ACFEF@ESESSMB307.ericsson.se>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/14.5.2.150604
x-originating-ip: [10.61.106.66]
Content-Type: multipart/alternative; boundary="_000_D1D1F2FE2405Fxiaoqzhuciscocom_"
MIME-Version: 1.0
Archived-At: <http://mailarchive.ietf.org/arch/msg/rmcat/9m14XszmQewX5SHJb4u3mqZVk-E>
Cc: rmcat WG <rmcat@ietf.org>
Subject: Re: [rmcat] Video sequences for emulation tests
X-BeenThere: rmcat@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "RTP Media Congestion Avoidance Techniques \(RMCAT\) Working Group discussion list." <rmcat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rmcat>, <mailto:rmcat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rmcat/>
List-Post: <mailto:rmcat@ietf.org>
List-Help: <mailto:rmcat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rmcat>, <mailto:rmcat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 19 Jul 2015 22:38:04 -0000

Agree that will be nice for folks to use the same set of video sequences for testing.  We have not yet tested with the sources shared by Stephan Wenger.  Will weigh in on this topic after we look into that.

BTW, from the link foreman15_4000.yuv has a size of 0 …

Thanks,
Xiaoqing

From: rmcat <rmcat-bounces@ietf.org<mailto:rmcat-bounces@ietf.org>> on behalf of Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com<mailto:zaheduzzaman.sarker@ericsson.com>>
Date: Sunday, July 19, 2015 at 4:31 PM
To: Varun Singh <vsingh.ietf@gmail.com<mailto:vsingh.ietf@gmail.com>>
Cc: rmcat WG <rmcat@ietf.org<mailto:rmcat@ietf.org>>
Subject: Re: [rmcat] Video sequences for emulation tests

Hi Varun,

Yes, we haven’t explicitly said which videos. But now I think it would be good to pick up couple of them if not one.

BR

Zahed

From: Varun Singh [mailto:vsingh.ietf@gmail.com]
Sent: den 19 juli 2015 23:08
To: Zaheduzzaman Sarker
Cc: rmcat WG
Subject: Re: [rmcat] Video sequences for emulation tests


Hi zahed,

We didn't explicitly say which videos, but the feast points to a URL with sequences. These sequences were shared by Stephan Wenger a few IETF meetings ago. IIRC, Foreman was used before that.  And the complete list is at the url.

Cheers

[HEVC-seq] HEVC, , "Test Sequences", http://<http://www.netlab.tkk.fi/~varun/test_sequences/>www.netlab.tkk.fi<http://www.netlab.tkk.fi/~varun/test_sequences/>/~varun/test_sequences/<http://www.netlab.tkk.fi/~varun/test_sequences/>
On Jul 19, 2015 9:44 PM, "Zaheduzzaman Sarker" <zaheduzzaman.sarker@ericsson.com<mailto:zaheduzzaman.sarker@ericsson.com>> wrote:
Hi,

As RMCAT congestion control algorithms are getting implemented, we will see more test results where real video encoder will be used.
We have seen results for GCC in the emulated network where a video sequence has been used. The evaluation results of SCReAM implementation we will also use some video sequences.

The eval-test (https://tools.ietf.org/html/draft-ietf-rmcat-eval-test-01) draft points to sources of the video sequences to use in the tests but does not pick any particular one(s). However, as the contents of the video sequences have impact on the encoder output, I believe it will be better if we can agree on the video sequences to use in the tests. This will make the results more comparable.

Any comments on that?

BR

Zahed

===============================================================================
ANM ZAHEDUZZAMAN SARKER
Senior Researcher
Services, Media and Network Features

Ericsson
Laboratoriegränd 11
97128 Luleå, Sweden
Phone +46 10 717 37 43<tel:%2B46%2010%20717%2037%2043>
Mobile +46 76 115 37 43<tel:%2B46%2076%20115%2037%2043>
Office +46 76 115 37 43<tel:%2B46%2076%20115%2037%2043>
Fax +46 920 996 21<tel:%2B46%20920%20996%2021>
zaheduzzaman.sarker@ericsson.com<mailto:zaheduzzaman.sarker@ericsson.com>
www.ericsson.com<http://www.ericsson.com>
===============================================================================

v2.23.0 | Report a Bug | By Email