Re: [rmcat] Video sequences for emulation tests

"Mo Zanaty (mzanaty)" <mzanaty@cisco.com> Sun, 19 July 2015 22:43 UTC

Return-Path: <mzanaty@cisco.com>
X-Original-To: rmcat@ietfa.amsl.com
Delivered-To: rmcat@ietfa.amsl.com
Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 61DCA1B2DF4 for <rmcat@ietfa.amsl.com>; Sun, 19 Jul 2015 15:43:42 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -14.51
X-Spam-Level:
X-Spam-Status: No, score=-14.51 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01, USER_IN_DEF_DKIM_WL=-7.5] autolearn=ham
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jQOBgyl6fqUq for <rmcat@ietfa.amsl.com>; Sun, 19 Jul 2015 15:43:40 -0700 (PDT)
Received: from rcdn-iport-3.cisco.com (rcdn-iport-3.cisco.com [173.37.86.74]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 38F8C1B2DF2 for <rmcat@ietf.org>; Sun, 19 Jul 2015 15:43:40 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=15220; q=dns/txt; s=iport; t=1437345820; x=1438555420; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=erhMVLPZpoJ60DW1U1K2vdT7eUcAfWRh8CcIKIB3Ris=; b=Zjsbl86nOwvHFYPrdTcdqttDTzGC76PGckuAxDZ2pBWYW4CWChDIrTj4 h5tOpopPQOoYLkDb6euk6Sx/8ySGlV2+n9UV3yDTK9cwZGfpjApq1pUUE 4I8kISq63iHXnOpx36Wg/d8b27EqDlU2kDFSwkXNX6a1S+WQlIN3i46Iu o=;
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: A0CGBQCPJ6xV/4gNJK1cFoIwTVRphSy4N4V3AoEdPBABAQEBAQEBgQqEIwEBAQQtHDAOAgIBCBEEAQEoBxYFBhEUCQgBAQQOBYgZAxINvl8NhS4BAQEBAQEBAQEBAQEBAQEBAQEBAQEXBItIgk2CNQQGAQmDDoEUBZRSAYRuhUqBaJFfhygmgg0cgVNvgksBAQE
X-IronPort-AV: E=Sophos; i="5.15,504,1432598400"; d="scan'208,217"; a="16816098"
Received: from alln-core-3.cisco.com ([173.36.13.136]) by rcdn-iport-3.cisco.com with ESMTP; 19 Jul 2015 22:43:38 +0000
Received: from xhc-rcd-x12.cisco.com (xhc-rcd-x12.cisco.com [173.37.183.86]) by alln-core-3.cisco.com (8.14.5/8.14.5) with ESMTP id t6JMhc1X027641 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=FAIL); Sun, 19 Jul 2015 22:43:38 GMT
Received: from xmb-rcd-x14.cisco.com ([169.254.4.42]) by xhc-rcd-x12.cisco.com ([173.37.183.86]) with mapi id 14.03.0195.001; Sun, 19 Jul 2015 17:43:38 -0500
From: "Mo Zanaty (mzanaty)" <mzanaty@cisco.com>
To: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>
Thread-Topic: [rmcat] Video sequences for emulation tests
Thread-Index: AdDCA1w2Kk90mXvXQlq2XhRN8ptByAAjYyOAAADUWAD//8A/cw==
Date: Sun, 19 Jul 2015 22:43:37 +0000
Message-ID: <C489F1D8-E66C-4EC2-AA18-C4B0DDF3A0F6@cisco.com>
References: <E0F7A68B07B53F4FBD12DABD61CBA90E129ABEC5@ESESSMB307.ericsson.se> <CAEbPqrz7xoAnFqRacD2F+Fiwq9=O6jFt-2ktLdyrdng2Hq4c5Q@mail.gmail.com>, <E0F7A68B07B53F4FBD12DABD61CBA90E129ACFEF@ESESSMB307.ericsson.se>
In-Reply-To: <E0F7A68B07B53F4FBD12DABD61CBA90E129ACFEF@ESESSMB307.ericsson.se>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
Content-Type: multipart/alternative; boundary="_000_C489F1D8E66C4EC2AA18C4B0DDF3A0F6ciscocom_"
MIME-Version: 1.0
Archived-At: <http://mailarchive.ietf.org/arch/msg/rmcat/w54jzObA7xeGgiResTJu7iWV-_8>
Cc: rmcat WG <rmcat@ietf.org>, Varun Singh <vsingh.ietf@gmail.com>
Subject: Re: [rmcat] Video sequences for emulation tests
X-BeenThere: rmcat@ietf.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: "RTP Media Congestion Avoidance Techniques \(RMCAT\) Working Group discussion list." <rmcat.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/rmcat>, <mailto:rmcat-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/rmcat/>
List-Post: <mailto:rmcat@ietf.org>
List-Help: <mailto:rmcat-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/rmcat>, <mailto:rmcat-request@ietf.org?subject=subscribe>
X-List-Received-Date: Sun, 19 Jul 2015 22:43:42 -0000

The encoder and its configuration, particularly rate control settings, usually impacts output bitrate even more than the selection of raw sequences. So if we are moving towards guidelines for how CC candidates should test real video, some specific encoder and configuration should be specified in addition to specific raw sequences.

Cheers,
Mo



On Jul 19, 2015, at 11:31 PM, Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com<mailto:zaheduzzaman.sarker@ericsson.com>> wrote:

Hi Varun,

Yes, we haven’t explicitly said which videos. But now I think it would be good to pick up couple of them if not one.

BR

Zahed

From: Varun Singh [mailto:vsingh.ietf@gmail.com]
Sent: den 19 juli 2015 23:08
To: Zaheduzzaman Sarker
Cc: rmcat WG
Subject: Re: [rmcat] Video sequences for emulation tests


Hi zahed,

We didn't explicitly say which videos, but the feast points to a URL with sequences. These sequences were shared by Stephan Wenger a few IETF meetings ago. IIRC, Foreman was used before that.  And the complete list is at the url.

Cheers

[HEVC-seq] HEVC, , "Test Sequences", http://<http://www.netlab.tkk.fi/~varun/test_sequences/>www.netlab.tkk.fi<http://www.netlab.tkk.fi/~varun/test_sequences/>/~varun/test_sequences/<http://www.netlab.tkk.fi/~varun/test_sequences/>
On Jul 19, 2015 9:44 PM, "Zaheduzzaman Sarker" <zaheduzzaman.sarker@ericsson.com<mailto:zaheduzzaman.sarker@ericsson.com>> wrote:
Hi,

As RMCAT congestion control algorithms are getting implemented, we will see more test results where real video encoder will be used.
We have seen results for GCC in the emulated network where a video sequence has been used. The evaluation results of SCReAM implementation we will also use some video sequences.

The eval-test (https://tools.ietf.org/html/draft-ietf-rmcat-eval-test-01) draft points to sources of the video sequences to use in the tests but does not pick any particular one(s). However, as the contents of the video sequences have impact on the encoder output, I believe it will be better if we can agree on the video sequences to use in the tests. This will make the results more comparable.

Any comments on that?

BR

Zahed

===============================================================================
ANM ZAHEDUZZAMAN SARKER
Senior Researcher
Services, Media and Network Features

Ericsson
Laboratoriegränd 11
97128 Luleå, Sweden
Phone +46 10 717 37 43<tel:%2B46%2010%20717%2037%2043>
Mobile +46 76 115 37 43<tel:%2B46%2076%20115%2037%2043>
Office +46 76 115 37 43<tel:%2B46%2076%20115%2037%2043>
Fax +46 920 996 21<tel:%2B46%20920%20996%2021>
zaheduzzaman.sarker@ericsson.com<mailto:zaheduzzaman.sarker@ericsson.com>
www.ericsson.com<http://www.ericsson.com>
===============================================================================