Re: [Mops] Reminder: Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC

Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com> Thu, 29 July 2021 11:53 UTC

Return-Path: <zaheduzzaman.sarker@ericsson.com>
X-Original-To: mops@ietfa.amsl.com
Delivered-To: mops@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2B6E73A1FF9; Thu, 29 Jul 2021 04:53:17 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.452
X-Spam-Level:
X-Spam-Status: No, score=-2.452 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.452, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, HTTPS_HTTP_MISMATCH=0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=ericsson.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2HsrcLJGOUcu; Thu, 29 Jul 2021 04:53:12 -0700 (PDT)
Received: from EUR02-AM5-obe.outbound.protection.outlook.com (mail-eopbgr00056.outbound.protection.outlook.com [40.107.0.56]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C2ED23A1FF7; Thu, 29 Jul 2021 04:53:11 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=nvaiuFF118W2/y/Xi/+dUYe/vpqrQaaUFGS6QG8RWTkgebEIgnACP7WxPJly51KGsJgmCjxylIXcxOF46+wE4mn28Dxkp3FJHLj9paJrT27ccQV/JJbC3PZStSlHqJ+i8twGUI3yvr+B88kVEgXlL+SuBj8eGPPlde292G29RRjaJh9Js4dKuveFsVx77Er7AQCXvtivNyAhtX+6f1duwRJVIU8BIOy79TU0rLzTKDktQrGP8SoZuiofZrUzrC9vlkTL0af8kMR2fdtoYQLq6KEBcMmwdUK5tK5QiDPvUmcLA2CTcFY9UpIbiGlQlSCBUVmtJkxRU/WRlBXQUma4aQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9o9BeQMaJ3F4QISh5wLlu3gWiAaTUQtqoC7o2c0rYIk=; b=RzjsUouSsZ8V6Vw3e0jGuJl5BUWrLgycXjcyaZSlm+b7E7E1ug7ljo6Wls+s1ThPx1yohpCk0EiXmLqKTfDPYWPJdPRNLuPxs6xj88u7oTXHgpMCgIk36qyXGmWxTExNCzCqDpirv8T/eenOVkT4fzidrh49EzB+xNqf/tDVLZHfp4d/1MFiLOgYHhG0G7ettfzm1uWT3d8qjs79d95decOCcX4TXOiySu+adV6lzREqTZjHNDg9BtVWXqEUuBVIG+tFUAAdgCSoCG3zOWLf3+PrktWPttk8xYYf6Q3K9TniL2ocO6lfmrqc6KT8fZ70JSG/jEv2RFEvtOrARhfuIg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9o9BeQMaJ3F4QISh5wLlu3gWiAaTUQtqoC7o2c0rYIk=; b=Yt4SpTxWQi6c2GvCYQ1zzd1pOoFyHQkX/qd+cgYXplTGDILF78Pzkl61q/4g2KfjnxFwY2d35bkAupbPqoyB8VShsgiiPBtH74Yousvx3b0V91IHVjMZBNF8im+/bbKdfdY728ZoBzX41n68WityezxpJrG0C6xz4b/BSA+oK/k=
Received: from HE1PR07MB4187.eurprd07.prod.outlook.com (2603:10a6:7:98::23) by HE1PR0701MB2586.eurprd07.prod.outlook.com (2603:10a6:3:96::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4373.14; Thu, 29 Jul 2021 11:53:08 +0000
Received: from HE1PR07MB4187.eurprd07.prod.outlook.com ([fe80::2474:6ca1:d760:b0a9]) by HE1PR07MB4187.eurprd07.prod.outlook.com ([fe80::2474:6ca1:d760:b0a9%7]) with mapi id 15.20.4394.010; Thu, 29 Jul 2021 11:53:08 +0000
From: Zaheduzzaman Sarker <zaheduzzaman.sarker@ericsson.com>
To: "Das, Dibakar" <dibakar.das@intel.com>, Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com>
CC: MORAND Lionel IMT/OLN <lionel.morand@orange.com>, Ian Swett <ianswett@google.com>, "mops@ietf.org" <mops@ietf.org>, tsvwg-chairs <tsvwg-chairs@ietf.org>, Alan Frindell <afrind=40fb.com@dmarc.ietf.org>, "quic@ietf.org" <quic@ietf.org>, Kirill Pugin <ikir@fb.com>
Thread-Topic: [Mops] Reminder: Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC
Thread-Index: AQHXg8cbuPEdfwjLOEm7z5CETlv+eKtYvX/AgAAMNYCAAAR74IAAQaiAgAAObxCAAR9WAA==
Date: Thu, 29 Jul 2021 11:53:08 +0000
Message-ID: <C737DF49-54BF-42A6-8F25-F0E094C3668C@ericsson.com>
References: <7C8E8AF7-02FA-4AD5-9A53-3A7539758C55@fb.com> <MW3PR11MB4700AAF6E8BB1FE1275876A0E1EA9@MW3PR11MB4700.namprd11.prod.outlook.com> <CAKcm_gOKv+pOmjaEsP1G_MkpKV_PzRMeutBjH+0kw4omi7F74w@mail.gmail.com> <MW3PR11MB4700445490984762C07FEAA6E1EA9@MW3PR11MB4700.namprd11.prod.outlook.com> <CAKKJt-erv-5waYiganL60eSO10v=Mok35ugzQPQ1Ya_E5K3KQQ@mail.gmail.com> <MW3PR11MB47003CB8C03D633F3137B976E1EB9@MW3PR11MB4700.namprd11.prod.outlook.com>
In-Reply-To: <MW3PR11MB47003CB8C03D633F3137B976E1EB9@MW3PR11MB4700.namprd11.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-GB
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Microsoft-MacOutlook/16.50.21061301
authentication-results: intel.com; dkim=none (message not signed) header.d=none;intel.com; dmarc=none action=none header.from=ericsson.com;
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 08d35844-4cac-4c8d-97f5-08d952876edc
x-ms-traffictypediagnostic: HE1PR0701MB2586:
x-microsoft-antispam-prvs: <HE1PR0701MB2586B3D4BBC0C5A5B74FC6EE9FEB9@HE1PR0701MB2586.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: ZEw2ogbCCoC3AjEZ7xpumCkao3N6zLi9rh2NANPHI3f/hwDpPSf07FCvJsf8QDUyy8xIxGQq9ttP0bpNFRXJImBKKlVfI/qg6hWL/eo6B082ASxPWUsiJnjugFWdWobUkR2lTi0FJgoI4kFpc96HXVpQ9eb3gRraYpxSQ5L6OAGiKOc1Ebp+6Tr2Sek4rTQtOI0bMwbopMDBK7irm5AtMr9aiJn6n1C3bOmL2Wku1FpMIyID35Cdp2W4rjVkiJSiaQNWmLYEEctptYSXNCvotachz38SB/WO8wYGnWZgKa/x2YPRg5fz/24dRQKeeaziFGmOAL64FQPMcUWHuLPj8NJyzP6PyMeB8dK09DVILv10AGEQB+FAxVvQIt1nquaDMfIo6vp493q9G9r1fLqBPYJ+eXHIjLARrfjKLb016LiAnuIbUvejdZCzFMTmmwLrs5/kT426Zd+v82kcbTZhhcyrxoLTaPGGeSp66LkgMvF8v9c0I0cf9z2TkekYR0lu2Utomc5Im4LZnqhOV66GIJ2RssGxmKsqMU+hAguLTI+1oAlXWUAq8oIbo4ioG4XJZ+qpjFhu/CnfF9iRwL8DAgxjzcPVhoEmluy85wUSQpl0CFEIw/waHhKTdxdpUg/pIHrBIUeCQNpgLGOUZWXxUP3cftEycxOYo93+uVP69egSBxG2iGwI3udoYPqTAg9plY/sVqm5CaRunGnlXLS8BKZreFlaJSVAp1W6NyEDO7b7t0nJAbdSWhgoOdMNrg5RNQQzFicK3Y/t9i5gvOLBHURm2ClqpfEgMZtg84q0AAvLHmgfBcuU6KXxlc0Qy3UANXsvRG2WEQbQe8Sn85lbTimZbVElcM1rFCeA+8liXBs=
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:HE1PR07MB4187.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(39860400002)(136003)(366004)(396003)(346002)(376002)(66556008)(66446008)(76116006)(6486002)(8936002)(26005)(64756008)(122000001)(6506007)(91956017)(2906002)(44832011)(38100700002)(2616005)(110136005)(54906003)(53546011)(316002)(38070700005)(186003)(66946007)(66476007)(8676002)(4326008)(71200400001)(86362001)(166002)(33656002)(5660300002)(83380400001)(478600001)(6512007)(966005)(36756003)(45980500001); DIR:OUT; SFP:1101;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: pT0fS81oJePI0UcbBt6WTgOjQrzhBJ0zYubYYhwHW20FAIFY99aS4hKu5hMc5Aj4M90h1EQAH0LK6KYCSgw82QqpTcFerpLgI+48evK86jSrpUKnBL1XhSE32gXHmNna52J5tbh2jcpTbg3OS5rmKsovOUDqk8sjpF6y+1+fHiNZbyyB4t/NwDY4RN1OhaVAPM1paPHE6LxCgg+pjc/MQIHffXBn11qpaP8rIXbRH6rbq3z6XePa2EA2EVndO5+i2tnfk+tPRlOJoZ7aOUIZ8SvjKyYKcXd+E5DdXKZYUpRifPF15mjya2i+YfPJW/QVEuok9n3/idjtaWIpzJbmjgzAloHMavcgWfFYwW0mL7088eSYTiJiDeNZsbcRsy4kLudcEgmChWe98z8abECXeT0KOEkk4o1sddVhjsCZw6/bw6PeKFQxKfjAq9jeZd5YAJ9u3wmHaLKBPX0TI7b8VjKcsN0eAfmLioFYjXyi8Zn7TyP6ZxoGFYK0bUUOkeJY8GjxeEm/aACt1i/LxsvTIDOlNx+zJaegFmSKmtWs4fksYOJvyo/Eo2ZVJOIrV5uaHx7I5zwMHSThX4YCfErx82CItj0EJJctFHHMYg4soEPRjNsxIwoGPKlumktd2ZUUbwLaIIwhF9mhTvpB3Ibea57iLtuMIV8FdwkOQbBNp4TWiaSi2afkIE3PoJclX70g+LQDWFvS33NGCkT4lxqlEQqVGtAqZvnsFlzHSeprxIq2v9ieWk53N2l1uwX7HoV3jBwzfckFoVtpMbIafPET2YZHu7VucZFmmso2+KDGG+OBWgpSbbpLEBEW3vymeQvMWAxIOjlWohFiR6/nqqH83Oijqs/nKGUfP9lUT895IE/Wa5wrY2KXoi65HD6tG/ZDPv/FRSxfAr3eTHQduJCBfyLTVFZxN2tVEwDXp33XzWJ0Ah50RkKZVjUcjk1fHhOu9oAFLCOt6cEgcfH2UpZzn/kS/xo1agpgX7ipphSeuW164pULcekGiSfexAZNFi/5GLGnoaA1iq7erXgmwMAu21qlMvZd1pAVCQWiaISheXxhoaAk/N9LgFTNSYKNbNEXWYNJXZ6V6l9tljf/fIEbu2DPacMi9d9Vqe/ifUe44ZRxP0Ts+MkR1MT2G6byuPfSrFYNqpqn2S4LxHcZGk7u0P3+lk5AUIOZAlxp4lIq4X01RsR5VYcCZmMZPMNag3auahKHiufAvbzrVqdhtY5kSRE/1hPIRWZMSMg7+t2aOfHL41bauRnTMk8ZWmAbVn1Vv6YlK2QkWwMtm6D5TR1CwchrVe04pElwdI0sSIX/a2IoLFdu2Y506xIE1w8sRPuWcm/5DvD2PBwX2vMqrJhSUw==
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative; boundary="_000_C737DF4954BF42A68F25F0E094C3668Cericssoncom_"
MIME-Version: 1.0
X-OriginatorOrg: ericsson.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: HE1PR07MB4187.eurprd07.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 08d35844-4cac-4c8d-97f5-08d952876edc
X-MS-Exchange-CrossTenant-originalarrivaltime: 29 Jul 2021 11:53:08.1940 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: oyGAaLO8AIB/b5ULearUq/tzx/YFxBVv6/2L8P8Wh2AQymnkaW4VL0FjwrLWWduvvUBJ4NPQZesZM/hUcLUZXwWNiHo2cKZL4UW+bKvdJ6Bw5nis1fgbNpxNgwbnT477
X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR0701MB2586
Archived-At: <https://mailarchive.ietf.org/arch/msg/mops/w9lPgEsccyUUlDV9oE5sPPmKG-c>
Subject: Re: [Mops] Reminder: Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC
X-BeenThere: mops@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Media OPerationS <mops.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/mops>, <mailto:mops-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/mops/>
List-Post: <mailto:mops@ietf.org>
List-Help: <mailto:mops-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/mops>, <mailto:mops-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 29 Jul 2021 11:53:18 -0000

Hi Dibakar,

Thanks for asking the question.

I think Spencer’s suggestion to involve 3GPP-IETF coordination team makes lots of sense here, hence I think you are on right track.

In my personal opinion, if a signaling helps that would be related to congestion control, recovery and ack signaling technique in use rather than specific to a particular protocol ( yes, QUIC comes with kind of right packaging of those techniques but those can be applied to other protocols as well). There are lot to discuss about it and requires right expertise ( I can always wish there is a single venue for that 😊).


BR
Zahed

On 2021-07-29, 06:51, "QUIC on behalf of Das, Dibakar" <quic-bounces@ietf.org<mailto:quic-bounces@ietf.org> on behalf of dibakar.das@intel.com<mailto:dibakar.das@intel.com>> wrote:

Hi Spencer,

Thank you for the detailed response as this is the sort of guidance I was looking for. Thank you also for the references.

Since the recommendation is to first raise the concern with layer-2 liaison, I will do that. However, I should clarify that I work on WiFi standards and not 3GPP. So, I will discuss the problem a bit more internally and then bring it up to the 802.11 liaison if needed.

Regards,
Dibakar

From: Spencer Dawkins at IETF <spencerdawkins.ietf@gmail.com>
Sent: Wednesday, July 28, 2021 4:53 PM
To: Das, Dibakar <dibakar.das@intel.com>
Cc: Ian Swett <ianswett@google.com>; Alan Frindell <afrind=40fb.com@dmarc.ietf.org>; quic@ietf.org; mops@ietf.org; Kirill Pugin <ikir@fb.com>; MORAND Lionel IMT/OLN <lionel.morand@orange.com>; tsvwg-chairs <tsvwg-chairs@ietf.org>
Subject: Re: [Mops] Reminder: Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC

Hi, Dibakar,

I apologize in advance if this is not the right venue to ask questions.

This is only my opinion, but this is a fine venue to ask questions. But it may not be a good venue to resolve issues. Please take what follows as suggestions.

There are people who understand some of the ins and outs of (for instance) 5G RAN, but honestly, there aren't a lot of them, so I'd start with 3GPP.

If this was a concern I had, the first place I'd stop is with Lionel Morand (lionel.morand@orange.com<mailto:lionel.morand@orange.com>), the 3GPP liaison to the IETF, to share this concern. Lionel tends to be the person who sets agendas for the 3GPP-IETF coordination team.

IETF participants are likely to say "if it hurts (performance) when you do that, you probably should stop doing that". In my opinion, that's because those participants don't want to special-case their protocols (especially transport-level protocols) to deal with L2 characteristics that won't be true for all underlying networking technologies.

The PILC working group, concluded about 20 years ago, put together a nuanced discussion about L2 retransmissions in https://datatracker.ietf.org/doc/html/rfc3819#section-8.1. If anyone in the IETF thought that reasoning needed to be updated, I'd start with the TSVWG chairs, at tsvwg-chairs@ietf.org<mailto:tsvwg-chairs@ietf.org> - I believe this would be in scope for them, and Gorry Fairhurst, one of the RFC 3819 co-authors, is also a TSVWG chair, so that would jumpstart things.

The current TSV ADs might have opinions about what should happen, but the TSVWG co-chairs can involve them if they need to be involved.

I've taken the liberty of copying Lionel and the TSVWG chairs, so if you do reach out to them, they'll know what you're talking about.

I hope this is helpful, and good luck on helping IETF and 3GPP Do The Right Thing. I know that's important.

If I can explain any of this further, please email me privately, just to minimize the hit on people's inboxes.

Best,

Spencer (full disclosure: I co-chaired PILC with Aaron Falk)

On Wed, Jul 28, 2021 at 3:17 PM Das, Dibakar <dibakar.das@intel.com<mailto:dibakar.das@intel.com>> wrote:
Hi Ian,

Thanks for the response.

I think having some signaling visible to the network layer could be useful for the transmitter in the wireless link (say, an AP) as it can take this information into account while preparing the packets. It can even be used in current WiFi (i.e., with in-order delivery) to optimize its scheduling for that stream for example, it can send a Ctrl frame soon to clear holes in the reorder buffer at the recipient.

Regards,
Dibakar


From: Ian Swett <ianswett@google.com<mailto:ianswett@google.com>>
Sent: Wednesday, July 28, 2021 12:42 PM
To: Das, Dibakar <dibakar.das@intel.com<mailto:dibakar.das@intel.com>>
Cc: Alan Frindell <afrind=40fb.com@dmarc.ietf.org<mailto:40fb.com@dmarc.ietf.org>>; quic@ietf.org<mailto:quic@ietf.org>; mops@ietf.org<mailto:mops@ietf.org>; Kirill Pugin <ikir@fb.com<mailto:ikir@fb.com>>
Subject: Re: Reminder: Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC

Hi,

I can't answer for Alan, but my belief is yes.  Client wifi stacks sometimes also do some reordering(and introduce the corresponding latency), so if we could design an indication that in-order delivery has no value, it could be fairly widely applicable.

That being said, I don't know what the right mechanism is?  Would we need something visible to a network or can we get away with a socket option that propagates to the local 5G network or Wifi firmware when possible?

Ian

On Wed, Jul 28, 2021 at 3:15 PM Das, Dibakar <dibakar.das@intel.com<mailto:dibakar.das@intel.com>> wrote:
Hi Kirill, Alan,

I could not attend the call this week and wont be able to attend this side meeting either.

But I had a general question about the performance of all such QUIC based protocols over wireless. Typically, the 5G and WiFI MAC layers deliver frames in-order which sort of recreates the HOL blocking problem at lower layers. I would expect this to in turn prevent the QUIC protocol to achieve its full performance gains at least in some congested network scenarios. Considering that in-order delivery is made optional in 5G PDCP, I was wondering if there could be a value to have some signaling defined in the QUIC (or RUSH ?) protocol that would allow lower layers to make better decision about whether to enable/disable in-order delivery for certain streams.

I apologize in advance if this is not the right venue to ask questions.

Regards,
Dibakar



From: QUIC <quic-bounces@ietf.org<mailto:quic-bounces@ietf.org>> On Behalf Of Alan Frindell
Sent: Wednesday, July 28, 2021 8:42 AM
To: avt@ietf.org<mailto:avt@ietf.org>; wish@ietf.org<mailto:wish@ietf.org>; QUIC WG <quic@ietf.org<mailto:quic@ietf.org>>; mops@ietf.org<mailto:mops@ietf.org>
Cc: Kirill Pugin <ikir@fb.com<mailto:ikir@fb.com>>
Subject: Reminder: Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC

Video Ingest over QUIC Side Meeting Friday 7/30 18:00 UTC / 11 Pacific

Link to draft agenda and video conference details: https://github.com/afrind/draft-rush/blob/main/meeting-materials/agenda.2021.07.03.md<https://protect2.fireeye.com/v1/url?k=00adeccc-5f36d5ca-00adac57-86ee86bd5107-7e78046795c61d1b&q=1&e=dbabf05d-73c5-47c7-b0be-c37322499476&u=https%3A%2F%2Fgithub.com%2Fafrind%2Fdraft-rush%2Fblob%2Fmain%2Fmeeting-materials%2Fagenda.2021.07.03.md>

-Alan
--
Mops mailing list
Mops@ietf.org<mailto:Mops@ietf.org>
https://www.ietf.org/mailman/listinfo/mops