[Moq] Re: MoQ + Compression

Luke Curley <kixelated@gmail.com> Fri, 26 June 2026 18:56 UTC

Return-Path: <kixelated@gmail.com>
X-Original-To: moq@mail2.ietf.org
Delivered-To: moq@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 359771083FBAE for <moq@mail2.ietf.org>; Fri, 26 Jun 2026 11:56:45 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ietf.org; s=ietf1; t=1782500205; bh=lfELwnm/7Xo5EArzmWCQ4w6Y2JwM2XyujJ7qM3vqWJY=; h=References:In-Reply-To:From:Date:Subject:To:Cc; b=hvHlxSQXcqkdRCds3QjMrpaRmJEuSotqm2XIbU6HtdcL1rXCfTyhem+xTOcuTcVRB eq9ZHD2PPMFfRh3I57XjDkiubxHNJVAc1fK+Q79VOWosfXvNpvS8HbgB4MP+8/M66w lS50xt4py3qsrY/tVcjTHhadmM/Es500cKatLlFg=
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -2.088
X-Spam-Level:
X-Spam-Status: No, score=-2.088 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_KAM_HTML_FONT_INVALID=0.01] autolearn=ham autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 8KJbDG9Jhg2j for <moq@mail2.ietf.org>; Fri, 26 Jun 2026 11:56:44 -0700 (PDT)
Received: from mail-ed1-x52a.google.com (mail-ed1-x52a.google.com [IPv6:2a00:1450:4864:20::52a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id 3F5841083FB25 for <moq@ietf.org>; Fri, 26 Jun 2026 11:56:16 -0700 (PDT)
Received: by mail-ed1-x52a.google.com with SMTP id 4fb4d7f45d1cf-69532288224so2878903a12.0 for <moq@ietf.org>; Fri, 26 Jun 2026 11:56:16 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; t=1782500175; cv=none; d=google.com; s=arc-20260327; b=exHsAaeH52sOtq+bILXK0yZzSzUQFhXmhgDezPK8vEpW7e7oGxyLD40nY5xNTL+jjE opFQtt1ErWXRnDyPDFdhhOpPtCIuxlzpG/LQO9Fgh5RPS6hZoz+uKR2mVsTuEFtgRrgK T6+8SqL4dXJEn4dTBaHF9pobpTCE5EbI5MOy2AylxNmU2I88j9skd+pgVtYCzagdqakp S0spQPcyzAQIJsdDkpR1H0ermrkYQEftFOHllE8TacZA0wrJl/61csOjSBnmO3C6nMD8 NKOBnoL9r1X49xakFK75kt4S/OPi+j+61XuJ+OGbGoOw13Q5J/K1UvGJ25O7kww3RM0O wn7Q==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=s0Hc8XmFaMt6OtNgR7O73lPZ6Ay1aaom3Bmey0Pjz9g=; fh=XLO/+K3KI5Trbh4Md9a3IyYaFQvU0AuKH1qqoVlVssw=; b=paUcpKXK0IUtEycBsLCMGGw6bvDKP8N1oUe0fvgW2pm4w4yZeNH+Ac/qqtwx3gmIxw 5CHm3LtLBu2ZRg8vNLCKGmyXgaZubBc3VjiKir4Rusd6cf8Jc9Wd1+VzRmwvsVrnQ7Zr IQLarp59KdGoyPTPYKbwyXPN2DP3XYa9SnDQF5zpHNGwpP02nn6bHCk4q8HXOfjnkiAy nMMERC0mKLRtm3CrM6JRSJL5DJqxLNANcqJNXExC2X+sLm4uo53keN3WqpfZhk7Qc+ju DcikqW0PQZY/tvhJsYkPn7gVd061xA5n8t9RvTmvwwCgCopujJsIDMq0/4nDShvpw2So VKhQ==; darn=ietf.org
ARC-Authentication-Results: i=1; mx.google.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1782500175; x=1783104975; darn=ietf.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=s0Hc8XmFaMt6OtNgR7O73lPZ6Ay1aaom3Bmey0Pjz9g=; b=MSgeY1MfAB5ZcLffTxPjjhO7ne/GL5vyIYU/lvOAONnJZVHaVjFrpLcoT/uLVY24te x4NZRFzDGBVMhOQIAXNm5PJ8F1P2NQA02dIClKIB6TftO/hcKBBc5gMeZFtciatnxBqM EjZ4UU/JpFSbWYw/pdfkCUtu97vpbZ99VecOaOlr9R55ctSW7cbRJseRIqUGa95JC3Nq 5Uhcvroibug/3ReGCebB2y43+vMQ7R4OHZKoWev6BETPCBOg3nHkjkZ1CsAXWmN/2vRG pVX3KYvNYU2CEmfETeRB1aOf483w3a0aRKNr1nhsO6sOH8LGz+5v7IWkg89HCU2fpIsJ p4GA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1782500175; x=1783104975; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-gg:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=s0Hc8XmFaMt6OtNgR7O73lPZ6Ay1aaom3Bmey0Pjz9g=; b=hMyGsuRTSo6mgBVX3wkCVnT1hjwjU2OvrZ7+f/bXYnFY53kO7c8Rx8CzMwaOJbKCM8 5n/IWbigcnOMK8IPaDqqstB9Jmvihs/2pvYq8EWryo+oJY2Dq9DzhDLYS60NHboAje1x zBejmPDuZSEbV4BAx3Pqj/zMxDOy5pPa7WC8DxB2rBDyFMZB2JoiWowVqGho34e7ffwy NEsAoAvTvW8sWXrNkESiVSDn20pgFJoACv3V051liiToAdW16u8Ndz0+C+fKqL10XszZ gCWUe3AMNsau6ghTnJh8wvy6rGcTfnejQANLwPsfopX2FT30yu9THy5JeHs7OleLRlE3 38zQ==
X-Gm-Message-State: AOJu0YwGFtGqB6fOCgCQSI5wJzYzxubWg9yx1YrrMRawxir9zy3auBIH FF7HkRtGJQ3kdWnF8ZqWiWh5rDUwkG3JTYlNLOukEhPQyEaNmw/WpSUW3aDK2G6qa83zVsIXPjO DAcFfXNP8eelVQe9xqal5w9SS/e0PucB4Tzmk
X-Gm-Gg: AfdE7ckA5AmpP1DU0kA+tdbi7aNLPzv0FW8MYiWd2tWF9YbkzRh36hTaTLDa7dZWJtL jlmJm1l6AkN6yQR/HpItS2Sa5BYvWIf83/EUHWc6tbr+lzN8GnDI8AVcEYlkHTY2rFJ3VJitSeJ nMTV7ktYls/s6kU05sPRl7xsO3KDw1V7k19L/NAqwUcrSQi6/nymQzebnZLXA1/ET0EBjuzxPGN vL0tQRoJYNKNdo3VjZztXdZEKUrxy3IUSJSZ06SNKb0TF785/SS4B8+X6jE0c9dNZkty7eekf3o OBzjJ853ofAKX8xl0sApm4m/V54nuQ==
X-Received: by 2002:a17:907:78a:b0:c12:34ed:da13 with SMTP id a640c23a62f3a-c1234ede0abmr75419766b.63.1782500175023; Fri, 26 Jun 2026 11:56:15 -0700 (PDT)
MIME-Version: 1.0
References: <CAHVo=Z=MwNtUtKYie2M62_mvXa26J6KfSG+DzcguDzkdER+Ocg@mail.gmail.com> <CANPAELv6CqDXmyR3EEWyX+XNBFVEC1URg7PPdU=1DkAATCpHZQ@mail.gmail.com> <CAHVo=Zmara43hi-hqk0-ZEBJ4Rz-qnNwyDfREEihLReko8FRnA@mail.gmail.com> <CAHVo=ZkBXBGk6z-9_po8Ocfj6-OrwiB3P+8972v1KLFeMV1aww@mail.gmail.com>
In-Reply-To: <CAHVo=ZkBXBGk6z-9_po8Ocfj6-OrwiB3P+8972v1KLFeMV1aww@mail.gmail.com>
From: Luke Curley <kixelated@gmail.com>
Date: Fri, 26 Jun 2026 11:56:03 -0700
X-Gm-Features: AVVi8CcUOCarikEQbIKyCfJeAKmFPIU696awHUgX-fGX9A9ZBim0xgdvD2Tig7M
Message-ID: <CAHVo=Zn76WgbA72HvoqG3aNBFTGY-Lm1R2xGk+8Fwr4v30pwAg@mail.gmail.com>
To: Alan Frindell <afrind@meta.com>
Content-Type: multipart/alternative; boundary="000000000000be953b06552ca999"
Message-ID-Hash: DV4FUDD6XBBAIVZ25XHEQV2SFRDKBGAU
X-Message-ID-Hash: DV4FUDD6XBBAIVZ25XHEQV2SFRDKBGAU
X-MailFrom: kixelated@gmail.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: MOQ Mailing List <moq@ietf.org>
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [Moq] Re: MoQ + Compression
List-Id: Media over QUIC <moq.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/moq/S1SsJCVZAh8HkUbjAY7PyBU_eh8>
List-Archive: <https://mailarchive.ietf.org/arch/browse/moq>
List-Help: <mailto:moq-request@ietf.org?subject=help>
List-Owner: <mailto:moq-owner@ietf.org>
List-Post: <mailto:moq@ietf.org>
List-Subscribe: <mailto:moq-join@ietf.org>
List-Unsubscribe: <mailto:moq-leave@ietf.org>

One last thing: adding DEFLATE to SUBSCRIBE_NAMESPACE would likely help a
ton. There's so much overlap between NAMESPACE messages, and they literally
get duplicated on each NAMESPACE_DONE.

On Fri, Jun 26, 2026 at 11:45 AM Luke Curley <kixelated@gmail.com> wrote:

> Sorry hit the send button to early.
>
> But you can imagine the headache if both of these files were large
>
>
> I meant tracks.
>
> Some companies use my libraries to publish sensor data or controls over
> Starlink. We don't want a scenario where one outdated subscriber that
> doesn't support compression causes 9x the data transfer from the publisher
> to the relay.
>
> Making DEFLATE mandatory to implement in moq-transport would fix a lot.
>
>
> On Fri, Jun 26, 2026 at 11:35 AM Luke Curley <kixelated@gmail.com> wrote:
>
>> Yeah Alan, that's the problem with doing it at the application layer. I'm
>> currently publishing two tracks:
>>
>>    - catalog.json
>>    - catalog.json.z
>>
>> But you can imagine the headache if both of these files were large, and
>> there was a 50-50 split among subscribers.
>>
>>
>> I mocked up a transport extension that was something like:
>>
>> 1. SETUP indicates decompression schemes in preferred order (1 =
>> deflate, 2 = zstd, etc).
>> 2. SUBGROUP_HEADER (or SUBSCRIBE_OK?) indicates the compression scheme.
>>
>> Like what Lucas said, the real problem is intermediaries. You ideally
>> want a relay to proxy the data, not waste CPU on (re)compression. A relay
>> can always decompress the data for subscribers that don't support a
>> compression scheme, but it probably shouldn't (re)compress it.
>>
>>
>> Suhas you run into rollout issues with that approach because it's not
>> backwards compatible. You blindly have to assume that every single
>> subscriber supports a compression scheme before you can turn it on.
>>
>>
>> On Fri, Jun 26, 2026 at 11:08 AM Alan Frindell <afrind@meta.com> wrote:
>>
>>> Cool work Luke.
>>>
>>> MOQT's model is clearly "the objects can't change for the same track
>>> name" - therefore the only way we have to signal compression support now is
>>> it bake it into the Full Track Name (eg: SUBSCRIBE namespace--name.deflate
>>> or something).  Otherwise, aren't you wandering into HTTP content
>>> negotiation, Vary header, etc territory?
>>>
>>> -Alan
>>>
>>>