Re: [hybi] Payload only compression extension, again

Takeshi Yoshino <tyoshino@google.com> Tue, 10 May 2011 07:53 UTC

Return-Path: <tyoshino@google.com>
X-Original-To: hybi@ietfa.amsl.com
Delivered-To: hybi@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8014AE0864 for <hybi@ietfa.amsl.com>; Tue, 10 May 2011 00:53:09 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -105.976
X-Spam-Level:
X-Spam-Status: No, score=-105.976 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, FM_FORGED_GMAIL=0.622, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id eRe6i9cydqtw for <hybi@ietfa.amsl.com>; Tue, 10 May 2011 00:53:08 -0700 (PDT)
Received: from smtp-out.google.com (smtp-out.google.com [216.239.44.51]) by ietfa.amsl.com (Postfix) with ESMTP id 74ECBE0861 for <hybi@ietf.org>; Tue, 10 May 2011 00:53:07 -0700 (PDT)
Received: from hpaq11.eem.corp.google.com (hpaq11.eem.corp.google.com [172.25.149.11]) by smtp-out.google.com with ESMTP id p4A7VDmS002235 for <hybi@ietf.org>; Tue, 10 May 2011 00:31:14 -0700
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=google.com; s=beta; t=1305012674; bh=DKcR0dnAnfaz8J6dm+YLVJtf2Vg=; h=MIME-Version:In-Reply-To:References:From:Date:Message-ID:Subject: To:Cc:Content-Type; b=D6B3tuqD06dwKMsiy5mA2yFKE6Fnk276m62zunRwMoaekzYfdho8RGpCOXsdAmsBT x7yb2S4EjiJJ77wyPGyqw==
Received: from gyh4 (gyh4.prod.google.com [10.243.50.196]) by hpaq11.eem.corp.google.com with ESMTP id p4A7VBdc023943 (version=TLSv1/SSLv3 cipher=RC4-SHA bits=128 verify=NOT) for <hybi@ietf.org>; Tue, 10 May 2011 00:31:12 -0700
Received: by gyh4 with SMTP id 4so2417656gyh.12 for <hybi@ietf.org>; Tue, 10 May 2011 00:31:11 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=beta; h=domainkey-signature:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-type; bh=i25wbcRfiFt0nHnsu/jcMv6SLaFbRIyQL/Y00e0m5Ow=; b=x8mO9YjSTDABhDqqymdMZCkz/C0iDivtKUxnw03ZcGAD3cL2a3aLgEGZLqGIkK9d4j kD0QzYooJ4nQ1YsEcDbw==
DomainKey-Signature: a=rsa-sha1; c=nofws; d=google.com; s=beta; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; b=aPX389GEtz7GMgIGLVk4JyHcMiQ44fuVZnatzm8W609JgdMvHDUCNnh8Vdd591/5sV HNplWySfe2gLBNAU4xEQ==
Received: by 10.91.66.39 with SMTP id t39mr4079470agk.28.1305012671236; Tue, 10 May 2011 00:31:11 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.91.53.15 with HTTP; Tue, 10 May 2011 00:30:51 -0700 (PDT)
In-Reply-To: <BANLkTimhEai77LC53NFeOhgNzFQes7HS7g@mail.gmail.com>
References: <AANLkTik2LqCC2-ZLLdWNNaQ18ypcQU_5djJobkYtYk6T@mail.gmail.com> <AANLkTik+uh98b0n7U=xrE0Aaa7MyBfZVXSwj+8wfVTKW@mail.gmail.com> <AANLkTinCtDepu+wDt4=8GyXqhfn=SQ7v2SjJhKzP2Mzr@mail.gmail.com> <AANLkTinhw0j5U_tvfCCrcEx=J6b7wBua4XzhWkvthUjL@mail.gmail.com> <BANLkTi=SjQwGQu-3v2wjniyp9DrQ1ZcQdA@mail.gmail.com> <BANLkTi=dqFN-57GV3rYDv4feTAaZFQko1g@mail.gmail.com> <BANLkTikWFwfs0FOuET5ZS1HEzjweNO0_CA@mail.gmail.com> <BANLkTikHXtVM+7nfz60toKTJCXBuMwMC1g@mail.gmail.com> <BANLkTinsMu+Znbg7Fe7+9HZeZg=Q8SwDHg@mail.gmail.com> <4DB8D3B2.8090002@mozilla.com> <BANLkTimE9qYEvBVLGbOsU7YDVGDwHpGjgA@mail.gmail.com> <BANLkTi=L=8r7dCkRa6MTC3AGziZWeM+fpA@mail.gmail.com> <BANLkTi=-msm-ppt1n_2U5+bHoZO1i+Yj7A@mail.gmail.com> <BANLkTikEYhsdcrK1RqQTwjy3yuSVOaw=Dw@mail.gmail.com> <BANLkTimhEai77LC53NFeOhgNzFQes7HS7g@mail.gmail.com>
From: Takeshi Yoshino <tyoshino@google.com>
Date: Tue, 10 May 2011 16:30:51 +0900
Message-ID: <BANLkTinW8SL-kwJs-ZsJPmqj269dT29N0A@mail.gmail.com>
To: Greg Wilkins <gregw@intalio.com>
Content-Type: multipart/alternative; boundary="0016e640cc7cb249e404a2e6f0ec"
X-System-Of-Record: true
Cc: "hybi@ietf.org" <hybi@ietf.org>, Patrick McManus <pmcmanus@mozilla.com>
Subject: Re: [hybi] Payload only compression extension, again
X-BeenThere: hybi@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Server-Initiated HTTP <hybi.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hybi>, <mailto:hybi-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/hybi>
List-Post: <mailto:hybi@ietf.org>
List-Help: <mailto:hybi-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hybi>, <mailto:hybi-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 10 May 2011 07:53:09 -0000

I can change my proposal to accept last blocks (blocks with BFINAL=1) to
allow use of java.util.zip. In my proposal, receiver expects 3 header bits
0b000 (and padding to byte boundary) on the tail of the application data
portion. Not to complicate receiver logic much, I'd make change like this
- sender: send(<compressed data flushed with Z_FINISH> + "\x00")
- receiver: inflate(received_data + "\x00\x00\xff\xff"). every time inflater
encounters end of stream (the last octet of a last block), renew inflater
and keep decompressing the remainder.
or
- sender: send(<compressed data flushed with Z_FINISH>)
- receiver: inflate(received_data). every time inflater encounters end of
stream, renew inflater and keep decompressing the remainder. if the end of
received_data is not end of stream, inflate("\x00\x00\xff\xff").

Either algorithm works for Z_SYNC_FLUSH-ed and "\x00\x00\xff\xff" stripped
frame, too.

Takeshi


On Tue, May 3, 2011 at 07:52, Greg Wilkins <gregw@intalio.com> wrote:

> On 3 May 2011 08:02, John Tamplin <jat@google.com> wrote:
> > My point was I see little value in having a compression extension which
> > starts the compression state afresh with every frame, as on real-world
> > applications this gives poor performance.
>
> +1
>
> My extension is more about prototyping plugable extension that work
> well in a chain of extension, plus handling the negotiation and per
> frame issues.    I'll follow the lead of the others/experience on the
> exact algorithms to use (even though I think that is going to cause me
> endless headaches with mismatched licenses and getting IP audits done
> at eclipse :(
>
> cheers
> _______________________________________________
> hybi mailing list
> hybi@ietf.org
> https://www.ietf.org/mailman/listinfo/hybi
>