Re: [openpgp] Deprecating compression support

Peter Gutmann <pgut001@cs.auckland.ac.nz> Tue, 19 March 2019 00:57 UTC

Return-Path: <pgut001@cs.auckland.ac.nz>
X-Original-To: openpgp@ietfa.amsl.com
Delivered-To: openpgp@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 33168130EA7 for <openpgp@ietfa.amsl.com>; Mon, 18 Mar 2019 17:57:58 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -4.199
X-Spam-Level:
X-Spam-Status: No, score=-4.199 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_MED=-2.3, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=auckland.ac.nz
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jzH5D_jeZRUy for <openpgp@ietfa.amsl.com>; Mon, 18 Mar 2019 17:57:56 -0700 (PDT)
Received: from mx4-int.auckland.ac.nz (mx4-int.auckland.ac.nz [130.216.125.246]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 8610F1240D3 for <openpgp@ietf.org>; Mon, 18 Mar 2019 17:57:55 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=auckland.ac.nz; i=@auckland.ac.nz; q=dns/txt; s=mail; t=1552957075; x=1584493075; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=FzhokFlCRjDIt6AcwuNnaCnDdGTOE4gD6TzdeWhMMOg=; b=RciXOmnofy27rhoBwfZctZF6f84wiMN2bM5K3Y3ZHU1M7aQYY6uUOdCx Thq73JT66wnSwQLj2iqF4MWlw7e2Vt7yJlx9fvs/1GBH/HddFtS3wjzwc 4okC62YBUcBzmzJH9OLiqcMa3EWEEXo2UN9WXXogHFgmRZMzTtshDs+Q+ I7VFJGQUWpSO4kVcoXJNvVof1rjtJ0OhL9DbibC1yb+R4h7a5oCps6XIx 0vkaObKUJEtvmV7M+5UCex201FWo2nWZmELzjXs1u8xrlxwxeSzizEBFz R/nY10yb77zKnXDHiicEJl+wtGCKdM78RenvOrJZeWY5vhYacBbslUHvE g==;
X-IronPort-AV: E=Sophos;i="5.58,495,1544439600"; d="scan'208";a="52222457"
X-Ironport-HAT: MAIL-SERVERS - $RELAYED
X-Ironport-Source: 10.6.3.9 - Outgoing - Outgoing
Received: from exchangemx.uoa.auckland.ac.nz (HELO uxcn13-tdc-e.UoA.auckland.ac.nz) ([10.6.3.9]) by mx4-int.auckland.ac.nz with ESMTP/TLS/AES256-SHA; 19 Mar 2019 13:57:52 +1300
Received: from uxcn13-ogg-d.UoA.auckland.ac.nz (10.6.2.5) by uxcn13-tdc-e.UoA.auckland.ac.nz (10.6.3.9) with Microsoft SMTP Server (TLS) id 15.0.1395.4; Tue, 19 Mar 2019 13:57:51 +1300
Received: from uxcn13-ogg-d.UoA.auckland.ac.nz ([10.6.2.5]) by uxcn13-ogg-d.UoA.auckland.ac.nz ([10.6.2.5]) with mapi id 15.00.1395.000; Tue, 19 Mar 2019 13:57:51 +1300
From: Peter Gutmann <pgut001@cs.auckland.ac.nz>
To: Jon Callas <joncallas=40icloud.com@dmarc.ietf.org>, "openpgp@ietf.org" <openpgp@ietf.org>
CC: Jon Callas <joncallas@icloud.com>
Thread-Topic: [openpgp] Deprecating compression support
Thread-Index: AQHU3YM4vbELTl6DS0ip+YCblb7fpaYRAjQAgAEgQyg=
Date: Tue, 19 Mar 2019 00:57:51 +0000
Message-ID: <1552957009760.34092@cs.auckland.ac.nz>
References: <871s3475dy.fsf@europa.jade-hamburg.de>, <96055353-B0EB-4E25-95CC-B25D9C5A0BA8@icloud.com>
In-Reply-To: <96055353-B0EB-4E25-95CC-B25D9C5A0BA8@icloud.com>
Accept-Language: en-NZ, en-GB, en-US
Content-Language: en-NZ
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ms-exchange-transport-fromentityheader: Hosted
x-originating-ip: [130.216.158.4]
Content-Type: text/plain; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Archived-At: <https://mailarchive.ietf.org/arch/msg/openpgp/8zpXRPILy1komyRBALl_-rh2m88>
Subject: Re: [openpgp] Deprecating compression support
X-BeenThere: openpgp@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "Ongoing discussion of OpenPGP issues." <openpgp.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/openpgp>, <mailto:openpgp-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/openpgp/>
List-Post: <mailto:openpgp@ietf.org>
List-Help: <mailto:openpgp-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/openpgp>, <mailto:openpgp-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 19 Mar 2019 00:57:58 -0000

Jon Callas <joncallas=40icloud.com@dmarc.ietf.org> writes:

>One of these differences is that zip-style compression is just not as useful
>now. 

There is one situation in which PGP was at one point widely used but for which
I don't have much current data (more recent than about five years ago) and
that's banking and medical EDI (so X12/HL7), where compression is a required
feature, because you're moving potentially multi-megabyte text files via FTP
to/from mainframes over slow links.

Outside of that rather specialised use, there's no reason to use compression.

>The compression inside of OpenPGP is also hard to implement correctly. The
>default compression, the “DEFLATE” option is a modified implementation of
>ZIP-style programs from the era of the late 1980s. 

To give some background to this, the original PGP use LHarc because it was
sort-of free.  When the first InfoZip implementations came out, Phil correctly
guessed that it would become the universal standard based on the popularity of
MSDOS Pkzip.  However, what went into PGP 2 was a pre-pre-pre-release of Zip,
whose format didn't settle down completely until after PGP was released.  I
think the only reason why deflateInit() still accepts -13 as a compression
parameter is to trigger the PGP 2-compatibility mode in the compressor.

>The underlying reality is even worse. Go look at section 5.6 of 2440, and
>there are interoperability hints for working with PGP2 because it had further
>limitations in it for internal table sizes. 

That was due to 16-bit segments on the 8086, even then you had all sorts of
hacks to get things to work.

Peter.