IETF Logo Mail Archive

Re: How to set up a proxy test framework?

Michael Toomim <toomim@gmail.com> Thu, 25 July 2024 09:39 UTC

Received: by ietfa.amsl.com (Postfix) id A8F44C1519AD; Thu, 25 Jul 2024 02:39:58 -0700 (PDT)
Delivered-To: ietfarch-httpbisa-archive-bis2juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A8166C1516EB for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 25 Jul 2024 02:39:58 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.857
X-Spam-Level:
X-Spam-Status: No, score=-2.857 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.25, HTML_MESSAGE=0.001, MAILING_LIST_MULTI=-1, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=w3.org header.b="WrbfQAY0"; dkim=pass (2048-bit key) header.d=w3.org header.b="FfDjnL5r"; dkim=pass (2048-bit key) header.d=gmail.com header.b="dJSd3k3G"
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id rzq4Z0UNDSdC for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 25 Jul 2024 02:39:54 -0700 (PDT)
Received: from mab.w3.org (mab.w3.org [IPv6:2600:1f18:7d7a:2700:d091:4b25:8566:8113]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A39ABC151065 for <httpbisa-archive-bis2Juki@ietf.org>; Thu, 25 Jul 2024 02:39:54 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=w3.org; s=s1; h=Subject:In-Reply-To:From:References:To:MIME-Version:Date:Message-ID: Content-Type:Cc:Reply-To; bh=fAJxdklZQfia0mLEW4Imji/wiWL4xfiPknu7Jitfohw=; b= WrbfQAY0uv312vuORmgoxHyTNvB4nQE3Q3vFP2BgknRgsK2hX/knP4iaeo2uuXVUTThMu5U9gzANd fNZr++z2iXD0CG/7kiPVTx5XdyJflZ6a3GYAvpx821FxmvZXI07owAtxUiRWBzmZ69JORgScZHdmL cnGvvHterpP5bDavscs6RByjk1HTCQDv7QTjEXdp8A+aNxOLaBipLAz38F1RdohftJexPPNMiWCLX RKDNEg5Mn1eeB8sLppyoOM/zaOPYlm4Le8cP8tPW3x/CV9BMeXHPWSlpsmuUXo5hDNpOvlSTaBZhv g5r3+peAFnV6c+cwkU6FeyS4yqKuUXlSJQ==;
Received: from lists by mab.w3.org with local (Exim 4.96) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1sWuwc-006cB2-1n for ietf-http-wg-dist@listhub.w3.org; Thu, 25 Jul 2024 09:39:30 +0000
Resent-Date: Thu, 25 Jul 2024 09:39:30 +0000
Resent-Message-Id: <E1sWuwc-006cB2-1n@mab.w3.org>
Received: from ip-10-0-0-144.ec2.internal ([10.0.0.144] helo=pan.w3.org) by mab.w3.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from <toomim@gmail.com>) id 1sWuwa-006c9N-10 for ietf-http-wg@listhub.w3.internal; Thu, 25 Jul 2024 09:39:28 +0000
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=w3.org; s=s1; h=In-Reply-To:From:References:To:Subject:MIME-Version:Date:Message-ID: Content-Type:Cc:Reply-To; bh=fAJxdklZQfia0mLEW4Imji/wiWL4xfiPknu7Jitfohw=; t=1721900368; x=1722764368; b=FfDjnL5ruSwFm4rNeyJr7EIGbSrZYT7tzN4VeOh56M9Mcls 7KrudOJes69Utg9xVhodJjtoKzJk9xummT+7GNnsrrTaoqPy2B5qq682FbT66S03faEbpkGlDT7gU 4zk/PMX3jiLPU0SSkkDoMZ3e3kaFEvIiVvK4pnIlSpy0PtDH65uqC7qpcNWwJfsGKF36OmfFt7Hc+ c+ytqYl2ilfl/7GUzlvO4mdEi6cS8XdQHS/8/cF3qQYabzg2sje2+ByckC278sGdYOVAPLhczDWfv wllH0130Tolun1ONQQ0qF6Y+/te2mgm7BTRTQRbHeqggW71RwUpPUP230R9t13wg==;
Received-SPF: pass (pan.w3.org: domain of gmail.com designates 2607:f8b0:4864:20::633 as permitted sender) client-ip=2607:f8b0:4864:20::633; envelope-from=toomim@gmail.com; helo=mail-pl1-x633.google.com;
Received: from mail-pl1-x633.google.com ([2607:f8b0:4864:20::633]) by pan.w3.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from <toomim@gmail.com>) id 1sWuwZ-00CkVg-28 for ietf-http-wg@w3.org; Thu, 25 Jul 2024 09:39:28 +0000
Received: by mail-pl1-x633.google.com with SMTP id d9443c01a7336-1fc5296e214so6187575ad.0 for <ietf-http-wg@w3.org>; Thu, 25 Jul 2024 02:39:27 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1721900364; x=1722505164; darn=w3.org; h=in-reply-to:from:content-language:references:to:subject:user-agent :mime-version:date:message-id:from:to:cc:subject:date:message-id :reply-to; bh=fAJxdklZQfia0mLEW4Imji/wiWL4xfiPknu7Jitfohw=; b=dJSd3k3GZKg8G92p0QNqEFLnPyBuVX+SZLSwA8pS+GabW9rjnACEifHvaPzUr3hU17 64/0rgmmdSw9+7SPryKgrzdU1noEv6uxJezVHa3sw9TYDiUgmIHXNETJ7mlDfTz9nCK9 qzDC6SbQn55K9Bmbg+GHyqYtKt5gcgMY6P2AvoJs+YxgGVJyYhScdrieUjN8QVWOYkot EPkaKAA2houDfaQ5HjW9bbK5jcV4j71yE4quVyecIhW6WR5jerJp3HKGsb4NuyBvGO30 moYNFTb7AOrpW2cmHbV8o7lFv87/KjNTi+e83Ca/M/6ytBOD6Sy5PCqjaPKOMeapCQ2R UCag==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1721900364; x=1722505164; h=in-reply-to:from:content-language:references:to:subject:user-agent :mime-version:date:message-id:x-gm-message-state:from:to:cc:subject :date:message-id:reply-to; bh=fAJxdklZQfia0mLEW4Imji/wiWL4xfiPknu7Jitfohw=; b=pTPhgVQIx6saQ518SERJhiNegRi5kgb55eL7o9wv50rhYnJ4Ijt5HGvPr4/NY5akXN wJSdWD2uEVqi5fZhRSjSQ+DlgRbPwwNtCexq/+45GvhUzBBOalMN0EtHs39EVyV8KVRf ktFSN8fhuU5dprMmZVZpL2TYtyCbPGGek4XMZPlY/dZ79rpGzue1HwLn61iXVVqyn7PI KWVUQv4ttZe03TBTulqXPLrMVtp2+WdyF6fk4++4ZiOvYy4kEJogQ1dO/A9r5hrMZBqU vOypPP/JWxRezZArhdMIRtCMFMkMl/nfz84/oRcNT3DdgUtQdTXlhAXfq2mQzQY+24GP g5bQ==
X-Forwarded-Encrypted: i=1; AJvYcCWj8+Y8KNn+pLKVb70h6dqO5QAv+FcFMHAIxt4TCSc3Wfut13RzIBpnfc7729uEoBYiRBS75Zi/bbQLUCUxb/DWIwHz
X-Gm-Message-State: AOJu0Ywg7+J3FnlUMCdZ2rDN8sGihSu4yMfElCby2OJE7AV33dwYszno frRWq/hlOvT5xT+XoysWeo/5ZiVYIQKX9QSKkwBu6Oso5D4Oy+Ec
X-Google-Smtp-Source: AGHT+IGPo14r4AHJAAjkOIqHzmhfggQNJ6MoYORy5ft6fXk6D0qnUk+s7UYKv9ZLIPI40G4P2z3fyQ==
X-Received: by 2002:a17:902:ec87:b0:1fd:a0e9:919 with SMTP id d9443c01a7336-1fed92ad376mr13089895ad.44.1721900363424; Thu, 25 Jul 2024 02:39:23 -0700 (PDT)
Received: from [172.31.7.130] ([207.194.231.35]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-1fed7c8c1a8sm9948455ad.2.2024.07.25.02.39.22 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 25 Jul 2024 02:39:23 -0700 (PDT)
Content-Type: multipart/alternative; boundary="------------iS0BoFesuamJcHakxRRUExXx"
Message-ID: <79f06434-4954-4c1b-a948-49966eec912f@gmail.com>
Date: Thu, 25 Jul 2024 02:39:22 -0700
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
To: Michiel Leenaars <michiel.ml@nlnet.nl>, Josh Cohen <joshco@gmail.com>, HTTP Working Group <ietf-http-wg@w3.org>, Marius Kleidl <marius@transloadit.com>
References: <240ca61c-e168-4858-9994-2abadb3a1d16@gmail.com> <D07EF2AA-C0CB-496E-ACF2-6F263A7AC9C5@gmail.com> <074a3702-ddbd-451d-afa5-37a5bd96e1be@gmail.com> <l6mnttzq6ey6lzlvkmpwpil5gfwsryi5axhs6zrs4jg2amsn2t@g7x3wv3phsaz>
Content-Language: en-US
From: Michael Toomim <toomim@gmail.com>
In-Reply-To: <l6mnttzq6ey6lzlvkmpwpil5gfwsryi5axhs6zrs4jg2amsn2t@g7x3wv3phsaz>
X-W3C-Hub-DKIM-Status: validation passed: (address=toomim@gmail.com domain=gmail.com), signature is good
X-W3C-Hub-Spam-Status: No, score=-5.1
X-W3C-Hub-Spam-Report: BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, DMARC_PASS=-0.001, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, W3C_AA=-1, W3C_DB=-1, W3C_WL=-1
X-W3C-Scan-Sig: pan.w3.org 1sWuwZ-00CkVg-28 05c99d1ddb231b3b330d7d26d30c616c
X-Original-To: ietf-http-wg@w3.org
Subject: Re: How to set up a proxy test framework?
Archived-At: <https://www.w3.org/mid/79f06434-4954-4c1b-a948-49966eec912f@gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/52129
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <https://www.w3.org/email/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

Beautiful! Now we've got three great-looking test harnesses to start with:

  * httptoolkit <https://httptoolkit.com>
  * mitmproxy <https://mitmproxy.org>
  * VTest <https://github.com/vtest/VTest>

And three proxies to play with:

  * Squid
  * Varnish
  * HAProxy

Claude is giving us tons of ideas on things to try with them.

Thanks everyone!

On 7/25/24 12:18 AM, Michiel Leenaars wrote:
> Hi Michael,
> I can recommend having a look at:
>
> https://httptoolkit.com
> https://mitmproxy.org
>
> (both of which are projects that we at NLnet financially support)
>
> Hope this is useful. Let me know if you or someone else needs help to
> get in touch with these projects...
>
> Best,
> Michiel
>
>>>> Thanks everyone for your feedback during today's versioning talk 
>>>> <https://datatracker.ietf.org/meeting/120/materials/slides-120-httpbis-versioning-for-http-resources-00.pdf>!
>>>>
>>>> On slides 10 and 11, Mark Nottingham keenly pointed out some issues 
>>>> we'll encounter with proxies. I want to set up a test framework to 
>>>> help find and validate a solution. Has anyone set up a such a proxy 
>>>> test framework before?
>>>>
>>>> I think my first step should be to list some scenarios or softwares 
>>>> to test with. I don't have a lot of experience yet in proxyland. 
>>>> I'd love advice!

v2.34.0 | Report a Bug | By Email | System Status