Re: How to set up a proxy test framework?

Marius Kleidl <marius@transloadit.com> Thu, 25 July 2024 08:14 UTC

Received: by ietfa.amsl.com (Postfix) id AD2C3C1CAF3B; Thu, 25 Jul 2024 01:14:26 -0700 (PDT)
Delivered-To: ietfarch-httpbisa-archive-bis2juki@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id AC76DC110D1E for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 25 Jul 2024 01:14:26 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.857
X-Spam-Level:
X-Spam-Status: No, score=-2.857 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.25, HTML_MESSAGE=0.001, MAILING_LIST_MULTI=-1, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=w3.org header.b="O8pq9h1C"; dkim=pass (2048-bit key) header.d=w3.org header.b="bAGtY2ns"; dkim=pass (1024-bit key) header.d=transloadit.com header.b="Lrdrt+cs"
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id CSQTljOh1raH for <ietfarch-httpbisa-archive-bis2Juki@ietfa.amsl.com>; Thu, 25 Jul 2024 01:14:22 -0700 (PDT)
Received: from mab.w3.org (mab.w3.org [IPv6:2600:1f18:7d7a:2700:d091:4b25:8566:8113]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 77507C137361 for <httpbisa-archive-bis2Juki@ietf.org>; Thu, 25 Jul 2024 01:14:22 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=w3.org; s=s1; h=Subject:Content-Type:Cc:To:Message-ID:Date:From:In-Reply-To: References:MIME-Version:Reply-To; bh=0ZwHjHfPSuZIXx0YnHaVDWp2sHnBFreRfqV70Wo4R3o=; b=O8pq9h1CX0QjBGxxMtzPjKbcgH hxzFQ9gQDEZY4J2VQlekdgahNFfzCDlHXbEYW0WM2PFpul7jSI99AhN9fDtFrbd0d41PLvEFB5dHt kSwH02asa/GloATG2sO83HN+Svvn+MiyP/vRDs9NilWIENZXHTp2pc9i8ZtN2N9St9PNzPfrqLci2 sJHfYp3HhzMMOdjbQ5DLDfddTpnnbOpHyqN7ZKqGL761f1e6qrv8/8NzMJPkSeR9EsdyOR+Lqebbh oB2Cd61S2JOuv4qYkxH5OVsxA+fInsWYTEIxAHUhKB7lg4G6FXpAZHgUcs6u65XIH8CUNllJUMfOh G3SpLnFg==;
Received: from lists by mab.w3.org with local (Exim 4.96) (envelope-from <ietf-http-wg-request@listhub.w3.org>) id 1sWtbW-006Shi-2S for ietf-http-wg-dist@listhub.w3.org; Thu, 25 Jul 2024 08:13:38 +0000
Resent-Date: Thu, 25 Jul 2024 08:13:38 +0000
Resent-Message-Id: <E1sWtbW-006Shi-2S@mab.w3.org>
Received: from ip-10-0-0-224.ec2.internal ([10.0.0.224] helo=puck.w3.org) by mab.w3.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from <marius@transloadit.com>) id 1sWtbU-006Sgj-32 for ietf-http-wg@listhub.w3.internal; Thu, 25 Jul 2024 08:13:36 +0000
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=w3.org; s=s1; h=Content-Type:Cc:To:Subject:Message-ID:Date:From:In-Reply-To: References:MIME-Version:Reply-To; bh=0ZwHjHfPSuZIXx0YnHaVDWp2sHnBFreRfqV70Wo4R3o=; t=1721895216; x=1722759216; b=bAGtY2nsKTb3tNvvu6Ds1k8x58gyINRtn6Rk5OHCXYYcdqLiwFBKTxXnoogTHaOAtYonXw4/9dP bv/7tske2HJET/xMrmBf1IeYybQ2ZXqG8a8vP7snOR2WCHiFIqAXkP+V2eN0rLRWWaZCH13r57+Xs s03KgMHXOXz8oKU+xCmUJfiXWNfBqkto6yIFRYEOZp3O5g1xRvbNiWO2fP9aA9w7UhCUXDaxDVkey rm4UGrQ6OcoZaCcGkUL3YH8+9jHQcrUUBdBxoUlqFvNskwxX1Abm0aunJ17q978TLPxeuLEO1NI+3 XE+asiRTlBaw08tAYp17AjzOKXBYOTEcoy1A==;
Received-SPF: pass (puck.w3.org: domain of transloadit.com designates 2a00:1450:4864:20::22b as permitted sender) client-ip=2a00:1450:4864:20::22b; envelope-from=marius@transloadit.com; helo=mail-lj1-x22b.google.com;
Received: from mail-lj1-x22b.google.com ([2a00:1450:4864:20::22b]) by puck.w3.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from <marius@transloadit.com>) id 1sWtbU-004MEJ-0l for ietf-http-wg@w3.org; Thu, 25 Jul 2024 08:13:36 +0000
Received: by mail-lj1-x22b.google.com with SMTP id 38308e7fff4ca-2eeb1ba040aso9853741fa.1 for <ietf-http-wg@w3.org>; Thu, 25 Jul 2024 01:13:36 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=transloadit.com; s=google; t=1721895212; x=1722500012; darn=w3.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=0ZwHjHfPSuZIXx0YnHaVDWp2sHnBFreRfqV70Wo4R3o=; b=Lrdrt+csSb9uHDx9ZPwLunG/QTpRVlPGNjFftBuKb3C+5NSuGlKTkbFbx+enZVo+eT WVBCP+Lxi3U4SPFKJTxGiGFfK1A1PwLz6DHgTjixJ5qNi3pg0DLymcKqB8a7/fVRSP8H gAReXCwS/ytE9CptDG0ZuffTJqWwaQe50v9Po=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1721895212; x=1722500012; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=0ZwHjHfPSuZIXx0YnHaVDWp2sHnBFreRfqV70Wo4R3o=; b=jLbE+EzG6/9MnzhUyYmxBMRpNwy6DzcBqGcA6KcMIlRva3UrmL65pVQld++57nav51 8BbgsSHevkiDFFBvfNDh4E/FbcxNBgepj6tI6oade66CR9js9YTRH4oj5r0ASxz8UnPD 8e3pCwQDszMFHxMcHBwuxSHciW0vFyVp3kD3HIPM+mXmMaNiNPZEbHgDjzGg649Ayh8A pk1u3Cm1wny+XUY0ay3JMZUuZe6emZxLmzhmqzpqcJuupyUJiCbXjVr/h0G/OGF8fk8O NrXwUebrbZJD+oq4ugCcYppUM7lU6r366++ERiex0AwO6je2a3uTsUe6ZZBGCluryOir dJJw==
X-Gm-Message-State: AOJu0Yx+Yw2ngqc1et78UqKHZfB3AFBqEgFj3DTLuj0O4ZCLezaYt7OW nVBhoCwcpjq6PYHmyyHw8Ee2rH5N52q4SU5jQG8bmJs/7yTSN+5SOoBJ/qanZ6Nu8FYU/6AONQB 4RCtgEyW/UZkswMWDg6mjatyKByPXnbnmpQvLnQ==
X-Google-Smtp-Source: AGHT+IGryBOlBMzt9uOmZ8kdZUjMVK01qBnT4CvaYVV2OVYTUrV8KIjYfiwYboBZq2ab6Bm0jqvAOvoT7bsG9dAZ0U0=
X-Received: by 2002:a05:651c:211b:b0:2ef:2608:2e46 with SMTP id 38308e7fff4ca-2f039c8a713mr18788861fa.6.1721895211831; Thu, 25 Jul 2024 01:13:31 -0700 (PDT)
MIME-Version: 1.0
References: <240ca61c-e168-4858-9994-2abadb3a1d16@gmail.com>
In-Reply-To: <240ca61c-e168-4858-9994-2abadb3a1d16@gmail.com>
From: Marius Kleidl <marius@transloadit.com>
Date: Thu, 25 Jul 2024 10:13:20 +0200
Message-ID: <CANY19Nvn-u_MPXdmzaZp3eg39jZ_3=wUBvR4xb1XG4g=nTg5FQ@mail.gmail.com>
To: Michael Toomim <toomim@gmail.com>
Cc: HTTP Working Group <ietf-http-wg@w3.org>
Content-Type: multipart/alternative; boundary="000000000000713638061e0df8bf"
X-W3C-Hub-DKIM-Status: validation passed: (address=marius@transloadit.com domain=transloadit.com), signature is good
X-W3C-Hub-Spam-Status: No, score=-4.1
X-W3C-Hub-Spam-Report: BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, DMARC_PASS=-0.001, HTML_MESSAGE=0.001, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, W3C_AA=-1, W3C_WL=-1
X-W3C-Scan-Sig: puck.w3.org 1sWtbU-004MEJ-0l c2b7c71bf3ae0414df689a0adf6b8aa0
X-Original-To: ietf-http-wg@w3.org
Subject: Re: How to set up a proxy test framework?
Archived-At: <https://www.w3.org/mid/CANY19Nvn-u_MPXdmzaZp3eg39jZ_3=wUBvR4xb1XG4g=nTg5FQ@mail.gmail.com>
Resent-From: ietf-http-wg@w3.org
X-Mailing-List: <ietf-http-wg@w3.org> archive/latest/52125
X-Loop: ietf-http-wg@w3.org
Resent-Sender: ietf-http-wg-request@w3.org
Precedence: list
List-Id: <ietf-http-wg.w3.org>
List-Help: <https://www.w3.org/email/>
List-Post: <mailto:ietf-http-wg@w3.org>
List-Unsubscribe: <mailto:ietf-http-wg-request@w3.org?subject=unsubscribe>

Hi Michael,

there was a recent exchange about HTTP testing tools on this mailing list
and VTest was mentioned there (
https://mailarchive.ietf.org/arch/msg/httpbisa/p2t_-aieyV2gSwSwaGPbmd8-Vto/)
I haven't used it myself, but it might be useful for your situation as it
was designed for testing proxies (esp. Varnish and HAProxy) as far as I
know. It can simulate an origin server and client, allowing you to check
how an intermediary handles the requests.

Best regards,
Marius Kleidl

On Thu, Jul 25, 2024 at 4:13 AM Michael Toomim <toomim@gmail.com> wrote:

> Thanks everyone for your feedback during today's versioning talk
> <https://datatracker.ietf.org/meeting/120/materials/slides-120-httpbis-versioning-for-http-resources-00.pdf>
> !
>
> On slides 10 and 11, Mark Nottingham keenly pointed out some issues we'll
> encounter with proxies. I want to set up a test framework to help find and
> validate a solution. Has anyone set up a such a proxy test framework before?
>
> I think my first step should be to list some scenarios or softwares to
> test with. I don't have a lot of experience yet in proxyland. I'd love
> advice!
>
> Thanks!
>
> Michael
>