[Tools-discuss] Re: Download entire transcript from meetecho
Eric Rescorla <ekr@rtfm.com> Thu, 09 October 2025 16:13 UTC
Return-Path: <ekr@rtfm.com>
X-Original-To: tools-discuss@mail2.ietf.org
Delivered-To: tools-discuss@mail2.ietf.org
Received: from localhost (localhost [127.0.0.1]) by mail2.ietf.org (Postfix) with ESMTP id 628EC7024223 for <tools-discuss@mail2.ietf.org>; Thu, 9 Oct 2025 09:13:39 -0700 (PDT)
X-Virus-Scanned: amavisd-new at ietf.org
X-Spam-Flag: NO
X-Spam-Score: -1.897
X-Spam-Level:
X-Spam-Status: No, score=-1.897 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_NONE=0.001] autolearn=ham autolearn_force=no
Authentication-Results: mail2.ietf.org (amavisd-new); dkim=pass (2048-bit key) header.d=rtfm-com.20230601.gappssmtp.com
Received: from mail2.ietf.org ([166.84.6.31]) by localhost (mail2.ietf.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id p2rd6FE2zAVn for <tools-discuss@mail2.ietf.org>; Thu, 9 Oct 2025 09:13:38 -0700 (PDT)
Received: from mail-yw1-x1130.google.com (mail-yw1-x1130.google.com [IPv6:2607:f8b0:4864:20::1130]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) by mail2.ietf.org (Postfix) with ESMTPS id 5576E702419B for <tools-discuss@ietf.org>; Thu, 9 Oct 2025 09:13:30 -0700 (PDT)
Received: by mail-yw1-x1130.google.com with SMTP id 00721157ae682-71d60157747so11696687b3.0 for <tools-discuss@ietf.org>; Thu, 09 Oct 2025 09:13:30 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rtfm-com.20230601.gappssmtp.com; s=20230601; t=1760026410; x=1760631210; darn=ietf.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=HwLTnlA5/Vcjr8Tpf5C3qvOEadTWmg6zg7Zv8momS5A=; b=lfSEkcFIXMdKBqqtKugugg52s+T91FNssZ8OIuqxE3oOo5v93s132izrc4oQnuSUjm sUtu6rxZwtmFpdIXRe/Bp2Jgfad4CKFN4lJeO6YsNhxhGKAiFj2r16geooj4S7tEiXXQ /RCjpd23p8BqslOCG3vmM5iY7aeoXFcW63xgFXxGxdFfqTV/DAV4J0R7xF4YTZKL1zxs 3F2m8LTMyf5l72tn/cMCjwhZI1kt6cZldMfGW8ULtjsOqydgz0YvR6gSl4bvEXvfclR3 O6j+quNg9nPP6FlJa5S/4lM+eE0tZevk0mprNpyzBHYXYpSU2KkjTSwmsFOYW3v1vrBD vyVQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1760026410; x=1760631210; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=HwLTnlA5/Vcjr8Tpf5C3qvOEadTWmg6zg7Zv8momS5A=; b=OVgOUXZ15uYaadz2o+BFxinXOiHBQ7Dgs+udXmM9Q9jdx8hQRivhqOIDvxJmLaoI/k KzZ504F+S+4nkQT0RskoUI6rWSKkDRmiwL7PvB4/UPC0V58iDn6aSaRG5Ky0153hQX1k ERsTUx2LURPWhp4lTZZc9J9MxHIf/quEQmvC0PWR+Qm3JV9uwYOfR5ohG3Zu+6EHj9o4 G0qS55UidlACYP2ygRUZhZZYwDPYJrsiSoALzLss1SPQwHt/+JEfhcfuv2H+zdu50ZRc hpNUZwXk3F6fZLtjjdQiWVVfwcRz1vYFVYAwT1ekIDYYavgjGtuIRy9HEEDvNohpUa/e hqrQ==
X-Gm-Message-State: AOJu0YzK6ssN6avsbn1RaHUV740Br/YHUsavF3eo4UXxh5GQziqMq5r4 smQFh6VUlYcRGbRgAa3p7yKHqH68RRaCh1I6MuCGaru7EKTOdqmYr0WK6R1aBVNX6gGlGya4plG FkawL/ZrbCXBYVSp920/adKWYZhHJL5I0N7tsU6GYxg==
X-Gm-Gg: ASbGncspjxCryJBpKbtSyHrrm4V8MHHXRKfFXh1c/gpvHYfK4KKxXoWG6eBFNb0RrHU xVi0gTkRWA5spBMzjcIh4o0GSU3q8D/lkw6+vx0/KwPzMM8UwYry7kmPCmKfTm/itVdHmKtpY4v 1nCU5agTB69St4lyiCDRFnx6bzXcAX+AEAKvVQW5698DQxak+BvVvB+Z/DOd7RkbaPEEjN7Rrhn XS1QNp26RlKP2rpg0UPHH2Q9N1ypzz7B8t+z/m5KWdd+pUqv4mf/o2QURM5AHw7+1GaF8SQ3H3z CibYyfiufI3wUNbPcUXMze9eIPDk32Nyc38XqRl8foNyUSng05Yu0g==
X-Google-Smtp-Source: AGHT+IHFIm5QK0lhNgN3oBWdHVUOO+3SH1D3Bl3iYvM0ueyEHVlL3z/nutYKX9+5H2UiFPoDJFo/xTbPKqCtis4sCRQ=
X-Received: by 2002:a05:690e:c8:b0:622:7517:af78 with SMTP id 956f58d0204a3-63ccb85338fmr6053236d50.13.1760026409525; Thu, 09 Oct 2025 09:13:29 -0700 (PDT)
MIME-Version: 1.0
References: <CABcZeBM-MdEyi+pVJHDXZaF3njDFXBVHRmfjyxhXKiwh3iKKDQ@mail.gmail.com> <CABcZeBPSs2T=dygVzVx4wnsLnVpFpHpuXOdt8eKte0xF2ZWyYQ@mail.gmail.com> <6a5a28d0-eac5-4189-adc3-c16de5cb6118@nostrum.com> <CABcZeBOvuAxD_aSg3G2zkauyMMqGxHMoMQwrqJv9Kioxq5H+Nw@mail.gmail.com> <c9dbd7ea-bdae-4ddf-8753-981a4b0c152c@nostrum.com>
In-Reply-To: <c9dbd7ea-bdae-4ddf-8753-981a4b0c152c@nostrum.com>
From: Eric Rescorla <ekr@rtfm.com>
Date: Thu, 09 Oct 2025 09:12:53 -0700
X-Gm-Features: AS18NWClNwwFHkGFd7s1bEZzgp8IZgslJNQOzQnKl9CPhLW6uUXdiMcw46XaG-8
Message-ID: <CABcZeBP7FG9ar3PgG7EAfZou3TX14KT+raEFFqafVdJDy8yAXw@mail.gmail.com>
To: Robert Sparks <rjsparks@nostrum.com>
Content-Type: multipart/alternative; boundary="000000000000ef77070640bc1422"
Message-ID-Hash: X5DWSOMW7MEYVT6OJZFBKPOPGEIJ2MUB
X-Message-ID-Hash: X5DWSOMW7MEYVT6OJZFBKPOPGEIJ2MUB
X-MailFrom: ekr@rtfm.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-tools-discuss.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: tools-discuss <tools-discuss@ietf.org>, tools-help@ietf.org
X-Mailman-Version: 3.3.9rc6
Precedence: list
Subject: [Tools-discuss] Re: Download entire transcript from meetecho
List-Id: IETF Tools Discussion <tools-discuss.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/tools-discuss/jWLayl_LeWMp63M8KUlko-xvQJo>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tools-discuss>
List-Help: <mailto:tools-discuss-request@ietf.org?subject=help>
List-Owner: <mailto:tools-discuss-owner@ietf.org>
List-Post: <mailto:tools-discuss@ietf.org>
List-Subscribe: <mailto:tools-discuss-join@ietf.org>
List-Unsubscribe: <mailto:tools-discuss-leave@ietf.org>
On Thu, Oct 9, 2025 at 9:03 AM Robert Sparks <rjsparks@nostrum.com> wrote:
> I followed up with Eric and I think he's unblocked.
>
> The original question was how to get to the transcripts (which I think
> meant the chatlogs),
>
No. I mean the autogenerated session transcripts.
and I wanted to point out that an easy way to get all of the chatlogs for a
> meeting is:
>
> rsync -a rsync.ietf.org::proceedings/123/chatlog/ chatlog/
>
This actually isn't really that convenient in this case, because I'm
running this
from a larger script. Running rsync means that I need to run rsync in a
subprocess,
then enumerate the entries in the directory, then clean up the files at the
end.
Rather, what I want is to be able to get all of this from an HTTP API.
-Ekr
RjS
> On 10/9/25 8:27 AM, Eric Rescorla wrote:
>
> That sounds great. In the meantime, can you fix whatever problem is
> preventing me from accessing these pages?
>
> -Ekr
>
>
>
> On Thu, Oct 9, 2025 at 6:23 AM Robert Sparks <rjsparks@nostrum.com> wrote:
>
>> Hi Ekr-
>>
>> We're aware and are expecting to move to serving the meeting material
>> views with no challenges at all during the week next week. Reworking how
>> the main proceedings page itself is served will be a different effort and
>> may come later than that, but we expect to remove the challenges from it
>> before the meeting.
>>
>> RjS
>> On 10/9/25 4:14 AM, Eric Rescorla wrote:
>>
>> Some URLs on the datatracker seem to still have some kind of bot blocking,
>> even with a botname that is supposed to be allowlisted.
>>
>> Consider the the following code:
>>
>> import requests
>>
>> headers = {"User-Agent": "ietf-agenda/0.1 (+
>> https://github.com/ekr/ietf-agenda)"}
>>
>> URL = "https://datatracker.ietf.org/meeting/123/proceedings"
>> URL2 = "https://datatracker.ietf.org/api/meeting/124/agenda-data"
>>
>> print(requests.get(URL).status_code)
>> print(requests.get(URL2).status_code)
>>
>> When run, this produces:
>>
>> 403
>> 200
>>
>> Sending this both to tools-discuss for awareness and tools-help to get
>> the block fixed.
>>
>> -Ekr
>>
>>
>>
>>
>>
>> On Wed, Oct 8, 2025 at 9:11 PM Eric Rescorla <ekr@rtfm.com> wrote:
>>
>>> Is there an official API endpoint to download the entire transcript
>>> for a meeting from meetecho?
>>>
>>> Thanks,
>>> -Ekr
>>>
>>>
>> -----------------------------------------------
>> Tools-discuss mailing list -- tools-discuss@ietf.org
>> To unsubscribe send an email to tools-discuss-leave@ietf.orghttps://mailarchive.ietf.org/arch/browse/tools-discuss/
>>
>>
> -----------------------------------------------
> Tools-discuss mailing list -- tools-discuss@ietf.org
> To unsubscribe send an email to tools-discuss-leave@ietf.orghttps://mailarchive.ietf.org/arch/browse/tools-discuss/
>
>
- [Tools-discuss] Download entire transcript from m… Eric Rescorla
- [Tools-discuss] Re: Download entire transcript fr… Eric Rescorla
- [Tools-discuss] Re: Download entire transcript fr… Robert Sparks
- [Tools-discuss] Re: Download entire transcript fr… Eric Rescorla
- [Tools-discuss] Re: Download entire transcript fr… Robert Sparks
- [Tools-discuss] Re: Download entire transcript fr… Eric Rescorla