IETF Logo Mail Archive

[Tools-discuss] Re: [EXTERNAL] Re: Why does kramdown convert to US-ACSII?

Mike Ounsworth <Mike.Ounsworth@entrust.com> Fri, 30 August 2024 12:46 UTC

Return-Path: <Mike.Ounsworth@entrust.com>
X-Original-To: tools-discuss@ietfa.amsl.com
Delivered-To: tools-discuss@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0790BC14F69C for <tools-discuss@ietfa.amsl.com>; Fri, 30 Aug 2024 05:46:18 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.105
X-Spam-Level:
X-Spam-Status: No, score=-7.105 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_FONT_LOW_CONTRAST=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=entrust.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id LovdGcBBxo_q for <tools-discuss@ietfa.amsl.com>; Fri, 30 Aug 2024 05:46:13 -0700 (PDT)
Received: from mx08-0015a003.pphosted.com (mx08-0015a003.pphosted.com [185.183.30.227]) by ietfa.amsl.com (Postfix) with ESMTP id 58F04C14F61C for <tools-discuss@ietf.org>; Fri, 30 Aug 2024 05:46:13 -0700 (PDT)
Received: from pps.filterd (m0242863.ppops.net [127.0.0.1]) by mx08-0015a003.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 47UC28qW022627; Fri, 30 Aug 2024 07:46:11 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=entrust.com; h= cc:content-type:date:from:in-reply-to:message-id:mime-version :references:subject:to; s=mail1; bh=t6l9ChYXxz5BGgunKGEu8FH4iJLN kCyELkPqifGYEn8=; b=i8L6TKRwlO7T/BhprasQCAoyDhzjOgHQWUs9k9z2h2Ad jZBYTYI15cQhH5f7IGaw+f7DUAoJmuVSlzI8jMIbm77j+zrwT3g/IqneqljPjUld USuvPJCAkGXxGnF+9Oh5Kf5LnUADs+PemlPrizLaBhXNm1g6I76L9Dfst3bUeZJr 5fdMSPkIINNcRvza12VEV0/0qksfaxnxpzkO5IP3i96VDViLdkdFqnUjSzq6wVyU J2ddhGBEj1DckYRvulGOZapUP+0DBQOeOarQ/JNoF6XWZooIGRktkZmnKQF06dne xgaAAv0ZxSGqhCq4Ebp/TPfCIRZXvMz1WrDSdIPY2A==
Received: from nam11-dm6-obe.outbound.protection.outlook.com (mail-dm6nam11lp2175.outbound.protection.outlook.com [104.47.57.175]) by mx08-0015a003.pphosted.com (PPS) with ESMTPS id 419puu5dex-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 30 Aug 2024 07:46:10 -0500 (CDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=gntuxapcIww7p3jdBfVh6YfVGCPzFv1l5D3B1VwHad8Cjc09sZ4MjiNV6om1XrPs2SsUuf31XuWzXMxtUyTy7rqVtmGgK/0X/DCeVz7cQspsAqoFs/xW/HDT46v13FUh0twVQeflL6AobVgug85vm/xuFSlSFBHRqNooPQKqObykGA8t/AfdzYGem1epzlHhBS6A/pguP9vaOrkx13W9WGKxOnSaOU611yyrPfdB3AxDESxWk76krPqeKP6o9AJfsfQuujy9LW5qdqDouMen7OQ7MvGgNK+SilhvMN8DwMgLD/kmovXejgNHZCBa+i3MgzSf/7lMBQ0Kc7IAxnhG0g==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=yzGj3qQ5TlmPm1ho1Hc2XfTxfY9yAY0lF+tu3v89fRE=; b=WwL4quDYki5Oi6RPQD/vXRBkuQp9053S1tTLXDocZ/VrcERfHxRSD3Os1fh5qzrzyzT7Fa+nXhV9qT4BwqxX6oWyItNQIRyQkzEhM3D6BNbTUVTY76xUNQ79FL1UftdvpqG7cI54oakWitncfiYDwHTsRjmCf7hCLfeMAD79ChyjKfTv7Ba8x3bH05mJk2oEdyluX/baJPFKnmEr9JL9Brtf4iSHjEys1J5avo/mRMss7aiSwq+4pacrSssvaLRQGRYq3bjgg3Dy1e5SbOGVKb+XQ3ts8tjrJq6roWf/uuESG4DkkKQLy/TI27Crjxuvcj3ayXLvgtJGSIohAsuJOA==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=entrust.com; dmarc=pass action=none header.from=entrust.com; dkim=pass header.d=entrust.com; arc=none
Received: from CH0PR11MB5739.namprd11.prod.outlook.com (2603:10b6:610:100::20) by CY5PR11MB6416.namprd11.prod.outlook.com (2603:10b6:930:34::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7918.20; Fri, 30 Aug 2024 12:46:06 +0000
Received: from CH0PR11MB5739.namprd11.prod.outlook.com ([fe80::b93d:b2d:3ad8:9702]) by CH0PR11MB5739.namprd11.prod.outlook.com ([fe80::b93d:b2d:3ad8:9702%4]) with mapi id 15.20.7918.019; Fri, 30 Aug 2024 12:46:06 +0000
From: Mike Ounsworth <Mike.Ounsworth@entrust.com>
To: Carsten Bormann <cabo@tzi.org>
Thread-Topic: [EXTERNAL] Re: [Tools-discuss] Why does kramdown convert to US-ACSII?
Thread-Index: Adr6VHLTh1tMyQwaRBWQK1oYx37rUAABC5qAACBu9WA=
Date: Fri, 30 Aug 2024 12:46:05 +0000
Message-ID: <CH0PR11MB57393D7724E67D8470A6450B9F972@CH0PR11MB5739.namprd11.prod.outlook.com>
References: <CH0PR11MB5739CD9E285FEEB41BAD9C5A9F962@CH0PR11MB5739.namprd11.prod.outlook.com> <593E12AC-FFE4-4F7C-B931-97CA829F1A8C@tzi.org>
In-Reply-To: <593E12AC-FFE4-4F7C-B931-97CA829F1A8C@tzi.org>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: yes
X-MS-TNEF-Correlator:
x-ms-publictraffictype: Email
x-ms-traffictypediagnostic: CH0PR11MB5739:EE_|CY5PR11MB6416:EE_
x-ms-office365-filtering-correlation-id: fab14659-9c8e-4b21-3705-08dcc8f1b6d9
x-ms-exchange-senderadcheck: 1
x-ms-exchange-antispam-relay: 0
x-microsoft-antispam: BCL:0;ARA:13230040|366016|376014|1800799024|38070700018;
x-microsoft-antispam-message-info: jU/RmkVA+gRGJmFS4g7S38xNFFkLiEo6wWA68qFO18Q7twneddGZZxtOTvj6TNovf6gb1Pk4/IwTaWdq3YntvOguqK9eJbaNkhHaMMHNx9YEW75YLzXUUSRBw97oJP1V9V3Lqkgc1aYAPiEZd2XlgJC0lnDA+prOe8h1f1H2ZN1h9clnfVlTEG8KUrF5vJY3JIwHnOe16bj6Z1CIaGuNNeXtZFUHf820BFiNziWLzmy27GvISFMm8iD+CoslHKkej8nvHdfKWNY1SOii8S9Fl7k9lnRFNAziOmQTxgodm43v3LwR7wBhoYPeU5RswN0d53ZuygJF/dmoD708Rn4+eT+U+VeneyeCLYBk3Fg9iIf9sW9BgJkoqFMTs9yzSVxZ9Gaaq5bo8GyOLMybke0JmuXiYaNdC/0mMSL6ih7DSJHZT03bLlihQjiEUBMSWXGH27RWyIz2o0ZPO5Rz0OzudUFeDxOFabeqKAeTLcZfIBx9hKR66o4nllH3R4EsjLUbL03b4DrNTTD6AEsy42O1RHyJQxw2kNHtv2YbRPWSWp0FFTLwUYyuCH5dPR2YCbt1qNT3zIPjYDBwKQCVB98SlMsxl0c6deGANOQxR8qeHYQQ32gZwtptvVU6jy1zBHphWeZQpIGlWYTEA4QCqyLWCLgxtyFUPdB6SbRdq2bW4uvuQLR1ZgJT0047euFgRvSpTAreOfHqXrhjZNzPaE1VRV5TJ+W/DlEPVx0KTL/1tS5uqbZesEMccFgq2B7nucwX2+sCnDCeRLUF2cPErUfq3RZXyaf4gJYavuGNeiSNHOVNdB4lLnyGqE221FL24xCRV+0urmhmSnw0vQvTcXVbP8bSgMQlFyW7j/HNW6IEvF+SfcE3WZsp0fsRJBT4r8PjCfYO9tXRyqH6qqyo6O0O1+mkzsTAeE/CW1yndVldsffQZawewWOrd/7I3HptZtcaTX7Bzj/eosw/Qt+b7BWSxbh1nTqGnCc0LZ+kofESBy6nm1QV8Fqk0BgQQdxTeQWsj5ayQVXBiprV1aI6iGD3PyYrdNEjiTnp2yC/AhXrSbMzMaRZKvbTmRWTHOEIkQkk7uTr9+GfUgVpOLdxRHCHDGnF8yY6ik2Q+63e/XtiwyKEOzHXFaOAiL7pC37v6mLMsCe/4FlQR8ZgpB5wt0VT8XUs6o49GhR84fa3j+FkSWGf2DaW7FjeGWWBqb39oxOnA7UZRNgYJiOCb9NhwqGmLvGArj0HetBDFVH/0btB3HGImu5cxXttTwi1sMxe5M6Yxp4Iczcp+i+StA8TYHS86kyNcqd7b44jt9G740kluUkn/I2rqw5BwiE7w1e3WCJMN1DHmh5eUxyk1JtFDW44fnnDucDCUXzPLMNH+sCKhblc+ZBVddL71brBwNaaCw7WMiIeS/K1OrsRaev2ojFqgA==
x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CH0PR11MB5739.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(366016)(376014)(1800799024)(38070700018);DIR:OUT;SFP:1102;
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: y7JZufrJoMkxKkbfKdqLCxITtHkBBr581f8K8za6pdq2AOFQvseafbvgxHRsb2OwjDHLJQPbkDLULqIc5GFdAFfMi5r3koO5Hf7S2hhM9IcKC/TGMKCNbjw3H8vzzEIZQA0YcAdCN0pmkwJ2aJ4Lg1A6Y1kuXq5wccBbOBM8aTO5OXD0yUBKVkqC2wYeHbX/hxNn8hYd3GrkuxZ4qb6/V6v3i/nFCNsPCoF/9Z1RebBFmkO2fkQeFBSbJ/iApPdtuxOygklmPHTOj69lVjZUwfK7I+O4BAJ8mWjEIcgmxH9P0mJ1GzSW21TpQa2GMv6dfdKNHi3KrwOdjwh2U5hOYAud91RYGn8z3bLeG78OpndnZTGzZjEUc6SbIl7SAm+wU2JvGeoj/6NM08umDwZ6pvSF9j/l1URB3gPfSiHe84VcHF8naLLEygMg5m9L8gjN2dBX15cpP+4oQObU8E+MaAd9vTgyAvnhLdCiC1nKIv+kHtZv1lli4MIeI5fWyh/jd3XYTDTAGt59GZVtSsabK0Hg+FXfuKthQFth6UoCw7Xyce6DvZ8imSgaWjo4ZHERayX4k+Ui1ebyMZc4wJahmWI8Cr54lxjHz2HOegpVobnaTulxZffdDX07ZvOhbpYPiC+Ew1jcj0i/OiU7k3n7r1EZ575rpw6VNft+8YDHrnDSZR5H9/6wuW+ogOMsRYucNfvKze91Kc3uKaaIpo2n1R62pbsovfeDVIPpxSZkRB8mHUt0Pw6xVnClvq0J5CbiuI4D2xiygtziY05e0f7TaQR7ZMnbqxbNSZEiBsUDb5bFEhR1SioTSQCFzNR2jeZ69OtR9CMuyrcuUIPIeZlHcS+MUmQQez2kENKabkJWSdqeOsjytJlrigf5cN9Zw2BL+dVksVz4jb+5bTi+w5OAodssOHBSZmHf91OhSZS292aqfzZ07oc8OjSgVi3qoTyyFT0TciukpUSAfjkL6lV4NMvZa6npiEh35XkAI6tBFjgFcMYrmoJxnfYhES70P9KyTIpSm5CHsWtlusCXTR3FCoTlEJl2sIgDVp010mmFRPjLbyGWTUjhDmStxf8XBFqdCU6jancps4GzRwwtncKQrbAxte5iQDlzKfYAuqQo/ViF8OLYgpzhBdHp0w3jyxwtdr2vmutO68/tppXlYb4WntdXRWJJ8un1g4GHTwJBT3C2NQJBUUh+6q/iAs5ARwaUJnG6dEeDXzPRN4qItp+hMJJYRt5drirLMarYM3x4mvaMGTBFnw9eike6tIxf8/nQ8TEoUWqKRcYXGyVh5L9o1572Sk1QaATpnwkqzgDdVt9SUxxdg138EDLhuH+Vw9w85T8tAw8HaavOD3SAF1Gc3zUuokIkSoiJx+e50NbqZ9W71mzWBJgGG88ejzkASVNCaF+vx1+V0a0vZe2PSjtKGV+K6R6I3RvlsQL5fxjoRzsJJvcgls6iWnMjrn21IhWAXA/TvBBohRdEIhx3k6wfmmj/ddFG9i4IFVpkoeKs0hlBiMbardfszJM1U/vapieFgZ8MzOkskcp2Z066n5y6cCfq+Z44p6fTeZ6NCfLsSSS3EOKK8P21Arxfu10UXU5b
Content-Type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg="2.16.840.1.101.3.4.2.1"; boundary="----=_NextPart_000_013F_01DAFAB0.AA859440"
MIME-Version: 1.0
X-OriginatorOrg: entrust.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: CH0PR11MB5739.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: fab14659-9c8e-4b21-3705-08dcc8f1b6d9
X-MS-Exchange-CrossTenant-originalarrivaltime: 30 Aug 2024 12:46:05.9818 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: f46cf439-27ef-4acf-a800-15072bb7ddc1
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: UDRPVd4sExQi+mm0f0/g08Zo+RBYE4f+NaYxjn9pCpyV22RxEQzaPu2c5ViZD921VVhoIrM1n1GBd/YScEIy9nD4QLM5hs4SN3lWxWJkaHc=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY5PR11MB6416
X-Proofpoint-GUID: 3BK5o9J9WukZSR6n_u4_dVoJ-v_xue5X
X-Proofpoint-ORIG-GUID: 3BK5o9J9WukZSR6n_u4_dVoJ-v_xue5X
X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1039,Hydra:6.0.680,FMLib:17.12.28.16 definitions=2024-08-30_07,2024-08-30_01,2024-05-17_01
X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 lowpriorityscore=0 priorityscore=1501 suspectscore=0 mlxlogscore=999 clxscore=1011 malwarescore=0 phishscore=0 bulkscore=0 mlxscore=0 impostorscore=0 spamscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.21.0-2407110000 definitions=main-2408300097
Message-ID-Hash: Z2AIH6NXTC6CJ2QJVVKSOFUXMVFKTKVK
X-Message-ID-Hash: Z2AIH6NXTC6CJ2QJVVKSOFUXMVFKTKVK
X-MailFrom: Mike.Ounsworth@entrust.com
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-tools-discuss.ietf.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
CC: "tools-discuss@ietf.org" <tools-discuss@ietf.org>, John Gray <John.Gray@entrust.com>, Felipe Ventura <Felipe.Ventura@entrust.com>
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [Tools-discuss] Re: [EXTERNAL] Re: Why does kramdown convert to US-ACSII?
List-Id: IETF Tools Discussion <tools-discuss.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/tools-discuss/YujpjcSQmWcIbVj5N9ARkF6H494>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tools-discuss>
List-Help: <mailto:tools-discuss-request@ietf.org?subject=help>
List-Owner: <mailto:tools-discuss-owner@ietf.org>
List-Post: <mailto:tools-discuss@ietf.org>
List-Subscribe: <mailto:tools-discuss-join@ietf.org>
List-Unsubscribe: <mailto:tools-discuss-leave@ietf.org>

Thank you so much Carsten.

 

Indeed, my document had the header:

 

coding: us-ascii

 

changing that to 

 

coding: utf-8

 

was what I needed. I feel dumb now. Thank you again.

 

 

---

Mike Ounsworth

 

From: Carsten Bormann <cabo@tzi.org> 
Sent: Thursday, August 29, 2024 4:16 PM
To: Mike Ounsworth <Mike.Ounsworth@entrust.com>
Cc: tools-discuss@ietf.org; John Gray <John.Gray@entrust.com>; Felipe Ventura <Felipe.Ventura@entrust.com>
Subject: [EXTERNAL] Re: [Tools-discuss] Why does kramdown convert to US-ACSII?

 

On 29. Aug 2024, at 22: 51, Mike Ounsworth <Mike. Ounsworth=40entrust. com@ dmarc. ietf. org> wrote: > > Hi tools team! Hi Mike! > Do you folks own the kramdown-rfc2629 tool? It’s open source, so we all own it. > Starting today,



On 29. Aug 2024, at 22:51, Mike Ounsworth < <mailto:Mike.Ounsworth=40entrust.com@dmarc.ietf.org> Mike.Ounsworth=40entrust.com@dmarc.ietf.org> wrote:
> 
> Hi tools team!
 
Hi Mike!
 
>  Do you folks own the kramdown-rfc2629 tool?
 
It’s open source, so we all own it.
 
> Starting today, I see this error when building my I-D from markdown:
>  /var/lib/gems/3.0.0/gems/kramdown-rfc2629-1.7.5/lib/kramdown-rfc/command.rb:603:in `encode': U+9673 from UTF-8 to US-ASCII (Encoding::UndefinedConversionError)
 
1.7.5 was January 10, 2024 (and Ruby 3.0 was 2020), but that is probably not the reason.
 
>  The line that it is complaining about is:
>  陳志華 (Abel C. H. Chen, Chunghwa Telecom)
>  So my question is: why is Kramdown forcing the document to US-ASCII?
 
Probably because you told it to do that.
 
You didn’t divulge the markdown source, did you?
But I bet the YAML header has a line that looks approximately like:
 
coding: ascii
 
If that is not it, please do send me the source.
 
> Am I not allowed to list authors with their Chinese names?
 
For a few years now already, you are, and if things are getting in the way, they are a bug.
(E.g, if you have problems with Han unification/traditional vs. simplified, I’d like to learn about those.)
 
(By the way, if you want to dig deeper into RFCs written in markdown, we have a mailing list called  <mailto:rfc-markdown@ietf.org> rfc-markdown@ietf.org < <mailto:rfc-markdown@ietf.org> mailto:rfc-markdown@ietf.org> — small and low-traffic.  Here is the archive:  <https://urldefense.com/v3/__https:/mailarchive.ietf.org/arch/browse/rfc-markdown/__;!!FJ-Y8qCqXTj2!csKT7UTP_FuMn35HOKw-hLyX3zKRkk1efbP4Z1csCX2kkOLFcUgo7D0OVfSPcvEiY_xjsDndyds5lBg$> https://urldefense.com/v3/__https://mailarchive.ietf.org/arch/browse/rfc-markdown/__;!!FJ-Y8qCqXTj2!csKT7UTP_FuMn35HOKw-hLyX3zKRkk1efbP4Z1csCX2kkOLFcUgo7D0OVfSPcvEiY_xjsDndyds5lBg$ .)
 
Grüße, Carsten

v2.28.0 | Report a Bug | By Email | System Status