Re: draft-klensin-net-utf8-06

["Frank Ellermann" <[e-mail]>]

John C Klensin wrote:

> less ready than the unicode-escapes one, partially because of
> the addition of a lot of new or revised text, but I hope we 
> are converging

Looking only at the diff, yes.  You've added a recommendation
to avoid private use code points, because they "do not have
standard definitions or normalization interpretations".

I think the latter is incorrect, they're by decree normalized.
Maybe what you want to say is that they can't have canonical
or compatible decompositions.  IMO the obvious "no standard
definition" alone is clearer and good enough to justify your
recommendation.

Not directly related to our draft, in 5.2 you write:
| The latter is important because an unassigned code point 
| always normalizes to itself.

Something's really odd with this in the Unicode standard:

For some unassigned code points it's "almost obvious" that
they'll never end up in any NFX, unless they also get the
non-character property.  What I have in mind are "obvious
gaps" in dingbats, mathematical symbols, and other blocks,
where the abstract character corresponding to the given
unassigned code point was already encoded elsewhere.  

One of the earlier examples is u+2073.  In theory they
could say "whatever we'll do with that code point, it
will be either a non-character, or have a canonical
decomposition, or stay as is (unassigned) forever".

Back to the draft, s/have been be tied/have been tied/
in 5.2. 
  
> I've added some words about both HT and FF.  One may need to
> look in the appendices to find all of them.

Fine now.  Over the weekend I read a related chapter
in the Unicode standard, and I think you have to 
mention LS u+2028 and maybe also PS u+2029 somewhere.

Admittedly banning LS might upset some folks.  IMO it's
similar to the NEL case, LS might be even more obscure.

OTOH I think that you shouldn't discuss IND u+0084,
it's dead.  TUS 5.0 says "formerly known as INDEX".

 Frank