Re: [MORG] Review of draft-ietf-morg-fuzzy-search-02.txt

[Alexey Melnikov <[e-mail]>]

Timo Sirainen wrote:

>On Tue, 2010-08-24 at 10:51 +0100, Alexey Melnikov wrote:
>  
>
>>>>Invalid input may also be problematic. For example if the search engine
>>>>takes UTF-8 stream as input, it might fail more or less badly when
>>>>illegal UTF-8 sequences are fed to it from a message whose character set
>>>>was claimed to be UTF-8. This could be avoided by validating all the
>>>>input and replacing illegal UTF-8 sequences with the Unicode replacement
>>>>character (U+FFFD).
>>>>
>>>>        
>>>>
>>I am too. I am not convinced that mentioning Unicode replacement 
>>character (U+FFFD) is necessary, but I suppose it is Ok.
>>    
>>
>So just "This could be avoided by validating all the input."
>
Yes. Or alternatively something like:

This could be avoided by validating all the
input and, for example, replacing illegal UTF-8 sequences with the Unicode replacement
character (U+FFFD).

I.e. I want to be clear thar replacing with U+FFFD is not the only 
solution.

>would be better? Or just remove the whole sentence.
>  
>