Re: [OAUTH-WG] application/x-www-form-urlencoded vs JSON

Eran Hammer-Lahav <eran@hueniverse.com> Tue, 20 April 2010 21:32 UTC

Return-Path: <eran@hueniverse.com>
X-Original-To: oauth@core3.amsl.com
Delivered-To: oauth@core3.amsl.com
Received: from localhost (localhost [127.0.0.1]) by core3.amsl.com (Postfix) with ESMTP id 7E0B33A6977 for <oauth@core3.amsl.com>; Tue, 20 Apr 2010 14:32:13 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.477
X-Spam-Level:
X-Spam-Status: No, score=-2.477 tagged_above=-999 required=5 tests=[AWL=0.121, BAYES_00=-2.599, HTML_MESSAGE=0.001]
Received: from mail.ietf.org ([64.170.98.32]) by localhost (core3.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id R+Cgl6OvAamB for <oauth@core3.amsl.com>; Tue, 20 Apr 2010 14:32:11 -0700 (PDT)
Received: from p3plex1out02.prod.phx3.secureserver.net (p3plex1out02.prod.phx3.secureserver.net [72.167.180.18]) by core3.amsl.com (Postfix) with SMTP id BE5213A689B for <oauth@ietf.org>; Tue, 20 Apr 2010 14:31:47 -0700 (PDT)
Received: (qmail 4986 invoked from network); 20 Apr 2010 21:31:38 -0000
Received: from unknown (HELO smtp.ex1.secureserver.net) (72.167.180.19) by p3plex1out02.prod.phx3.secureserver.net with SMTP; 20 Apr 2010 21:31:38 -0000
Received: from P3PW5EX1MB01.EX1.SECURESERVER.NET ([10.6.135.20]) by P3PW5EX1HT001.EX1.SECURESERVER.NET ([72.167.180.19]) with mapi; Tue, 20 Apr 2010 14:31:38 -0700
From: Eran Hammer-Lahav <eran@hueniverse.com>
To: "jsmarr@stanfordalumni.org" <jsmarr@stanfordalumni.org>
Date: Tue, 20 Apr 2010 14:31:26 -0700
Thread-Topic: [OAUTH-WG] application/x-www-form-urlencoded vs JSON
Thread-Index: Acrg0NuNNWRZGnXGQgmBDzZbSI5UKQ==
Message-ID: <9FB1C9A1-6E27-45B8-AFD5-649AD8591AFF@hueniverse.com>
References: <9890332F-E759-4E63-96FE-DB3071194D84@gmail.com> <90C41DD21FB7C64BB94121FBBC2E723438E30A379B@P3PW5EX1MB01.EX1.SECURESERVER.NET> <20100419134825.134951nuzvi35hk4@webmail.df.eu> <90C41DD21FB7C64BB94121FBBC2E723438E5C7F45E@P3PW5EX1MB01.EX1.SECURESERVER.NET> <t2wc334d54e1004200924ja0e7786u9b349a1931098f2a@mail.gmail.com> <l2ofd6741651004201245gdfc6e2a3j10a6e8a3e59f2072@mail.gmail.com> <1271793363.20679.6.camel@Dynamo> <j2wc334d54e1004201417s1bbcc025r76fdb607295f384c@mail.gmail.com>
In-Reply-To: <j2wc334d54e1004201417s1bbcc025r76fdb607295f384c@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: multipart/alternative; boundary="_000_9FB1C9A16E2745B8AFD5649AD8591AFFhueniversecom_"
MIME-Version: 1.0
Cc: OAuth WG <oauth@ietf.org>
Subject: Re: [OAUTH-WG] application/x-www-form-urlencoded vs JSON
X-BeenThere: oauth@ietf.org
X-Mailman-Version: 2.1.9
Precedence: list
List-Id: OAUTH WG <oauth.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/listinfo/oauth>, <mailto:oauth-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/oauth>
List-Post: <mailto:oauth@ietf.org>
List-Help: <mailto:oauth-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/oauth>, <mailto:oauth-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 20 Apr 2010 21:32:13 -0000

All the issues around encoding in 1.0 were about signatures. This is no longer an issue.

EHL

On Apr 20, 2010, at 14:19, "Joseph Smarr" <jsmarr@gmail.com<mailto:jsmarr@gmail.com>> wrote:

On the one hand, I'm sympathetic to the "easy to write a parser yourself" argument for url-encoding, since in general I think you want to minimize any toolchain/library requirements to maximize adoption. On the other hand, I'd argue that OAuth 1.0 has shows url-encoding to be "deceptively easy" to implement yourself, plus there are *fewer* easy/good parsing libraries available, and that leads more developers to try and hand-code parsers that actually contain bugs.

Now David, I'm sure your implementation has no bugs, but lots of "official OAuth libraries" did have bugs in their parsers, whereas JSON does have widely available, high-quality support, and it's just complex enough that you're not tempted to try and write a (buggy) version yourself, yet not so painful that it would be unthinkable to do so (compared to, say, a compliant XML parser).

Thanks, js

On Tue, Apr 20, 2010 at 12:56 PM, Paul C. Bryan <<mailto:email@pbryan.net>email@pbryan.net<mailto:email@pbryan.net>> wrote:
I'm struggling to imagine hardware that on the one hand would support
OAuth, but on the other would be incapable of supporting JSON...

-----Original Message-----
From: David Recordon <<mailto:recordond@gmail.com>recordond@gmail.com<mailto:recordond@gmail.com>>
To: <mailto:jsmarr@stanfordalumni.org> jsmarr@stanfordalumni.org<mailto:jsmarr@stanfordalumni.org>
Cc: OAuth WG <<mailto:oauth@ietf.org>oauth@ietf.org<mailto:oauth@ietf.org>>
Subject: Re: [OAUTH-WG] application/x-www-form-urlencoded vs JSON
Date: Tue, 20 Apr 2010 12:45:05 -0700

Having written an implementation last night against the web server
flow, I'm worried about adding JSON as a requirement for the response.
While it might be easier for environments with JSON libraries, it's
drastically more complex for environments (like embedded hardware)
which doesn't support JSON. And writing basic form encoded parsing
code really isn't that hard – especially if I can do it!


On Tue, Apr 20, 2010 at 9:24 AM, Joseph Smarr <<mailto:jsmarr@gmail.com>jsmarr@gmail.com<mailto:jsmarr@gmail.com>> wrote:
> +1 to including JSON format, and perhaps making it the required format. In
> my experience helping numerous developers debug their OAuth implementations,
> url-encoding/decoding was often a source of bugs, since a) the libraries are
> usually hand-built, b) url-encoding is known to be funky/inconsistent wrt +
> vs. %20 and other such things, and c) it's very sensitive to things like a
> trailing newline at the end of the response, which can easily be tokenized
> as part of the the last value (since the normal implementations just split
> on & and =). In contrast, I've never heard of any problems parsing JSON, nor
> any encoding/decoding bugs related to working with JSON in other APIs
> (something I *cannot* say about XML, which is way more finicky about
> requiring its values to be properly encoded or escaped in CDATA etc.; I've
> also seen way more inconsistency in support of XML parsers and their output
> formats, whereas JSON always works exactly the same way and always "just
> works").
> So in conclusion, url-encoding has caused a lot of pain in OAuth 1.0, and
> JSON is already widely supported (presumably including by most APIs that
> you're building OAuth support to be able to access!), so I think it would
> simplify the spec and increase ease/success of development to use JSON as a
> request format. In fact, I think I'd like to push for it to be the
> default/required format, given the positive attributes above. Does anyone
> object, and if so, why?
> Thanks, js
>
> On Tue, Apr 20, 2010 at 8:10 AM, Eran Hammer-Lahav <<mailto:eran@hueniverse.com>eran@hueniverse.com<mailto:eran@hueniverse.com>>
> wrote:
>>
>> There seems to be support for this idea with some concerns about
>> complexity. Someone needs to propose text for this including defining the
>> request parameter and schema of the various reply formats.
>>
>> EHL
>>
>> > -----Original Message-----
>> > From: Torsten Lodderstedt [mailto:<mailto:torsten@lodderstedt.net>torsten@lodderstedt.net<mailto:torsten@lodderstedt.net>]
>> > Sent: Monday, April 19, 2010 4:48 AM
>> > To: Eran Hammer-Lahav
>> > Cc: Dick Hardt; OAuth WG
>> > Subject: Re: [OAUTH-WG] application/x-www-form-urlencoded vs JSON
>> >
>> >
>> > > We can also offer both and define a client request parameter (as long
>> > > as the server is required to make at least one format available).
>> >
>> > +1 on this
>> >
>> > regards,
>> > Torsten.
>> >
>> > >
>> > > EHL
>> > >
>> > >> -----Original Message-----
>> > >> From: <mailto:oauth-bounces@ietf.org> oauth-bounces@ietf.org<mailto:oauth-bounces@ietf.org> [mailto:<mailto:oauth-bounces@ietf.org>oauth-bounces@ietf.org<mailto:oauth-bounces@ietf.org>] On
>> > >> Behalf Of Dick Hardt
>> > >> Sent: Sunday, April 18, 2010 9:30 PM
>> > >> To: OAuth WG
>> > >> Subject: [OAUTH-WG] application/x-www-form-urlencoded vs JSON
>> > >>
>> > >> The AS token endpoint response is encoded as application/x-www-form-
>> > >> urlencoded
>> > >>
>> > >> While this reuses a well known and understood encoding standard, it
>> > >> is uncommon for a client to receive a message encoded like this. Most
>> > >> server responses are encoded as XML or JSON. Libraries are NOT
>> > >> reedily available to parse application/x-www-form-urlencoded results
>> > >> as this is something that is typically done in the web servers
>> > >> framework. While parsing the name value pairs and URL un-encoding
>> > >> them is not hard, many developers have been caught just splitting the
>> > parameters and forgetting to URL decode the token.
>> > >> Since the token is opaque and may contain characters that are
>> > >> escaped, it is a difficult bug to detect.
>> > >>
>> > >> Potential options:
>> > >>
>> > >> 1) Do nothing, developers should read the specs and do the right
>> > >> thing.
>> > >>
>> > >> 2) Require that all parameters are URL safe so that there is no
>> > >> encoding issue.
>> > >>
>> > >> 3) Return results as JSON, and recommend that parameters be URL safe.
>> > >>
>> > >> -- Dick
>> > >> _______________________________________________
>> > >> OAuth mailing list
>> > >> <mailto:OAuth@ietf.org> OAuth@ietf.org<mailto:OAuth@ietf.org>
>> > >> <https://www.ietf.org/mailman/listinfo/oauth> https://www.ietf.org/mailman/listinfo/oauth
>> > > _______________________________________________
>> > > OAuth mailing list
>> > > <mailto:OAuth@ietf.org> OAuth@ietf.org<mailto:OAuth@ietf.org>
>> > > <https://www.ietf.org/mailman/listinfo/oauth> https://www.ietf.org/mailman/listinfo/oauth
>> > >
>> >
>> >
>> >
>>
>> _______________________________________________
>> OAuth mailing list
>> <mailto:OAuth@ietf.org> OAuth@ietf.org<mailto:OAuth@ietf.org>
>> <https://www.ietf.org/mailman/listinfo/oauth> https://www.ietf.org/mailman/listinfo/oauth
>
>
> _______________________________________________
> OAuth mailing list
> <mailto:OAuth@ietf.org> OAuth@ietf.org<mailto:OAuth@ietf.org>
> <https://www.ietf.org/mailman/listinfo/oauth> https://www.ietf.org/mailman/listinfo/oauth
>
>
_______________________________________________
OAuth mailing list
<mailto:OAuth@ietf.org>OAuth@ietf.org<mailto:OAuth@ietf.org>
<https://www.ietf.org/mailman/listinfo/oauth>https://www.ietf.org/mailman/listinfo/oauth






<ATT00001..txt>