Re: [scim] Does SCIM 2.0 have a compliance test suite?

Samuel Erdtman <samuel@erdtman.se> Fri, 29 September 2017 08:56 UTC

Return-Path: <samuel@erdtman.se>
X-Original-To: scim@ietfa.amsl.com
Delivered-To: scim@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 19DAF13213D for <scim@ietfa.amsl.com>; Fri, 29 Sep 2017 01:56:19 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.899
X-Spam-Level:
X-Spam-Status: No, score=-1.899 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=erdtman-se.20150623.gappssmtp.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 7lBLyUDLjTBR for <scim@ietfa.amsl.com>; Fri, 29 Sep 2017 01:56:16 -0700 (PDT)
Received: from mail-pf0-x230.google.com (mail-pf0-x230.google.com [IPv6:2607:f8b0:400e:c00::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 7159B132031 for <scim@ietf.org>; Fri, 29 Sep 2017 01:56:16 -0700 (PDT)
Received: by mail-pf0-x230.google.com with SMTP id u12so433103pfl.4 for <scim@ietf.org>; Fri, 29 Sep 2017 01:56:16 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=erdtman-se.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=oMFOeMPAD2ttWI0P3NgnmqDOQrb/vL6CZ0EIeeyqfkY=; b=uKxl+uPJXBjheIS1mY8+MSWbm4bfNck+uibZH+PkSaAoewFNlPicq8qDKFFc3sqlVJ ZHJNZSB/a3fxv4tyeu68+yVJoOz19HczzveipGq14ffoD7lJkYMXKfjO0+neZzbPAUFS A47LZwVv4em05DSGmDTKtJ1MwbCpFLYG856oBue08Fx/F0wQA5SwwoVB2kEdlymV+WLG H1NWPvM6+hzszPCyk0tHh00cte03JgMd10CVvcvWXNmjLlmf+akAS2CSSQIybMed2rg3 eCZWzk4GSkQdcOO37/f/V/4ApDcpcwmzckGm34EJH0VlCsHo6ytDAdq/TDi+qy6eCDl/ dHKg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=oMFOeMPAD2ttWI0P3NgnmqDOQrb/vL6CZ0EIeeyqfkY=; b=V4DXH/d1jEfZ+KboT4ZgAETIKLobq6EIW2ZA8xh28EsoZn+zQsUv50GoKDYUCmGeYL tKkcXixaEPtRvVUSaSgcmtcLD59uupr9x3xl9VZBOxIrBtS9V+SLDbL+i637Lv9UJAW8 0bpx63tlBldLdCnInQ9NChh5IdF7KEqWSkiQR2QIFw25YgRoR+pzIILRTKqHy6RrcC8i 1V8sM+KAp3UH1E8UxXxI6qQ5CA1feIqEGapDW36O924BUjhvvF7bsSk3c+/4xZzYMAyF rdSEQUKlY49bXylNhAu+e548whFbcbtu2W3pQ6WklkoL5kcv4q5EPG6wadJ1N8BOMin9 VlvA==
X-Gm-Message-State: AHPjjUgdAoGbckUV+ncFqAqAglowXYSjxWJIgt6Z/1Kz+PmBrkvNgRRv LfUyU59EjAh2/F18mLX23QojXkdIl6OsWwgMGcRxAA==
X-Google-Smtp-Source: AOwi7QB1mvKEqGttM6IIFJyXnxTpGyZ8O1vZDH/A/ragf4gyYOZu6rlcMX4Bj3mEV+uUDh+4pUi8zFOdcR3ALKR6u6A=
X-Received: by 10.101.83.72 with SMTP id w8mr6592661pgr.226.1506675375931; Fri, 29 Sep 2017 01:56:15 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.100.143.170 with HTTP; Fri, 29 Sep 2017 01:56:15 -0700 (PDT)
In-Reply-To: <CAN2oXrC7Np9OssJ_d+TJHjjbTtvk8H4Qtn+2e9TbpwcjQu2EUQ@mail.gmail.com>
References: <CAN2oXrCHc3OFoUWf+TUSZTO+OAU2iLmZ+MfRMbgT0uRyzFFuHQ@mail.gmail.com> <CAF2hCbZ-6vtKELAdgeaeg-iyEpHb-ZS0PQshNg0VuxUa1We7hA@mail.gmail.com> <CAN2oXrCaqddXkvgePM4r9yHh6roW8opYsx1=qM0-wE2jMP_ZDQ@mail.gmail.com> <C24AF6E0-C290-437C-B5E8-DCB0A827CCEF@oracle.com> <CAN2oXrBYqmOsd6dGGzH60kcYZ6zVxJWLpFUgs4scw48ym0P-dQ@mail.gmail.com> <CAN2oXrC7Np9OssJ_d+TJHjjbTtvk8H4Qtn+2e9TbpwcjQu2EUQ@mail.gmail.com>
From: Samuel Erdtman <samuel@erdtman.se>
Date: Fri, 29 Sep 2017 10:56:15 +0200
Message-ID: <CAF2hCbZ+vEE=AesCF95CpTNsUJVdCJMq7tdgnGz=rvMqtzO9HA@mail.gmail.com>
To: Darshana Gunawardana <darshanasbg@gmail.com>
Cc: Phil Hunt <phil.hunt@oracle.com>, vindula.13@cse.mrt.ac.lk, "scim@ietf.org" <scim@ietf.org>, Omindu Rathnaweera <omindu.dishan@gmail.com>
Content-Type: multipart/alternative; boundary="089e0826dfdc93156f055a5032b6"
Archived-At: <https://mailarchive.ietf.org/arch/msg/scim/UMWGuwfk3cpfcUuGdvFc7BbvNj0>
Subject: Re: [scim] Does SCIM 2.0 have a compliance test suite?
X-BeenThere: scim@ietf.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Simple Cloud Identity Management BOF <scim.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/scim>, <mailto:scim-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/scim/>
List-Post: <mailto:scim@ietf.org>
List-Help: <mailto:scim-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/scim>, <mailto:scim-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 29 Sep 2017 08:56:19 -0000

Hi,

I have had an initial look at the project.

Correct me if I´m wrong but it is a copy of the simplecloud.info repo with
the compliance 2.0 added in parallel. a fork would have been even easier
but I think this could work too.

Have you tried to run the project in heroku? does all the dependencies etc.
work in that environment?

I tried to test the hosted demo but got a 404
https://compliance-scim2.wso2apps.com/scimproxycompliance/

The path forward that I would prefer would be to get an initial PR to
simplecloud.info repo (https://github.com/erdtman/simplecloud.info/) with
the added code (preferable not to master).

Not necessarily making it visible, I can do that once I have merged the PR.

Best regards
//Samuel






On Tue, Sep 12, 2017 at 4:32 AM, Darshana Gunawardana <darshanasbg@gmail.com
> wrote:

> Hi all,
>
> Giving you an update about on the topic.
>
> We were able to get a GSoC project slot for the above proposal and the
> elected student -Vindula who cc'ed here- was able to come up with a
> promising implementation on the project.
>
>    - GSoC Project URL: https://summerofcode.withgoogle.com/projects/#
>    6261985816608768
>    - VIndula's blog on the project: https://medium.com/@
>    vindulajayawardana/scim-2-0-compliance-test-suite-737fd4ace3cc
>    <https://medium.com/@vindulajayawardana/scim-2-0-compliance-test-suite-737fd4ace3cc>
>    - Source Repo: https://github.com/wso2-incubator/scim2-compliance-
>    test-suite
>    - Hosted Demo: https://compliance-scim2.wso2apps.com/
>    scimproxycompliance/
>
> With the increasing adoption of the SCIM 2.0, this test suite will be a
> strong initial step to validate interoperability, yet i'm sure there is
> much room to improve. So,
> > Try the hosted demo
> > If you see have any suggestion to improve, open a git issue on the source
> repo <https://github.com/wso2-incubator/scim2-compliance-test-suite>
> > If you know the fix, send a PR..
>
> Any kind of feedback would be highly appreciated.
>
> Thanks,
>
>
> On Fri, Mar 17, 2017 at 12:19 AM, Darshana Gunawardana <
> darshanasbg@gmail.com> wrote:
>
>> Hi folks,
>>
>> Thanks all for your responses.
>>
>> On Wed, Mar 1, 2017 at 1:05 AM, Phil Hunt <phil.hunt@oracle.com> wrote:
>>
>>> There has been discussion about having OpenID Foundation host some
>>> tests. However, so far, nobody has volunteered to write the tests or fund
>>> their support.  If we can generate interest, maybe we can make it happen.
>>>
>>
>> A few of us at WSO2 thought about a suitable way to generate interest on
>> this.
>>
>> WSO2 has been a mentor organization for GSoC for the last three years and
>> also accepted for the same on this year as well. So we have come up with a
>> GSoC project proposal on the topic "SCIM 2.0 compliance test suite". You
>> can find more details of the project proposal on the below link.
>>
>> https://docs.wso2.com/display/GSoC/Project+Proposals+for+201
>> 7#ProjectProposalsfor2017-Proposal21:[IS]SCIM2.0compliancetestsuite
>>
>> Any suggestions on the project proposal are highly appreciated.
>>
>> The good news is, we already have one interested applicant on this
>> project!!!
>>
>> Hopefully we will have more applicants.. and a decent student proposal to
>> proceed with..
>>
>> Thanks,
>> Darshana
>>
>>
>>>
>>> Note: The IETF does not seem to handle inter-op test suites and
>>> certifications.  At least not in my experience.
>>>
>>> Phil
>>>
>>> Oracle Corporation, Identity Cloud Services & Identity Standards
>>> @independentid
>>> www.independentid.com
>>> phil.hunt@oracle.com
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Feb 7, 2017, at 12:15 AM, Darshana Gunawardana <darshanasbg@gmail.com>
>>> wrote:
>>>
>>> Hi Samuel,
>>>
>>> Thanks for the response..!
>>>
>>> My colleges from WSO2 are in the process of implementing SCIM 2.0 server
>>> and currently people working on improving the test coverage on that.
>>>
>>> If there is no work done on this, we can check on creating common SCIM
>>> 2.0 suite and contributing back to the community. Wanted to check whether
>>> it would be useful to implement common SCIM 2.0 suite thing.
>>>
>>> If this is something useful to have, we can check on possible ways of
>>> getting interested persons...
>>>
>>> And can I know references on the implementations on the test suite done
>>> on SCIM 1.1? So I can get an idea on the current design and effort needed
>>> to implement in that way.
>>>
>>> Thanks,
>>> Darshana
>>>
>>> On Tue, Feb 7, 2017 at 1:06 PM, Samuel Erdtman <samuel@erdtman.se> wr
>>> ote:
>>>
>>>> There is currently no such tool as far as I know.
>>>>
>>>> That it says ongoing is a bit too optimistic, there is no ongoing work
>>>> as far as I know.
>>>>
>>>> You are not the only one asking for this so maybe a few persons could
>>>> do some cooperation and create something.
>>>>
>>>>
>>>> On Tue, 7 Feb 2017 at 07:37, Darshana Gunawardana <
>>>> darshanasbg@gmail.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> Is there a test tool that can used to check compliance with the SCIM
>>>>> 2.0 specification?
>>>>>
>>>>> The site [1] specifies that there is an ongoing effort. Is this an
>>>>> open source effort where someone interested can try prototype versions and
>>>>> contribute for the development?
>>>>>
>>>>> [1] http://www.simplecloud.info/
>>>>> [2] "Work on SCIM 2.0 tests is under development and there are
>>>>> currently no support for the enterprise extension"
>>>>>
>>>>> Thanks,
>>>>> --
>>>>> With Regards,
>>>>>
>>>>> Darshana Gunawardana,
>>>>> Alumni : Dept. of Computer Science & Engineering,
>>>>> University of Moratuwa,
>>>>> Sri Lanka
>>>>> _______________________________________________
>>>>> scim mailing list
>>>>> scim@ietf.org
>>>>> https://www.ietf.org/mailman/listinfo/scim
>>>>>
>>>>
>>>
>>>
>>> --
>>> With Regards,
>>>
>>> Darshana Gunawardana,
>>> Alumni : Dept. of Computer Science & Engineering,
>>> University of Moratuwa,
>>> Sri Lanka
>>> _______________________________________________
>>> scim mailing list
>>> scim@ietf.org
>>> https://www.ietf.org/mailman/listinfo/scim
>>>
>>>
>>>
>>
>>
>> --
>> With Regards,
>>
>> Darshana Gunawardana,
>> Alumni : Dept. of Computer Science & Engineering,
>> University of Moratuwa,
>> Sri Lanka
>>
>
>
>
> --
> With Regards,
>
> Darshana Gunawardana,
> Alumni : Dept. of Computer Science & Engineering,
> University of Moratuwa,
> Sri Lanka
>