RE: [nfsv4] Last Call: <draft-ietf-nfsv4-scsi-layout-06.txt> (Parallel NFS (pNFS) SCSI Layout) to Proposed Standard

Spencer Shepler <> Mon, 18 July 2016 05:50 UTC

Return-Path: <>
Received: from localhost (localhost []) by (Postfix) with ESMTP id D9A4712D155; Sun, 17 Jul 2016 22:50:15 -0700 (PDT)
X-Virus-Scanned: amavisd-new at
X-Spam-Flag: NO
X-Spam-Score: -2.003
X-Spam-Status: No, score=-2.003 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: (amavisd-new); dkim=pass (1024-bit key)
Received: from ([]) by localhost ( []) (amavisd-new, port 10024) with ESMTP id U5E-n3ovVtqW; Sun, 17 Jul 2016 22:50:07 -0700 (PDT)
Received: from ( []) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by (Postfix) with ESMTPS id 1F70012D159; Sun, 17 Jul 2016 22:50:04 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=JSI3vyfLcLkknUN2ktw5ftlkGaUrJbWJgkvT9OTlxBU=; b=DboRI82m/mN5kGfCFCipZG5U2XZHp0vRnBDdNhMW2YYuSJ1RzgDMqOQqeJD2gxPwTSc87Xk1dozsLPI0C8YmWAeZKdpQEaIBPyPmNF1kwPdHOCloetwhm6juNAZaKs5CpmN+huvPqtZgDx4fbnz0MduQ3jD+2xMw7hWO2p33NFw=
Received: from ( by ( with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.528.16; Mon, 18 Jul 2016 05:50:02 +0000
Received: from ([]) by ([]) with mapi id 15.01.0528.017; Mon, 18 Jul 2016 05:50:02 +0000
From: Spencer Shepler <>
To: Christoph Hellwig <>, "Black, David" <>
Subject: RE: [nfsv4] Last Call: <draft-ietf-nfsv4-scsi-layout-06.txt> (Parallel NFS (pNFS) SCSI Layout) to Proposed Standard
Thread-Topic: [nfsv4] Last Call: <draft-ietf-nfsv4-scsi-layout-06.txt> (Parallel NFS (pNFS) SCSI Layout) to Proposed Standard
Date: Mon, 18 Jul 2016 05:50:02 +0000
Message-ID: <>
References: <> <> <>
In-Reply-To: <>
Accept-Language: en-US
Content-Language: en-US
authentication-results: spf=none (sender IP is );
x-originating-ip: [2001:4898:80e8:7::510]
x-ms-office365-filtering-correlation-id: 699d3257-575d-46dc-08e6-08d3aecf5cc8
x-microsoft-exchange-diagnostics: 1; CO2PR03MB2279; 6:1pmIeGvzlkPkZ1EOncETIc2unSaIAAh+mRT30CV/RQPESKub07gV9lyA+GK9GzrDLxFArTKcIt6cSCYvAIWDSySledBdXkgQxeyd0i9HJMfjJs4srNX0VGcECgnmBwyeWYC4Y6JNUGKaaMRK5bziuduGcqdFoMpqQ91vzCZK/+CT8dOpMayHxA4OXJBcLe1yadb0ZQ1m6fxILT/Nj6/hTOEbZWdHFn66n8aNu2EXQnHI83A9XDYy6iGOfyIclojhlV8/p4C+cWgTTzhuw3uIuvZY5nP7nhI7g0S66CYgotE7fAFaSg6dc3/pY//t1jRcod2pSdBX38o4oV+4MosETA==; 5:irDV9MelFFMLGg6ImTtQZRW+SSe/ZA8AxS2CaB0Vl5jl/FLwvoBdqusf4jycXtH/r1VQ95YIcLnQb8kSxffhwO5qwWkuvk3y5yXxWjy8eoe8ZySqxGCqF9GMUPWuXys8H4fBl5flfivsUns2feS6CQ==; 24:+1MlLJQByAKxlIqP6YTYWtXumGOMdCZ7rE6fbPOFJ0+FYDHTVnSYNDpa2vOprOMK7zsqPfRc0aTP5mYCvMjcPlmTWhbrmdhVJ+xc/PMf5/s=; 7:qOJEwR6uaOW8PTnKEMbxHZAPQBvZcPXKQ8ejYhQ+b9I6EDgspITga5wEvx3F2V9UsBV1u4HKt56CEdL/F55SBBphyhC/qoFmTPQpxaYkzv9SV7HPTQVws7rntKZYoqaOIKflVLcogmAVrOWY6kQlUZ9cHmelP0eJchA3O5ytuAXPP/e8nRSyy8ARc8v9UXncUL+s2x6pxkrYHJ1FbJflUZlQearwI9W84Y/5dnxTN9Dsk/Gzuk5HKeqM5/xuoLHP
x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:CO2PR03MB2279;
x-microsoft-antispam-prvs: <>
x-exchange-antispam-report-test: UriScan:(158342451672863)(189930954265078)(219752817060721);
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(61425038)(601004)(2401047)(5005006)(8121501046)(3002001)(10201501046)(6055026)(61426038)(61427038); SRVR:CO2PR03MB2279; BCL:0; PCL:0; RULEID:; SRVR:CO2PR03MB2279;
x-forefront-prvs: 00073DB75F
x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(6009001)(7916002)(377454003)(13464003)(51914003)(24454002)(199003)(189002)(230783001)(575784001)(99286002)(15975445007)(10090500001)(8990500004)(86362001)(74316002)(586003)(5005710100001)(106116001)(5003600100003)(76576001)(11100500001)(19580405001)(86612001)(3660700001)(7846002)(2906002)(10290500002)(2950100001)(7696003)(189998001)(10400500002)(92566002)(122556002)(81166006)(33656002)(8936002)(81156014)(7736002)(6116002)(105586002)(68736007)(9686002)(77096005)(97736004)(19580395003)(54356999)(87936001)(3280700002)(5002640100001)(102836003)(5001770100001)(2900100001)(50986999)(305945005)(76176999)(101416001)(4326007)(8676002)(8666005)(106356001)(7059030)(3826002); DIR:OUT; SFP:1102; SCL:1; SRVR:CO2PR03MB2279;; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en;
received-spf: None ( does not designate permitted sender hosts)
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-originalarrivaltime: 18 Jul 2016 05:50:02.7038 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO2PR03MB2279
Archived-At: <>
Cc: "" <>, "" <>, "" <>, "" <>
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: IETF-Discussion <>
List-Unsubscribe: <>, <>
List-Archive: <>
List-Post: <>
List-Help: <>
List-Subscribe: <>, <>
X-List-Received-Date: Mon, 18 Jul 2016 05:50:16 -0000

Updated draft is fine with me (if the question was for Spencer S. instead of Spencer D).

-----Original Message-----
From: nfsv4 [] On Behalf Of Christoph Hellwig
Sent: Sunday, July 17, 2016 9:35 PM
To: Black, David <>
Subject: Re: [nfsv4] Last Call: <draft-ietf-nfsv4-scsi-layout-06.txt> (Parallel NFS (pNFS) SCSI Layout) to Proposed Standard

Hi David,

thanks for the updates.  Let's talk about the detail tomorrow in Berlin,
but unless Spencer disagrees I'll prepare a new draft once the meeting
is over.

On Sun, Jul 10, 2016 at 06:51:40PM +0000, Black, David wrote:
> -- Introduction, last paragraph.
> Add a sentence saying that there are no other significant differences from RFC 5663
> (previous sentences indicate use of SCSI for fencing and LAYOUTCOMMIT improvements),
> e.g., the volume topology (Section 2.3.2) and data structures that describe extents
> (Section 2.3.3.) are common with RFC 5663.  Those two examples seem important.

Just scrapping the sentence might be best.

> -- Section 2.1, 1st paragraph
> 	" and the SCSI initiators used for the pNFS Metadata Server and clients MUST
> 	   support SCSI persistent reservations."
> Add a citation of [SPC4] to support that MUST requirement.

> -- Section 2.1, 2nd paragraph:
>    Clients MUST be able to perform I/O to
>    the block extents without affecting additional areas of storage
>    (especially important for writes); therefore, extents MUST be aligned
>    to 512-byte boundaries.
> That assumes a 512 byte logical block size, which is generally ok for now, but 4k is coming.
> At a minimum,  "extents MUST be aligned to logical block size boundaries of the logical
> units, e.g., 512 bytes."  OTOH, would it be reasonable to just make 4k alignment a MUST
> now, as there will be storage systems that need 4k alignment and 4k alignment generally
> works better than 512-byte alignment with existing systems?

I think the right thing is to simply scrap the 512 byte example and just
require extents to be aligned to at least the logical block size.

All implementations of the block and scsi layout known to me align to 4k or
larger, but I see no fundamental reason to forbid 512 byte alignment.

> -- Section 2.3.1
>    It is similar to the "Identification
>    Descriptor Target Descriptor" specified in [SPC4], but limits the
>    allowed values to those that uniquely identify a LU.
> I suggest just deleting this sentence, as that is now called an "Identification CSCD Descriptor" - 
> if this sentence is retained, the use of those descriptors in EXTENDED COPY would be
> important to mention - that seems like a diversion.


>    2.  The "DESIGNATOR TYPE" MUST be set to one of four values
> T10 is now allowing UUIDs to also be used in the working draft of SPC-5, and those would be
> appropriate here.  Nonetheless, I suggest no change until SPC-5 is completed at T10, as this
> draft is (properly, IMHO) based on SPC-4.

Yes, I would love to be able to support UUIDs, but I see no way to allow
for that until SPC-5 has been completed.

> -- Section
>    To make sure all I_T nexuses are registered,
>    the client SHOULD set the "All Target Ports" (ALL_TG_PT) bit when
>    registering the key, or otherwise ensure the registration is
>    performed for each initiator port.
> It looks like initiator and target registration scopes were conflated here and
> need to be separated.  Suggested text:
>    To make sure all I_T nexuses are registered,
>    the client SHOULD set the "All Target Ports" (ALL_TG_PT) bit when
>    registering the key, or otherwise ensure the registration is
>    performed for each target port, and MUST perform registration
>    for each initiator port.

Thanks, this will need an update.

> -- References
> Current version of SAM is SAM-5, consider updating SAM-4 reference to SAM-5.


nfsv4 mailing list