| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 1 | <?xml version="1.0" encoding="UTF-8"?> | 
 | 2 | <!DOCTYPE book PUBLIC "-//OASIS//DTD DocBook XML V4.1.2//EN" | 
 | 3 | 	"http://www.oasis-open.org/docbook/xml/4.1.2/docbookx.dtd" []> | 
 | 4 |  | 
 | 5 | <book id="scsimid"> | 
 | 6 |   <bookinfo> | 
| Randy Dunlap | dc8875e | 2007-11-15 15:42:30 -0800 | [diff] [blame] | 7 |     <title>SCSI Interfaces Guide</title> | 
| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 8 |  | 
 | 9 |     <authorgroup> | 
 | 10 |       <author> | 
 | 11 |         <firstname>James</firstname> | 
 | 12 |         <surname>Bottomley</surname> | 
 | 13 |         <affiliation> | 
 | 14 |           <address> | 
| James Bottomley | 99cb813 | 2008-02-03 16:00:12 -0600 | [diff] [blame] | 15 |             <email>James.Bottomley@hansenpartnership.com</email> | 
| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 16 |           </address> | 
 | 17 |         </affiliation> | 
 | 18 |       </author> | 
 | 19 |  | 
 | 20 |       <author> | 
 | 21 |         <firstname>Rob</firstname> | 
 | 22 |         <surname>Landley</surname> | 
 | 23 |         <affiliation> | 
 | 24 |           <address> | 
 | 25 |             <email>rob@landley.net</email> | 
 | 26 |           </address> | 
 | 27 |         </affiliation> | 
 | 28 |       </author> | 
 | 29 |  | 
 | 30 |     </authorgroup> | 
 | 31 |  | 
 | 32 |     <copyright> | 
 | 33 |       <year>2007</year> | 
 | 34 |       <holder>Linux Foundation</holder> | 
 | 35 |     </copyright> | 
 | 36 |  | 
 | 37 |     <legalnotice> | 
 | 38 |       <para> | 
 | 39 |         This documentation is free software; you can redistribute | 
 | 40 |         it and/or modify it under the terms of the GNU General Public | 
 | 41 |         License version 2. | 
 | 42 |       </para> | 
 | 43 |  | 
 | 44 |       <para> | 
 | 45 |         This program is distributed in the hope that it will be | 
 | 46 |         useful, but WITHOUT ANY WARRANTY; without even the implied | 
 | 47 |         warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. | 
 | 48 |         For more details see the file COPYING in the source | 
 | 49 |         distribution of Linux. | 
 | 50 |       </para> | 
 | 51 |     </legalnotice> | 
 | 52 |   </bookinfo> | 
 | 53 |  | 
 | 54 |   <toc></toc> | 
 | 55 |  | 
 | 56 |   <chapter id="intro"> | 
 | 57 |     <title>Introduction</title> | 
 | 58 |     <sect1 id="protocol_vs_bus"> | 
 | 59 |       <title>Protocol vs bus</title> | 
 | 60 |       <para> | 
 | 61 |         Once upon a time, the Small Computer Systems Interface defined both | 
 | 62 |         a parallel I/O bus and a data protocol to connect a wide variety of | 
 | 63 |         peripherals (disk drives, tape drives, modems, printers, scanners, | 
 | 64 |         optical drives, test equipment, and medical devices) to a host | 
 | 65 |         computer. | 
 | 66 |       </para> | 
 | 67 |       <para> | 
 | 68 |         Although the old parallel (fast/wide/ultra) SCSI bus has largely | 
 | 69 |         fallen out of use, the SCSI command set is more widely used than ever | 
 | 70 |         to communicate with devices over a number of different busses. | 
 | 71 |       </para> | 
 | 72 |       <para> | 
 | 73 |         The <ulink url='http://www.t10.org/scsi-3.htm'>SCSI protocol</ulink> | 
 | 74 |         is a big-endian peer-to-peer packet based protocol.  SCSI commands | 
 | 75 |         are 6, 10, 12, or 16 bytes long, often followed by an associated data | 
 | 76 |         payload. | 
 | 77 |       </para> | 
 | 78 |       <para> | 
 | 79 |         SCSI commands can be transported over just about any kind of bus, and | 
 | 80 |         are the default protocol for storage devices attached to USB, SATA, | 
 | 81 |         SAS, Fibre Channel, FireWire, and ATAPI devices.  SCSI packets are | 
 | 82 |         also commonly exchanged over Infiniband, | 
 | 83 |         <ulink url='http://i2o.shadowconnect.com/faq.php'>I20</ulink>, TCP/IP | 
 | 84 |         (<ulink url='http://en.wikipedia.org/wiki/ISCSI'>iSCSI</ulink>), even | 
 | 85 |         <ulink url='http://cyberelk.net/tim/parport/parscsi.html'>Parallel | 
 | 86 |         ports</ulink>. | 
 | 87 |       </para> | 
 | 88 |     </sect1> | 
 | 89 |     <sect1 id="subsystem_design"> | 
 | 90 |       <title>Design of the Linux SCSI subsystem</title> | 
 | 91 |       <para> | 
 | 92 |         The SCSI subsystem uses a three layer design, with upper, mid, and low | 
 | 93 |         layers.  Every operation involving the SCSI subsystem (such as reading | 
 | 94 |         a sector from a disk) uses one driver at each of the 3 levels: one | 
| Randy Dunlap | dc8875e | 2007-11-15 15:42:30 -0800 | [diff] [blame] | 95 |         upper layer driver, one lower layer driver, and the SCSI midlayer. | 
| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 96 |       </para> | 
 | 97 |       <para> | 
 | 98 |         The SCSI upper layer provides the interface between userspace and the | 
 | 99 |         kernel, in the form of block and char device nodes for I/O and | 
 | 100 |         ioctl().  The SCSI lower layer contains drivers for specific hardware | 
 | 101 |         devices. | 
 | 102 |       </para> | 
 | 103 |       <para> | 
 | 104 |         In between is the SCSI mid-layer, analogous to a network routing | 
 | 105 |         layer such as the IPv4 stack.  The SCSI mid-layer routes a packet | 
 | 106 |         based data protocol between the upper layer's /dev nodes and the | 
 | 107 |         corresponding devices in the lower layer.  It manages command queues, | 
 | 108 |         provides error handling and power management functions, and responds | 
 | 109 |         to ioctl() requests. | 
 | 110 |       </para> | 
 | 111 |     </sect1> | 
 | 112 |   </chapter> | 
 | 113 |  | 
 | 114 |   <chapter id="upper_layer"> | 
 | 115 |     <title>SCSI upper layer</title> | 
 | 116 |     <para> | 
 | 117 |       The upper layer supports the user-kernel interface by providing | 
 | 118 |       device nodes. | 
 | 119 |     </para> | 
 | 120 |     <sect1 id="sd"> | 
 | 121 |       <title>sd (SCSI Disk)</title> | 
 | 122 |       <para>sd (sd_mod.o)</para> | 
 | 123 | <!-- !Idrivers/scsi/sd.c --> | 
 | 124 |     </sect1> | 
 | 125 |     <sect1 id="sr"> | 
 | 126 |       <title>sr (SCSI CD-ROM)</title> | 
 | 127 |       <para>sr (sr_mod.o)</para> | 
 | 128 |     </sect1> | 
 | 129 |     <sect1 id="st"> | 
 | 130 |       <title>st (SCSI Tape)</title> | 
 | 131 |       <para>st (st.o)</para> | 
 | 132 |     </sect1> | 
 | 133 |     <sect1 id="sg"> | 
 | 134 |       <title>sg (SCSI Generic)</title> | 
 | 135 |       <para>sg (sg.o)</para> | 
 | 136 |     </sect1> | 
 | 137 |     <sect1 id="ch"> | 
 | 138 |       <title>ch (SCSI Media Changer)</title> | 
 | 139 |       <para>ch (ch.c)</para> | 
 | 140 |     </sect1> | 
 | 141 |   </chapter> | 
 | 142 |  | 
 | 143 |   <chapter id="mid_layer"> | 
 | 144 |     <title>SCSI mid layer</title> | 
 | 145 |  | 
 | 146 |     <sect1 id="midlayer_implementation"> | 
 | 147 |       <title>SCSI midlayer implementation</title> | 
 | 148 |       <sect2 id="scsi_device.h"> | 
 | 149 |         <title>include/scsi/scsi_device.h</title> | 
 | 150 |         <para> | 
 | 151 |         </para> | 
 | 152 | !Iinclude/scsi/scsi_device.h | 
 | 153 |       </sect2> | 
 | 154 |  | 
 | 155 |       <sect2 id="scsi.c"> | 
 | 156 |         <title>drivers/scsi/scsi.c</title> | 
| Randy Dunlap | dc8875e | 2007-11-15 15:42:30 -0800 | [diff] [blame] | 157 |         <para>Main file for the SCSI midlayer.</para> | 
| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 158 | !Edrivers/scsi/scsi.c | 
 | 159 |       </sect2> | 
 | 160 |       <sect2 id="scsicam.c"> | 
 | 161 |         <title>drivers/scsi/scsicam.c</title> | 
 | 162 |         <para> | 
 | 163 |           <ulink url='http://www.t10.org/ftp/t10/drafts/cam/cam-r12b.pdf'>SCSI | 
 | 164 |           Common Access Method</ulink> support functions, for use with | 
 | 165 |           HDIO_GETGEO, etc. | 
 | 166 |         </para> | 
 | 167 | !Edrivers/scsi/scsicam.c | 
 | 168 |       </sect2> | 
 | 169 |       <sect2 id="scsi_error.c"> | 
 | 170 |         <title>drivers/scsi/scsi_error.c</title> | 
 | 171 |         <para>Common SCSI error/timeout handling routines.</para> | 
 | 172 | !Edrivers/scsi/scsi_error.c | 
 | 173 |       </sect2> | 
 | 174 |       <sect2 id="scsi_devinfo.c"> | 
 | 175 |         <title>drivers/scsi/scsi_devinfo.c</title> | 
 | 176 |         <para> | 
 | 177 |           Manage scsi_dev_info_list, which tracks blacklisted and whitelisted | 
 | 178 |           devices. | 
 | 179 |         </para> | 
 | 180 | !Idrivers/scsi/scsi_devinfo.c | 
 | 181 |       </sect2> | 
 | 182 |       <sect2 id="scsi_ioctl.c"> | 
 | 183 |         <title>drivers/scsi/scsi_ioctl.c</title> | 
 | 184 |         <para> | 
| Randy Dunlap | dc8875e | 2007-11-15 15:42:30 -0800 | [diff] [blame] | 185 |           Handle ioctl() calls for SCSI devices. | 
| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 186 |         </para> | 
 | 187 | !Edrivers/scsi/scsi_ioctl.c | 
 | 188 |       </sect2> | 
 | 189 |       <sect2 id="scsi_lib.c"> | 
 | 190 |         <title>drivers/scsi/scsi_lib.c</title> | 
 | 191 |         <para> | 
 | 192 |           SCSI queuing library. | 
 | 193 |         </para> | 
 | 194 | !Edrivers/scsi/scsi_lib.c | 
 | 195 |       </sect2> | 
 | 196 |       <sect2 id="scsi_lib_dma.c"> | 
 | 197 |         <title>drivers/scsi/scsi_lib_dma.c</title> | 
 | 198 |         <para> | 
 | 199 |           SCSI library functions depending on DMA | 
 | 200 |           (map and unmap scatter-gather lists). | 
 | 201 |         </para> | 
 | 202 | !Edrivers/scsi/scsi_lib_dma.c | 
 | 203 |       </sect2> | 
 | 204 |       <sect2 id="scsi_module.c"> | 
 | 205 |         <title>drivers/scsi/scsi_module.c</title> | 
 | 206 |         <para> | 
 | 207 |           The file drivers/scsi/scsi_module.c contains legacy support for | 
 | 208 |           old-style host templates.  It should never be used by any new driver. | 
 | 209 |         </para> | 
 | 210 |       </sect2> | 
 | 211 |       <sect2 id="scsi_proc.c"> | 
 | 212 |         <title>drivers/scsi/scsi_proc.c</title> | 
 | 213 |         <para> | 
 | 214 |           The functions in this file provide an interface between | 
 | 215 |           the PROC file system and the SCSI device drivers | 
 | 216 |           It is mainly used for debugging, statistics and to pass | 
 | 217 |           information directly to the lowlevel driver. | 
 | 218 |  | 
 | 219 |           I.E. plumbing to manage /proc/scsi/* | 
 | 220 |         </para> | 
 | 221 | !Idrivers/scsi/scsi_proc.c | 
 | 222 |       </sect2> | 
 | 223 |       <sect2 id="scsi_netlink.c"> | 
 | 224 |         <title>drivers/scsi/scsi_netlink.c</title> | 
 | 225 |         <para> | 
 | 226 |           Infrastructure to provide async events from transports to userspace | 
 | 227 |           via netlink, using a single NETLINK_SCSITRANSPORT protocol for all | 
 | 228 |           transports. | 
 | 229 |  | 
 | 230 |           See <ulink url='http://marc.info/?l=linux-scsi&m=115507374832500&w=2'>the | 
 | 231 |           original patch submission</ulink> for more details. | 
 | 232 |         </para> | 
 | 233 | !Idrivers/scsi/scsi_netlink.c | 
 | 234 |       </sect2> | 
 | 235 |       <sect2 id="scsi_scan.c"> | 
 | 236 |         <title>drivers/scsi/scsi_scan.c</title> | 
 | 237 |         <para> | 
 | 238 |           Scan a host to determine which (if any) devices are attached. | 
 | 239 |  | 
 | 240 |           The general scanning/probing algorithm is as follows, exceptions are | 
 | 241 |           made to it depending on device specific flags, compilation options, | 
 | 242 |           and global variable (boot or module load time) settings. | 
 | 243 |  | 
 | 244 |           A specific LUN is scanned via an INQUIRY command; if the LUN has a | 
 | 245 |           device attached, a scsi_device is allocated and setup for it. | 
 | 246 |  | 
 | 247 |           For every id of every channel on the given host, start by scanning | 
 | 248 |           LUN 0.  Skip hosts that don't respond at all to a scan of LUN 0. | 
 | 249 |           Otherwise, if LUN 0 has a device attached, allocate and setup a | 
 | 250 |           scsi_device for it.  If target is SCSI-3 or up, issue a REPORT LUN, | 
 | 251 |           and scan all of the LUNs returned by the REPORT LUN; else, | 
 | 252 |           sequentially scan LUNs up until some maximum is reached, or a LUN is | 
 | 253 |           seen that cannot have a device attached to it. | 
 | 254 |         </para> | 
 | 255 | !Idrivers/scsi/scsi_scan.c | 
 | 256 |       </sect2> | 
 | 257 |       <sect2 id="scsi_sysctl.c"> | 
 | 258 |         <title>drivers/scsi/scsi_sysctl.c</title> | 
 | 259 |         <para> | 
 | 260 |           Set up the sysctl entry: "/dev/scsi/logging_level" | 
 | 261 |           (DEV_SCSI_LOGGING_LEVEL) which sets/returns scsi_logging_level. | 
 | 262 |         </para> | 
 | 263 |       </sect2> | 
 | 264 |       <sect2 id="scsi_sysfs.c"> | 
 | 265 |         <title>drivers/scsi/scsi_sysfs.c</title> | 
 | 266 |         <para> | 
 | 267 |           SCSI sysfs interface routines. | 
 | 268 |         </para> | 
 | 269 | !Edrivers/scsi/scsi_sysfs.c | 
 | 270 |       </sect2> | 
 | 271 |       <sect2 id="hosts.c"> | 
 | 272 |         <title>drivers/scsi/hosts.c</title> | 
 | 273 |         <para> | 
 | 274 |           mid to lowlevel SCSI driver interface | 
 | 275 |         </para> | 
 | 276 | !Edrivers/scsi/hosts.c | 
 | 277 |       </sect2> | 
 | 278 |       <sect2 id="constants.c"> | 
 | 279 |         <title>drivers/scsi/constants.c</title> | 
 | 280 |         <para> | 
 | 281 |           mid to lowlevel SCSI driver interface | 
 | 282 |         </para> | 
 | 283 | !Edrivers/scsi/constants.c | 
 | 284 |       </sect2> | 
 | 285 |     </sect1> | 
 | 286 |  | 
 | 287 |     <sect1 id="Transport_classes"> | 
 | 288 |       <title>Transport classes</title> | 
 | 289 |       <para> | 
| Randy Dunlap | dc8875e | 2007-11-15 15:42:30 -0800 | [diff] [blame] | 290 |         Transport classes are service libraries for drivers in the SCSI | 
| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 291 |         lower layer, which expose transport attributes in sysfs. | 
 | 292 |       </para> | 
 | 293 |       <sect2 id="Fibre_Channel_transport"> | 
 | 294 |         <title>Fibre Channel transport</title> | 
 | 295 |         <para> | 
 | 296 |           The file drivers/scsi/scsi_transport_fc.c defines transport attributes | 
 | 297 |           for Fibre Channel. | 
 | 298 |         </para> | 
 | 299 | !Edrivers/scsi/scsi_transport_fc.c | 
 | 300 |       </sect2> | 
 | 301 |       <sect2 id="iSCSI_transport"> | 
 | 302 |         <title>iSCSI transport class</title> | 
 | 303 |         <para> | 
 | 304 |           The file drivers/scsi/scsi_transport_iscsi.c defines transport | 
 | 305 |           attributes for the iSCSI class, which sends SCSI packets over TCP/IP | 
 | 306 |           connections. | 
 | 307 |         </para> | 
 | 308 | !Edrivers/scsi/scsi_transport_iscsi.c | 
 | 309 |       </sect2> | 
 | 310 |       <sect2 id="SAS_transport"> | 
 | 311 |         <title>Serial Attached SCSI (SAS) transport class</title> | 
 | 312 |         <para> | 
 | 313 |           The file drivers/scsi/scsi_transport_sas.c defines transport | 
 | 314 |           attributes for Serial Attached SCSI, a variant of SATA aimed at | 
 | 315 |           large high-end systems. | 
 | 316 |         </para> | 
 | 317 |         <para> | 
 | 318 |           The SAS transport class contains common code to deal with SAS HBAs, | 
 | 319 |           an aproximated representation of SAS topologies in the driver model, | 
 | 320 |           and various sysfs attributes to expose these topologies and managment | 
 | 321 |           interfaces to userspace. | 
 | 322 |         </para> | 
 | 323 |         <para> | 
 | 324 |           In addition to the basic SCSI core objects this transport class | 
 | 325 |           introduces two additional intermediate objects:  The SAS PHY | 
 | 326 |           as represented by struct sas_phy defines an "outgoing" PHY on | 
 | 327 |           a SAS HBA or Expander, and the SAS remote PHY represented by | 
 | 328 |           struct sas_rphy defines an "incoming" PHY on a SAS Expander or | 
 | 329 |           end device.  Note that this is purely a software concept, the | 
 | 330 |           underlying hardware for a PHY and a remote PHY is the exactly | 
 | 331 |           the same. | 
 | 332 |         </para> | 
 | 333 |         <para> | 
 | 334 |           There is no concept of a SAS port in this code, users can see | 
 | 335 |           what PHYs form a wide port based on the port_identifier attribute, | 
 | 336 |           which is the same for all PHYs in a port. | 
 | 337 |         </para> | 
 | 338 | !Edrivers/scsi/scsi_transport_sas.c | 
 | 339 |       </sect2> | 
 | 340 |       <sect2 id="SATA_transport"> | 
 | 341 |         <title>SATA transport class</title> | 
 | 342 |         <para> | 
 | 343 |           The SATA transport is handled by libata, which has its own book of | 
 | 344 |           documentation in this directory. | 
 | 345 |         </para> | 
 | 346 |       </sect2> | 
 | 347 |       <sect2 id="SPI_transport"> | 
 | 348 |         <title>Parallel SCSI (SPI) transport class</title> | 
 | 349 |         <para> | 
 | 350 |           The file drivers/scsi/scsi_transport_spi.c defines transport | 
 | 351 |           attributes for traditional (fast/wide/ultra) SCSI busses. | 
 | 352 |         </para> | 
 | 353 | !Edrivers/scsi/scsi_transport_spi.c | 
 | 354 |       </sect2> | 
 | 355 |       <sect2 id="SRP_transport"> | 
 | 356 |         <title>SCSI RDMA (SRP) transport class</title> | 
 | 357 |         <para> | 
 | 358 |           The file drivers/scsi/scsi_transport_srp.c defines transport | 
 | 359 |           attributes for SCSI over Remote Direct Memory Access. | 
 | 360 |         </para> | 
 | 361 | !Edrivers/scsi/scsi_transport_srp.c | 
 | 362 |       </sect2> | 
 | 363 |     </sect1> | 
 | 364 |  | 
 | 365 |   </chapter> | 
 | 366 |  | 
 | 367 |   <chapter id="lower_layer"> | 
 | 368 |     <title>SCSI lower layer</title> | 
 | 369 |     <sect1 id="hba_drivers"> | 
 | 370 |       <title>Host Bus Adapter transport types</title> | 
 | 371 |       <para> | 
 | 372 |         Many modern device controllers use the SCSI command set as a protocol to | 
 | 373 |         communicate with their devices through many different types of physical | 
 | 374 |         connections. | 
 | 375 |       </para> | 
 | 376 |       <para> | 
 | 377 |         In SCSI language a bus capable of carrying SCSI commands is | 
 | 378 |         called a "transport", and a controller connecting to such a bus is | 
 | 379 |         called a "host bus adapter" (HBA). | 
 | 380 |       </para> | 
 | 381 |       <sect2 id="scsi_debug.c"> | 
 | 382 |         <title>Debug transport</title> | 
 | 383 |         <para> | 
 | 384 |           The file drivers/scsi/scsi_debug.c simulates a host adapter with a | 
 | 385 |           variable number of disks (or disk like devices) attached, sharing a | 
 | 386 |           common amount of RAM.  Does a lot of checking to make sure that we are | 
 | 387 |           not getting blocks mixed up, and panics the kernel if anything out of | 
 | 388 |           the ordinary is seen. | 
 | 389 |         </para> | 
 | 390 |         <para> | 
 | 391 |           To be more realistic, the simulated devices have the transport | 
 | 392 |           attributes of SAS disks. | 
 | 393 |         </para> | 
 | 394 |         <para> | 
 | 395 |           For documentation see | 
 | 396 |           <ulink url='http://www.torque.net/sg/sdebug26.html'>http://www.torque.net/sg/sdebug26.html</ulink> | 
 | 397 |         </para> | 
 | 398 | <!-- !Edrivers/scsi/scsi_debug.c --> | 
 | 399 |       </sect2> | 
 | 400 |       <sect2 id="todo"> | 
 | 401 |         <title>todo</title> | 
 | 402 |         <para>Parallel (fast/wide/ultra) SCSI, USB, SATA, | 
 | 403 |         SAS, Fibre Channel, FireWire, ATAPI devices, Infiniband, | 
 | 404 |         I20, iSCSI, Parallel ports, netlink... | 
 | 405 |         </para> | 
 | 406 |       </sect2> | 
 | 407 |     </sect1> | 
 | 408 |   </chapter> | 
 | 409 | </book> |