| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 1 | <?xml version="1.0" encoding="UTF-8"?> | 
|  | 2 | <!DOCTYPE book PUBLIC "-//OASIS//DTD DocBook XML V4.1.2//EN" | 
|  | 3 | "http://www.oasis-open.org/docbook/xml/4.1.2/docbookx.dtd" []> | 
|  | 4 |  | 
|  | 5 | <book id="scsimid"> | 
|  | 6 | <bookinfo> | 
| Randy Dunlap | dc8875e | 2007-11-15 15:42:30 -0800 | [diff] [blame] | 7 | <title>SCSI Interfaces Guide</title> | 
| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 8 |  | 
|  | 9 | <authorgroup> | 
|  | 10 | <author> | 
|  | 11 | <firstname>James</firstname> | 
|  | 12 | <surname>Bottomley</surname> | 
|  | 13 | <affiliation> | 
|  | 14 | <address> | 
| James Bottomley | 99cb813 | 2008-02-03 16:00:12 -0600 | [diff] [blame] | 15 | <email>James.Bottomley@hansenpartnership.com</email> | 
| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 16 | </address> | 
|  | 17 | </affiliation> | 
|  | 18 | </author> | 
|  | 19 |  | 
|  | 20 | <author> | 
|  | 21 | <firstname>Rob</firstname> | 
|  | 22 | <surname>Landley</surname> | 
|  | 23 | <affiliation> | 
|  | 24 | <address> | 
|  | 25 | <email>rob@landley.net</email> | 
|  | 26 | </address> | 
|  | 27 | </affiliation> | 
|  | 28 | </author> | 
|  | 29 |  | 
|  | 30 | </authorgroup> | 
|  | 31 |  | 
|  | 32 | <copyright> | 
|  | 33 | <year>2007</year> | 
|  | 34 | <holder>Linux Foundation</holder> | 
|  | 35 | </copyright> | 
|  | 36 |  | 
|  | 37 | <legalnotice> | 
|  | 38 | <para> | 
|  | 39 | This documentation is free software; you can redistribute | 
|  | 40 | it and/or modify it under the terms of the GNU General Public | 
|  | 41 | License version 2. | 
|  | 42 | </para> | 
|  | 43 |  | 
|  | 44 | <para> | 
|  | 45 | This program is distributed in the hope that it will be | 
|  | 46 | useful, but WITHOUT ANY WARRANTY; without even the implied | 
|  | 47 | warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. | 
|  | 48 | For more details see the file COPYING in the source | 
|  | 49 | distribution of Linux. | 
|  | 50 | </para> | 
|  | 51 | </legalnotice> | 
|  | 52 | </bookinfo> | 
|  | 53 |  | 
|  | 54 | <toc></toc> | 
|  | 55 |  | 
|  | 56 | <chapter id="intro"> | 
|  | 57 | <title>Introduction</title> | 
|  | 58 | <sect1 id="protocol_vs_bus"> | 
|  | 59 | <title>Protocol vs bus</title> | 
|  | 60 | <para> | 
|  | 61 | Once upon a time, the Small Computer Systems Interface defined both | 
|  | 62 | a parallel I/O bus and a data protocol to connect a wide variety of | 
|  | 63 | peripherals (disk drives, tape drives, modems, printers, scanners, | 
|  | 64 | optical drives, test equipment, and medical devices) to a host | 
|  | 65 | computer. | 
|  | 66 | </para> | 
|  | 67 | <para> | 
|  | 68 | Although the old parallel (fast/wide/ultra) SCSI bus has largely | 
|  | 69 | fallen out of use, the SCSI command set is more widely used than ever | 
|  | 70 | to communicate with devices over a number of different busses. | 
|  | 71 | </para> | 
|  | 72 | <para> | 
|  | 73 | The <ulink url='http://www.t10.org/scsi-3.htm'>SCSI protocol</ulink> | 
|  | 74 | is a big-endian peer-to-peer packet based protocol.  SCSI commands | 
|  | 75 | are 6, 10, 12, or 16 bytes long, often followed by an associated data | 
|  | 76 | payload. | 
|  | 77 | </para> | 
|  | 78 | <para> | 
|  | 79 | SCSI commands can be transported over just about any kind of bus, and | 
|  | 80 | are the default protocol for storage devices attached to USB, SATA, | 
|  | 81 | SAS, Fibre Channel, FireWire, and ATAPI devices.  SCSI packets are | 
|  | 82 | also commonly exchanged over Infiniband, | 
|  | 83 | <ulink url='http://i2o.shadowconnect.com/faq.php'>I20</ulink>, TCP/IP | 
|  | 84 | (<ulink url='http://en.wikipedia.org/wiki/ISCSI'>iSCSI</ulink>), even | 
|  | 85 | <ulink url='http://cyberelk.net/tim/parport/parscsi.html'>Parallel | 
|  | 86 | ports</ulink>. | 
|  | 87 | </para> | 
|  | 88 | </sect1> | 
|  | 89 | <sect1 id="subsystem_design"> | 
|  | 90 | <title>Design of the Linux SCSI subsystem</title> | 
|  | 91 | <para> | 
|  | 92 | The SCSI subsystem uses a three layer design, with upper, mid, and low | 
|  | 93 | layers.  Every operation involving the SCSI subsystem (such as reading | 
|  | 94 | a sector from a disk) uses one driver at each of the 3 levels: one | 
| Randy Dunlap | dc8875e | 2007-11-15 15:42:30 -0800 | [diff] [blame] | 95 | upper layer driver, one lower layer driver, and the SCSI midlayer. | 
| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 96 | </para> | 
|  | 97 | <para> | 
|  | 98 | The SCSI upper layer provides the interface between userspace and the | 
|  | 99 | kernel, in the form of block and char device nodes for I/O and | 
|  | 100 | ioctl().  The SCSI lower layer contains drivers for specific hardware | 
|  | 101 | devices. | 
|  | 102 | </para> | 
|  | 103 | <para> | 
|  | 104 | In between is the SCSI mid-layer, analogous to a network routing | 
|  | 105 | layer such as the IPv4 stack.  The SCSI mid-layer routes a packet | 
|  | 106 | based data protocol between the upper layer's /dev nodes and the | 
|  | 107 | corresponding devices in the lower layer.  It manages command queues, | 
|  | 108 | provides error handling and power management functions, and responds | 
|  | 109 | to ioctl() requests. | 
|  | 110 | </para> | 
|  | 111 | </sect1> | 
|  | 112 | </chapter> | 
|  | 113 |  | 
|  | 114 | <chapter id="upper_layer"> | 
|  | 115 | <title>SCSI upper layer</title> | 
|  | 116 | <para> | 
|  | 117 | The upper layer supports the user-kernel interface by providing | 
|  | 118 | device nodes. | 
|  | 119 | </para> | 
|  | 120 | <sect1 id="sd"> | 
|  | 121 | <title>sd (SCSI Disk)</title> | 
|  | 122 | <para>sd (sd_mod.o)</para> | 
|  | 123 | <!-- !Idrivers/scsi/sd.c --> | 
|  | 124 | </sect1> | 
|  | 125 | <sect1 id="sr"> | 
|  | 126 | <title>sr (SCSI CD-ROM)</title> | 
|  | 127 | <para>sr (sr_mod.o)</para> | 
|  | 128 | </sect1> | 
|  | 129 | <sect1 id="st"> | 
|  | 130 | <title>st (SCSI Tape)</title> | 
|  | 131 | <para>st (st.o)</para> | 
|  | 132 | </sect1> | 
|  | 133 | <sect1 id="sg"> | 
|  | 134 | <title>sg (SCSI Generic)</title> | 
|  | 135 | <para>sg (sg.o)</para> | 
|  | 136 | </sect1> | 
|  | 137 | <sect1 id="ch"> | 
|  | 138 | <title>ch (SCSI Media Changer)</title> | 
|  | 139 | <para>ch (ch.c)</para> | 
|  | 140 | </sect1> | 
|  | 141 | </chapter> | 
|  | 142 |  | 
|  | 143 | <chapter id="mid_layer"> | 
|  | 144 | <title>SCSI mid layer</title> | 
|  | 145 |  | 
|  | 146 | <sect1 id="midlayer_implementation"> | 
|  | 147 | <title>SCSI midlayer implementation</title> | 
|  | 148 | <sect2 id="scsi_device.h"> | 
|  | 149 | <title>include/scsi/scsi_device.h</title> | 
|  | 150 | <para> | 
|  | 151 | </para> | 
|  | 152 | !Iinclude/scsi/scsi_device.h | 
|  | 153 | </sect2> | 
|  | 154 |  | 
|  | 155 | <sect2 id="scsi.c"> | 
|  | 156 | <title>drivers/scsi/scsi.c</title> | 
| Randy Dunlap | dc8875e | 2007-11-15 15:42:30 -0800 | [diff] [blame] | 157 | <para>Main file for the SCSI midlayer.</para> | 
| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 158 | !Edrivers/scsi/scsi.c | 
|  | 159 | </sect2> | 
|  | 160 | <sect2 id="scsicam.c"> | 
|  | 161 | <title>drivers/scsi/scsicam.c</title> | 
|  | 162 | <para> | 
|  | 163 | <ulink url='http://www.t10.org/ftp/t10/drafts/cam/cam-r12b.pdf'>SCSI | 
|  | 164 | Common Access Method</ulink> support functions, for use with | 
|  | 165 | HDIO_GETGEO, etc. | 
|  | 166 | </para> | 
|  | 167 | !Edrivers/scsi/scsicam.c | 
|  | 168 | </sect2> | 
|  | 169 | <sect2 id="scsi_error.c"> | 
|  | 170 | <title>drivers/scsi/scsi_error.c</title> | 
|  | 171 | <para>Common SCSI error/timeout handling routines.</para> | 
|  | 172 | !Edrivers/scsi/scsi_error.c | 
|  | 173 | </sect2> | 
|  | 174 | <sect2 id="scsi_devinfo.c"> | 
|  | 175 | <title>drivers/scsi/scsi_devinfo.c</title> | 
|  | 176 | <para> | 
|  | 177 | Manage scsi_dev_info_list, which tracks blacklisted and whitelisted | 
|  | 178 | devices. | 
|  | 179 | </para> | 
|  | 180 | !Idrivers/scsi/scsi_devinfo.c | 
|  | 181 | </sect2> | 
|  | 182 | <sect2 id="scsi_ioctl.c"> | 
|  | 183 | <title>drivers/scsi/scsi_ioctl.c</title> | 
|  | 184 | <para> | 
| Randy Dunlap | dc8875e | 2007-11-15 15:42:30 -0800 | [diff] [blame] | 185 | Handle ioctl() calls for SCSI devices. | 
| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 186 | </para> | 
|  | 187 | !Edrivers/scsi/scsi_ioctl.c | 
|  | 188 | </sect2> | 
|  | 189 | <sect2 id="scsi_lib.c"> | 
|  | 190 | <title>drivers/scsi/scsi_lib.c</title> | 
|  | 191 | <para> | 
|  | 192 | SCSI queuing library. | 
|  | 193 | </para> | 
|  | 194 | !Edrivers/scsi/scsi_lib.c | 
|  | 195 | </sect2> | 
|  | 196 | <sect2 id="scsi_lib_dma.c"> | 
|  | 197 | <title>drivers/scsi/scsi_lib_dma.c</title> | 
|  | 198 | <para> | 
|  | 199 | SCSI library functions depending on DMA | 
|  | 200 | (map and unmap scatter-gather lists). | 
|  | 201 | </para> | 
|  | 202 | !Edrivers/scsi/scsi_lib_dma.c | 
|  | 203 | </sect2> | 
|  | 204 | <sect2 id="scsi_module.c"> | 
|  | 205 | <title>drivers/scsi/scsi_module.c</title> | 
|  | 206 | <para> | 
|  | 207 | The file drivers/scsi/scsi_module.c contains legacy support for | 
|  | 208 | old-style host templates.  It should never be used by any new driver. | 
|  | 209 | </para> | 
|  | 210 | </sect2> | 
|  | 211 | <sect2 id="scsi_proc.c"> | 
|  | 212 | <title>drivers/scsi/scsi_proc.c</title> | 
|  | 213 | <para> | 
|  | 214 | The functions in this file provide an interface between | 
|  | 215 | the PROC file system and the SCSI device drivers | 
|  | 216 | It is mainly used for debugging, statistics and to pass | 
|  | 217 | information directly to the lowlevel driver. | 
|  | 218 |  | 
|  | 219 | I.E. plumbing to manage /proc/scsi/* | 
|  | 220 | </para> | 
|  | 221 | !Idrivers/scsi/scsi_proc.c | 
|  | 222 | </sect2> | 
|  | 223 | <sect2 id="scsi_netlink.c"> | 
|  | 224 | <title>drivers/scsi/scsi_netlink.c</title> | 
|  | 225 | <para> | 
|  | 226 | Infrastructure to provide async events from transports to userspace | 
|  | 227 | via netlink, using a single NETLINK_SCSITRANSPORT protocol for all | 
|  | 228 | transports. | 
|  | 229 |  | 
|  | 230 | See <ulink url='http://marc.info/?l=linux-scsi&m=115507374832500&w=2'>the | 
|  | 231 | original patch submission</ulink> for more details. | 
|  | 232 | </para> | 
|  | 233 | !Idrivers/scsi/scsi_netlink.c | 
|  | 234 | </sect2> | 
|  | 235 | <sect2 id="scsi_scan.c"> | 
|  | 236 | <title>drivers/scsi/scsi_scan.c</title> | 
|  | 237 | <para> | 
|  | 238 | Scan a host to determine which (if any) devices are attached. | 
|  | 239 |  | 
|  | 240 | The general scanning/probing algorithm is as follows, exceptions are | 
|  | 241 | made to it depending on device specific flags, compilation options, | 
|  | 242 | and global variable (boot or module load time) settings. | 
|  | 243 |  | 
|  | 244 | A specific LUN is scanned via an INQUIRY command; if the LUN has a | 
|  | 245 | device attached, a scsi_device is allocated and setup for it. | 
|  | 246 |  | 
|  | 247 | For every id of every channel on the given host, start by scanning | 
|  | 248 | LUN 0.  Skip hosts that don't respond at all to a scan of LUN 0. | 
|  | 249 | Otherwise, if LUN 0 has a device attached, allocate and setup a | 
|  | 250 | scsi_device for it.  If target is SCSI-3 or up, issue a REPORT LUN, | 
|  | 251 | and scan all of the LUNs returned by the REPORT LUN; else, | 
|  | 252 | sequentially scan LUNs up until some maximum is reached, or a LUN is | 
|  | 253 | seen that cannot have a device attached to it. | 
|  | 254 | </para> | 
|  | 255 | !Idrivers/scsi/scsi_scan.c | 
|  | 256 | </sect2> | 
|  | 257 | <sect2 id="scsi_sysctl.c"> | 
|  | 258 | <title>drivers/scsi/scsi_sysctl.c</title> | 
|  | 259 | <para> | 
|  | 260 | Set up the sysctl entry: "/dev/scsi/logging_level" | 
|  | 261 | (DEV_SCSI_LOGGING_LEVEL) which sets/returns scsi_logging_level. | 
|  | 262 | </para> | 
|  | 263 | </sect2> | 
|  | 264 | <sect2 id="scsi_sysfs.c"> | 
|  | 265 | <title>drivers/scsi/scsi_sysfs.c</title> | 
|  | 266 | <para> | 
|  | 267 | SCSI sysfs interface routines. | 
|  | 268 | </para> | 
|  | 269 | !Edrivers/scsi/scsi_sysfs.c | 
|  | 270 | </sect2> | 
|  | 271 | <sect2 id="hosts.c"> | 
|  | 272 | <title>drivers/scsi/hosts.c</title> | 
|  | 273 | <para> | 
|  | 274 | mid to lowlevel SCSI driver interface | 
|  | 275 | </para> | 
|  | 276 | !Edrivers/scsi/hosts.c | 
|  | 277 | </sect2> | 
|  | 278 | <sect2 id="constants.c"> | 
|  | 279 | <title>drivers/scsi/constants.c</title> | 
|  | 280 | <para> | 
|  | 281 | mid to lowlevel SCSI driver interface | 
|  | 282 | </para> | 
|  | 283 | !Edrivers/scsi/constants.c | 
|  | 284 | </sect2> | 
|  | 285 | </sect1> | 
|  | 286 |  | 
|  | 287 | <sect1 id="Transport_classes"> | 
|  | 288 | <title>Transport classes</title> | 
|  | 289 | <para> | 
| Randy Dunlap | dc8875e | 2007-11-15 15:42:30 -0800 | [diff] [blame] | 290 | Transport classes are service libraries for drivers in the SCSI | 
| Rob Landley | eb44820 | 2007-11-03 13:30:39 -0500 | [diff] [blame] | 291 | lower layer, which expose transport attributes in sysfs. | 
|  | 292 | </para> | 
|  | 293 | <sect2 id="Fibre_Channel_transport"> | 
|  | 294 | <title>Fibre Channel transport</title> | 
|  | 295 | <para> | 
|  | 296 | The file drivers/scsi/scsi_transport_fc.c defines transport attributes | 
|  | 297 | for Fibre Channel. | 
|  | 298 | </para> | 
|  | 299 | !Edrivers/scsi/scsi_transport_fc.c | 
|  | 300 | </sect2> | 
|  | 301 | <sect2 id="iSCSI_transport"> | 
|  | 302 | <title>iSCSI transport class</title> | 
|  | 303 | <para> | 
|  | 304 | The file drivers/scsi/scsi_transport_iscsi.c defines transport | 
|  | 305 | attributes for the iSCSI class, which sends SCSI packets over TCP/IP | 
|  | 306 | connections. | 
|  | 307 | </para> | 
|  | 308 | !Edrivers/scsi/scsi_transport_iscsi.c | 
|  | 309 | </sect2> | 
|  | 310 | <sect2 id="SAS_transport"> | 
|  | 311 | <title>Serial Attached SCSI (SAS) transport class</title> | 
|  | 312 | <para> | 
|  | 313 | The file drivers/scsi/scsi_transport_sas.c defines transport | 
|  | 314 | attributes for Serial Attached SCSI, a variant of SATA aimed at | 
|  | 315 | large high-end systems. | 
|  | 316 | </para> | 
|  | 317 | <para> | 
|  | 318 | The SAS transport class contains common code to deal with SAS HBAs, | 
|  | 319 | an aproximated representation of SAS topologies in the driver model, | 
|  | 320 | and various sysfs attributes to expose these topologies and managment | 
|  | 321 | interfaces to userspace. | 
|  | 322 | </para> | 
|  | 323 | <para> | 
|  | 324 | In addition to the basic SCSI core objects this transport class | 
|  | 325 | introduces two additional intermediate objects:  The SAS PHY | 
|  | 326 | as represented by struct sas_phy defines an "outgoing" PHY on | 
|  | 327 | a SAS HBA or Expander, and the SAS remote PHY represented by | 
|  | 328 | struct sas_rphy defines an "incoming" PHY on a SAS Expander or | 
|  | 329 | end device.  Note that this is purely a software concept, the | 
|  | 330 | underlying hardware for a PHY and a remote PHY is the exactly | 
|  | 331 | the same. | 
|  | 332 | </para> | 
|  | 333 | <para> | 
|  | 334 | There is no concept of a SAS port in this code, users can see | 
|  | 335 | what PHYs form a wide port based on the port_identifier attribute, | 
|  | 336 | which is the same for all PHYs in a port. | 
|  | 337 | </para> | 
|  | 338 | !Edrivers/scsi/scsi_transport_sas.c | 
|  | 339 | </sect2> | 
|  | 340 | <sect2 id="SATA_transport"> | 
|  | 341 | <title>SATA transport class</title> | 
|  | 342 | <para> | 
|  | 343 | The SATA transport is handled by libata, which has its own book of | 
|  | 344 | documentation in this directory. | 
|  | 345 | </para> | 
|  | 346 | </sect2> | 
|  | 347 | <sect2 id="SPI_transport"> | 
|  | 348 | <title>Parallel SCSI (SPI) transport class</title> | 
|  | 349 | <para> | 
|  | 350 | The file drivers/scsi/scsi_transport_spi.c defines transport | 
|  | 351 | attributes for traditional (fast/wide/ultra) SCSI busses. | 
|  | 352 | </para> | 
|  | 353 | !Edrivers/scsi/scsi_transport_spi.c | 
|  | 354 | </sect2> | 
|  | 355 | <sect2 id="SRP_transport"> | 
|  | 356 | <title>SCSI RDMA (SRP) transport class</title> | 
|  | 357 | <para> | 
|  | 358 | The file drivers/scsi/scsi_transport_srp.c defines transport | 
|  | 359 | attributes for SCSI over Remote Direct Memory Access. | 
|  | 360 | </para> | 
|  | 361 | !Edrivers/scsi/scsi_transport_srp.c | 
|  | 362 | </sect2> | 
|  | 363 | </sect1> | 
|  | 364 |  | 
|  | 365 | </chapter> | 
|  | 366 |  | 
|  | 367 | <chapter id="lower_layer"> | 
|  | 368 | <title>SCSI lower layer</title> | 
|  | 369 | <sect1 id="hba_drivers"> | 
|  | 370 | <title>Host Bus Adapter transport types</title> | 
|  | 371 | <para> | 
|  | 372 | Many modern device controllers use the SCSI command set as a protocol to | 
|  | 373 | communicate with their devices through many different types of physical | 
|  | 374 | connections. | 
|  | 375 | </para> | 
|  | 376 | <para> | 
|  | 377 | In SCSI language a bus capable of carrying SCSI commands is | 
|  | 378 | called a "transport", and a controller connecting to such a bus is | 
|  | 379 | called a "host bus adapter" (HBA). | 
|  | 380 | </para> | 
|  | 381 | <sect2 id="scsi_debug.c"> | 
|  | 382 | <title>Debug transport</title> | 
|  | 383 | <para> | 
|  | 384 | The file drivers/scsi/scsi_debug.c simulates a host adapter with a | 
|  | 385 | variable number of disks (or disk like devices) attached, sharing a | 
|  | 386 | common amount of RAM.  Does a lot of checking to make sure that we are | 
|  | 387 | not getting blocks mixed up, and panics the kernel if anything out of | 
|  | 388 | the ordinary is seen. | 
|  | 389 | </para> | 
|  | 390 | <para> | 
|  | 391 | To be more realistic, the simulated devices have the transport | 
|  | 392 | attributes of SAS disks. | 
|  | 393 | </para> | 
|  | 394 | <para> | 
|  | 395 | For documentation see | 
|  | 396 | <ulink url='http://www.torque.net/sg/sdebug26.html'>http://www.torque.net/sg/sdebug26.html</ulink> | 
|  | 397 | </para> | 
|  | 398 | <!-- !Edrivers/scsi/scsi_debug.c --> | 
|  | 399 | </sect2> | 
|  | 400 | <sect2 id="todo"> | 
|  | 401 | <title>todo</title> | 
|  | 402 | <para>Parallel (fast/wide/ultra) SCSI, USB, SATA, | 
|  | 403 | SAS, Fibre Channel, FireWire, ATAPI devices, Infiniband, | 
|  | 404 | I20, iSCSI, Parallel ports, netlink... | 
|  | 405 | </para> | 
|  | 406 | </sect2> | 
|  | 407 | </sect1> | 
|  | 408 | </chapter> | 
|  | 409 | </book> |