Please consider a donation to the Higher Intellect project. See https://preterhuman.net/donate.php or the Donate to Higher Intellect page for more info.

Difference between revisions of "Driving the Digitized World"

From Higher Intellect Vintage Wiki
Jump to navigation Jump to search
(Created page with "<p>The rapid transformation of our world into a digitized world � one in which vast amounts of alphanumeric, audio, and video information are stored in digital, rather th...")
 
 
Line 1: Line 1:
 +
<h3>Introduction</h3>
 
<p>The rapid transformation of our world into a digitized world &#151; one in
 
<p>The rapid transformation of our world into a digitized world &#151; one in
 
which vast amounts of alphanumeric, audio, and video information are stored in
 
which vast amounts of alphanumeric, audio, and video information are stored in
Line 6: Line 7:
 
scenes, helping to move this information revolution from pipedream to widespread
 
scenes, helping to move this information revolution from pipedream to widespread
 
reality, is today&#146;s faster, reliable and economical hard disk drives.</p>  
 
reality, is today&#146;s faster, reliable and economical hard disk drives.</p>  
 
  
 
<p>Most desktop computers include 3.5-inch drives that provide the storage
 
<p>Most desktop computers include 3.5-inch drives that provide the storage
Line 13: Line 13:
 
must provide increased capacities at lower costs in order to accommodate the
 
must provide increased capacities at lower costs in order to accommodate the
 
delivery of digitized applications to end users.</p>  
 
delivery of digitized applications to end users.</p>  
 
  
 
<p>High-end drives, which offer even higher capacities and more performance
 
<p>High-end drives, which offer even higher capacities and more performance
Line 19: Line 18:
 
high-end digitized applications:  professional video and audio production,
 
high-end digitized applications:  professional video and audio production,
 
video-on-demand, E-mail, medical imaging and satellite communications.</p>  
 
video-on-demand, E-mail, medical imaging and satellite communications.</p>  
 
  
 
<p>In order to meet the needs of these particularly storage-intensive
 
<p>In order to meet the needs of these particularly storage-intensive
 
applications, hard disk drives must be able to provide:</p>  
 
applications, hard disk drives must be able to provide:</p>  
 
  
 
<ul>  
 
<ul>  
Line 32: Line 29:
 
<li>High reliability  
 
<li>High reliability  
 
</ul>  
 
</ul>  
 
  
 
<h3>Unlimited Capacities</h3>  
 
<h3>Unlimited Capacities</h3>  
 
  
 
<p>The capacity rule today is &#147;you can never have too much.&#148;  
 
<p>The capacity rule today is &#147;you can never have too much.&#148;  
Line 44: Line 39:
 
space.  With these demands, it is easy to see why high capacities in digitized
 
space.  With these demands, it is easy to see why high capacities in digitized
 
applications are a necessity &#151; not a luxury.</p>  
 
applications are a necessity &#151; not a luxury.</p>  
 
  
 
<p>Drive capacity is typically increased by altering the mechanical design or
 
<p>Drive capacity is typically increased by altering the mechanical design or
Line 50: Line 44:
 
adding more disks and heads.  Though this is a common and widely accepted
 
adding more disks and heads.  Though this is a common and widely accepted
 
practice, it does add expense and complicates manufacturing.</p>  
 
practice, it does add expense and complicates manufacturing.</p>  
 
  
 
<p>Increasing the drive&#146;s areal density also results in increased storage
 
<p>Increasing the drive&#146;s areal density also results in increased storage
Line 60: Line 53:
 
peak detect read channels and inductive head technology used since the
 
peak detect read channels and inductive head technology used since the
 
introduction of the first hard disk drives.</p>  
 
introduction of the first hard disk drives.</p>  
 
  
 
<p>The fact that 3.5-inch drives now offer 9GB versus 4GB just one year ago,
 
<p>The fact that 3.5-inch drives now offer 9GB versus 4GB just one year ago,
Line 69: Line 61:
 
cabinet.  Thus, today&#146;s Internet and video servers add a whole new meaning
 
cabinet.  Thus, today&#146;s Internet and video servers add a whole new meaning
 
to the term &#147;capacity requirements.&#148;</p>  
 
to the term &#147;capacity requirements.&#148;</p>  
 
  
 
<h3>High Random Throughput</h3>  
 
<h3>High Random Throughput</h3>  
 
  
 
<p>Superior random throughput is required of high-end drives in the digitized
 
<p>Superior random throughput is required of high-end drives in the digitized
Line 81: Line 71:
 
voicemail, the Internet and other on-line database services are highly dependent
 
voicemail, the Internet and other on-line database services are highly dependent
 
on rapid random throughput.</p>  
 
on rapid random throughput.</p>  
 
  
 
<p>Random throughput can be increased by reducing a drive&#146;s command
 
<p>Random throughput can be increased by reducing a drive&#146;s command
Line 89: Line 78:
 
by executing SCSI commands in hardware rather than firmware.  Average rotational
 
by executing SCSI commands in hardware rather than firmware.  Average rotational
 
latency is also improved with drive spin speeds as high as 7,200 RPM.</p>  
 
latency is also improved with drive spin speeds as high as 7,200 RPM.</p>  
 
  
 
<p>Random throughput can be improved by adding intelligence to the drive design.
 
<p>Random throughput can be improved by adding intelligence to the drive design.
Line 98: Line 86:
 
feature reduces average latency by 20 percent by reordering and optimizing
 
feature reduces average latency by 20 percent by reordering and optimizing
 
commands, looking for the shortest total seek plus latency times.</p>  
 
commands, looking for the shortest total seek plus latency times.</p>  
 
  
 
<h3>High Sequential Throughput</h3>  
 
<h3>High Sequential Throughput</h3>  
 
  
 
<p>High sequential throughput is essential for such applications as video
 
<p>High sequential throughput is essential for such applications as video
Line 115: Line 101:
 
throughput of hard disk drives has improved by about 30 percent per year over
 
throughput of hard disk drives has improved by about 30 percent per year over
 
the last few years.</p>  
 
the last few years.</p>  
 
  
 
<p>High sequential throughput is essential for such applications as video
 
<p>High sequential throughput is essential for such applications as video
Line 129: Line 114:
 
throughput of hard disk drives has improved by about 30 percent per year over
 
throughput of hard disk drives has improved by about 30 percent per year over
 
the last few years.</p>  
 
the last few years.</p>  
 
  
 
<h3>Uninterrupted Throughput</h3>  
 
<h3>Uninterrupted Throughput</h3>  
 
  
 
<p>In addition to providing fast sequential throughput, the drive system must
 
<p>In addition to providing fast sequential throughput, the drive system must
Line 142: Line 125:
 
uninterrupted data flow.  If part of the signal is lost, the entire dataset must
 
uninterrupted data flow.  If part of the signal is lost, the entire dataset must
 
be resent, with prohibitively expensive results.</p>  
 
be resent, with prohibitively expensive results.</p>  
 
  
 
<p>Today, there are two primary causes of  momentary pauses in the data stream:  
 
<p>Today, there are two primary causes of  momentary pauses in the data stream:  
Line 150: Line 132:
 
eliminate head misalignments that require off-line and often time consuming
 
eliminate head misalignments that require off-line and often time consuming
 
TCALs to ensure data integrity.</p>  
 
TCALs to ensure data integrity.</p>  
 
  
 
<p>Interruptions can also be eliminated by correcting errors on-the-fly, rather
 
<p>Interruptions can also be eliminated by correcting errors on-the-fly, rather
Line 157: Line 138:
 
in length in realtime.  This capability better ensures continuous transmission
 
in length in realtime.  This capability better ensures continuous transmission
 
of video, audio and other data streams.</p>  
 
of video, audio and other data streams.</p>  
 
  
 
<h3>High Reliability</h3>  
 
<h3>High Reliability</h3>  
 
  
 
<p>Hard drive reliability is crucial for servers handling mission-critical data.
 
<p>Hard drive reliability is crucial for servers handling mission-critical data.
Line 169: Line 148:
 
five disks achieve the 4GB capacity point that required ten disks just one year
 
five disks achieve the 4GB capacity point that required ten disks just one year
 
ago.</p>  
 
ago.</p>  
 
  
 
<p>Drive reliability is further improved through rigorous environment testing.  
 
<p>Drive reliability is further improved through rigorous environment testing.  
Line 177: Line 155:
 
drives.</p>  
 
drives.</p>  
  
 
+
<p><big>A terabyte &#147;site&#148; for a virtual world&#146;s fair</big></p>  
<p><big>A terabyte &#147;site&#148; for a virtual
 
world&#146;s fair</big></p>  
 
 
 
  
 
<p>The new role of high-capacity 3.5-inch drives in the digitized world is
 
<p>The new role of high-capacity 3.5-inch drives in the digitized world is
Line 189: Line 164:
 
be distributed to content providers around the globe. The drives will constitute
 
be distributed to content providers around the globe. The drives will constitute
 
one of the largest collections of data storage ever assembled.</p>  
 
one of the largest collections of data storage ever assembled.</p>  
 
  
 
<p>Preliminary plans include storage solutions for everything from a Global
 
<p>Preliminary plans include storage solutions for everything from a Global
Line 196: Line 170:
 
Huis Ten Bosch, a city near Nagasaki that has become a model for environmental
 
Huis Ten Bosch, a city near Nagasaki that has become a model for environmental
 
activism.</p>  
 
activism.</p>  
 
  
 
<p>As a virtual event, the Exposition&#146;s size is measured not in acres, but
 
<p>As a virtual event, the Exposition&#146;s size is measured not in acres, but

Latest revision as of 02:03, 8 October 2020

Introduction

The rapid transformation of our world into a digitized world &#151; one in which vast amounts of alphanumeric, audio, and video information are stored in digital, rather than analog form, &#151; has impacted today&#146;s home and work environments. Digital information can be manipulated by computer users, transmitted over networks, and randomly accessed and retrieved. Behind the scenes, helping to move this information revolution from pipedream to widespread reality, is today&#146;s faster, reliable and economical hard disk drives.

Most desktop computers include 3.5-inch drives that provide the storage needed to create graphics or presentations, play multimedia-based computer games, or download information after &#147;surfing the net.&#148; These drives must provide increased capacities at lower costs in order to accommodate the delivery of digitized applications to end users.

High-end drives, which offer even higher capacities and more performance features than their desktop counterparts, are an enabling technology for high-end digitized applications: professional video and audio production, video-on-demand, E-mail, medical imaging and satellite communications.

In order to meet the needs of these particularly storage-intensive applications, hard disk drives must be able to provide:

  • Ever-increasing capacities
  • High random throughput
  • High sequential throughput
  • Uninterrupted data streams
  • High reliability

Unlimited Capacities

The capacity rule today is &#147;you can never have too much.&#148; Today&#146;s high-end 3.5-inch drives, such as the Quantum Atlas&#153; II and Quantum Empire&#153; II drives offer as much as nine gigabytes (GB). Depending on the compression method used, half an hour of audio requires about 30 megabytes (MB) and one hour of video requires approximately 2GB of storage space. With these demands, it is easy to see why high capacities in digitized applications are a necessity &#151; not a luxury.

Drive capacity is typically increased by altering the mechanical design or improving areal density (capacity per disk). The first method involves simply adding more disks and heads. Though this is a common and widely accepted practice, it does add expense and complicates manufacturing.

Increasing the drive&#146;s areal density also results in increased storage capacity. Commonly measured in bits per square inch, areal density has been doubling every 18 months over the last three years. The most advanced drives accomplish this feat by incorporating new Partial Response Maximum Likelihood (PRML) read channels, new magnetoresisitive (MR) heads, or a combination of the two technologies. PRML read channels and MR heads will eventually replace the peak detect read channels and inductive head technology used since the introduction of the first hard disk drives.

The fact that 3.5-inch drives now offer 9GB versus 4GB just one year ago, demonstrates the ability of drive vendors to improve areal density at amazing rates. But consider the Internet or video-on-demand, both of which can easily consume terabytes (1,000 gigabytes) of storage space. To achieve these desired capacities, servers today may feature 60 or more drives housed in a single cabinet. Thus, today&#146;s Internet and video servers add a whole new meaning to the term &#147;capacity requirements.&#148;

High Random Throughput

Superior random throughput is required of high-end drives in the digitized world &#151; especially when used in server environments. Video servers, for example, allow multiple viewers to access and watch the same movie &#151; with each viewer able to pause, rewind and fast forward, as if they were using their own personal VCR. These and other digitized applications such as E-mail, voicemail, the Internet and other on-line database services are highly dependent on rapid random throughput.

Random throughput can be increased by reducing a drive&#146;s command overhead time, head seek and settle time, and rotational latency (which occurs when the head arrives at the appointed track, but then must wait for the requested data to rotate under it). Command overhead, for example, is reduced by executing SCSI commands in hardware rather than firmware. Average rotational latency is also improved with drive spin speeds as high as 7,200 RPM.

Random throughput can be improved by adding intelligence to the drive design. Quantum drives, for example, now incorporate the built-in processing power of a 386 chip to control the inner workings of the drives. This increased intelligence is used to add new features including advanced reordering algorithms. Quantum&#146;s Optimized Reordering Command Algorithm (ORCA&#153;) feature reduces average latency by 20 percent by reordering and optimizing commands, looking for the shortest total seek plus latency times.

High Sequential Throughput

High sequential throughput is essential for such applications as video editing, medical imaging and satellite communications &#151; applications in which the data stream flows in realtime. Sequential throughput can be improved by incorporating faster read channel electronics (such as PRML) into the drive. PRML read channels enable both higher areal densities and higher internal data rates because they permit more and more bits to be packed onto a disk&#146;s surface. The Quantum Atlas II and Quantum Empire II drives provide industry-leading internal data rates of 110 and 90 megabits per second, respectively. These internal data rates, in turn, have led to the fast sequential throughput required by digitized applications. The sequential throughput of hard disk drives has improved by about 30 percent per year over the last few years.

High sequential throughput is essential for such applications as video editing, medical imaging and satellite communications &#151; applications in which the data stream flows in realtime. Sequential throughput can be improved by incorporating faster read channel electronics (such as PRML) into the drive. PRML read channels enable both higher areal densities and higher internal data rates because they permit more and more bits to be packed onto a disk&#146;s surface. The Quantum Atlas II and Quantum Empire II drives provide industry-leading internal data rates of 110 and 90 megabits per second, respectively. These internal data rates, in turn, have led to the fast sequential throughput required by digitized applications. The sequential throughput of hard disk drives has improved by about 30 percent per year over the last few years.

Uninterrupted Throughput

In addition to providing fast sequential throughput, the drive system must also ensure that the transmission is free of interruptions. Even a slight interruption can have large consequences on sequential operations. For example, a medical imaging device, such as a CAT scan machine, spews out data to a buffer and from there to a disk drive. If the drive is not fast enough, the buffer can overflow, and data will be lost. A satellite transmission also requires uninterrupted data flow. If part of the signal is lost, the entire dataset must be resent, with prohibitively expensive results.

Today, there are two primary causes of momentary pauses in the data stream: thermal recalibrations (TCALs) and time-consuming error correction schemes. Quantum and recently, other drive vendors have eliminated TCALs by implementing an advanced embedded servo (head positioning) scheme. Embedded servo schemes eliminate head misalignments that require off-line and often time consuming TCALs to ensure data integrity.

Interruptions can also be eliminated by correcting errors on-the-fly, rather than shifting into separate and lengthy firmware error recovery routines. Quantum&#146;s current generation of drives can correct errors of up to 73 bits in length in realtime. This capability better ensures continuous transmission of video, audio and other data streams.

High Reliability

Hard drive reliability is crucial for servers handling mission-critical data. Drive reliability has improved with higher levels of ASIC integration, fewer moving parts within the drive and through power reduction. Quantum high-end drives use just one single-sided printed circuit board (PCB) as compared to early high-end drives that had as many as four interconnected PCBs. And now, five disks achieve the 4GB capacity point that required ten disks just one year ago.

Drive reliability is further improved through rigorous environment testing. For example, the PCBs of Quantum drives are tested over a broader range of temperatures (-40°C to 100°C). This and other types of stress testing provides valuable information to Quantum engineers who can design more robust drives.

A terabyte &#147;site&#148; for a virtual world&#146;s fair

The new role of high-capacity 3.5-inch drives in the digitized world is exemplified by the Internet 1996 World Exposition, a virtual world&#146;s fair for the information age, conceived of by Carl Malamud, founder of the Internet Multicasting Society. As an official organizer of the event, Quantum is donating more than a terabyte worth of storage space in the form of 250 drives that will be distributed to content providers around the globe. The drives will constitute one of the largest collections of data storage ever assembled.

Preliminary plans include storage solutions for everything from a Global Schoolhouse to an online exhibit of Thai food. Washington&#146;s Kennedy Center will host performances in cyberspace, and one exhibit will feature a virtual Huis Ten Bosch, a city near Nagasaki that has become a model for environmental activism.

As a virtual event, the Exposition&#146;s size is measured not in acres, but in gigabytes. As Malamud has noted, &#147;Our Eiffel Tower is 1.2 terabytes of disk space.&#148; For this event, and for future applications of the digitized world, the disk drive is the stuff that 21st century dreams are made of.

See Also