Tuesday, November 21, 2017

The Medium Shrinks the Message: New 4-Color Optical Data Storage

Last weekend I had a second encounter with a popular blurb about a new optical-data-storage technology originating at Case Western Reserve University (my alma mater). A polymer chemist, Emily Pentzer (and co-authors), discovered a way to combine a thermochromic and a photochromic chemical in a polymer film to make four possible colors depending on the stimulation. You can see the essence of the invention in the figure below [1].  The refereed-journal publication is [2].

The promise of the invention is to enable a twofold shrinkage of data storage because you can extract two bits of information (four colors) where previous technologies had enabled only one bit (0 or 1) per storage location.  The medium could be said to shrink the message.

The blurb’s description is a bit cryptic relative to the above goal, so I began a line of investigation that began with pure imagination and ended with obtaining the paper and discussing the matter with its main author.

From [1], I learned that the invention involves a polymer layer that contains two kinds of small molecules in low concentration. Call the two additives P (photochromic, actually o-nitrobenzyl ester of benzoic acid) and T (thermochromic, actually cyano-substituted oligo(p-phenylene vinylene)). When a layer containing P and T (which is tough enough to resist even abrasion by sandpaper) is exposed to no light, it is colorless (black). When that layer is exposed to UV, it fluoresces ultramarine.   When the layer is exposed to heat (perhaps via IR), it fluoresces green. Finally, when the layer is exposed to both heat and uv, it fluoresces cyan.  The colors appear in the figure below. 

To me the text doesn’t describe an encoding system (to which information can be deposited and then retrieved at leisure).  I imagined the following variation of the technology for writing and subsequent reading.  Suppose the stimulation is always a mixture of heat and UV.  If the layer contains neither T nor P, the color is black; if it contains T but not P, the color is green; if it contains P but not T, the color is blue; and if it contains both P and T, the color is light blue.  In this explanation, the information is contained in whether P or T (or both or neither) is applied to the information-storage site.  The stimulating radiation at the moment of retrieval is always the same, because we have no way of knowing in advance which information-laden color will be retrieved.

My departure from [1] was a bad guess, and in retrospect pasting together all those little P and T fragments would be very expensive. I was led to the original paper [2], whose abstract clarifies the mechanism for the write and read algorithms for numbers (0) to (3): “The as-prepared film is non-fluorescent (0), and can be written through a wooden or metal mask with thermal treatment (1), light treatment (2), or both (3), giving three different colours of fluorescence under UV irradiation.”

This explanation still left me wondering how UV can write on the mixture of polymers and yet stops perturbing the medium during the reading process. When you are “reading” the written medium with a UV beam, how do you ensure you don’t change symbol (1) into symbol (3) and symbol (0) into symbol (2)?  In other words, how do you arrange for the medium to be write-once, read-many-times? Accordingly, I conducted a brief e-mail interview with Dr. Pentzer. Here was the essence of it:
Hue Angles: “Am I correct in assuming that the light treatment is UV, and that UV spectrum peaks at 365 nm?”
Pentzer: “Yes, we use a typical hand-held UV lamp like that used to visualize TLC plates.”

Hue Angles: “Is the thermal treatment done with a beam of IR radiation, or do you deliver localized heat with another technology?”

Pentzer: “We actually use a little heat pen. We are currently trying to start a collaboration with engineers/other scientists who can use an IR beam.  We want to combine engineering approaches with our chemistry.”

Hue Angles: “When you are reading the written medium with a UV beam, how do you ensure you don’t change symbol (1) into symbol (3) and symbol (0) into symbol (2)?”

Pentzer: “It really depends on the strength of the UV source. With a hand-held lamp, we can read about 20 minutes before we start to have issues with visibility. So, if we pattern with a strong UV light source, we can read with a handheld lamp---no problem. We also have to ensure we don't expose the patterned films to sunlight for too long...so, it's really a game of reading it only when you need to.”

I’m sure we’ll hear more about this new technology as it develops. With all my speculations gone, the medium will shrink the message still further.

References:
[1]. CWRU researchers find a chemical solution shrinks digital data storage, http://thedaily.case.edu/cwru-researchers-find-chemical-solution-shrinks-digital-data-storage/ . July 5, 2017.
[2] P. Wei, B. Li, A. de Leon, and E. Pentzer, Beyond binary: optical data storage with 0, 1, 2, and 3 in polymer films. J. Mater. Chem. C, 2017, 5, 5780-5786. http://pubs.rsc.org/en/content/articlelanding/2017/tc/c7tc00929a#!divAbstract

Michael H. Brill
Datacolor



        Graphical summary of the new CWRU technology (copied from the website in Ref. 1)

Thursday, September 14, 2017

Does a Mantis Shrimp have a Real Color Space?

The small mantis shrimp (a stomatopod crustacean) has a mean right hook--able to accelerate its “punch” to a speed of 50 mph in a few milliseconds, smashing prey and glass fish tanks. It also has an amazing visual system, with 12 or more different receptor cells covering 300 to 720 nm.


Mantis shrimp from the front.[https://en.wikipedia.org/wiki/Mantis_shrimp]

A fairly recent article by H H Thoen et al. in Science [1] describes two hypotheses for the color vision of a particular mantis shrimp (one of more than 500 known species). The first hypothesis is that the color vision is “like ours” in making opponent-pair comparisons between receptor types that allow good discrimination of wavelength.  The other hypothesis is that the mantis shrimp processes each kind of receptor input (spectral band) separately, a method that would give poor wavelength discrimination but might have other advantages.  It turns out that, despite having many more photoreceptor types than we do, the mantis shrimp has poorer wavelength discrimination. Therefore, Thoen et al conclude that the mantis shrimp has no color space at all, but recognizes reflectances by comparing inputs to each kind of receptor separately.  The idea is that color discrimination (e.g., by humans) is facilitated by a ratio (comparison) between spectral bands at the same point in the visual field, whereas the mantis shrimp performs ratios of inputs at different spatial locations to each spectral band separately, and thereby performs reflectance recognition at 12 spectral bins. The authors claim that the mantis-shrimp spectral sensitivity curves are narrow enough so that within-band ratios derived from them exhibit illuminant invariance (color constancy) and allow the mantis shrimp to accurately recognize a reflectance in 12 bins. But the spectral sensitivity curves of the mantis shrimp, shown in Fig. 1A of the same article, tend to have bandwidths of about 100 nm, similar to our own receptor sensitivities. The poor wavelength discrimination of the mantis shrimp seems to be experimental fact, and that would imply a reduced inter-band comparison.  However, that does not mean color constancy by within-band ratios must be enhanced in this animal. 

Another of these authors’ ideas seems to have more traction. If the bands act separately, the neural processing may be accelerated to match the mantis shrimp’s top-speed lifestyle.  The quickly passing world could be processed by a kind of “push-broom sensor” architecture, whereby the 12 kinds of receptors are arranged in one spatial direction, replicates of the arrangement occupy the perpendicular spatial direction, and motion in the first spatial direction accumulates spatial details in a time-encoded form.  Such a design is common for the push-broom sensors that we use in our remote sensing apparatus based on the same principle.

Yet another idea from Thoen et al. is also worth mention: These authors seem to believe that a true color space requires inter-band comparisons, and that such comparisons impose a processing overhead that may not be acceptable to a simple if strongly aggressive creature such as the mantis shrimp.  This rationale bears comparison with the idea, briefly explored by Mark Fairchild ([2], [3]), that even humans don’t need a color space at all, and that what we call color can be expressed with a small number of one-dimensional scales. By this reasoning, color space is a construct of theory, and not intrinsic to visual information. 

Such discussion will inevitably lead to a philosophical and definitional problem.  What, after all, comprises a color space, versus “not-a-space”? Mark Fairchild required a space to have a metric, but I think that requirement could be waived, as could Thoen’s band-comparison requirement.  To me a space is just a representation that allows important features to be salient.  It’s hard to visualize a structure in a 12-dimensional space (such as that of the mantis shrimp investigated by Thoen, et al.), if that space is represented in conventional rectangular coordinates.  But there’s an alternative picture, in which the 12 coordinate axes are lined up parallel with each other and evenly spaced in a plane. Each spectrum is a 12-component object in the space, and shows up as a point on each of the parallel one-dimensional axes.  The original 12D point is represented as an open polygon, with vertices being the component values along the consecutive axes, and line segments connecting the consecutive vertices. Such a structure allows you to see 12-dimensional structures in two dimensions. For example, all the points on a line in the 12-dimensional rectangular space generate a set of 11 intersection points that characterize the line.  The use of parallel coordinates to represent high-dimensional data was invented by Alfred Inselberg more than 30 years ago [4].  Maybe our champion mantis shrimp is using such a representation to track prey, detect mates, and fool anthropocentric color researchers. 

Representative sample of parallel coordinates [By Yug - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=37631153]

References:

[1]. H H Thoen, M J How, T-H Chiou, and J Marshall. A different form of color vision in mantis shrimp. Science Vol. 343, 24 Jan 2014, 411- 413.

[2] M D Fairchild. Is there really such a thing as color space? Foundations of uni-dimensional appearance spaces. ISCC/IS&T/SID Special Topics Meeting Revisiting Color Spaces, San Jose CA (2011), 21-22.

[3] M D Fairchild and R L Heckaman. Deriving appearance scales. IS&T Color and Imaging Conference 20 (2012), 281-287.

[4] A Inselberg. The plane with parallel coordinates. Visual Computer 1 (4): 69-91 (1985).

Michael H. Brill
Datacolor