Multimodal volume visualization

In "Volume Analysis Using Multimodal Surface Similarity", authors use the similarity between 2 registered volume to help users create meaningful visualization.

The similarity map, a 2D matrix, represents a measure of the similarity between every possible combination of isosurface in the volumes. For example, the value of the map at x = ( 5, 24 ) is a measure of the mutual information between isosurface of value 5 in the first volume and isosurface of value 24 in the second volume. Each cell in the map is computed by first building a distance map for each of the volumes. The distance map is a volume in which each voxel contains the shortest distance to the considered isosurface. Then, the mutual information of the 2 volumes is computed and become an entry in  the similarity map.

The similarity map can be used as an intuitive way to define a transfer function. Users can place points on the similarity map at interesting locations and assign colors and opacity to those points. The contribution of each sample in the volume to the final rendering is computed by using the colors and opacity of the nearest neighbor control points in similarity space. The figure below shows a similarity map with the control points on the left and the resulting volume rendering on the right.

Image from the paper available here

Learn from basic perception principles

The tutorial on Perception and Cognition for Visualization, Visual Data Analysis and Computer Graphics was a little shallow considering the audience. The whole morning session could have been concatenated into a half hour session without loosing any content. I still got a couple of useful insights from it to improve visualization.

A good visualization is one for which equal steps in data values produces equal perceptual steps. The next graph shows that not all visual dimensions are equal in that respect. Ideal slope is 1.

It is interesting to view the human visual system as a band-pass filter. The system is most sensitive in the a mid-range spacial frequency, but most importantly, we see from the graph that luminance is much more efficient for representing high-frequency visual details.

It is thus a good idea to use intensity to display high-frequency details in an image. On the other hand, color coding should be used for very low frequency information.

Color attracts pre-attention. It can be used by the visual system to perform an effortless search (see picture below). But color should be used with moderation. Large patches of bright color have very little effect.

The perception of a scene is highly influenced by the nature of the task performed by the viewer. The intention drives visual behavior.

Images in this post are all from the presenter's slides available here.