Abstract
Color blending is a popular display method for functional and anatomic image fusion. The underlay image is typically displayed in grayscale, and the overlay image is displayed in pseudo colors. This pixel-level fusion provides too much information for reviewers to analyze quickly and effectively and clutters the display. To improve the fusion image reviewing speed and reduce the information clutter, a pixel-feature hybrid fusion method is proposed and tested for PET/CT images. Segments of the colormap are selectively masked to have a few discrete colors, and pixels displayed in the masked colors are made transparent. The colormap thus creates a false contouring effect on overlay images and allows the underlay to show through to give contours an anatomic context. The PET standardized uptake value (SUV) is used to control where colormap segments are masked. Examples show that SUV features can be extracted and blended with CT image instantaneously for viewing and diagnosis, and the non-feature part of the PET image is transparent. The proposed pixel-feature hybrid fusion highlights PET SUV features on CT images and reduces display clutters. It is easy to implement and can be used as complementarily to existing pixel-level fusion methods.
This is a preview of subscription content, log in via an institution to check access.
References
Hutton BF, Braun M, Thurfjell L, Lau DYH: Image registration: an essential tool for nuclear medicine. Eur J Nucl Med 29:559–577, 2002
Quarantelli M, Alfano B, Larobina M, Tedeschi E, Brunetti A, Covelli EM, Ciarmiello A, Mainolfi C, Salvatore M: Frequency encoding for simultaneous display of multimodality images. J Nucl Med 40:442–447, 1999
Laliberte F, Gagnon L, Sheng Y: Registration and fusion of retinal images – An evaluation study. IEEE Trans Med Imag 22:661–673, 2003
Kim J, Cai W, Eberl S, Feng D: Real-time volume rendering visualization of dual-modality PET/CT images with interactive fuzzy thresholding segmentation. IEEE Trans Infor Technol Biomed 11:161–169, 2007
Foley JD, van Dam A, Feiner SK, Hughes JF: Computer Graphics: Principles and Practice, 2nd edition. Boston: Addison-Wesley, 1996
Thie JA: Understanding the standardized uptake value, its methods, and implications for usage. J Nucl Med 45:1431–1434, 2004
Armbrust M, Fox A, Griffith R, Joseph AD, Katz R, Konwinski A, Lee G, Patterson D, Rabkin A, Stoica I, Zaharia M: Above the clouds: A Berkeley view of cloud computing, Feb. 2009 (available at http://www.eecs.berkeley.edu/Pubs/TechRpts/2009/EECS-2009-28.html, accessed Nov. 2009).
Gonzalez RC, Woods RE: Digital Image Processing, Boston: Addison-Wesley, 1992
Woo M, Neider J, Davis T, Shreiner D: OpenGL Programming Guide, 3rd edition. Boston: Addison-Wesley, 1999
Acknowledgements
The authors would like to thank Sanjay Gopal for stimulating discussions and reviewers for constructive comments and suggestions. Kaichun Wang implemented the image fusion algorithm in the presence of the KeyColor discussed in “Colormaps for Feature Extraction”.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhu, YM., Nortmann, C.A. Pixel-Feature Hybrid Fusion for PET/CT Images. J Digit Imaging 24, 50–57 (2011). https://doi.org/10.1007/s10278-009-9259-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10278-009-9259-8