Abstract
In this paper we propose a novel super-resolution based algorithm for the pansharpening of multispectral images. Within the Bayesian formulation, the proposed methodology incorporates prior knowledge on the expected characteristics of multispectral images; that is, it imposes smoothness within each band by means of the energy associated with the ℓ1 norm of vertical and horizontal first order differences of image pixel values and also takes into account the correlation among the bands of the multispectral image. The observation process is modeled using the sensor characteristics of both panchromatic and multispectral images. The method is tested on real and synthetic images, compared with other pansharpening methods, and the quality of the results assessed both qualitatively and quantitatively.
Similar content being viewed by others
References
Aiazzi, B., Alparone, L., Baronti, S., Garzelli, A., & Selva, M. (2006). MTF-tailored multiscale fusion of high-resolution MS and Pan imagery. Photogrammetric Engineering & Remote Sensing, 72(5), 591–596.
Aiazzi, B., Alparone, L., Baronti, S., Pippi, I., & Selva, M. (2002). Generalised Laplacian pyramid-based fusion of MS + P image data with spectral distortion minimisation. ISPRS International Archives of Photogrammetry and Remote Sensing, 34, 3–6.
Alparone, L., Wald, L., Chanussot, J., Thomas, C., Gamba, P., & Bruce, L. M. (2007). Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data-fusion contest. IEEE Transactions on Geoscience and Remote Sensing, 45(10), 3012–3020.
Bioucas-Dias, J., Figueiredo, M., & Oliveira, J. (2006). Total-variation image deconvolution: A majorization-minimization approach. In Proc. of the 2006 int. conf. on acoustics, speech and signal processing (ICASSP’2006) (Vol. 2, pp. II–861–II–864).
Carper, W. J., Lillesand, T. M., & Kiefer, R. W. (1990). The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data. Photographic Engineering & Remote Sensing, 56(4), 459–467.
Cook, M. K., Peterson, B. A., Dial, G., Gibson, L., Gerlach, F. W., Hutchins, K. S., et al. (2001). IKONOS technical performance assessment. Proceedings of SPIE, 4381, 94–108.
Khan, M. M., Alparone, L., & Chanussot, J. (2009). Pansharpening quality assessment using the modulation transfer functions of instruments. IEEE Transactions on Geoscience and Remote Sensing, 47(11), 3880–3891.
Kullback, S., & Leibler, R. A. (1951). On information and sufficiency. Annals of Mathematical Statistics, 22, 79–86.
Lange, K. (2004). Optimization. In Springer texts in statistic. New York: Springer Verlag.
Lillo-Saavedra, M., & Gonzalo, C. (2007). Multispectral images fusion by a joint multidirectional and multiresolution representation. International Journal of Remote Sensing, 28(18), 4065–4079.
Molina, R., Vega, M., Mateos, J., & Katsaggelos, A. K. (2008). Variational posterior distribution approximation in Bayesian super resolution reconstruction of multispectral images. Applied and Computational Harmonic Analysis, 24(2), 251–267.
Nuñez, J., Otazu, X., Fors, O., Prades, A., Pala, V., & Arbiol, R. (1999). Multiresolution-based image fusion with additive wavelet decomposition. IEEE Transactions on Geoscience and Remote Sensing, 37(3), 1204–1211.
Otazu, X., Gonzalez-Audicana, M., Fors, O., & Nuñez, J. (2005). Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods. IEEE Transactions on Geoscience and Remote Sensing, 43(10), 2376–2385.
Price, J. C. (1999). Combining multispectral data of different spatial resolution. IEEE Transactions on Geoscience and Remote Sensing, 37(3), 1199–1203.
Shah, V. P., Younan, N. H., & King, R. L. (2008). An efficient pan-sharpening method via a combined adaptive pca approach and contourlets. IEEE Transactions on Geoscience and Remote Sensing, 46(5), 1323–1335.
Vega, M., Molina, R., & Katsaggelos, A. K. (2009). L1 prior majorization in Bayesian image restoration. In 16th Int. Conf. on Digital Signal Processing.
Vijayaraj, V. (2004). A quantitative analysis of pansharpened images. Master’s thesis, Mississippi St. University.
Wald, L., Ranchin, T., & Mangolini, M. (1997). Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images. Photogrammetric Engineering & Remote Sensing, 63(6), 691–699.
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004). Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4), 600–612.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work has been supported by the “Comisión Nacional de Ciencia y Tecnología” under contract TIN2007-65533 and the Consejería de Innovación, Ciencia y Empresa of the Junta de Andalucía under contracts P07-TIC-02698 and P07-FQM-02701.
Rights and permissions
About this article
Cite this article
Vega, M., Mateos, J., Molina, R. et al. Super Resolution of Multispectral Images using ℓ1 Image Models and Interband Correlations. J Sign Process Syst 65, 509–523 (2011). https://doi.org/10.1007/s11265-010-0554-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11265-010-0554-x