Abstract
Recently, the application of Independent Component Analysis (ICA) to natural images has raised a great interest. Some outstanding features have been observed, like the sparse distribution of the independent components and the special appearance of the ICA bases (most of them look like edges). This paper provides a new insight on this behaviour, being supported by experimental results. In particular, a mathematical proof of the relation between ICA and sparse coding is given.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Barlow, H.: Sensory Communication. Possible Principles Underlying the Transformation of Sensory Messages, pp. 217–234. MIT Press, Cambridge (1961)
Bell, A., Sejnowski, T.: The “Independent Components” of Natural Scenes are Edge Filters. Vision Research 37(23), 3327–3338 (1997)
Cao, X., Liu, R.: General Approach to Blind Source Separation. IEEE Transactions on Signal Processing 44(3), 562–571 (1996)
Cichocki, A., Amari, S.I.: Adaptive Blind Signal and Image Processing. John Willey & Sons, West Sussex (2002)
Field, F.: What is the Goal of Sensory Coding? Neural Computation 6, 559–601 (1994)
Hornillo-Mellado, S., Martín-Clemente, R., Puntonet, C.G., Acha, J.I.: Application of Independent Component Analysis to Edge Detection. In: Proc. World Automation Congress (WAC 2004), Sevilla, Spain (2004)
Hornillo-Mellado, S., Martín-Clemente, R., Acha, J.I., Puntonet, C.G.: Application of Independent Component Analysis to Edge Detection and Watermarking. In: Mira, J., Álvarez, J.R. (eds.) IWANN 2003. LNCS, vol. 2687, pp. 273–280. Springer, Heidelberg (2003)
Hyvärinen, A., Hoyer, P.O., Hurri, J.: Extensions of ICA as Models of Natural Images and Visual Processing. In: Proc. International Symposium on Independent Component Analysis and Blind Signal Separation (ICA 2003), Nara, Japan, pp. 963–974 (2003)
Hyvärinen, A., Karhunen, J., Oja, E.: Independent Component Analysis. Wiley-Interscience, John Wiley & Sons (2001)
Hyvärinen, A., Oja, E.: A Fast Fixed-Point Algorithm for Independent Component Analysis. Neural Computation 6, 1484–1492 (1997)
Olshausen, B.A., Field, D.J.: Sparse Coding with an Overcomplete Basis Set: A Strategy Employed by V1? Vision Research 37(23), 3311–3325 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hornillo-Mellado, S., Martín-Clemente, R., Górriz-Sáez, J.M. (2005). Connections Between ICA and Sparse Coding Revisited. In: Cabestany, J., Prieto, A., Sandoval, F. (eds) Computational Intelligence and Bioinspired Systems. IWANN 2005. Lecture Notes in Computer Science, vol 3512. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11494669_127
Download citation
DOI: https://doi.org/10.1007/11494669_127
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26208-4
Online ISBN: 978-3-540-32106-4
eBook Packages: Computer ScienceComputer Science (R0)