Journal of Radio Electronics. eISSN 1684-1719. 2023. ¹11
ContentsFull text in Russian (pdf)
DOI: https://doi.org/10.30898/1684-1719.2023.11.30
neuromorphic method for coding / restoring images
specified by a stream of poisson counts
V.E. Antsiperov
125009, Russia, Moscow, Mokhovaya str., 11, b.7
The paper was received November 30, 2023.
Abstract. The paper discusses one of the possible neuromorphic methods for processing relatively large volumes of streaming data. The method is mainly motivated by the known mechanisms of sensory perception of living systems, in particular, methods of visual perception. In this regard, the main provisions of the method are discussed in the context of problems of encoding/recovering images on the periphery of the visual system. The proposed method is focused on representing input data in the form of a stream of discrete events (samples), similar to the discharge events of retinal neurons. For these purposes, a special representation of data streams is used in the form of a controlled size sample of counts (sampling representations). Based on the specifics of the sampling representation, the generative data model is naturally formalized in the form of a system of components distributed over the field of view. Within the framework of the generative model, the optimal coding problem is formulated into the problem of searching for maximum likelihood estimates. The solution to the last problem was carried out on the basis of structuring an array of components in the form of receptive fields model, embodying universal principles (including lateral inhibition) of the neural network of the brain. The mechanism of lateral inhibition is implemented in the model in the form of an antagonistic center / environment structure of the RP. Issues of image decoding are considered in the context of restoring spatial contrasts, which partly emulates the work of the so-called simple cells of the visual cortex. It is shown that the model of coupled ON-OFF decoding allows for the restoration of sharp image details in the form of emphasizing edges, and the connection of the method with the so-called retinex theory is noted.
Key words: neuromorphic methods, Poisson samples, sampling representation, receptive fields, edge-directed image interpolation
Financing: The work was carried out at the expense of budgetary financing within the framework of the state order at the Kotel’nikov Institute of Radio-Engineering and Electronics of the Russian Academy of Sciences (State Assignment “RELDIS”).
Corresponding author: Antsiperov Viaheslav, antciperov@cplire.ru
References
1. Nguyen G. et al. Machine learning and deep learning frameworks and libraries for large-scale data mining: a survey //Artificial Intelligence Review. – 2019. – Ò. 52. – Ñ. 77-124. DOI: https://doi.org/10.1007/s10462-018-09679-z .
2. Christensen D. V. et al. 2022 roadmap on neuromorphic computing and engineering //Neuromorph. Comput. Eng. – 2022. – Ò. 2. – Ñ. 022501. DOI: https://doi.org/10.1088/2634-4386/ac4a83
3. Antsiperov V. E. Generative Model of Autoencoders Self-Learning on Images Represented by Count Samples //Automation and Remote Control. – 2022. – Ò. 83. – ¹. 12. – Ñ. 1959-1983. https://doi.org/10.1134/S00051179220120098
4. Kuffler S. W. Discharge patterns and functional organization of mammalian retina //Journal of neurophysiology. – 1953. – Ò. 16. – ¹. 1. – Ñ. 37-68. https://doi.org/10.1152/jn.1953.16.1.37.
5. Marr D., Hildreth E. Theory of edge detection //Proceedings of the Royal Society of London. Series B. Biological Sciences. – 1980. – Ò. 207. – ¹. 1167. – Ñ. 187-217. https://doi.org/10.1098/rspb.1980.0020.
6. Bear M. F., Connors B. W., Paradiso M. A. The eye //Neuroscience: Exploring the Brain,. – 2007. – Ñ. 277-307.
7. Allebach J., Wong P. W. Edge-directed interpolation //Proceedings of 3rd IEEE International Conference on Image Processing. – IEEE, 1996. – Ò. 3. – Ñ. 707-710. https://doi.org/10.1109/icip.1996.560768
8. Antsiperov V. New Centre/Surround Retinex-like Method for Low-Count Image Reconstruction //Proceedings of the 12th International Conference on Pattern Recognition Applications and Methods-ICPRAM. – SciTePress, 2023. – Ñ. 517-528. https://doi.org/10.5220/0011792800003411
9. Antsiperov V., Kershner V. Retinotopic image encoding by samples of counts //International Conference on Pattern Recognition Applications and Methods. – Cham : Springer International Publishing, 2021. – Ñ. 52-75. https://doi.org/10.1007/978-3-031-24538-1_3
10. Barrett H. H., White T., Parra L. C. List-mode likelihood //JOSA A. – 1997. – Ò. 14. – ¹. 11. – Ñ. https://doi.org/10.1364/JOSAA.14.002914
11. Young G. A., Smith R. L. Essentials of statistical inference. – Cambridge University Press, 2005. – Ò. 16.
12. Land E. H. The retinex theory of color vision //Scientific American. – 1977. – Ò. 237. – ¹. 6. – Ñ. 108-129. https://doi.org/10.1038/scientificamerican1277-108.
For citation:
Antsiperov V.E. Neuromorphic method for coding / restoring images specified by a stream of Poisson counts. // Journal of Radio Electronics. – 2023. – ¹. 11. https://doi.org/10.30898/1684-1719.2023.11.30 (In Russian)