An efficient Convolutional Neural Network (CNN) Based Image Colorization Technique
PDF

Keywords

Image, colorization, convolutional neural network, gray-scale, features

How to Cite

Wasim, M., Ahmed, L. ., Najib, M. S. ., Khalil, M. T. ., Ali, M. W. ., & Khan, . A. A. . (2022). An efficient Convolutional Neural Network (CNN) Based Image Colorization Technique. KIET Journal of Computing and Information Sciences, 6(1), 82-92. https://doi.org/10.51153/kjcis.v6i1.159

Abstract

Color in any image playing a vital role for better understanding and real image visualization. In past when there was no concept of colored images each black and white image need to highlight its own merits to explain an image in a better way, but when the concept of colored images started the things were totally changed to describe and highlight key features and attributes of an image in a more better and effective manner. The key issue is that the old images and videos are color less and in some cases it needs to be colorized. There are a number of applications are uses to colorized a gray-scale image. The authors of this paper also presented an efficient deep learning based image colorization technique.  The proposed system maps all the gray contrast pixels of the image into its corresponding colored pixels to produce a colored image using Convolutional Neural Network (CNN) technique. The proposed system is totally an automated system and it avoid any manual work or user hand-define rules. The system first read the gray contrast of each pixel of image; matches function then create the corresponding color contrast from the color map and finally convert the gray contrast image into color image. The system tested around 100 images and found accuracy about 95%.

https://doi.org/10.51153/kjcis.v6i1.159
PDF

References

Zhang, Richard, Phillip Isola, and Alexei A. Efros. "Colorful image colorization." European conference on computer vision. Springer, Cham, 2016.

Xia, Menghan, Xueting Liu, and Tien-Tsin Wong. "Invertible grayscale." ACM Transactions on Graphics (TOG) 37.6 (2018): 1-10.

Al Azzeh, Jamil, et al. "Creating a color map to be used to convert a gray image to color image." International Journal of Computer Applications 153.2 (2016): 31-34.

Kumar, Smriti, and Ayush Swarnkar. "Colorization of gray scale images in l?? color space using mean and standard deviation." 2012 IEEE Students' Conference on Electrical, Electronics and Computer Science. IEEE, 2012.

Haldankar, Govind, Atul Tikare, and Jayprabha Patil. "Converting gray scale image to color image." Proceedings of SPIT-IEEE Colloquium and International Conference, Mumbai, India. Vol. 1. No. 189. 1989.

Karlik, Bekir, and Mustafa Sariöz. "Coloring gray-scale image using artificial neural networks." 2009 2nd International conference on adaptive science & technology (ICAST). IEEE, 2009.

Karlik, Bekir, and Mustafa Sariöz. "Coloring gray-scale image using artificial neural networks." 2009 2nd International conference on adaptive science & technology (ICAST). IEEE, 2009.

Yu, Lu, et al. "Beyond eleven color names for image understanding." Machine Vision and Applications 29.2 (2018): 361-373.

Al-Azzeh, Jamil, Ziad Alqadi, and Mohammed Abuzalata. "Performance Analysis of Artificial Neural Networks used for Color Image Recognition and Retrieving." international Journal of Computer Science and Mobile computing 8.2 (2019): 20-33.

Chary, R., D. Rajya Lakshmi, and K. V. N. Sunitha. "Feature extraction methods for color image similarity." arXiv preprint arXiv:1204.2336 (2012).

Kuo, Cheng-Hao, Sameh Khamis, and Vinay Shet. "Person re-identification using semantic color names and rankboost." 2013 IEEE workshop on applications of computer vision (WACV). IEEE, 2013.

Ansari, Mohd, and Dushyant Kumar Singh. "Significance of Color Spaces and Their Selection for Image Processing: A Survey." Recent Advances in Computer Science and Communications (Formerly: Recent Patents on Computer Science) 15.7 (2022): 946-956.

Mandloi, Gaurav. "A survey on feature extraction techniques for color images." International Journal of Computer Science and Information Technologies 5.3 (2014): 4615-4620.

Anwar, Saeed, et al. "Image colorization: A survey and dataset." arXiv preprint arXiv:2008.10774 (2020).

Huang, Shanshan, et al. "Deep learning for image colorization: Current and future prospects." Engineering Applications of Artificial Intelligence 114 (2022): 105006.

Dhir, Rashi, Meghna Ashok, and Shilpa Gite. "An overview of advances in image colorization using computer vision and deep learning techniques." Review of Computer Engineering Research 7.2 (2020): 86-95.

Royer, Amelie, Alexander Kolesnikov, and Christoph H. Lampert. "Probabilistic image colorization." arXiv preprint arXiv:1705.04258 (2017).

Varga, Domonkos, and Tamás Szirányi. "Fully automatic image colorization based on Convolutional Neural Network." 2016 23rd International Conference on Pattern Recognition (ICPR). IEEE, 2016.

Nguyen, Tung, Kazuki Mori, and Ruck Thawonmas. "Image colorization using a deep convolutional neural network." arXiv preprint arXiv:1604.07904 (2016).

En.wikipedia.org. (2019). "Mughal-e-Azam". [online] Available at:

https://en.wikipedia.org/wiki/Mughal-e-Azam#Colourisation, 2019.

Bao, B. and Fu, H. (2019). "Scribble-based colorization for creating smooth shaded vector graphics". Computers & Graphics, 81, pp.73-81.

Reddit.com. (2019). " Colorization - The colorization of old black & white photos". [online] Available at: https://www.reddit.com/r/Colorization/, 2019.

He, M., Chen, D., Liao, J., Sander, P. and Yuan, L. (2018). "Deep exemplar-based colorization". ACM Transactions on Graphics, 37(4), pp.1-16.

Zhang, R., Isola, P., & Efros, A. A. (2016, October). "Colorful image colorization. In European conference on computer vision", (pp. 649-666). Springer, Cham.

"Colorize Black and White Photos", Algorithmia, 2019. [Online]. Available: https://demos.algorithmia.com/colorize-photos, 2019.

REINHARD, E., ASHIKHMIN, M., GOOCH, B., AND SHIRLEY, P. 2001. "Color transfer between images". IEEE Computer Graphics and Applications 2021, 34–4.

TAI, Y., JIA, J., AND TANG, C. 2005. "Local color transfer via probabilistic segmentation by expectation-maximization". In CVPR, 747–754.

WELSH, T., ASHIKHMIN, M., AND MUELLER, K. 2002. "Transferring color to greyscale images". ACM Trans. Graph. 21, 3 (July), 277–280.

Zhang, R., Isola, P., & Efros, A. A. (2016, October). "Colorful image colorization. In European conference on computer vision", (pp. 649-666). Springer, Cham.

"CNN Architectures, a Deep-dive", Medium, 2019. [Online]. Available: https://towardsdatascience.com/cnn-architectures-a-deep-dive-a99441d18049, 2019.

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). "Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems", (pp. 1097-1105).