Best Shot Selection using Convolutional Neural Networks
##plugins.themes.academic_pro.article.main##
Abstract
Mobile phone cameras have small camera sensor size as compared to professional cameras, capture less light at a time and capture everything in focus. Also, it is very common for novice photographers to miss the best shot. These days’ companies use multiple camera systems to solve these problems, which in turn increase the complexity and the costs of deploying these systems. This paper presents an android based mobile phone camera application that takes help from the work done in segmentation networks to capture portrait images and it also tries to capture the best possible photograph using traditional image processing and convolutional neural networks. Our system is performing better in terms of Mean IOU than existing available systems. Results showed that our model is simple and cost effective. This model is easily embeddable in upcoming mobile phones as a best-shot selection feature.
##plugins.themes.academic_pro.article.details##
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
- abhiswain, Joe, H. 2019. Aisegment.com - matting human datasets. Kaggle.
- Android, S. 2018. Android. https://developer.android.com/studio.
- compositing, A. 2020. Alpha compositing wiki. https://en.wikipedia.org/wiki/Alphacompositing.
- Dlib, D. 2019. Dlib c++ library. dlib C++ Library, http://dlib.net/ .
- Du, X., Wang, X., Li, D., Zhu, J., Tasci, S., Upright, C., Walsh, S., and Davis, L. 2019.
- Boundary-sensitive network for portrait segmentation. In 2019 14th IEEE International
- Conference on Automatic Face Gesture Recognition (FG 2019). 1–8.
- Girshick, R., Donahue, J., Darrell, T., and Malik, J. 2014. Rich feature hierarchies
- for accurate object detection and semantic segmentation. In 2014 IEEE Conference on
- Computer Vision and Pattern Recognition. 580–587.
- Google, D. 2021. Android.hardware.camera2 android developers. Android Developers,
- https://developer.android.com/reference/android/hardware/camera2/package-summary.
- Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., An-
- dreetto, M., and Adam, H. 2017. Mobilenets: Efficient convolutional neural networks
- for mobile vision applications.
- Krizhevsky, A., Sutskever, I., and Hinton, G. E. 2012. Imagenet classification with deep
- convolutional neural networks. In Advances in Neural Information Processing Systems,
- F. Pereira, C. Burges, L. Bottou, and K. Weinberger, Eds. Vol. 25. Curran Associates, Inc.
- Labelbox. 2021. The leading training data platform for data labeling. Labelbox,
- https://labelbox.com/ .
- Mehta, S., Rastegari, M., Caspi, A., Shapiro, L., and Hajishirzi, H. 2018. Espnet:
- Efficient spatial pyramid of dilated convolutions for semantic segmentation.
- Mehta, S., Rastegari, M., Shapiro, L., and Hajishirzi, H. 2018. Espnetv2: A light-weight,
- power efficient, and general purpose convolutional neural network.
- Newbury, R., Cosgun, A., Koseoglu, M., and Drummond, T. 2019. Learning to take good
- pictures of people with a robot photographer.
- Open, Source, C. V. L. 2019. opencv. https://opencv.org/ .
- Park, H., Sj ̈osund, L. L., Yoo, Y., Bang, J., and Kwak, N. 2019. Extremec3net: Extreme
- lightweight portrait segmentation networks using advanced c3-modules.
- Park, H., Sj ̈osund, L. L., Yoo, Y., Monet, N., Bang, J., and Kwak, N. 2020. Sinet:
- Extreme lightweight portrait segmentation networks with spatial squeeze modules and in-
- formation blocking decoder. In 2020 IEEE Winter Conference on Applications of Computer
- Vision (WACV). 2055–2063.
- Python, Software, F. 2018. Python. https://www.python.org/ .
- PyTorch, L. 2020. Pytorch. https://pytorch.org/ .
- Redi, M., Rasiwasia, N., Aggarwal, G., and Jaimes, A. 2015. The beauty of capturing
- faces: Rating the quality of digital portraits.
- Smoothstep. 2020. Smoothstep wiki. https://en.wikipedia.org/wiki/Smoothstep.
- Soukupova, T. and Cech, J. 2016. Real-time eye blink detection using facial landmarks. 21st
- Computer Vision Winter Workshop, Slovenia.
- Zhang, L. and Hong, W. A. 2018. Top shot on pixel 3. Google AI Blog.
- Zhang, S.-H., Dong, X., Li, H., Li, R., and Yang, Y.-L. 2019. Portraitnet: Real-time
- portrait segmentation network for mobile device. Computers Graphics 80, 104–113.
- International Journal of Next-Generation Computing, Vol. 6, No. 3, November 2015.