COLOR RECOGNITION WEARABLE DEVICE USING MACHINE LEARNING FOR VISUALY IMPAIRED PERSON

  • NIK NUR WAHIDAH NIK HASHIM
  • TAREK MOHAMED BOLAD
  • Noor Hazrin Hany Mohamad Hanif
Keywords: Colors, Neural network, Image processing, Vibration, Sound.

Abstract

ABSTRACT: Recognizing colors is a concerning problem for the visually impaired person. The aim of this paper is to convert colors to sound and vibration in order to allow fully/partially blind people to have a ‘feeling’ or better understanding of the different colors around them. The idea is to develop a device that can produce vibration for colors. The user can also hear the name of the color along with ‘feeling’ the vibration. Two algorithms were used to distinguish between colors;  RGB to HSV color conversion in comparison with neural network and decision tree based machine learning algorithms. Raspberry Pi 3 with Open Source Computer Vision (OpenCV) software handles the image processing. The results for RGB to HSV color conversion algorithm were performed with 3 different colors (red, blue, and green). In addition, neural network and decision tree algorithms were trained and tested with eight colors (red, green, blue, orange, yellow, purple, white, and black) for the conversion to sound and vibration. Neural network and decision tree algorithms achieved higher accuracy and efficiency for the majority of tested colors as compared to the RGB to HSV.

ABSTRAK: Membezakan antara warna adalah masalah yang merunsingkan terutamanya kepada mereka yang buta, separa buta atau buta warna. Tujuan kertas penyelidikan ini adalah untuk membentangkan kaedah menukar warna kepada bunyi dan getaran bagi membolehkan individu yang buta, separa buta atau buta warna untuk mendapat ‘perasaan’ atau pemahaman yang lebih baik tentang warna-warna yang berbeza disekeliling mereka. Idea yang dicadangkan adalah dengan membuat sebuah alat yang dapat menghasilkan getaran bagi setiap warna yang berbeza. Disamping itu, pengguna juga dapat mendengar nama warna tersebut. Algoritma yang digunakan untuk membezakan antara warna adalah penukaran warna RGB kepada HSV yang dibandingkan dengan rangkaian neural dan algoritma pembelajaran mesin berasaskan pokok keputusan. Raspberry Pi 3 bersaiz kad kredit dengan perisian Open Source Computer Vision (OpenCV) mengendalikan pemprosesan imej. Hasil algoritma penukaran warna RGB kepada HSV telah dilakukan dengan tiga warna yang berbeza (merah, biru, dan hijau). Tambahan pula, hasil rangkaian neural dan algoritma berasaskan pokok keputusan telah dilakukan dengan lapan warna (merah, hijau, biru, oren, kuning, ungu, putih, dan hitam) dengan penukaran warna tersebut kepada bunyi dan getaran. Selain itu, hasil rangkaian neural dan algoritma berasaskan pokok keputusan mencapai hasil dapatan yang baik dengan ketepatan dan kecekapan yang tinggi bagi kebanyakan warna yang diuji berbanding RGB kepada HSV.

Downloads

Download data is not yet available.

References

Ohkubo T, Kobayashi K. (2008). A color compensation vision system for color-blind people. Proceedings of the SICE Annual Conference, 1286–1289. https://doi.org/10.1109/SICE.2008.4654855

Rashid H, Al-mamun ASMR, Sijanur M, Robin R, Ahasan M, Reza SMT. (2016). Bilingual Wearable Assistive Technology for Visually Impaired Persons. https://doi.org/10.1109/MEDITEC.2016.7835386

Cavaco S, Mengucci M, Henriquesh T, Correia N, Medeiros F. (2013). From pixels to pitches : unveiling the world of color for the blind. https://doi.org/10.1109/SeGAH.2013.6665305

Palsokar A. (2016). A RGB-HSI Conversion Based Model to Map the Colour Perception Into Audio Equivalent to Assist Visually Impaired Persons. https://doi.org/10.1109/IACC.2016.96

Manaf A, Sari R. (2011). Color Recognition System with Augmented Reality Concept and Finger Interaction. https://doi.org/10.1109/ICTKE.2012.6152389

Rini JJ, Thilagavati B. (2015). Recognizing clothes patterns and colours for blind people using neural network, 1–5. https://doi.org/10.1109/ICIIECS.2015.7193006

Trifanica A, Butean A, Moldoveanu A, Butean D. (2015). Gamepad Vibration Methods to Help Blind People Perceive Colors, 37–40. Retrieved from https://www.researchgate.net/publication/283070958

Published
2018-12-01
How to Cite
NIK HASHIM, N. N. W., MOHAMED BOLAD, T., & Mohamad Hanif, N. H. H. (2018). COLOR RECOGNITION WEARABLE DEVICE USING MACHINE LEARNING FOR VISUALY IMPAIRED PERSON. IIUM Engineering Journal, 19(2), 213 - 220. https://doi.org/10.31436/iiumej.v19i2.945
Section
Mechatronics and Automation Engineering