IOT

Facial Recognition Smart Glasses for Visually Challenged Persons

We are living in a technology-based society where we have lots of innovative ideas day by day. These new innovations in IoT communications-based projects come as an ever-growing network that strives constantly to share and gather insight on the latest trends in the industrial IoT Platform.

There are millions of disabled people in this world who are always in need of helping hands. Independent mobility reduces the dependence on caregivers.  Disabled people always find themselves challenging to go out  independently because of their physical deficiency or inability to move in a  normal fashion.  People with visual impairment face many challenges in their daily life as modern assistive devices are often do not meeting consumer requirements in terms of price and level of assistance. 

Here we propose a  new design of assistive smart glasses for visually impaired persons.   The aim of the project of  Blind assistance is to promote a wide challenge in computer vision such as recognition of persons of the surrounding practice by the blind on a  daily basis.  The camera is placed on a blind person’s glasses.  A  dataset of persons gathered from daily scenes is generated to apply the required recognition.  The camera is used to detect any person. The proposed method for the blind aims at expanding possibilities to people with vision loss to achieve their full potential.  The main object of the project is to design and implement real-time object recognition using blind glass. 

PROPOSED SYSTEM:

In this project, we will design a smart eyeglass that can help a visually challenged person to recognize the person in front of him and learn about obstacles ahead. This will be enabled by face recognition and distance detection features.

 The purpose of this system is to eliminate the assistance required for disabled people.  By promoting independent mobility, it develops the feeling of self-reliance by reducing dependence on any assistant.  A  person having any difficulty in functional mobility suffers from aloofness as they decrease their participation in various social activities that lead to cause stress, isolation, and fear of negligence.

Our aim is to create an intelligent system, imitating the human eye, which transfers diverse scenes and images to the brain. The brain in turn analyzes the images or scenes and based on previously stored information, the surrounding objects are identified. For this purpose, we use a small device that performs similar to the human brain, called “Raspberry Pi”; It is a small device that analyzes the images and scenes with the help of the camera. This project has an in-built sensor in it that spreads ultrasonic waves in the direction the person is going by scanning at most 5-6 meters of 30º range. This new system may solve some of the major problems of blind persons that are still existing. Finally, the sound of each person in the database is called, and a message is sent to tell the blind about the person in front of them.

  The main objective of this work is to develop a low-cost,  reliable,  portable, user-friendly,  low power and robust solution for smooth navigation.  

SYSTEM ARCHITECTURE:

The proposed system comprises a  depth camera for collecting the depth information of the surroundings  XD,  an ultrasonic rangefinder consisting of an ultrasonic sensor,  an embedded CPU  (Central  Processing  Unit)  board acting as the main processing module. The embedded CPU performs operations such as depth image processing, data fusion,  AR  rendering,  guiding sound synthesis,  etc.,  a  pair of  AR  glasses to display the visual enhancement information, and an earphone to play the  guiding sound. 

This proposed system helps a visually challenged person to identify the person in front of him and learn about obstacles ahead. This will be enabled by face recognition and distance detection features. In this system, the  Raspberry pi and Pi camera are used for the facial recognition process. And also used an Ultrasonic sensor for obstacle detection and avoidance and a 5V power supply to run the Raspberry pi.

HARDWARE REQUIRED:

  •  RASPBERRY Pi 4:

Raspberry Pi 4 Model B is designed as the latest product in the popular Raspberry Pi range of computers. This model features ground-breaking increases in processor speed, multimedia performance, memory. And connectivity compared to the predecessor Raspberry Pi 3 Model B+ while retaining backward compatibility and similar power consumption. Raspberry Pi 4 Model B is capable of providing desktop performance comparable to entry-level x86 PC systems. This version comes with 4GB of RAM, but we also have versions with 1 and 2 GB.

  • Ultrasonic Sensor:

This ultrasonic sensor module is used for measuring distance, object sensors, motion sensors, etc. Ultrasonic Sensor HC-SR04 uses sonar to measure the distance of the 

This is one of the interesting IoT project ideas to create. This Self Reliant feature is what we want to reinstate in visually impaired persons. We have developed a Smart Glasses system that we will design a smart eyeglass that can help a visually challenged person recognize the person in front of him and learn about obstacles object. It emits an ultrasonic wave at 40 kHz which will go and bounce back after hitting an object. An ultrasonic sensor detects and measures the distance of a target object using ultrasonic sound waves and converts the reflected sound into an electrical signal.

  • MINI CAMERA 

A webcam is a video camera that feeds or streams an image or video in real-time to or through a computer to a computer network, such as the Internet. Webcams are typically small cameras that sit on a desk, attach to a user’s monitor, or are built into the hardware. Webcams can be used during a video chat session involving two or more people, with conversations that include live audio and video. For example, Apple’s iSight camera, which is built into Apple laptops, iMacs, and a number of iPhones, can be used for video chat sessions, using the iChat instant messaging program (now called Messages).

CONCLUSION:

IoT or the internet of things is characterized as a forthcoming innovation that empowers us to control equipment gadgets through the Internet. This IoT-based system is designed specifically for the assistance of Blind persons using a special Mini camera. Raspberry Pi is the latest technology available in the modern world. But what makes Raspberry Pi special is that it has its own Operating System, thereby reducing the circuitry on the person’s body. This system is an eco-friendly, highly efficient, and cost-effective system.

This is one of the interesting IoT project ideas to create. This Self Reliant feature is what we want to reinstate in visually impaired persons.  We have developed a Smart Glasses system that enables disabled patients to move their wheelchair independently in their own direction. It also provides an emergency indication in times of necessity and doctors can then provide patients with immediate solutions and guidance based on their health conditions. It also avoids unwanted movement, which may even cause danger to user life.

Leave a Reply

Your email address will not be published.