Heartbeat Detection and Recognition of Anomaly Using IOT
Heartbeat Detection and Recognition of Anomaly Using IOT
Heartbeat Detection and Recognition of Anomaly Using IOT
BELAGAVI-590018
Project Report on
(18CSP82)
Bachelor of Engineering
In
Information Science & Engineering
Submitted by
2021-2022
NAGARJUNA COLLEGE OF ENGINEERING AND TECHNOLOGY
(An Autonomous Institution under VTU, Accredited by NAAC with “A+” Grade)
Bengaluru-562164, Karnataka, India
CERTIFICATE
Certified that the project work entitled “Heartbeat Detection and Recognition of Anomaly using
IOT” carried out by Ms. Ch. Lakshmi Chaitanya (INC18IS012), Ms. Keerthana V Temkar
(1NC18IS018), Ms. Nasreen Taj (INC18IS031) and Ms. Sahithi T (1NC18IS045) bonafide students
of Nagarjuna College of Engineering and Technology, an autonomous institution under Visvesvaraya
Technological University, Belagavi in partial fulfillment for the award of Bachelor of Engineering in
Information Science & Engineering during the academic year 2021-2022. It is certified that all
corrections/suggestions indicated for internal assessment have been incorporated in the report deposited in
the departmental library. The project work has been approved, as it satisfies the academic requirement in
respect of project work prescribed for the said degree.
External Viva-Voce
1. ......................................... .............................................
2. ......................................... .............................................
ACKNOWLEDGEMENT
The satisfaction and euphoria that accompanies the successful completion of this project would
be incomplete without the mention of the people who made it possible whose constant guidance and
encouragement crowned our effort with success. We consider it as our privilege and duty to express
our gratitude and respect to all those who guide us in the completion of this project report.
First and foremost, its our immense pleasure to thank our beloved guide Dr. Anil Kannur,
Professor and HOD, Department of Information Science and Engineering, Nagarjuna College of
Engineering and Technology, for helping, guiding and strengthening us to complete the project
work.
It’s our immense pleasure to thank our project coordinator Ms. Shruti Jalapur, Assistant
Professor, Department of Information Science and Engineering, Nagarjuna College of Engineering
and Technology for her constant support and assistance at every stage.
We wish to express our deepest gratitude and thanks to Dr. Anil Kannur, Head of the
Department, Information Science and Engineering, Nagarjuna College of Engineering and
Technology for his valuable suggestions and guidance throughout the period of this project report.
We would take this opportunity to express our heart-felt gratitude to Dr. B V Ravishankar,
Principal, Nagarjuna College of Engineering & Technology for his constant support and
encouragement in preparation of this report and for providing library and laboratory facilities
needed to prepare this project report.
Last but not the least, we would like to thank our parents, friends, teaching and non-teaching
staff of NCET.
i
ABSTRACT
This article proposes a novel system which gives us platform to monitor the heartbeat rate through
your mobile phone. The main reason for this study is to get the heartbeat rate detection through
phone which will be easy for a person with poor health can monitor his heartbeat. With the
advancement of smartphone technology, photoplethysmogram (PPG) capture and heart rate
measurement are now possible. This study proposes an improved method for extracting heartrate
from PPG signals captured by a smartphone camera, as well as an Android application for real-time
PPG signal processing. Video samples are captured with a smartphone camera are imported into
MATLAB for additional processing and algorithm evaluation. On the Android platform, an
optimized algorithm was built and tested with several smart phones. All the records that are recorded
by the system are stored and monitored. Different users or different person records can be stored in
one mobile phone.
ii
PARTICIPATION
Photos of exhibition
iii
TABLE OF CONTENTS
Acknowledgment i
Abstract ii
Participation iii
1. Introduction 1-4
i.Existing System 10
ii.Problem Statement 10
iii.Proposed System 10
iv.Objective 11
v.System Requirements 11
4. Methodology 12-16
5. Modules 17-24
6. Working 25-29
8. Results 32
9. Conclusion 33
Chapter 1:
INTRODUCTION
WHO (World Health Organization) has declared that the majority of worldwide
deaths are caused by heart diseases. The indicators show that approximately 30%
of all deaths are caused due to heart diseases. This is why we need to develop a
system that can detect the early stages of heart stroke. With this system, we can
store and sort the existing data. First of all, taking the data from the users, the system
generalizes the health report by all the current information and data stored and gives
situation details in form of a report. At this point, getting a wide range of medical
data with all kinds of data about diseases, the symptoms they have, and their early
detection, or the critical stage they are in, as the scope of medical scope is a wide
range. Most importantly the difficult task is to examine the data secured and analyse
the current symptoms according to the data stored. It is difficult to get the exact or
accurate diagnosis without past medical cases and their data. It is not possible for
doctors to have all the medical cases happening and their details as the doctors have
a high workload. For the analysis and diagnosis of the patient getting detailed
information about the patient plays a crucial role as it plays a decision-making
factor. So, developing a biomedical-oriented decision support system that can be
used to get detailed information for the doctors who can assist them in their
treatment and decision-making process.
The next main factor we need to talk about or consider are the symptoms. For the
diagnosis of treatment, we need the symptoms and readings of measurements that
have been noted by the system. Few symptoms are body temperature, rapid
breathing, heart racing, headaches etc. these symptoms are noted in accordance with
the degree of the intensity. These can only be noted according to the person
experiencing these symptoms. And this needs treatment. If not treated on time this
can lead to a higher risk of complications and few can also lead to death. So to note
these kinds of symptoms, it can also be included in the application for the further
study of the person’s case and to get a better analysis of his cases. Health problems
like heart failure or any kind of heart-related disease are increasing at a high rate.
And to control these, we need to monitor the person timely.
The medical monitoring systems, for now, is moving towards the wireless concept.
It is considered as the modern development method. Mainly having the complete
case history on the monitor of the doctor can help is sudden emergencies as the
patient’s health reaches the doctor from anywhere the patient resides. Which in turn
can save lives due to in-time diagnosis reports from the previous data stored by
people and alerting the doctor on time, before the health is put on line by giving
them in time treatment. So having a health monitoring system that is simple and
inexpensive yet complete can be handy in many situations. It can be considered an
advancement in technology.
According to WHO (World Health Organisation), health problems are increasing
day by day. An estimated 17.9 million people died from cardiovascular vascular
diseases in 2019 which is 32% of all global deaths. Of these deaths, 85% were due
to heart attack and stroke. It is important to detect For any kind of cardiovascular
disease, early detection of it is recommended so that in time medical treatment can
begin.
So, we are proposing a system with sensors to receive information on heartbeat rate
which will be transmitted on an IoT platform that can be accessed by the users. The
accessing of the information can be done via the internet. A continuous record of
body health history can be used to detect the disease through the symptoms and
analyse the disease that one has. As we all believe in early detection of the
symptoms and curing them. So, implementing it through the current technology is
the main objective of our study.
Heatstroke is a condition caused by your body overheating, usually as a result of
prolonged exposure to or physical exertion in high temperatures. This most serious
form of heat injury, heatstroke, can occur if your body temperature rises to 104 F
(40 C) or higher. The condition is most common in the summer months. Heatstroke
requires emergency treatment. Untreated heatstroke can quickly damage your brain,
heart, kidneys, and muscles. The damage worsens the longer treatment is delayed,
In today’s era, health problems are increasing day by day at a high pace. The death
rate of 55.3 million people dying each year or 151,600 people dying each day or
6316 people dying each hour is a big issue all over the world. Hence it is the need
of hour to overcome such problems. We, therefore, propose a change in wireless
sensors technology by designing a system that included different wireless sensors
to receive information with respective heart rate, etc. that will be undoubtedly
further transmitted on an IoT platform that is accessible by the user via the internet.
An accessible database is created about the patient’s health history which can be
further monitored & analysed by the doctor if necessary. This project proposes a
health monitoring system that is capable of detecting parameters of our body such
as heart rate. A continuous record of body health parameters can be used o detect
the disease in a more efficient manner. Nowadays, people pay more attention to the
prevention & early recognition of disease. In addition to it, new generation mobile
phones technologies.
Chapter 2:
LITERATURE SURVEY
2.2. IoT based system for Heart Rate Monitoring and Heart Attack Detection
International Journal of Engineering and Advanced Technology (IJEAT)
ISSN: 2249-8958, Volume-8 Issue-5, June 2019
Heart rate monitoring is a vital aspect of maintaining heart health. People from
different age groups have different ranges for maximum and minimum values of
heart rate, the monitoring system must be compatible enough to tackle this scenario.
In this paper, an IoT-based system has been implemented that can monitor the
heartbeat from the output given by a hardware system consisting of a NodeMCU
and pulse sensor. Further, an alert system is added which is executed if the heartbeat
goes below or above the permissible level given in the devised algorithm. The alert
message is received by the doctor through a mobile phone application. By using
this prototype, the doctors can access the heartbeat data of the patient from any
location. The nurses or the duty doctor available at the hospital can monitor the
heart rate of the patient in the serial monitor through the real-time monitoring
system. The real-time monitoring is done via Adafruit, this platform is more secure
to store the information and uses the MQTT protocol which has lots of advantages
over others. IFTTT protocol is also used to create conditional statements called
applets. The prototype is integrated with GPS technology to monitor the live
location of the device from any part of the world and uses a local server to provide
security, privacy, and low latency. The heartbeat data and other personal details of
the patient are stored in the cloud, this can be utilized for future studies on the health
condition of the patient. The prototype is realized using NodeMCU, pulse sensor,
Adafruit, and Blynk cloud.
body temperature of 99.73%. The distance range of sensor data transmission for
open space without obstructions of 67 meters and for enclosed space with a barrier
of 13 meters.
2.4. Heartbeat Sensing and Heart Attack Detection using the Internet of Things:
IoT, ISSN XXXX XXXX © 2017 IJESC
In this project, we are implementing a heartbeat monitoring and heart attack
detection system using the Internet of things. These days we have an increased
number of heart diseases including an increased risk of heart attacks. The sensor is
then interfaced to a microcontroller that allows checking heart rate readings and
transmitting them over the internet. The user may set the high as well as low levels
of the heartbeat limit. After setting these limits, the system starts monitoring, and
as soon as the patient heart beat goes above a certain limit, the system sends an alert
to the controller which then transmits this over the internet and alerts the doctors as
well as concerned users. Also, the system alerts for lower heartbeats. Whenever the
user logs on for monitoring, the system also displays the live heart rate of the
patient. Thus, concerned ones may monitor heart rate as well as get an alert of heart
attack to the patient immediately from anywhere and the person can be saved on
time.
2.5. Design of a dynamic monitoring system for patient health indexes based
on the mobile terminal, Received 16 February 2021; revised 19 March
2021; accepted 21 March 2021 Available online 1 April 2021
A dynamic monitoring system for patient health indexes based on a mobile terminal
is designed. The design of the system is divided into four parts. Firstly, the four-
layer framework of the system is designed, including acquisition, communication,
display, and alarm. Secondly, the hardware of the system is designed. Thirdly, the
three software running programs of the system are designed, including patients’
physiological parameter acquisition program, communication transmission
program, display, and early warning. Finally, the simulation test shows that the
monitoring results are close to the actual results. This also indicates that the
designed system can accurately detect the health status of patients.
Chapter 3:
SYSTEM ANALYSIS
processing. Video samples are captured with a smartphone camera are imported
into MATLAB for additional processing and algorithm evaluation. On the Android
platform, an optimized algorithm was built and tested with several smartphones.
All the records that are recorded by the system are stored and monitored. Thus, in
such an environment proposed system serves to be of effective cost with ease of
application.
Chapter 4:
METHODOLOGY
From the evolution, we now from a model of the system. We give in some inputs
and run the system. These inputs and running of the system work as the results we
get from the system.
or produces an image when it is exposed to light. So, people would see the image
through light. This is the old method that was taken over by the electronic devices
which contain the image sensor. There is a shutter that is inbuilt into our phone.
This shutter opens when the camera is activated. Once the shutter opens, sensors
are exposed to the light. This light is captured by the pixels until the shutter closes
or deactivates. The clarity of the image is in accordance with the speed of shutter
activation and deactivation. The photos can be blurred if the shutter is deactivated
swiftly.
By default, the sensors in smartphones do not see the colours. We are able to
produce the colour images as we have the colour filter array which is placed over
the photosites. this now produces the colour information in the digital image which
is the final review of the photo we would like to capture.
Now for the clarity of the image, sensors play a vital role. It determines the size and
quality of the image. The quality of the image is directly related to the size of the
sensor. This means that a bigger sensor produces better picture clarity. As we speak
of clarity, we can now discuss image stabilization. Image stabilization is important
for a quality image without having any blur. This can be achieved by sensors that
move on a gyroscope system that captures minor movements and details. This is
the main factor of image stabilization. Image stabilization can be done in a
smartphone camera by using the sensors placed in the mobile phone, which acts as
the optical image stabilization system that moves the camera’s sensor to counter the
movement of the phone. When this is done, it adjusts the focal length between the
sensor and the lens, and as the result is steady a shot is taken with no blur.
As discussed, to capture any colour images we need to add a colour filter is
necessary. This filer is placed on the photosites and it can determine the colour of
the image as shown in fig 4.2[5]. It plays a role in the mobile phone which allows a
certain colour into each pixel. A filter named Bayer filter is famous and it is used
widely in mobile phones. This filter is made up of blue/green and red/green filters
as alternating rows. The blue filter captures the blue light whereas green captures
green light similarly red captures red light. If there is a light that doesn’t match the
filter is reflected but if there is more filter reflected like about two thirds, the camera
needs to calculate the colour in each pixel. The electrical signal measurement from
the photosites is used for the determination of the colour of the entire image.
Once this corrected image is captured the sensors need to go through the processing
pipeline. Now you have the final image which you can edit, save the image, share,
or even print it out.
So in simple words, the camera of a smartphone works in a similar way as a camera
works, from the shutter to lens to the final image. Signal processing of the system
takes place as shown in fig 4.3.
Chapter 5:
MODULES
appliances) that support one or more common ecosystems, and can be controlled
via devices associated with that ecosystem, such as smartphones and smart
speakers. The IoT can also be used in healthcare systems.
A thing in the internet of things can be a person with a heart monitor implant, a
farm animal with a biochip transponder, an automobile that has built-in sensors to
alert the driver when tire pressure is low, or any other natural or man-made object
that can be assigned an Internet Protocol (IP) address and is able to transfer data
over a network.
IoT Working
The connectivity, networking and communication protocols used with these web-
enabled devices largely depend on the specific IoT applications deployed.
IoT can also make use of artificial intelligence (AI) and machine learning to aid in
making data collecting processes easier and more dynamic.
the Internet of Things in health care was estimated to reach 117 billion by 2020.
IoT devices will collect a very big amount of data on the way people communicate
with each other.
5.3 IoT and Health care Monitoring
According to Forbes magazine IoT market will be more than 117 billion by 2020.
Health care one of the biggest sectors in Internet of Things technology. IoT
wearable device monitor patient health related blood pressure and body
temperature. Health care sector uses smart health sensors to analyse and collect data
using gateways and analyse through cloud and stores in clouds.
Precisely, the demand and supply fluctuations shifted the stability and increased the
importance of cost-effectiveness, even though healthcare practitioners didn’t think
in such economic terms before.
Personalized medicine has also become more popular, with the US market doubled
from $9.2 billion in 2013 to $18.2 billion, as Deloitte reports. These new tendencies
towards caring about customer well-being and bringing true value-for-money called
for searching for new ways to serve the industry. And cloud computing completes
this task successfully.
Very basic services provide notification services via email or SMS. More advanced
systems (for example AOL) provides users with the choice of selecting a preferred
delivery channel such as e-mail, Short Message Service (SMS), instant messaging
(IM), via voice through voice portals, desktop alerts and more. Novel approaches
provide users with the ability to schedule their own alerts (for example Google
Calendar). The most sophisticated service providers embrace all capabilities,
aggregating a multitude of reminders, notifications, and alerts, catering the delivery
system to the specific context of the content being delivered thus enabling users to
create sophisticated scenarios.
5.8 Obstacles without Alert System for Heat stroke and Heart rate
The impacts from work stress relate dare one of the reasons why most of people
tend to forgot. This clarifies that individual's day by day life could influence their
conduct and contribute to one’s decision because of distressing and work load.
Chapter 6:
WORKING
First of all, we need to collect data from the user from his fingertips. Simultaneously
we also need to collect the data from the medical device.
Now the video is recorded from the fingertip through the smart phones which is
then transmitted to the software for the data analysis. And simultaneously, the data
from the medical device is transmitted to the computer by USB port. In general, the
steps followed by the data collection through the medical device is from the user to
the pulse oximeter to evaluating the results which are taken to the computer by USB
port for the pre-processing to analyse the data and the results from these are
obtained for future comparison between application results and the real results. We
will consider these as the Results 1. The input graph can be seen as shown in fig
6.2[5].
where, m*n is the video resolution, a(i,j,c,t) is corresponding matrix for each RGB
channel(the resolution we consider is 320*240), c is the RGB channel, d the
corresponding matrix for each channel has element’s value from 0 to 255
representing brightness of relative pixels (i=1,2,3,…,m and
Chapter 7:
ANDROID DEVELOPED APPLICATION
For the major and important part of development of the application is to get the
PPG signal from processing part. In the processing part we take frame to frame
image from rear camera and then calculations begin as shown in fig 7.1. First, we
take the image and format the image for encoding. Then we use JavaScript to
convert it to the RGB channel format. Then the pixel array is taken and we then
find its average to get the waveform.
Now this signal is taken for signal classification and then to get to the processing
as discussed in the working part. As said, we use MATLAB for the further
calculations to get the heart beat rate from the finger tips to the signal extraction to
processing to calculations to the results. We now get the real time heartbeat rate.
Chapter 8:
RESULT
As we run the software, we can see that there is an android application icon is shown
in top between the screen. As we start the application, we can see that the flashlight
is on and it is trying to capture the image. The primary phase of the application then
begins. We can see that the application begins and tries to recognize the finger
placed in front of the camera. We can see a application icon blinks while taking the
reading. The heartbeat rate is displayed on the screen at the top left corner. The
results are more accurate as we place our finger in front of the camera for a minute.
The screenshots of the results are as shown below, where fig 8.1 shows the image
before taking the reading while fig 8.2 shows the image after reading
Fig 8.1: Capturing the image Fig 8.2: Heartbeat Rate Detection
Chapter 9:
CONCLUSION AND FUTURE SCOPE
9.1 Conclusion
In the study, we have seen that the heartbeat rate can be found through a smart
phone. This method is in the review stage where we need to conduct the
experiments to get large data to process and to gain the accuracy. We develop the
application by reducing the time required to get the heartbeat rate by getting 50-60
video inputs in less than a min. we then process that video from frame-to-frame
image. This this then used to get the threshold and the high point. This high point
is now used to get the heartbeat rate.
Before that we reduce the errors and gain more accuracy. By this application we
can check heartbeat rate at any place and any time. this application can also be used
to send emergency message to the doctors who can get the complete analysis of the
person. This application can also be used to keep take of the record of the person
which makes the process of treatment a lot easier, simpler and on time taking into
consideration of the fact that the timely treatment can save life.
REFERENCE
NAGARJUNA
COLLEGE OF ENGINEERING & TECHNOLOGY
BENGALURU
An Autonomous Institution under VTU
CERTIFICATE OF PARTICIPATION
02.07.2022 conducted in the college during the academic year 2021 -2022.
Head of
V Jury Dr. B.V Ravishankar - - -
***
NGI
NAGARJUNA
GROUP OF INSTITUTIONS
COLLEGE
NAGARJUNA
OF
ENGINEERING
TECHNOLOGY
BENGALURU
&
An Autonomous Institution under VTU
CERTIFICATE OF PARTICIPATION
02.07.2022 conducted in the college during the academic year 2021- 2022.
-
NGI
NAGARJUNA
GROUP OF INSTITUTIONS
NAGARJUNA
COLLEGE OF ENGINEERING& TECHNOLOGY
BENGALURU
An Autonomous Institution under VTU
CERTIFICATE OF PARTICIPATION
VO8 ***
****
NGI
NAGARIUNA
GROUP OF INSTITUTIONS
NAGARJUNA
COLLEGE OF ENGINEERING &TECHNOLOGY
BENGALURU
An Autonomous Institution under VTU
CERTIFICATE OF PARTICIPATION
02.07.2022 conducted in the college during the academic year 2021 - 2022.
A
Head of Jury Dr. B.V Ravishankar OB
Department Technical Project Exhibition Principal, NCET
*** ww
**
Heartbeat Rate Measurement using Android Phone
Dr. Anil Kannur Ms. Sahithi T Ms. Ch Lakshmi Chaitanya
Guide and HOD of ISE Dept Student of Nagarjuna College of Student of Nagarjuna College of
Nagarjuna College of Engineering and Engineering and Technology Engineering and Technology
Technology Bangalore, Karnataka Bangalore, Karnataka
Bangalore, Karnataka
Ms. Keerthana V Kemkar College: Nagarjuna College of
Ms. Nasreen Taj Student of Nagarjuna College of Engineering and Technology
Student of Nagarjuna College of Engineering and Technology Devanahalli, Bamgalore-562164
Engineering and Technology Bangalore, Karnataka
Bangalore, Karnataka
Abstract— This article proposes a novel system which gives us detailed information for the doctors which can assist them in
platform to monitor the heartbeat rate through your mobile their treatment and decision-making process.
phone. The main reason for this study is to get the heartbeat The next main factor we need to talk or consider are the
rate detection through phone which will be easy for a person
symptoms. For the diagnosis of treatment, we need the
with poor health can monitor his heartbeat. With the
symptoms and readings of measurements that have been
advancement of smartphone technology, photoplethysmogram
(PPG) capture and heart rate measurement are now possible. noted by the system. Few symptoms are body temperature,
This study proposes an improved method for extracting rapid breathing, heart racing, headaches etc. these symptoms
heartrate from PPG signals captured by a smartphone camera, are noted in accordance with the degree of the intensity.
as well as an Android application for real-time PPG signal These can only be noted according to the person
processing. Video samples are captured with a smartphone experiencing these symptoms. And these needs a treatment.
camera are imported into MATLAB for additional processing If not treated on time this can lead to a higher risk of
and algorithm evaluation. On the Android platform, an complications and few can also lead to death. So to note
optimised algorithm was built and tested with several smart
these kind of symptoms, it can also be included in the
phones. All the records that are recorded by the system are
application for the further study of the persons case and to
stored and monitored. Different users or different person
records can be stored in one mobile phone. get the better analysis of his cases. Health problems like
Keywords— Heart Rate, Photoplethysmogram, Smart phone, heart failure or any kind of heart related diseases are
MATLAB, Java. increasing at high rate. And to control these, we need to
monitor the person timely.
I. INTRODUCTION The medical monitoring systems for now is moving towards
wireless concept. It is considered as the modern
WHO (World Health Organization) have declared that
development method. Mainly having the complete case
majority of the worldwide deaths are caused by heart
history on the monitor of the doctor can help is sudden
diseases. The indicators show that approximately 30% of all
emergencies as the patients’ health reaches the doctor from
deaths are caused due to heart diseases. Which is why we
anywhere the patient resides. Which in turn can save lives
need to develop a system which can detect early stages of
due to in time diagnosis report from the previous data stored
heart stroke. By this system we can store and sort the
by people and alerting the doctor on time, before the health
existing data. First of all, taking the data from the users,
is put on line by giving them in time treatment. So having a
system generalises the health report by all the current
health monitoring system which is simple and inexpensive
information and data stored and gives situation details in
yet complete can be handy in many situations. It can be
form of a report. At this point, getting the wide range of
considered the advancement in the technology.
medical data with all kinds of data about diseases, the
According to WHO (World Health Organisation) the health
symptoms they have, and their early detection, or the critical
problems are increasing day by day. An estimated 17.9
stage they are in, as the scope of medical scope is wide
million people died from cardiovascular vascular diseases in
range. Most importantly the difficult task is to examine the
2019 which is 32% of all global deaths. Of these deaths,
data secured and analyse the current symptoms according to
85% were due to heart attack and stroke. It is important to
the data stored. It is difficult to get the exact or accurate
detect For any kind of cardiovascular diseases, an early
diagnosis without the past medical cases and its data. It is
detection detection of it is recommended for so that in time
not possible for doctors to have all the medical cases
medical treatment can begin.
happening and its details as the doctors have high work
So, we are proposing a system with sensors to receive
load. For the analysis and diagnosis of the patient getting the
information on heartbeat rate which will be transmitted on
detailed information of the patient plays a crucial role as it
an IoT platform which can be accessed by the users. The
plays decision-making factor. So, developing a biomedical
accessing of the information can be done via internet. A
oriented decision support system which can be used to get
continuous record of body health history can be used to
detect the disease through the symptoms and analysing the constructed, along side the patients' physiological parameter
disease that one has. As we all believe in early detection of acquisition, verbal exchange transmission, display, and early
the symptoms and curing it. So, to implement it through the warning programmes. Finally, the simulation test indicates
current technology, is our main objective to our study. that the monitoring results are pretty accurate. This
moreover manner that the system is capable of identifying a
affected man or woman's health popularity with pinpoint
II. LITERATURE REVIEW accuracy.[3]
A. IoT based System for Heart Rate Monitoring .
International Journal of Engineering Research & D. Design, deployment, and usability of a mobile
Technology[1] system for cardiovascular health monitoring within
With the use of IoT technology, the Heart Rate Monitoring the electronic Framingham Heart Study[4]
system have become advanced with the purpose of detecting BACKGROUND: The virtual Framingham Heart
the patient`s heartbeat as a manner to display screen the Investigation (eFHS) is a nested look at that looks at how
danger of coronary coronary heart attack further to everyday health facts from mobile devices correlates with
check-ups. Body health monitoring is important to us cardiovascular hazard factors and disease. It is crafted from
because of the truth we want to make sure that our health is FHS research people. OBJECTIVE To characterise the
in pinnacle operating order. One of the most important purchaser characteristics, usability, and survey response
factors to bear in mind with this gadget is the coronary costs of an application (app). METHODS Eligible FHS
coronary heart rate (HR). In this project, we show how we people may also need to accumulate an Apple Watch
used Bluetooth technology to create a low-fee coronary wearable, a digital blood pressure (BP) cuff, and the eFHS
coronary heart rate monitoring system. A coronary coronary phone software program software for some distance off
heart rate module, an Android application, and a Bluetooth survey administration. The usability of the state-of-the-art
module are some of the various components that make up app have become assessed the use of the Mobile App Rating
the system. The Heart Rate (HR) module uses a non- Scale (MARStwo )`s domains (functionality and aesthetics),
invasive approach (Photoplethysmography) to build up further to survey final touch costs at baseline and three
coronary coronary heart rate data from the subject (patients) months.[4]
and transfers it to the computer.[1]
III. SYSTEM REQUIREMENTS
B. IoT based system for Heart Rate Monitoring and The versions used in the analysis and the processing are:
Heart Attack Detection [2] MATLAB: R2011a: this is used for the post processing at
Monitoring your coronary coronary heart rate is an essential the time of the calculations and analysis.
difficulty of retaining your coronary coronary heart in right For development using android developer tools (ADT)
shape. People of numerous a long term have extraordinary software: Android SDK and ADT v22.3.
maximum and minimum coronary coronary heart rate Android application supports flash near camera which runs
ranges, so the monitoring device need to be able to on Android OS 4.0 or higher.
accommodate this situation. An IoT-based absolutely device
has been built in this have a look at that can show the
IV. METHODOLOGY
coronary heart beat from the output of a hardware device
including a NodeMCU and a pulse sensor. There is also a A. Smart phone photography
warning mechanism, that`s activated every time the
Smart phone photography
coronary heart beat falls under or exceeds the algorithm's
The most important part of the photography through phone
relevant limit. The alert message is added to the doctor
is the sensor. With the help of sensor we can capture the
through a mobile telecellsmartphone application. [2]
images using our smart phones. So, in the process of
capturing images the sensor is the most vital part. Now the
C. Design of a dynamic monitoring system for patient
question arises, how does a sensor works in a smart phone?
health indexes based on mobile terminal[3]
The smartphone camera has an image sensor that captures
A dynamic monitoring system for affected man or woman
light through the lens and converts it into a digital image.
health symptoms and symptoms based totally mostly on
Millions of photosites, also known as pixels, make up the
mobileular terminals is being developed. The format of the
sensor. Pixels' primary role is to capture light. Megapixels
system is break up into four sections. The system`s four-
are the units of measurement for the amount of light
layer foundation is designed first, along side acquisition,
collected. [5]
verbal exchange, display, and alert. Second, the hardware of
We utilise a sensor that operates like a film frame. The film
the system is created. Finally, the system`s three software
frame we're talking about is from before cameras, when
program application going for walks programmes are
photography was yet in its infancy. Photographs were once signal measurements from the photosites.
taken on a roll of celluloid film. When exposed to light, it is
then coated with a specific chemical that gives or makes a
picture. As a result, individuals would be able to perceive
the image through light. This is the old method, which has
been replaced by electronic devices with image sensors. In
our phone, there is an inbuilt shutter. When the camera is
turned on, this shutter opens. Sensors are exposed to light
once the shutter opens. The pixels catch this light until the
shutter closes or is turned off. The clarity of the image is in
accordance with the speed of shutter activation and
deactivation. The photos can be blur if the shutter is
deactivated swiftly.
The sensors on smartphones do not detect colours by
default. We can create colour photographs since we have a
colour filter array that is placed over the photosites. This
creates the colour information in the digital image, which is
the final check of the photo we want to take.
Sensors now play an important role in image clarity. It
determines the image's size and quality. The size of the
Fig 1
sensor has a direct connection with the image quality. That
Only functional or sensors are not enough to get the image
is to say, a larger sensor generates clearer images. While
out as the final product; we need to work more on
we're on the subject of clarity, we can now move on to
processing. Before the final output, the image is processed.
picture stabilisation. Image stabilisation is necessary for a
A processor is used to process the image signal. In order to
high-quality image that is free of blur. Sensors that move on
produce a finished image, the image signal processor must
a gyroscope system that records small motions and details
complete a number of tasks. The colour filtration procedure,
can help with this. The key factor in image stabilisation is
as we already covered, is the first step.
this. In a smartphone camera, image stabilisation can be
As this stage is completed, the image signal processor
achieved by employing the sensors built into the phone,
applies more modifications to the raw image. Shade
which act as an optical image stabilisation system, moving
correction, pixel correction, and noise reduction are among
the camera's sensor to counteract the phone's movement.
the corrections. The sensors must travel through the
When this is done, the focal length between the sensor and
processing pipeline after this corrected image is captured.
the lens is adjusted, and an image with no blur is captured as
You now have the finished image, which you can modify,
a result.
save, share, or even print.
As previously stated, a colour filter is required to capture
So, in simple terms, a smartphone camera operates in the
any colour photographs. As illustrated in fig 1[5,] this filer
same way that a camera does, from the shutter to the lens to
is put on the photosites and can determine the colour of the
the final image.
image. It is responsible for allowing a certain colour to be
Signal processing of the system takes place as shown in fig
shown in each pixel on a mobile phone. The Bayer filter is a
2
well-known filter that is commonly used in mobile phones.
This filter is made up of alternating rows of blue/green and
red/green filters. The blue filter captures blue light, while
the green and red filters capture green and red light,
respectively. If a light that does not match the filter is
reflected, the camera must compute the colour in each pixel.
If there is more filter reflected, such as around two-thirds,
the camera must calculate the colour in each pixel. The
colour of the complete image is determined using electrical
evaluating the results which are taken to the computer by
USB port for the pre-processing to analyse the data and the
results from these are obtained for future comparison
between application results and the real results. We will
consider these as the Results 1. The input graph can be seen
as shown in fig 4[5].
Fig 2
Fig 4
As for the steps for the android calculations first user’s
V. WORKING
fingertip. Then the input is processed to the mobile phone
A. Heartbeat Rate Measurement from the captured video from the fingertips earlier. This
capturing is in form of the video clip. This video clip is
In the pulse oximeter, we have the photodiode and light
further sent for data analysing and the results are obtained.
source, which is now replaced with the built-in smart phone
These results are taken as Results 2 as shown in Fig 5. We
camera. Through smart phone we try detect PPG signal
calculate the mean brightness through this.
(Photoplethysmography). We take PPG signals from the
Formula we use for this calculation is:
fingertips through the camera. We have the flash light on
Pixels (resolution) – m*n
which plays an important part for the PPG signal detection.
Video – V
While taking the PPG signal we take the RGB extraction
Number of time frames – t
and the graph (fig 3) is as follows[6]:
Channel – c
Frame rate – F
Video data – V(m,n,c,t)
Mean brightness b(t) is calculated by:
Now, the input shown is the videos hat we capture from the
subjects through their fingertips. Now the main input
medium is the rear camera of the mobile phone.
The inputs as shown are in form of videos. It is then sent to
the processing part, this video is seen from a video to frame
in the video. These frames are now taken to RGB extraction
Fig 5 block. RGB extraction block is used to get the frames in
sequence of red, green and blue channels. These channels
Now, the two results are taken together for android are the brightness of the colours which are taken. In this
programming. These two results are taken in and are channelling process red channel is preferred the most for
calculated using the MATLAB. Now we start comparing obtaining the PPG signal. The intensity of this channel is
result 2 with the result 1. If the results have minimum error calculated. Now, it goes to the representation part. This PPG
in them, it is then sent to the mobile phone as the heart beat signals are moved to average filter in order to the high point.
detected. If not, it is again sent for comparison and if the We need these high points to get the segmentation stages of
comparison error is still large, the measuring is taken again. the person and this is the segmentation stage. As we get this
And now the data, we take different inputs from different point, we now move to the classification stage. In this stage,
age groups. The videos we take from the people are many. the high point we got are reclassified with respective to the
The inputs are in form of videos. We recommend the users distance constraints, moving variants and RGB threshold.
to insert the finger for about a minute. In that min we take Now the calculations are done. We get the heartbeat rate.
50 videos as our input. Now for each input we take the
heartbeat rate. And we do the same thing for the rest of the
inputs we take. [6]
At the trial stage, we ask the subjects to try this software IV ANDROID APPLICATION DEVELOPMENT
with their right hand and simultaneously wear the pulse For the major and important part of development of the
oximeter in the left hand. Now these are considered as the application is to get the PPG signal from processing part. In
experimental data we collect and try out. For all the the processing part we take frame to frame image from rear
experimental try outs, we make the subject use pulse camera and then calculations begin as shown in fig 6. First,
oximeter on the left hand for its better reading and our we take the image and format the image for encoding. Then
software is made to try with his right hand where the index we use JavaScript to convert it to the RGB channel format.
finger is placed on the rear camera of the mobile phone and Then the pixel array is taken and we then find its average to
its flash light is on. These two are conducted get the waveform. Now this signal is taken for signal
simultaneously. These experiments are conducted under classification and then to get to the processing as discussed
supervision as ensuring the setup of the experiment and the in the working part. As said, we use MATLAB for the
process of the experiment is done in a proper manner in the further calculations to get the heart beat rate from the finger
same time the evaluation is also done. This experiment is to tips to the signal extraction to processing to calculations to
be conducted while using different phones and multiple the results. We now get the real time heartbeat rate.
This this then used to get the threshold and the high point.
This high point is now used to get the heartbeat rate.
Before that we reduce the errors and gain more accuracy. By
this application we can check heartbeat rate at any place and
any time. this application can also be used to send
emergency message to the doctors who can get the complete
analysis of the person. This application can also be used to
keep take of the record of the person which makes the
process of treatment a lot easier, simpler and on time taking
into consideration of the fact that the timely treatment can
save life.
REFERENCES
[1] IoT based System for Heart Rate Monitoring,
International Journal of Engineering Research &
Technology (IJERT) Vol. 9 Issue 07, July-2020
[2] IoT based system for Heart Rate Monitoring and Heart
Attack Detection International Journal of Engineering
and Advanced Technology (IJEAT) ISSN: 2249-8958,
Volume-8 Issue-5, June 2019
[3] Design of a dynamic monitoring system for patient
health indexes based on mobile terminal, Received 16
February 2021; revised 19 March 2021; accepted 21
March 2021 Available online 1 April 2021
[4] Design, deployment, and usability of a mobile system
for cardiovascular health monitoring within the
Fig 6
electronic Framingham Heart Study
RESULTS [5] https://www.semanticscholar.org/paper/A-Color-Filter-
Array-Based-Multispectral-Camera-Brauers-
As we run the software, a dialogue box appears while we
Aach/2d76bd7262a677bdacf49db7f3168919563e3503/f
use the software, describing the general steps to use the
igure/2
application. Another dialogue box appears, asking for
[6] https://www.researchgate.net/figure/Typical-
permission to use the flashlight. The primary phase of the
transmittance-curves-of-the-RGB-filters-of-the-silicon-
application then begins. There are indices that display the
sensor-found-in-the_fig2_263390471
values for the average, healthy, maximum, and danger
[7] Learning to interact with new technology: Health care
values, as can be seen. Then we'll look for a start button. It
workers’ experiences of using a monitoring system for
starts computing the heartbeat rate as soon as we click on it.
assessing hand hygiene – a grounded theory study-
We can see a trail moving around the heartbeat calculator on
American Journal of Infection Control 000 (2021) 1−6
the screen, indicating how much time we have left to lay our
[8] Design of a dynamic monitoring system for patient
finger on the camera. The heartbeat rate is displayed on the
health indexes based on mobile terminal- Received 16
screen after one minute.
February 2021; revised 19 March 2021; accepted 21
March 2021 Available online 1 April 2021
[9] B. Gu, Forecast and analysis of covid-19 epidemic
CONCLUSION based on improved seir model, J. Phys. Conf. 1802 (4)
(2021), 042050.
In the study, we have seen that the heartbeat rate can be
[10] K.D. Pandl, S. Thiebes, M. Schmidt-Kraepelin, A.
found through a smart phone. This method is in the review
Sunyaev, How detection ranges and usage stops impact
stage where we need to conduct the experiments to get large
digital contact tracing effectiveness for covid-19, Sci.
data to process and to gain the accuracy. We develop the
Rep. 11 (9414) (2021) 1–11.
application by reducing the time required to get the
[11] Statistics Bureau of Japan, Retrieved from,
heartbeat rate by getting 50-60 video inputs in less than a
http://www.stat.go.jp/data/jinsui /new.html, 2021.
min. we then process that video from frame-to-frame image.
[12] B. RaI, A. Shukla, D.K. Dwivedi, Incubation period for [21] L. Xue, X. Li, W. Wu, et al, Design of Tracking,
COVID-19: a systematic review and meta-analysis, J Telemetry, Command (TT&C) and Data Transmission
Public Health (Berl.) (2021). Integrated Signal in TDD Mode [J], Remote Sensing 12
[13] C. Cheng, D. Zhang, D. Dang, J. Geng, G. Duan, (20) (2020) 3340.
Incubation Period of COVID-19 from 11545 Patients in [22] L. Bai, Q. Zhao, Z. Zhou, Evaluation of the effect of
Observation Study, 2021. chemotherapeutic drug training on mobile terminal for
[14] MyDataHelps. neurooncology nurses based on Kirkpatrick’s model [J],
https://mydatahelps.org/identityserver/local/participant# Neurosci. Med. 11 (3) (2020) 83–90.
/splash. Accessed September 2, 2020. [23] K. Sowjanya, Mou Dasgupta, Sangram Ray, An elliptic
[15] Yang X, Ma L, Zhao X, Kankanhalli A. Factors curve cryptography based enhanced anonymous
influencing user’s adherence to physical activity authentication protocol for wearable health monitoring
applications: a scoping literature review and future systems, Int. J. Inf. Secur. 19 (1) (2020) 129–146.
directions. Int J Med Inform 2020;134:104039. [24] Naeem Iqbal, Shabir Ahmad, Do Hyeun Kim, Health
[16] World Health Organization, World Health Day, monitoring system for elderly patients using intelligent
Measure your blood pressure, reduce your risk. task mapping mechanism in closed loop healthcare
https://www.who.int/mediacentre/news/releases/2013/w environment, Symmetry 13 (2) (2021) 357
orl d_health_day_20130403/en/, 2013. (Accessed 31 [25] Muhammad Salek Ali, Massimo Vecchio, Guntur D.
March 2021). Putra,Salil S. Kanhere, Fabio Antonelli, A decentralized
[17] International Diabetes Federation (Idf), IDF Diabetes peer-to-peer remote health monitoring system, Sensors
Atlas, ninth ed., 2019. (Accessed 31 March 2021). 20 (6) (2020) 1656.
[18] B. Srimathi, T. Ananthkumar, Li-Fi based automated [26] Krishna Teja, Umang Patel, Parthkumar Patel, Yash
patient healthcare monitoring system [J], Indian J. Agrawal, Rutu Parekh, Smart soldier Health monitoring
Public Health Res. Dev. 11 (2) (2020) 393. system incorporating embedded electronics, in:
[19] L. Liu, J. Xu, Y. Huan, et al, A smart dental health-IoT Advances in VLSI and Embedded Systems, Springer,
platform based on intelligent hardware, deep learning, Singapore, 2021, pp. 223–234
and mobile terminal [J], IEEE J. Biomed. Health. Inf.
24 (3) (2020)898–906.
[20] Z. Chang, B. Hu, X. Li, et al, Dynamic visualization
model simulation of hadoop cluster for nursing
monitoring data [J], Computer Simulation 37 (08)
(2020), pp. 153–156+251.