Innovative Technologies and Services For Smart Cities
Innovative Technologies and Services For Smart Cities
Innovative Technologies and Services For Smart Cities
Technologies
and Services for
Smart Cities
Edited by
Subhas Mukhopadhyay and Tarikul Islam
Printed Edition of the Special Issue Published in Electronics
www.mdpi.com/journal/electronics
Innovative Technologies and Services
for Smart Cities
Innovative Technologies and Services
for Smart Cities
Editorial Office
MDPI
St. Alban-Anlage 66
4052 Basel, Switzerland
This is a reprint of articles from the Special Issue published online in the open access journal Electronics
(ISSN 2079-9292) from 2017 to 2019 (available at: https://www.mdpi.com/journal/electronics/
special issues/smart cities)
For citation purposes, cite each article independently as indicated on the article page online and as
indicated below:
LastName, A.A.; LastName, B.B.; LastName, C.C. Article Title. Journal Name Year, Article Number,
Page Range.
c 2019 by the authors. Articles in this book are Open Access and distributed under the Creative
Commons Attribution (CC BY) license, which allows users to download, copy and build upon
published articles, as long as the author and publisher are properly credited, which ensures maximum
dissemination and a wider impact of our publications.
The book as a whole is distributed by MDPI under the terms and conditions of the Creative Commons
license CC BY-NC-ND.
Contents
Daniele Spoladore, Sara Carciotti, Sara Arlati, Massimiliano Nolich and Marco Sacco
RoomFort: An Ontology-Based Comfort Management Application for Hotels
Reprinted from: Electronics 2018, 7, 345, doi:10.3390/electronics7120345 . . . . . . . . . . . . . . . 136
Carlos Garcia-Rubio, Rebeca P. Dı́az Redondo, Celeste Campoand Ana Fernández Vilas
Using Entropy of Social Media Location Data for the Detection of Crowd Dynamics Anomalies
Reprinted from: Electronics 2018, 7, 380, doi:10.3390/electronics7120380 . . . . . . . . . . . . . . . 163
v
Jing Hu, Yaling Lai, Ao Peng, Xuemin Hong and Jianghong Shi
Proactive Content Delivery with Service-Tier Awareness and User Demand Prediction
Reprinted from: Electronics 2019, 8, 50, doi:10.3390/electronics8010050 . . . . . . . . . . . . . . . 178
vi
About the Special Issue Editors
Subhas Mukhopadhyay holds a B.E.E. (gold medalist), M.E.E., Ph.D. (India), and Doctor of
Engineering (Japan). He has over 30 years of teaching, industrial, and research experience. He is
currently Professor of Mechanical/Electronics Engineering, Macquarie University, Australia, and
is the Discipline Leader of the Mechatronics Engineering Degree Programme. Before joining
Macquarie, he was Professor of Sensing Technology, Massey University, New Zealand. His
fields of interest include smart sensors and sensing technology, instrumentation techniques,
wireless sensors and network (WSN), Internet of Things (IoT), numerical field calculation, and
electromagnetics. He has supervised over 40 postgraduate students and over 100 Honours students.
He has examined over 50 postgraduate theses. He has published over 400 papers in different
international journals and conference proceedings, written 7 books and 42 book chapters, and edited
17 conference proceedings. He has also edited 32 books with Springer-Verlag and 24 journal Special
Issues. He has organized over 20 international conferences as either General Chairs/co-chairs
or Technical Programme Chair. He has delivered 335 presentations including keynote, invited,
tutorial, and special lectures. He is a Fellow of IEEE (USA), a Fellow of IET (UK), a Fellow of
IETE (India). He is a Topical Editor of IEEE Sensors journal. He is also an associate editor of IEEE
Transactions on Instrumentation and Measurements. He is a Distinguished Lecturer of the IEEE Sensors
Council from 2017 to 2019. He chairs the IEEE IMS NSW chapter. More details are available
at https://scholar.google.com.au/citations?user=8p-BvWIAAAAJ&hl=enhttps://orcid.org/
0000-0002-8600-5907http://web.science.mq.edu.au/directory/listing/person.htm?id=smukhopa.
Tarikul Islam is Professor in Electrical Engineering. He received his M.Sc. Eng. Degree in
instrumentation and control system from A. M. U. Aligarh, U.P. in 1997, and his Ph.D. (Eng.) degree
from Jadavpur University, Kolkata, India, in 2007. He has over 20 years of teaching and research
experience. He has authored/co-authored 4 book chapters, one edited book, 2 Indian patents, and
more than 140 papers in peer-reviewed journals and conferences. He has received funding for his
research projects from Indian Government Agencies of $US 214,000. His research interests include
sensors and sensing technologies, and electronics instrumentation. He is a life member of IETE
(India), ISTE (India). He is associated editor of the IEEE Sensors Journal and International Journal of
Smart Sensing and Intelligent Systems. He is a co-editor of a Special Issue of an international journal.
vii
electronics
Editorial
Innovative Technologies and Services for Smart Cities
Subhas Chandra Mukhopadhyay 1, * and Tarikul Islam 2, *
1 School of Engineering, MQ Centre for Smart Green Cities, Macquarie University,
New South Wales, NSW 2109, Australia
2 Department of Electrical Engineering, Faculty of Eng. & Technology, Jamia Millia Islamia (University),
New Delhi-110025, India
* Correspondence: [email protected] (S.C.M.); [email protected] (T.I.)
1. Introduction
Smart cities represent a multidiscipline field continuously evolved by the advancement of
sensor-based information technology and communication technology. Less budget, resource
constraints, and continuous software upgradesare some of the few problems affecting the
implementation of smart cities. However, it is to note that smart city is not only a technical issue
but also smart governance as a complex process of institutional change and acknowledgement of
the geopolitical nature of appealing visions of socio-technical governance [1,2]. The only solution to
these problems is to develop smarter technologies and more efficient usage of available infrastructures
in order to meet the needs of smart cities [3]. A combination of smart sensors, universal platform,
information and communication technologies (ICT), Internet of Things (IoT), energy harvesting, cloud
computing, and open source technologies, compatible with next generation networks (NGN), will
help towards the actual achievement of a smart city [4,5]. It is now possible to develop significant
technology platforms and IoT solutions for smart cities without a massive investment. However, IoT
interoperability is still at a very early stage, and standardization is difficult to achieve as it is usually
led by companies with strong market positions. There is a need for stand-alone development, where
large companies will not dictate terms and conditions.
The aim of this special issue is to report on the design and development of smart sensors,
a universal interfacing platform, along with the IoT framework, extending it to next-generation
networks (4G, 5G, and future networks) for monitoring parameters of interest with the goal of achieving
smart cities. Examples of this work include developing novel sensors for monitoring of environmental
pollution and other parameters and making the data available to a wider community through remote
access to cloud computing. The proposed universal interfacing platform with the IoT framework will
solve many challenging issues, and it will significantly boost the growth of IoT-related applications,
not just in the environmental monitoring domain, but in the other key areas, such as smart home,
wearables, smart city with smart waste management, smart E-metering, smart water supply, intelligent
traffic control, smart grid and remote health care applications, in any country [6]. The need is to
develop a low-cost solution so that any country, without investing a massive amount of resources, can
exploit the research outcomes.
are compared with the commercial DEW point meter. The dew point is the temperature at which
the water vapor present in air/gas condenses to liquid form. This sensor is useful for the condition
monitoring of gas insulated substations (GISs), transformers, and circuit breakers in order to achieve
an uninterrupted power supply in smart cities.
In [8], a smart prayer mat has been designed and tested for detecting human postures and
counting posture cycles. This smart praying mat may be helpfulto help old and forgetful Muslims to
perform their obligatory five times a day religious praying at regular prescribed times. Authors employ
resistive force sensors placed at the prescribed locations in the mat, where forces are significant and
consistent. Unique force patterns are observed according to the position of postures. This technology
was successfully tested with 30 participants in the age group of 30 to 60 years.Recent trends are
to develop a building-integrated photovoltaic system (BIPS) to generate low-cost environmentally
friendly electrical energy. But the low-output efficiency and high costs are the challenges for the
implementation of BIPS system. A low-cost solution with improved solar efficiency by using aluminum
reflector has been proposed in [9]. A bi-reflector solar PV system (BRPVS) with thin film Al-foil reflector
and an LLC converter for a BIPV system is proposed and experimented with a 400-W prototype.
A cadmium–sulfide (CdS) photo-resistor sensor and an Arduino-based algorithm is developed to
control the working of the reflectors. Experimental results show that there is an enhancement of 28%
power efficiency with respect to the solar PV module.
A multiwalled carbon nanotube-based strain sensor is fabricated for structural health monitoring
application [10]. The sensor is fabricated by mixing different amounts of MWCNT and epoxy resin
(EpoThin® ). The sensor works on resistive principle and is mounted on a metal specimen (beam).
The impedance variation of the sensor is studied with the variation of tensile strength on the spavin
with a controlled known force. The response of the sensor shows a significant change in impedance with
a variation of tensile strength. An Internet of Things (IoT)-compatible smart trap detector for crawling
insects and other arthropods in an urban environment has been developed in [11]. A box-shaped
device attracts targeted insect pests, senses the presence of insects, and takes a picture of the internal
space of the boxautomatically, and after a fixed time interval the picture is sent to an authorized
person/stakeholder through a WiFi device. The device has detection efficiency in the range of 96%
to 99%. Asemantic-based decision support system (DSS), depending on ontological models, to assist
architects and interior designers in domestic environments’ reconfiguration for independent living
is discussed in [12]. The development process of the ontology is presented in detail together with
the results deriving from reasoning processes. To ease the reconfiguration of domestic environments,
a prototypical application taking advantage of the DSS is presented. A zero-power microwave sensor
having two pairs of open-ended coaxial probes is used as a liquid sensor.One is inside a known
pure reference water sample, and the other one is inside the water under test. The basestation
propagates a single tone signal at the frequency of f0/2. At the sensing node, an antenna absorbs that
signal and a passive frequency doubler makes its frequency twice, i.e., f0, which will be used as the
carrier signal. At base station, the sensed signal is demodulated. The proposed system is tested for
humic acid water at 2.5 GHz frequency [13].A wireless sensor network having four metal oxide gas
sensors powered by a solar panel to discriminate four volatile compounds, such as benzene, toluene,
ethylbenzene, and xylene (BTEX) has been proposed in [14]. Pattern recognition of data is carried
out by a radial basis neural network and principal component analysis. ZigBee protocol is used to
transmit data wirelessly to a self-developed data cloud. RoomFort, a smart comfort management
system is developed to enhance the comfort of hotel room guests. It provides a set of domain ontologies
to formalize comfort-related metrics and to exploit the automatic reasoning capabilities provided
by Semantic Web technologies while gathering data through a network of sensors to ensure guests
are provided with tailored comfort profiles during their stays in the hotel [15]. Automatic detection
of unusual crowd dynamics using geotagged posts on location-based social networks (LBSNs) is
proposed in [16]. Authors use Instagram API media/search endpoint to collect the location of the
pictures posted by Instagram users in a given area periodically. Locations are summarized by their
2
Electronics 2019, 8, 376
centroid. The entropy algorithm succeeds in finding abnormal events without the need for a training
phase, being able to dynamically adapt to changes in crowd behavior. Cost-effective delivery of
substantialdata content information is a big challenge facing modern mobile communication networks.
In reference [17], authors propose an integrated, proactive content delivery scheme that jointly exploits
the availability of multiple service tiers and multi-user behavior prediction. Three optimal algorithms
and one heuristic algorithm are introduced to solve the cost-minimization problems of multi-user
proactive content delivery under different modeling assumptions. In the traditional wireless sensor
network (WSN), loading balancing technology is difficult to meet the requirements of adaptability
and flexibility. In reference [18], the load balancing issue is addressed by software-defined WSN.
This mechanism utilizes the advantages of a centralized control SDN (software-defined network) and
flexible traffic scheduling. The simulation results show that the improved SDSNLB (software-defined
sensor network load balancing) routing algorithm has better performance than LEACH (low-energy
adaptive clustering hierarchy) protocol.
Author Contributions: S.C.M. and T.I. worked together in the whole editorial process of the special issue,
‘Innovative Technologies and Services for Smart Cities”, published by journal Electronics. T.I. drafted this editorial
summary and S.C.M. reviewed, edited and finalized the manuscript.
Acknowledgments: First of all, we would like to thank all researchers who submitted articles to this special
issue for their excellent contributions. We are also grateful to all reviewers who helped in the evaluation of the
manuscripts and made very valuable suggestions to improve the quality of contributions. We would like to
acknowledge the editorial board of Electronics, who invited us to guest edit this special issue. We are also grateful
to the Electronics Editorial Office staff who worked thoroughly to maintain the rigorous peer-review schedule and
timely publication.
Conflicts of Interest: The authors declare no conflict of interest.
References
1. Meijer, A.; Bolívar, M.P.R. Governing the smart city: A review of the literature on smart urban governance.
Int. Rev. Adm. Sci. 2016, 82, 392–408. [CrossRef]
2. Angelidou, M. Smart cities: A conjuncture of four forces. Cities 2015, 47, 95–106. [CrossRef]
3. Mehmood, Y.; Ahmad, F.; Yaqoob, I.; Adnane, A.; Imran, M.; Guizani, S. Internet-of-things-based smart cities:
Recent advances and challenges. IEEE Commun. Mag. 2017, 55, 17–23. [CrossRef]
4. Ghayvat, H.; Mukhopadhyay, S.C.; Liu, J.; Babu, A.; Elahi, E.; Gui, X. Internet of things for smart homes and
buildings: Opportunities and challenges. Austral. J. Telecommun. Digit. Econ. 2015, 3, 33–47. [CrossRef]
5. Islam, T.; Mukhopadhyay, S.C.; Suryadevara, N.K. Smart sensors and internet of things: A postgraduate
paper. IEEE Sens. J. 2017, 17, 577–588. [CrossRef]
6. Islam, T.; Mukhopadhayay, S.C. Wearable Sensors for Physiological Parameters Measurement: Physics,
Characteristics, Design and Applications. In Wearable Sensors: Applications, Design and Implementation;
Mukhopadhyay, S.C., Islam, T., Eds.; Institute of Physics (IOP): Bristol, UK, 2017; pp. 1–31,
ISBN 978-0-7503-1503-6.
7. Kumar, L.; Islam, T.; Mukhopadhyay, S.C. Sensitivity enhancement of a PPM level capacitive moisture sensor.
Electronics 2017, 6, 41. [CrossRef]
8. Kasman, K.; Moshnyaga, V.G. New technique for posture identification in smart prayer mat. Electronics 2017,
6, 61. [CrossRef]
9. Khan, M.A.; Zeb, K.; Uddin, W.; Sathishkumar, P.; Ali, M.U.; Hussain, S.; Ishfaq, M.; Himanshu;
Subramanian, A.; Kim, H.-J. Design of a building-integrated photovoltaic system with a novel Bi-reflector PV
System (BRPVS) and optimal control mechanism: An experimental study. Electronics 2018, 7, 119. [CrossRef]
10. Sam-Daliri, O.; Faller, L.; Farahani, M.; Roshanghias, A.; Oberlercher, H.; Mitterer, T.; Araee, A.; Zang, H.
MWCNT-epoxy nanocomposite sensors for structural health monitoring. Electronics 2018, 7, 143. [CrossRef]
11. Eliopoulos, P.; Tatlas, N.; Rigakis, I.; Potamitis, I. A “smart” trap device for detection of crawling insects and
other arthropods in urban environments. Electronics 2018, 7, 161. [CrossRef]
12. Spoladore, D.; Sacco, M. Semantic and dweller-based decision support system for the reconfiguration of
domestic environments: RecAAL. Electronics 2018, 7, 179. [CrossRef]
3
Electronics 2019, 8, 376
13. Mirzavand, R.; Honari, M.M.; Laribi, B.; Khorshidi, B.; Sadrzadeh, M.; Mousavi, P. An unpowered sensor
node for real-time water quality assessment (humic acid detection). Electronics 2018, 7, 231. [CrossRef]
14. Arroyo, P.; Lozano, J.; Suárez, J.I. Evolution of wireless sensor network for air quality measurements.
Electronics 2018, 7, 342. [CrossRef]
15. Spoladore, D.; Arlati, S.; Carciotti, S.; Nolich, M.; Sacco, M. RoomFort: An ontology-based comfort
management application for hotels. Electronics 2018, 7, 345. [CrossRef]
16. Garcia-Rubio, C.; Redondo, R.P.D.; Campo, C.; Vilas, A.F. Using entropy of social media location data for the
detection of crowd dynamics anomalies. Electronics 2018, 7, 380. [CrossRef]
17. Hu, J.; Lai, Y.; Peng, A.; Hong, X.; Shi, J. Proactive content delivery with service-tier awareness and user
demand prediction. Electronics 2019, 8, 50. [CrossRef]
18. Cui, X.; Huang, X.; Ma, Y.; Meng, Q. A load balancing routing mechanism based on SDWSN in smart city.
Electronics 2019, 8, 273. [CrossRef]
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
4
electronics
Article
Sensitivity Enhancement of a PPM Level Capacitive
Moisture Sensor
Lokesh Kumar 1 , Tarikul Islam 2, * and Subhas Chandra Mukhopadhyay 3
1 Department of Physics & Astrophysics, University of Delhi, Delhi-110007, India; [email protected]
2 Department of Electrical Engineering, Faculty of Engineering & Technology,
Jamia Millia Islamia (A Central University), Maulana Mohammed Ali JauharMarg,
New Delhi 110025, India
3 Department of Mechanical/Electronics Engineering, Macquarie University, Sydney, NSW 2109, Australia;
[email protected]
* Correspondence: [email protected]; Tel.: +91-11-2698-1717 (ext.2355)
Abstract: Measurement of moisture at ppm or ppb level is very difficult and the fabrication of such
sensors at low cost is always challenging. High sensitivity is an important parameter for trace level
(ppm) humidity sensors. Anelectronic detection circuit for interfacing the humidity sensor with high
sensitivity requires a simple hardware circuit with few active devices. The recent trends for increasing
the sensitivity include fabricating nanoporous film with a very large surface area. In the present
work, the sensitivity of a parallel plate capacitive type sensor with metal oxide sensing film has been
significantly improved with an aim to detect moisture from 3 to 100 ppm in the industrial process
gases used to fabricate semiconductors and other sensitive electronic devices. The sensitivity has
been increased by (i) fabricating a nanoporous film of aluminum oxide using the sol-gel method and
(ii) increasing the cross-sectional area of a parallel plate capacitor. A novel double sided capacitive
structure has been proposed where two capacitors have been fabricated—one on the top and one
on the bottom side of a flat alumina substrate—and then the capacitors are connected in parallel.
The structure has twice the sensitivity of a single sensor in the same ppm range but the size of the
structure remains unchanged. The important characteristics of the sensors such as the sensitivity
ΔC
(S = Δppm × 100), the response time (tr ), and the recovery time (tc ) are determined and compared
with a commercial SHAW, UKdew point meter. The fabricated double sided sensor has comparable
sensitivity (S = 100%, tr (s) = 28, tc (s) = 40) with the commercial meter (S = 100.5%, tr (s) = 258)
but has a faster response time. The proposed method of sensitivity enhancement is simple, and
mass producible.
Keywords: porous alumina; sol-gel technique; capacitive sensor; sensitivity; dynamic range; ppm
1. Introduction
Humidity sensors are widely used in different industrial, agricultural, medical, food preservation,
home ventilation and air-conditioning (HVAC), and respiratory monitoring applications for the
development of smart cities. Moisture measurement at ppm level is essential for condition monitoring
of gas insulated substations (GISs), transformers, and circuit breakers in orderto achieve uninterrupted
power supply in smart cities. The trace moisture sensor is extremely useful in certain crucial
applications, where it can withstand corrosive and contaminating gases. The sensor should be
sensitive to sudden and drastic change of moisture and available at low cost with a relatively long
calibration period. The dynamic range of humidity measurement, which extends from %RH to ppb
level, is extremely large [1–5]. Capacitive sensors are widely used for the measurement of humidity
over a wide range. The most widely used capacitive sensor in %RH is the interdigitated electrode
structure. The interdigitated sensor, to the best of our knowledge, is only suitable for RH level humidity
measurement [5]. Very recently, an attempt has been made by the authors to measure moisture at ppm
level by a micro interdigitated capacitive sensor. However, the sensor does not show sensitivity less
than 200 ppm [6]. A large number of research articles is published every year in different journals
on the topic of %RH humidity measurement. However, the number of research papers for ppm level
moisture detection is very low [5]. The cost of a commercial ppm level moisture sensor is at least fifty
times higher than that of RH sensors [6,7].
Aluminum oxide may be suitable for trace level moisture measurement, since it is thermally
stable, and chemically inert in a corrosive environment. Among the different methods of alumina
film preparation, the sol-gel method is a simple, less expensive method to prepare a pure ceramic thin
film of desired thickness. The film can be formed on the ceramic substrate by the dip coating, spin
coating or spray coating method [1,2,6–10]. Incomparison to other ceramic materials, aluminum oxide
(Al2 O3 ) is highly hydrophilic and it is one of the most useful materials for moisture measurement
in most industrial gases [4,10,11]. Several works have been reported in the recent past to measure
moisture in the range of 0–100 ppm. However, enhancement of the sensitivity is still required to
make a prototype system for the possibility of commercial applications. In addition, there is a need to
increase the dynamic range below 10 ppm [8,9,12–23]. Continuous efforts are made by the researchers
to fabricate highly porous nanostructures such as nanowire, nanotubes, and nanopores using different
fabrication techniques. Such nanostructure films result in a very high surface area suitable for humidity
sensing [23–29]. Efforts are also being made to explore new fabrication techniques and materials to
achieve the goal of high sensitivity and selectivity [30]. The methods followed for the fabrication
of nanostructures with desirable pore morphology are costly, time consuming and very often lead
to failure. It is not necessary that the sensitivity will increase by increasing the surface area. It also
requires tuning the pore morphology. Most recently, the sensitivity of a capacitive trace moisture sensor
was enhanced by increasing the surface area of a pure alumina nanoporous film with the addition
of polymer polyethylene glycol (PEG). The surface area of the alumina is increased two-fold but the
sensitivity is increased by approximately 61%. It is found that with the increase in surface area, the
size of the pores also increases [8].
In the present work, we have studied the sensitivity of a capacitive trace moisture sensor for
measuring moisture in ppm. The sensitivity has been addressed by (i) selecting a suitable pore
morphology nanostructured thin film of Al2 O3 ; and (ii) increasing the cross-sectional area of the
parallel plate electrode. To enhance sensitivity further, a unique structure with two identical parallel
plate capacitors on each side of the alumina substrate has been fabricated. When these two capacitors
are connected in parallel, the sensitivity is enhanced almost two-fold but the actual size remains
unchanged. Also, this structure prevents the wastage of very useful dip-coated film on the opposite
side of the substrate as reported previously in [7,9,14,16,17,21–23]. The proposed method of sensitivity
enhancement is easy, simple, and less time consuming. The sensor can be utilized for condition
monitoring of electrical equipment and moisture measurement in human respiration.
2. Experimental
6
Electronics 2017, 6, 41
solution. The dispersed ions form a net structure and after complete peptization, the sol becomes
transparent. To remove the excess volatile organic impurities from the sol, the solution was refluxed for
about 18 h at a constant temperature of 80 ◦ C.Finally, the solution was stirred on a magnetic hot plate
for nearly 24 h at a room temperature of 25 ◦ C. To facilitate the adhesion of the film on the substrate,
nearly 1% polyvinyl alcohol (molecular weight 125,000) was mixed in the sol solution.
180
[311] [400] [440
160 ]
140
120
Intensity (a.u.)
100
80
60
40
20
0
20 30 40 50 60 70 80
2ș (°)
Figure 1. XRD results of the alumina powder prepared from the sol-gel method showing γ-Al2 O3 (450 ◦ C, 1 h).
The average size of the crystallite was found to be ~4 nm. The BET gas adsorption and desorption
method was used to determine the surface area of the powder samples. The nitrogen gas adsorption
isotherm of the sample is shown in Figure 2 [11,12].The isotherm was studied using a Nova 2000e
(Quantachrome Instruments Limited, Boynton Beach, FL, USA) BET analyzer at liquid nitrogen
temperature (77 K). The oxide sample in power form was placed in a sample cell and allowed to degas
for nearly 2 h at 250 ◦ C in vacuum. The degassed material was then exposed to a known concentration
of N2 gas at the constant temperature. The adsorption isotherm plotted between 1/[W((Po/P)-1)] and
relative pressure P/P0 for γ-Al2 O3 is shown in Figure 2.
The specific surface area, the average pore size and the micro-pore volume of the samples sintered
at different conditions are shown in Table 1.
It is observed that with the increase in sintering time and temperature, the BET surface area
reduces and the DA (Dubinin Astakhov) pore size increases. The roughness of the porous film
7
Electronics 2017, 6, 41
deposited on an alumina substrate (α-phase) was determined by the atomic force micrograph (AFM).
The microstructure of the alumina film deposited on the substrate was also studied using FESEM.
The FESEM image of the top surface of the metal oxide film at 100 nm scale is shown in Figure 3.
The surface contains a large number of voids (micropores) of different sizes. The average pore size of
the voids is around 10 nm.
14.0
y = 18.88 ×(P/Po) + 0.029
12.0 R² = 0.99
1 / [ W((Po/P) - 1) ]
10.0
8.0
6.0
4.0
2.0
0.0
0.00 0.10 0.20 0.30 0.40 0.50 0.60 0.70
Sample BET Surface Area (m2 /gm) DA Pore Size (Å) MicroporeVolume(cc/gm)
Alumina (450 ◦ C, 1 h) 220 10.4 0.200
Alumina (450 ◦ C, 6 h) 200.4 10.8 0.177
Alumina (900 ◦ C, 1 h) 186 12.2 0.139
ȱ
Figure 3. Scanningelectronmicrograph of the top surfaceofthe γ-Al2 O3 film.
8
Electronics 2017, 6, 41
A thin film of binder mixed alumina sol was deposited on the gold printed alumina substrate
by a desktop computer interfaced automatic Single Dip Coatinginstrument (Model: SDC-2007C,
Apex Instruments Co. Pvt. Ltd., Kolkata, India). The substrate was dipped in the prepared sol at a
dipping speed of 60 mm/m, wet time 30 s and then pulled out at a speed of 30 mm/m. The substrate
was kept for 1 m in the solution before being pulled off. Deposited thin film was dried at 80 ◦ C for
nearly 5 min. The steps of film deposition over the substrates were repeated six times.
When the film was dried, a second gold electrode was screen printed on the sensing film. The top
electrode is made macroporous with average pore size (~1–7 μm), which is much larger than the
average pore size of the sensing film. The schematic of film deposition of γ-Al2 O3 on gold plate by the
sol-gel method is shown in Figure 4.
The red dots in the schematic indicate the formation of pores after sintering. Finally, two terminals
are soldered at the top and the bottom electrodes for the electrical connection of the sensor. Precautions
were taken to minimize the variation of the film thickness among sensors with the help of a software
controlled automatic dipcoater. All the four sensors have almost identical dielectric films, except the
electrode size. Figure 5a shows the schematic and Figure 5b shows the photograph of the sensors
fabricated in the laboratory environment.
9
Electronics 2017, 6, 41
(a)ȱ (b)
Figure 5. The capacitive sensor with different sensing area (a) schematic diagram of the sensor;
(b) photograph.
10
Electronics 2017, 6, 41
worstcase scenarioin determining the transient response curve. The sensor takes a very short time,
29 s, to increase the capacitance value from 10 to 90% of its maximum value. During recovery, the
sensor was refreshed by dry nitrogen gas to decrease the moisture concentration from 100 ppm to
3 ppm. The capacitance value of the sensor decreases with the decrease in moisture concentration
as shown in Figure 7. The recovery time of the sensor is defined as the time taken by the sensor to
decrease the capacitance value from maximum to 10% value and it is ~87 s. For the sensor Cp2 , the
response time is 28 s and the recovery time is 85 s. The response and the recovery time depend on
the pore morphology, and the thickness of the sensing film. The humidity sensor which works on
the adsorption and desorption principle, takes more time to desorb than to adsorb the moisture in
the pores. It is observed that the output of the sensor is stable and recovers fully, when the sensor is
refreshed by dry N2 gas. Because of the small sensitivity of Cp3 and Cp4 , tr and tc of these sensors are
not determined.
11
Electronics 2017, 6, 41
where γ is the fractional volume of water adsorbed by the porous film, and εw is the dielectric constant
of water. The fractional volume of water adsorbed in the porous film depends on the pore morphology.
The well-known equation for the Kelvin radius gives us useful information about the desired pore
morphology. It is reported that theoretically, the pore size as obtained from the Kelvin equation for
sensing moisture in ppm should be below 10 Å [8,26]. The average pore size of the fabricated film as
shown in Table 1 is 12.2 Å (γ-Al2 O3 sintered initially at 450 ◦ C and then at 900 ◦ C for 1 h), which is
close to the theoretical value.
The sensitivity (S) of a sensor can be defined as [1,2,20,27]
Cu − Cl
S= (4)
Cl
Cu − Cl
S= (5)
RHu − RHl
Cu −Cl
Cl
S= (6)
RHu − RHl
where Cu and Cl are the upper and the lower limit of the capacitance values of the sensor, RHu and
RHl are the upper and the lower limit of humidity (%RH or ppm). The sensitivity represented by
Equation (5) is more suitable in such a situation when the sensor has approximately linear response [20].
The output of the sensor is approximately linear (R2 = 0.95, for perfect linear response R2 = 1).
Equation (5) is more usable to understand the performance of the sensor since it provides information
about the input and the output parameters, but in Equation (4), the reader does not have an idea about
the type of input parameter and its range.
The sensitivity parameters of four sensors have been determined using Equation (5).
The sensitivity values of all the four sensors in the range 3–100 ppm are plotted with the variation of
the cross-sectional area. It is observed in Figure 8 that the sensitivity increases almost linearly with the
increase in effective area. When the effective cross-sectional area increases, more water molecules are
adsorbed in the nanostructured porous film, resulting in an increase in effective dielectric constant.
12
Electronics 2017, 6, 41
50
y = 0.434x - 3.5436
45
R² = 0.9569
40
35
30
S (%)
25
20
15
10
5
0
0 20 40 60 80 100 120
Sensing area (mm2)
Figure 8. Variation of sensitivity with electrode area for 3–100 ppm moisture.
13
Electronics 2017, 6, 41
of the sensor C2 with the variation of moisture is shown in Figure 9a. The capacitive response of C3
when both C1 and C2 are connected in parallel is shown in Figure 9b.
980
960 S (%) = 51
950
940
(a)
930
920
910
0 30 60 90 120
Moisture (ppm)
1880
1820
1800
(b)
1780
1760
1740
0 20 40 60 80 100 120
Moisture (ppm)
Figure 9. The response curve of the proposed sensor structure connected in parallel, (a) C2; the
capacitor on the bottom side (b) C3 = C1 + C2.
It is observed that in the case of C3, the overall capacitance change for the same moisture range
becomes almost double. This sensitivity enhancement is obtained by simply connecting the two
capacitors in parallel without modifying the surface area or the thickness of the film. The correlation
coefficient of the actual response curve from the linear fitted curve is 0.95, which is close to the desired
value of 1. Linearity is always a desirable characteristic of a sensor for ease of calibration. For a
linear response, only two calibration points are required to calibrate the reading. The conversion
from a scale reading to the corresponding measured value of input moisture is most convenient if
it is required to multiply a fixed constant rather than to refer to a nonlinear calibration curve or to
compute from a nonlinear calibration equation.Hysteresis is another important parameter of a sensor.
When a sensor is employed for moisture measurement in any application, the moisture level in the
environment may increase or decrease. Ideally, the sensor should give the same capacitance at the
14
Electronics 2017, 6, 41
same moisture level when approached in both directions. For a sensor withhysteresis error, different
reading results for a particular moisture level are given, depending on whether the moisture level is
applied from lower or higher values. The hysteresis plot for both increase and decrease in moisture
from 13 to 108 ppm for C3 is shown in Figure 10. The maximum deviation of the capacitance value
for the forward and reverse cycle of moisture is around 0.45%. The response and recovery times of
C3 determined from the transient response curve for a 3–108 ppm step change in moisture are 28 s
and 40 s respectively. The repeatability of the capacitive response of C3 for three similar step changes
in moisture concentration is shown in Figure 11. The repeatability error is caused by the inability
of the sensor to give the same capacitance under similar step change in moisture. The maximum
repeatability error of the sensor output is ~0.2% and the standard deviation of the successive peaks is
0.7. Experiments were also performed to study the signal frequency effect on the capacitance values,
by varying the frequency from 100 Hz to 100 kHz at fixed 80 ppm moisture. The rate of change of
the capacitance value at lower frequency—below 20 kHz—is much higher than the frequency above
20 kHz. Therefore, the ac signal with frequency above 20 kHz is suitable to avoid the frequency
dependency capacitance change. This is due to the fact that, when the sensor is interfaced with an
electronic circuit for displaying the moisture value, the minor change in excitation frequency does not
affect the reading of the meter. High capacitance change at lower frequency is due to the combined
effect of dielectric adsorption capacitance and the double layer capacitance. At higher frequency, the
effect of double layer capacitance is insignificant [33].
1.88
1.86 Increase in moisture
Capacitance (nF)
1880
1860
1840
Capacitance (pF)
1820
1800
1780
1760
1740
0 500 1000 1500 2000 2500 3000 3500 4000
Time (s)
15
Electronics 2017, 6, 41
Investigation is needed to study the drift due to aging [2]. Our experience shows that if the
sensor is kept in drying agent (molecular sieve) as practiced in a commercial dew point meter (SHAW),
the reading will be stable for a long time [10,11]. However, if there is a drift in the output, it can be
reduced by heating the sensor at a temperature of around 400 ◦ C. Drift is caused due to deposition of
residual impurity from the N2 gas or due to gradual change in γ phase to γ-Al2 O3 .H2 O (boehmite).
This causes volume expansion of the oxide, resulting in a gradual decrease in surface area and
porosity [2]. The sensor does not show any drift due to the change in working temperature [9,18,19,23].
Comparison of the characteristics of the single sided and double sided sensor with the reading of the
commercial dew point meter is shown in Table 3.
6. Conclusions
The present work deals with the fabrication of capacitive porous alumina-based sensors with
different sensing areas for sensing humidity in ppm. The pore morphology of the sensing layer of
each sensor is identical. The characteristics of the moisture sensors were examined for 3 to 100 ppm
moisture content in dry gas. We have found that a moisture sensor with a larger effective area has
higher sensitivity in a lower range. Pore morphology, thickness of the film and the sensing area play an
important role for the sensitive detection of humidity at trace level. The parallel plate sensor provides
a better solution for trace moisture detection. In comparison to the conventional interdigitated sensor,
the parallel plate sensor with very small size may sense humidity at the %RH level. We have also
discussed another unique structure consisting of capacitors on each side of the substrate to enhance the
sensitivity for trace level moisture detection. This double sided capacitor structure is easy to fabricate
and it can enhance sensitivity greatly without affecting the overall size. It may be possible to obtain a
measurementbelow 3 ppm, but due to the lack of a testing facility, an experiment was not conducted.
Further work could test the sensor’s ability to measure moisture in GIS or transformer oil.
Acknowledgments: Authors would like to thank the funding agency DRDO for providing the financial support.
Author Contributions: L.K. performed the experimental work under the supervision of T.I. S.C.M. gave the
valuable suggestion to conduct experiments.
Conflicts of Interest: The authors declare no conflict of interest.
1. Fenner, R.; Zdankiewicz, E. Micromachined water vapor sensors: A review of sensing technologies. IEEE Sens.
2001, 1, 309–317. [CrossRef]
2. Feng, S.; Chen, X.; Chen, J.; Hu, J. A novel humidity sensor based on alumina nanowire films. J. Phys. D
Appl. Phys. 2012, 45, 225305. [CrossRef]
3. Tetelin, A.; Pouget, V.; Lachaud, J.-L.; Pellet, C. Dynamic behavior of a chemical sensor for humidity level
measurement in human breath. IEEE Trans. Inst. Meas. 2004, 53, 1262–1267. [CrossRef]
4. Fagan, J.G.; Amarakoon, V.R.W. Reliability and reproducibility of ceramic sensors, part III, humidity sensors.
Am. Ceram. Soc. Bull. 1993, 72, 119–130.
5. McMillan, G.K.; Douglas, M. Process/Industrial Instruments and Controls Handbook, 5th ed.; Tata McGraw Hill
Education Private Limited: Patel Nagar, New Delhi, India, 2009; pp. 4237–4247.
6. Blanka, T.A.; Eksperiandova, L.P.; Belikov, K.N. Recent trends of ceramic humidity sensors development:
A review. Sens. Actuators B 2016, 228, 416–442. [CrossRef]
16
Electronics 2017, 6, 41
7. Islam, T.; Nimal, A.T.; Mittal, U.; Sharma, M.U. A micro interdigitated thin film metal oxide capacitive sensor
for measuring moisture in the range of 175–625 ppm. Sens. Actuators B 2015, 221, 357–364. [CrossRef]
8. Mahboob, M.R.; Zargar, Z.H.; Islam, T. A sensitive and highly linear capacitive thin film sensor for trace
173 moisture measurement in gases. Sens. Actuators B 2016, 228, 658–664. [CrossRef]
9. Funke, H.H.; Grissom, B.L.; McGrew, C.E.; Raynor, M.W. Techniques for the measurement of trace moisture
in high-purity electronic specialty gases. Rev. Sci. Instrum. 2003, 74, 3909–3933. [CrossRef]
10. Neumeier, S.; Echterhof, T.; Olling, R.; Pfeifer, H.; Simona, U. Zeolite based trace humidity sensor for high
temperature applications in hydrogen atmosphere. Sens. Actuators B 2008, 134, 171–174. [CrossRef]
11. Islam, T.; Kumar, L.; Khan, S.A. A novel sol-gel thin film porous alumina based capacitive sensor for
measuring trace moisture in the range of 2.5 to 25 ppm. Sens. Actuators B 2012, 173, 377–384. [CrossRef]
12. De Lange, M.F.; Vlugt, T.J.H.; Gascon, J.; Kapteijn, F. Adsorptive characterization of porous solids: Error
analysis guides the way. MicroporousMesoporous Mater. 2014, 200, 199–215. [CrossRef]
13. Brinker, C.J.; Scherer, G.W. Sol–Gel Science; Academic Press: San Diego, CA, USA, 1990.
14. SHAW Moisture Meters (UK) Ltd. Westgate Bradford. BD13SQ. Available online: www.shawmeters.com
(accessed on 15 March 2017).
15. General Electric. Moisture and Humidity Measurement. Available online: www.ge-mcs.com (accessed on
15 March 2017).
16. Hashiguchi, K.; Lisak, D.; Cygan, A.; Ciuryło, R.; Abea, H. Wavelength-meter controlled cavity
ring-downspectroscopy: High-sensitivity detection of trace moisture in N2 at sub-ppb levels.
Sens. Actuators A 2016, 241, 152–160. [CrossRef]
17. Kapaa, P.; Pana, L.; Bandhanadhama, A.; Fanga, J.; Varahramyana, K.; Davis, W.; Ji, H.F. Moisture
measurement using porous aluminum oxide coated microcantilevers. Sens. Actuators B 2008, 134, 390–395.
[CrossRef]
18. Pandey, M.; Mishra, P.; Saha, D.; Sengupta, K.; Jain, K.; Islam, S.S. Nanoporous alumina (c- and a-phase)
gel cast thick film for the development of trace moisture sensor. J. Sol-Gel Sci. Technol. 2013, 68, 317–323.
[CrossRef]
19. Ohira, S.; Goto, K.; Toda, K.; Dasgupta, P.K. A capacitance sensor for water: Trace moisture measurement
ingases and organic solvents. Anal. Chem. 2012, 84, 8891–8897. [CrossRef] [PubMed]
20. Doeblin, E.O. Measurement Systems: Application and Design, 4th ed.; Tata McGraw Hill: New Delhi, India,
2002; p. 198.
21. Basu, S.; Saha, M.; Chatterjee, S.; Mistry, K.; Bandyopadhay, S.; Sengupta, K. Porous ceramic sensor for
measurement of gas moisture in the ppm range. Mater. Lett. 2001, 49, 29–33. [CrossRef]
22. Saha, D.; Sengupta, K. Trace moisture detection in oil filled transformer by ceramic sensor. Mater. Sci. Eng.
2015, 73, 012022. [CrossRef]
23. Chen, Z.; Jin, M.C. An Alpha-Alumina Moisture Sensor for Relative and Absolute Humidity Measurement.
In Proceedings of the 1992 IEEE Industry Applications Society Annual Meeting, Houston, TX, USA,
4–9 October1992; Volume 2, pp. 1668–1675.
24. Islam, T.; Mahboob, R.; Khan, S.A. A simple MOX vapor sensor on polyimide substrate for measuring
humidity in ppm Level. IEEE Sens. 2015, 15, 3004–3013. [CrossRef]
25. Kima, Y.; Junga, B.; Leea, H.; Kimb, H.; Leeb, K.; Park, H. Capacitive humidity sensor design based on anodic
aluminum oxide. Sens. Actuators B 2009, 141, 441–446. [CrossRef]
26. Islam, T.; Khan, U.A.; Akhtar, J.A.; Rahman, M.Z.U. A digital hygrometer for trace moisture measurement.
IEEE Trans. Ind. Electr. 2014, 61, 5599–5605. [CrossRef]
27. Bakhoum, E.G.; Cheng, M.H.M. High-accuracy miniature dew point sensor and instrument. IEEE Sens. J.
2015, 15, 1482–1488. [CrossRef]
28. Batumalay, M.; Harun, S.W.; Irawati, N.; Ahmad, H.; Arof, H. A study of relative humidity fiber-optic sensors.
IEEE Sens. J. 2015, 15, 1945–1950. [CrossRef]
29. Babaei, F.H.; Rahbarpour, S. Alteration of pore size distribution by sol–gel impregnation for dynamic range
and sensitivity adjustment in Kelvin condensation-based humidity sensors. Sens. Actuators B 2014, 191,
572–578. [CrossRef]
30. Lopez, F.M.; Briand, D.; Rooij, N.F. Decreasing the size of printed comb electrodes by the introduction of a
dielectricinterlayer for capacitive gas sensors on polymeric foil: Modeling and fabrication. Sens. Actuators B
2013, 189, 89–96. [CrossRef]
17
Electronics 2017, 6, 41
31. Whelan, A.M. Sol-Gel Sensors. In Sol-Gel Materials for Energy, Environment and Electronic Applications; Springer:
Berlin, Germany; pp. 121–153.
32. Yoldas, B.E. Design of sol-gel coating media for ink-jet printing. J. Sol-Gel Sci. Technol. 1998, 13, 147–152.
[CrossRef]
33. Islam, T.; Rahman, Z.U. Investigation of the electrical characteristics on measurement frequency of a thin-film
ceramic humidity sensor. IEEE Trans. Instrum. Meas. 2016, 65, 694–702. [CrossRef]
© 2017 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
18
electronics
Article
New Technique for Posture Identification in
Smart Prayer Mat
Kasman Kasman * and Vasily G. Moshnyaga
Graduate School of Engineering, Fukuoka University, Fukuoka 814-0180, Japan; [email protected]
* Correspondence: [email protected]; Tel.: +81-92-801-0833
Abstract: Smart praying mats are essential to help old and forgetful Muslims perform their religious
needs. Due to the binary representation of pressure sensors embedded into the mat for posture
identification, existing smart praying systems either use large sensing arrays, thus becoming
expensive and bulky, or utilize only a limited number of sensors, minimizing the cost of posture
recognition accuracy. This article presents a new technique for detecting human postures and
counting posture cycles by a smart mat. Unlike related solutions, the proposed technique identifies
postures by voltage levels observed from five sensors only. The technique has been implemented
in a prototype smart mat and experimentally evaluated by 30 Islam worshipers. The results show
that it provides unobtrusive and robust (100%) recognition of all six postures of the Muslim praying
cycle and reliable cycle counting. The implementation is inexpensive, easy to use and quite helpful
for users.
Keywords: smart mat; pressure sensors; sensor systems and applications; assistive living
1. Introduction
Praying is a central pillar of the Muslim faith; a mandatory religious ritual performed five times
a day at prescribed times. The ritual is quite challenging for elders whose attentive and cognitive
capabilities are deteriorating with age. When praying, a worshiper has to perform a sequence of
six postures (Figure 1) called Rakah (in singular) and Rakat (in plural). Because the sequence must be
repeated a number of times while reciting passages from the Quran, elders frequently have difficulty
remembering which cycle is being performed. Incomplete sequence, however, is not acceptable.
Once forgotten, a worshiper must go back and fulfill an extra sequence to ensure that he has done the
proper number of Rakat.
D E F G H I
ȱ
Figure 1. The sequence of postures to complete a single Rakah in a prayer: (a,c) standing (b) bowing;
(d,f) prostration; (e) sitting.
Furthermore, the number of cycles, which must be repeated by a worshiper in a pray, varies
according to the time of day as well as the day. For example, two Rakat must be performed at dawn
prayer, four at each prayer at noon, afternoon and evening, and three at sunset prayer. Old and
forgetful people have problems not only remembering how many ritual cycles have to be performed
in a prayer but also losing track of the cycles that they have already completed [1]. Although Muslims
with severe mental illness or intellectual disability are allowed to be exempted from praying, those with
mild and moderate cognitive impairment are not. The options they currently have are quite limited:
either to perform in a congregation following the leader or ask someone to inform them which
Rakah is currently performed. Elders with cognitive impairment usually practice their rituals at
home. They live independently and frequently do not have someone close to ask. At the same
time, those who can usually hesitate being a burden to others and showing their cognitive problems,
and may eventually lead to bad mood, depression, more extensive cognitive decay, and a stronger
association with dementia [2]. Therefore, information and communication technologies capable of
assisting forgetful Muslims in praying are important.
In this article, we present a new technique for automatic sensing and recognition of Rakat postures
by using a smart mat.
2. Related Research
Over the years, various technologies have been proposed to help Muslims with prayers and
Rakat counting. Google Play and Apple Store nowadays contain a number of software applications
which can automatically count the number of Rakat on mobile devices (smartphones or tablet PC)
with embedded accelerometers. In order to use the applications, a worshiper must possess a proper
device in addition to a prayer mat (which is not always the case for old and forgetful people), and also
be within the area of Global System for Mobile Communications (GSM) or Wifi coverage in order to
access the application server. Therefore, research efforts have been concentrated on incorporating
Rakat counting electronics into the prayer mat itself.
Khatri [3] proposed the use of a solar-powered electrical switch pad and liquid crystal display
(LCD) operable by a forehead of a worshipper when he or she prostrates on the mat. Faouaz [4] also
used LCD with a switch, built in the prayer mat, with the difference that the switch is turned on and off
by the user. Abdelmohsen [5] advocated placing a so-called “pressurable plate” under an ordinary mat
to detect a prostration posture anytime the user’s forehead touches the mat, and incrementing the Rakat
counter on display by every even prostration posture. Arrar [6] developed a portable cycle counter
based on IR sensors embedded into the prayer rug. Kantarceken [7] presented a prayer assistance
device with built-in camera, infra-red sensors, microphones, Bluetooth and acoustic transducers for
detecting physical gestures and spoken words of a prayer. Ismail et al. [8] used pressure sensors
embedded in the mat under the forehead area to detect the prostration posture. When a second
prostration is recognized, the counter is incremented, and its value is displayed on an MP3 player and
replayed as an audible cue.
Despite differences in implementation, all of these smart prayer mats have several features in
common. Namely, they differentiate human postures by patterns of binary signals (0 and 1) generated
from switches or pressure sensors embedded into the mat. The sensors operate locally while the
postures span the entire area of the prayer mat. Therefore, the devices either employ a large number of
sensors distributed over the mat, as shown in Figure 2a, in order to improve the detection accuracy on
expense of cost (e.g., [6,8]), or use a few sensors placed under the forehead (see Figure 2b) to detect the
prostration posture only (e.g., [4,5,7]). These cost-oriented solutions do not take into account the other
postures of the Rakah sequence and thus might increment the counter when the user skips a posture or
makes two prostrations consequently; which is unacceptable. Besides, to our knowledge, none of the
existing prayer mats proposed so far can differentiate the standing posture from the bowing posture,
thus impeding the correct posture recognition.
20
Electronics 2017, 6, 61
(a)ȱ (b)ȱ
Figure 2. Distribution of pressure sensor in existing smart mats: (a) distributed over the mat area;
(b) localized in the forehead area.
It should be noted that research on smart mats/carpets capable of recognizing human postures and
analyzing the human gait has intensified recently, especially for health-care and medical applications.
Middleton et al. [9] developed a gate-recognition “floor sensor” that had 1536 small sensing elements
arranged in a 3 × 0.5 m2 rectangular strip with an individual sensor area of 3 cm2 . Aud et al. [10]
presented a fall-detecting smart carpet built from an array of signal-scavenging sensors that use
energy available throughout the environment. Although this design does not have a power supply,
the electronics put into the carpet make it thick and heavy. For example, a small mat of the carpet has
four blocks of foil reading electronics parts, four AD convertors, one microcontroller, and one wireless
transmitter. Miguel et al. [11] and Cheng et al. [12] advocated using arrays of pressure sensors made
of electrostatic discharge protection foam mixed with carbon fiber to identify static activities on the
carpet. Tanaka et al. [13] designed a smart carpet from an array of pressure-sensing tiles that can be
easily assembled on a floor to monitor user position, motion and falls. Chaccour et al. [14] embedded
a matrix of differential piezoresistive pressure sensors into a carpet for fall detection. Ho et al. [15]
proposed a textile technology for making smart carpets from tension-sensitive electro-conductive yarns.
The sensing yarn has an elastic core wound around by two tension-sensitive electro-conductive threads
of polyester and stainless steel fibers separated by a non-conductive basal layer. The technology
can detect light touch, tactile perception, and tensile forces, and seems to be promising though its
application in smart mats has not been revealed yet.
In addition to the abovementioned research, a number of successful products have been already
deployed. An example is a smart yoga mat [16] that employs over 21,000 built-in piezoresistive sensors
to detect human poses and display them on a smartphone or tablet PC. The device provides robust
identification of various yoga postures, thus allowing the user to improve his/her yoga practice.
However, it is quite expensive (450 US$ retail price).
In this article, we propose a new technique for posture detection and identification by using smart
mats. In contrast to related methods, the proposed technique differentiates postures based on voltage
levels generated by mat sensors. According to experimental evaluation, it provides unobtrusive and
robust detection of all six Rakah postures and reliable Rakat counting. Its implementation is simple
and efficient, yet inexpensive.
The rest of the article is organized as follows. In the next section, we discuss the proposed
technique. Section 4 describes the prototype’s implementation in a smart mat and presents results of
experimental evaluation. Section 5 summarizes our findings and outlines work for the future.
3.1. An Overview
The key idea behind our method emanates from empirical analysis of output voltages produced by
a pressure sensor of a single zone force-sensing resistor (FSR) family, which are largely used nowadays
in automotive electronics, medical systems, and various industrial and robotics applications. A FSR is
a two-wire device made from polymer thick film that “exhibits a decrease in resistance with increase
in force applied to the surface of the sensor” [17]. As the force grows, the output voltage increases.
When a person steps over the sensor, his weight causes the sensor to generate an output voltage
21
Electronics 2017, 6, 61
proportional to the product of person’s mass and the gravitational acceleration. For example, if a FSR
sensor is tied to a measuring resistor RM in a configuration shown in Figure 3a, the output voltage,
VOUT , increases with weight, as depicted in Figure 3b. Under a constant force, the output voltage
remains constant. Note, the weight in the article is shown in terms of kilogram-force (1 kgf = 9.8 N).
(a)ȱ (b)
Figure 3. Results of force-sensing resistor (FSR) sensor testing: (a) a test circuit; (b) FSR voltage as
a function of applied weight and output resistance RM .
As a force, weight has both a magnitude and a direction associated with it. While the direction of
the weight force always remains toward the center of the earth, the distribution of the weight over the
body’s center of gravity changes with human posture. For instance, when a person stands straight,
his weight concentrates over his feet. So the weight force is maximal. When a person bows, sits or
prostrates, his body’s center of gravity shifts and so does the weight distribution. Because a posture
affects the weight force applied to the sensor, it changes the voltage produced by the sensor.
Figure 4 depicts the FSR voltage variations with postures, accumulated (at RM = 600 Ω) from
a test in which 30 people of different weight were standing, sitting and prostrating while a FSR sensor
was under their feet. As one can see, the postures induce distinguishable voltages though the levels of
the voltages vary with the mass.
Our posture detection technique exploits this posture-voltage dependency. In contrast to
existing approaches, which differentiate human postures by binary patterns of active sensors,
the proposed technique identifies postures by voltage levels produced by the sensors. It assumes that
the prayer mat contains an array of FSR strip-line sensors connected to an embedded microcontroller.
The microcontroller reads the sensor voltages, and based on them, detects postures performed by
the user.
22
Electronics 2017, 6, 61
9287
9
:HLJKWNJI
ȱ
Figure 4. The FSR sensor voltage variation with the user’s posture and weight.
The results revealed three distinguishable areas of the mat usage, associated with the user’s feet
(Area 1), knees, (Area 2) and head (Area 3), respectively, as shown in Figure 5. Without being asked,
all participants used same area for feet, identified from a picture printed on the mat. Namely, the Area
1 was used in standing and bowing postures; Area 2 in sitting and prostrating postures; and Area 3 in
the prostrating posture only.
Figure 5. Sensing areas associated with praying postures: (a) standing, (b) bowing, (c) sitting,
(d) prostration.
Figure 6 shows the details of mat area usage for each posture. In this figure, lines and columns
determine the squares within the mat areas (see Figure 7); the vertical axis shows the square usage
in terms of the number of participants that touched a particular square in a posture. The two visible
peaks in the graphs, associated with Areas 1 and 2, correspond to the mat regions used by the left
and the right legs, respectively; the graph at the bottom reflects the regions of Area 3 touched by
head. As the results demonstrate, every participant in the test placed their feet over Line 3 of Area 1 in
the standing posture, pressed Line 3 of Area 1 and Line 2 of Area 2 in the sitting posture, and in the
prostration posture had their feet over Line 4 of Area 1, their knees over Line 4 of Area 2 and their
forehead over Line 3 of Area 3. Thus, to detect all of the postures of the Rakah sequence, only five
strip-type (Model 408) FSR sensors [16] are needed. A standard strip-type FSR-408 sensor is 622 mm
long and 6.35 mm wide, and 1 mm thin. Because it responds to pressure applied from up to ±5 cm
from its edge, we position the sensors on the mat as shown in Figure 7.
23
Electronics 2017, 6, 61
(a)ȱ (d)ȱ
(b)ȱ (e)ȱ
ȱ ȱ
(c)ȱ (f)ȱ
Figure 6. The mat area usage in different postures. (a) Area 1 usage at standing posture; (b) Area 1
usage at sitting posture; (c) Area 1 usage at prostration posture; (d) Area 2 usage at sitting posture;
(e) Area 2 usage at prostration posture; (f) Area 3 usage at prostration posture.
Figure 7. The FSR sensor voltage variation with the user’s posture.
Now consider output voltages induced by these five FSR sensors when a mat user implements
the Rakah postures. Table 1 presents an example observed for a 40 kg user (RM = 600 Ω). The standing
24
Electronics 2017, 6, 61
posture leads to the maximal voltage in comparison to the other voltages listed in the Table. This is
because the user in this posture presses the mat by his entire weight. When the user bows, the Area 1
sensors generate voltages around 90–100% of the maximal level. The sitting posture causes only 80%
of the maximal voltage on sensors in Area 1, and around 60% of the maximal level on sensors in Area
2. When the user takes the prostrating posture, the sensors of Areas 2 and 3 produce voltages in the
range of 50–75% and 4–25% of the maximal level, respectively.
To study the relationship between the user’s posture, weight, and voltage ranges, we empirically
measured the sensor outputs induced by 30 different users of the prayer mat. Figure 8 shows the
results in terms of sensor voltages (VOUT ) normalized to the peak voltage levels (V0 ) of the Area
1 sensors.
ȱ
(a)ȱ
ȱ
(b)ȱ
Figure 8. Normalized voltage variations observed on outputs of sensors in Area 1–3 when 30 users of
different weight performed the bowing and sitting postures (a), and the prostration posture (b).
25
Electronics 2017, 6, 61
For the sake of simplicity, we depict only the maximal values of the normalized voltages generated
by sensors in Areas 1 and 2 for the bowing, the sitting and the prostration postures. The absolute
variation of peak voltage (V0 ) with the weight is given in Figure 4. Interestingly, the voltage ranges
associated with the postures are quite distinguishable and do not depend much on the user’s weight.
In the sequel, we exploit these voltage–posture correlation for posture detection.
The state machine works as follows. As the user activates the machine, it evaluates the outputs of
sensors in Area 1 for 3 s in order to identify the peak voltage of the standing posture. If the voltage
level is less than a given threshold (L0 ), i.e., no pressure on sensors, the system remains in the initial
stage. Otherwise, the calculated peak voltage is applied as a reference (V0 ) for computing ten voltage
thresholds (Li) of the detection conditions. Namely,
L1 = 0.9 × V0 , (1)
L 2 = 1 × V0 , (2)
26
Electronics 2017, 6, 61
L3 = 0.5 × V0 , (3)
L4 = 0.65 × V0 , (4)
L5 = 0.5 × V0 , (5)
L6 = 0.12 × V0 , (6)
L7 = 0.1 × V0 , (7)
L8 = 0.8 × V0 , (8)
L9 = 0.05 × V0 , (9)
For example, if the reference voltage V0 = 1.89 V, the L1 = 1.7 V, L2 = 1.89 V, L3 = 0.945 V, and so
on. The bowing posture is detected when the output voltages of Area 1 sensors are within the
range L1 ≤ V1 ≤ L2 . Otherwise, the system waits until the user implements the posture correctly
i.e., the outputs of sensors 1 and 2 satisfy the specified condition. Note that even if the specified
condition is satisfied but there is non-zero output from other sensors, the system will remain in the
current state. To detect the prostration posture, we use Areas 2 and 3 sensors. If the outputs of the
Area 2 sensors satisfy the condition: L3 ≤ V2 ≤ L4 , and the outputs of the Area 3 sensors satisfy the
condition: L5 ≤ V3 ≤ L6 , then the system identifies the prostration posture. Otherwise, it continues
waiting for the correct implementation of the required posture. To detect the sitting posture, we check
whether the Area 1 voltages (V1 ) and the Area 2 voltages (V2 ) are within the ranges: L7 ≤ V1 ≤ L8 and
L9 ≤ V2 ≤ L10 . If either of these two conditions is unsatisfied, or there is a non-zero voltage output
from the Area 3 sensors, the posture is rejected as incorrect. Thus, we proceed to the next state if the
user correctly implements the postures. As the second prostration is identified, the system increments
the Rakat Counter (RC) by 1 and repeats the cycle.
4.1. Implementation
The proposed technique was implemented in a smart mat prototype [18] that additionally to
Rakah counting also determined the start time of a next prayer and the direction to Mekkah (or Qibla).
The praying mat was 120 cm × 70 cm in size, which is conventional for a medium height user.
Figure 10 shows a block diagram of electronics embedded into the mat. The sensor array contained
five force-sensing resistive strips (FSR 406) placed under Areas 1–3 of the mat, as shown in Figure 7.
To reduce sensor displacement and eliminate undesirable effects of dirt, the sensors were fixed in
special pockets made of cloth that were sewn to the backside of the praying mat. The processing unit
(depicted by gray pattern in Figure 10) includes an 8-bit microcontroller (AVR ATmega32, from Atmel
Crop., Chandler, AR, USA), a GPS receiver (Ublox NEO 6M, from Thalwil, Switzerland), a digital
compass (CMPS10, from Robot Electroncs, Norfolk, UK), a real-time clock (RTC) unit, and an interface
circuitry. The control panel contains a 128 × 64 graphical LCD display, a digital buzzer and a number
of switches. By pushing a corresponding button on the control panel, the user can display on the
screen either the ST (start time of the next prayer), QD (Qibla Direction), and RC (Rakah Counter).
He or she can also reset RC, deactivate the buzzer (alarm off) or power off the smart mat if necessary.
27
Electronics 2017, 6, 61
On the mat, the FSR sensing strips were attached to the backside of the mat, while the
microcontroller and the control panel shared the board placed on the foreside of the mat. The proposed
posture detection and Rakat counting technique was implemented in software.
Figure 11a,b shows photographs of the smart mat prototype and its usage in a prayer. The user
activates the smart mat by pushing the power bottom on the control panel. By default, the RC is zero.
When activated, the system displays the value of RC and the next posture to be taken by the user,
thus guiding him or her through the Rakah sequence. If the system recognizes that the user completed
a Rakah, it increments the RC value. Otherwise, the value of RC remains unchanged.
Figure 11c exemplifies data shown on the display as the user completed the sitting posture of
the second Rakah sequence. At any time, the user can reset the counter or switch the power OFF
if necessary.
yȱ
ȱ
(a)ȱ (b) (c)ȱ
Figure 11. Photographs: (a) the smart mat prototype (b) the smart mat usage; (c) displayed data.
28
Electronics 2017, 6, 61
order. In between the tests, the power was switched OFF. The tests totaled 120 simulated cycles of six
postures each.
The evaluation revealed several results. First, when the system was switched ON and no pressure
asserted to the mat, the voltage readings from the FSR sensors were almost 0, causing the system to
remain in the initial state. The system operation started only when someone stepped over sensing
Area 1, and when the level of voltage generated from the sensors of this area exceeds L0 . (Though we
used L0 = 1, the threshold level can be calibrated to reduce external noise if any. According to [17],
the FSR sensors are no more prone to noise pickup than a passive resistor).
Second, the posture detection ratio of the proposed technique was 100%, even though the
participants in the tests had different styles for sitting, standing, and prostration. Some of them
inclined or moved forward/backward more than others; some used their hands to support their
body when standing. Despite variations in posture style, the proposed method was able to effectively
distinguish all six postures of the Rakah sequence and correctly count the Rakat. At the same time,
we should notice that the posture detection and recognition might depend on the person’s height.
Namely, it might be possible that a mat designated for a person of an average height may fail to
correctly identify postures of a very tall or a short person or vice versa. We assume that this issue
will not pose a problem in reality, because worshippers usually use mats of sizes proportional to
their height.
Finally, the tests showed that the sensors in the mat successfully detect gait characteristics and are
not perceptible to the people as they stay, sit, or prostrate. Overall, all the participants of the evaluation
experiments reported the proposed smart mat useful and quite helpful.
29
Electronics 2017, 6, 61
the mat area. Someone unfamiliar with Islam may argue that a mat user hypothetically might jump,
step out of the mat during a prayer, go out, return back, and so on. Moreover, a prayer might be
interrupted by a child, another person (e.g., caregiver), or a pet, for example, who might step over
the mat and cause an error. While these events might happen hypothetically, they are far from reality.
Religious people are very serious in their beliefs, obligations, and rituals. Preparations to pray are
actually taken with a large care to prevent any external interruption. When a prayer starts, everyone in
a Muslim family prays, including kids. During a prayer, each worshiper uses his own mat and is
fully concentrated on the spiritual act of praying, i.e., communicating with God. So it is a realistic
consideration that a Muslim will not be doing anything else other than praying if someone near them is
also engaged in prayer. However, even if a hypothetical case takes place and a faulty action or posture
is detected, the system will remain in its current state until the required posture is done correctly.
6. Conclusions
In this paper, we presented a new technique for unobtrusive human posture identification by
a smart mat to assist Muslims in praying. As the experimental evaluation revealed, the proposed
technique provides robust recognition of postures taken by a worshiper in a prayer and correct
counting of the Rakat cycles in real time.
Finally, we would like to notice that the proposed voltage based posture identification technique
is not limited to the smart prayer mat and Rakat counting, even though the paper has been focused on
this specific application only. We think that it can be used in other applications as well. In healthcare,
for example, the technique can be applied to identify the sleeping postures, or for monitoring the
frequency of posture change of in-bed patients to decrease the development of ulcers. Similarly, it can
be applied to detect sitting postures from sensors placed inside a chair. We are currently investigating
further applications.
Acknowledgments: The authors thank colleagues from Tele-communication Laboratory of Moslem University of
Makassar, Indonesia for assistance in accumulating experimental data and helpful discussions.
Author Contributions: All authors have contributed to the work presented in this article. Kasman Kasman
conceived and designed the smart mat prototype, performed experiments and wrote the text; Vasily G. Moshnyaga
directed the work, analyzed and interpreted the obtained results and revised the manuscript.
Conflicts of Interest: The authors declare no conflict of interest.
References
1. Ismail, J.; Noor, N.L.M.; Isa, W.A.R.W.M. Addressing cognitive impairment among elderly people:
A techno-spiritual perspective. In Proceedings of the 5th International Conference on Information and
Communication Technology for the Muslim World (ICT4M), Kuching, Malaisia, 17–18 November 2014;
pp. 1–5.
2. Speck, C.E.; Kukull, W.A.; Brenner, D.E.; Bowen, J.D.; McCormick, W.C.; Teri, L.; Pfanschmidt, M.L.;
Thompson, J.D.; Larson, E.B. History of depression as a risk factor for Alzheimer’s disease. Epidemiology
1995, 6, 366–369. [CrossRef] [PubMed]
3. Khatri, A.E.S. Prayer Mat. UK Patent 2,263,003-A, 7 July 1993.
4. Faouaz, H. Muslim Prayer Counter. U.S. Patent 6,783,822, 31 August 2004.
5. Abdelmohsen, A.M.E. Prayer Carpet (for Muslims) Provided with a Number of Bowings (Rak’a) Digital
Displayer Apparatus. WO Patent 2,007,104,321 A1, 20 September 2007.
6. Arrar, R.B.J. Portable Interactive Islamic Prayer Counter. U.S. Patent 7,508,316 B1, 24 March 2009.
7. Kantarceken, I. Prayer Assistance Device for Use As e.g. Personal Digital Assistant, Has Electronic Memory
Unit Storing Program Flow that Acoustically Corrects Spoken Words and Physical Gestures of Prayer by
Sound Transducer Unit. Patent DE 102,010,048,504 B3, 5 April 2012.
8. Ismail, J.; Noor, N.L.M.; Isa, W.A.R.W.M. Smart prayer mat: A textile-based pressure sensor to assist elderly
with cognitive impairment in praying Activity. In Proceedings of the 5th International Conference on
Computing & Informatics (ICOCI), Istanbul, Turkey, 11–13 August 2015; pp. 241–246.
30
Electronics 2017, 6, 61
9. Middleton, L.; Buss, A.A.; Nixon, M.S. A floor sensor system for gait recognition. In Proceedings of the 2005
4th IEEE Workshop on Automatic Identification Advanced Technologies, Buffalo, NY, USA, 17–18 October
2005; pp. 171–176.
10. Aud, M.A.; Abbott, C.C.; Tyrer, H.W.; Neelgund, R.V.; Shriniwar, U.G.; Mohammed, A.; Devarakonda, K.K.
Smart Carpet: Developing a sensor system to detect falls and summon assistance. J. Gerontol. Nurs. 2010, 36,
8–12. [CrossRef] [PubMed]
11. Miguel, J.; Morgado, A.; Konig, A. Low-Power concept and prototype of distributed resistive pressure sensor
array for smart floor and surfaces in intelligent environments. In Proceedings of the International Conference
on Systems, Signals and Devices, Chemnitz, Germany, 20–23 March 2012; pp. 1–6.
12. Cheng, J.; Sandholm, M.; Zhou, B.; Kreil, M.; Lukowicz, P. Recognizing subtle user activities and person
identity with cheap resistive pressure sensing carpet. In Proceedings of the International Conference on
Intelligent Environments, Shanghai, China, 30 June–4 July 2014; pp. 148–153.
13. Tanaka, O.; Ryu, T.; Hayashida, A.; Moshnyaga, V.G.; Hashimoto, K. A Smart Carpet Design for Monitoring
People with Dementia. In Progress in System Engineering, Advances in Intelligent Systems and Computing;
Selvaraj, H., Zydek, D., Chmaj, G., Eds.; Springer: Berlin, Germany, 2015; pp. 653–659.
14. Chaccour, K.; Darazi, R.; El Hassani, A.H.; Andres, E. Smart carpet using differential piezoresistive pressure
sensors for elderly fall detection. In Proceedings of the 2015 IEEE 11th International Conference on Wireless
and Mobile Computing, Networking and Communications (WiMob), Abu Dhabi, United Arab Emirates,
19–21 October 2015; pp. 225–229.
15. Ho, V.A.; Imai, S.; Hirai, S. Multimodal flexible sensor for healthcare system. In Proceedings of the 2014
36th Annual International Conference of the IEEE on Engineering in Medicine and Biology Society (EMBS),
Chicago, IL, USA, 26–30 August 2014; pp. 5976–5979.
16. The World’s First Intelligent Yoga Mat. Available online: https://smartmat.com/ (accessed on 25 May 2017).
17. FSR 400 Series Data Sheet, Interlink Electronics. Available online: http://www.steadlands.com/data/
interlink/fsrdatasheet.pdf (accessed on 25 May 2017).
18. Kasman, K.; Moshnyaga, V.G. A smart mat for assisting Muslims in praying. In Proceedings of the 2017
IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA, 8–10 January 2017;
pp. 481–484.
© 2017 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
31
electronics
Article
Design of a Building-Integrated Photovoltaic System
with a Novel Bi-Reflector PV System (BRPVS) and
Optimal Control Mechanism: An Experimental Study
Muhammad Adil Khan 1 , Kamran Zeb 1,2 , Waqar Uddin 1 , P. Sathishkumar 1 ,
Muhammad Umair Ali 1 , S. Hussain 1 , M. Ishfaq 1 , Himanshu 1 , Archana Subramanian 1
and Hee-Je Kim 1, *
1 School of Electrical Engineering, Pusan National University, Busandaehak-ro 63beon-gil, Geumjeong-gu,
Busan 46241, Korea; [email protected] (M.A.K.); [email protected] (K.Z.);
[email protected] (W.U.); [email protected] (P.S.); [email protected] (M.U.A.);
[email protected] (S.H.); [email protected] (M.I.); [email protected] (H.);
[email protected] (A.S.)
2 School of Electrical Engineering and Computer Science, National University of Sciences and Technology,
Islamabad 44000, Pakistan
* Correspondence: [email protected]; Tel.: +82-51-510-2364
Abstract: Environment protection and energy saving are the most attractive trends in zero-carbon
buildings. The most promising and environmentally friendly technique is building integrated
photovoltaics (BIPV), which can also replace conventional buildings based on non-renewable energy.
Despite the recent advances in technology, the cost of BIPV systems is still very high. Hence, reducing
the cost is a major challenge. This paper examines and validates the effectiveness of low-cost
aluminum (Al) foil as a reflector. The design and the performance of planer-reflector for BIPV
systems are analyzed in detail. A Bi-reflector solar PV system (BRPVS) with thin film Al-foil reflector
and an LLC converter for a BIPV system is proposed and experimented with a 400-W prototype.
A cadmium–sulfide (CdS) photo-resistor sensor and an Arduino-based algorithm was developed to
control the working of the reflectors. Furthermore, the effect of Al-foil reflectors on the temperature of
PV module has been examined. The developed LLC converter confirmed stable output voltage despite
large variation in input voltage proving its effectiveness for the proposed BRPVS. The experimental
results of the proposed BRPVS with an Al-reflector of the same size as that of the solar PV module
offered an enhancement of 28.47% in the output power.
Keywords: building integrated photovoltaics (BIPV); renewable energy; solar; LCC converter;
half bridge; bi-reflector solar PV system (BRPVS)
1. Introduction
Recently, environmental pollution, global warming, and energy shortage have been generally seen
as alarming global issues. The building sector consumes a major proportion of energy. For example,
in the European Union, 30–40% of energy is consumed by the building sectors, that produce 32% of
carbon dioxide emissions [1]. Attention has been given to zero energy buildings to develop future
energy saving infrastructures. In this scenario, renewable energy is expected to play an important
role. Photo–Voltaic (PV) systems are very attractive choices for production of electric power due to
their noiseless and nonpolluting nature. Building Integrated Photo–Voltaic (BIPV) is a new version
of the PV system, in which the building is used for installation of PV modules to reduce cost and
improve the appearance [2]. In addition to the environmental influences of BIPV, they also reduce
the long-term cost of the building sector. Compared to a standalone PV system, BIPV does not
require any extra land for installation and the cost can be balanced by installing this on the rooftop
of the building structure [3]. However, the lower efficiency and higher initial cost make BIPV less
practical and difficult to commercialize. Dye-Sensitized Solar Cells (DSSCs) have attracted considerable
attention in recent years because of their simple assembly, lightweight, flexibility, economical price of
materials, satisfactory photocurrent transformation efficiency, precise energy return time, and tunable
optical properties [4]. On the other hand, DSSCs have power conversion efficiency of more than
14% with a limited active area; the output power decreases with increasing cell effective area of the
photoanode [5]. An alternate solution exists to increase the net output power from the PV module
to reduce the cost of the system because the initial cost of the PV system is the main hurdle to the
widespread use of this technology. The output power can be increased by increasing the incident light
on the PV system [6]. The position of the Sun is not fixed to one place because it changes its position
from dawn to dusk and also during the entire year, which means that a fixed PV system is inefficient.
Therefore, the tracking of single- and dual-axis PV systems are suggested for this purpose [7,8]. On the
other hand, such a system has two disadvantages, increase in initial cost and decreased lifetime of the
mechanical parts of the PV system. Moreover, such a system also requires extra power supply and
motors to move the solar system, which makes the system more complex and increases the size of the
PV system, making it unrealistic for commercialization [8,9].
Another way is to reflect the light onto the PV module to increase the efficiency of BIPV systems.
This system will increase the sunlight flux intensity per unit area on the BIPV, resulting in an amplified
output power, which would allow a decrease in the size and cost of the PV module. With the help of
the reflector with a planar shape, solar radiation will increase [10]. The advances in architecture and
the artistic structure of buildings with narrow roof spaces has created a challenging situation for the
installation of a BIPV system with reflectors and the crowded city has forced planning management
to consider the roof and facade [11]. Despite this, installing such a system will make the architecture
appear less attractive, which is a notable factor in new solar systems [12]. Moreover, the health
concerns for BIPV can be a major disadvantage and a real challenge for BIPV systems. The study
predicted a gain in annual output from amorphous Silicon (a-Si) PV modules of up to 25%, considering
the latitude of 60◦ N and a specular reflector with a reflectivity of 0.8 [13]. Probst and Roecker
reported the advantages of mixing solar collectors for developing a system [14]. The advantage of
adding booster reflectors by placing the reflector at a 90◦ angle with a crystalline Silicon (c-Si) PV
module and varying the inclination of the assembly was explored in [15]. Karlson and Wilson [16]
designed the Maximum Reflector Collector (MaReCo) in 2000, which was then modified by Brogren
and Karlson [17] from an edge reflector to a parabolic design, which boost the radiations falling on
the PV module. On the other hand, not all the increasing radiation was converted to electrical power;
some was reflected and some were converted to heat in BIPV module. From such studies, a small
amount of heat was absorbed by the cell, which decreased the efficiency of the cell and module.
The increase in temperature resulted in a 0.3–0.5% per K decrease in efficiency [18]. The increase in
temperature in the BIPV system was overcome using a Building Integrated Photo-Voltaic Thermal
system (BIPVT) [19]. Using such a system, the efficiency was increased to 30–40% and two separate
collector quantities of space and material were minimized due to hybridization [20]. This choice
was more substantial because of the low price and sufficient availability, and these two factors make
it more practical. A Concentrated Photo-Voltaic (CPV) system, which applies an optical element,
was used to focus the sunlight on the solar cell. Such type of intensified light increased the energy
up to some extent [21,22]. Some studies suggested a horizontal arrangement of the reflector with the
solar panel [23]. A model of ray tracing to calculate the irradiation rise was proposed [24]. Some used
diffuse reflectors, which are a collective view factor and specular reflectance mode [25], whereas others
use a 2-D specular reflectance model and experimental data [26]. The non-specular ridged booster
reflector increased the output by 8% [27]. Although Mirror-Augmented Photo-Voltaic (MAPV) is low
cost, it produces non-uniformity in irradiance, which is overcome by optimizing the system properly
33
Electronics 2018, 7, 119
to maximize the annual power production. The uniformity in a PV system is the primary objective of
the system, but the PV module is not ideal for MAPV because of its non-uniformity [28]. A different
method was suggested by Van Dijk et al. for power conversion improvement. The solar module has
a glass layer with a lens array on the top and a reflector on bottom side [29]. A reflector perpendicular
to the PV panel with a width 2.7 times the panels obtains a result of 1.5 at solar noontime and was
used keeping in view weather conditions of Tokyo, Japan [30]. Khan et. al. studied three different (i.e.,
flat mirror, spherical mirror and Al foil) reflector materials for studying high-performance materials
and used a variety of cooling techniques to enhance the performance of existing PV systems [31].
Effective power conditioning for BIPV is crucial. In common practice, the boost DC-DC converter
is used to increase the PV voltage and track the maximum point of the PV output power in real
time. Considering that switching of semiconductor devices occurs at high currents, the efficiency
of these converters is low at high frequencies because of the hard switching [32–36]. On the other
hand, at low frequencies, the size and cost of the magnetic components and the capacitor would be
high. Furthermore, the parasitic capacitance of the PV modules to the ground might cause leakage
currents due to the lack of isolation in conventional power conversion topologies [37]. To handle
these problems, a DC-DC LLC resonant converter was presented [38,39]. LLC converters have been
utilized broadly in various DC converters as a result of their similar zero voltage Switching (ZVS)
for the essential MOSFETs and zero current Switching (ZCS) for optional diodes, which enable them
to achieve high proficiency and power thickness [40,41]. Typically, pulse width switching frequency
modulation techniques is utilized as a part of LLC resonant converters to standardize the output
current and voltage, yet the non-direct highlights of the input voltage make it difficult for ordinary
linear control systems to accomplish the normal execution and a hybrid control scheme has been
introduced for the purpose of switching [42,43].
Based on a literature survey and discrepancy available in existing solutions to enhance the PV
module power for a BIPV system, this study evaluated the Al-foil sheet and LLC converter-based
Bi-Reflector PV System (BRPVS). A reflector system was designed to enhance the output power,
and a hybrid control scheme of a half-bridge LLC resonant converter is proposed for a wide input
range application and medium power applications. The objective of this research is to design and
briefly discuss a novel reflector system (BRPVS) its operation and possible outcomes. This study
conducted real-time experiments to examine the performance of BRPVS and developed an algorithm
to control the working of the BRPVS. Its effects on the output power were examined and its optimal
control way of operation was defined. Moreover, an optical and thermal model was also evaluated.
A detailed description of the system is provided in Section 2. The remainder of the manuscript
is arranged as follows. Section 2 presents a detailed overview of the proposed system along with
component required to design the BRPVS system. Experimental arrangements of the designed system
are discussed in Section 3. Results for experimental study are discussed in Section 4 while Section 5
summarizes the conclusion of this study.
34
Electronics 2018, 7, 119
Figure 1. An overview Proposed BRPVS with its mandatory components (i.e., BRS, LLC converter,
inverter, Energy storage system, distribution, and control unit).
35
Electronics 2018, 7, 119
Figure 3 demonstrates that a square wave is produced by the switch network having frequency
fs = ωs /2π. With the resonant L-C network present in the topology of the converters, generates
sinusoidal the current and voltage are using each frequency cycle and hence sinusoidal approximation
is suitable to examine the characteristics and parameter determination of the converter.
Figure 3. Output voltage of switch network along with its fundamental component.
The switching network, which produces a fundamental and odd harmonic of square wave voltage.
Fundamental component vS1 (t) can be calculated using Equation (1) [44].
2Vg
vS1 (t) = sin(ωs t) = vs1 sin(ωs t) (1)
π
where Vg shows amplitude of the input square wave. Resonant output current denoted by iR is defined
by Equation (2) a with peak amplitude (IR1 ) and phase shift (θR )
The rectifier input voltage (VR (t)) well be similar to its fundamental component (VR1 ) and is
given be below relation (i.e., Equation (3))
4V
VR1 = sin(ωs t − θR ) (3)
π
36
Electronics 2018, 7, 119
As capacitor does not allow DC current to pass through it, steady-state load current i(t) and DC
component (I) of rectifier input current are equal expressed by Equation (4).
T0
2 2 2
I= IR1 |sin(ωs t − θR |dt = I (4)
Ts 0 π R1
The effective resistive load (Re ) of the RC-tank can be evaluated as ratio of VR1 (t) and IR1 (t)
given by Equation (5).
V (t)
Re = R1 (5)
IR1 (t)
The transfer function (H(s)) of the designed LLC converter is given utilizing Equation (6).
sLm Re
H( s ) = (6)
sLr + sCr + sLm Re
1
The voltage gain (M) i.e., transfer function magnitude, is given by Equation (7).
2
f
fr (m − 1)
M = 2 (7)
2
f2 f2
−1 + f
− 1 (m − 1)
f2p fr f2r
Lp
where Lp = Lm + Lr , m = Lr , Q= 1
Re
Lr
Cr , fr = √1 , fp = √1 .
2π Lr Cr 2π Lp Cp
According to the mode of operation, the DC characteristics of the LLC resonant converter can be
divided into three regions, as shown in Figure 4. In region 1, the converter works in a similar manner
to SRC. In this region, Lm does not resonate with the resonant capacitor, Cr ; it acts as a load of the
series resonant tank when it is clamped by the output voltage. The LLC resonant converter can operate
under the no load condition without the penalty of a very high switching frequency with a passive
load. In addition, with a passive load, Lm , ZVS could be ensured for any load condition.
In region 2, the converter operation is more complicated. At the beginning Lr is resonant with
Cr and Lm is clamped by the output voltage. As the Lr current reaches the same level as the Lm
current, the Lr and Cr resonance is stopped, and Lm starts participating. As the LLC resonant converter
acts as a multi-resonant converter, the resonant frequency is different in different intervals of time
37
Electronics 2018, 7, 119
because of resonant process between Lm + Lr with Cr . The designed operating region is region 2
and precautionary measure should be made to prevent the converter from entering region 3. For
resonant converter output voltage control, controlling of switching frequency is used mostly to change
the DC gain of the resonant tank. If the input voltage of the resonant converter changes or the load
fluctuates, the resonant change impedance of the tank changes according to the switching frequency
change of the control hybrid control system that adjusts the output voltage by changing the switching
frequency. The net change in switching frequency is made according to the design of the resonant tank
and consequently relates to the load conditions and the input voltage range.
Figure 5 shows an overview of a BRS with an Al reflector with attached PV modules with detailed
electrical and optical models given below.
38
Electronics 2018, 7, 119
Electrical Modeling
For modeling of BRS, an equivalent electric circuit is developed, as depicted in Figure 6.
The equivalent model consists of a current source for a solar cell with a photocurrent (IL ) with
a pn junction diode, a parallel resistor (Rsh ) and a series resistor (Rs ).
Solar irradiance and constant temperature and solar irradiance, the V-I characteristics of the model
which has been proposed can be given using the Equation (8):
V + Rs V + Rs
I = IL − Io exp −1 − (8)
a Rsh
Important parameters (IL,ref , Io,ref , Rs,ref , Rsh,ref and aref ) for modeling PV module with BRPVS
can be estimated by using conditions in Table 2 [46].
Applying the condition defined in Table 2 to Equation (8), Equations (9)–(13) are derived [3]:
Voc,ref V
IL,ref = Io,ref exp − 1 − oc,ref (9)
aref Rsh,ref
Isc,ref Rs,ref I R
Isc,ref = IL,ref − Io,ref exp − 1 − sc,ref s,ref (10)
aref Rsh,ref
Maximum power output (MPP), current (Imp ) and voltage (Vmp ) are related using below
listed equation:
Pmp = Imp Vmp (14)
39
Electronics 2018, 7, 119
Temperature dependency of maximum power point efficiency is a very important aspect when
we are dealing with performance of PV module written in below equation:
Imp Vmp
ηmp = (15)
GT Am
Optical Modeling
Using the traditional approach of optical geometry, the total irradiance (Stot ) absorbed into the
BRPVS system can be easily predicted. Total solar radiation (Stot ) is the sum of the direct solar radiation
(Sd ) on the solar panel, the ground reflected radiations (Sg ), the sky diffusion radiations (SSK ), the right
reflector radiation (SreflR ) to the surface of the PV panel with a tilted plane angle, α1, and radiation
reflected from the left reflector (SreflL ) to the PV panel with a tilted plane angle α2 [47]:
We used a reflector for PV system to model the solar system for BRDF [29]. The analysis method
of integrative in which irradiation to point differential for PV module represented by (dx) from each
differential scattering element on the reflector in (dy) to direction of dx has been presented [30].
So, in two dimension that is x and y-axis, integration is performed to show the solar irradiation on
module surface. The module in which energy incident (Eir ) is impacting plane reflector at point dx as
shown in Equation (17).
Eir = Ep cos θ dydz (17)
Through the differential angle (Eref ), reflected radiant intensity per unit depth and radiant
intensity per unit depth that strikes the surface of the module (Em ) as shown in Equations (18)
and (19) respectively [48].
Eref = Eir BDRF θ, θ ρ (18)
Em = Eref dθ (19)
Equation (20) shows the angle of incidence (θ) of the differential ray onto the surface of the module
and the distance that the ray has travelled.
dy cos( β)
dθ = (20)
r
D(θ, θ )
BDRF θ, θ = π (21)
2
− π2 D(θ, θ )dθ
Equation (22) can be obtained from Equations (17)–(21) and integrated with characteristic
dimensions, and multiplied by the depth of the module (Amodule ) and the irradiance (W/m2 ) that is
on the surface of the module due to reflection (Gim ) can be calculated using Equation (22):
where ρ is surface reflectivity, Am module area, and θ is the angle between the incoming ray and
reflector surface
Control Mechanism
A motorized BRPVS system can be designed by studies done on the bases of the experiment
in Section 4. This is an optional control mechanism to obtain greater efficiency. The system was
designed with Arduino, Stepper motor, Stepper motor driver, reflectors, Cds/sensors, and power
40
Electronics 2018, 7, 119
supply. Connecting the Stepper motor with Arduino requires a proper connection and wiring pattern
using the driver circuits. Figure 7 gives an overview of a motorized BRPVS.
Figure 8. shows a controlled algorithm for movement of BRPVS. The movement of the reflector is
controlled by the CdS sensors placed on the reflectors and solar panel using the controlled algorithm
shown in Figure 8. This system is designed with four light-dependent resistors. The resistance of the
LDR /CDS sensor varies with light. In the morning, when the amount of light on the right reflector is
greater than the left reflector resistance, and the resistance LDR/CDS of the right reflector (RCdS(R) ) is
less than the left (RCdS(L) ), the Arduino program compares these values and moves the stepper motor
of the right reflector at the given optimal angle or tilt (θTL ) when there is shade on the solar panel, i.e.,
the LDR placed on the right side of the panel resistance (RCdS(PVR) ) is no more than the normal bright
light operating range (Rth ). In the afternoon, the resistances of the LDR/CDS right and left sensor are
equal and the stepper motor of both reflectors moves focusing light on the solar panel. In the evening,
when the amount of light on the left reflector is more than that on the right reflector resistance of the
LDR/CDS of the right reflector, the again Arduino program compares these values and moves the
stepper motor of the left reflector at the given optimal angle or tilt when there is shade on the solar
panel, i.e., the LDR placed on the left side of the panel (RCdS(PVL) ) is no greater than the normal bright
light operating range. Compared to conventional tracing, which requires continuous tracking and
movement of the entire Solar PV solar series and parallel array structure, the proposed BRPVS needs
to adjust the movement of the reflector only three times per day, i.e., morning, afternoon, and evening.
Moreover, this movement of reflectors is an optional feature to enhance the efficiency to a large extent.
41
Electronics 2018, 7, 119
42
Electronics 2018, 7, 119
Figure 9. A full bridge inverter scheme with low pass filter and DSP controller for BRPVS.
The current swell is cut off to utilize the inductor. The value of the inductor is given by the
following equations:
L = V × di/dt (23)
where Vdc is the input DC voltage; fs is the switching frequency; L is the output filter inductor; ΔImax
is the permissible ripple current and Dmax is the duty cycle maximum.
The capacitor depends on the inverter peak value and ripple voltage measurements of the output.
Inductor current ripple is retained in the capacitor output. This can be shown in the following equation:
ΔVc ∼
= ΔILc × fs + rESR × ΔIL (26)
where ΔVout is the output voltage ripple; ΔILc is the ripple current of the inductor and rESR is the
capacitor equivalent series resistance.
43
Electronics 2018, 7, 119
The implementation of future intelligent grid technology, smart pricing, demand-side management,
peak load, smart grid, demand-side management, smart metering, peak load curtailment, might
deliver the goals of the regulator and policymakers but may also create uncertainty for consumers
regarding the price of power. Power consumption control will be experienced by consumers when
they purchase power and assess how much they consume during power shortages [7]. Therefore,
a storage system is needed to save some energy when there is insufficient solar power available to run
a specific load. During the charging process, the ESS available capacity at time, “t” can be described as:
The available ESS capacity during the discharging time can be given by Equation (28) [49].
The depth of discharge (DoD) is a measure of how much energy has been withdrawn from
a storage device, and is expressed as a percentage of the full capacity according to Equation (29).
The effective method of an energy management system that comprises storage elements allows
consumers to shift their electricity purchases during peak hours to decrease the electricity demand
3. Experimental Setup
Figure 10 presents the experimental setup for a BRPVS system. To determine the effects of Al-BRS
on temperature and power output, an experimental setup was developed, as shown in Figure 10a.
The experiment was carried out near the Mechatronic Engineering Building 107 and the Laser and
Sensor Laboratory, Pusan National University, having latitude 31.4861303◦ E. The optimal tilt angle
of 30◦ was selected. A 20 watt PV module was used to determine the effects of reflector on the
performance with the given latitude. A MASTECH MS827 millimeter for measuring current and
voltage with different irradiance and reflector conditions. A FLUKE VT04A visual IR thermometer
was utilized for thermal images at a specific time. An EL-USB-3 voltage and temperature data logger
were used to measure the voltage and temperature of the PV module to recode the data.
Figure 10. Experimental arrangements for (a) Al-foil based BRS; (b) Hardware implementation of
400 W Half bridge LLC converter prototype.
44
Electronics 2018, 7, 119
A 0.5-mm of thick aluminum foil sheet was wrapped on a paperboard of rectangular shape to
make the structure firm. In the first experiment, aluminum foil was used as the equaling size as that of
the solar cell. In the installation of the real-time BIPV system, the exact south (180 N) is not always
available present so two different positions, south-east 150 N (diverted toward the east from south of
30◦ ) and south-west 210 N (toward west diverted 30◦ ), were used.
A 400-W prototype LLC converter was developed as shown in Figure 10b having an input voltage
ranging 200–400 V and a fixed output voltage of 48 V. A MASTECH MS8217 millimeter to get voltage
and current value under various point. The LLC resonant converter control scheme has two different
input voltage ranges according to the control scheme that depends upon PFM control scheme having
input voltage from 200 to 300 V and by the asymmetric PWM at the input voltage range from 300 to
400 V. The LLC resonant tank has 1.68 voltage gain with an input voltage 200 V and 1.12 voltage gain
at input voltage 300 V, where switching frequency varied from 50 kHz to 112 kHz. Table 3 shows the
LLC resonant converter design parameters. For the desired switching, the proposed hybrid switching
scheme was used on a Microchip dsPIC33F16GS502.
Parameter Value
Maximum Power (fmax ) 400 W
Switching Frequency (fs ) 60–112 kHz
Input voltage range (Vs ) 200–400 V
Series Resonant Capacitance (Cr ) 66 nF
Output voltage (Vo ) 48 V
Series Resonant Inductance (Lr ) 30.56 μH
Parallel Resonant Inductance (Lm ) 103.44 μH
Turn Ratio of Transformer (Np : Ns ) 24:7
Input Capacitance (Cin ) 450 V/330 μF
Output Capacitance (Co ) 200 V/220 μF
45
Electronics 2018, 7, 119
(a) (b)
(c)
Figure 11. Solar irradiance of Busan (35◦ 10 0” N, 129◦ 4 0” E): (a) Morning (7:00 to 10:00); (b) Afternoon
(11:00 to 14:00); (c) Evening (15:00 to 18:00).
46
Electronics 2018, 7, 119
Figure 12. Comparative analysis of the (a) Short circuit current (Ish); (b) Open circuit voltage (Voc );
(c) Output power of BIPV system with and without Al foil based BRPVS.
The use of Al-foil reflector does not too much increase the cost of the PV system but improves
its effectiveness. The temperature effect on Al-BRS was then monitored. During the experiment,
the thermal images were photographed for the PV module with the BRPVS system.
In Figure 13, the thermal image showed a temperature hotspot at 11:30, 12:30, and 13:30 with
no reflectors at 42.1 ◦ C, 42.3 ◦ C, and 43 ◦ C, respectively. Conversely, at 11:30, 12:30, and 13:30 using
the Al-Foil reflector, the hotspot temperatures for the solar power system were 38.9 ◦ C, 39.4 ◦ C and
40.5 ◦ C, respectively. The above statistics show that using a reflector ensures that the PV system is safe
and does not significantly increase the temperature of the BIPV system.
(a)
47
Electronics 2018, 7, 119
(b)
Figure 13. Studying effect on temperature of PV module (a) Without BRS; (b) Al foil BRS.
(a) (b)
Figure 14. Finding optimal size of reflector: (a) Output power; (b)Percentage increase.
The next task was to find the optimal angle for BRPVS that gives the highest output power. Perfect
south is difficult to achieve for every BIPV system. Hence, three different positions were selected:
south 0◦ , south-east (30◦ from south towards east), and south west (30◦ from south towards west).
Figure 15 shows the output power of the solar module while using the Al-Foil BRS with the
above-mentioned angles. The optical angle of BRS differs depending on position and time. The optimal
BRS angles for the south, south-east, and south-west locations from 9:00 am to 11:00 am were 80◦ ,
75◦ and 90◦ , respectively (Figure 15a–c). During the afternoon time i.e., 11:00 am to 2:00 pm keeping
both reflectors at 90◦ delivers maximum output power. In the evening from 3:00 pm to 5:00 pm,
48
Electronics 2018, 7, 119
the best angle for the south, south-east, and south-west position was 80◦ , 90◦ , and 75◦ , respectively.
These results show as panel move for south the optimal angle for BRS changes however with little
adjustment in the reflector angle can help to yield more power from the same module without reflector
Figure 15. Output power of PV (a) south 0◦ ; (b) south-east (30◦ from south towards east);(c) south-west
(30◦ from south towards west).
49
Electronics 2018, 7, 119
Figure 16. Testing operation of designed converter for wide range variable input voltage. (a) Vin = 200 V,
fs = 74.67 kHz; (b) Vin = 230 V, fs = 82.31 kHz; (c) Vin = 300 V, fs = 109.23 kHz; (d)Vin = 400V, fs = 109.23 kHz.
Figure 16a shows the current of the resonant inductor (Ir ), resonant voltage (Vr ), and input
voltage (Vin ) of the LLC resonant tank and switching signal of Q2 at an input voltage of 200 V. The red
line in the graph presents the output voltage while the blue line shows the input voltage. Similarly,
the yellow and green input voltage (Vin ) and switching signal of Q2 are shown. The output voltage was
controlled and kept constant at 48 V. The results clearly show that the switching frequency increased
with increasing input voltage in order to regulate the output voltage in the PFM operation region.
In addition, resonance current peak value enlarged due to the increase in amount of current circulating
in the resonant tank.
5. Conclusions
The power generation performance of the BIPV is influenced by the amount the of available
solar radiation. The output power given by photovoltaic systems increases in proportion to the
solar radiation. This study confirmed the effect of BRPVS on the performance of BIPV module
through real-time outdoor experiments. Half-bridge LLC resonant converters for wide input range
voltage fluctuations (200–400 V) and medium power applications have been proposed and tested by
experiments using a 400-W prototype. Experimental results show that using a low-cost Al foil reflector
in a BRPVS system can improve the output power by more than 28.47% depending on the time, size of
the reflector, and location of the solar panel. Movement of BRPVS was controlled by the algorithm
developed and discussed in this paper. A hardware implementation of the algorithm was performed
using an Arduino-controlled CdS sensor and a stepper motor array. A BRPVS solar system was found
to be a cost-effective solution for BIPV with conventional amorphous and crystalline solar panels and
can be applied easily for future zero carbon green energy buildings, particularly in countries with
lower annual solar radiation than the standard test condition defined for a solar PV system or building
where it is difficult to face the PV panels completely towards south or the Sun. Future research should
evaluate efficient reflector materials and effective control system operating mechanisms.
50
Electronics 2018, 7, 119
Author Contributions: H.-J.K. and M.A.K. conceptualize the idea of this research work. H.-J.K developed the
proposal to the funding body. M.A.K. designed the experimental setup and procured the equipment and the
material required for the experimental work. The fabrication and integration of the experimental setup was
mostly carried out by the M.A.K. and S.H. under the supervision of H.-J.K., P.S., A.S., S.H. and H. helped in
experimental work and fabrication of power conversion circuit. Results were analyzed by K.Z., M.U.A., W.U. and
M.I. The paper was written by all the authors with different degrees of contribution.
Acknowledgments: This research was supported by Basic Research Laboratory through the National Research
Foundations of Korea funded by the Ministry of Science, ICT and Future Planning (NRF-2015R1A4A1041584).
Conflicts of Interest: The authors declare no conflict of interest.
References
1. Liu, X.; Wu, Y.; Hou, X.; Liu, H. Investigation of the Optical Performance of a Novel Planar Static PV
Concentrator with Lambertian Rear Reflectors. Buildings 2017, 7, 88. [CrossRef]
2. Tahir, S.; Wang, J.; Baloch, M.H.; Kaloi, G.S. Digital Control Techniques Based on Voltage Source Inverters in
Renewable Energy Applications: A Review. Electronics 2018, 7, 18. [CrossRef]
3. Norton, B.; Eames, P.C.; Mallick, T.K.; Huang, M.J.; McCormack, S.J.; Mondol, J.D.; Yohanis, Y.G. Enhancing
the performance of building integrated photovoltaics. Sol. Energy 2011, 85, 1629–1664. [CrossRef]
4. Öztürk, S.; Canver, M.; Çadırcı, I.; Ermiş, M. All SiC Grid-Connected PV Supply with HF Link MPPT
Converter: System Design Methodology and Development of a 20 kHz, 25 kVA Prototype. Electronics 2018,
7, 85. [CrossRef]
5. Tian, H.; Yu, X.; Zhang, J.; Duan, W.; Tian, F.; Yu, T. The influence of environmental factors on DSSCs for
BIPV. Int. J. Electrochem. Sci. 2012, 7, 4686–4691.
6. Mousazadeh, H.; Keyhani, A.; Javadi, A.; Mobli, H.; Abrinia, K.; Sharifi, A. A review of principle and
sun-tracking methods for maximizing solar systems output. Renew. Sustain. Energy Rev. 2009, 13, 1800–1818.
[CrossRef]
7. Yaden, M.F.; Melhaoui, M.; Gaamouche, R.; Hirech, K.; Baghaz, E.; Kassmi, K. Photovoltaic System Equipped
with Digital Command Control and Acquisition. Electronics 2013, 2, 192–211. [CrossRef]
8. Hafez, A.Z.; Yousef, A.M.; Harag, N.M. Solar tracking systems: Technologies and trackers drive types—A
review. Renew. Sustain. Energy Rev. 2018, 91, 754–782. [CrossRef]
9. Vračar, L.; Prijić, A.; Nešić, D.; Dević, S.; Prijić, Z. Photovoltaic Energy Harvesting Wireless Sensor Node for
Telemetry Applications Optimized for Low Illumination Levels. Electronics 2016, 5, 26. [CrossRef]
10. Khan, M.A.; Zeb, K.; Sathishkumar, P.; Ali, M.U.; Uddin, W.; Hussain, S.; Ishfaq, M.; Khan, I.; Cho, H.-G.;
Kim, H.-J. A Novel Supercapacitor/Lithium-Ion Hybrid Energy System with a Fuzzy Logic-Controlled Fast
Charging and Intelligent Energy Management System. Electronics 2018, 7, 63. [CrossRef]
11. Chemisana, D. Building integrated concentrating photovoltaics: A review. Renew. Sustain. Energy Rev. 2011,
15, 603–611. [CrossRef]
12. Yoon, S.; Tak, S.; Kim, J.; Jun, Y.; Kang, K.; Park, J. Application of transparent dye-sensitized solar cells to
building integrated photovoltaic systems. Build. Environ. 2011, 46, 1899–1904. [CrossRef]
13. French, R.H.; Murray, M.P.; Lin, W.C.; Shell, K.A.; Brown, S.A.; Schuetz, M.A.; Davis, R.J. Solar radiation
durability of materials components and systems for low concentration photovoltaic systems. In Proceedings
of the IEEE Energytech, Cleveland, OH, USA, 25–26 May 2011; pp. 1–5.
14. Probst, M.M.; Roecker, C. Towards an improved architectural quality of building integrated solar thermal
systems (BIST). Sol. Energy 2007, 81, 1104–1116. [CrossRef]
15. Augustin, D.; Chacko, R.; Jacob, J. Canal top solar PV with reflectors. In Proceedings of the 2016 IEEE
International Conference on Power Electronics, Drives and Energy Systems (PEDES), Trivandrum, India,
14–17 December 2016; pp. 1–5.
16. Karlsson, B.; Wilson, G. MaReCo design for horizontal, vertical or tilted installation. In Proceedings of the
EuroSun, Copenhagen, Denmark, 19–22 June 2000.
17. Brogren, M.; Karlsson, B. Low-concentrating water-cooled PV thermal hybrid systems for high latitudes.
In Proceedings of the Conference Record of the Twenty-Ninth IEEE Photovoltaic Specialists Conference,
New Orleans, LA, USA, 19–24 May 2002; pp. 1733–1736.
18. Dubey, S.; Tiwari, G.N. Thermal modeling of a combined system of photovoltaic thermal (PV/T) solar water
heater. Sol. Energy 2008, 82, 602–612. [CrossRef]
51
Electronics 2018, 7, 119
19. Anderson, T.N.; Duke, M.; Morrison, G.L.; Carson, J.K. Performance of a building integrated
photovoltaic/thermal (BIPVT) solar collector. Sol. Energy 2009, 83, 445–455. [CrossRef]
20. Baitule, A.S.; Sudhakar, K. Solar powered green campus: a simulation study. Int. J. Low-Carbon Technol. 2017,
12, 400–410. [CrossRef]
21. Tien, N.X.; Shin, S. A Novel Concentrator Photovoltaic (CPV) System with the Improvement of Irradiance
Uniformity and the Capturing of Diffuse Solar Radiation. Appl. Sci. 2016, 6, 251. [CrossRef]
22. Pérez-Higueras, P.; Muñoz, E.; Almonacid, G.; Vidal, P.G. High concentrator photovoltaics efficiencies:
Present status and forecast. Renew. Sustain. Energy Rev. 2011, 15, 1810–1815. [CrossRef]
23. Kosti, L.T.; Pavlovi, Z.T. Optimal position of flat plate reflectors of solar thermal collector. Energy Build. 2012,
45, 161–168. [CrossRef]
24. Pucar, M.D.J.; Despic, A.R. The enhancement of energy gain of solar collectors and photovoltaic panels by
the reflection of solar beams. Energy 2002, 27, 205–223. [CrossRef]
25. Hall, M.; Roos, A.; Karlsson, B. Reflector materials for two-dimensional low-concentrating photovoltaic
systems: The effect of specular versus diffuse reflectance on the module efficiency. Prog. Photovolt. Res. Appl.
2005, 13, 217–233. [CrossRef]
26. Grassie, S.L.; Sheridan, N.R. The use of planar reflectors for increasing the energy yield of flat-plate collectors.
Sol. Energy 1977, 19, 663–668. [CrossRef]
27. Tina, G.M.; Ventura, C. Energy assessment of enhanced fixed low concentration photovoltaic systems.
Sol. Energy 2015, 119, 68–82. [CrossRef]
28. Lin, W.C.; Hollingshead, D.; French, R.H.; Shell, K.A.; Schuetz, M.; Karas, J. Non-tracked mirror-augmented
photovoltaic design and performance. In Proceedings of the 38th IEEE Photovoltaic Specialists Conference
(PVSC), Austin, TX, USA, 3–8 June 2012; pp. 2076–2081.
29. Van Dijk, L.; van de Groep, J.; Veldhuizen, L.W.; Di Vece, M.; Schropp, R.E.I. Concepts for external light
trapping and its utilization in colored and image displaying photovoltaic modules. Prog. Photovolt. Res. Appl.
2017, 25, 553–568. [CrossRef]
30. Matsushima, T.; Setaka, T.; Muroyama, S. Concentrating solar module with horizontal reflectors. Sol. Energy
Mater. Sol. Cells 2003, 75, 603–612. [CrossRef]
31. Khan, M.A.; Ko, B.; Alois Nyari, E.; Park, S.E.; Kim, H.-J. Performance Evaluation of Photovoltaic Solar
System with Different Cooling Methods and a Bi-Reflector PV System (BRPVS): An Experimental Study and
Comparative Analysis. Energies 2017, 10, 826. [CrossRef]
32. Filippini, M.; Molinas, M.; Oregi, E.O. A Flexible Power Electronics Configuration for Coupling Renewable
Energy Sources. Electronics 2015, 4, 283–302. [CrossRef]
33. Sathishkumar, P.; Krishna, T.N.V.; Himanshu; Khan, M.A.; Zeb, K.; Kim, H.-J. Digital Soft Start Implementation
for Minimizing Start Up Transients in High Power DAB-IBDC Converter. Energies 2018, 11, 956. [CrossRef]
34. Khan, M.A.; Krishna, T.N.V.; Sathishkumar, P.; Sarat, G.; Kim, H.-J. A hybrid power supply with fuzzy controlled
fast charging strategy for mobile robots. In Proceedings of the International Conference on Information and
Communication Technology Robotics (ICT-ROBOT 2016), Busan, Korea, 7–9 September 2016.
35. Khan, M.A.; Badshah, S. Design and analysis of cross flow turbine for micro hydro power application using
sewerage water. RJASET 2014, 8, 821–828. [CrossRef]
36. Popavath, L.N.; Kaliannan, P. Photovoltaic-STATCOM with Low Voltage Ride through Strategy and Power
Quality Enhancement in a Grid Integrated Wind-PV System. Electronics 2018, 7, 51. [CrossRef]
37. Moonem, M.A.; Pechacek, C.L.; Hernandez, R.; Krishnaswami, H. Analysis of a Multilevel Dual Active
Bridge (ML-DAB) DC-DC Converter Using Symmetric Modulation. Electronics 2015, 4, 239–260. [CrossRef]
38. Buccella, C.; Cecati, C.; Latafat, H.; Razi, K. A grid-connected PV system with LLC resonant DC-DC converter.
In Proceedings of the International Conference on Clean Electrical Power (ICCEP), Alghero, Italy, 11–13 June 2013.
39. Beiranvand, R.; Rashidian, B.; Zolghadri, M.R.; Alavi, S.M.H. Using LLC resonant converter for designing
wide-range voltage source. IEEE Trans. Ind. Electron. 2011, 58, 1746–1756. [CrossRef]
40. Chang, C.H.; Chang, E.C.; Cheng, H.L. A high-efficiency solar array simulator implemented by an LLC
resonant DC–DC converter. IEEE Trans. Ind. Electron. 2013, 28, 3039–3046. [CrossRef]
41. Mishima, T.; Nakaoka, M. A novel high-frequency transformer-linked soft-switching half-bridge DC–DC
converter with constant-frequency asymmetrical PWM scheme. IEEE Trans. Ind. Electron. 2009, 56, 2961–2969.
[CrossRef]
52
Electronics 2018, 7, 119
42. Jang, J.; Pidaparthy, S.K.; Choi, B. Current Mode Control for LLC Series Resonant DC-to-DC Converters.
Energies 2015, 8, 6098–6113. [CrossRef]
43. Shin, D.; Lee, K.J.; Lee, J.P.; Kim, H.J. Hybrid Control Scheme for a Half-Bridge LLC Resonant Converter with
a Wide Input Range. In Proceedings of the International Conference on Intelligent Robotics and Applications,
Busan, Korea, 25–28 September 2013; pp. 345–352.
44. Feng, W.; Lee, F.C.; Mattavelli, P. A hybrid strategy with simplified optimal trajectory control for LLC resonant
converters. In Proceedings of the Twenty-Seventh Annual IEEE Applied Power Electronics Conference and
Exposition (APEC), Orlando, FL, USA, 5–9 February 2012; pp. 1096–1103.
45. The Facets about Aluminum. Available online: http://www.alufoil.org/facts.html (accessed on 24 July 2017).
46. Stutenbaeumer, U.; Mesfin, B. Equivalent model of monocrystalline, polycrystalline and amorphous silicon
solar cells. Renew. Energy 1999, 18, 501–512. [CrossRef]
47. Bahaidarah, H.M.; Tanweer, B.; Gandhidasan, P.; Rehman, S. A Combined optical, thermal and electrical
performance study of a V-trough PV System—Experimental and analytical investigations. Energies 2015, 8,
2803–2827. [CrossRef]
48. Andrews, R.W.; Pollard, A.; Pearce, J.P. Photovoltaic system performance enhancement with nontracking
planar concentrators: Experimental results and bidirectional reflectance function (BDRF)-based modeling.
In Proceedings of the IEEE 39th Photovoltaic Specialists Conference (PVSC), Tampa, FL, USA, 16–21 June 2013;
pp. 229–234.
49. Khan, M.A.; Zeb, K.; Sathishkumar, P.; Himanshu; Rao, S.S.; Gopi, C.V.V.M.; Kim, H.-J. A Novel Off-Grid
Optimal Hybrid Energy System for Rural Electrification of Tanzania Using a Closed Loop Cooled Solar
System. Energies 2018, 11, 905. [CrossRef]
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
53
electronics
Article
MWCNT–Epoxy Nanocomposite Sensors for
Structural Health Monitoring
Omid Sam-Daliri 1,2 , Lisa-Marie Faller 2, *, Mohammadreza Farahani 1 , Ali Roshanghias 3 ,
Hannes Oberlercher 4 , Tobias Mitterer 2 , Alireza Araee 1 and Hubert Zangl 2
1 School of Mechanical Engineering, College of Engineering, University of Tehran, Tehran 1417466191, Iran;
[email protected] (O.S.-D.); [email protected] (M.F.); [email protected] (A.A.)
2 Institute of Smart Systems Technologies, Alpen-Adria-Universität Klagenfurt, 9020 Klagenfurt, Austria;
[email protected] (T.M.); [email protected] (H.Z.)
3 CTR Carinthian Tech Research AG, 9524 Villach, Austria; [email protected]
4 Mechanical Engineering Department, Carinthian University of Applied Sciences, 9524 Villach, Austria;
[email protected]
* Correspondence: [email protected]; Tel.: +43-463-2700-3563
Abstract: We address multi-walled carbon nanotubes (MWCNTs) for structural health monitoring in
adhesive bonds, such as in building structures. MWCNT-loaded composites are employed to sense
strain changes under tension load using an AC impedance measurement setup. Different weight
percentages of 1, 1.5, 2 and 3 wt % MWCNTs are added to the base epoxy resin using different
dispersion times, i.e., 5, 10, and 15 min. The equivalent parallel resistance of the specimens is first
measured by applying an alternating voltage at different frequencies. To determine the mechanical
as well as sensory properties, the specimens are then subjected to a tensile test with concurrent
impedance measurement at a fixed pre-chosen frequency. Using alternating voltage, a higher
sensitivity of the impedance reading can be achieved. Employing these sensors in buildings and
combining the readings of a network of such devices can significantly improve the buildings’ safety.
Additionally, networks of such sensors can be used to identify necessary maintenance actions
and locations.
1. Introduction
The aim to fabricate smart composite structures to improve safety and to monitor structures as
part of our living environment has resulted in a major research effort regarding the composition and
performance of composites based on advanced materials. Advanced materials are used to fabricate
smart sensors based on carbon particles, such as carbon fibers, carbon blocks, graphite [1,2], and also
multi-walled carbon nanotubes (MWCNTs). MWCNTs have distinctive mechanical and electrical
properties. They provide a unique potential to improve the mechanical [3–5] as well as electrical
properties [6–10] of polymer–matrix composites. MWCNT–epoxy adhesives are used for applications
such as electronic devices, smart adhesive joints in buildings and bus structures [11–13], and gas
sensors [14]. In [3], the authors study the tensile behavior of carbon nanotubes (CNT)-loaded epoxy
nanocomposite films, and report that, by adding CNTs to the polymer matrix, the tensile modulus,
yield strength, and ultimate strength of the final polymer films can be increased. In [7], the electrical
properties of CNT–epoxy nanocomposites were improved by surface treatment of the CNT specimens.
A comparison of the electrical and mechanical properties of various carbon-loaded composites with
a focus on their piezo-resistive properties is presented in [15].
The changes in the electrical resistance result from deformations and failures within the polymer
matrix when the composites are subjected to mechanical loading [16–18]. The two predominant
factors governing the resulting resistance are as follows [19]: first, the contact between two adjacent
carbon nanotubes, which might be broken; second, the change in the tunneling resistance between two
adjacent carbon nanotubes due to variation of the distance between them. A detailed elaboration of
the mechanisms governing the change of the electrical resistance of MWCNT–epoxy nanocomposites
under mechanical stress is given in [20]. Based on these changes in electrical resistance, MWCNT thin
films have been employed for damage sensing [21–23], and CNT-loaded composites were suggested
as strain sensors in the industrial sector for health monitoring [24–26].
It has further been shown that the morphological properties of carbon nanoparticles influence
the response of the respective nanocomposite sensors [27]. The nanocomposite sensors are comprised
of conductive networks or agglomerates distributed within the polymer matrix, where MWCNT
form 1-D structures. The network conductivity is further affected by the weight percentage of
the nanoparticles, mutual interactions between them, and their state of dispersion in the polymer
matrix [28,29], which strongly depend on the preparation and activation process.
In this work, we present a study which investigates the influence of weight percentage of MWCNT
and its dispersion time on the alternating current (AC) impedance. This AC impedance measurement
can provide higher sensitivity by considering, also, the electrostatic properties of the material.
Considering also such frequency dependent parameters, the sensing functionality of MWCNT–epoxy
composites can thus be exploited or even improved, investing less energy. This presents a novelty
compared to aforementioned studies, where direct current (DC) measurement is employed to determine
the electrical properties of the considered specimens.
Low necessary energy facilitates the design of autarkic sensor systems [30] to monitor building
structures. Using technologies such as transducer electronic data sheets (TEDS) [31], these devices
can additionally be integrated into modern building automation facilities. There, a network of such
sensors can provide information on the health state of a building and indicate necessary maintenance.
In Section 2, the material and equipment needed for the preparation method, as well as
the mechanical and electrical testing of the nanocomposites, is presented. First, the preparation
method, which consists of only basic steps, such as mixing and deagglomeration, is introduced.
Then, the tensile testing machine and the electrical impedance measurement for, first, the percolation
threshold, and secondly, during the tensile testing, are described. In Section 3, the results of the
percolation threshold measurements and tensile testing are described, then the microstructure of
the nanocomposites is presented based on scanning electron microscopy (SEM) images. Finally, in
Section 4, concluding remarks on the presented study are given.
2.1. Materials
The base of the prepared nanocomposites is epoxy as matrix, and MWCNTs as the conductive
nanofiller. The used epoxy resin is EpoThin® (Buehler, Braunschweig, Germany), a free-flowing,
low viscosity, low shrinkage epoxy resin which allows the nanofiller to easily distribute in the EpoThin
matrix. It has a typical cure time of nine hours at 27 ◦ C, according to the manufacturer datasheet.
MWCNT conductive nanoparticles by Cheaptube (Grafton, VT, USA) were used. The outer diameter
of the considered MWCNT is 30 to 50 nm. The length of the used MWCNT is between 10 to 20 μm,
with a purity of more than 95%.
55
Electronics 2018, 7, 143
Weighed amounts of epoxy resin and carbon nanotubes (measured by a digital scale with
accuracy equal to 0.1 mg) were mechanically stirred for 5 min in a beaker. The mixture was then
placed in a shear mixer (IKA T18 digital ULTRA TURRAX, IKA, Staufen, Germany), at 1000 rpm
for 15 min. Then, the dispersion of the MWCNT in the epoxy resin was further accomplished using
an ultrasonic bath (see Figure 1a). Effective means of deagglomerating and dispersing are needed to
overcome the bonding forces after wettening the powders. Therefore, an ultrasonic bath with high
frequency (35–60 kHz) was used to disperse the MWCNTs in the epoxy resin appropriately, and break
agglomerated particles. The time was set accordingly to the considered respective time of dispersion
(see Table 1), and the environmental temperature was kept constant at 25 ◦ C. Thus, CNTs with weight
percentages of 1, 1.5, 2, and 3 wt % were dispersed in the epoxy matrix at different dispersion times.
The resin was then combined with hardener in the ratio of 2:1 for 15 min on the stirrer, and was
immediately poured into the dog-bone molds. After 24 h, the dog-bone shape samples, for tensile
testing, were extracted from the mold. The curing temperature affects the electrical properties and
strength of the nanocomposites. Therefore, it is preferred to use room temperature (25 ◦ C) for a duration
of one day to cure the specimens. The mold was designed according to the ASTM D638 standard.
In this process, we avoid commonly employed, often complex, activation procedures.
To facilitate the electrical measurement of the samples, two metallic wires were applied close
to the necking end parts at a specific distance of 7.5 cm. The wires are fixed using conductive silver
adhesive. The surface-ring contact was used to minimize electrical contact resistance (see Figure 1b).
(a) (b)
Figure 1. (a) Magnetic stirrer and ultrasonic bath (b) nanocomposite specimen.
56
Electronics 2018, 7, 143
measurement bridge by Extech Instruments. This instrument determines the equivalent parallel
resistance at different frequency settings. The shape of the resulting measurement curves can be
analyzed to determine the respective percolation threshold of the samples; for non-conducting
materials, the resistance will decrease with increasing frequency. This is due to the predominant
capacitive effect that can be observed here. Above the percolation threshold, the resistive behavior will
dominate, and the impedance of the samples stays constant over frequency.
The second step is the impedance measurement at a fixed frequency during the tensile
test. The frequency is chosen in order to optimally exploit the range of the input amplifier.
These measurements are done using a high-speed, high-resolution measurement platform [34,35].
It is based on an FPGA system with a customized analog front-end to enable high-speed,
high-resolution measurements. For series production, the components can be integrated into a system
which, in terms of size and costs, is well suited for the application of commercial structural health
monitoring in buildings.
Figure 2. Illustration of the impedance measurement setup during the tensile test.
The measurement setup is illustrated in Figure 2: Left is the nanocomposite specimen which,
on one side, is connected to the input analog amplifier chain as part of the impedance measurement
hardware. The other side is connected to the output, which supplies a digitally generated sine
signal. In the digital domain, the measurement platform also supplies the algorithms necessary for
signal processing, e.g. down-conversion of the acquired signal. Down-conversion is done to transfer
the measurement signal from a higher measurement frequency to a lower frequency, together with
a reduction of the necessary number of samples. The results can then be used for further processing,
such as analysis and visualization.
A higher measurement frequency can, in the first place, be beneficial to avoid or reduce the
influence of other electrical equipment present near the sensors. This is important when these
nanocomposite sensors are to be employed in buildings which commonly suffer from high electric
emissions due to the used machinery and other equipment. Secondly, in this application, we assume
that improved impedance readings are achieved also for samples below the percolation threshold
through the application of a high frequency measurement signal. Thus, also samples with less attractive
electrical properties, but prepared using a simplified and less time-consuming fabrication process,
might as well be used for sensing.
Through preliminary analysis done in the initial impedance measurements described in Section 3.1,
the measurement frequency for the tensile testing (Section 3.3) is chosen to be 100 kHz with an excitation
voltage of 1 V (signal generator in Figure 2) to optimally exploit the input range of the equipment.
57
Electronics 2018, 7, 143
Via the shunt resistance of 50 Ω, which incorporates a voltage divider with the measurement impedance
(see Figure 2), a voltage reading is recorded, which is proportional to the resistance of the sample.
For a resistance change, the voltage signal also changes accordingly. To determine the impedance
as illustrated in the result diagrams, first a calibration measurement using a known resistance is
done. Using this calibration measurement, and a proportionality factor (to relate the voltage at the
measurement impedance to the voltage at the shunt resistance), the recorded voltage reading can be
corrected to give the equivalent impedance.
Figure 3. Equivalent parallel resistance of the nanocomposite sensors with a dispersion time equal to
10 min.
Figure 4. Equivalent parallel resistance of nanocomposite sensors with a dispersion time equal to
15 min.
58
Electronics 2018, 7, 143
Conductive networks formed in the epoxy matrix as conductive fillers are distributed
appropriately within the epoxy matrix [37]. As a result, the initial resistance changes with the employed
dispersion time.
Based on the equivalent parallel resistance value, the effect of dispersion time was investigated
using statistical analysis in Minitab (see Figure 5a,b). Since the resistance does not change significantly
for an increase of the dispersion time above 10 min, this value could be identified as sufficient with
respect to the given process settings. Additionally, this analysis shows that the effect of the dispersion
time is higher at a low weight percent of MWCNTs.
Figure 5. Interaction plots of the weight percent and dispersion time for Rp at different frequencies
(a) 120 Hz (b) 10 kHz.
59
Electronics 2018, 7, 143
3.2. Morphology
The dispersion of MWCNTs in the epoxy resin was validated using SEM images. SEM pictures of
the fracture surface of the nanocomposite specimens were taken after the tensile test. In Figure 6a,b,
SEM images of nanocomposites containing 2 wt % MWCNTs at lower and higher magnifications with
5 min dispersion time are given. The highlighted circles in Figure 6a,b mark agglomerated zones of
MWCNTs in the epoxy matrix. When compared to the scale given at the lower right corner of the
images, it can be seen that the size of the highlighted zones is between 10 and 20 μm (see Figure 6b).
However, high degrees of agglomeration have to be avoided when preparing MWCNT composites,
agglomeration zones of diameters larger than 10 μm are required to achieve a sufficient conductivity.
Additionally, we observed a nearly uniform distribution of MWCNTs in the epoxy matrix with
increasing dispersion time and weight percent (see Figure 6c).
Figure 6. Cont.
60
Electronics 2018, 7, 143
61
Electronics 2018, 7, 143
Consequently, the specimen with 3 wt % with 10 min dispersion time is more sensitive than the
others (see Figure 9) given the chosen measurement setup. These results are also further consistent with
the SEM image of the nanocomposite with 3 wt % MWCNT at 10 min dispersion time (see Figure 6c).
This filler amount is also determined to be the percolation threshold as elaborated in Section 3.1.
In comparison to the specimens including 1 and 2 wt % MWCNT, the slope of the resistance changes
diagram for the specimens with 3 wt % MWCNTs also exhibits a smoother shape. Georgousis et al. [36]
reported that the highest sensitivity can be achieved close to the percolation threshold. In the present
study, we confirm these results showing that the smoothest curves are achieved above the percolation
threshold. Obviously, the samples below the percolation threshold (1, 1.5, and 2 wt %) can be used
for sensing by applying an AC impedance measurement setup and a suitable read-out strategy to
correct for the non-smooth curve shape. The employment of specimen with different filler content and
dispersion times may be adapted to the application and the sensitivity requirements at certain force
and displacement regions.
Based on the max forces of the specimens using different dispersion time, the max strength was
obtained for every weight percent (Table 2). The maximum strength is the ultimate strength of the
nanocomposite (the apex point of the force-displacement diagram). This is different from the failure
stress, which occurs after this maximum point. A significant difference could be observed between the
maximum forces achieved for specimens containing different percentages of MWCNTs. The specimens
including 3 wt % MWCNTs could withstand less longitudinal force. It can further be seen from
Table 2 that when increasing the filler amount from 1 to 3 wt %, the maximum strength decreases from
68.36 MPa to 50.19 MPa. In general, the strength of nanocomposites obtained from tensile tests were
improved by adding MWCNT to the epoxy matrix. As reported in Table 2, the maximum strength of
the nanocomposites increased with respect to pure epoxy. However, the maximum strength decreased
by adding more than 1 wt % MWCNTs, which is similar to what was reported in [42].
Figure 7. Force and impedance changes for the nanocomposite sensor with 2 wt % MWCNTs for
the different dispersion times of (a) 5 min, (b) 10 min, and (c) 15 min. The arrows indicate the axis
belonging to the respective curve. Note: the scaling on the righthand axis and displacement are not
uniform throughout the illustrated results.
62
Electronics 2018, 7, 143
Figure 8. Force and impedance changes for the nanocomposite sensor with 3 wt % MWCNTs at 5 min
dispersion time. The arrows indicate the axis belonging to the respective curve. Note: the scaling on
the righthand axis and displacement below are not uniform throughout the illustrated results.
(a)
(b)
(c)
Figure 9. Cont.
63
Electronics 2018, 7, 143
(d)
(e)
Figure 9. Force and impedance changes as a function of displacement for nanocomposites with different
weight percent prepared at 10 min dispersion time and (a) 1 wt % CNT; (b) 1.5 wt % CNT; (c) 2 wt % CN;
(d) and (e) 3 wt % CNT. The arrows indicate the axis belonging to the respective curve. Note: the scaling
on the righthand axis and displacement below are not uniform throughout the illustrated results.
The slopes of the electrical impedance diagrams show that a filler amount equal to 3 wt %
MWCNTs, and at least 10 min dispersion time, provided the highest sensitivity with respect to
displacement and applied force using the suggested measurement setup. However, the mechanical
strength decreased to 50.19 MPa.
4. Conclusions
In this work, we introduce a measurement technique for condition monitoring of damage in
composites for structures and buildings by conductive nano-adhesive. The conductive nano-adhesive
was prepared with various MWCNT contents and different dispersion times. Then, the capability
of the prepared MWCNT–epoxy composites as nanocomposite sensors was studied by determining
their electrical impedance changes during longitudinal loading. It was observed that dispersion
times longer than 10 min provide no significant improvement in the equivalent parallel resistance of
the nanocomposite. Although the maximum tolerated forces of these nanocomposite sensors were
64
Electronics 2018, 7, 143
achieved with 1 wt % MWCNT content, the nanocomposite sensors fabricated with 3 wt % MWCNTs
and a dispersion time of 10 minutes showed better self-damage sensing capabilities in the considered
setup, while still achieving a mechanical strength higher than that of pure epoxy.
Author Contributions: O.S.-D. prepared the specimens, contributed to electrical and mechanical testing and
drafted the paper. L.-M.F. contributed to the electrical and mechanical measurements, did the analysis in MATLAB
and edited the paper. M.F. gave suggestions on how to modify the paper and provided supervision. A.R. aided in
preparation of the specimen and contributed the SEM analyses. H.O. contributed in the tensile testing, and T.M.
worked on the suitable signal processing for the electrical measurements. A.A. is supervisor. H.Z. organized the
financing and collaborations, L.-M.F. and H.Z. reviewed the paper and provided supervision.
Funding: This research received no external funding.
Acknowledgments: This study was financially supported by the Alpen-Adria-Universität. The preparation of
specimens was conducted in the chemistry lab of the Carinthian Tech Research (CTR) AG and mechanical testing
equipment was supplied by the Carinthian University of Applied Sciences (FH Kärnten) in Villach.
Conflicts of Interest: The authors declare no conflict of interest.
References
1. Lu, J.; Chen, X.; Lu, W.; Chen, G. The piezoresistive behaviors of polyethylene/foliated graphite
nanocomposites. Eur. Polym. J. 2006, 42, 1015–1021. [CrossRef]
2. Le, J.-L.; Du, H.; Dai Pang, S. Use of 2d graphene nanoplatelets (gnp) in cement composites for structural
health evaluation. Compos. Part B 2014, 67, 555–563. [CrossRef]
3. Thostenson, E.T.; Chou, T.-W. Aligned multi-walled carbon nanotube-reinforced composites: Processing and
mechanical characterization. J. Phys. D Appl. Phys. 2002, 35, L77–L80. [CrossRef]
4. Suhr, J.; Koratkar, N.; Keblinski, P.; Ajayan, P. Viscoelasticity in carbon nanotube composites. Nat. Mater.
2005, 4, 134–137. [CrossRef] [PubMed]
5. Cha, J.; Jun, G.H.; Park, J.K.; Kim, J.C.; Ryu, H.J.; Hong, S.H. Improvement of modulus, strength and fracture
toughness of cnt/epoxy nanocomposites through the functionalization of carbon nanotubes. Compos. Part B
2017, 129, 169–179. [CrossRef]
6. Wang, L.; Dang, Z.-M. Carbon nanotube composites with high dielectric constant at low percolation threshold.
Appl. Phys. Lett. 2005, 87, 042903. [CrossRef]
7. Li, J.; Zhang, G.; Zhang, H.; Fan, X.; Zhou, L.; Shang, Z.; Shi, X. Electrical conductivity and electromagnetic
interference shielding of epoxy nanocomposite foams containing functionalized multi-wall carbon nanotubes.
Appl. Surf. Sci. 2018, 428, 7–16. [CrossRef]
8. Guadagno, L.; Raimondo, M.; Vertuccio, L.; Naddeo, C.; Barra, G.; Longo, P.; Lamberti, P.; Spinelli, G.;
Nobile, M. Morphological, rheological and electrical properties of composites filled with carbon nanotubes
functionalized with 1-pyrenebutyric acid. Compos. Part B 2018, 147, 12–21. [CrossRef]
9. Gardea, F.; Lagoudas, D.C. Characterization of electrical and thermal properties of carbon nanotube/epoxy
composites. Compos. Part B 2014, 56, 611–620. [CrossRef]
10. Krainoi, A.; Kummerlöwe, C.; Nakaramontri, Y.; Vennemann, N.; Pichaiyut, S.; Wisunthorn, S.; Nakason, C.
Influence of critical carbon nanotube loading on mechanical and electrical properties of epoxidized natural
rubber nanocomposites. Polym. Test. 2018, 66, 122–136. [CrossRef]
11. Galvez, P.; Quesada, A.; Martinez, M.A.; Abenojar, J.; Boada, M.J.L.; Diaz, V. Study of the behaviour of
adhesive joints of steel with cfrp for its application in bus structures. Compos. Part B 2017, 129, 41–46.
[CrossRef]
12. Vajtai, R.; Wei, B.; Zhang, Z.; Jung, Y.; Ramanath, G.; Ajayan, P. Building carbon nanotubes and their smart
architectures. Smart Mater. Struct. 2002, 11, 691–698. [CrossRef]
13. Koo, Y.; Shanov, V.N.; Yun, Y. Carbon nanotube paper-based electroanalytical devices. Micromachines 2016, 7,
72. [CrossRef]
14. Lee, J.; Lim, S.-H. CNT foam-embedded micro gas pre-concentrator for low-concentration ethane
measurements. Sensors 2018, 18, 1547. [CrossRef] [PubMed]
15. Avilés, F.; May-Pat, A.; López-Manchado, M.; Verdejo, R.; Bachmatiuk, A.; Rümmeli, M. A comparative
study on the mechanical, electrical and piezoresistive properties of polymer composites using carbon
nanostructures of different topology. Eur. Polym. J. 2018, 99, 394–402. [CrossRef]
65
Electronics 2018, 7, 143
16. Nofar, M.; Hoa, S.; Pugh, M. Failure detection and monitoring in polymer matrix composites subjected
to static and dynamic loads using carbon nanotube networks. Compos. Sci. Technol. 2009, 69, 1599–1606.
[CrossRef]
17. Wang, Y.; Wang, S.; Li, M.; Gu, Y.; Zhang, Z. Piezoresistive response of carbon nanotube composite film
under laterally compressive strain. Sens. Actuators A 2018, 273, 140–146. [CrossRef]
18. Kim, H.; Kim, Y. High performance flexible piezoelectric pressure sensor based on cnts-doped 0–3
ceramic-epoxy nanocomposites. Mater. Des. 2018, 151, 133–140. [CrossRef]
19. Hu, N.; Fukunaga, H.; Atobe, S.; Liu, Y.; Li, J. Piezoresistive strain sensors made from carbon nanotubes
based polymer nanocomposites. Sensors 2011, 11, 10691–10723.
20. Prudencio, E.; Bauman, P.; Williams, S.; Faghihi, D.; Ravi-Chandar, K.; Oden, J. Real-time inference of
stochastic damage in composite materials. Compos. Part B 2014, 67, 209–219. [CrossRef]
21. Kwon, D.-J.; Wang, Z.-J.; Choi, J.-Y.; Shin, P.-S.; DeVries, K.L.; Park, J.-M. Damage sensing and fracture
detection of cnt paste using electrical resistance measurements. Compos. Part B 2016, 90, 386–391. [CrossRef]
22. Mishra, S.; Kumaran, K.; Sivakumaran, R.; Pandian, S.P.; Kundu, S. Synthesis of PVDF/CNT and
their functionalized composites for studying their electrical properties to analyze their applicability in
actuation & sensing. Colloids Surf. A 2016, 509, 684–696.
23. Na, W.-J.; Byun, J.-H.; Lee, M.-G.; Yu, W.-R. In-situ damage sensing of woven composites using carbon
nanotube conductive networks. Compos. Part A 2015, 77, 229–236. [CrossRef]
24. Li, C.; Thostenson, E.T.; Chou, T.-W. Sensors and actuators based on carbon nanotubes and their composites:
A review. Compos. Sci. Technol. 2008, 68, 1227–1249. [CrossRef]
25. Lee, B.M.; Gupta, S.; Loh, K.J.; Nagarajaiah, S. Strain sensing and structural health monitoring using
nanofilms and nanocomposites. In Innovative Developments of Advanced Multifunctional Nanocomposites in
Civil and Structural Engineering; Loh, K., Nagarajaiah, S., Eds.; Elsevier: Cambridge, UK, 2016; pp. 303–326.
26. Kang, I.; Schulz, M.J.; Kim, J.H.; Shanov, V.; Shi, D. A carbon nanotube strain sensor for structural health
monitoring. Smart Mater. Struct. 2006, 15, 737–748. [CrossRef]
27. Meeuw, H.; Viets, C.; Liebig, W.; Schulte, K.; Fiedler, B. Morphological influence of carbon nanofillers on
the piezoresistive response of carbon nanoparticle/epoxy composites under mechanical load. Eur. Polym. J.
2016, 85, 198–210. [CrossRef]
28. Alig, I.; Pötschke, P.; Lellinger, D.; Skipa, T.; Pegel, S.; Kasaliwal, G.R.; Villmow, T. Establishment, morphology
and properties of carbon nanotube networks in polymer melts. Polymer 2012, 53, 4–28. [CrossRef]
29. Pal, G.; Kumar, S. Multiscale modeling of effective electrical conductivity of short carbon fiber-carbon
nanotube-polymer matrix hybrid composites. Mater. Des. 2016, 89, 129–136. [CrossRef]
30. Zangl, H.; Muehlbacher-Karrer, S.; Hamid, R. Interfaces for autarkic wireless sensors and actuators in
the internet of things. In Advanced Interfacing Techniques for Sensors; Springer: New York, NY, USA, 2017;
pp. 167–189.
31. Zangl, H.; Zine-Zine, M.; Mühlbacher-Karrer, S. Teds extensions toward energy management of wireless
transducers. IEEE Sens. J. 2015, 15, 2587–2594. [CrossRef]
32. Seyhan, A.T.; Tanoğlu, M.; Schulte, K. Tensile mechanical behavior and fracture toughness of MWCNT and
DWCNT modified vinyl-ester/polyester hybrid nanocomposites produced by 3-roll milling. Mater. Sci.
Eng. A 2009, 523, 85–92. [CrossRef]
33. Kueseng, P.; Sae-oui, P.; Rattanasom, N. Mechanical and electrical properties of natural rubber and nitrile
rubber blends filled with multi-wall carbon nanotube: Effect of preparation methods. Polym. Test. 2013, 32,
731–738. [CrossRef]
34. Faller, L.-M.; Mitterer, T.; Leitzke, J.P.; Zangl, H. Design and evaluation of a fast, high-resolution sensor
evaluation platform applied to mems position sensing. IEEE Trans. Instrum. Meas. 2017, 67, 1014–1027.
[CrossRef]
35. Faller, L.-M.; Leitzke, J.; Zangl, H. Design of a fast, high-resolution sensor evaluation platform applied to
a capacitive position sensor for a micromirror. In Proceedings of the 2017 IEEE International Instrumentation
and Measurement Technology Conference (I2MTC), Turin, Italy, 22–25 May 2017; pp. 1–6.
36. Georgousis, G.; Pandis, C.; Kalamiotis, A.; Georgiopoulos, P.; Kyritsis, A.; Kontou, E.; Pissis, P.; Micusik, M.;
Czanikova, K.; Kulicek, J. Strain sensing in polymer/carbon nanotube composites by electrical resistance
measurement. Compos. Part B 2015, 68, 162–169. [CrossRef]
66
Electronics 2018, 7, 143
37. Pircheraghi, G.; Powell, T.; Solouki Bonab, V.; Manas-Zloczower, I. Effect of carbon nanotube dispersion
and network formation on thermal conductivity of thermoplastic polyurethane/carbon nanotube
nanocomposites. Polym. Eng. Sci. 2016, 56, 394–407. [CrossRef]
38. Ferrreira, A.; Rocha, J.; Ansón-Casaos, A.; Martínez, M.; Vaz, F.; Lanceros-Mendez, S. Electromechanical
performance of poly (vinylidene fluoride)/carbon nanotube composites for strain sensor applications.
Sens. Actuators A 2012, 178, 10–16. [CrossRef]
39. Ku-Herrera, J.; Aviles, F. Cyclic tension and compression piezoresistivity of carbon nanotube/vinyl ester
composites in the elastic and plastic regimes. Carbon 2012, 50, 2592–2598. [CrossRef]
40. Grammatikos, S.; Paipetis, A. On the electrical properties of multi scale reinforced composites for damage
accumulation monitoring. Compos. Part B 2012, 43, 2687–2696. [CrossRef]
41. Lim, A.S.; An, Q.; Chou, T.-W.; Thostenson, E.T. Mechanical and electrical response of carbon nanotube-based
fabric composites to hopkinson bar loading. Compos. Sci. Technol. 2011, 71, 616–621. [CrossRef]
42. Yu, S.; Tong, M.N.; Critchlow, G. Wedge test of carbon-nanotube-reinforced epoxy adhesive joints. J. Appl.
Polym. Sci. 2009, 111, 2957–2962. [CrossRef]
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
67
electronics
Article
A “Smart” Trap Device for Detection of Crawling
Insects and Other Arthropods in Urban Environments
Panagiotis Eliopoulos 1 , Nikolaos-Alexandros Tatlas 2 , Iraklis Rigakis 3 and Ilyas Potamitis 4, *
1 Department of Agriculture Technologists, Technological Educational Institute of Thessaly, 41110 Larissa,
Greece; [email protected]
2 Department of Electronics Engineering, Piraeus University of Applied Sciences, 12244 Athens, Greece;
[email protected]
3 Department of Electronics, Technological Educational Institute of Crete, 73133 Chania, Greece;
[email protected]
4 Department of Music Technology & Acoustics, Technological Educational Institute of Crete,
74133 Rethymno, Greece
* Correspondence: [email protected]; Tel.: +30-28310-21900; Fax: +30-28310-21913
Abstract: We introduce a device for the automatic detecting and reporting of crawling insects in
urban environments. It is a monitoring device for urban pests that complies with the context of
smart homes and smart cities, and is compatible with the emerging discipline of the Internet of
Things (IoT). We believe it can find its place in every room of a hotel, hospital, military camp,
and residence. This box-shaped device attracts targeted insect pests, senses the entering insect,
and takes automatically a picture of the internal space of the box. The e-trap includes strong
attractants (pheromone and/or food) to increase capture efficiency and traps the insect on its sticky
floor. The device carries the necessary optoelectronic sensors to monitor all entrances of the trap.
As the insect enters it interrupts the infrared light source. This triggers a detection event; a picture
is taken, and a time-stamp is set before delivering the picture through the Wi-Fi to an authorized
person/stakeholder. The device can be integrated seamlessly in urban environments and operates
unobtrusively to human activities. We report results on various insect pests and depending on the
insect species, can reach a detection accuracy ranging from 96 to 99%.
1. Introduction
The quality of life for most people in the future will be represented in the cities’ quality of life
index. The European Commission has, in recent years, been increasing its focus on urban issues, as a
response to the fact that by 2020 it is estimated that almost 80% of EU citizens will be living in cities [1].
Cities provide development and growth, and generally better life benefits than in rural areas. Apart
from quality of living, houses, buildings, roads, schools, hospitals, markets, and other structures that
characterize the urban environment, cities also provide habitats for a special group of insects and other
arthropods, some of which have attained pest status, the so-called “urban insects” [2–4].
Contrarily to agroecosystems, pest status in the urban environment may not be based on a
measurable feature. The damage and the control treatments costs cannot always be determined.
Structural damage (e.g., termites, wood boring beetles), sanitary problems (e.g., cockroaches), health
threats (e.g., bed bugs), or simple annoyance only by the insect presence (e.g., insects in houses,
stinging insects), have been developed to common cases in urban environments. A decision to apply
control measures may be based on potential damage or personal injury, or solely or in part on emotion.
Arthropods in the urban environment are completely unacceptable, whether their populations are low
or high. Pest management and control strategies are based on early detection and pest identification
before applying chemical and nonchemical control treatments.
Early pest detection is crucial for an effective and affordable control in urban environments.
For this purpose, various trap types (mainly sticky) are frequently used by homeowners, pest
management professionals, and urban entomologist researchers for detecting infestations of crawling
insects like ants, termites, bedbugs, cockroaches, earwigs, beetles, moth larvae, etc., as well as other
crawling arthropods such as spiders, millipedes, centipedes, etc. [2,5,6]. These devices provide
consistent estimates not only of insects’ presence (detection) and relative abundance (monitoring),
but they are also useful for evaluating insecticide treatment efficacy (post-treatment analysis) and
control purposes (population reduction) [7–9].
As a detection tool, sticky traps provide information on distribution and population density,
thereby assisting in properly targeting insecticide applications. Because of their safety, ease of use,
and non-toxicity, sticky traps are considered to be a valuable tool in integrated pest management (IPM)
programs especially in urban environments.
For the purposes of this study, trapping tests were performed for the detection of three very
common crawling insects in urban environments.
A. Cockroaches (Order: Blattodea): They are cosmopolitan insects, occurring nearly all over
the world. Although, most of the approximately 4000 described species live in small populations in
forest habitats, their association with decaying organic matter and humid conditions maintains some
species (nearly 30) in the urban environment. They may become very serious pests given that they
can passively transport pathogenic microbes on their body surfaces. Particularly, in environments
such as hospitals [10,11], they are often linked with allergic reactions in humans [12] and asthma [13].
These allergens are heat-stable and persistent in the living space. Approximately 20–50% of homes
with no visible sign of cockroaches have detectable cockroach allergens in dust [14].
B. Ants (Hymenoptera: Formicidae): The pest status of ants is based on their nesting and
foraging habits. The urban environment provides a variety of soil types and conditions, suitable for
a large number of ant species [2,15]. Nesting along building foundations can result in damage
to structural members of buildings, and to exterior faces. Ants usually enter the buildings to
find food, demonstrating remarkable persistence foraging inside and establishing satellite nests
indoors. The habit of foraging ants to visit a variety of food sources increases their potential to
acquire pathogenic and food decay microbes. A large number of pathogens have been recorded
from ant species, including bacteria (Burkholderia, Clostridium, Enterobacter, Salmonella, etc.) and fungi
(Aspergillus, Penicillium, etc.), [2,15,16]. Pest ants in the urban environment have a significant economic
impact both on the pest control industry and the general public. Many times, ants have been ranked
as the number one pest problem of households, even surpassing cockroaches [17]. Most important
and well-studied species are the fire ants (Solenopsis sp.), because of their medical and agricultural
impact [18]; the Pharaoh ants (Monomorium pharaonis), which are major household pests and can
act as disease vectors in hospitals [19]; and carpenter ants (Camponotus spp.), which are important
wood-destroying organisms [20].
C. Beetle pests of stored food (Order: Coleoptera): Beetle pests are often recorded in urban
environments searching for food (e.g., cereals, grains, packaged food, flour, etc.). Their presence may
become a serious problem in certain cases like in residences, markets, hospitals, bakeries, restaurants
etc. There is a plethora of beetle species (Sitophilus, Rhyzoperta, Tribolium, Cryptolestes, Oryzaephilus,
Stegobium, Lasioderma, etc.) invading abovementioned urban environments searching for food [21,22].
Recently, we observe an upsurge of interest in shifting sophisticated, high-tech procedures to
insect sensing that are typically encountered in other research fields (see the LIDAR applications
on insect fauna [23], Perles in optical sensing of termites [24], Potamitis for electronic e-traps for
flying insects [25–28], and Zhong on applying deep learning to insects trapped on sticky traps [29]).
This study belongs to this general trend but is different to its aim and cause. Our study aims to
introduce a novel “intelligent” trap that can be hidden conveniently under a bed or fixed to the wall
69
Electronics 2018, 7, 161
that can become a useful tool for the automated early detection of crawling insects and other arthropods
in urban environments. Though we have tested three widely encountered cases the applicability can
be directly extended to other cases as well, namely: The presence mainly of Bed Bugs (Hemiptera:
Cimicidae) and Cloth Moths that feed on stored fabrics (Lepidoptera: Tineidae) can be devastating for
the reputation and prospect of a hotel or hospital in the era of TripAdvisor, Instagram, and Facebook.
The proposed device will curtail the cost of Integrated Pest Management (IPM) applied to hotels as it
will limit the application of IPM from a prescheduled basis (i.e., once a year) to an on-time, localized
(i.e., per room) application of IPM. More on, it allows the hotel to advertise that it takes best action to
protect its customers and their children by applying surveillance control on insects.
Figure 1. (Left) A prototype of the smart trap. (Right) The electronics are mounted on top of a
plastic trap.
Our smart trap functions like a classic floor trap. Traps may differ greatly in design features
(shape, size, surface material, etc.) and the presence of attractants (food, pheromone). All these factors
along with placement method influence dramatically the trap efficacy [30].
The box includes a strong attractant to attract the insects and maximize captures. The insect is
trapped on a sticky surface that is inside the device, basically a cardboard coated with special insect
glue (Tangle-Trap® Sticky Coatings, Tanglefoot, Marysville, Washington, DC, USA) that lasts (remains
sticky) for 4–6 months. The sticky floor provides the means for immediate verification of reported
results. Captured insects frequently release additional pheromone by themselves and increase the
attractiveness. The presence of multiple attractants targeting different insect species simultaneously is
also possible and recommended.
The concept presented in this work does not depend on a specific trap configuration and many
types are compatible with it. In this work, we modified a well-known trap for crawling insects
(TRAPPER Pest Monitor® , Bell Labs, Murray Hill, NJ, USA) on which we added the electronic
components (see Figure 1-Right). This trap has multiple entrances that are all monitored simultaneously
by a single laser beam (infrared laser PN: 980MD-30-1230-CAB/NANMA). Any entering pest will
70
Electronics 2018, 7, 161
interrupt the laser’s beam, and this triggers a time counter. The wavelength of the laser is at 980 nm
and its power at 30 mW.
Figure 2. Surveillance of urban, crawling insects in the context of smart-cities. Residential accounts,
food processing plants, military camps, underground stations, and hospitals are some of the main
locations that can be monitored independently or as part of a regional/country network in the context
of the Internet of Things (IoT).
After 20 s a photograph (Camera OV2640, cmos sensor camera module, Omnivision, Santa Clara,
CA, USA) of the internal volume of the trap is taken (Figure 3), time-stamped and delivered to
pre-stored mail addresses while a copy of the picture is stored internally in the SD card of the device.
The time delay ensures that is given enough time to the insect that follows the chemical signals of the
bait to crawl inside. The crossing of the laser beam by an insect effects a voltage drop in the receiver’s
amplifier. The drop is analogous to the size of the insect. A minimum and maximum threshold is
set during monitoring of the voltage drop based on inactive, targeted pests. For example, when we
need to monitor cockroaches we do not want the system to be triggered by the accidental entrance
of an ant. Note that a random entrance is uncommon as targeted insects enter the trap because the
follow their corresponding pheromones. Similarly, we monitor the time delay of the entering event
based on marking the onset and the end of an entering event. A long delay is atypical for an insect
movement and this initiates a possible malfunction notice sent through the Wi-Fi (e.g., an insect
blocking the entrance). The speed of the entering pest is also calculated, and atypical speeds are
rejected as false alarms.
The processor that handles all tasks is a STM32F767 ARM Microcontroller (see Figure 1-Right).
71
Electronics 2018, 7, 161
Figure 3. Photograph from the internal of the trap, automatically taken 20 s after insect’s entrance.
A diagram of the system summarizing its modules and their interconnection is depicted in the
block diagram of Figure 4.
The STM32F767 processors has all the communication buses that are required for the task.
The laser sends 200 Hz pulses of 12 μs duration. The pulses are received by the photodiode and
are amplified. The amplifier’s output is driven to analogue input of the processor. The processor runs
an algorithm that reads the amplitude of the signal and detects if the beam of light has been interrupted.
If so, then, after 20 s a light illuminates the trap and the camera takes a picture. The jpeg picture is
transferred through the 8-BIT DCMI interface to the memory of the processor and stored in the SD card.
The communication of the processor with the SD is done through the 4-BIT SPI interface. Subsequently,
the photograph is sent via the Wi-Fi functionality to predefined e-mails. The e-mails as well as other
parameters are stored in a settings file stored in the SD card of the system. The software is written in
C language using the IAR Embedded workbench. The programming of the flash memory has been
done using the ST-Link V2 programmer. The code initialization was done using the STM32CubeMX of
72
Electronics 2018, 7, 161
ST. For programming the peripheral sub-components such as the SD and the camera, ADC and the
Wi-Fi interface we made use of the STM32 HAL Drivers.
2.2. Evaluation
For the purposes of our study, a prototype of this trap was tested under real conditions in three
cases. Our trap was placed:
(a) in an old food warehouse with an increased presence of cockroaches in Agrinio, Central Greece.
Trap placement lasted from early to mid-May 2018.
(b) in a livestock unit with large ant populations in Larissa, Central Greece. Trap placement lasted
from early to mid-April 2018.
(c) in an old-style granary (horizontal type) with a heavy insect infestation in stored wheat mass in
Farsala, Central Greece. Trap placement lasted from early to mid-March 2018.
Trap placement lasted about two weeks in all cases. The trap was visually checked by a
qualified entomologist on a daily basis, and the number of captured insect individuals was recorded.
These manual records were compared with the data that were automatically recorded by the trap and
sent wirelessly. Non-target insects or other arthropods that may enter the trap accidentally were not
included in the results but in our experiments, these were rare cases. During each manual inspection
the sticky surface with captured insects was removed for examination in the lab (Figure 5) and replaced
by an identical one clean sticky cardboard surface. In all cases the proper attractant was placed in the
center of sticky surface in order to make sure that insects would enter the trap. Baits applied for each
target were: pure wheat germ oil (HealthAid, Harrow, London, UK) for stored food beetles, 25% sugar
solution for ants, and Trapper roach attractant (Bell Labs, Murray Hill, NJ, USA) for cockroaches.
Figure 5. Evaluation of reported results. Sticky surface inside the trap after 2 days of placement in
(Left) a cereal grain storage facility with serious insect infestations, (Right) in an old food warehouse
with an increased presence of cockroaches.
73
Electronics 2018, 7, 161
4
Cockroaches
Automatically Counted
r = 0,9642
2
Total detected : 29
1
Total counted : 24
0
0 1 2 3 4 5
35
Ants
30
Automatically Counted
25
20
15 r = 0,9946
10
Total detected : 222
5 Total counted : 197
0
0 5 10 15 20 25 30 35 40
20
Stored Food Beetles
Automatically Counted
15
10
r = 0,9829
0
0 5 10 15 20 25
Manually recorded captures
Figure 6. Accuracy of the automatic counting in comparison with actual detection, each species target
insect. The values of the correlation coefficient r prove that our system is > 96% accurate (when detected
and counted values are the same then r equals to 1).
In order to evaluate the accuracy of the proposed system, the numbers of the captures measured
by the system were compared to those counted manually. The inaccuracy of the system is based on the
error between manual counting and system counting. Equation (1), which represents the accuracy of
the system, is shown as follows:
| Mc − Ac |
a = 1− . (1)
Mc
where α is the counting accuracy of the system, Mc is the number of the captures by manual counting,
and Ac is the number of the automatically counted captures. The results are shown in Table 1.
74
Electronics 2018, 7, 161
As it is clearly presented, our smart trap is very accurate, achieving about 90% accuracy on
automatic counts compared with manually counted numbers of captured insects. The accuracy of our
system in detecting insect presence is also shown by the very high correlation (r > 0.96 in all cases)
between the generated signals and actual numbers of insects caught in the trap.
To the best of our knowledge, it is the first time that an automated remote system is evaluated
under real conditions in detecting insect pests in urban environments. Lab studies have been carried
out on the development of automated detection of insects [31–33] but in a totally different context from
ours (e.g., probes inserted in the grain mass).
Our study aims to introduce a novel trap-device that we believe it can find its place to every
urban environment such as houses, hotel rooms, hospitals, underground stations and trains, military
camps, airports, food markets and storages. Such a device will also curtail the cost of Integrated Pest
Management (IPM) as it will limit the application of IPM from a prescheduled basis (i.e., once a year)
to an on-time, localized (i.e., per room) application of IPM.
It has been well documented that insects may act as a “pathogen reservoir”, which especially in a
hospital environment, may cause serious health hazards [34–36]. Insect problems can be detrimental
75
Electronics 2018, 7, 161
for the financial prospect of a private hospital establishment or for the managemental capability of the
head of the hotel and finally of the Ministry of Health [37].
Again, the presence of ants, cockroaches, bed bugs or stored food insects in home residencies,
schools or even in military camps may become a serious problem with unforeseen consequences [2,38].
With a cost of materials roughly 30 Euros (as per 13 August 2018) the device has also the prospect to be
widely accepted by typical residencies at least to one device per house.
Finally, the suggested product conforms with the concept of the smart house and through the
emerging trend of IoT it can connect the concept of a smart house to a smart city that keeps an
eye-watch on the insects at larger spatial scales.
4. Conclusions
With the recent advancements in wireless communications, networks, and integrated sensors,
the ability to use wireless sensor networks (WSNs) to cover large areas with a network of IoT nodes
that collectively transmit information to a central server in real-time has become available. Wireless
sensor networks have been demonstrated to exhibit the potential of being used in massive scale for
environmental parameter monitoring. While they are constantly evolving to the point of a widely used
technology, the requirements for an automated trap, including autonomous operation pose practical
limitations to the use of off-the-shelf solutions, thus leading to the design and development of custom
hardware. This is due to the type of sensor (imaging and presence), the application field, the need for
low power operation, adaptable size to match the trap, robustness to environmental conditions, the
need for spatial coverage and the existence of isolated or remote monitoring spots. The main concept
is to hide a small, affordable device for insect surveillance of urban crawling insects and forget its
existence until the user receives a picture in his/her mobile.
The smart trap presented in this work was developed following the above requirements,
for fully-automated operation. The cost and size will allow multiple traps to be installed in
possibly concealed locations such as under beds, as instructed by the IPM strategy with a sole
technical requirement of sufficient Wi-Fi coverage, which is nowadays taken for granted in most
indoor environments.
As the events are relayed via wireless networking, following the IoT architecture, these traps may
be integrated to any smart-building infrastructure. This may allow the establishment of applications
ranging from end-user notification/alerting in order to take appropriate measures, to condition-based
insect management depending on set business rules. Moreover, as insect infestation may not be
localized on a building basis but be widespread, by centralizing the server infrastructure and providing
geolocational information for each smart trap, an interactive infestation map may be created, adding
the system to the smart city concept. Future work relates detection of urban insects and deep
learning classification algorithms that have become a standard in visual-based applications of artificial
intelligence as in the paradigm of Zhong [29], where the device automatically counts the insects and
reports their identity and as in Sadegh et al. [39] where the identity of wild animals is automatically
inferred based on their picture.
Author Contributions: Conceptualization, I.P.; Methodology, P.E.; Software, I.R.; Validation, P.E., N.T.;
Writing-Review & Editing, P.E., I.P., N.T.
Funding: This work was supported by the GSRT-Greece matching funds associated to No. 605073, FP7
Project ENTOMATIC.
Conflicts of Interest: The authors declare no conflicts of interest.
References
1. European Commission. Making Our Cities Attractive and Sustainable: How the EU Contributes to Improving the
Urban Environment; Publications Office of the European Union: Luxembourg, 2010.
76
Electronics 2018, 7, 161
2. Robinson, W.H. Urban Insects and Arachnids: A Handbook of Urban Entomology; Cambridge University Press:
Cambridge, UK, 2005.
3. McIntyre, N.E. Ecology of urban arthropods: A review and a call to action. Ann. Entomol. Soc. Am. 2000, 93,
825–835. [CrossRef]
4. Bonnefoy, X.; Kampen, H.; Sweeney, K. Public Health Significance of Urban Pests; World Health Organization:
Geneva, Switzerland, 2008.
5. Dhang, P. Urban Pest Management: An Environmental Perspective; CABI: Oxfordshire, UK, 2011.
6. Dhang, P. Urban Insect Pests: Sustainable Management Strategies; CABI: Oxfordshire, UK, 2014.
7. Owens, J.M.; Bennett, G.W. Comparative study of German cockroach (Dictyoptera: Blattellidae) population
sampling techniques. Environ. Entomol. 1983, 12, 1040–1046. [CrossRef]
8. Kaakeh, W.; Bennett, G.W. Evaluation of trapping and vacuuming compared with low-impact insecticide
tactics for managing German cockroaches in residences. J. Econ. Entomol. 1997, 90, 976–982. [CrossRef]
9. Ballard, J.B.; Gold, R.E. Field evaluation of two trap designs used for control of German cockroach
populations. J. Kansas Entomol. Soc. 1983, 56, 506–510.
10. Rivault, C.; Cloarec, A.; Le Guyader, A. Bacterial load of cockroaches in relation to urban environment.
Epidemiol. Infect. 1993, 110, 317–325. [CrossRef] [PubMed]
11. Elgderi, R.M.; Ghenghesh, K.S.; Berbash, N. Carriage by the German cockroach (Blattella germanica) of
multiple-antibiotic-resistant bacteria that are potentially pathogenic to humans, in hospitals and households
in Tripoli, Libya. Ann. Trop. Med. Parasitol. 2006, 100, 55–62. [CrossRef] [PubMed]
12. Kutrup, B. Cockroach infestation in some hospitals in Trabzon, Turkey. Turk. J. Zool. 2003, 27, 73–77.
13. Kang, B.; Vellody, D.; Homburger, H.; Yunginger, J.W. Cockroach cause of allergic asthma: Its specificity and
immunologic profile. J. Allergy Clin. Immunol. 1979, 63, 80–86. [CrossRef]
14. Eggleston, P.A.; Arruda, L.K. Ecology and elimination of cockroaches and allergens in the home. J. Allergy
Clin. Immunol. 2001, 107, S422–S429. [CrossRef] [PubMed]
15. Rust, M.K.; Su, N.Y. Managing social insects of urban importance. Annu. Rev. Entomol. 2012, 57, 355–375.
[CrossRef] [PubMed]
16. Máximo, H.J.; Felizatti, H.L.; Ceccato, M.; Cintra-Socolowski, P.; Beretta, A.L. Ants as vectors of pathogenic
microorganisms in a hospital in São Paulo county, Brazil. BMC Res. Notes 2014, 7. [CrossRef] [PubMed]
17. Whitmore, R.W.; Kelly, J.E.; Reading, P.L. National Home and Garden Pesticide Use Survey, Final Report. Volume
I: Executive Summary, Results, and Recommendations; USEPA: Washington, DC, USA, 1992.
18. Jemal, A.; Hugh-Jones, M. A review of the red imported fire ant (Solenopsis invicta Buren) and its impacts
on plant, animal, and human health. Prev. Vet. Med. 1993, 17, 19–32. [CrossRef]
19. Wetterer, J.K. Worldwide spread of the pharaoh ant, Monomorium pharaonis (Hymenoptera: For-micidae).
Myrmecol. News 2010, 13, 115–129.
20. Hansen, L.D.; Akre, R.D.; Wildey, K.; Robinson, W. Urban pest management of carpenter ants. In Proceedings
of the First International Conference on Urban Pests, Cambridge, UK; 1993; pp. 271–279.
21. Rees, D.P. Insects of Stored Products; Csiro Publishing: Clayton, Australia, 2004.
22. Subramanyam, B. Integrated Management of Insects in Stored Products; CRC Press: Boca Raton, FL, USA, 1995.
23. Jansson, S.; Brydegaard, M. Passive kHz lidar for the quantification of insect activity and dispersal.
Anim. Biotelem. 2018, 6. [CrossRef]
24. Perles, A.; Mercado, R.; Capella, J.V.; Serrano, J.J. Ultra-Low power optical sensor for xylophagous insect
detection in wood. Sensors 2016, 16, 1977. [CrossRef] [PubMed]
25. Potamitis, I.; Rigakis, I.; Fysarakis, K. Insect biometrics: Otoacoustic signal processing and its applications to
remote monitoring of McPhail type traps. PLoS ONE 2015, 10. [CrossRef] [PubMed]
26. Potamitis, I.; Rigakis, I.; Tatlas, N.-A. Automated surveillance of fruit flies. Sensors 2017, 17, 110. [CrossRef]
[PubMed]
27. Potamitis, I.; Rigakis, I. Large aperture optoelectronic devices to record and time-stamp insects’ wingbeats.
IEEE Sensors J. 2016, 16, 6053–6061. [CrossRef]
28. Potamitis, I.; Eliopoulos, P.; Rigakis, I. Automated Remote Insect Surveillance at a Global Scale and the
Internet of Things. Robotics 2017, 6, 19. [CrossRef]
29. Zhong, Y.; Gao, J.; Lei, Q.; Zhou, Y. A vision-based counting and recognition system for flying insects in
intelligent agriculture. Sensors 2018, 18, 1489. [CrossRef] [PubMed]
77
Electronics 2018, 7, 161
30. Wang, C.; Bennett, G.W. Comparative study of integrated pest management and baiting for German
cockroach management in public housing. J. Econ. Entomol. 2006, 99, 879–885. [CrossRef] [PubMed]
31. Mankin, R.W.; Hodges, R.D.; Nagle, H.T.; Schal, C.; Pereira, R.M.; Koehler, P.G. Acoustic indicators for
targeted detection of stored product and urban insect pests by inexpensive infrared, acoustic, and vibrational
detection of movement. J. Econ. Entomol. 2010, 103, 1636–1646. [CrossRef] [PubMed]
32. Oliver-Villanueva, J.V.; Abián-Pérez, M.A. Advanced wireless sensors for termite detection in wood
constructions. Wood Sci. Technol. 2013, 47, 269–280. [CrossRef]
33. Shuman, D.; Weaver, D.K.; Larson, R.G. Performance of an analytical, dual infrared-beam, stored-product
insect monitoring system. J. Econ. Entomol. 2005, 98, 1723–1732. [CrossRef] [PubMed]
34. Fakoorziba, M.R.; Eghbal, F.; Hassanzadeh, J.; Moemenbellah-Fard, M.D. Cockroaches (Periplaneta
americana and Blattella germanica) as potential vectors of the pathogenic bacteria found in nosocomial
infections. Ann. Trop. Med. Parasitol. 2010, 104, 521–528. [CrossRef] [PubMed]
35. Feizhaddad, M.H.; Kassiri, H.; Sepand, M.R.; Ghasemi, F. Bacteriological survey of American cockroaches in
hospitals. Middle East J. Sci. Res. 2012, 12, 985–989. [CrossRef]
36. Garcia, F.R.M.; Lise, F. Ants associated with pathogenic microorganisms in brazilian hospitals: Attention to a
silent vector. Acta Scientiarum. Health Sci. 2013, 35. [CrossRef]
37. Owens, K.; Pesticides, B. Healthy hospitals controlling pests without harmful pesticides. In Healthy Hospitals
Controlling Pests without Harmful Pesticides; HCWH: Washington, DC, USA, 2003.
38. Daar, S.; Drlik, T.; Olkowski, H.; Olkowski, W. IPM for Schools: A How-to Manual; USEPA: Washington, DC,
USA, 1997.
39. Norouzzadeh, M.S.; Nguyen, A.; Kosmala, M.; Swanson, A.; Palmer, M.S.; Packer, C.; Clune, J. Automatically
identifying, counting, and describing wild animals in camera-trap images with deep learning. Proc. Natl.
Acad. Sci. USA 2018. [CrossRef] [PubMed]
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
78
electronics
Article
Semantic and Dweller-Based Decision Support
System for the Reconfiguration of Domestic
Environments: RecAAL
Daniele Spoladore * and Marco Sacco
Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing (STIIMA),
National Research Council of Italy (CNR), 23900 Lecco, Italy; [email protected]
* Correspondence: [email protected]; Tel.: +39-0341-2350202
Abstract: Researches in the field of ambient assisted living (AAL) have increased in the last ten
years, and the paradigms of the smart home have widely spread. Smart homes must consider
the health-related issues and the real needs deriving from the ageing of their dwellers. In the
smart home, appliances are expected to provide support to the residents, especially when they are
characterized by disabilities and/or impairments related to ageing. While most of the AAL solutions
presented in literature rely on complex systems and architectures, residents affected by mild or
moderate disabilities can take advantage of just a simpler reconfiguration of living environments,
i.e., the replacement of certain appliances with others that are able to help them in coping with their
limitations. This paper proposes a semantic-based decision support system (DSS), which relies on
ontological models, to assist designers in domestic environments’ reconfiguration. The ontology
leverages semantic representations of dwellers and domestic environments’ domains of knowledge
to foster the adoption of appliances able to help the residents to live independently. The development
process of the ontology is presented in detail together with the results deriving from reasoning
processes. To ease the reconfiguration of domestic environments, a prototypical application taking
advantage of the DSS is presented.
Keywords: decision support system; ambient assisted living; domestic environment reconfiguration;
ontology
1. Introduction
The research in the fields of smart home, ambient assisted living (AAL) and domestic healthcare
has strongly increased during the last ten years. One of the reasons of this attention lies in the
remarkable increase of the ageing population (aged 65 or more), who is expected to reach the 30%
of the European population over the forthcoming decades [1]. This segment of population is often
characterized by a loss of independence in several activities of daily living (due to functional limitations
or to the onset of disabilities), and by a diminishing sense of safety—which could potentially lead to
injuries while performing activities inside the house [2]. In this context, the smart home is expected to
deliver to its inhabitants tailored services able to assist the dwellers for a better, healthier and safer life
in their everyday living environment. Therefore, the smart home has been widely addressed as a set of
technologies with the potential to help ageing population in living independently, monitoring their
safety and well-being, and preventing injuries and accidents in the domestic environments [3].
However, it has been highlighted how the possibility to rely on the set of technologies deployed
in a smart home may raise some concerns in the ageing population. For instance, the user-friendliness
of the devices and the need for training dedicate to older residents in the use and management of the
smart home are two remarkable barriers that can jeopardize the real adoption of AAL solutions [4].
Besides, unfamiliarity with the devices and residents’ concerns regarding stigmatization have also
been reported as non-negligible issues for older residents [5]. Finally, privacy concerns can represent
an obstacle for the adoption of monitoring devices in a smart home [6].
A solution for the problems raised by ageing population can therefore rely on a simple
reconfiguration of a standard home with a set of appliances that can support the residents in coping
with their impairments while performing activities of daily living [7]. This kind of reconfiguration
appears promising to balance the support provided to the elderly inhabitants, and their concerns related
to the unfamiliarity with the devices and to their privacy. Works related to the reconfiguration of living
environments are mainly focused on ubiquitous computing and context-aware systems—distributed
systems have been discussed as a promising tool to support the reconfiguration of domestic
devices [8,9]. The possibility to have residents programming their own pervasive computing
environments has also been investigated with the purpose of helping dwellers to be involved in
the reconfiguration of their own domestic environments [10]. Another area where research is focused
regards the possibility to provide adaptation over the time (reconfiguration) of the services provided
by an intelligent environment [11,12]. Nonetheless, to the best of authors’ knowledge, no work in
literature faces the problem of providing ageing population with a set of existing and familiar tools
(such as everyday appliances) designed to (or presenting some features that) help them to cope with
their limitations.
The “Design For All” (D4All) [13] and “Future Home for Future Community” (FHfFC) [14]
projects tackle the issue of easing the reconfiguration of existing domestic environments with familiar
appliances by relying on semantic web technologies. These technologies (in particular ontology) are
connected with decision-making processes, since they provide a formal (logic-based) and sharable
interpretation of knowledge. Semantic models are exploited in DSSs’ development since they can
foster information integration; moreover, ontologies can support automatic reasoning processes, thus
allowing to infer new information starting from the knowledge stated in the model [15].
Through the exploitation of a semantic knowledge base, a Decision Support System (DSS) aimed
at helping architects and smart home designers to provide the inhabitants with a set of appliances
that can help them in everyday-life activities is deployed. Through the use of the DSS, dwellers
(especially those characterized by mild or moderate impairments and elderlies) can rely on familiar
appliances that facilitate them in the execution of some activities. The DSS is designed starting from
the characterization of the dwellers, i.e., the end-users of the AAL solutions and appliances, and relies
on a standard and holistic framework for the description of their health conditions. The developed DSS
is then exploited in an application designed to support designers and smart home architects during
the reconfiguration process.
The remainder of this paper is organized as follows: Section 2 presents the existing works in
the field of semantic-based DSSs, with a focus on AAL and user-oriented solutions. In Section 3,
the methodology exploited for the creation of two use cases and the framework for health conditions
description are introduced, as well as the key factors that led to the identification of the domains of
interest for the ontology. Section 4 deepens into the application ontology description, illustrating the
different solutions adopted for its development. The result of the development process constitutes
the main component of the DSS, which takes advantage of semantic web-leveraged reasoning process
to deliver sets of appliances suitable for each of the dwellers identified in the use cases. Section 5
describes an application using the DSS (RecAAL), and discusses the results obtained from reasoning
process, while Section 6 provides the results of a preliminary testing conducted on RecAAL. Section 7
analyses the limits and future perspective of the DSS. Finally, the Conclusions summarize the main
outcomes and sketch the future steps that need to be implemented to enhance the DSS.
2. Related Works
The topic of modeling the health-data is one of the main issues when tackling the interoperability
among various data sources. Data integration is not a trivial task: The possibility to link different
80
Electronics 2018, 7, 179
health-data is complicated by the heterogeneity of data formats and different naming conventions.
The major importance of this topic gave birth to the Semantic Web for Health Care and Life Sciences
Interest Group [16], whose mission is to advocate, support and develop the adoption of semantic
web technologies across clinical research, healthcare and life sciences. In Reference [17], the authors
relied on ontologies to integrate electronic health records to foster integrated care. In this work,
ontology-based case-finding algorithms are exploited to enhance the accuracy of the diagnosis of
Type 2 Diabetes and to foster the integration of different health-related data to improve the quality
of care. A unified data model provided by ontology is the backbone of the method for accessing
health data in Reference [18]; in the context of emergency medical services, the method allows IoT
devices to access distributed and heterogeneous data. In Reference [19], the authors described an
adaptive mediation system (ARIEN) leveraging ontologies to provide an accurate and seamless
integration of heterogeneous medical data, enhancing data interoperability. To tackle the issues of the
health-related concepts measured with differential accuracy from diverse data sources, the authors
of Reference [20] designed a semantic-based application (PopHR), that was able to automates the
integration and extraction of health-related data; the application uses an ontological framework to
describe data relevant to chronic diseases. Ontologies are also exploited to normalize and integrate
structured and unstructured data from multiple sources. In Reference [21], a semantic annotation
lightweight model for healthcare data is presented; this model is intended to provide interoperability
among diverse IoT devices monitoring patients’ health, and adopts Resource Description Framework
(RDF) [22] as modelling language, and SPARQL (SPARQL Protocol and RDF Query Language) [23] for
health-records extraction. A framework for the management and reuse of clinical archetypes and data
is described in Reference [24]; the framework allows to semantically annotate and transform health
data in order to make them interoperable. With regard to the context of mobile health, Reference [25]
illustrated a patient monitoring system for the IoT; the architecture of the system relies on an ontology
that enables the monitoring of patients’ health status. Inferences provided by the ontology are
used to recommend workout routines and improving eating habits of patients. Datta et al. [26]
presented an IoT architecture to provide personalized and connected healthcare services; part of this
architecture leverages ontologies to manage and gather health-related knowledge, while semantic
rules are exploited to combine cross-domain knowledge.
In the field of AAL solutions, some interesting examples of semantic-based DSS can be traced in
the literature. The possibility of enabling reasoning processes and inferring new knowledge on context,
dwellers’ activities and comfort metrics gathers a great deal of interest [27]. Osman et al. [28] conceived
a DSS for supporting independent living for people suffering from dementia is described. This DSS
leverages the semantic representation of context information and semantic rules (modelled with
Semantic Web Rule Language(SWRL) [29]), in order to build a knowledge base able to capture changes
in the situational conditions and the inferred information are provided to clinical personnel to help
them in their decisions. Zentek et al. [30] proposed an interesting use of ontologies to provide flexible
management of AAL environments configuration. The framework takes into account two key factors
of AAL solutions: the heterogeneity of settings and home environments, and the changing over the
time of the user’s needs. Zhang et al. [31] developed a sharable clinical DSS system providing clinical
personnel with patient-based recommendations support clinical-decision process. The knowledge-base
of the system takes advantage of both ontologies and SWRL rules to provide automatic suggestions.
Ontology-based technologies are a key factor in many works related to Internet of Things (IoT)
and AAL solutions, since they allow to provide a formal description of many domains of knowledge
involved. Energy efficiency and consumption is a relevant topic in smart homes and ambient
intelligence, where semantic web technologies can play an important role. Fotopoulou et al. [32]
presented an energy-aware IT ecosystem that leverages ontologies to provide recommendations
related to energy consumption to the residents. The architecture collects energy, environmental and
behavioral-related data and combines them to generate recommendations tailored on the residents’
lifestyles. Fensel et al. [33] described the OpenFridge platform, which leverages ontologies to
81
Electronics 2018, 7, 179
transform into triples users’ collected measurements of their refrigerators and analyzes the resulting
semantic data with SPARQL. OpenFridge exploits specialized ontologies for representing and linking
refrigerators’ data in RDF format, with the ultimate aim of contributing to appliances’ energy efficiency.
Madrazo et al. [34] implemented a semantic-based energy information system, connecting several and
various data sources exploiting ontologies; semantic models are used to integrate the information
regarding energy certificates, building descriptions, energy monitoring in buildings and climate data.
Bonino et al. [35] developed an ontology-based model for describing electrical energy consumption in
a smart home; this ontology (PowerOnt) provides the means to support energy efficiency measures in
residential homes.
Ontologies cover a pivotal role also in describing the interactions between the residents and the
smart home (its services, devices, locations, etc.). Huang et al. [36] presented a dialog system for
residents, who can inquire the smart home system for information related to appliances using their
voice. The system adopts a semantic approach to manage residents’ vocal inputs and transforming
them into service requests. In Ni et al. [37], ontologies are exploited as a mean to represent human
activity within the smart home, thus allowing the detection of residents’ behaviors. The proposed
semantic model is built as a network of ontologies describing the resident, the environmental context
and the activities.
Contrary to the main trend in AAL, the DSS presented in this work is not dedicated to support the
deployment of context-aware or ubiquitous systems: The DSS fosters the reconfiguration of domestic
environments using everyday appliances, which are more familiar to the residents. In RecAAL’s DSS
the dwellers’ health status and its formalization assume a central role.
82
Electronics 2018, 7, 179
ICF is used to describe potential residents (Section 3.2); designers can then exploit this piece
of information as an input of the DSS to provide a suitable reconfiguration of the set of domestic
appliances (Section 3.3) to the dweller characterized with ICF.
Figure 1. An excerpt of the International Classification of Functioning, Disability and Health (ICF)
classification illustrating the deepening of a component into two different health-related functions.
83
Electronics 2018, 7, 179
Figure 1 shows how under the same chapter both visual and hearing-related functions can be
listed; to address properly the problems related to the “Quality of Vision”, another level must be
enabled—the fourth level item, characterized by a five-digits code.
The complete classification encompasses more than 1400 domains, organized according to the
abovementioned hierarchy of concepts. Specifically, “Body Functions” component’s domains aim
at providing categories for the description of the functioning of human body systems, while “Body
Structures” domains identify the anatomical parts of such systems. “Activity and Participation”
domains describe the execution of tasks and actions in every-day situations, while the “Environmental
Factors” domains provide the means to assess the social and physical impact of the environment on
the individual, together with the possibility to describe the existence of physical barriers or facilitators
in the environments where the individuals usually perform tasks.
The functioning or disability of an individual can be assessed selecting the suitable category
and its corresponding code and then adding one or more qualifiers. A qualifier records the presence
and assesses the severity of a problem in specific domains of functioning, personal or societal level.
A generic qualifier can be added at the end of the domain code and serves as an indicator of the level
of severity characterizing the domain; this generic qualifier can acquire a set of integer values:
The value 8 is used when the information gathered to decide the qualifier are not enough,
while 9 is used when no specification can be given about a specific domain (for instance, when coding
b650 “Menstruation Functions” for a male person). The generic qualifier assumes the meaning of
descriptor of barriers (defined as physical, social and attitudinal factors that could force an individual
to perform below their capacities), or facilitators (factors that can ease or enhance the performance
of the individual) for the specification of the Environmental Factors domains. The simple qualifier
represents the impact of a barrier (e410.1 a mild barrier/negative impact in the “Individual attitudes of
immediate family members”), while a qualifier presenting the “+” sign indicates a facilitator (e410.+2
a moderate facilitation/positive impact in the “Individual attitudes of immediate family members”).
Each component can make use of other qualifiers (following the generic one) according to the
qualifiers structure [39], reported in Figure 2.
84
Electronics 2018, 7, 179
Figure 2. A description of all the possible qualifiers applicable for each ICF component and their
meanings (according to References [39,44]).
ICF’s component “Personal Factors” is yet to be completed, therefore the classification can
rely on the remaining four components—enough to provide a sound and complete description of
health-related issues, since “Personal Factors” are the particular background of an individual’s life and
living [45]. Although ICF presents many advantages, it has to be underlined that this framework is
characterized by some shortcomings, such as problems regarding incongruent classification of some
concepts, a lack of clarity between activities and their qualities, incorrect parent-child relationships
of concepts and an overemphasis on subsumption [46–48]. The ICF has also been modelled into an
ontology [49], which can be used as a reference model for other domain ontologies and that inherits all
the flaws belonging to the classification.
For the purpose of the DSS, the developed ontology relies on the generic qualifiers and adopts
the whole “Body Functions”, “Body Structures”, and “Activity and Participation” components (up to
fourth level items).
1. Elderly characterized by frailty—a persona that comprises men or women of 65 or more years
old, characterized by unstable health condition and by one (or more) of these four criteria:
(1) Involuntary loss of weight of 4.5 kg in the last year; (2) asthenia or sense of fatigue for at least
three days in a week; (3) limited physical activity and sedentary life style; (4) limited walking
speed, with a time required to cover 4 m greater than 6 s [52].
2. User with visual impairments—people with a visual impairment that compromises (totally or
partially) their social and working activity.
3. User with hearing impairments—this persona includes people characterized by a partial or total
hearing loss.
85
Electronics 2018, 7, 179
86
Electronics 2018, 7, 179
Clinical personnel involved in the projects tried to refer to the minimum amount of ICF domains
to provide a proper description of the two personae’s health conditions; for the codes involving
Activity and participation domains, the qualifier choice was limited to the first (indicating how a
person performs activities inside their environments and with devices such as glasses, cane, etc.).
In Silvia’s last code the full set of Body Structures qualifiers was used to represent that fact that the
problem affects both of her arms. It is here intended that domains not specified in the above lists are
not interested by any form of impairment.
• It is the room that can benefit most from AAL tailored solutions [54];
• It is the place where older people suffer from most domestic injuries [55];
• It is where one of the Instrumental Activities of Daily Living takes place (meal preparation) [7].
The following is the description of the use case related to the reconfiguration of the kitchen.
In the use case a designer is required to design the kitchens using a Decision Support System able
to select the most suitable appliances for the two end-users, who are specifically:
Both users are characterized by moderate impairments that could jeopardize their safety and
make their activities strenuous in the kitchen. The designer acquires the user’s kitchens blueprints and
the users’ health conditions, via an application; users’ sensible data (address, health conditions) cannot
be seen directly by the designer, who can only see an aggregate information, such as a string reporting
“user with moderate visual impairment” or “user characterized by mild frailty”; the designer elaborates
virtual models of the two kitchens. In these models, the individual can place the most suitable
appliances to cope with the users’ impairment(s), such as an oven, refrigerator, cooktop, dishwasher
and useful sensors (e.g., air quality detection, user’s presence detection, luminance measurement),
choosing them from a list. This list is the result of the activities of the DSS (an ontology-based reasoning
process), which (according to the users’ health conditions) automatically selects from the catalogues
of appliances only those options that are suitable to improve end-users’ autonomy. At the end of the
design phase, the designer can save the kitchens’ reconfiguration projects. During the reconfiguration
the designer meets the users for who the reconfiguration projects are designed; the individual can
discuss with them the choices of appliances and (according to their feedbacks) modify such choices.
Then the designer can save again the project and export it in a construction drawing format.
In this use case the designer selects the most suitable appliance options together with the end-users
of the reconfigured environment, so that dwellers’ desires in terms of appliances’ functionalities,
interaction modalities and aesthetical characteristics (color, shape, etc.) can be met.
87
Electronics 2018, 7, 179
88
Electronics 2018, 7, 179
The final task foresees the extraction of the terminology from the CQs and their answers to form a
pre-glossary of terms. These terms were later formally represented into the ontology, in the form of
concepts, instances and relationships. The terms with a higher frequencies highlight the domains for
which an activity of research of existing or reusable knowledge sources must be conducted.
89
Electronics 2018, 7, 179
project’s needs. In the following paragraphs, the chosen approaches are specified for each module.
The ontology was developed in English. The reusable ontologies identified following this methodology
was one: The ICF Ontology [49].
90
Electronics 2018, 7, 179
Figure 3. An excerpt of the modelling of Giovanni’s health condition; individuals are represented with
diamonds, concepts are represented with circles, and roles are represented with arrows (dashed arrows
indicate datatype properties, full-line arrows represent object properties). The type of an individual is
stated with a curved arrow.
The TBox provides a description of the user’s “Health Condition”, allowing to distinguish them
among “Vision Impaired Health Condition”, “Motor Impaired Health Condition”, “Hearing Impaired
Health Condition”, and “Cognitive Impaired Health Condition”. For each of these subclasses, a further
sub-classification regarding the grade of impairment is provided according to ICF qualifiers, as shown
in Figure 4.
A dweller is linked to the individual’s health condition through the object property
“hasHealthCondition” and each health condition is associated with a dateTime Stamp value through
the datatype property “isAssessedOnDate”; in this way it is possible to keep track of the evolution of a
dweller’s physical and physiological status over time.
Figure 4. An excerpt of the classification of dwellers and their health conditions (concepts are
represented with circles). HC, health condition; w/, with; imp., impairment.
91
Electronics 2018, 7, 179
4.3.2. Empirical Methodology for Populating the Appliances and Sensors Module
To populate the “Appliances and Sensors” module with instances, a group of experts (composed
by an architect, a designer and a biomedical engineer) was appointed to select a list of appliances and to
classify them as being suitable for particular categories of residents with impairments. The appliances
were selected by searching the main online vendors on the web for appliances designed for people
with disabilities. For an appliance to be evaluated by the group of experts, its webpage had to be
provided with the following information:
Full specifications for the appliance (dimensions, accessories, buttons and controls description,
power requirements and energy performances, programs installed):
The result of this search led to the inclusion of both ADA compliant (appliances compliant to
the Americans with Disabilities Act [68]) and non-ADA compliant appliances in the list, which is
composed of a total of 25 appliances (five ovens, five refrigerators, five cooktops, four dishwashers,
three washers, three microwave ovens; see Appendix A for the complete list).
The group identified the selected appliances according to at least one of these features:
• The appliance has (at least) a program that is able to help a person with a specific disability in
performing activities in the kitchen (cooking, cleaning, etc.);
• The appliance’s design features (colors, design, shape, etc.) makes it easy to use for people
with disabilities.
92
Electronics 2018, 7, 179
The 25 appliances found were then classified according to the benefit(s) they can supply: The group
worked to empirically assess whether an appliance was able to help the resident to cope with one or
more of their impairments, selecting specific ICF domains where appliance’s features could enhance
the performing of activities or mitigate a disability. For instance, cooktops characterized by large
button controls, digital and wide backlit display, high contrast design (such as a dark-colored surface
with bright-colored controls) have been classified as somehow helpful for people with specific visual
impairments (b21002, b21000 for the acuity of near/distant vision). Lift ovens, whose door opens
following a vertical movement, can be particularly suited for wheelchair users (thus helping users with
impairments in the structures specified in “s120 Spinal cord and related structures”, “s110 Structure
of brain” and in the functions specified in the codes from “b760 Control of voluntary movement
functions” to “b780 Sensations related to muscles and movement functions”); nonetheless, this type
of oven can help people who cannot bend (“d4105 Bending”) or suffers from muscular problems
(b7300, b7356).
The impossibility to physically evaluate each specimen of the selected appliances led to the
application of the empirical methodology described above. By relying merely on manufacturer
provided information, the DSS’s knowledge base can be incremented by applying the same
methodology to appliances not previously enlisted. The group of experts substantially acted as
prospects (persons motivated to purchase an item) usually do when they want to purchase an appliance:
They search information on the products (on the internet or in stores) they are interested in, but only
rarely they can test it (contrary to automotive industry, home appliance industry does not allow to test
the products before purchasing them).
Appliances’ assessment has been conducted assuming that all appliances have to be installed in a
house following the appropriate specifications and expedients, which means for example that in order
for a lift oven to be of some advantage for a wheelchair user, the appliance must be installed taking
into account the user’s height on their wheelchair (the height can indeed vary according to the type of
wheelchair adopted and its settings).
The results of this work make use of a specific object property (“helpsCopingWith”), to state where
an appliance can provide support for specific impairments, as illustrated in the following Figure 5.
Figure 5. An example of an oven, classified as helpful for dwellers with motor impairments. Individuals
are represented with diamonds, concepts are represented with circles, and roles are represented with
arrows. The type of an individual is stated with a curved arrow, while datatype properties are collected
under the square bracket.
93
Electronics 2018, 7, 179
Evidently an appliance can be classified as suitable to help different categories of dwellers with
disabilities, thus belonging to two or more of the subclasses discussed above.
Sensors can also be classified following a similar approach. For instance, smoke and gas
detectors can be helpful for people whose sense of smell is compromised (“b255 Smell functions”),
while luminance sensors can be used to assess the environmental conditions for individuals with
vision-related impairments. Sensors do not take advantage of the “helpsCopingWith” object property
since they provide measurements and observations that can be used to monitor the safety and the
quality of the environment regardless of the user.
To further classify the health condition according to the value of the generic qualifier, a set of rules
is specified; the following SWRL rule specifies the conditions for which a health condition is inferred
to suffer for a moderate vision-related impairment:
Classes, described in Section 4.2.2, are further detailed with the use of OWL restrictions, as the
following excerpt in XML/RDF syntax [70] illustrates:
94
Electronics 2018, 7, 179
<owl:Class rdf:id=“DwellerWithVisionImpairment”>
<owl:equivalentClass>
<owl:Restriction>
<owl:onProperty rdf:resource=“#hasHealthCondition” />
<owl:someValuesFrom
rdf:resource=“#HealthConditionWithVisualImpairment” />
</owl:Restriction>
</owl:equivalentClass>
</owl:Class>
Once the residents are classified according to their health condition, it is possible to retrieve a list
of appliances that have been classified as able to help dwellers to cope with some of their impairments.
This matching can be performed with a set of SWRL rules, like the following one, which is associated
with appliances to a specific health condition with visual impairments:
This rule allows each appliance recognized as helping residents in coping with a specific
impairment of their health condition to be linked to the dwellers via the object property
“suitableApplianceFor”.
The application ontology, uploaded on a semantic repository, can be queried using the SPARQL
Protocol and RDF Query Language (SPARQL) [23]. In this way, it is possible to retrieve the results
inferred by the reasoner with a simple SPARQL query like the following:
PREFIX r: <http://www.stiima.cnr.it/RecAAL/>
SELECT ?appliance~WHERE
{?appliance r:isSuitableFor r:Silvia }.
Querying with SPARQL also allows to retrieve the list of all appliances belonging to specific
classes, retrieve the list of residents with specific impairments, the list of programs and details specified
for each appliance.
95
Electronics 2018, 7, 179
Figure 6. A snapshot of the RecALL: The designer selects the resident for which the reconfiguration
project is executed. Once the resident is selected, SPARQL queries interrogate the knowledge base to
retrieve the appliances suitable for the chosen resident, according to their health condition.
Figure 7. A snapshot of RecAAL: The designer chooses the appliance from those suggested by the
Decision Support System (DSS), as suitable for the resident.
The designer can also select sensors to be installed in the kitchen. The list of sensors selected
appears on the blackboard (as illustrated in Figure 8). At the end of the reconfiguration activity,
the reconfigured project can be saved, and can be saved in the semantic knowledge base with a
SPARQL query inserting a new project or modifying an existing one.
96
Electronics 2018, 7, 179
Figure 8. A snapshot of RecAAL: The list of sensors selected during the reconfiguration process is
shown on the blackboard in the 3D environment.
• Technology Acceptance Model 2 (TAM2) questionnaire [72]—the original version of TAM aimed
at assessing how a user come to accept and use a certain technology, through the evaluation of its
perceived usefulness and its perceived ease of use [73]. With the respect to this first version, TAM2
has been extended to evaluate technology acceptance also in terms of social influence (subjective
norm, voluntariness, and image) and cognitive instrumental (job relevance, output quality, result
demonstrability, and perceived ease of use) processes. All the questionnaire’s items are assessed
using a 7-point Likert scale, ranging from 1 (“strongly disagree”) to 7 (“strongly agree”).
• System Usability Scale (SUS) [74]—it consists of a ten-item questionnaire with five response
options for respondents (from 1, “strongly disagree” to 5, “strongly agree”). SUS allows evaluating
a wide variety of products and services in terms of user-friendliness, consistency, ease in learning
their functioning, cumbersomeness.
• Section C of Mobile App Rating Scale (MARS) [75]—the rating scale assesses app quality on four
dimensions, i.e., engagement, functionality, aesthetics, information. In this case, the evaluation
was limited to the graphical aspects (Section C). All items are rated on a 5-point scale from 1
“Inadequate” to 5 “Excellent”.
5.2. Results
97
Electronics 2018, 7, 179
not require a lot of my mental effort”), 9 (“I find the system to be easy to use”), and 10 (“I find it
easy to get the system to do what I want it to do”), belonging to the “Perceived Ease of Use” scale.
Lower scores are reported for items 11 (“In my job, usage of the system is important”), and 14 (“I have
no problem with the quality of the system’s output”.) They correspond to the “Job Relevance” and
“Output Opportunity” scales (Table 2).
Table 2. The results of the administered Technology Acceptance Model 2 (TAM2) questionnaire.
Figure 9. A representation of System Usability Scale (SUS): The red arrow indicates RecAAL’s score.
98
Electronics 2018, 7, 179
Table 3. The results of the administer Mobile App Rating Scale (MARS)_section C test.
• Low readability of appliances names because of the small font (five subjects);
• User needs or clinical condition are not made explicit in the application when the designer starts
the reconfiguration project (four subjects);
• Lack of residents customized icon (three subjects);
• Dweller choice is not well shown (three subjects);
• Concerns related to a low understanding of the logical link between residents and appliances
choices—without a preliminary explanation (three subjects);
• Redundant icons on the appliance choice menu (two subjects);
• Need for emphasizing appliances when the cursor hovers over one of the selectable options
(three subjects).
5.3. Discussion
Applied technology research uses extensively models of Technology Acceptance in order to
predict the intended use. In particular, TAM was used in many works in order to examine acceptance
of different technologies [77]. Regarding the DSSs evaluation, TAM model has been used to understand
acceptance inclination of manager’s in business organization [78]; evaluation of a DSS is also conducted
in Reference [79], where a sample of airline companies’ employees assessed the benefits deriving from
the use of a DSS. Other examples of DSS evaluation with TAM can be traced in research fields related
to the planning of environmental development [80] and to the clinical setting [81,82]. The authors
of this work are not aware of any study that measures TAM’s variables in a DSS designed for AAL.
Moreover, since DSSs’ interface plays a pivotal role in technology acceptance, and it constitutes the
only means through which the operator exploits the system, a comparison with similar systems is
not possible.
Generally, we can observe that DSS technologies are well accepted by users working in
professional fields, especially if they are designed to help in specific phases of the work. In accordance,
our tool received positive evaluations at the overall score and, in particular at the scales that are
most considered (i.e., “Perceived Usefulness” and “Perceived ease of use”). The SUS score was 72.5
(SD = 9.61), corresponding to a borderline level between “Marginal” and “Acceptable” according
to the Acceptability ranges, and between the “Ok” and “Good” Adjective ratings. For this reason,
enhancements are necessary. Finally, overall mean score at the section C of MARS was 3.38 (SD = 0.25),
corresponding to the median value of the Likert scale, which corresponds to “satisfaction with few
problems”; “moderate quality graphics aspects” and “average visual appeal”. It is evident that some
graphics aspects are to be reviewed and modified.
Subjects’ comments noted during test session are relevant to deepen emerged issues and to
understand which improvements are to be carried out. Small font used to indicate of appliances’ name
and resident’s characteristics should be enlarged with attention to the color contrast; dwellers’ icons
customization should be allowed. Subjects emphasized the need to make explicit clinical conditions of
99
Electronics 2018, 7, 179
the dwellers, during the initial configuration phase. Logical links between dwellers and appliances
choices must be explicitly stated. Other improvable graphics aspects are: Emphasizing appliances
when the cursor hovers over them, and eliminating redundant icons from the menu.
100
Electronics 2018, 7, 179
Since the DSS’s aim is to suggest appliances for the reconfiguration of different domestic
environments (not limited to the kitchen) an extension of the ontology should encompass also
describing the appliances’ location; reconfiguration projects that tackles two or more rooms could
benefit from a formal description of the environments. To this purpose, DogOnt [89] can provide the
means to describe how a domestic environment is composed (including architectural elements and
furniture) and the location of the various devices in the home.
RecAAL’s DSS could therefore benefit from the application of Machine Learning (ML) techniques
to populate the appliances’ ABox: Trying to automatically classify the appliances according to a set of
appliances already classified by experts can, from the one hand, increase the number of individuals,
while on the other hand can speed up application ontology’s population process.
Another application of ML techniques can concern the possibility to classify the appliances,
not only as suitable for some specific impairments, but also to the severity of the impairments.
In RecAAL, the selection of an appliance from the suggested list is performed by the designer together
with the resident; by exploiting ML to further classify appliances according also to the magnitude of the
impairments they can help coping with, the designer can potentially have a more limited—but more
fitting—selection to choose from. This approach requires anyway clinical personnel to supervise the
results generated from the automatic classification performed by ML techniques, since the complete
automation of this classification process involves a sensitive domain—people with impairments
everyday life and habits.
101
Electronics 2018, 7, 179
Additionally, the list of appliances could be flanked with a list of kitchen aids (such as cutting
boards and tools for slicing foods designed for one-handed people, automatic and/or electric can
openers, ergonomic peelers, etc.). These tools should undergo the same evaluation from a group of
experts to be classified conveniently and may require the full extent of ICF “Body Structures” qualifiers
to specify the type of disability the tools can mitigate; for this case, the DSS’s application ontology
already provides the means to support this kind of body structures-related descriptions.
Finally, dwellers’ feedback regarding their experiences with the appliances selected and installed
in their houses can constitute a validation means for experts’ group work, helping in better defining
the classification methodology, illustrated in Section 4.3.2. Residents’ feedbacks can potentially be
organized in a semantic knowledge base to be integrated to the original RecALL’s ontology.
7. Conclusions
In this work, the development of a Decision Support System (DSS) for the reconfiguration of
a domestic environment is presented; while most of AAL solutions rely on complex systems and
architectures, the DSS suggests a set of appliances to support residents affected by mild or moderate
disabilities, thus enabling a simpler reconfiguration of living environments. The development process
starts with the identification of specific residents, elderlies affected by impairments related to ageing
and users affected by sensory or motor systems pathologies. To define the health condition of the
residents, the International Classification of Functioning, Disability and Health (ICF) was selected as a
standard tool able to ease communication among clinical and non-clinical stakeholders.
The DSS relies on a semantic application ontology, whose development is performed following
the NeOn Methodology; the application ontology reuses ICF’s ontology and develops other parts from
scratch. The result of this process is an application ontology that takes into account the residents’ health
status and providing the means to describe the appliances to be placed within the reconfiguration
process. Reasoning with the DSS allows to match residents with a set of appliances able to help them
to cope with their impairments.
The DSS constitutes the base of the RecAAL application, which replicates the resident domestic
environments in a 3D model; in this model a designer can select and place the appliances according to
the results generated by reasoning process, then he can save the reconfiguration project.
Further works foresee the possibility to enhance some aspects of the DSS and the RecAAL
application, by applying ML techniques for the automatic classification of appliances and kitchen aids.
Author Contributions: D.S. designed the study, developed the ontology and RecAAL, wrote the first draft of the
manuscript. M.S. contributed to the development of RecAAL and revised the manuscript.
Funding: This work has been founded by “Convenzione Operativa No. 19365/RCC” in the framework of the
project “Future Home for Future Communities”.
Acknowledgments: Authors would like to acknowledge the contribution of the group of experts, who cooperated
to the classification of the 25 test appliances used to develop the Decision Support System.
Conflicts of Interest: The authors declare no conflict of interest.
102
Appendix A
Electronics 2018, 7, 179
103
Figure A1. A recapitulatory schema of the work conducted by the expert group on a set of 25 appliances.
Electronics 2018, 7, 179
References
1. Giannakouris, K. Ageing characterises the demographic perspectives of the European societies. Stat. Focus
2008, 72, 2008.
2. Christensen, K.; Doblhammer, G.; Rau, R.; Vaupel, J.W. Ageing populations: The challenges ahead. Lancet
2009, 374, 1196–1208. [CrossRef]
3. Chan, M.; Campo, E.; Estève, D.; Fourniols, J.Y. Smart homes—Current features and future perspectives.
Maturitas 2009, 64, 90–97. [CrossRef] [PubMed]
4. Demiris, G.; Rantz, M.J.; Aud, M.A.; Marek, K.D.; Tyrer, H.W.; Skubic, M.; Hussam, A.A. Older adults’
attitudes towards and perceptions of “smart home”technologies: A pilot study. Med. Inf. Internet Med. 2004,
29, 87–94. [CrossRef] [PubMed]
5. Demiris, G.; Hensel, B.K.; Skubic, M.; Rantz, M. Senior residents’ perceived need of and preferences for
“smart home” sensor technologies. Int. J. Technol. Assess. Health Care 2008, 24, 120–124. [CrossRef] [PubMed]
6. Courtney, K.L. Privacy and Senior Willingness to Adopt Smart Home Information Technology in Residential
Care Facilities. Available online: http://hdl.handle.net/1828/6616 (accessed on 7 August 2018).
7. Katz, S. Assessing self-maintenance: Activities of daily living, mobility, and instrumental activities of daily
living. J. Am. Geriatr. Soc. 1983, 31, 721–727. [CrossRef] [PubMed]
8. Åkesson, K.P.; Bullock, A.; Rodden, T.; Koleva, B.; Greenhalgh, C. A Toolkit for User Re-Configuration of
Ubiquitous Domestic Environments. Available online: http://citeseerx.ist.psu.edu/viewdoc/download?
doi=10.1.1.120.7276&rep=rep1&type=pdf (accessed on 7 August 2018).
9. Humble, J.; Crabtree, A.; Hemmings, T.; Åkesson, K.P.; Koleva, B.; Rodden, T.; Hansson, P. Playing with
the BitsUser-configuration of Ubiquitous Domestic Environments. In Proceedings of the International
Conference on Ubiquitous Computing, Seattle, WA, USA, 12–15 October 2003; pp. 256–263.
10. Criel, J.; Geerts, M.; Claeys, L.; Kawsar, F. Empowering elderly end-users for ambient programming:
The tangible way. In Proceedings of the International Conference on Grid and Pervasive Computing, Oulu,
Finland, 11–13 May 2011; pp. 94–104.
11. Giner, P.; Cetina, C.; Fons, J.; Pelechano, V. Building self-adaptive services for ambient assisted living.
In Proceedings of the International Work-Conference on Artificial Neural Networks, Salamanca, Spain,
10–12 June 2009; pp. 740–747.
12. Ruiz-López, T.; Rodríguez-Domínguez, C.; Noguera, M.; Garrido, J.L. Towards a reusable design of a
positioning system for AAL environments. In Proceedings of the International Competition on Evaluating
AAL Systems through Competitive Benchmarking, Lecce, Italy, 26 September 2011; pp. 65–79.
13. Design for All. Project Website. Available online: www.d4all.eu (accessed on 7 August 2018).
14. Future Home for Future Communities. Project Website. Available online: www.fhffc.it (accessed on 7
August 2018).
15. Blomqvist, E. The use of Semantic Web technologies for decision support—A survey. Semant. Web 2014,
5, 177–201.
16. Cheung, K.H.; Prud’hommeaux, E.; Wang, Y.; Stephens, S. Semantic Web for Health Care and Life Sciences:
A review of the state of the art. Eur. PMC 2009. [CrossRef] [PubMed]
17. Liaw, S.T.; Taggart, J.; Yu, H.; de Lusignan, S.; Kuziemsky, C.; Hayen, A. Integrating electronic health
record information to support integrated care: Practical application of ontologies to improve the accuracy of
diabetes disease registers. J. Biomed. Inf. 2014, 52, 364–372. [CrossRef] [PubMed]
18. Xu, B.; Xu, L.D.; Cai, H.; Xie, C.; Hu, J.; Bu, F. Ubiquitous data accessing method in IoT-based information
system for emergency medical services. IEEE Trans. Ind. Inf. 2014, 10, 1578–1586.
19. Khan, W.A.; Khattak, A.M.; Hussain, M.; Amin, M.B.; Afzal, M.; Nugent, C.; Lee, S. An adaptive semantic
based mediation system for data interoperability among health information systems. J. Med. Syst. 2014,
38, 28. [CrossRef] [PubMed]
20. Shaban-Nejad, A.; Lavigne, M.; Okhmatovskaia, A.; Buckeridge, D.L. PopHR: A knowledge-based platform
to support integration, analysis, and visualization of population health data. Ann. N. Y. Acad. Sci. 2017,
1387, 44–53. [CrossRef] [PubMed]
21. Ullah, F.; Habib, M.A.; Farhan, M.; Khalid, S.; Durrani, M.Y.; Jabbar, S. Semantic interoperability for big-data
in heterogeneous IoT infrastructure for healthcare. Sustain. Cities Soc. 2017, 34, 90–96. [CrossRef]
104
Electronics 2018, 7, 179
22. Pan, J.Z. Resource description framework. In Handbook on Ontologies; Springer: Berlin, Germany, 2009;
pp. 71–90.
23. Pérez, J.; Arenas, M.; Gutierrez, C. Semantics and Complexity of SPARQL. In Proceedings of the International
Semantic Web Conference, Athens, GA, USA, 5–9 November 2006; pp. 30–43.
24. del Carmen Legaz-García, M.; Martínez-Costa, C.; Menárguez-Tortosa, M.; Fernández-Breis, J.T. A semantic
web based framework for the interoperability and exploitation of clinical models and EHR data. Knowl.-Based
Syst. 2016, 105, 175–189. [CrossRef]
25. Gomez, J.; Oviedo, B.; Zhuma, E. Patient monitoring system based on internet of things. Procedia Comput. Sci.
2016, 83, 90–97. [CrossRef]
26. Datta, S.K.; Bonnet, C.; Gyrard, A.; Da Costa, R.P.F.; Boudaoud, K. Applying Internet of Things
for personalized healthcare in smart homes. In Proceedings of the 2015 24th Wireless and Optical
Communication Conference (WOCC), Taipei, Taiwan, 23–24 October 2015; pp. 164–169.
27. Bikakis, A.; Patkos, T.; Antoniou, G.; Plexousakis, D. A survey of semantics-based approaches for context
reasoning in ambient intelligence. In Proceedings of the European Conference on Ambient Intelligence,
Darmstadt, Germany, 7–10 November 2007; pp. 14–23.
28. Osman, T.; Lotfi, A.; Langensiepen, C.; Chernbumroong, S.; Saeed, M. Semantic-based decision support for
remote care of dementia patients. In Proceedings of the 2014 IEEE Symposium on Intelligent Agents (IA),
Orlando, FL, USA, 9–12 December 2014; pp. 89–96.
29. Horrocks, I.; Patel-Schneider, P.F.; Boley, H.; Tabet, S.; Grosof, B.; Dean, M. SWRL: A Semantic Web Rule
Language Combining OWL and RuleML. Available online: http://www.daml.org/swrl/proposal/rules-all.
html (accessed on 6 August 2018).
30. Zentek, T.; Marinc, A.; Rashid, A. Methods and tools for ontology-based configuration processes of AAL
environments. In Ambient Assisted Living; Springer: Berlin, Germany, 2014; pp. 213–224.
31. Zhang, Y.F.; Gou, L.; Tian, Y.; Li, T.C.; Zhang, M.; Li, J.S. Design and development of a sharable clinical
decision support system based on a semantic web service framework. J. Med. Syst. 2016, 40, 118. [CrossRef]
[PubMed]
32. Fotopoulou, E.; Zafeiropoulos, A.; Terroso-Sáenz, F.; Simsek, U.; González-Vidal, A.; Tsiolis, G.; Gouvas, P.;
Liapis, P.; Fensel, A.; Skarmeta, A. Providing personalized energy management and awareness services for
energy efficiency in smart buildings. Sensors 2017, 17, 2054. [CrossRef] [PubMed]
33. Fensel, A.; Tomic, D.K.; Koller, A. Contributing to appliances’ energy efficiency with Internet of Things,
smart data and user engagement. Future Gener. Comput. Syst. 2017, 76, 329–338. [CrossRef]
34. Madrazo, L.; Massetti, M.; Sicilia, A.; Wadel, G.; Ianni, M. SEíS: A semantic-based system for integrating
building energy data. Informes de la Construcción 2015, 67, 11. [CrossRef]
35. Bonino, D.; Corno, F.; De Russis, L. Poweront: An ontology-based approach for power consumption
estimation in smart homes. In Internet of Things. User-Centric IoT; Springer: Berlin, Germany, 2015; pp. 3–8.
36. Huang, C.C.; Liu, A.; Zhou, P.C. Using ontology reasoning in building a simple and effective dialog system
for a smart home system. In Proceedings of the 2015 IEEE International Conference on Systems, Man, and
Cybernetics, Kowloon, China, 9–12 October 2015; pp. 1508–1513.
37. Ni, Q.; de la Ivan, P.; García Hernando, A.B. A foundational ontology-based model for human activity
representation in smart homes. J. Ambient Intell. Smart Environ. 2016, 8, 47–61. [CrossRef]
38. Hardie, G.J. ACC0SSible EnVirOnments TOWard Universal Design. In Design Intervention (Routledge Revivals):
Toward a More Humane Architecture; Van Nostrand Reinhold: Washington, DC, USA, 2015.
39. Organization, W.H. International classification of functioning, disability and health: ICF. In World Health
Organization; World Health Organization: Geneva, Switzerland, 2001.
40. Arlati, S.; Spoladore, D.; Mottura, S.; Zangiacomi, A.; Ferrigno, G.; Sacchetti, R.; Sacco, M. Architecture of a
virtual reality and semantics-based framework for the return to work of wheelchair users. In Proceedings of
the International Conference on Augmented Reality, Virtual Reality and Computer Graphics, Ugento, Italy,
12–15 June 2017; pp. 74–85.
41. Spoladore, D. Ontology-based decision support systems for health data management to support collaboration
in ambient assisted living and work reintegration. In Proceedings of the Working Conference on Virtual
Enterprises, Vicenza, Italy, 18–20 September 2017; pp. 341–352.
42. Okochi, J.; Utsunomiya, S.; Takahashi, T. Health measurement using the ICF: Test-retest reliability study of
ICF codes and qualifiers in geriatric care. Health Qual. Life Outcomes 2005, 3, 46. [CrossRef] [PubMed]
105
Electronics 2018, 7, 179
43. Freedman, V.A. Adopting the ICF language for studying late-life disability: A field of dreams? J. Gerontol.
Ser. A Biomed. Sci. Med. Sci. 2009, 64, 1172–1174. [CrossRef] [PubMed]
44. Buono, S.; Zagaria, T. ICF-Classificazione Internazionale del funzionamento, della Disabilità e della Salute.
Ciclo Evolutivo e Disabilità/Life Span Disabil. 2003, 6, N1.
45. Scherer, M.J.; Craddock, G.; Mackeogh, T. The relationship of personal factors and subjective well-being to
the use of assistive technology devices. Disabil. Rehabil. 2011, 33, 811–817. [CrossRef] [PubMed]
46. Andronache, A.S.; Simoncello, A.; Della Mea, V.; Daffara, C.; Francescutti, C. Semantic aspects of the
International Classification of Functioning, Disability and Health: Towards sharing knowledge and unifying
information. Am. J. Phys. Med. Rehabil. 2012, 91, S124–S128. [CrossRef] [PubMed]
47. Della Mea, V.; Simoncello, A. An ontology-based exploration of the concepts and relationships in the activities
and participation component of the international classification of functioning, disability and health. J. Biomed.
Semant. 2012, 3, 1. [CrossRef] [PubMed]
48. Kumar, A.; Smith, B. The ontology of processes and functions: A study of the international classification
of functioning, disability and health. In Proceedings of the AIME 2005 Workshop on Biomedical Ontology
Engineering, Aberdeen, UK, 23–27 July 2005.
49. BioPortal. International Classification of Functioning, Disability and Health Ontology. Available online:
https://www.bioportal.bioontology.org/ontologies/ICF (accessed on 5 August 2018).
50. Cooper, A. The Inmates Are Running the Asylum: [Why High-Tech Products Drive Us Crazy and How to Restore
the Sanity]; Sams Indianapolis: Indianapolis, IN, USA, 2004.
51. Pruitt, J.; Grudin, J. Personas: Practice and theory. In Proceedings of the 2003 Conference on Designing for
User Experiences, San Francisco, CA, USA, 6–7 June 2003; pp. 1–15.
52. Fried, L.P.; Tangen, C.M.; Walston, J.; Newman, A.B.; Hirsch, C.; Gottdiener, J.; Seeman, T.; Tracy, R.; Kop, W.J.;
Burke, G. Frailty in older adults: Evidence for a phenotype. J. Gerontol. Ser. A Biol. Sci. Med. Sci. 2001,
56, 146–157. [CrossRef]
53. Gauthier, S.; Reisberg, B.; Zaudig, M.; Petersen, R.C.; Ritchie, K.; Broich, K.; Belleville, S.; Brodaty, H.;
Bennett, D.; Chertkow, H. Mild cognitive impairment. Lancet 2006, 367, 1262–1270. [CrossRef]
54. Blasco, R.; Marco, Á.; Casas, R.; Cirujano, D.; Picking, R. A smart kitchen for ambient assisted living. Sensors
2014, 14, 1629–1653. [CrossRef] [PubMed]
55. Angermann, A.; Bauer, R.; Nossek, G.; Zimmermann, N. Injuries in the European Union: Statistics Summary
2003–2005; Eurosafe, KFV: Vienna, Austria, 2007.
56. Gruber, T.R. A translation approach to portable ontology specifications. Knowl. Acquis. 1993, 5, 199–220.
[CrossRef]
57. Menzel, C. Reference Ontologies-Application Ontologies: Either/Or or Both/And? Available online: http:
//ceur-ws.org/Vol-94/ki03rao_menzel.pdf (accessed on 6 August 2018).
58. Fernández-López, M.; Gómez-Pérez, A. Overview and analysis of methodologies for building ontologies.
Knowl. Eng. Rev. 2002, 17, 129–156. [CrossRef]
59. Suárez-Figueroa, M.C.; Gómez-Pérez, A.; Fernández-López, M. The NeOn methodology for ontology
engineering. In Ontology Engineering in a Networked World; Springer: Berlin, Germany, 2012; pp. 9–34.
60. Fernández-López, M.; Gómez-Pérez, A.; Juristo, N. Methontology: From ontological art towards ontological
engineering. In Proceedings of the AAAI-97 Spring Symposium Series, Stanford, CA, USA, 24–26 March 1997.
61. Sure, Y.; Staab, S.; Studer, R. Ontology engineering methodology. In Handbook on Ontologies; Springer: Berlin,
Germany, 2009; pp. 135–152.
62. Suárez-Figueroa, M.C.; Gómez-Pérez, A.; Villazón-Terrazas, B. How to write and use the ontology
requirements specification document. In Proceedings of the OTM Confederated International Conference
On the Move to Meaningful Internet Systems, Vilamoura, Portugal, 1–6 November2009; pp. 966–982.
63. McGuinness, D.L.; Van Harmelen, F. OWL Web Ontology Language Overview. Available online: http:
//www.citeulike.org/group/2170/article/100176 (accessed on 6 August 2018).
64. Grüninger, M.; Fox, M.S. Methodology for the Design and Evaluation of Ontologies. Available online:
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.44.8723 (accessed on 7 August 2018).
65. Gangemi, A. Ontology design patterns for semantic web content. In Proceedings of the International
semantic web conference, Galway, Ireland, 6–10 November 2005; pp. 262–276.
106
Electronics 2018, 7, 179
66. Daniele, L.; den Hartog, F.; Roes, J. Created in close interaction with the industry: The smart appliances
reference (SAREF) ontology. In Proceedings of the International Workshop Formal Ontologies Meet
Industries, Berlin, Germany, 5 August 2015; pp. 100–112.
67. Compton, M.; Barnaghi, P.; Bermudez, L.; García-Castro, R.; Corcho, O.; Cox, S.; Graybeal, J.; Hauswirth, M.;
Henson, C.; Herzog, A. The SSN ontology of the W3C semantic sensor network incubator group. Web Semant.
Sci. Serv. Agents World Wide Web 2012, 17, 25–32. [CrossRef]
68. Act, D. Americans with Disabilities Act. Available online: https://www.ada.gov/ (accessed on 7
August 2018).
69. Sirin, E.; Parsia, B.; Grau, B.C.; Kalyanpur, A.; Katz, Y. Pellet: A practical owl-dl reasoner. Web Semant. Sci.
Serv. Agents World Wide Web 2007, 5, 51–53. [CrossRef]
70. Beckett, D.; McBride, B. RDF/XML Syntax Specification (Revised). Available online: http://citeseerx.ist.psu.
edu/viewdoc/download?doi=10.1.1.454.3972&rep=rep1&type=pdf (accessed on 7 August 2018).
71. Kim, S.L.; Suk, H.J.; Kang, J.H.; Jung, J.M.; Laine, T.H.; Westlin, J. Using Unity 3D to facilitate mobile
augmented reality game development. In Proceedings of the 2014 IEEE World Forum on Internet of Things
(WF-IoT), Seoul, Korea, 6–8 March 2014; pp. 21–26.
72. Venkatesh, V.; Davis, F.D. A theoretical extension of the technology acceptance model: Four longitudinal
field studies. Manag. Sci. 2000, 46, 186–204. [CrossRef]
73. Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology.
MIS Q. 1989, 319–340. [CrossRef]
74. Brooke, J. SUS-A quick and dirty usability scale. Usabil. Eval. Ind. 1996, 189, 4–7.
75. Stoyanov, S.R.; Hides, L.; Kavanagh, D.J.; Zelenko, O.; Tjondronegoro, D.; Mani, M. Mobile app rating scale:
A new tool for assessing the quality of health mobile apps. JMIR mHealth uHealth 2015, 3, e27. [CrossRef]
[PubMed]
76. Bangor, A.; Kortum, P.; Miller, J. Determining what individual SUS scores mean: Adding an adjective rating
scale. J. Usabil. Stud. 2009, 4, 114–123.
77. Casas, C.A. Factors That Determine Attitudes toward the Use Technology to Plan for Retirement:
An Empirical Analysis. Available online: https://academyfinancial.org/resources/Documents/
Proceedings/2010/6B-Casas.pdf (accessed on 7 August 2018).
78. Dulcic, Z.; Pavlic, D.; Silic, I. Evaluating the intended use of Decision Support System (DSS) by applying
Technology Acceptance Model (TAM) in business organizations in Croatia. Procedia-Soc. Behav. Sci. 2012,
58, 1565–1575. [CrossRef]
79. Alshibly, H.H. Investigating decision support system (DSS) success: A partial least squares structural
equation modeling approach. J. Bus. Stud. Q. 2015, 6, 56.
80. Adagha, O.; Levy, R.M.; Carpendale, S.; Gates, C.; Lindquist, M. Evaluation of a visual analytics
decision support tool for wind farm placement planning in Alberta: Findings from a focus group study.
Technol. Forecast. Soc. Chang. 2017, 117, 70–83. [CrossRef]
81. Grout, R.W.; Cheng, E.R.; Carroll, A.E.; Bauer, N.S.; Downs, S.M. A six-year repeated evaluation of
computerized clinical decision support system user acceptability. Int. J. Med. Inf. 2018, 112, 74–81. [CrossRef]
[PubMed]
82. Omar, A.; Ellenius, J.; Lindemalm, S. Evaluation of Electronic Prescribing Decision Support System at
a Tertiary Care Pediatric Hospital: The User Acceptance Perspective. In ITCH; IOS Press: Amsterdam,
The Netherlands, 2017; pp. 256–261.
83. Navas-Delgado, I.; Aldana-Montes, J.F. Data Integration: Introducing Semantics. In Handbook of Research on
Innovations in Database Technologies and Applications: Current and Future Trends; IGI Global: Hershey, PA, USA,
2009; pp. 460–470.
84. Noy, N.F. Ontology mapping. In Handbook on Ontologies; Springer: Berlin, Germany, 2009; pp. 573–590.
85. Elmenreich, W.; Khatib, T.; Monacchi, A. Smart Microgrids: Optimizing Local Resources toward Increased
Efficiency and a More Sustainable Growth. In Research and Development Evolving Trends and Practices-towards
Human, Institutional and Economic Sectors Growth; InTechOpen: Lodon, UK, 2017.
86. Sommaruga, L.; Perri, A.; Furfari, F. DomoML-env: An ontology for Human Home Interaction. In Proceedings
of the SWAP 2005—Semantic Web Applications and Perspectives, Trento, Italy, 14–16 December 2005; p. 166.
87. FIPA Ontology Service Specification 2000. Available online: http://www.fipa.org/specs/fipa00086/
XC00086C.html. (accessed on 1 August 2018).
107
Electronics 2018, 7, 179
88. Brickley, D.; Miller, L. FOAF Vocabulary Specification 0.91 2010. Available online: http://xmlns.com/foaf/
spec/ (accessed on 1 August 2018).
89. Bonino, D.; Corno, F. Dogont-ontology modeling for intelligent domotic environments. In Proceedings of
the International Semantic Web Conference, Karlsruhe, Germany, 26–30 October 2008; pp. 790–803.
90. World Population Prospects: The 2017 Revision, Key Findings and Advance Tables. Available online: https:
//www.esa.un.org/unpd/wpp/publications/files/wpp2017_keyfindings.pdf (accessed on 7 August 2018).
91. Clegg, A.; Young, J.; Iliffe, S.; Rikkert, M.O.; Rockwood, K. Frailty in elderly people. Lancet 2013, 381, 752–762.
[CrossRef]
92. Xue, Q.-L. The frailty syndrome: Definition and natural history. Clin. Geriatr. Med. 2011, 27, 1–15. [CrossRef]
[PubMed]
93. Organization, W.H. Universal Eye Health: A Global Action Plan 2014–2019; World Health Organization: Geneva,
Switzerland, 2013.
94. Bickenbach, J.; Cieza, A.; Rauch, A.; Stucki, G. ICF Core Sets: Manual for Clinical Practice for the ICF Research
Branch, in Cooperation with the WHO Collaborating Centre for the Family of International Classifications in Germany
(DIMDI); Hogrefe Publishing: Boston, MA, USA, 2012.
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
108
electronics
Article
An Unpowered Sensor Node for Real-Time Water
Quality Assessment (Humic Acid Detection)
Rashid Mirzavand 1, *, Mohammad Mahdi Honari 1 , Bahareh Laribi 2 , Behnam Khorshidi 3 ,
Mohtada Sadrzadeh 3 and Pedram Mousavi 1
1 Intelligent Wireless Technology Lab (IWTL), University of Alberta, Edmonton T6G 1H9, Canada;
[email protected] (M.M.H.); [email protected] (P.M.)
2 Li Ka Shing Centre for Health Research Innovation, University of Alberta, Edmonton T6G 2E1, Canada;
[email protected]
3 Advanced Water Research Lab (AWRL), University of Alberta, Edmonton T6G 1H9, Canada;
[email protected] (B.K.); [email protected] (M.S.)
* Correspondence: [email protected]; Tel.: +1-587-557-6800
Abstract: A zero-power microwave sensor is reported for the real-time assessment of water quality.
The proposed structure is able to transmit sensed data directly to a base-station without additional
data processing at the wireless sensor node (WSN) which results in less power consumption.
The base-station propagates a single tone signal at the frequency of f 0 /2. At the sensing node, an
antenna absorbs that signal and a passive frequency doubler makes its frequency twice, i.e., f 0 , which
will be used as the carrier signal. Two pairs of open-ended coaxial probes are used as liquid sensors;
one inside a known reference sample and the other one inside the water under test. A combination of
both sensors’ data will be sent to the base-station. A special six-port structure is used for modulation
of sensed data over the carrier. At the base-station, a receiver will demodulate the received signal for
extracting the sensed data. As an example, the system has been evaluated at f 0 = 2.45 GHz for the
detection of Humic-Acid levels as a common contaminant of river waters.
1. Introduction
Water crisis, according to the Global Risks Report by World Economic Forum in 2017,
is consistently among the top-ranked global risks since 2012 [1]. Improved technologies make water
harvesting possible from rainwater, seawater desalination, and industrial/municipal waste-waters,
even at homes [2,3]. These utilities are required to periodically monitor water quality. To prevent
unhealthy water usage, the automated in-line sensors are required to detect various pollutions [4,5].
However, most of these systems are not real-time and/or Internet of Things (IoT) compatible, as they
need special laboratory equipment. Using wireless sensor nodes and Internet of distributed water
systems are a step toward smarter cities [6–9]. A wireless sensor node (WSN) in a wireless network
senses a physical/chemical variation in a desired environment [10–12], analyze them, and transmit
the extracted data to a receiver which can be a mobile phone or a base-station [13]. In this regard,
the WSN usually has a small processing unit, one or more sensors, a telecommunication subsystem,
and a source of energy in the form of battery or energy harvesting module. A few un-powered sensor
systems were proposed which comprises receiving, frequency conversion, sensing, and transmitting
elements [14–16].
There are a couple of architecture reported for sensor nodes in the literature which usually
include radio frequency identification (RFID). The interferometry systems send a signal and measure
the reflection from sensor nodes by a direct conversion receiver [17–20]. The chip-based sensing
nodes have a separate sensor, a digitizer, and a direct conversion modulator [21,22]. Using chips
make multi-node networks possible but a higher received signal strength is required for powering-up
the sensor and micro-controller chips. The chipless structures in [23–26] work based on the shift in
the operating frequency. These frameworks are sensitive to the undesirable condition varieties that
change the frequency response of system and need an accurate frequency discovery at the receiver.
This detriment is a major point of confinement on the actualizing functional remote systems based
on these type of sensors. The six-port structures (SPS), as a vector modulator, only consists of some
passive elements [27–30] and is an ideal choice for a near-to-zero (N-zero) or zero-power systems.
The direct conversion sensors, as of late proposed in [31,32], need a signal generator and a power
source with the occasional support or trade necessities at the sensor node. Therefore, these kind of
nodes cannot be utilized in applications with restricted access or troubles for upkeep.
This paper proposes real-time water quality assessment using a Base-Station (BS) and sensor
nodes in a water harvesting system. The adaptive and switched-beam antenna at the BS makes an
exclusive connection with each node possible. The sensor node senses the effects of filter’s output
and reference sample on the reflection coefficients of open-ended coaxial probes, simultaneously.
This information can be used to determine the quality of filtered water. For systems with exchangeable
filters, the reference sample can be taken when the filter is new and works perfectly. After that,
the quality of filtering and thus the replacement time of the filter can be determined.
The proposed direct conversion sensor is based on the SPS that simplify the sensing system
by eliminating digitizer and integrating the sensor into the modulator. Using the vector modulator
eliminates the frequency up-converting chain and leads to a low-cost and straightforward realization
of modulation scheme for transmitting data. The introduced unpowered WSN comprises a dual-band
receiving/transmitting antenna, a frequency diplexer, a frequency doubler, a SPS, and two pairs of
open-ended coaxial probes for sensing in which one pair senses the desired variations in the water
under test (WUT) while the other one is in contact with the pure water, as a reference. These probes
provide broadband and non-destructive sensing of liquids. The variations in sensing parts modulate
the input signal and the reference data can be used in the calibration procedure of six-port receiver at
the BS.
For evaluation, the system has been implemented at the frequency of 2.45 GHz. As a common
contaminant sample, various concentrations of humic acid in water were used as the WUTs to resemble
dissolved organic matter in the river. The measurement results show that the proposed sensor node
can detect the level of pollution with a good accuracy.
110
Electronics 2018, 7, 231
For a WUT with permittivity of ε WUT , the reflection coefficient (ΓWUT ) of the open-ended line can be
represented by [33],
1 − jωZ0 ε WUT C0 + C f
ΓWUT = , (1)
1 + jωZ0 ε WUT C0 + C f
Figure 1. Schematic presentation of real-time water quality assessment: (a) A water sensor network;
(b) A sensor node; (c) Open-ended coaxial line sensing of water.
The proposed sensor node uses the same sensitive circuits for the WUT and reference samples.
The node consists of a six-port sensor, a dual-band antenna, a diplexer, and a frequency doubler,
as shown in Figure 2a. The antenna absorbs the transmitted signal of BS at f /2 and the diplexer
passes it to the frequency doubler. The output signal of the doubler is used as the input signal of the
SPS, at f . The output port of SPS is connected to the f branch of diplexer and transmits the output
modulated-signal back to the BS through the antenna. The other four ports of SPS are connected to two
111
Electronics 2018, 7, 231
pairs of open-ended coaxial line for sensing, as described previously. One pair senses the WUT while
the other one with a known sample is used as a reference for calibration procedure at the receiver.
Figure 2. Functional block diagrams of system’s sub-circuits: (a) The sensor node; (b) The base station;
(c) The six-port sensor; (d) The six-port receiver.
The modified SPS as a sensor node uses a 90◦ hybrid coupler, two pairs of variable reflectors
and one power combiner, as shown in Figure 2c. In the first stage, the input signal at port #1 (P1 ) is
quadrature divided between two branches, named by I- and Q-path. At each path, a pair of sensitive
structures reflects the signal at reflection ports, i.e., P3 , P4 , P5 , and P6 , while the phase and amplitude
of reflected signals change according to the WUT. The power combiner adds two reflected signals at
the output port P2 . Considering the SPS as a linear circuit with ideal power combiner (equal power
division with 0 degrees phase shift) and quadrature couplers (equal power division with 90 degrees
phase shift), its scattering parameters are related as follows,
where Smn is the reflected power waves from port m due to the incident power waves at port n, for n
and m from 1 to 6. Then, the reflection coefficient at the input (R11 ) and transmission from input to
output (T21 ) of SPS can be represented as,
112
Electronics 2018, 7, 231
Based on (3) and (4), the input reflection coefficient will be equal to zero (R11 = 0) if ΓRe f Γ3 = Γ4
and ΓWUT Γ5 = Γ6 . Then, the normalized transmission coefficient from the input to the output port (TN )
is simplified to:
1
TN 2 T21 = Γ Re f + jΓWUT , (6)
2S31
which is normalized to the known value of S31 . Hence, for a single tone input signal, the output signal
is composed of two reflected components, i.e., Γ Re f and jΓWUT , which are in a semi-orthogonal vector
space and easy to separate at the receiver.
3. Experimental Verification
The proposed system is evaluated at the power and data transmit frequencies of 1.225 GHz
and 2.45 GHz, respectively, as shown in Figure 3a. The circuits are fabricated with printed circuit
technology on Rogers’ RO4003 material with relative permittivity of 3.55, thickness of 0.508 mm,
and loss tangent of 0.0027. The antennas is fabricated on Rogers’ RT/duroid 5880 material with relative
permittivity of 2.2, thickness of 0.508 mm, and loss tangent of 0.0009.
An R&S ZVA67 (Rohde & Schwarz: Munich, BY, Germany) vector network analyzers is used for
reflection coefficient measurements. An ADF4350 (Analog Devices: Norwood, MA, USA) frequency
synthesizer generates both frequencies at the base station. An AD7605 (Analog Devices: Norwood, MA,
USA) data acquisition system converts received signals from analog to digital domain for demodulation
in a personal computer. The output power of transmitter was +5 dBm and distance between the sensor
node and base-station was selected as 1.5 m. The sensor is zero power but there is no critical limitation
on the power consumption of base-station. Therefore, the transmitted and received signals can be
113
Electronics 2018, 7, 231
amplified by a power amplifier (PA) and a low noise amplifier (LNA), respectively, to increase the
wireless coverage or improve the signal to noise ratio.
The detailed schematics of all sub-circuits are presented in Figure 3 with the dimensions provided
in Tables 1 and 2. A HSMS-2850 (Broadcom Inc.: San Jose, CA, USA) conventional diode and an open
stub are used to generate and filter the second harmonic of the input signal in the output branch.
A dual-band low-profile antennas [34] is designed to transmit and receive the frequencies of 1.225
GHz and 2.45 GHz. Figure 4 shows the implemented overall system, sensing node, receiver, diplexer,
the combined structure of diplexer and frequency doubler, and dual-band antenna.
Figure 3. Detailed schematic of designed circuits: (a) The six-port sensor; (b) The six-port receiver;
(c) The duplexer at sensor node including frequency doubler; (d) The dual band antenna.
The measured parameters of various parts are presented in Figure 5. The SPS provides the
acceptable transitions about −6 dB while its isolation and reflection coefficients are better than −10 dB,
at the operating frequency of 2.45 GHz. The required phase shifts of 0◦ and 90◦ in a conventional SPS
are also achieved, as shown in Figure 5a. The antenna response in Figure 5b shows that despite the
small size, it can be used in both frequencies with the acceptable gains (more than 1.7 dBi). The diplexer
has less than −0.5 dB loss in the pass bands and better than 15 dB isolation in the rejection bands for
both branches of 1.225 GHz and 2.45 GHz, as seen in Figure 5c. The performance of frequency doubler
in Figure 5d shows about 10 dB conversion loss from main to the second harmonic signals.
114
Electronics 2018, 7, 231
Figure 5. Cont.
115
Electronics 2018, 7, 231
To evaluate the sensor in the first step, the sensitive circuit has been tested to find its response
to various samples which will be used as the reference to calculate concentrations of contaminant
(CoC) in the water at the BS. The system is tested with three water samples with 5, 11, and 28 ppm
of humic acid and for each sample the measurements were repeated 10 times. A commercial humic
acid (Sigma-Aldrich, CAS no: 1415-93-6) was used in sample preparation. The amplitude and phase of
ΓWUT versus CoC are approximately linear, as can be seen in Figure 6a,b. These curves can be used at
the BS to extract the CoC from the calculated Γ R .
The calculated constellation at the BS for all samples and 10 times measurements are presented
in Figure 7. All data are normalized to a reference case which is obtained by using the pure water as
WUT. Using a nonlinear interpolation, we can fit a curve to the measurement points. The errors of
demodulated points, (I, Q)Dem , with the points on the fitted curve, (I, Q)Fit , can be defined as,
( IDem − IFit )2 + ( Q Dem − Q Fit )2
Error × 100%, (8)
2 + Q2
IFit Fit
116
Electronics 2018, 7, 231
Figure 7. Demodulated data at the receiver (I: real part, Q: imaginary part).
In the above measurements, errors are less than 4% for a laboratory test environment using
a +5 dBm transmitter at 1.225 GHz and about 1.5 m wireless range. Undoubtedly, this error depends
on the propagation channel conditions, such as propagation power, distance between transmitter and
receiver, and environmental noises.
In a real scenario, first, two similar volume of pure water are used as the test and the reference
samples. This test gives us a reference node which will be mapped to (1,1,0). Then, the test ports
will be put inside the WUT samples while the reference ports remain in the pure water. By using (7),
demodulated I and Q will be extracted from the received signal and normalized to the reference values.
The demodulated constellation point (I, Q)Dem will be mapped to Figure 7 and the concentration
of contaminant can be determined. In a water treatment system, a pre-defined level of pollution is
considered for water quality assessment and the proportional limit point, (I, Q)Lim , can be determined
for that level of pollution from the fitted curve. Then, the base station can simply compare (I, Q)Dem
with (I, Q)Lim and find if the water quality is acceptable or not. Therefore, the system provides a simple
real-time assessment without local power sources at the sensor node. This is true that some water
quality assessment systems can provide higher wireless ranges and various pollution detection but
they need very long processing times and periodic battery maintenances at the sensor nodes.
4. Conclusions
This paper proposed a zero-power direct conversion sensor. The six-port structure was used at
the node as a sensing data modulator and at the base station as the IQ data demodulator. The input
signal of this sensor was generated by a passive frequency doubler from a pure wave received from
the BS at f /2. A dual band antenna was used as the receiver of power-up signal at f /2 and transmitter
of modulated signal at f . As an example for validation, a system is fabricated at f = 2.45 GHz
and its results for various polluted water samples have been presented. The ability of sensing and
directly transmitting its data at the RF frequencies, without local power source and signal processing
at the node, expand applications of the proposed system as sensor nodes in real-time water quality
assessment with low complexity, power consumption, and cost. In this paper, the system was designed
and evaluated by using the conventional microwave structures and inexpensive printed circuit board
(PCB) technology. In the next step, the sensor nodes have been optimized and miniaturized for
mass production and WSN applications by using compact building blocks and integrated circuit
(IC) technologies. Moreover, the application can be extended to human body sensors for wireless
measurement of biological tissues [35].
Author Contributions: R.M. conceived design and experiments. M.M.H. assisted in experiments. B.L. and P.M.
participated in developing approach and methodology. B.K. and M.S. prepared the samples and assisted with
discussion and interpretation of results. All authors reviewed the manuscript.
117
Electronics 2018, 7, 231
Funding: This research was funded by NSERC-AITF industrial research chair program.
Conflicts of Interest: The authors declare no conflicts of interest.
Abbreviations
QPD Quadrature Power Divider
QPC Quadrature Power Coupler
PC Power Combiner
PD Power Detector
LPF Low Pass Filter
RSC Reference Sensitive Circuits
SSC Sample Sensitive Circuits
References
1. World Economic Forum. The Global Risks Report 2017; World Economic Forum: Geneva, Switzerland, 2017.
2. Allwood, G.; Wild, G.; Hinckley, S. Fiber bragg grating sensors for mainstream industrial processes.
Electronics 2017, 6, 92. [CrossRef]
3. Khorshidi, B.; Thundat, T.; Fleck, B.A.; Sadrzadeh, M. A novel approach toward fabrication of high
performance thin film composite polyamide membranes. Sci. Rep. 2016, 6, 22069. [CrossRef] [PubMed]
4. Park, S.J.; Hong, J.T.; Choi, S.J.; Kim, H.S.; Park, W.K.; Han, S.T.; Park, J.Y.; Lee, S.; Kim, D.S.; Ahn, Y.H.
Detection of microorganisms using terahertz metamaterials. Sci. Rep. 2014, 4, 4988. [CrossRef] [PubMed]
5. Højris, B.; Christensen, S.C.B.; Albrechtsen, H.-J.; Smith, C.; Dahlqvist, M. A novel, optical, on-line bacteria
sensor for monitoring drinking water quality. Sci. Rep. 2016, 6, 23935. [CrossRef] [PubMed]
6. Culler, D.E.; Mulder, H. Smart sensors to network the world. Sci. Am. 2004, 290, 84–91. [CrossRef] [PubMed]
7. Tucker, R.; Ruffini, M.; Valcarenghi, L.; Campelo, D.R.; Simeonidou, D.; Du, L.; Marinescu, M.-C.;
Middleton, C.; Yin, S.; Forde, T. Connected OFCity: Technology innovations for a smart city project.
IEEE/OSA J. Opt. Commun. Networking 2017, 9, A245–A255. [CrossRef]
8. Bouk, S.H.; Ahmed, S.H.; Kim, D.; Song, H. Named-data-networking-based ITS for smart cities.
IEEE Commun. Mag. 2017, 55, 105–111. [CrossRef]
9. Li, M.; Lin, H.-J. Design and implementation of smart home control systems based on wireless sensor
networks and power line communications. IEEE Trans. Ind. Electron. 2015, 62, 4430–4442. [CrossRef]
10. Im, H.; Lee, S.; Naqi, M.; Lee, C.; Kim, S. Flexible PI-Based Plant Drought Stress Sensor for Real-Time
Monitoring System in Smart Farm. Electronics 2018, 7, 114. [CrossRef]
11. Mirzavand, R.; Honari, M.M.; Mousavi, P. High-Resolution Balanced Microwave Material Sensor with
Extended Dielectric Range. IEEE Trans. Ind. Electron. 2017, 64, 1552–1560. [CrossRef]
12. Mirzavand, R.; Honari, M.M.; Mousavi, P. High-Resolution Dielectric Sensor Based on Injection-Locked
Oscillators. IEEE Sens. J. 2017, 18, 141–148. [CrossRef]
13. Donelli, M.; Manekiya, M. Development of Environmental Long Range RFID Sensors Based on the
Modulated Scattering Technique. Electronics 2018, 7, 106. [CrossRef]
14. Visser, H.J.; Vullers, R.J.M. RF energy harvesting and transport for wireless sensor network applications:
Principles and requirements. Proc. IEEE 2013, 101, 1410–1423. [CrossRef]
15. Huang, H.; Chen, P.-Y.; Hung, C.-H.; Gharpurey, R.; Akinwande, D. A zero power harmonic transponder
sensor for ubiquitous wireless μL liquid-volume monitoring. Sci. Rep. 2016, 6, 18795. [CrossRef] [PubMed]
16. Zhang, J.; Tian, G.Y.; Marindra, A.M.J.; Sunny, A.I.; Zhao, A.B. A review of passive RFID tag antenna-based
sensors and systems for structural health monitoring applications. Sensors 2017, 17, 265. [CrossRef] [PubMed]
17. Linz, S.; Oesterle, F.; Talai, A.; Lindner, S.; Mann, S.; Barbon, F.; Weigel, R.; Koelpin, A. 100 GHz
reflectometer for sensitivity analysis of MEMS sensors comprising an intermediate frequency six-port
receiver. In Proceedings of the 2015 IEEE Topical Conference on Wireless Sensors and Sensor Networks
(WiSNet), San Diego, CA, USA, 25–28 January 2015.
18. Vinci, G.; Koelpin, A. Progress of six-port technology for industrial radar applications. In Proceedings of
the 2016 IEEE Topical Conference on Wireless Sensors and Sensor Networks (WiSNet), Austin, TX, USA,
24–27 January 2016.
118
Electronics 2018, 7, 231
19. Mann, S.; Linz, S.; Erhardt, S.; Lindner, S.; Lurz, F.; Maune, H.; Weigel, R.; Koelpin, A. Differential measuring
dual six-port concept and antenna design for an inline foil thickness sensor. In Proceedings of the 2016
German Microwave Conference (GeMiC), Bochum, Germany, 14–16 March 2016.
20. Kuo, H.-C.; Lin, C.-C.; Yu, C.-H.; Lo, P.-H.; Lyu, J.-Y.; Chou, C.-C.; Chuang, H.-R. A fully integrated 60-GHz
CMOS direct-conversion Doppler radar RF sensor with clutter canceller for single-antenna noncontact
human vital-signs detection. IEEE Trans. Microwave Theory Tech. 2016, 64, 1018–1028. [CrossRef]
21. Von der Mark, S.; Huber, M.; Boeck, G. 24 GHz direct conversion transceiver for sensor networks.
In Proceedings of the 2007 IEEE Wireless Communications and Networking Conference, Kowloon, China,
11–15 March 2007.
22. Cook, B.S.; Vyas, R.; Kim, S.; Thai, T.; Le, T.; Traille, A.; Aubert, H.; Tentzeris, M.M. RFID-based sensors for
zero-power autonomous wireless sensor networks. IEEE Sens. J. 2014, 14, 2419–2431. [CrossRef]
23. Adhikary, M.; Biswas, A.; Akhtar, M.J. Active Integrated Antenna Based Permittivity Sensing Tag. IEEE Sens.
Let. 2017, 1, 1–4. [CrossRef]
24. Lobato-Morales, H.; Corona-Chavez, A.; Olvera-Cervantes, J.L.; Chávez-Pérez, R.A.; Medina-Monroy, J.L.
Wireless sensing of complex dielectric permittivity of liquids based on the RFID. IEEE Trans. Microwave
Theory Tech. 2014, 62, 2160–2167. [CrossRef]
25. Bouaziz, S.; Chebila, F.; Traille, A.; Pons, P.; Aubert, H.; Tentzeris, M. Novel micro-fluidic structures for
wireless passive temperature telemetry medical systems using radar interrogation techniques in Ka-band.
IEEE Antennas Wirel. Propag. Lett. 2012, 11, 1706–1709. [CrossRef]
26. Cole, A.J.; Young, P.R. Chipless Liquid Sensing Using a Slotted Cylindrical Resonator. IEEE Sens. J. 2017, 18,
149–156. [CrossRef]
27. Li, J.; Bosisio, R.G.; Wu, K. Computer and measurement simulation of a new digital receiver operating
directly at millimeter-wave frequencies. IEEE Trans. Microwave Theory Tech. 1995, 43, 2766–2772. [CrossRef]
28. Mirzavand, R.; Mohammadi, A.; Abdipour, A. Low-cost implementation of broadband microwave receivers
in Ka-band using multiport structures. IET Microwaves Antennas Propag. 2009, 3, 483–491. [CrossRef]
29. Mirzavand, R.; Mohammadi, A.; Ghannouchi, F.M. Five-port microwave receiver architectures and
applications. IEEE Commun. Mag. 2010, 48, 30–36. [CrossRef]
30. Beikmirza, M.R.; Mohammadi, A.; Mirzavand, R. Power amplifier linearisation using digital predistortion
and multi-port techniques. IET Sci. Meas. Technol. 2016, 10, 467–476. [CrossRef]
31. Mirzavand, R.; Honari, M.M.; Mousavi, P. N-ZERO direct conversion wireless sensor based on six-port
structures. In Proceedings of the 2017 IEEE MTT-S International Microwave Symposium (IMS), Honololu,
HI, USA, 4–9 June 2017.
32. Mirzavand, R.; Honari, M.M.; Mousavi, P. Direct-conversion sensor for wireless sensing networks. IEEE Trans.
Ind. Electron. 2017, 64, 9675–9682. [CrossRef]
33. Berube, D.; Ghannouchi, F.M.; Savard, P. A comparative study of four open-ended coaxial probe models for
permittivity measurements of lossy dielectric/biological materials at microwave frequencies. IEEE Trans.
Microwave Theory Tech. 1996, 44, 1928–1934. [CrossRef]
34. Li, R.; Pan, B.; Laskar, J.; Tentzeris, M.M. A Novel Low-Profile Broadband Dual-Frequency Planar Antenna
for Wireless Handsets. IEEE Trans. Antennas Propag. 2008, 56, 1155–1162. [CrossRef]
35. La Gioia, A.; Porter, E.; Merunka, I.; Shahzad, A.; Salahuddin, S.; Jones, M.; O’Halloran, M. Open-Ended
Coaxial Probe Technique for Dielectric Measurement of Biological Tissues: Challenges and Common Practices.
Diagnostics 2018, 8, 40. [CrossRef] [PubMed]
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
119
electronics
Article
Evolution of Wireless Sensor Network for Air
Quality Measurements
Patricia Arroyo, Jesús Lozano * and José Ignacio Suárez
Industrial Engineering School, University of Extremadura, 06071 Badajoz, Spain; [email protected] (P.A.);
[email protected] (J.I.S.)
* Correspondence: [email protected]; Tel.: +34-924-289-300
Abstract: This study addresses the development of a wireless gas sensor network with low cost,
small size, and low consumption nodes for environmental applications and air quality detection.
Throughout the article, the evolution of the design and development of the system is presented,
describing four designed prototypes. The final proposed prototype node has the capacity to connect
up to four metal oxide (MOX) gas sensors, and has high autonomy thanks to the use of solar panels, as
well as having an indirect sampling system and a small size. ZigBee protocol is used to transmit data
wirelessly to a self-developed data cloud. The discrimination capacity of the device was checked with
the volatile organic compounds benzene, toluene, ethylbenzene, and xylene (BTEX). An improvement
of the system was achieved to obtain optimal success rates in the classification stage with the final
prototype. Data processing was carried out using techniques of pattern recognition and artificial
intelligence, such as radial basis networks and principal component analysis (PCA).
Keywords: chemical sensors; wireless sensor network; cloud computing; air quality
1. Introduction
In most cities, air quality improved (significantly) over the past decades. Visible air pollution
(smoke, dust, and smog) disappeared from many cities due to local, national, and European initiatives.
However, the current air quality still affects the health of the population. According to the World Health
Organization (WHO), 1.7 million children die as a result of contaminated environments (indoor and
outdoor) [1]. On the other hand, the Health Effect Institute concludes from its studies that long-term
exposure to air pollution in 2016 was responsible for the deaths of 6.1 million people due to strokes,
heart attacks, lung diseases, and lung cancer [2]. Air quality is, therefore, a problem common to almost
all major cities.
Volatile organic compounds (VOCs) are among the main pollutants in the atmosphere. These are
organic compounds that evaporate or sublimate at room temperature and pressure, and are derived
from products such as fuels and solvents from anthropogenic and natural sources. These compounds
are directly associated with chronic effects on health, as well as the formation of ozone and mists.
The health effects of VOCs depend on the type of component, although benzene (C6 H6 ) is the most
relevant compound, since it is considered a potent human carcinogen by the International Agency for
Research on Cancer (IARC). Specifically, it causes acute myeloid leukemia, and there is some evidence
that it may cause lymphocytic leukemia [3]. In addition, like toluene (C6 H5 CH3 ), it is a precursor
pollutant of ozone and secondary organic aerosols.
Because of the great global damage caused by the presence of pollutants in the atmosphere,
many organizations and countries around the world established monitoring systems that provide
the data needed to improve air quality. While, for the vast majority of these observations, the
established analytical reference methods continue to be used, miniaturization led to a growth in
the prominence of a generation of low-cost devices. Such devices are also smaller, lighter, and have
a lower power consumption. Thanks to their appearance, an increase in the spatial density of the
measurements was achieved, even though they are less precise devices than the reference systems.
Although they are not a direct substitute for reference instruments, they are a complementary source of
information on air quality to validate atmospheric models and predictions at high temporal and spatial
resolution [4]. This potential increase in the spatial density of the measurements is mainly achieved
using sensor networks.
The wireless sensor network (WSN) is a growing technology that is applied in many different
monitoring situations [5]. WSNs are composed of small devices called nodes that collect information
from the environment with sensors, process it, and communicate wirelessly with other nodes in the
network. The main fields in which the WSNs are used include (according to Reference [6]) military and
crime prevention, health, environment, industry and agriculture, and urbanization and infrastructure.
However, this technology offers significant benefits especially in applications where large spaces must
be covered, such as in the measurement of air quality. As a result, there are numerous related works in
this field, many of which were recently collected by some authors [7,8]. Nevertheless, WSNs have a
limited lifespan due to energy consumption. Therefore, much of the current and future research focuses
on the use of different techniques in order to maximize lifetime [9]. Among them are the architectures
of tiered systems, medium access control (MAC) protocols of low energy consumption, “duty-cycle”
strategies, and the redundant placement of nodes to ensure coverage. As of yet, these techniques
only manage to optimize and adapt energy consumption to maximize battery life of the sensor node.
However, it is also worth highlighting energy-harvesting techniques, which use renewable energy
sources to address the problem, and can be an important step forward in achieving the continuous
operation of the WSNs over time [10].
Within the different technologies and standards of WSN, ZigBee stands out for applications
of low cost, low consumption, and low data rate [11]. ZigBee is a model that defines a set of
communication protocols that overlaps the IEEE.802.15.4 [12,13] specification. In addition, devices
that use this communication protocol allow working in power-saving mode, thereby further reducing
the consumption of the system. Consequently, this communication protocol was used in numerous
applications related to air quality [14–16].
Also noteworthy is the need for quick access from anywhere to the information of the WSN nodes.
To this end, Internet of things (IoT) and cloud computing can be used [17]. Cloud computing refers to
internet servers responsible for responding to requests at any time. On the other hand, the Internet
of things technology is the interconnection of a network of objects through the internet. These two
technologies are complementary: IoT can benefit from the unlimited storage and communication
offered by cloud technology, while cloud computing can extend its reach to the “real world” with IoT.
The integration of these technologies with the WSN was already carried out in some works due to its
great utility [18–20].
In regards to low-cost gas sensors, there are different technologies available, mainly including
resistive sensors, electrochemical sensors, nondispersive infrared (NDIR) detectors, absorption sensors,
and photoionization detectors (PIDs) [21]. Resistive metal oxide (MOX) gas sensors are one of the
most used due to their low cost, low consumption, lightweight nature, and small size. In addition,
MOX sensors react with a large number of gases and have a very quick response time. Because of
this versatility, they are very useful in various fields, especially in the environmental monitoring and
detection of pollutants [22,23].
The results presented in this work study the discrimination capacity of the system for benzene,
toluene, ethylbenzene, and xylene (BTEX) compounds. Other methods and technologies were
previously used for this purpose. The most common method for the detection of these VOCs is
gas chromatography/mass spectrometry [24–27]. These systems are of high precision and selectivity.
However, they are expensive and due to the large size and weight of the equipment; as such, their
field detection capacity is limited. In addition, although these methods are very useful for low-level
121
Electronics 2018, 7, 342
detection, they require a lot of time due to sample transport, analyte desorption, preconcentration, and
data transmission. Numerous authors also used devices based on colorimetric methods [28]. However,
although they are portable, they do not allow the creation of a spatial matrix of numerous nodes that
allows studying the presence of BTEX at different points.
Notably, it is usually necessary to apply data processing techniques in the use of devices with
MOX gas sensors. The main used pattern recognition techniques in the field of gas detection were
summarized in numerous articles in recent years [29,30].
Therefore, in this work a low-cost system was developed for the measurement of air quality.
Throughout the article, the architecture and the evolution in the development of the electronic and
communication system are described.
In this work, the following contributions are presented:
• Design and development of a wireless gas sensor network for low-cost air quality measurements,
with low size and low consumption.
• Description of the different prototypes corresponding to the evolution of the designed system
across several years and projects: electronics and communication.
• Use of artificial neural networks for processing the collected data.
• The discrimination capability of the module was tested with BTEX volatile compounds. These tests
also allowed studying the evolution of system operation.
122
Electronics 2018, 7, 342
Throughout the evolution of the system, four different prototypes were designed and developed,
depending on the context of the application and also improving on the previous ones. The first version
was a homemade prototype created to study the operation of ZigBee communication and gas sensors.
The second system incorporated improvements in system autonomy and a greater versatility for using
different types of sensors. The third one included changes in communication and data acquisition
(incorporating the use of a data cloud), and improved the adaptation of the sensors signals and
their stability. Finally, the last system is the most optimized, incorporating solar power and greater
autonomy, greater adaptation and control of the sensors, and improvements in the acquisition and
processing of data.
Figure 2. Electrical diagram of battery charging system corresponding to prototype version 2 (PV2).
This circuit was eliminated in the third prototype because the location where it was going to be used
had no external source, thus allowing the optimization of the size of the PCB (Printed Circuit Board).
The last and current prototype (PV4) includes a 3.7-V and 2050-mAh battery that, together with
a solar panel, greatly improves the autonomy of the system. For this purpose, the LT3652 charger
integrated circuit (Linear Technology, Milpitas, CA, USA), optimized for solar panel applications, is
used (Figure 3). This circuit keeps the solar panel at the maximum output power and the charging
current is modified according to the battery state at each moment. In addition, it has temperature
protection and a timer.
123
Electronics 2018, 7, 342
Figure 3. Electrical diagram of battery charging system from solar panels corresponding to PV4.
124
Electronics 2018, 7, 342
125
Electronics 2018, 7, 342
added, since not all the sensors needed the same power for proper operation. In the third version, this
variable resistor was replaced by a fixed one (as in the case of the conditioning circuit for the sensor
signal), and the heating element activation and deactivation functionality was incorporated using a
digital output of the XBee module and a bipolar transistor. Thus, it managed to reduce consumption
when sensors were not necessarily working. Finally, PV4 added a heater power control through a
PWM (Pulse-Width Modulation) output and a MOSFET transistor, thereby achieving the possibility
of modifying the operating temperatures of the gas sensors and of using the pulsed-temperature
operating mode.
Figure 6 shows the final electrical diagram of the sensor signal conditioning and of the heating
power control in PV4. RH corresponds to the heating resistance, R3 is the resistor placed in series to
limit the maximum current in RH, Rg is the gate resistor, VS is the output voltage of the gas sensor, R2
and R1 are the resistors corresponding to the amplification circuit of the signal, RS is the resistance
of the sensor, RL the load resistor corresponding to the sensor, and VA is the output voltage of the
amplifier stage, and the input to the analog/digital converter of the XBee module.
Figure 6. Electrical diagram of the sensor signal conditioning circuits and of the control of the heating
power in PV4.
According to this, the input voltage in the XBee module is defined by the following equation
(corresponding to the non-inverting amplifier):
126
Electronics 2018, 7, 342
Figure 7. Electrical diagram of the activation circuits of the pump and the electrovalve (PV2, PV3, and PV4).
127
Electronics 2018, 7, 342
minimum consumption, and the autonomy, whether the gas sensors were integrated within the node
or were connectable from an external PCB, as well as the tools used to receive, store, and process
the collected data by the sensor nodes, whether they included a connection and control capacity for
the pumping system, and the main features of improvement with respect to the previous version.
The evolution was geared toward greater autonomy, smaller size, and greater flexibility and versatility.
Pictures of the evolution of the wireless gas sensor nodes described in this paper are presented in
Figure 8.
128
Electronics 2018, 7, 342
Firstly, pre-processing techniques are applied to the collected data. In this case, this stage is
performed in real time on the gateway. One of the existing feature extraction algorithms in the literature
according to Gutierrez-Osuna [30] was used, namely the relative resistance algorithm (RR). Following
this algorithm, the characteristic value of each measurement is defined by the following equation:
RR = RV /RN , (3)
where RV is the resistance value in exposure to the reference compound (air) and RN is the resistance
value in exposure to the target compound, both in steady-state situations.
To reduce the size of the extracted data, the principal component analysis (PCA) [37] technique was
used. This technique reduces the dataset, losing the least amount of information possible. It employs
linear combinations of the original variables resulting in linearly independent variables. This phase
and the following phase are performed in the cloud system.
Next, the prediction phase is carried out. At this stage, regression techniques can be applied to
quantify concentrations, while classification techniques can be applied to discriminate contaminating
compounds, or clustering techniques can be applied to group similar responses. In the results shown
in this article, classification tasks were applied. To this end, probabilistic neural networks (PNN) were
used, also called radial basis networks due to the use of a neuron activation radial basis function
(RBF) [38]. These networks are made up of four layers. The input layer corresponds to the PCA
components used. The next one is the pattern layer, with a number of neurons equal to the training
vectors, grouped by classes, where the distance between the input layer vector and each element of the
training set was evaluated. The third layer, i.e., the summation layer, contains a neuron for each class
and adds the outputs of the pattern neurons belonging to the same class. Lastly, the output layer is a
“limiter” that seeks the maximum value of the sum layer. Then, the highest value is selected and set to
1 as a result, while the other outputs are set to 0.
Finally, to determine the validity of the system, predictions of known values were made to
compare the estimate values with the real results. Leave-one-out cross-validation (LOOCV) was used
to determine the performance of the trained model in this case. This validation technique proposes to
perform as many iterations as samples present in the dataset.
129
Electronics 2018, 7, 342
• 2 × TGS2600 (Figaro, Japan) and 2 × TGS2620 (Figaro, Japan) in PV2 and PV3.
• 2 × TGS8100 (Figaro, Japan), 1 × CCS801, and 1 × CCS803 (ams, UK) in PV4.
These tests attempted to analyze the ability of devices to discriminate the BTEX (benzene, toluene,
ethylbenzene, and xylene) volatile organic compounds dissolved in water. For this purpose, the
static head space technique was used in 22-mL vials. Samples of 10 mL were prepared at a 5%
concentration of each compound. Then, the headspace was drawn into the sensor cell using a pump.
The vials were kept at 20 ◦ C. Each measurement cycle lasted 10 min: 140 s for the passage of the target
compound to the sensor cell, and 460 s for the flow of the reference gas (in this case, clean air). In the
measurements made with the final prototype, these times were updated to 60 s (target) and 540 s
(reference) to ensure the signal stabilization in the reference gas phase. Figure 10 shows a diagram of
the measurement process.
More than 15 measurements were taken for each one of the BTEX compounds and distilled water
(in order to have a reference of absence of simulated contaminants in the environment).
3.2. Results
The signals obtained from one of the sensors of each of the four sets of measurements are shown in
Figure 11. The selected signals correspond to eight measurement cycles of xylene in each case. One of
130
Electronics 2018, 7, 342
the sensors (model TGS2600) was selected for PV2 and PV3. Because PV4 did not use this sensor
model, the signal of sensor model TGS8100, from the same manufacturer, was selected. The evolution
shows the improvement achieved in each version due to changes in the power and conditioning
circuits, pump power, and timing optimization. Thus, between the first two sets of measurements,
noise reduction was achieved thanks to the changes introduced in the conditioning and power circuits
of the sensors, and changes in the heater temperature. Then, between the second and third package
(made with the same version of the device, PV3), further noise reduction and a greater stabilization
of the signal were achieved by decreasing the flow rate of the sample (by controlling the power of
the pump). Finally, between the last two sets of measurements, in addition to the changes introduced
in the adaptation and control circuitry, a faster response was achieved due to the use of a sensor of
smaller size and consumption.
6(162566,*1$/6(92/87,21
97*6
Resistance (Ohm)
97*6
Time (s)
Figure 11. Evolution of sensor signals (resistance versus time), corresponding to the eight xylene measurements.
Once all the data from the measurements were collected, data processing was performed. In the
case of PV2, the preprocessing phase was done manually through the Matlab software. However, in the
third and fourth versions, this process was performed automatically (while measurements were made)
by the program developed in Python that ran on the gateway. As explained above, this preprocessing
phase used the relative resistance algorithm. It extracted the value of the ratio between the resistance
value of the baseline and the resistance value during exposure to the target compound. In this way, it
was possible to extract the main information, while considerably reducing the size of the data.
131
Electronics 2018, 7, 342
In all cases, the first two measures were discarded, since the systems were not yet stabilized
and the conditions were not the same. Therefore, 13 measurements of each compound were used for
data processing.
Then, an analysis of the main component (PCA) was carried out for a graphical representation
of the measurements. Figure 12A shows the first two principal components of the measurements
made with PV2. A high overlap can be observed between some compounds such as toluene, benzene,
and xylene. In addition, short-term drift and dispersion effects appear, resulting from high noise
in the measurements and non-stable temperature of the gas sensor heaters. The PCA of the same
measurements made with PV3 is presented in Figure 12B. It shows that the clusters are further
apart than in the previous case, although there is still overlap between those of toluene and xylene.
Furthermore, a high drift effect is still present, possibly due to depletion of the sample. A similar test
was repeated using lower pump power in the extraction phase of the sample (test 2). Moreover, the
preprocessing program was improved, achieving greater accuracy of obtaining the characteristic value
of each measurement. In Figure 12C, it can be observed that the PCA plot improved significantly,
managing to reduce the drift effect and the overlaps between zones (only a small overlap between the
areas of benzene and toluene, although they are generally very close to each other). Finally, Figure 12D
shows the first two principal components of the values of the measurements made with the latest
version of the device (PV4), where it can be observed that different areas concerning each compound
are clearly separated and non-dispersed.
Figure 12. Principal component analysis (PCA) plot for benzene, toluene, ethylbenzene, and xylene
(BTEX) compounds of the different datasets: (A) PV2; (B) PV3 (test 1); (C) PV3 (test 2); (D) PV4.
132
Electronics 2018, 7, 342
Next, PNN was used in order to discriminate the compounds. Then, the LOOCV validation
technique was used to study the classification capacity in each case. The results of each of the four
studied cases are presented in Table 2, which contains the confusion matrix obtained, allowing us
to observe the system performance. The matrix columns represent the predicted class, and the rows
represent the real class. As a result, the main diagonal contains correct predictions, while values
outside it correspond to erroneous ones. Red data represent the matrix corresponding to the results
of PV2. Blue data correspond to the first test performed with PV3 (without preprocessing and pump
power correction), while green data correspond to the second test (with correction) of PV3. Finally,
the black columns refer to the data resulting from PV4. The resulting success rates were 80%, 93.84%,
96.82%, and 100% for the four datasets, respectively.
Table 2. Confusion matrix obtained in leave-one-out cross-validation (LOOCV) validation. Red: PV2;
blue: PV3 (test1); green: PV3 (test2); black: PV4.
4. Conclusions
In this paper, a wireless gas sensor network focusing on the study of air quality was presented.
For this purpose, the electronic evolution of the designed sensor nodes was described, until a node of
low cost, low consumption, and small size was obtained. Up to four gas microsensors can be connected
to the nodes. In addition, they incorporate a control and RF module with ZigBee protocol that allows
communication with a central node. This, in turn, is responsible for collecting and storing the data,
controlling some aspects of the sensor nodes, and, in the most advanced prototype, preprocessing the
data and uploading it to a data cloud.
The system was designed to be used in pollutant detection applications and air quality control
in large areas. In order to verify the proper operation and discrimination capacity of the system,
discrimination tests of BTEX volatile organic compounds were carried out. These tests also allowed
studying the evolution of system operation. As a result, the signals were observed to improve
significantly, and the discrimination success rates increased from 80% (PV1) to 100% (PV4).
Author Contributions: P.A. designed the hardware and performed the measurements; J.I.S. and J.L. designed the
control architecture and the experiments. All authors wrote the article.
Funding: The authors want to thank the Spanish Ministry of Economy and Competitiveness and Junta de
Extremadura for supporting the TEC2013-48147-C6-5-R and IB16048 projects.
Acknowledgments: The authors want to thank José Luis Herrero for help with the cloud system, and Pablo
Carmona, Juan Álvaro Fernandez, and Carlos Sánchez for help with the data processing methods.
Conflicts of Interest: The authors declare no conflict of interest.
References
1. WHO. The Cost of a Polluted Environment: 1.7 Million Child Deaths a Year, Says WHO; World Health
Organization: Geneva, Switzerland, 2017.
2. McCarthy, N. Air Pollution Contributed to More Than 6 Million Deaths in 2016; Forbes: New York, NY, USA, 2018.
3. WHO. Esposure to Benzene: A Major Public Health Concern; World Health Organization: Geneva,
Switzerland, 2010.
133
Electronics 2018, 7, 342
4. Lung, C.; Jones, R.; Zellweger, C.; Karppinen, A.; Penza, M.; Dye, T.; Hüglin, C.; Ning, Z.; Leigh, R.; Hagan, D.;
et al. Low-Cost Sensors for the Measurement of Atmospheric Composition: Overview of Topic and Future Applications
(WMO); Lewis, A.C., Von Schneidemesser, E., Peltier, R., Eds.; World Meteorological Organization: Geneva,
Switzerland, 2018; ISBN 9789263112156.
5. Yick, J.; Mukherjee, B.; Ghosal, D. Wireless sensor network survey. Comput. Netw. 2008, 52, 2292–2330.
[CrossRef]
6. Rawat, P.; Singh, K.D.; Chaouchi, H.; Bonnin, J.M. Wireless sensor networks: A survey on recent
developments and potential synergies. J. Supercomput. 2014, 68, 1–48. [CrossRef]
7. Yi, W.Y.; Lo, K.M.; Mak, T.; Leung, K.S.; Leung, Y.; Meng, M.L. A Survey of Wireless Sensor Network Based
Air Pollution Monitoring Systems. Sensors 2015, 15, 31392–31427. [CrossRef] [PubMed]
8. Othman, M.F.; Shazali, K. Wireless Sensor Network Applications: A Study in Environment Monitoring
System. Procedia Eng. 2012, 41, 1204–1210. [CrossRef]
9. Baranov, A.; Spirjakin, D.; Akbari, S.; Somov, A. Optimization of power consumption for gas sensor nodes:
A survey. Sens. Actuators A Phys. 2015, 233, 279–289. [CrossRef]
10. Shaikh, F.K.; Zeadally, S. Energy harvesting in wireless sensor networks: A comprehensive review.
Renew. Sustain. Energy Rev. 2016, 55, 1041–1054. [CrossRef]
11. Farahani, S. Chapter 3—ZigBee and IEEE 802.15.4 Protocol Layers. In ZigBee Wireless Networks and Transceivers;
Elsevier: Amsterdam, The Netherlands, 2008; pp. 33–135.
12. De Guglielmo, D.; Brienza, S.; Anastasi, G. IEEE 802.15.4e: A survey. Comput. Commun. 2016, 88, 1–24.
[CrossRef]
13. Baronti, P.; Pillai, P.; Chook, V.W.C.; Chessa, S.; Gotta, A.; Hu, Y.F. Wireless sensor networks: A survey on the
state of the art and the 802.15.4 and ZigBee standards. Comput. Commun. 2007, 30, 1655–1695. [CrossRef]
14. Huang, Y.; Hu, L.; Yang, D.; Liu, H. Air-Sense: Indoor environment monitoring evaluation system based on
ZigBee network. IOP Conf. Ser. Earth Environ. Sci. 2017, 81, 12208. [CrossRef]
15. Kasar, A.R.; Khemnar, D.S.; Tembhurnikar, N.P. WSN Based Air Pollution Monitoring System. Int. J. Sci.
Eng. Appl. 2013, 2, 2319–7560. [CrossRef]
16. Yang, C.-T.; Chen, S.-T.; Den, W.; Wang, Y.-T.; Kristiani, E. Implementation of an Intelligent Indoor
Environmental Monitoring and management system in cloud. Future Gener. Comput. Syst. 2018. [CrossRef]
17. Botta, A.; de Donato, W.; Persico, V.; Pescapé, A. Integration of Cloud computing and Internet of Things: A
survey. Future Gener. Comput. Syst. 2016, 56, 684–700. [CrossRef]
18. Herrero, J.L.; Lozano, J.; Santos, J.P.; Suárez, J.I. On-line classification of pollutants in water using wireless
portable electronic noses. Chemosphere 2016, 152, 107–116. [CrossRef] [PubMed]
19. Li, W.; Kara, S. Methodology for Monitoring Manufacturing Environment by Using Wireless Sensor Networks
(WSN) and the Internet of Things (IoT). Procedia CIRP 2017, 61, 323–328. [CrossRef]
20. Kumar, P.M.; Lokesh, S.; Varatharajan, R.; Gokulnath, C.; Parthasarathy, P. Cloud and IoT based disease
prediction and diagnosis system for healthcare using Fuzzy neural classifier. Future Gener. Comput. Syst.
2018. [CrossRef]
21. Aleixandre, M.; Gerboles, M. Review of small commercial sensors for indicative monitoring of ambient gas.
Chem. Eng. Trans. 2012, 30, 169–174. [CrossRef]
22. Fine, G.F.; Cavanagh, L.M.; Afonja, A.; Binions, R. Metal oxide semi-conductor gas sensors in environmental
monitoring. Sensors 2010, 10, 5469–5502. [CrossRef] [PubMed]
23. Peterson, P.J.D.; Aujla, A.; Grant, K.H.; Brundle, A.G.; Thompson, M.R.; Vande Hey, J.; Leigh, R.J. Practical use
of metal oxide semiconductor gas sensors for measuring nitrogen dioxide and ozone in urban environments.
Sensors 2017, 17, 1653. [CrossRef] [PubMed]
24. Kubinec, R.; Adamuščin, J.; Jurdáková, H.; Foltin, M.; Ostrovský, I.; Kraus, A.; Soják, L. Gas chromatographic
determination of benzene, toluene, ethylbenzene and xylenes using flame ionization detector in water
samples with direct aqueous injection up to 250 μL. J. Chromatogr. A 2005, 1084, 90–94. [CrossRef] [PubMed]
25. Hazrati, S.; Rostami, R.; Fazlzadeh, M. BTEX in indoor air of waterpipe cafés: Levels and factors influencing
their concentrations. Sci. Total Environ. 2015, 524–525, 347–353. [CrossRef] [PubMed]
26. Niri, V.H.; Mathers, J.B.; Musteata, M.F.; Lem, S.; Pawliszyn, J. Monitoring BTEX and aldehydes in car exhaust
from a gasoline engine during the use of different chemical cleaners by solid phase microextraction-gas
chromatography. Water Air Soil Pollut. 2009, 204, 205–213. [CrossRef]
134
Electronics 2018, 7, 342
27. Zali, S.; Jalali, F.; Es-haghi, A.; Shamsipur, M. New nanostructure of polydimethylsiloxane coating as
a solid-phase microextraction fiber: Application to analysis of BTEX in aquatic environmental samples.
J. Chromatogr. B 2016, 1033–1034, 287–295. [CrossRef] [PubMed]
28. Allouch, A.; Le Calvé, S.; Serra, C.A. Portable, miniature, fast and high sensitive real-time analyzers: BTEX
detection. Sens. Actuators B Chem. 2013, 182, 446–452. [CrossRef]
29. Marco, S.; Gutiérrez-Gálvez, A. Signal and Data Processing for Machine Olfaction and Chemical Sensing: A
Review. IEEE Sens. J. 2012, 12, 3189–3214. [CrossRef]
30. Gutierrez-Osuna, R. Pattern analysis for machine olfaction: A review. IEEE Sens. J. 2002, 2, 189–202. [CrossRef]
31. Lozano, J.; Suárez, J.I.; Arroyo, P.; Ordiales, J.M.; Álvarez, F. Wireless sensor network for indoor air quality
monitoring. Chem. Eng. Trans. 2012, 30, 319–324. [CrossRef]
32. Arroyo, P.; Lozano, J.; Suárez, J.I.; Herrero, J.L.; Carmona, P. Wireless sensor network for indoor air quality
monitoring and Control. Chem. Eng. Trans. 2016, 54, 217–222. [CrossRef]
33. Kohl, D. Fundamentals and Recent Developments of Homogeneous Semiconducting Sensors. In Sensors and
Sensory Systems for an Electronic Nose; Gardner, J.W., Bartlett, P.N., Eds.; Springer: Dordrecht, The Netherlands,
1992; pp. 53–76.
34. Moseley, P.T.; Stoneham, A.M.; Williams, D.E. Oxide semiconductors: Patterns of gas response behaviour
according to materials type. In Techniques and Mechanisms in Gas Sensing; Moseley, P.T., Norris, J.,
Williams, D.E., Eds.; Adam Hilger: Bristol, UK, 1991; pp. 108–138.
35. Presmanes, L.; Thimont, Y.; El Younsi, I.; Chapelle, A.; Blanc, F.; Talhi, C.; Bonningue, C.; Barnabé, A.;
Menini, P.; Tailhades, P. Integration of P-Cuo thin sputtered layers onto microsensor platforms for gas
sensing. Sensors 2017, 17, 1409. [CrossRef] [PubMed]
36. Eady, F. Maxstream/XBee. In Hands-On ZigBee; Newnes, Ed.; Elsevier: Amsterdam, The Netherlands, 2007;
pp. 131–152.
37. Esbensen, K.H.; Geladi, P. Principal Component Analysis: Concept, Geometrical Interpretation, Mathematical
Background, Algorithms, History, Practice. Compr. Chemom. 2009, 211–226. [CrossRef]
38. Specht, D.F. Probabilistic neural networks. Neural Netw. 1990, 3, 109–118. [CrossRef]
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
135
electronics
Article
RoomFort: An Ontology-Based Comfort Management
Application for Hotels
Daniele Spoladore 1, *, Sara Arlati 1,† , Sara Carciotti 2 , Massimiliano Nolich 2 and Marco Sacco 1
1 Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, National Research
Council, Via Previati 1/E, 23900 Lecco, Italy; [email protected] (S.A.); [email protected] (M.S.)
2 Department of Engineering and Architecture, University of Trieste, Via Alfonso Valerio 6/3, 34127 Trieste,
Italy; [email protected] (S.C.); [email protected] (M.N.)
* Correspondence: [email protected]; Tel.: +39-0341-2350202
† Current address: Department of Electronics, Information and Bioengineering, Politecnico di Milano,
Via Giuseppe Ponzio 34, 20133 Milano, Italy.
Abstract: Business traveling is attracting growing attention due to the expansion of international
markets. This fact calls for an increasing attention of the tourism sector toward the needs of business
travellers, who often require services that are different from the ones desired by leisure tourists.
The application of smart solutions coming from Context Awareness and Ambient Intelligence
aimed at promoting guests’ comfort and well-being, also in cases in which they have special needs,
represents a promising solution to tackle business travellers’ requirements and thus, to increase
hotels attractiveness and incomes. In this context, this work introduces RoomFort, a smart comfort
management system aimed at enhancing comfort of hotel room guests and leveraging on semantic
representations of comfort, environment, and sensors. RoomFort provides a set of domain ontologies
to formalize comfort-related metrics and to exploit the automatic reasoning capabilities provided
by Semantic Web technologies, while gathering data through a network of sensors to ensure guests
are provided with tailored comfort profiles during their stays in the hotel. Particular focus has
been placed on visual comfort, since indoor lighting features constitute one of the main factors
influencing the two main activities that most business travellers accomplish in their hotel room:
working and relaxing.
1. Introduction
Business travelling has been assuming a growing trend in the last years due to the globalization
and expansion of international markets. World Travel & Tourism Council stated that there is a relation
between business travel and economic growth, highlighting a direct correlation between international
travel tourism and global trade growth [1]. The increase in demand will lead to higher tariffs, with a
consequent increase of 3.7% for hotels incomes [2]. This trend, though with different rates, is the same
worldwide: the Global Business Travel Association [3] has declared that the business travel sector has
been undergoing a strong increase in the last years.
In such context, several sources have started highlighting that business travellers need to rely on
comfortable hotel rooms, in which comfort metrics (temperature, illuminance and humidity rate) can
be adjusted according to the guests’ needs [4,5]. Moreover, frequent business travellers would like to
customize comfort metrics according to the activities they are performing [6].
The requested features call for a novel idea of comfort, which can be approached to the holistic
comfort, a concept that takes into account the traveller and both tangible and intangible environmental
factors to deliver an optimal and tailored experience during guests’ stay. This is particularly relevant
for business travellers, who, in addition to normal activities performed in the hotel room by leisure
tourists, may need to work in their room. They need to be alert, concentrated and not distracted by
unpleasant or uncomfortable environments; thus, it is imperative for hotel owners to provide them
with the highest and most tailored comfort possible. For this purpose, Ambient Intelligence (AmI)
and Context Awareness (CA) are two fields of study that can provide some interesting features to the
hotellerie industry, by making rooms and services "smarter". AmI and CA, in fact, can enhance the
comfort quality of the guests’ stay in the hotel by providing them tailored comfort sets and services.
This work presents RoomFort, a system that aims at providing guests with comfort metrics that
are tailored to their needs (intended as both physical and physiological necessities, as well as desires)
and adjusted according to the activities they are performing in their hotel room. RoomFort exploits
formal (i.e., ontological) representations of “domains of knowledge” related to the guests and to
the room’s comfort metrics, and a network of sensors to measure, analyze and customize comfort
metrics. Ontologies can provide a logic-based, formal and sharable interpretation of knowledge
and can foster information integration, support automatic reasoning processes and allow to infer
new information; therefore, they represent a promising tool for fostering the decision making in
contexts—as hotellerie—where several domains of knowledge are involved [7]. The system can be
exploited to customize temperature, humidity rate, air temperature (with Heating, Ventilation and
Air Conditioning (HVAC) system) and air quality (by triggering the opening and closing of room’s
windows); nevertheless, the achievement of the optimal visual comfort has been chosen as the main
objective of this work. This is due to both the strong influence that light conditions have on human
alertness and performances [8] and to the ease with which light installations could be made in the hotel
rooms, with respect to the renewal of the heating or of the air-conditioning systems. Finally, RoomFort
grants data privacy for both customers and hotel manager, as personal data and hotel data are stored
in separate private cloud space and only the parameters need to optimize the guest comfort inside a
given hotel room are merged together, inside a private cloud enclave, to perform a reasoning in order
to obtain the best actuation for the activity performed by that guest in that given room of that hotel.
The remainder of this work is organized as follows: Section 2 underlines some of the remarkable
papers in the field of semantic and intelligent based technologies for comfort management in indoor
environments; this Section highlights the lack of standard reference ontologies in a pivotal field of
knowledge (i.e., representation of indoor comfort metrics). Section 3 introduces the concept of holistic
comfort and links it to the hotel industry, highlighting some of the issues and desiderata belonging to
business travellers, target of this work. Section 4 presents the current status of hotels’ categorization in
Europe, United States of America, Canada and other countries; this section also introduces the sample
hotel room adopted for this work. Section 5 describes RoomFort system’s architecture and delves into
the description of the domain ontologies developed, with a specific focus on the methodology adopted
for modelling, the RoomFort application and the information exchange among the architectural actors.
Section 6 introduces the preliminary tests conducted to define the best luminous metrics for reading
and relaxing in a hotel room; the results deriving from this tests are then discussed and modelled in the
ontologies. Section 7 briefly points the attention on some particular use-cases, showing how RoomFort
could be of potential benefit for a variety of travellers and how it can meet the concept of comfort
understood as a service to be provided to guests. Finally, Section 8 summarizes the main outcome of
this work and sketches the future directions it will undertake.
2. Related Work
Research on comfort has acquired a growing importance in the last decade with the spreading of
CA systems, Ambient Assisted Living (AAL) and AmI. However, very few works relied on ontologies
to provide a sound, sharable and reasonable knowledge base describing comfort-related concepts and
measurements. The above-mentioned domains of knowledge share some similarities: they rely on
sensors to capture environmental information and they exploit technologies to ease dweller’s life, with
137
Electronics 2018, 7, 345
a particular focus on frail segments of the population. Ontology also plays a pivotal role in tourism,
where the exploitation of knowledge bases has lead to a variety of smart solutions.
138
Electronics 2018, 7, 345
BOnSAI takes into account the possibility to describe “environmental parameters”, such as CO2 level,
Illuminance, Pressure, Humidity to express the functionality of smart devices and services. These
parameters are used to express the functionalities of the devices deployed within the environment
and, secondary, to increase user’s comfort. Similarly, in [20] the authors developed the ThinkHome
ontology to represent the whole smart home ecosystem, thus, encompassing some comfort-related
concepts. ThinkHome encompasses the possibility to deduce the default comfort parameters according
to dweller’s age and gender leveraging reasoning mechanisms. The ontology, developed with OWL,
provides the means to describe temperature, humidity and air quality. More detailed indoor comfort
metrics are modelled in the Smart Home Simulator [21], an AAL Virtual Reality-based application
leveraging semantic representations of concepts to provide inhabitants with customized services and
comfort metrics (CO2 concentration, humidity rate, illuminance and temperature) according to their
health conditions.
139
Electronics 2018, 7, 345
the characteristics of the room and its services are important factors which strongly influence the choice
of the hotel [28]. Recent research showed how business travellers are more inclined to take into account
comfort-related services while choosing hotel rooms [29], thus, indicating that the attention towards
Indoor Environmental Quality (IEQ) represents an economic value for them. Also, it is worth noticing
that, contrary to leisure tourists, business travellers never consider their travel as a vacation, but always
as a business and work-related issue. Therefore, they do not experience the travel as pleasant, but
rather as a burden to bear to obtain better professional positions. Many business travellers report to
work many hours—even beyond normal working hours—to finish their duties sooner, so that they can
come back home earlier. This is due both to job-related concerns (e.g., more demanding workload on
return) and to the willingness of seeing again family members and friends. These pressing—and often
auto-imposed—demands turn into stress, burnout syndromes and unhealthy behaviours [30]. This is
the main reason why comfort has become a relevant concern for business travellers: the hotel room
alone cannot contribute in changing such behaviours, but may limit business travellers’ unease by
providing, from the one hand, a comfortable working environment promoting workers’ concentration
and alertness, and, on the other hand, a relaxing space to restore and recover after long working
shifts [31].
140
Electronics 2018, 7, 345
for reading and working with a laptop, thus, limiting reverberation and promoting paper-based text
clearness. Indeed, lighting can influence working performances, especially those performances directly
depending on vision. Several characteristics of lighting (such as illuminance, glare, spectrum of the
light) can help a worker to stay alert and to focus his/her attention or motivation. In 1989, the National
Electrical Manufacturers Association of the USA had already pointed out the link between lighting and
rapidity of production of drawings in an indoor environment where bright reflections were reduced [4].
Baron et al. [39] investigated the role of illuminance and spectral distribution (i.e., the colour) of
light on the performance of different tasks. Variations in illuminance and lamp typologies were found
to exert a significant effect on several cognitive and work-related tasks, such as word categorization,
preferring cooperation for resolving interpersonal conflicts (instead of avoidance), willingness to help
others, sense of ability in performing a clerical task [40].
More recently, it was also demonstrated how lighting and students’ learning performance are
connected, better lighting leads to an increase in students’ learning motivation [41]. Because of these
reasons, a hotel room that allows being customized by the guests according to their needs or desires
could play an important role in promoting the hotel’s revenue. Indeed, it is attractive for the more
demanding travellers and, consequently, can be considered as an added value for the hotel owner,
who can improve the quality of the services he/she provides and increase the rate of returning visitors.
This represents a strong need for hotel owners, who aim more and more at creating memorable
experiences in their guests: travellers are usually prone to look for different accommodations in order
to enrich their experience [5,42], and thus, they must be provided with strong motivations to return to
an already-visited place. In fact, the increasing awareness of importance of comfort has led people to be
more demanding and search for more and more the quality in their living environments, and thus, in
the hotels’ rooms as well. Light intensity and colour are two factors with impact on people’s activity in
the space that can help in achieving these objectives. Since illumination is known to cause behavioural
responses in humans, such knowledge can be exploited in order to help hotel guest in staying either
alert or concentrated, or relaxed [43]. According to the results of the study conducted in [44], the cool
colours are perceived as pleasant, comfortable, and activating, while warm colours are perceived as
more relaxing. Because of this, and considering the small economical effort required to change the
room’s lighting, hotel managers should consider applying these known concept on light colours in
their facilities, so to influence guests’ emotions and feelings [45].
With regard to business travellers’ needs, highlighted in the subsection above, the possibility to
provide a customized luminous comfort setting appears promising in easing their staying by helping
them in better performing their jobs, or relaxing when needed.
To do this, it is necessary to go beyond what is defined in the “lighting standards” in working
environments, which are regulated by the European norm EN 12464-1 that sets the minimum
requirements for indoor illuminance of working places. This standard sets the minimum illuminance
requirements of an actual working area (also defined as “task area”) rather than of the entire room.
For each of the working activities identified by the EN 12464-1, the norm specifies the ranges for a
set of parameters concurring in the definition of the luminous environment (luminance distribution,
illuminance, glare, colour rendering and colour appearance of light, daylight, glare, flicker). The norm
also recommends the minimum amount of illuminance for each task area according to a set of factors:
In particular, EN 12464-1 stresses how the required maintained illuminance (Em ) should be
increased in case of particular conditions, e.g., when there is the necessity of higher productivity,
when the visual capacity of a worker is below normal, when the task requires a great amount of
attention and/or time, etc. On the contrary, the maintained illuminance can be decreased in other
141
Electronics 2018, 7, 345
particular conditions, e.g., the task is undertaken for an unusually short time or details on which
worker’s attention must focus are large or highly contrasted. In any case, the normative states that in
continuously occupied area, the Em cannot be less than 200 lux. The European standard considers only
white light, though literature pointed out that the overall impression that a person gets of a space is
contributed by three atmospheric elements: colour, light and style; the colour seems to be the most
influential [46].
• France adopts a seven categories classification, ranging from “no star”, to five stars and including
also the “Palace” class for five-star hotels;
• Spain does not rely on a national classification system for hotels; each Regional Government
ratifies its own classification systems—although the differences among the various regional
classifications are minimal. Generally, hotels are classified according to a system of stars ranging
from the one to five;
• in Germany, under the patronage of HOTREC (Hotels, Restaurants and Cafés in Europa) [48],
a one to five stars system is used to classify hotel rooms and their services;
• in the United Kingdom a star rating system is adopted to describe all accommodations (hotels,
B&Bs, inns, etc.).
Australia, South Africa and India also adopt a star rating system; in the United State of America
and Canada the accommodations are classified according to a one to five rating system developed
in 1977 by the American Automobile Association. The system is divided in five categories and uses
“diamonds” instead of stars (one diamond being the lowest category and five diamonds being the
highest category).
Italy has a hotel rating system that ranges from one to five stars (the higher the number of
stars is, the higher is the quality level of the accommodation) and that aims at guaranteeing more
competitiveness to the national tourism in the global market [49]. The Italian rating system is
mandatory and managed by public authorities.
Such rating system defines the minimum national standards for services and facilities and classifies
hotels according to a code represented by a number of stars. As the number of stars increases, the
services provided by the hotel and its rooms proportionally increase. For example, a one-star room
needs a minimum 14 m2 of for a double bed (8 m2 for single bed) and a five-star room requires 16 m2
for a double bed (9 m2 for single bed). For the purpose of this work, a typical Italian three-star room
has been taken as sample. The characteristics of this type of room, are:
• services: 16/24 h of reception, daily cleaning of rooms, at least 1 foreign language and TV service
in each room;
• minimum dimensions: 8 m2 one single bedroom, 14 m2 double bedroom, 3 m2 bathroom;
142
Electronics 2018, 7, 345
• furniture: bed, table, chair, desk, wardrobe, mirror, luggage stool and bath furniture.
As the reader can see, the above-mentioned classification systems do not take into account IEQ
metrics, but focuses on rooms’ dimensions and on the services the hotel can provide to its guests.
Therefore, improving IEQ would not act on improving the hotel rating, but rather toward promoting
travellers’ revisit and supporting an (appropriate) increase of the hotel room cost with respect to other
rooms belonging to the same rating category.
• a set of sensors to detect illuminance, CO2 concentration, temperature and humidity rate inside
the room;
• a framework for semantic annotation of data gathered by the sensors, according to [51];
• a repository for indoor measurements (data gathered by sensors and semantically annotated);
• a reasoner able to provide customization of comfort metrics according to a set of conditions,
described in ontologies;
• a set of ontologies, formalizing both the conditions and the rules to tailor indoor comfort metrics
(described in detail in Sections 5.2–5.4);
• actuators, in this case a set of nine Philips Hue Lamps (six mounted on the ceiling and three on
the table); the complete set of actuators encompasses also a PCE thermo-hygrometer and a Cozir
Amb CO2 concentration sensor;
• an application running on Android devices and allowing the guest to declare the activities he/she
wants to perform and in which area of the room;
• a secure cloud service for hosting the hotel and the guest data, and for running the reasoning
processing and producing the optimal comfort actuations for that guest performing a given
activity inside such hotel room.
Therefore, to operate in the RoomFort framework, both hotel and guest characteristics are
described in a set of ontologies. More in details, each hotel room needs to be described in an ontology
143
Electronics 2018, 7, 345
encompassing concepts and measurements related to spaces, furniture and installed devices in order
to provide interoperability among devices and a safe and sound control of comfort metrics. The guest
should have his/her own data related to his/her health condition in an ontology-compliant format
too; in fact, these data are retrieved by RoomFort in order to customize the room’s indoor comfort
metrics according to the guests’ desires and activities.
Figure 1 shows a business traveller booking a room in a hotel which uses the RoomFort framework,
bringing together his/her own personal and health-related ontologies. Leveraging on the possibility to
access to all the knowledge formalized in the ontologies, RoomFort can operate as an application that
configures the comfort metrics in the room according to the guest’s needs and preferences [52]. The key
feature of this proposed architecture is the focus on the guest, as an individual with specific needs or
desires. In this context, RoomFort aims at providing him/her with tailored comfort metrics, with the
final goal of increasing his/her satisfaction. As shown in Figure 2, RoomFort relies on a cloud-based
architecture. The application operates on a private cloud enclave that stores the information of the
booked room, the environmental sensing data and the ontologies related to the guest. In this way,
the reasons behind an actuation are only available on the private enclave and stay hidden to hotel
personnel, thus, safeguarding guests’ privacy.
Figure 1. A schema describing the functioning of RoomFort: a business traveller can choose any hotel
adopting the system and import his/her preferences.
144
Electronics 2018, 7, 345
knowledge and adding value to several knowledge-based businesses and fields. RoomFort’s ontologies
were developed following the methodology described by Suárez-Figueroa et al. [54], the NeOn
Methodology. Among the variety of semantic modelling methodologies, NeOn was chosen since it
considerably simplifies the identification of the knowledge to be represented through the compiling of
the Ontology Requirements Specification Document (ORSD) [55]; the ORSD allows to acquire useful
indications regarding the granularity of the semantic models, their extents, the scope of the models,
the identification of the end-users of the ontologies, the functional and non-functional requirements the
ontologies must satisfy. Together with the NeOn Methodology, ORSD can simplify the development of
the ontologies by specifying their extents. Following the scenarios depicted in the NeOn Methodology,
the development of RoomFort’s models foresees the reuse of already existing ontological resources
and the development from scratch of new models.
As mentioned above, the domains of interest of this study regard:
• the guests and their health conditions Section 5.2; the International Classification of Functioning,
Disability and Health (ICF) was found as a suitable ontology for the description of health-related
conditions [56];
• the hotel room and the devices (sensors and actuators) in it Section 5.3, a domain divided into:
– the hotel room, for the description of which the Accommodation Ontology Language
Reference (ACCO) [57] and DogOnt [13] were the reused ontologies;
– the devices deployed in the room, whose formal description is performed referring to the
Smart Appliance REFerence Ontology (SAREF) [58];
• the comfort metrics to be monitored in order to provide a comfortable environment to the guest
Section 5.4, for which RoomFort relies on ontologies developed from scratch and led by the
embryonic work presented in [21,59]. A particular attention is posed on the luminous comfort, as
stated in the previous Sections, as one of the most sensitive domains for business travellers.
These modules composing RoomFort ontology are developed using OWL-DL [60], a subset of
OWL combining enough expressive power with full reasonability. The open-source ontology editor
Protégé (version 5.3) was used for the development of the semantic models.
The following subsections delve into the description of the semantic modules developed for
RoomFort architecture.
145
Electronics 2018, 7, 345
impairment). Therefore, the qualified code b21020.2 indicates a moderate impairment in the
“Colour vision”.
ICF is often exploited as a practical tool to ease the communication between health professionals
and other stakeholders [59,62]; moreover, the classification is suited also to describe each context
where health and environment interact: work reintegration [63], domestic age-care [64], AAL [65].
ICF has also been represented into an ontological model in RDF/OWL [56], which can be used as
reference in the modelling of more complex ontologies. However, it has to be underlined that this
model inherits some shortcomings belonging to the whole classification, such as problems regarding
incongruent classification of some concepts, a lack of clarity between activities and their qualities,
incorrect parent-child relationships [66] and overemphasis on subsumption [67].
Figure 4. An example of the modelling of a guest’s health condition; individuals are represented with
diamonds, concepts are represented with circles, and roles are represented with arrows (dashed arrows
indicate datatype properties, full-line arrows represent object properties). The type of an individual is
stated with a curved arrow.
For each ICF code involved in the description of an impairment, a “descriptor” individual is used;
descriptors are used to provide a univocal link for each ICF code and its qualifier, avoiding the use of a
reification [68].
146
Electronics 2018, 7, 345
In this way, it is possible to represent the full extent of ICF qualifiers and to model complex health
conditions, enabling the semantic representation of n-ary relationships without adding complexity to
the whole application ontology.
People suffering from maculopathy have issues in performing activities low illuminance and at
night-time and reported to have difficulties in reading [70]. In this case, it is thus, recommendable
to provide them with an intense and focused light, which can help them in distinguishing written
text. RoomFort can provide these type of users with more appropriate environmental conditions
by automatically adjusting the maintained illuminance, light colour and wall colour while they are
performing working activities in the room. Of course, RoomFort cannot address all the physiological
problems related to these conditions, neither it provides a permanent solution; instead, the system can
make the working activity more comfortable to those who are particularly fragile in some vision-related
dimension. Similarly, RoomFort can provide personalized comfort metrics related to persons who have
some form of impairment in the perception of temperature (described by ICF codes b2700 Sensitivity to
temperature; b550 Thermoregulatory functions; b5501 Maintenance of body temperature), respiratory
issues (described with ICF range of codes related to the functions of the respiratory system b440-b449).
In these cases, a guest travelling to a hotel equipped with RoomFort can upload (or ask his/her
physician to upload) his/her physiological status (formalized in an RDF/OWL ontology) and a set of
SWRL rules to adapt comfort metrics of the customized comfort set by increasing or decreasing the
illuminance and changing light colour. The SWRL acquires the following form:
The Customized Luminous Comfort Setting (CLCS) is modelled as a “regular” comfort setting,
but for instance in the case of a business traveller characterized by hypersensitivity to light, its comfort
setting is adjusted as shown in the following Figure 5.
147
Electronics 2018, 7, 345
Figure 5. An example of the modelling of a Customized Luminous Comfort Setting (CLCS) for a
traveller characterized by visual impairment. Individuals are represented with diamonds, concepts
are represented with circles, and roles are represented with arrows (dashed arrows indicate datatype
properties, full-line arrows represent object properties). The type of an individual is stated with a
curved arrow.
148
Electronics 2018, 7, 345
created with RDF/OWL, as well as already exploited in several studies on interoperability among
devices [71]. SAREF has been adopted to describe the devices deployed in the room used for RoomFort
tests (see further Section 5); in particular, for each device its type (sensor, actuator, appliance, light,
etc.) and specific ID are specified.
Figure 6. An example of the modelling of a measurement performed in the hotel room; individuals
are represented with diamonds, concepts are represented with circles, and roles are represented with
arrows (dashed arrows indicate datatype properties, full-line arrows represent object properties).
The type of an individual is stated with a curved arrow.
Each measurement acquired by a sensor is then classified thanks to a set of SWRL rule.
For instance, the following rule:
allows to classify an illuminance measurement when the guest specifies he/she wants to read in
the room as comfortable or uncomfortable; in the latter case, uncomfortable measurements enable
actuation and are used to suggest corrective actions. Moreover, as seen above, a similar modelling
can be adopted for the description of both Luminous Comfort Settings (LCS) and CLCS. In this case,
an individual representing the LCS is linked with its characteristics (through datatype properties
indicating the RGB code of the color of the light and the Em expressed in lux), as illustrated in Figure 7.
149
Electronics 2018, 7, 345
Figure 7. An example of the modelling of Luminous Comfort Setting (LCS); individuals are represented
with diamonds, concepts are represented with circles, and roles are represented with arrows (dashed
arrows indicate datatype properties). Please note that this specific LCS here represented is one of the
results coming from the evaluation of visual comfort in a hotel room (described in Section 6).
5.6. The RoomFort Application: Querying and Retrieving Data From the Ontology
RoomFort application is developed with Unity 3D [74] to run on Android devices (smartphone
and tablets). The applications’ interface has been designed to be user-friendly and the more intuitive
as possible. It allows the guest to select the activities and the area of the room (the bed or the desk,
for example) in which he/she wants to perform such activity. Moreover, the application can be used to
create novel CLCS according to guest’s responses and save them in the semantic repository. Figure 8
shows a user while experiencing the RoomFort application.
The application can exchange information with the semantic repository (and the ontologies hosted
in it) via a semantic middleware, a software developed with Java that allows to query the semantic
knowledge base using predefined SPARQL (SPARQL Protocol and RDF Query Language) [75] queries.
This program is run each time the guest decides to perform an activity inside the room and taps the
related button on the smartphone application interface to state her/his intention. The moment the
passenger taps the button on the application to perform an activity, the middleware program runs
to generate a proper SPARQL query with necessary input data to be able to retrieve information
regarding guest’s health condition. These input data are passed from application to the middleware
through a JSON (JavaScript Object Notation) file indicating the passenger’s name, the activity she/he
would like to perform, health-related data, the location where the activity is going to happen; the
JSON file is fed into the middleware as an input to generate the precise SPARQL queries to insert that
150
Electronics 2018, 7, 345
specific situation inside the ontology, retrieve the inferred data according to the new data inserted,
and finally delete the inserted data to have the ontology ready for the next execution. After generating
the correct SPARQL query, the middleware program runs the Stardog server, on which a query similar
to the following is performed:
a query that allows retrieving the luminous conditions suitable for relaxing on the bed. Similarly,
though the use of the SPARQL command INSERT a guest can add one or more LCS to the ontology—in
this case, to his/her preferences. The middleware operates by translating SPARQL queries’ results into
JSON files and feeding them to the actuators, the lamps near the bed, in this specific case.
Figure 8. A screenshot of the RoomFort application for Android devices. The user (identified by
his/her own ID number) selects an activity.
151
Electronics 2018, 7, 345
6.1. Methods
6.1.1. Participants
Twenty-eight adults aged 44.25 ± 17.09 have been enrolled in the study. All were in a good general
health status. Exclusion criteria were: moderate to severe vision or motor impairment; severe pain;
cognitive decline; inability to read Italian language; inability to provide informed written consent.
All the other demographic and clinical characteristics of the study participants are reported in Table 1.
Participants 28
Gender (M/F) 12/16
Age 44.25 ± 17.09
Education (Years) ⎧ 15.63 ± 3.13
⎪
⎪ Astigmatism : 43%
⎨
Myopia : 46%
Mild vision impairment 71% :
⎪
⎪ Presbyopia : 21%
⎩
Hyperopia : 11%
6.1.2. Equipment
The test took place in an indoor environment simulating a three-star hotel room. As depicted in
Figure 9, the guest enters the room through the entrance area that acts as an anteroom between the
bathroom and sleeping area. From this area, the guest can then access to the outdoor terrace. The room
dimensions—including the bathroom— were 3 × 6 m2 ; room height was 2.20 m. The room’s three
functional areas were furnished as follows:
• Entrance: wardrobe
• Sleeping area: bed 1 and 2, bedside Tables 1 and 2, chair 1, desk, minibar, TV
• Terrace: chair 2, table
152
Electronics 2018, 7, 345
The space and furniture organization inside the room matches the characteristics of the
environment described in the ontology. The room and the terrace were equipped with networked
devices able to monitor the environment and to deliver appropriate comfort metrics according to
each guest’s preferences and to the activity he/she is performing. For luminous comfort provision,
six Philips Hue spotlights were mounted on the ceiling and three table lamps mounting Philips Hue
bulbs were placed close to the table (see Figure 9). The light beams of these three lamps were directed
toward the white wall behind the table, so that light colors and temperature could be experienced at
their best by an individual sit at the table; this also allows to change the colour of the wall, according
to the selected LCS. A window allowing the daylight illumination of the room was present on the
shortest wall, however, not to influence the test results, it was covered with a dark curtain for the
whole tests’ duration (with the exception of the questionnaires’ answering time). To accomplish the
reading task, the users were provided with white-paper pages; the texts were taken from the Italian
edition of the books “La coscienza di Zeno” (Zeno’s Conscience, Italo Svevo, 1923) and “Utopia” (Utopia,
Thomas Moore, 1516). The choice of extracts not too easy to comprehend was intentional, to encourage
the user in concentrating during the activity accomplishment. Both texts were written with a serif
typeface (Georgia), pt. 12.
6.1.3. Protocol
Each subject performed the test in the above-mentioned environment, been administered with all
light conditions for the duration of both the activities. Each session started with one minute of dark
adaptation [77]. Each light condition lasted 2 min per activity, thus, resulting in: 2 min of reading with
condition (1), administration of the questionnaire (see Measures paragraph), 2 min of relaxing with
condition (1), administration of the questionnaire. At the end of such a series, one minute of dark
adaptation was performed and the light condition was changed. The whole test lasted about 25–30 min
per subjects. The four light conditions are presented in Table 2 and in Figure 10. Standards represent
the average illumination required for reading, i.e., the general condition that one can expect to find in
correspondence with a hotel room’s table. The other three conditions, namely “Relax”, “Concentration”
and “Red” were similar to the Philips Hue predefined light sets.
The choice of using predefined lighting sets is justified from the lack of scientific literature
regarding this topic; since to our knowledge no other studies investigating lighting comfort while
reading and relaxing in a hotel room have been conducted, we relied on the know-how and the
knowledge of a world-known manufacturer, such as Philips.
153
Electronics 2018, 7, 345
Table 2. Characteristics of the four light conditions used for the validation. RGB (Red, Green and Blue)
is the color model adopted.
Figure 10. The four light conditions: “Normative”, “Relax”, “Concentration” and “Red”.
6.1.4. Measures
To evaluate the rates of perceived comfort, an ad-hoc questionnaire—adapted from [37,78]—has
been developed. The questionnaire foresees three items aimed at investigating the satisfaction of the
users with respect to the light conditions during the accomplishment of a specific activity, and two
items about the user’s personal feelings.
(Q1) I am satisfied with the amount of light for reading;
(Q2) I am satisfied with the amount of light for relaxing;
(Q3) I like the vertical surface brightness;
Q4) I feel concentrated;
(Q5) I feel relaxed.
In all cases, the user had to indicate his/her level of agreement on a 7-point Likert scale ranging
from 1 (strongly disagree) to 7 (strongly agree).
6.2. Results
Results of the questionnaires for the two considered activities are reported in Table 3.
Table 3. Results of the questionnaires. Grouping information using the Turkey method and 95%
confidence level (means that do not share a letter are significantly different). Conc. = Concentration.
Reading Relaxing
Relax Conc. Red Normative Relax Conc. Red Normative
5.11 ±1.26 A 4.39 ±1.26 A 3.39 ±1.69 B 4.50 ±1.32 A 5.39 ±1.17 A 4.21±1.77 B 4.14 ±1.63 B 4.36 ±1.81 A,B
4.64 ±1.6 B 6.11 ±1.23 A 2.86 ±1.65 C 5.89 ±1.10 A 4.61 ±1.59 B 5.82 ±1.49 A 3.04 ±1.86 C 5.50 ±1.35 A,B
4.64 ±1.62 A 5.21 ±1.45 A 3.54 ±1.77 B 4.89 ±1.47 A 4.54 ±1.88 A,B 5.11 ±1.66 A,B 3.75 ±1.82 B 4.43 ±1.57 A,B
4.93 ±1.68 A 4.43 ±1.57 A,B 3.36 ±1.75 B 4.61 ±1.50 A 5.21 ±1.57 A 4.32 ±1.66 A,B 4.00 ±1.75 B 4.14 ±1.76 A,B
4.74 ±1.72 A 5.36 ±1.57 A 3.00 ±1.72 B 5.04 ±1.57 A 4.46 ±1.53 A 4.89 ±1.73 A 3.11 ±1.77 B 4.43 ±1.73 A
154
Electronics 2018, 7, 345
Figure 11. The modelling of the two Luminous Comfort Setting (LCS) deriving from the tests conducted
on luminous comfort evaluation. Individuals are represented with diamonds, concepts are represented
with circles, and roles are represented with arrows (dashed arrows indicate datatype properties).
155
Electronics 2018, 7, 345
156
Electronics 2018, 7, 345
rely on a safe and shared model to formalize guests’ data and comfort. Therefore, for a pervasive
adoption of RoomFort hotel industry must agree on a shared and sound ontological description of
the domains of interest, even considering the lack of ontological standards, as described in Sections 2
and 5. Using a shared vocabulary (as the one described in Section 5), each hotel can therefore describe
itself, its rooms and the services it provides. Nonetheless, RoomFort’s horizontal scalability allows
the system to be exploited also for the customization of comfort metrics in relation to other activities
performed in the room (eating, working with a laptop, watching the television, etc.).
RoomFort can be further developed into a Decision Support System (DSS); in fact, being aware of
the guests’ health condition and his/her needs, RoomFort can potentially provide the guest with a set
of most suitable LCS, CO2 concentration, indoor temperature and humidity rate to maximize his/her
comfort; in the particular case of guests afflicted by vision-related, respiratory-related or sensitivity
to temperature-related health problems the expedients provided by the DSS can potentially help the
guests in coping with their impairments while performing specific activities.
Finally, RoomFort—even if originally thought for business travellers due to their particular
necessities—can be adjust to work also for leisure tourists, especially in the context of CaaS,
in which leisure tourists can decide whether to purchase or not an additional, automatic and optimal
comfort settings.
157
Electronics 2018, 7, 345
uncomfortable feeling and increasing the comfort perception, the attractiveness of the hotel could
exponentially increases. RoomFort’s system architecture assures that no guest personal data is stored
in the hotel environment, so that privacy is preserved.
Future studies foresee the evaluation of RoomFort application for smartphones, following the
validation framework proposed in this work. A set of tests, aimed at validating RoomFort’s capabilities
to actuate modifications in temperature and humidity rate—by triggering the activation of the HVAC
system of the room—will also be deployed; then a test with participants will be aimed at evaluating the
quality of the provided actuation. Together with the management of visual comfort, this feature
can constitute a step towards the adoption of tailored holistic comfort in indoor environments.
Moreover, RoomFort will be tested also with leisure tourists, to understand their possible acceptance
of this technology in the context of providing optimal and energy-saving comfort management as an
additional service.
Author Contributions: D.S. developed the ontologies presented in this work, set the semantic repository,
contributed to the development of RoomFort architecture and supervised the writing of the first draft of this
paper. S.C. provided the description of the room and contributed to the enrollment of the 28 participants and to
the administration of the study together with M.N.; S.A. developed the study protocol, analyzed the outcomes,
wrote the study methods and results, and revised the whole manuscript; M.N. developed the application with the
help of S.A. and D.S., contributed to the development of RoomFort architecture and to the administration of the
study; M.S. contributed to the development of RoomFort and revised the manuscript together with S.A.
Funding: This research received no external funding.
Acknowledgments: This work has been founded by “Convenzione Operativa No. 19365/RCC” in the framework
of the project “Future Home for Future Communities”. Authors would like to acknowledge the 28 participants
who took part to the study.
Conflicts of Interest: The authors declare no conflict of interest.
Abbreviations
The following abbreviations are used in this manuscript:
References
1. World Travel & Tourism Council. Available online: https://www.wttc.org (accessed on 18 October 2018).
2. WTTC. Travel & Tourism Global Economic Impact & Issues 2018; WTTC: London, UK, 2018; p. 11.
3. Global Business Travel Association. Available online: https://www.gbta.org/membership-and-communities/
chapters-and-regions/europe (accessed on 18 October 2018).
4. Boyce, P.R.; Berman, S.M.; Collins, B.L.; Lewis, A.L.; Rea, M.S. Lighting and Human Performance: A Review;
National Electrical Manufacturers Association (NEMA) and Lighting Research Institute: Washington, DC,
USA, 1989.
5. Lovelock, C.; Wirtz, J.; Tat Keh, H.; Lu, X. Services Marketing in Asia: Managing People , Technology and Strategy,
2nd ed.; Prentice Hall, Pearson: Singapore, 2005; Volume 13.
6. Veitch, J.A.; Hine, D.W.; Gifford, R. End users: Knowledge, beliefs, and preferences for lighting. J. Inter. Des.
1993, 19, 15–26. [CrossRef]
158
Electronics 2018, 7, 345
7. Blomqvist, E. The use of Semantic Web technologies for decision support—A survey. Semant. Web 2014,
5, 177–201.
8. Vimalanathan, K.; Ramesh Babu, T. The effect of indoor office environment on the work performance,
health and well-being of office workers. J. Environ. Health Sci. Eng. 2014, 12, 113. [CrossRef] [PubMed]
9. Tila, F.; Kim, H. Semantic IoT System for Indoor Environment Control—A Sparql and SQL based hybrid
model. Adv. Sci. Technol. Lett. 2015, 120, 678–683.
10. Pan, J.Z. Resource Description Framework. In Handbook on Ontologies; Springer: Berlin/Heidelberg, Germany,
2009; pp. 71–90.
11. Zeiler, W.; Van Houten, M.; Savanović, P.; Zeiler, W.; Van Houten, R.; Boxem, G.; Savanovic, P.;
Van Der Velden, J.; Wortel, W.; Haan, J.F.; et al. Flexergy: An Ontology to Couple Decentrilised Sustainable
Comfort Systems with Centralised Energy Infrastructures; Technical Report; Technische Universiteit Eindhoven:
Eindhoven, The Netherlands, 2009.
12. Mahroo, A.; Spoladore, D.; Caldarola, E.G.; Modoni, G.; Sacco, M. Enabling the Smart Home Through a
Semantic-Based Context-Aware System. In Proceedings of the PerLS’18—Second International Workshop on
Pervasive Smart Living Spaces IEEE International Conference on Pervasive Computing and Communication,
Athens, Greece, 19–23 March 2018.
13. Bonino, D.; Corno, F. DogOnt—Ontology modeling for intelligent domotic environments. In International
Semantic Web Conference; Springer: Berlin/Heidelberg, Germany, 2008; pp. 790–803.
14. Frešer, M.; Cvetković, B.; Gradišek, A.; Luštrek, M. Anticipatory system for T–H–C dynamics in room with
real and virtual sensors. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and
Ubiquitous Computing Adjunct—UbiComp ’16, Heidelberg, Germany, 12–16 September 2016; pp. 1267–1274.
15. McGuinness, D.L.; Van Harmelen, F. OWL Web Ontology Language Overview. W3C Recomm. 2004.
Available online: http://www.w3.org/TR/owl-features/ (accessed on 18 October 2018).
16. Horrocks, I.; Patel-schneider, P.F.; Boley, H.; Tabet, S.; Grosof, B.; Dean, M. SWRL: A Semantic Web Rule
Language Combining OWL and RuleML. W3C Memb. Submiss. 2004, 21, 1–20.
17. Adeleke, J.A.; Moodley, D. An Ontology for Proactive Indoor Environmental Quality Monitoring and
Control. In Proceedings of the 2015 Annual Research Conference on South African Institute of Computer
Scientists and Information Technologists—SAICSIT ’15, Stellenbosch, South Africa, 28–30 September 2015;
pp. 1–10.
18. Stavropoulos, T.G.; Vrakas, D.; Vlachava, D.; Bassiliades, N. BOnSAI. In Proceedings of the 2nd International
Conference on Web Intelligence, Mining and Semantics—WIMS ’12, Craiova, Romania, 6–8 June 2012; p. 1.
19. Martin, D.; Burstein, M.; Hobbs, J.; Lassila, O.; McDermott, D.; McIlraith, S.; Narayanan, S.; Paolucci, M.;
Parsia, B.; Payne, T.; et al. OWL-S: Semantic markup for web services. W3C Memb. Submiss. 2004. Available
online: https://www.w3.org/Submission/OWL-S/(accessed on 18 October 2018).
20. Reinisch, C.; Kofler, M.J.; Kastner, W. ThinkHome: A smart home as digital ecosystem. In Proceedings of the
4th IEEE International Conference on Digital Ecosystems and Technologies, Dubai, UAE, 13–16 April 2010;
pp. 256–261.
21. Spoladore, D.; Arlati, S.; Sacco, M. Semantic and Virtual Reality-Enhanced Configuration of Domestic
Environments: The Smart Home Simulator. Mob. Inf. Syst. 2017, 2017, 3185481. [CrossRef]
22. Borràs, J.; Moreno, A.; Valls, A. Intelligent tourism recommender systems: A survey. Expert Syst. Appl. 2014,
41, 7370–7389. [CrossRef]
23. Kim, D.; Kim, S. The role of mobile technology in tourism: Patents, articles, news, and mobile tour app
reviews. Sustainability 2017, 9, 2082. [CrossRef]
24. Petrina, O.; Petrina, O.B. Smart Spaces Based Construction and Personalization of Recommendation Services
for Historical e-Tourism of Recommendation Services for Historical e-Tourism. Int. J. Adv. Intell. Syst. 2016,
9, 85–95.
25. Smirnov, A.; Shilov, N.; Kashevnik, A.; Ponomarev, A. Cyber-physical infomobility for tourism application.
Int. J. Inf. Technol. Manag. 2017, 16, 31. [CrossRef]
26. Moreno, A.; Valls, A.; Isern, D.; Marin, L.; Borràs, J. SigTur/E-Destination: Ontology-based personalized
recommendation of Tourism and Leisure Activities. Eng. Appl. Artif. Intell. 2013, 26, 633–651. [CrossRef]
27. Kolcaba, K.Y. Holistic comfort: Operationalizing the construct as a nurse-sensitive outcome. Adv. Nurs. Sci.
1992, 15, 1–10. [CrossRef]
159
Electronics 2018, 7, 345
28. Chu, R.K.; Choi, T. An importance-performance analysis of hotel selection factors in the Hong Kong hotel
industry: A comparison of business and leisure travellers. Tour. Manag. 2000, 21, 363–377. [CrossRef]
29. Buso, T.; Dell’Anna, F.; Becchio, C.; Bottero, M.C.; Corgnati, S.P. Of comfort and cost: Examining indoor
comfort conditions and guests’ valuations in Italian hotel rooms. Energy Res. Soc. Sci. 2017, 32, 94–111.
[CrossRef]
30. Striker, J.; Luippold, R.S.; Nagy, L.; Liese, B.; Bigelow, C.; Mundt, K.A. Risk factors for psychological stress
among international business travellers. Occup. Environ. Med. 1999, 56, 245–252. [CrossRef] [PubMed]
31. Gilbert, D.C.; Morris, L. The relative importance of hotels and airlines to the business traveller. J. Contemp.
Hosp. Manag. 1995, 7, 19–23. [CrossRef]
32. Ariffin, A.A.M.; Aziz, N.A. The Effect of Physical Environment’s Innovativeness on the Relationship between
Hosting Quality and Satisfaction in Hotel Services. Int. J. Trade Econ. Financ. 2012, 3, 337–342. [CrossRef]
33. Ryu, K.; Jang, S.C.S. The Effect of Environmental Perceptions on Behavioral Intentions Through Emotions:
The Case of Upscale Restaurants. J. Hosp. Tour. Res. 2007, 31, 56–72. [CrossRef]
34. Bohdanowicz, P.; Martinec, I.; Martinac, I. Thermal comfort and energy-savings in the hotel industry.
In Proceedings of the Conference on Biometeorology and Aerobiology Joint with the 16th International
Congress on Biometeorology, Kansas City, MI, USA, 28 October–1 November 2002; Volume 1, pp. 396–400.
35. Magnini, V.P.; Parker, E.E. The psychological effects of music: Implications for hotel firms. J. Vacat. Mark.
2009, 15, 53–62. [CrossRef]
36. Fisk, W.J. Health and Productivity Gains from Better Indoor Environments and their Relationship with
Building Energy Efficiency. Annu. Rev. Energy Environ. 2000, 25, 537–566. [CrossRef]
37. Van Den Wymelenberg, K.; Inanici, M. A critical investigation of common lighting design metrics for
predicting human visual comfort in offices with daylight. LEUKOS J. Illum. Eng. Soc. N. Am. 2014, 10,
145–164. [CrossRef]
38. Abbas, N.; Kumar, D.; McLachlan, N. The psychological and physiological effects of light and colour on
space users. In Proceedings of the IEEE Engineering in Medicine and Biology 27th Annual Conference,
Shanghai, China, 17–18 January 2006; Volume 2, pp. 1228–1231.
39. Baron, R.A.; Rea, M.S.; Daniels, S.G. Effects ofindoor lighting (illuminance and spectral distribution) onthe
performance of cognitive tasks and interpersonalbehaviors: The potential mediating role of positive affect.
Motiv. Emot. 1992, 1, 1–33. [CrossRef]
40. Samani, S.A.; Samani, S.A. The impact of indoor lighting on students’ learning performance in learning
environments: A knowledge internalization perspective. Int. J. Bus. Soc. Sci. 2012, 3, 127–136.
41. Shamsul, B.; Sia, C.; Ng, Y.; Karmegan, K. Effects of Light’s Colour Temperatures on Visual Comfort Level,
Task Performances, and Alertness among Students. Am. J. Public Health Res. 2013, 1, 159–165. [CrossRef]
42. Ariffin, A.A.M.; Maghzi, A. A preliminary study on customer expectations of hotel hospitality: Influences of
personal and hotel factors. Int. J. Hosp. Manag. 2012, 31, 191–198. [CrossRef]
43. Küller, R.; Ballal, S.; Laike, T.; Mikellides, B.; Tonello, G. The impact of light and colour on psychological
mood: A cross-cultural study of indoor work environments. Ergonomics 2006, 49, 1496–1507. [CrossRef]
[PubMed]
44. Odabaşioğlu, S.; Olguntürk, N. Effects of Coloured Lighting on the Perception of Interior Spaces. Percept. Mot.
Skills 2015, 120, 183–201. [CrossRef] [PubMed]
45. Siamionava, K.; Slevitch, L.; Tomas, S.R. Effects of spatial colors on guests’ perceptions of a hotel room. Int. J.
Hosp. Manag. 2018, 70, 85–94. [CrossRef]
46. Countryman, C.C.; Jang, S. The effects of atmospheric elements on customer impression: The case of hotel
lobbies. Int. J. Contemp. Hosp. Manag. 2006, 18, 534–545. [CrossRef]
47. Minazzi, R. Hotel Classification Systems: A Comparison of International Case Studies. Economica 2012, 4,
64–86.
48. HOTREC Hotels, Restaurants & Cafés in Europa. Available online: https://www.hotrec.eu (accessed on
18 October 2018).
49. Gazzetta Ufficiale. Decree 21 October 2001, in the Gazzetta Ufficiale n. 34, 11 February 2009. Available
online: http://www.gazzettaufficiale.it/eli/gu/2009/02/11/34/sg/pdf (accessed on 18 October 2018).
50. Cuzzocrea, A.; Grasso, G.M.; Nolich, M. Effective and efficient distributed management of big clinical data:
A framework. Int. J. Data Min. Model. Manag. 2018, in press.
160
Electronics 2018, 7, 345
51. Wei, W.; Barnaghi, P. Semantic annotation and reasoning for sensor data. In European Conference on Smart
Sensing and Context; Springer: Berlin/Heidelberg, Germany, 2009; pp. 66–76.
52. Buqi, R.; Carciotti, S.; Cipriano, M.; Ferrari, P.; Nolich, M. Cruise cabin as a home: Smart approaches
to improve cabin comfort. In Proceedings of the NAV 2018: 19th International Conference on Ship and
Maritime Research, Trieste, Italy, 20–22 June 2018; pp. 647–654.
53. Gruber, T.R. A Translation Approach to Portable Ontology Specifications. Knowl. Acquis. 1993, 5, 199–220.
[CrossRef]
54. Pérez, A.; Baonza, M.D.F.; Villazón, B. Neon Methodology for Building Ontology Networks: Ontology Specification;
Technical Report February; Departamento de Inteligencia Artificial, Facultad de Informática, Universidad
Politécnica de Madrid: Madrid, Spain, 2008.
55. Fernández-López, M.; Gómez-Pérez, A.; Juristo, N. METHONTOLOGY: From Ontological Art Towards
Ontological Engineering. In Proceedings of the AAAI-97 Spring Symposium on Ontological Engineering,
Stanford, CA, USA, 24–26 March 1997; pp. 33–40.
56. International Classification of Functioning, Disability and Health. Available online: https://www.bioportal.
bioontology.org/ontologies/ICF (accessed on 18 October 2018).
57. Hepp, M. Accommodation Ontology Language Reference; Technical Report; Hepp Research GmbH: Innsbruck,
Austria, 2013.
58. Daniele, L.; den Hartog, F.; Roes, J. Created in Close Interaction with the Industry: The Smart Appliances
REFerence (SAREF) Ontology. In Lecture Notes in Business Information Processing; Springer: Cham,
Switzerland, 2015; Volume 225, pp. 100–112.
59. Spoladore, D.; Arlati, S.; Nolich, M.; Carciotti, S.; Rinaldi, A. Ontologies’ definition for modeling the cabin
comfort on cruise ships. In Proceedings of the NAV 2018: 19th International Conference on Ship and
Maritime Research, Trieste, Italy, 20–22 June 2018; pp. 877–884.
60. Motik, B.; Sattler, U.; Studer, R. Query answering for OWL-DL with rules. Web Semant. Sci. Serv. Agents
World Wide Web 2005, 3, 41–60. [CrossRef]
61. World Health Organization. International Classification of Functioning, Disability and Health: ICF; World Health
Organization: Geneva, Switzerland, 2001.
62. Spoladore, D. Ontology-based decision support systems for health data management to support collaboration
in ambient assisted living and work reintegration. In Proceedings of the 18th IFIP WG 5.5 Working
Conference on Virtual Enterprises, Vicenza, Italy, 18–20 September 2017; Volume 506, pp. 341–352.
63. Arlati, S.; Spoladore, D.; Mottura, S.; Zangiacomi, A.; Ferrigno, G.; Sacchetti, R.; Sacco, M. Architecture of a
virtual reality and semantics-based framework for the return to work of wheelchair users. In International
Conference on Augmented Reality, Virtual Reality and Computer Graphics; Springer: Cham, Switzerland, 2017;
Volume 10325, pp. 74–85.
64. Okochi, J.; Utsunomiya, S.; Takahashi, T. Health measurement using the ICF: Test-retest reliability study of
ICF codes and qualifiers in geriatric care. Health Qual. Life Outcomes 2005, 3, 46. [CrossRef] [PubMed]
65. Spoladore, D.; Sacco, M. Semantic and Dweller-Based Decision Support System for the Reconfiguration of
Domestic Environments: RecAAL. Electronics 2018, 7, 179. [CrossRef]
66. Della Mea, V.; Simoncello, A. An ontology-based exploration of the concepts and relationships in the
activities and participation component of the international classification of functioning, disability and health.
J. Biomed. Semant. 2012, 3, 1. [CrossRef] [PubMed]
67. Andronache, A.S.; Simoncello, A.; Della Mea, V.; Daffara, C.; Francescutti, C. Semantic aspects of the
International Classification of Functioning, Disability and Health: Towards sharing knowledge and unifying
information. Am. J. Phys. Med. Rehabil. 2012, 91, S124–S128. [CrossRef] [PubMed]
68. Noy, N.; Rector, A.; Hayes, P.; Welty, C. Defining N-Ary Relations on the Semantic Web. W3C Work. Group
Note. 2006. Available online: https://www.w3.org/TR/swbp-n-aryRelations/ (accessed on 18 October 2018).
69. Da Silva, M.R.; de Souza Nobre, M.I.R.; de Carvalho, K.M.; de Cássia Ietto Montilha, R. Visual impairment,
rehabilitation and International Classification of Functioning, Disability and Health. Rev. Bras. Oftalmol.
2014, 73, 291–301. [CrossRef]
70. Owsley, C.; McGwin, G.; Scilley, K.; Kallies, K. Development of a questionnaire to assess vision problems
under low luminance in age-related maculopathy. Investig. Ophthalmol. Vis. Sci. 2006, 47, 528–535. [CrossRef]
[PubMed]
161
Electronics 2018, 7, 345
71. Daniele, L.; den Hartog, F.; Roes, J. How to keep a reference ontology relevant to the industry: A case
study from the smart home. In International Experiences and Directions Workshop on OWL; Springer: Cham,
Switzerland, 2016; Volume 9557, pp. 117–123.
72. Rohloff, K.; Dean, M.; Emmons, I.; Ryder, D.; Sumner, J. An Evaluation of Triple-Store Technologies for
Large Data Stores. In OTM Confederated International Conferences “On the Move to Meaningful Internet Systems”;
Springer: Berlin/Heidelberg, Germany, 2007; pp. 1105–1114.
73. Stardog 5—Knowledge Graph Platform. Available online: https://www.stardog.com/docs/ (accessed on
18 October 2018).
74. Unity. Available online: https://unity3d.com/ (accessed on 18 October 2018).
75. Sirin, E.; Parsia, B. SPARQL-DL: SPARQL query for OWL-DL. In Proceedings of the OWLED 2007 Workshop
on OWL: Experiences and Directions, Innsbruck, Austria, 6–7 June 2007.
76. Oral, G.K.; Yener, A.K.; Bayazit, N.T. Building envelope design with the objective to ensure thermal, visual
and acoustic comfort conditions. Build. Environ. 2004, 39, 281–287. [CrossRef]
77. Ohta, N.; Robertson, A. Colorimetry: Fundamentals and Applications; John Wiley & Sons: Hoboken, NJ,
USA, 2006.
78. Wang, Q.; Xu, H.; Zhang, F.; Wang, Z. Influence of color temperature on comfort and preference for LED
indoor lighting. Optik 2017, 129, 21–29. [CrossRef]
79. Izsó, L.; Láng, E.; Laufer, L.; Suplicz, S.; Horváth, Á. Psychophysiological, performance and subjective
correlates of different lighting conditions. Light. Res. Technol. 2009, 41, 349–360 [CrossRef]
80. Viola, A.U.; James, L.M.; Schlangen, L.J.M.; Dijk, D.J. Blue-enriched white light in the workplace improves
self-reported alertness, performance and sleep quality. Scand. J. Work Environ. Health 2008, 34, 297–306.
[CrossRef] [PubMed]
81. Gómez-Romero, J.; Molina-Solana, M.; Ros, M.; Ruiz, M.D.; Martin-Bautista, M.J. Comfort as a service:
A new paradigm for residential environmental quality control. Sustainability 2018, 10, 3053. [CrossRef]
82. Brooke, J. SUS-A quick and dirty usability scale. Usabil. Eval. Ind. 1996, 189, 4–7.
83. Venkatesh, V.; Davis, F.D. A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal
Field Studies. Manag. Sci. 2000, 46, 186–204. [CrossRef]
c 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
162
electronics
Article
Using Entropy of Social Media Location Data for the
Detection of Crowd Dynamics Anomalies
Carlos Garcia-Rubio 1 , Rebeca P. Díaz Redondo 2 , Celeste Campo 1, * and Ana Fernández Vilas 2
1 Department of Telematic Engineering, University Carlos III of Madrid, Avda. Universidad 30, Leganés,
E-28911 Madrid, Spain; [email protected]
2 Information & Computing Lab., AtlantTIC Research Center, School of Telecommunications Engineering,
University of Vigo, E-36310 Vigo, Spain; [email protected] (R.P.D.R.); [email protected] (A.F.V.)
* Correspondence: [email protected]
Abstract: Evidence of something unusual happening in urban areas can be collected from different
data sources, such as police officers, cameras, or specialized physical infrastructures. In this paper,
we propose using geotagged posts on location-based social networks (LBSNs) to detect crowd
dynamics anomalies automatically as evidence of a potential unusual event. To this end, we use the
Instagram API media/search endpoint to collect the location of the pictures posted by Instagram users
in a given area periodically. The collected locations are summarized by their centroid. The novelty of
our work relies on using the entropy of the sequence of centroid locations in order to detect abnormal
patterns in the city. The proposal is tested on a data set collected from Instagram during seven
months in New York City and validated with another data set from Manchester. The results have also
been compared with an alternative approach, a training phase plus a ranking of outliers. The main
conclusion is that the entropy algorithm succeeds inn finding abnormal events without the need for
a training phase, being able to dynamically adapt to changes in crowd behavior.
Keywords: city behavior; anomaly detection; location-based social networks; data mining algorithms
1. Introduction
Any city management department is interested in detecting unusual events in the urban area as
early as possible. Being aware of any unexpected situation going on in the city allows city management
departments to take action, for instance by controlling traffic or public transportation or informing the
city inhabitants. Many of the detection techniques are based on noticing the unexpected behavior of
groups of people (e.g., abnormally high or low number of citizens) using cameras or other advanced
devices in smart cities. The main drawback of this approach is the need to deploy a specialized physical
infrastructure in the area under study.
To overcome this limitation, location-based social networks (LBSNs) seem to be an interesting
approach: no specific infrastructure is needed to collect the data, but the citizens themselves are the
ones who buy, maintain, and carry the needed mobile devices; and they freely disclose their location
throughout the day by proactively posting pictures or tweets, thus making the process seamless to
them. This paradigm allows collecting a high volume of data, coming from many different users,
distributed throughout all the city, thus becoming a good proxy for representing the behavior of the city.
However, collecting the continuous stream of LBSN data, summarizing and analyzing it, and actually
detecting the anomalies are tasks that may lead to an important computational cost, thus making it
difficult to be applied in real time.
With this trade-off in mind, we propose a novel approach to detect potential anomalies as they
happen with an efficient methodology. The idea is to sample at intervals the location data of Instagram
posts to represent the behavior of citizens. The collected locations at each interval will be summarized
by their centroid. The novelty of our work relies on the use of entropy to analyze the sequence
of centroid locations (one per interval) in order to detect anomalies. Since entropy measures the
uncertainty of the next event in a sequence, when something unusual happens and the citizens’
locations greatly vary, we expect changes in the value of entropy.
This approach is shown to be quick enough to spot changes in the city behaviors as they happen,
since entropy calculation is an easy iterative process. Although entropy has been traditionally used for
outlier detection in many areas, to our knowledge, there are no previous approaches applying this
strategy to detect crowd dynamics anomalies in urban areas. In this paper, we propose how to go from
location information of a crowd to a sequence of symbols to which Shannon’s entropy definition can
be applied.
The rest of the paper is as follows: Section 2 overviews other alternatives to detect anomalies
in crowd behavior, whereas our approach is detailed in Section 3; after that, we present the data
set and how the parameters of the algorithm are selected in Section 4. In Section 5, we validate the
entropy-based methodology for crowd anomalies detection in the city. In Section 6, we discuss the
limitations of our approach. Finally, we discuss the conclusions in Section 7.
2. Related Work
Early detection of unusual events in urban areas is a challenge that has been tackled from
different sides. Besides the video-processing techniques [1,2], the use of public posts shared in social
media has recently constituted a novel focus of attention [3]. Some approaches focus on the shared
content, for example the analysis of text messages to detect events, like in [4] or [5], where Twitter
and Instagram were the data sources. Other proposals go further and try to detect natural disasters,
such as earthquakes [6] or forest fires [7].
However, users’ locations are becoming more important, especially since LBSNs are so popular.
In [8], tweets were collected and assigned to previously-defined regions in intervals of six hours,
which makes the possibility of the early detection of events difficult. Twitter was also used in [9],
where a high activity triggers the system. Later, those tweets were analyzed to know if the event was
already expected or not. In this case, the detection does not work for low activity behaviors, even if
they are rare indeed. The proposal in [10] tried to detect and monitor local social events by applying
clustering (k-means), although this technique requires specifying the number of cluster in advance,
which is not flexible enough for detection purposes.
Previous work also faced crowd detection based on geolocated posts by using density-based
clustering [11,12] without imposing an a priori decision about the number of clusters or their shape.
In spite of having obtained sound and accurate results, its computation cost suggests applying this
approach only when other evidence of unexpected behavior has been detected.
All works above face the problem of identifying events that do not match an expected pattern,
which is established by applying both supervised or unsupervised machine learning approaches.
Once a regular pattern is defined, any anomaly detection technique may be applied. However,
a pattern-based approach implies a two-step process, whose success depends on the availability of
training data and, more importantly, on the ability to maintain an up-to-date pattern throughout time.
On the contrary, entropy-based outlier detection, the novel approach in this paper, exploits the entropy
behavior to minimize both drawbacks: (i) anomalous data increase the entropy values, so no previous
patterns are needed, and (ii) the entropy levels are continuously adapted as long as new geolocated
data are extracted from social media.
164
Electronics 2018, 7, 380
The problem scenario is as follows. We consider the locations of the people distributed throughout
a specific city and summarize them by their centroid. The centroid location changes throughout the
day and also depends on the day itself. However, how the location changes throughout a particular
day is similar if we compare the same day of the week (e.g., Tuesdays) across different weeks, except
when an abnormal or unexpected event is taking place. Thus, we need to determine and track the
location of the centroid at intervals, to detect deviations from the normal weekly track, for each day of
the week.
Breaking the problem into its parts, the general methodology proposed is as follows:
1. First, we need to obtain the data representing the distribution of the people all over the
considered city.
2. The next step is to identify the location of the people’s concentration. Then, the crowd tracking
generates a sequence of locations that represent the crowd behavior, for each day, separately.
3. Then, we need to measure how “normal” or “unexpected” the behavior represented by the
locations sequence is.
4. In order to deal with such an amount of data, we need to summarize the data through some
indicator that is fast to retrieve, as well as expressive enough so as to reflect anomalies.
5. Finally, we need to detect possible abnormal behaviors from the previous measurements.
Our proposal is implemented as follows. In order to determine people locations, we used data
collected from Instagram: we obtained the location of the pictures posted by this LBSN’s users
throughout the city, and we grouped them into time periods, T.
Three time intervals, T, were tested: 15, 30, and 60 min. For shorter time intervals (less than
15 min), the number of posts would not be statistically significant in order to detect behavioral
variations reliably (with the Instagram API, we obtained up to 200 posts on average every 15 min).
On the other hand, longer time intervals would introduce too much delay when detecting an event.
Thus, each day of the week was divided into 15–60 min chunks, and the data about the posts in each
chunk provided by Instagram were aggregated to compute the distribution of the geotagged Instagram
posts in the city.
We assumed that the variations in the geographical distribution of geotagged posts in Instagram
could be used to track variations in the location of the whole population in the city. In other words,
we assumed that any event that produced an abnormally high or low number of citizens in an area
would reflect in the geotagged post distribution on Instagram. See Section 6 for a discussion on content
bias in crowd-sourced geographic information.
Once we had the locations of posts in the last T period, the centroid of the locations was calculated
to summarize the data at each interval, using the Haversine distance, since the points are on the
Earth’s surface.
After that, we need to transform the centroid coordinates (one per interval) into the symbolic
domain, which allows computing the entropy of the sequence later on. In order to do so, the city was
split into S × S non-overlapping cells of the same size. Then, each cell was labeled with a symbol.
The position of the centroid at each temporal interval was identified by the symbol of the cell that
enclosed that position. Thus, the city behavior was expressed as a sequence of symbols. We tested
different grid resolutions, from 3 × 3–9 × 9.
Next, we quantified the behavior of the centroid movement as the deviation from the expected
uncertainty of that centroid movement. People movements have some degree of randomness, as shown
in [13], and so does the behavior of the resulting crowd. However, big deviations from the expected
value of uncertainty can potentially unveil unexpected events. This way, we allowed the centroid
movement to have the expected level of randomness, but we aimed to capture the times in which that
randomness was too different from the expected value. One way to measure the expected uncertainty
of a sequence of symbols pertaining to an alphabet L is through the information theory concept
165
Electronics 2018, 7, 380
of Shannon entropy. We will now introduce the concept of entropy and its practical interpretation.
A wider review on this topic can be found in [14,15].
Let X be a discrete random variable taking values on an alphabet L , |L | being the cardinality of
the alphabet, with Probability Mass Function (PMF) Pr ( X = l ) = p (l ) , ∀l ∈ L . Then, the Shannon
entropy of X can be written as:
H = − ∑ p(l ) log2 p(l ) (1)
l ∈L
where the base two logarithm denotes that the resulting entropy value is measured in bits and where
p(l ) is the probability of symbol l. Paying attention to the practical meaning of entropy, H measures
the expected “surprise” or uncertainty enclosed by the random variable X.
Since the probability mass function p(l ) is not available, and our data were not an infinite sequence
of symbols, we approximate it by a maximum likelihood estimator based on the observable data:
Nl,i
p(l, i ) = ,0 ≤ i ≤ n (2)
i
where Nl,i is the number of appearance of location l in the sequence from the beginning up to time
interval i and n is the total number of time intervals.
Applying this to the entropy formula, for each time interval, i, we have:
As we will explain later, at each interval, we will calculate the entropy from the beginning of
the sequence up to that interval, H, and also the entropy considering just the last win symbols of the
sequence, Hwin , with win ranging from 2 weeks–2 months. For Hwin we will use Equation (3), but with
p(l, i ) being:
Nwl,i
p(l, i ) = , win ≤ i ≤ n (4)
win
where Nwl,i is the number of appearances of location l in the last win symbols of the sequence (from
i − win + 1–i).
Finally, we inspect the values of the entropy calculated at each time interval i, H (i ), or Hwin (i ),
depending on whether we consider the entropy from the beginning of the last win symbols, and label as
potential anomalies those samples with higher entropy differences with respect to the previous value.
In the next section, this methodology is applied to a specific scenario, analyzing the
parameter selection (time interval duration, grid size, entropy calculation details) and discussing
the results obtained.
166
Electronics 2018, 7, 380
167
Electronics 2018, 7, 380
Figure 1. Entropy evolution of Thursdays for different values of time interval (T min), grid resolution
(S), and sequence window (win weeks).
Date Event
12 October 2015 Columbus Day
12 October 2015 Halloween
11 November 2015 Veterans Day
26 November 2015 Thanksgiving Day
24 December 2015 Christmas’ Eve
25 December 2015 Christmas
31 December 2015 New Year’s Eve
1 January 2016 New Year
In Figure 2, we plot the results of this analysis for different parameter combinations of T, S, and
W. With W = 4 weeks, we can spot up to 55% of special days in the first 20% of the total ordered
days. Therefore, in order to identify the highest number possible by considering the least number
of total days, a window of 4 weeks is preferable, combined with T = 15 min and any grid size
(both S = 5 × 5 and S = 7 × 7 overlap). Besides these results, something even more interesting came
up during the analysis. Taking a look at the steepest changes in entropy (the top values in the ordered
list), we further analyzed the contents of the posts and discovered that three of the days at the top
of the list corresponded to an unknown event for us: the Comic Con conference, held in New York
during 8–11 October (The identification of the cause of the event was made in this work by manually
inspecting the posts of that day. In another independent work, we showed how a story detection
process can be used (using natural language processing) to find out what is happening in an area [16]).
That discovery ignited the expectations regarding the method proposed as one to capture unexpected
168
Electronics 2018, 7, 380
behaviors quickly in the city for further analysis using more computationally-expensive techniques to
understand exactly what is going on.
ZHHNVZLQGRZ
[PLQ
[PLQ
[PLQ
'HWHFWHGDEQRUPDOGD\V
1XPEHURIGD\V
5. Validation
In this section, we validate the entropy-based methodology for crowd anomalies detection.
First, we compare the abnormal days detected in the data set described in Section 4.1 using our
technique with the ones detected using a different approach. Second, we test the effectiveness of our
technique with a different data set.
169
Electronics 2018, 7, 380
an abnormal distance from other values. We can display the observations in a box plot with the median
and the lower and upper quartiles (defined as the 25th and 75th percentiles). We define the lower
quartile as Q1 , the upper quartile as Q3 , and the difference (Q3 − Q1 ) as the interquartile range (IQR).
Then, according to [17], we define the following values (often called fences):
where δ = 1.5 is used for moderate outliers (UMO and LMO) and δ = 3 for extreme outliers (UEO and
LEO). These values of δ are the standards in exploratory data analysis ([17,19]). However, and in order
to avoid negative numbers, we have redefined the lower limits as follows:
This definition reflects that a cluster in the real-time clustering should be considered with an unusually
low number of points when it is lower than the minPoints used to obtain the reference clustering,
and extremely low when the cluster is empty.
Therefore, identifying an outlier is as simple as comparing the number of data points in a cluster
belonging to the real-time clustering with the number of points in the correspondent cluster in the
reference cluster. Consequently, if the value is greater than the UEO, we know that the activity should
be considered highly abnormal; if the value is greater than the UMO, but lower than the UEO, we know
that the activity should be considered as unexpected; if the value is lower than the LEO, we know that
the activity should be considered highly abnormal; and finally, if the value is lower than the LMO,
but greater than the LEO, the activity should be considered as unexpected.
The essential issue here is to know which is the cluster in the reference cluster that should be used
for the previous comparison, i.e., which is the cluster in the reference cluster that fits the cluster under
study. In order to determine this important aspect, we have defined the distance between two clusters
Cx and Py as follows:
n
1 Cx
nCx i∑
dist xy = dist xiy
=0
were nCx is the number of points in the cluster Cx and dist xi y is the distance between a point c xi ,
which belongs to cluster Cx , and the cluster Py . Our definition of this distance, between a point and a
cluster, is the following one:
i.e., it is the distance between the point c xi and the closest point that belongs to Py .
Finally, a cluster Cx is considered to fit the reference cluster Py if it holds that:
The definitions above allow us to compare both clustering by comparing individually each cluster
in the real-time clustering with all the clusters in the reference clustering as follows:
1. When a cluster in the real-time clustering fits (according to Equation (5)) a cluster in the reference
clustering, the number of points in the former is compared to the four thresholds in order to find
out if there is any kind of anomaly.
2. If more than one cluster in the real-time clustering fits the same cluster in the reference clustering,
they will be considered as a unique cluster, i.e., they are merged. Then, the number of points in
170
Electronics 2018, 7, 380
the merged clusters is compared with the four thresholds in order to find out if there is any kind
of anomaly.
3. All the clusters in the real-time clustering that do not fit any cluster in the reference clustering
are considered as Position Outliers (PO), since it entails that we have detected activity in the
real-time clustering in areas where it was not expected according to the reference clustering.
4. If no cluster in the reference clustering fits a cluster in the real-time clustering, we consider that
the cluster exists with zero points, and it is considered as a Position Outlier (PO), since there is
not activity in a specific area where it is expected according to the reference clustering.
As a result of the comparison between the real-time clustering and the reference clustering,
we will have a set of clusters that constitutes the difference clustering. The analysis of this difference
clustering allowed us to infer if the activity in the area under study was the expected one or if it shows
some outliers [12].
1. if the cluster has a Number of Points (NoP) greater than the LMO and lower than the UMO,
the DoA is zero, i.e., the cluster represents an expected or normal behavior.
2. If the cluster has an NoP greater than the UMO, the DoA is the result of subtracting the UMO
from the NoP. This applies for those clusters.
3. If the cluster has an NoP lower than the LMO, the DoA is the result of subtracting the NoP form
the LMO.
4. If the cluster is a Position Outlier (PO), the DoA is the result of adding its NoP to the maximum
DoA calculated for the other clusters in the difference clustering.
The result of adding the obtained values for all the clusters in the difference clustering is the
Degree of Anomaly (DoA) of the difference clustering.
171
Electronics 2018, 7, 380
0͘5
0͘45
0͘4
0͘35
0͘3
Entropy
0͘25
0͘2
0͘15
0͘1
0͘05
0
1 8 15 22 29 36 43 50 57 64 71 78 85 92 99 106 113 120 127
Day in the data set (ordered by entropy)
18͕000
16͕000
14͕000
Degree of Anomaly (DoA)
12͕000
10͕000
8͕000
6͕000
4͕000
2͕000
0
1 8 15 22 29 36 43 50 57 64 71 78 85 92 99 106 113 120 127
Day in the data set (ordered by DoA)
Figure 4. Days in the data set ordered according to the degree of anomaly of the difference clustering.
172
Electronics 2018, 7, 380
• The algorithms needed some history to compare past behaviors with present behaviors and to
be able to decide if one day was abnormal or not. We have established this initial transient in
four weeks. 16 September was the fist day after this transient period, and it was still considered
abnormal by the entropy algorithm, not so by the DoA algorithm.
• The entropy algorithm better detected consecutive abnormal days, for example long weekends
around a holiday, e.g., Thanksgiving, or events lasting several days, e.g., the winter storm Jonas.
Note that a travel ban was instituted for New York City for 23–24 January during the storm Jonas
and that this was one of the top abnormal days for both algorithms.
• On the other hand, the entropy algorithm tended to point out as anomalous wrongly the days
following really anomalous days. As it used a four-week window for calculating the entropy, if in
the last four weeks, there were several abnormal days, e.g., the Christmas holidays, then the days
of the week after Christmas appeared to be different from the previous ones and appeared high
in the entropy rank. However, this feature is important for adapting to city changes, e.g., street
closures for long-term works.
With these results, we can validate that the entropy approach worked well at detecting abnormal
events in the city when compared with an algorithm that was trained with the whole data set but
two weeks. The first advantage of the entropy-based outlier detection is that no previous patterns
for training are needed, since it is continuously learning from the location of the posts obtained
from Instagram. After an initial transient period of four weeks, anomalous data increase the entropy
values and abnormal events start to be detected. The second advantage is that the entropy levels are
continuously adapted as long as new geolocated data are extracted from social media. New patterns
are learned. and older patterns are forgotten, adapting to the evolution of the city.
Regarding the computational cost of the entropy algorithm, it is very simple and can be
implemented in real time with low resource consumption. Since we used the windowed version
173
Electronics 2018, 7, 380
of the entropy, Hwin , the computation cost of the entropy depended on the number of symbols in the
sequence, win, and the cardinality of the alphabet |L | (i.e., the number of possible different symbols
in our distribution). In our case, the cardinality of the alphabet was the number of cells in the grid in
which we divided the city. Assuming a grid of S × S cells, |L | = S2 . Both quantities are constant and
small, and Equation (3) can be computed in a fixed, short time.
All the results presented so far were obtained using the New York data set. We will check next if
the algorithm works well with the same parameters used before in a very different data set.
Figure 5. Entropy evolution in the Manchester data set with the selected parameters.
6. Limitations
One of the limitations of using Instagram or any other social network to detect anomalous events
is that it is very sensitive to changes in API policies. At the time we carried out the New York data
capture campaign (end of 2015 and beginning of 2016), the Instagram API media/search endpoint
allowed recovering data from any moment in the past, between two timestamps (you can see the
API at the time of our data capture campaign at the Internet Archive: http://web.archive.org/web/
20150531210319/https://instagram.com/developer/endpoints/media/), so our data set could be
re-extracted later by anyone (for example, if she/he would like to reproduce our study). This is not
possible anymore. Besides, since June 2016, for privacy reasons, the media/search endpoint in Sandbox
mode was limited to return just the media you uploaded from that location. To have access to the
public content published by others, you need to submit your application to Instagram for approval for
the Live mode. This was not required when we made the New York capture campaign.
Another limitation of our approach is about how the Instagram API media/search endpoint
provides geolocated posts. The location of the post was obtained from the latitude and longitude
where the photo was taken (provided by the device). However, Instagram does not provide public
174
Electronics 2018, 7, 380
information about the percentage of Instagram posts that contain geolocation. According to the survey
study in [20], 30% of the respondents said they geotag all posts, and 30% said they never geotag
posts; however, 60% claimed to geotag some of their posts, and about 10% claimed to geotag half or
more of their posts. Although an accurate percentage cannot be provided without the official data
from Instagram, taking into consideration the information in [21], it could be claimed that geotagged
posts increase engagement up to 79%. Additionally, we can argue that Instagram is one of the most
geolocated social networks, since the percentage of geolocated posts in Twitter was just 1% in 2014 [22],
the same year as the study in [21].
A possible question is whether there may be events of interest that may not be detected using
Instagram because they were not attractive to their users. In this work, we are interested in detecting
unusual events such as emergencies. In [23], the authors presented the results of a study on citizens’
perception of social media in emergencies conducted in Germany. The study highlighted that around
24% of people have used social media during an emergency to share information. When asked about
what types of information they share, 37% of the times they share the location and some photo or
video. According to this study, we expect emergency events to be identifiable on Instagram, as we
have found in the two study cases (New York and Manchester) presented in this paper.
Finally, some recent papers ([24,25]) studied content bias in crowd-sourced geographic
information in OpenStreetMap, depending on the country and the culture. Another work presented
a similar study during disasters ([26]). It is difficult to know if there are deviations of this nature in
the data we obtained from Instagram. We do not know the information that could be relevant to
study these biases, such as age, nationality, cultural level, etc., of post authors. However, we believe
that our use of social networks (specifically Instagram) differs from that of OpenStreetMap in these
works in two important aspects. First, the posts we obtained were generated in a very limited are
(radius of 5 km), so we did not expect great differences in demographic and social characteristics of
the post authors. Second, in OpenStreetMap, the geographic information is explicitly crowd-sourced
by the users (they make an explicit action to send the information), while in our work, we collected the
geographic information from Instagram without the users being aware that they were participating
in this process. We believe that this unnoticed collection process protects against the biases that
occur when the user explicitly sends the information. Anyway, these aspects remain open and need
further investigation.
7. Conclusions
This paper proposes a new entropy-based methodology for early detection of anomalies in urban
areas that exploits the location data of the posts published on LBSNs. The proposal uses a centroid
as the single geographic point summarizing the pulse of the city, the location of which is tracked to
detect changes in its entropy evolution. Although more than one point could be used to represent the
citizens’ movement all around the area under study, working only with one centroid allows obtaining
quick and sound results.
From the time sequence of centroids that summarize the pulse of the city, just the last W weeks
were considered, and the centroids were discretized into an S × S grid. We studied different values of
the parameters, and we found the best results with W = 4 and S = 5. We then used the entropy of the
discretized sequence of centroid locations in the last W weeks to detect anomalies.
The main advantage of our algorithm is that there is no training phase, so the algorithm starts
detecting abnormal days from the beginning, with good results after the first W weeks. Another
advantage of our approach is that it can adapt to changes in the dynamics of the city, since at the
same time it learns new patterns from current posts, it forgets old (more than W weeks old) patterns.
The algorithm is simple and fast, so it can be executed in real time with low resource consumption.
The validation was done with seven months of geolocated data from Instagram posts published in
NYC. Apart from correctly identifying up to 55% of expected abnormal days (Christmas, holidays, etc.),
the solution was able to discover events we were not aware of, where an unusual pattern was clearly
175
Electronics 2018, 7, 380
detected by our proposed methodology, and further analysis of the content of the posts uncovered the
reason. The parameters selected were also validated with other data set, from Manchester, where the
effects of a terrorist attack in the entropy of the crowd dynamics can be observed.
We are currently working on two lines: on the one hand, extending the algorithm to work with
more than one centroid (two, three) representing the movement of the whole population in the city;
on the other hand, the analysis presented in this paper shows the changes (of entropy or DoA) at a day
level. This analysis can be presented at shorter intervals (every 15 or 30 min) to show sudden changes
in the city as they occur.
In this work, we have considered aggregation of Instagram posts at fixed time intervals (15, 30,
and 60 min). As future work, other forms of aggregation of posts can be investigated. Posts could be
aggregated in variable length time intervals, aggregating a constant number of posts (e.g., 200 post)
per time interval, so that the time intervals would be shorter or larger depending on the activity (the
number of posts) on Instagram. Surely, this could help detect the events that cause a large number of
posts faster.
Author Contributions: All the authors participated in the conceptualization of this paper. C.G.-R. and C.C.
contributed to the design, implementation, and validation of the entropy-based abnormal events detection
algorithm. R.P.D.R. and A.F.V. contributed to the data sets and the DoA approach to abnormal events detections.
Funding: This research was partially funded by the Ministry of Economy and Competitiveness through
TEC2017-84197-C4-1-R, TEC2017-84197-C4-2-R, TEC2014-54335-C4-2-R, and TEC2014-54335-C4-3-R, and the
European Regional Development Fund (ERDF) and the Galician Regional Government under agreement for
funding the Atlantic Research Center for Information and Communication Technologies (AtlantTIC).
Acknowledgments: C.G.-R. and C.C. would like to acknowledge Alicia Rodriguez-Carrion for her help in the
initial stages of this work.
Conflicts of Interest: The authors declare no conflict of interest. The founding sponsors had no role in the design
of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, and in the
decision to publish the results.
References
1. Ghidoni, S.; Cielniak, G.; Menegatti, E. Texture-based crowd detection and localization. In Intelligent
Autonomous Systems 12; Springer: Berlin/Heidelberg, Germany, 2013; pp. 725–736.
2. Zhang, Y.; Qin, L.; Ji, R.; Yao, H.; Huang, Q. Social attribute-aware force model: Exploiting richness of
interaction for abnormal crowd detection. IEEE Trans. Circuits Syst. Video Technol. 2015, 25, 1231–1245.
[CrossRef]
3. Atefeh, F.; Khreich, W. A survey of techniques for event detection in twitter. Comput. Intell. 2015, 31, 132–164.
[CrossRef]
4. Watanabe, K.; Ochi, M.; Okabe, M.; Onai, R. Jasmine: A real-time local-event detection system based on
geolocation information propagated to microblogs. In Proceedings of the 20th ACM international conference
on Information and Knowledge Management, Glasgow, UK, 24–28 October 2011; pp. 2541–2544.
5. Ranneries, S.B.; Kalør, M.E.; Nielsen, S.A.; Dalgaard, L.N.; Christensen, L.D.; Kanhabua, N. Wisdom of the
local crowd: Detecting local events using social media data. In Proceedings of the 8th ACM Conference on
Web Science, Hannover, Germany, 22–25 May 2016; pp. 352–354.
6. Sakaki, T.; Okazaki, M.; Matsuo, Y. Earthquake shakes Twitter users: Real-time event detection by social
sensors. In Proceedings of the 19th International Conference on World Wide Web, Raleigh, NC, USA,
26–30 April 2010; pp. 851–860.
7. De Longueville, B.; Smith, R.S.; Luraschi, G. “OMG, from here, I can see the flames!”: A use case of mining
location based social networks to acquire spatio-temporal data on forest fires. In Proceedings of the 2009
International Workshop on Location Based Social Networks, Seattle, WA, USA, 3 November 2009; pp. 73–80.
8. Wakamiya, S.; Lee, R.; Sumiya, K. Crowd-based urban characterization: Extracting crowd behavioral
patterns in urban areas from twitter. In Proceedings of the 3rd ACM SIGSPATIAL International Workshop
On Location-Based Social Networks, Chicago, IL, USA, 1 November 2011; pp. 77–84.
176
Electronics 2018, 7, 380
9. Walther, M.; Kaisser, M. Geo-spatial event detection in the twitter stream. In Proceedings of the ECIR’13
Proceedings of the 35th European Conference on Advances in Information Retrieval, Moscow, Russia,
24–27 March 2013.
10. Lee, R.; Sumiya, K. Measuring geographical regularities of crowd behaviors for Twitter-based geo-social
event detection. In Proceedings of the 2nd ACM SIGSPATIAL International Workshop On Location Based
Social Networks, San Jose, CA, USA, 2–5 November 2010; pp. 1–10.
11. ben Khalifa, M.; Redondo, R.P.D.; Vilas, A.F.; Rodríguez, S.S. Identifying urban crowds using geo-located
Social media data: A Twitter experiment in New York City. J. Intell. Inf. Syst. 2017, 48, 287–308. [CrossRef]
12. Domínguez, D.R.; Redondo, R.P.D.; Vilas, A.F.; Khalifa, M.B. Sensing the city with Instagram: Clustering
geolocated data for outlier detection. Expert Syst. Appl. 2017, 78, 319–333. [CrossRef]
13. Gonzalez, M.C.; Hidalgo, C.A.; Barabasi, A.L. Understanding individual human mobility patterns. Nature
2008, 453, 779–782, doi:10.1038/nature06958. [CrossRef] [PubMed]
14. Gao, Y.; Kontoyiannis, I.; Bienenstock, E. Estimating the entropy of binary time series: Methodology,
some theory and a simulation study. Entropy 2008, 10, 71–99. [CrossRef]
15. Cover, T.M.; Thomas, J.A. Elements of Information Theory, 2nd ed.; Wiley: New York, NY, USA, 2006.
16. Cerezo-Costas, H.; Fernández-Vilas, A.; Martín-Vicente, M.; Díaz-Redondo, R.P. Discovering geo-dependent
stories by combining density-based clustering and thread-based aggregation techniques. Expert Syst. Appl.
2018, 95, 32–42. [CrossRef]
17. Tukey, J.W. Exploratory Data Analysis; Addison-Wesley Reading: Boston, MA, USA, 1977.
18. Acuna, E.; Rodriguez, C. A Meta Analysis Study of Outlier Detection Methods in Classification; Technical paper;
Department of Mathematics, University of Puerto Rico at Mayaguez: Mayaguez, Puerto Rico, 2004.
19. Natrella, M. NIST/SEMATECH e-Handbook of Statistical Methods; NIST/SEMATECH. 2013.
Available online: https://www.itl.nist.gov/div898/handbook/ (accessed on 29 November 2018).
20. Menfors, M.; Fernstedt, F. Geotagging in Social Media: Exploring the Privacy Paradox. Bachelor’s Thesis,
University of Borås, Borås, Sweden, 2015.
21. Heine, C. 14 Instagram Data Findings That Every Marketer Needs to Know. 2014. Available online: https://
www.adweek.com/digital/14-instagram-data-findings-every-marketer-needs-know-160969/ (accessed on
29 November 2018).
22. Graham, M.; Hale, S.A.; Gaffney, D. Where in the World are You? Geolocation and Language Identification
in Twitter. Prof. Geogr. 2014, 66, 568–578. [CrossRef]
23. Reuter, C.; Kaufhold, M.A.; Spielhofer, T.; Hahne, A.S. Social Media in Emergencies: A Representative
Study on Citizens’ Perception in Germany. Proc. ACM Hum.-Comput. Interact. 2017, 1, 90:1–90:19,
doi:10.1145/3134725. [CrossRef]
24. Quattrone, G.; Capra, L.; De Meo, P. There’s No Such Thing As the Perfect Map: Quantifying Bias
in Spatial Crowd-sourcing Datasets. In Proceedings of the 18th ACM Conference on Computer
Supported Cooperative Work & Social Computing (CSCW ’15), Vancouver, BC, Canada, 14–18 March 2015;
pp. 1021–1032. [CrossRef]
25. Dittus, M.; Quattrone, G.; Capra, L. Mass Participation During Emergency Response: Event-centric
Crowdsourcing in Humanitarian Mapping. In Proceedings of the 2017 ACM Conference on
Computer Supported Cooperative Work and Social Computing (CSCW ’17), Portland, OR, USA,
25 February–1 March 2017; pp. 1290–1303. [CrossRef]
26. Anderson, J.; Soden, R.; Keegan, B.; Palen, L.; Anderson, K.M. The Crowd is the Territory: Assessing Quality
in Peer-Produced Spatial Data During Disasters. Int. J. Hum.-Comput. Interact. 2018, 34, 295–310. [CrossRef]
c 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
177
electronics
Article
Proactive Content Delivery with Service-Tier
Awareness and User Demand Prediction
Jing Hu 1 , Yaling Lai 1 , Ao Peng 1, *, Xuemin Hong 2 and Jianghong Shi 2
1 School of Information Science and Engineering, Xiamen University, Xiamen 361005, Fujian, China;
[email protected] (J.H.); [email protected] (Y.L.)
2 Key Laboratory of Underwater Acoustic Communication and Marine Information Technology, Ministry of
Education of China, Xiamen University, Xiamen 361005, Fujian, China; [email protected] (X.H.);
[email protected] (J.S.)
* Correspondence: [email protected]; Tel.: +86-592-258-0150
Abstract: Cost-effective delivery of massive data content is a pressing challenge facing modern
mobile communication networks. In the literature, two primary approaches to tackle this challenge
are service-tier differentiation and personalized proactive content caching. However, these two
approaches have not been integrated and studied in a unified framework. This paper proposes an
integrated proactive content delivery scheme that jointly exploits the availability of multiple service
tiers and multi-user behavior prediction. Three optimal algorithms and one heuristic algorithm
are introduced to solve the cost-minimization problems of multi-user proactive content delivery
under different modelling assumptions. The performance of the proposed scheme is systematically
investigated to reveal the impacts of proactive window size, service-tier price ratio, and traffic cost
model on the system performance.
Keywords: proactive content delivery; differentiated services; redundant capacity; secondary traffic
1. Introduction
The rapid proliferation of smart phones and mobile Internet has driven an explosive growth of
mobile data traffic demand. According to Cisco’s report [1], global mobile data traffic will reach 49
exabytes per month by 2021. Among various types of mobile applications, content delivery (e.g., web
browsing, video streaming) consumes the majority of the mobile data traffic. A Cisco report [1]
estimated that video content will account for 78% of the world’s total mobile traffic in 2021. However,
the high price of mobile data plan (e.g., cost per Mbyte) is still one of the main factors prohibiting
the ubiquitous adoption of mobile video applications. Therefore, significant research interests have
been attracted in designing a mobile content delivery network that is cost-friendly to massive content
delivery services.
Contradicting the high price of mobile data plan, the overall utilization of the mobile
communication network’s capacity is relatively low. This is because the mobile traffic demand varies
significantly across space and time [2–5], while the network is typically built to accommodate the peak
traffic demand. Consequently, a large amount of “redundant capacity” (i.e., the difference between the
actual traffic load and the network capacity) is not used during off-peak hours [6], resulting in a low
overall utilization of the network. It is widely anticipated that improving the network utilization can
help to reduce the cost per bit for mobile operators and ultimately the price per bit for mobile users.
A wide range of different approaches have been studied to improve the network capacity
utilization. These approaches can be broadly categorized into two types: network-centric approach
and price-centric approach. The former focuses on improving the technical efficiency of the network,
which can ultimately reduce the operational expenses (OPEX) and/or capital expenses (CAPEX) of
mobile operators. Within this category, “green radio” [7–9] aims to dynamically adjust the number
of powered-on base stations (BSs) to match the actual traffic demand, so that the OPEX (mainly the
cost of electricity consumption) can be reduced. Another approach called “proactive mobile edge
caching” [10–18] aims to push popular (i.e., frequently requested) content in advance and cache them
in the mobile edge network or even in end-user devices, so that on-demand traffic is off-loaded to the
edge network or to off-peak hours. In practice, Netflix’s content delivery network (CDN), named Open
Connect, can deploy servers at Internet exchange points (IXPs) and inside Internet service providers
(ISPs) without operating either a backbone network or data centers, and pre-load contents on its servers
during off-peak times to reduce the amount of transit traffic [19]. Furthermore, the hybrid CDN–P2P
solutions, integrating P2P into the current CDN architectures, were proposed to maximize throughput
and reduce expenses [20]. This load-balancing approach helps to ease the pressure of network capacity
expansion, so that the CAPEX can be reduced.
The second category is the price-centric approach. The rationale is to introduce diverse
communication service tiers [21,22] with differentiated prices to end users. The service tiers and
prices are allowed to be changed flexibly, such that the network utilization can be improved via market
dynamics. Within this category, time-based data pricing schemes [23–30] (i.e., different traffic pricing
during different hours in a day) are designed to attract users through special discounts in off-peak
hours. This coarse-grain approach can help to smooth the temporal variation of traffic load, but is
unable to balance the spatial traffic variation. Moreover, traffic from cheaper data plans may affect the
quality-of-service (QoS) of traffic from normal data plans, resulting in a degraded quality-of-experience
(QoE) for normal users in off-peak hours.
An alternative price-centric approach is service-based data pricing schemes [31–38], which allow
the mobile operator (i.e., mobile ISP) to offer differentiated communication service tiers associated with
different prices. Paper [31] derived the optimal service qualities and associated prices for an ISP with
the consideration of capacity constraints and user characteristics. Paper [32] addressed the problem
of ISP service tier design based on specific requirements of the applications such as web browsing
and video streaming. Financial portfolio theory was applied to develop an optimization model in [33].
Various technical, economical, and social aspects of Internet service differentiation were discussed
in [34–38]. Generally speaking, compared with time-based data pricing schemes, service-based data
pricing schemes offer more flexibility and greater commercial incentive. Therefore, the 5th generation
(5G) mobile communication network has incorporated new technologies, such as network slicing, to
enable mobile ISPs to offer differentiated service tiers.
The above-mentioned studies on mobile content delivery have mostly taken a perspective from
the mobile ISPs, who are essentially data pipes and have limited knowledge about user behavior and
preference. In a parallel research field of content recommendation [39–42], it has been established that
the content providers (CPs), such as YouTube and Netflix, can play an active role in content delivery.
The reason is that CPs hold the data of users’ content preferences and historical access behavior. For
general human behavior [39,40], especially for wireless data users [41,42], there is substantial evidence
showing that their content consumption behaviors are fairly predictable at a fine-grain timescale (from
minutes to hours). Such personalized, fine-grain information enables CPs to predict users’ content
demand, so that traditional proactive caching schemes can be personalized and become more effective.
As a result, CP-centric personalized content delivery, as an alternative to the traditional ISP-centric
content delivery, has attracted increasing research interests lately.
179
Electronics 2019, 8, 50
Previous studies on mobile content delivery have either taken an ISP-centric perspective or a
CP-centric perspective. To our best knowledge, studies that unify both perspectives are still rare. In
this paper, we propose a content delivery scheme that integrates both perspectives. Our scheme can
simultaneously exploit the availability of differentiated services tiers and the predictability of user
behavior. The main contributions of our paper are as follows. First, we propose a proactive content
delivery scheme with service-tier awareness and user behavior prediction for the purpose of cost
reduction. Second, considering a baseline scheme of proactive content delivery with one time-slot, we
derive the optimal content delivery policy that can minimize the long-term cost. Third, considering a
generalized scheme of multi-time-slot proactive content delivery, we propose a near-optimal heuristic
algorithm for cost reduction. The performances of the proposed schemes are systematically evaluated
to reveal key insights into the impacts of various system parameters on the cost.
The remainder of this paper is organized as follows. Section 2 describes the system model.
Sections 3 and 4 formulate and analyze the problems of proactive content delivery in single-time-slot
and multi-time-slot cases, respectively. Numerical results are presented in Section 5. Finally,
conclusions are drawn in Section 6.
2. System Model
Contentȱ
Provider Paymentȱforȱ
Traffic InternetȱServiceȱ PrimaryȱTraffic
EndȱUsers
Provider SecondaryȱTraffic
Contents
Userȱhistoricalȱȱȱ
behaviorȱdata
ȱ
Figure 1. Illustration of the system model.
Within each service tier, the total traffic cost C ( L) is a function of the traffic load L. The cost
is interpreted as the cost to the ISP for secondary service provision (i.e., transmit more data using
redundant capacity). It is assumed that such a cost of the ISP is proportional to the cost of CP to access
communication services provided by the ISP. Two cost models are considered in our paper. One is the
180
Electronics 2019, 8, 50
simple case of volume-based or linear cost, which means the cost per unit traffic remains unchanged
regardless of the traffic load L. In this case, we have Cl ( L) = k l L, where the cost is linearly proportional
to the traffic load. Another case is quadratic cost, where Cq ( L) = k q L2 . This is a commonly used
model in the literature [18] to reflect the fact that the cost to the ISP to support higher data rates scales
non-linearly with the data rate. Such a nonlinear scaling is rooted in Shannon’s capacity formula: once
the physical bandwidth is fixed, the data rate can be improved by increasing the transmit power, but
with diminishing returns. In the literature, the cost–traffic volume function is commonly approximated
by a quadratic function for analytical convenience [18].
It is assumed that multiple users’ arrival and content consumption behaviors are independent
from each other. Furthermore, user demands are assumed to be cyclic-stationary. This assumption
is supported by various measurements showing that the user demand fluctuates in a periodic
pattern [40,43] (e.g., on a daily basis). As a result, we can group multiple time slots into a cyclic
period. The number of time slots in a period is denoted as T. It follows that
181
Electronics 2019, 8, 50
Variable Definition
N Number of users
T Number of time-slots in a cyclic period
W Window size for proactive content caching
ξ n,t User n’s demand at time-slot t (unit: MB)
pn,t User n’s arrival probability at time-slot t
In,t Random variable of user n’s demand at time-slot t
Crt System’s redundant capacity at time-slot t (unit: MB)
xn,t+1 Portion of proactively delivered data to be consumed at time-slot t + 1 (unit: MB)
xn,t (τ ) Portion of proactively delivered data to be consumed at time-slot t + τ (unit: MB)
β Ratio of the cost of the ST service tier over the PT tier
where we define a N × T matrix x, the elements of which are xn,t , ∀n, t. In Equation (3), xn,t+1
represents the portion of proactively pushed data for the next time slot t + 1, and the expectation is
taken over the random variable In,t . The received data for each user should not exceed the user’s
demand at time t, i.e.,
0 ≤ xn,t ≤ ξ n,t (4)
and the total amount of proactively pushed data cannot exceed the upper limit of the redundancy
capacity at the current time-slot t, i.e.,
N
∑ xn,t+1 ≤ Crt (5)
n =1
The main objective is to minimize the total cost over the feasible space of x. The optimization
problem can be formulated as
min ηs (x)
⎧ x
⎪
⎪ 0 ≤ xn,t ≤ ξ n,t ∀n, t
⎪
⎪
⎪
⎨ xn,t = xn,t+T ∀n, t (6)
s.t. N
⎪
⎪
⎪ ∑ xn,t ≤ Crt ∀n, t
⎪
⎪ n =1
⎩ In,t ∈ {0, 1} ∀n, t
For comparison purposes, also consider the baseline case of pure RCD. The time-average expected
cost in this case is given by
1 T N
η = ∑ E C ∑n=1 ξ n,t In,t (7)
T t =1
where ∑nN=1 ξ n,t In,t is the actual traffic load requested at time t. In this case, the system is purely reactive
to the users’ request and there is no decision variable to be optimized.
182
Electronics 2019, 8, 50
T N N
ηsl (x) = 1
T ∑ E k l ∑ (ξ n,t − xn,t )In,t + β · k l ∑ xn,t+1
t =1 n =1 n =1 (8)
( a) 1 T N
= T ∑ ∑ k l (( β − pn,t ) xn,t + ξ n,t pn,t )
t =1 n =1
We note that the property of cyclic-stationary user demand (i.e., xn,t = xn,t+T ) is used in Equation
(8) to give ∑tT=1 xn,t+1 = ∑tT=1 xn,t . From Equation (8), we can see that the optimization problem in
Equation (6) becomes a linear programming problem, such that the problem can be easy solved by
classic methods such as the dual interior point method.
A closer look at Equation (8) reveals a key insight that both the cost and the PCD decision variable
x are determined by the relative difference between the cost ratio β and users’ arrival probabilities pn,t .
When pn,t > β, PCD for the nth user is beneficial for cost reduction; when pn,t < β, PCD for the nth
user becomes harmful because there is a higher likelihood that the pushed data will not be actually
consumed by the user, so that the resource used for PCD is wasted. When pn,t = β, PCD for the nth
user makes no difference.
We can see that in this case, we no longer have a simple intuitive solution for x. However, it can
be proved that the problem in Equation (9) is a convex optimization problem (see Appendix A). Hence,
the optimal solution can be readily solved using standard convex optimization techniques.
183
Electronics 2019, 8, 50
1 T N W N W
where the decision variable x is a N × T × W matrix, whose elements are given by xn,t (τ ), ∀n, t, τ.
Here, what differs from the single-time-slot case is that user n’s cached data at time t is the accumulated
data pushed from the previous W time-slots. PCD for each user is constrained by the individual user
demand, i.e.,
xn,t−τ (τ ) ≥ 0,
W (11)
∑ xn,t−τ (τ ) ≤ ξ n,t
τ =1
in addition, the total amount of PCD data of all users at any time-slot t cannot exceed the current
redundant capacity, i.e.,
N W
∑ ∑ xn,t (τ ) ≤ Crt (12)
n =1 τ =1
min ηm (x)
⎧ x
⎪
⎪ x n,t ( τ ) ≥0 ∀n, t, τ
⎪
⎪
⎪
⎪ xn,t (τ ) = xn,t+T (τ ) ∀n, t, τ
⎪
⎪
⎪
⎨ W
xn,t−τ (τ ) ≤ ξ n,t ∀n, t, τ (13)
s.t. τ∑ =1
⎪
⎪
⎪
⎪ N W
⎪ ∑ ∑ xn,t (τ ) ≤ Crt
⎪ ∀n, t, τ
⎪
⎪
⎪
⎩ n =1 τ =1
In,t ∈ {0, 1} ∀n, t
T N W N W
l (x) =
ηm 1
T ∑ E Cl ∑ ξ n,t − ∑ xn,t−τ (τ ) In,t + β · Cl ∑ ∑ xn,t (τ )
t =1 =1
n τ =1 n =1 τ =1
T N W N W
= T1 ∑ k l ∑ ξ n,t − ∑ xn,t−τ (τ ) pn,t + β · k l ∑ ∑ xn,t (τ ) (14)
t =1 n=1 τ =1 n =1 τ =1
(b) 1 T N W
= T ∑ k l ∑ ∑ xn,t (τ )( β − pn,t ) + ξ n,t pn,t
t =1 n =1 τ =1
optimization problem reduces to a linear programing problem. Similar to the case of single time-slot,
the effectiveness of PCD still depends on the relative difference between the traffic cost ratio β and
user n’s arrival probability pn,t . However, the proactive data user n received from different time-slot,
i.e., xn,t−τ (τ ), depends on the redundant capacity of the previous W time-slots. This requires proper
monitoring of real-time redundant capacity over multiple time slots.
184
Electronics 2019, 8, 50
5. Simulation Results
This section presents numerical results to our previous analysis. For illustration purposes, we set
T = 10 and N = 3. User n’s demand at time t is drawn from a uniform distribution on [0, 500]; the
arrival probability of user n at time t follows a uniform distribution on [0, 1]. The scaling constants in
the linear and quadratic cost models are given by k l = 2 and k q = 0.005, respectively. The case of pure
RCD, where there is no proactive caching, is also presented as a performance benchmark.
185
Electronics 2019, 8, 50
(a)ȱ (b)ȱ
Figure 2. (a) The time-average expected cost as a function of the ST/PT cost ratio β; (b) the redundant
capacity utilization as a function of the ST/PT cost ratio β (linear cost model, varying redundant
capacity Crt ).
Using the quadratic cost model, Figure 3 shows how the time-average expected cost and the
redundant capacity utilization changes as a function of the ST/PT cost ratio β. The results are obtained
by solving the convex optimization problem defined in Section 3.3. The general trend observed in
Figure 3 is similar to that in Figure 2, i.e., a smaller value of β leads to a lower cost and a higher
utilization of the redundant capacity. However, a key difference to Figure 2 occurs when β approaches
1, where PCD is shown to be useful for cost reduction even when the cost of ST and PT are the same.
For example, at Crt = 400 and β = 1, the time-average cost can be reduced by nearly 32% (as opposed to
0% in Figure 2) and the redundant traffic utilization is about 43% (as opposed to 0% in Figure 2). This
is because the PCD can help to smooth the user demand in time, while a more balanced user demand
yields a lower cost under the quadratic cost model.
(a)ȱ (b)ȱ
Figure 3. (a) The time-average expected cost as a function of the ST/PT cost ratio β; (b) the redundant
capacity utilization as a function of the ST/PT cost ratio β (quadratic cost model, varying redundant
capacity Crt ).
186
Electronics 2019, 8, 50
The general conclusions drawn from Figure 4 are the same as that in Figure 2, i.e., PCD is not useful
when there is no cost difference between ST and PT service tiers. Apart from this, Figure 4a–c further
reveal the impact of proactive window size on the performance. It is observed that increasing the
window size does help to further reduce the cost, but the improvement is limited and becomes
insignificant when W is greater than five. In Figure 4c, we can see that when the value of β increases,
the effectiveness of cost reduction by increasing W decreases. This suggests that when the costs of the
two service tiers are comparable, increasing the proactive window size W will become less effective for
cost saving.
(a)ȱ (b)ȱ
(c)ȱ
Figure 4. (a) The time-average expected cost as a function of the ST/PT cost ratio β; (b) the redundant
capacity utilization as a function of the ST/PT cost ratio β; (c) the time-average expected cost as a
function of the proactive window size W (linear cost model, Crt = 400, varying window size W).
Finally, Figure 5 shows three figures related to the performance of multi-time-slot PCD under the
quadratic cost model. The results are obtained by solving the non-linear optimization problem defined
in Section 4.3 using pattern search. Compared with Figure 4, Figure 5 shows that using PCD is always
useful for cost reduction regardless of the values of β. Even when β = 1, the cost can still be reduced
by 53% thanks to the load smoothing effect. Moreover, increasing the window size also helps for load
smoothing, and is hence considered beneficial for all values of β. Table 2 further demonstrates the
smoothing effect of multi-time-slot PCD on network traffic load. Given Crt = 400 and β = 0.5, the
variances of the actual traffic across different time slots is shown as a function of the window size. We
187
Electronics 2019, 8, 50
can see that increasing W helps to reduce the variance of the traffic load, but has diminishing returns
especially when W becomes greater than five.
(a)ȱ (b)ȱ
(c)ȱ
Figure 5. (a) The time-average expected cost as a function of the ST/PT cost ratio β; (b) the redundant
capacity utilization as a function of the ST/PT cost ratio β; (c) the time-average expected cost as a
function of the proactive window size W (quadratic cost model, Crt = 400, varying window size W).
W 1 2 3 5 8 10
Variance
8.3188 5.7479 5.0893 4.2842 3.4933 3.3491
(×104 )
The above simulation results show that both single time-slot and multiple time-slot PCD can
bring good performance gain for CP. The performance gain increases with lower cost rate β and
larger window size W. However, the performance gain is fundamentally constrained by the volume of
redundant capacity. In practice, this means close cooperation must be established between CP and
ISP so that the volume of redundant capacity in the current network can be measured and shared in
real time. For the ISP, our model helps to improve the overall utilization of network infrastructure
and generate additional revenue. For CP, our model helps to attract users and promote content
consumption by reducing the cost of content delivery per bit. In summary, our model can offer a
win-win situation for ISP and CP.
188
Electronics 2019, 8, 50
6. Conclusions
This paper proposes a personalized PCD scheme that aims to minimize the total cost of
content delivery by means of multiple service-tier transmission and multi-user behavior prediction.
The problem of personalized PCD has been systematically investigated in single-time-slot and
multi-time-slot cases, under both linear and quadratic cost models. Three optimal algorithms and one
heuristic algorithm have been presented to solve the respective optimization problems. Simulation
results have demonstrated the effectiveness of the proposed PCD scheme and revealed the impacts of
proactive window size, service-tier cost ratio, and traffic cost model on the cost of content delivery. We
conclude that personalized PCD over multiple service tiers can effectively reduce the cost when the
cost is sensitive to the total traffic load and/or the type of service tiers.
Author Contributions: Conceptualization, J.H. and Y.L.; Formal analysis, J.H.; Investigation, Y.L.; Methodology,
A.P.; Project administration, A.P. and X.H.; Resources, J.S.; Supervision, J.S.; Validation, Y.L.; Writing—Original
draft, J.H.; Writing—Review & editing, A.P. and X.H.
Funding: This research was funded by the National Natural Science Foundation of China (NSFC) (Grant No.:
61571378) and the National Key Research and Development Program of China (Grant No.: 2018YFB0505202).
Conflicts of Interest: The authors declare no conflict of interest.
Appendix A
Substituting Equation (9) into Equation (6), the problem of single-slot cost optimization becomes:
T N N
min 1
T ∑ ∑ k q ( β + pn,t ) xn,t
2 +
∑ ∑ k q ( pn,t pm,t + β) xn,t xm,t
x t =1 n =1 n =1 m = n
N
− ∑ 2k q ξ n,t pn,t + ∑ ξ m,t pn,t pm,t xn,t + cons
n =1 ⎧ m=n
⎪ 0 ≤ xn,t ≤ ξ n,t ∀n, t (A1)
⎪
⎪
⎪
⎪
⎨ xn,t = xn,t+T ∀n, t
s.t. N
⎪
⎪
⎪ ∑ xn,t ≤ Crt ∀n, t
⎪ n =1
⎪
⎩ In,t ∈ {0, 1} ∀n, t
k 2
where, cons = Tq ∑tT=1 ∑nN=1 ξ n,t pn,t + ∑m=n ξ n,t ξ m,t pn,t pm,t . The value of cons mainly depends on pn,t
and ξ n,t , so cons is independent of the variables and not relevant for the minimization of the objective
function. We can see this is a quadratic programming problem. In order to prove the convexity of the
objective function, we define Qt as its Hessian matrix, whose elements are given by:
t ] = pn,t , [Q
Proof: suppose that [Q t]
n,n m,n = pm,t pn,t (n = m and n, m ∈ {1, 2, . . . , N }), then:
t = PtT Qt Pt
Q (A3)
where, Pt = diag{ p1,t , . . . , p N,t }, Qt = pn,t1+1 , Qt = 1. Let us set vector b =
T
nn nm
β β ... β , then we have Q̂t = Q t + bbT , and:
Qt = k q Q̂t (A4)
189
Electronics 2019, 8, 50
Therefore whether Qt is a positive definite matrix can be determined by the nature of Q̂t . First,
t can be proved to be a positive definite matrix. Here gn is defined as the n-order principal minor
Q
determinant of Q t , n ∈ {1, 2, . . . , N }, i.e.,
α
1 1 ··· 1
1 α2
gn = . .
(A5)
.. . .
1 αn
where αn = 1
pn,t+1 > 1, and then:
n
1 − α1 n
gn = α1 + ∑ ∏ ( α k − 1) (A6)
k =2
1 − αk k =2
We have gn > 0, ∀n, i.e., all principal minor determinants of Qt are positive, thereby Qt is a
positive definite matrix, meaning that Qt is also positive definite. According to Sylvester’s theorem:
we can write:
Q̂t = Qt + bbT = t −1 b
Qt 1 + bT Q (A8)
Because Q t is positive definite as shown above, we can get Q̂t > 0, therefore it can be concluded
that the objective function’s Hessian matrix Qt is a positive definite matrix, which ends our proof that
the optimization problem in Equation (A1) is a convex quadratic programming problem.
References
1. Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2016–2021. Available
online: https://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-
vni/mobile-white-paper-c11-520862.html (accessed on 23 January 2018).
2. Lee, D.; Zhou, S.; Zhong, X.; Niu, Z.; Zhou, X.; Zhang, H. Spatial modeling of the traffic density in cellular
networks. IEEE Wirel. Commun. 2014, 21, 80–88. [CrossRef]
3. Zhao, Z.; Li, M.; Li, R.; Zhou, Y. Temporal-spatial distribution nature of traffic and base stations in cellular
networks. IET Commun. 2017, 11, 2410–2416. [CrossRef]
4. Leland, W.E.; Taqqu, M.S.; Willinger, W.; Wilson, D.V. On the self-similar nature of Ethernet traffic (extended
version). IEEE/ACM Trans. Netw. 1995, 2, 1–15. [CrossRef]
5. Park, K.; Willinger, W. Self-similar network traffic: An overview. In Self-Similar Network Traffic and Performance
Evaluation; Park, K., Willinger, W., Eds.; John Wiley and Sons: New York, NY, USA, 2000; pp. 1–38, ISBN
978-0-471-31974-0.
6. Zhang, Y.; Lu, H.; Wang, H.; Hong, X. Cognitive cellular content delivery networks: Cross-layer design and
analysis. In Proceedings of the IEEE Vehicular Technology Conference (VTC spring), Nanjing, China, 15–18
May 2016; pp. 1–6.
7. Wang, B.; Wu, Y.; Liu, K.J.R.; Clancy, T.C. An anti-jamming stochastic game for cognitive radio networks.
IEEE J. Sel. Areas Commun. 2011, 29, 877–889. [CrossRef]
8. Han, C.; Harrold, T.; Armour, S.; Krikidis, I.; Videv, S.; Grant, P.M.; Haas, H.; Thompson, J.S.; Ku, I.; Wang, C.;
et al. Green radio: Radio techniques to enable energy-efficient wireless networks. IEEE Commun. Mag. 2011,
49, 46–54. [CrossRef]
9. Ismail, M.; Zhuang, W. Green radio communications in a heterogeneous wireless medium. IEEE Wirel.
Commun. 2014, 21, 128–135. [CrossRef]
10. Kangasharju, J.; Roberts, J.; Ross, K.W. Object replication strategies in content distribution networks. Comput.
Commun. 2002, 25, 376–383. [CrossRef]
190
Electronics 2019, 8, 50
11. Vakali, A.; Pallis, G. Content delivery networks: Status and trends. IEEE Internet Comput. 2003, 7, 68–74.
[CrossRef]
12. Pallis, G.; Vakali, A. Insight and perspectives for content delivery networks. Commum. ACM 2006, 49,
101–106. [CrossRef]
13. Ahlehagh, H.; Dey, S. Video-aware scheduling and caching in the radio access network. IEEE/ACM Trans.
Netw. 2014, 22, 1444–1462. [CrossRef]
14. Ahlehagh, H.; Dey, S. Video caching in radio access network: Impact on delay and capacity. In Proceedings
of the IEEE Wireless Communications and Network Conference (WCNC), Paris, France, 1–4 April 2012;
pp. 2276–2281.
15. Xu, Y.; Li, Y.; Wang, Z.; Lin, T. Coordinated caching model for minimizing energy consumption in radio
access network. In Proceedings of the IEEE International Conference on Communications (ICC), Sydney,
Australia, 10–14 June 2014; pp. 2406–2411.
16. Shoukry, O.; Elmohsen, M.A.; Tadrous, J.; Gamal, H.E.; Elbatt, T.; Wanas, N.; Elnakieb, Y.; Khairy, M. Proactive
scheduling for content pre-fetching in mobile networks. In Proceedings of the IEEE International Conference
on Communications (ICC), Sydney, Australia, 10–14 June 2014; pp. 2848–2854.
17. Shoukry, O.K.; Fayek, M.B. Evolutionary scheduler for content pre-fetching in mobile networks. In
Proceedings of the 2013 AAAI Fall Symposium Series, Arlington, VA, USA, 15–17 November 2013;
pp. 386–391.
18. Tadrous, J.; Eryilmaz, A.; Gamal, H.E. Joint smart pricing and proactive content caching for mobile services.
IEEE/ACM Trans. Netw. 2016, 24, 2357–2371. [CrossRef]
19. Bottger, T.; Cuadrado, F.; Tyson, G.; Castro, I.; Uhlig, S. Open connect everywhere: A glimpse at the internet
ecosystem through the lens of the Netflix CDN. ACM SIGCOMM Comp. Commun. Rev. 2018, 48, 28–34.
[CrossRef]
20. Hasslinger, G.; Hartleb, F. Content delivery and caching from a network provider’s perspective. Comput.
Netw. 2011, 55, 3991–4006. [CrossRef]
21. Kimbler, K.; Taylor, M. Value added mobile broadband services innovation driven transformation of the
‘smart pipe’. In Proceedings of the 2012 16th International Conference on Intelligence in Next Generation
Networks, Berlin, Germany, 8–11 October 2012; pp. 30–34.
22. Yang, Z.; Ma, Z. Analysis of communication operators transformation on smart pipe. In Proceedings of
the 2013 5th International Conference on Intelligent Human-Machine Systems and Cybernetics, Hangzhou,
China, 26–27 August 2013; pp. 131–134.
23. Jiang, L.; Parekh, S.; Walrand, J. Time-dependent network pricing and bandwidth trading. In Proceedings of
the NOWS Workshops 2008-IEEE Network Operations and Management Symposium Workshops, Salvador
da Bahia, Brazil, 7–11 April 2008; pp. 193–200.
24. Joe-Wong, C.; Ha, S.; Chiang, M. Time-dependent broadband pricing: Feasibility and benefits. In Proceedings
of the 31st International Conference on Distributed Computing Systems (ICDCS), Minneapolis, MN, USA,
20–24 June 2011; pp. 288–298.
25. Sen, S.; Joe-Wong, C.; Ha, S.; Chiang, M. Smart data pricing: Using economics to manage network congestion.
Commun. ACM 2015, 58, 86–93. [CrossRef]
26. Zhang, L. Smart Data Pricing in Wireless Data Networks: An Economic Solution to Congestion. Ph.D. Thesis,
Hong Kong Polytechnic University, Hong Kong, China, 2016.
27. Zhang, L.; Wu, W.J.; Wang, D. Time dependent pricing in wireless data networks: Flat-rate vs. Usage-based
schemes. In Proceedings of the 33rd IEEE Annual Conference on Computer Communications (IEEE
INFOCOM), Toronto, ON, Canada, 27 April–2 May 2014; pp. 700–708.
28. Kesidis, G.; Das, A.; de Veciana, G. On flat-rate and usage-based pricing for tiered commodity internet
services. In Proceedings of the 42nd Annual Conference on Information Sciences and Systems, Princeton, NJ,
USA, 19–21 March 2008; pp. 304–308.
29. Chau, C.K.; Wang, Q.; Chiu, D.M. On the Viability of Paris Metro Pricing for Communication and Service
Networks. In Proceedings of the Conference on IEEE INFOCOM, San Diego, CA, USA, 15–19 March 2010;
pp. 1–9.
30. Ma, R.T.B. Usage-Based Pricing and Competition in Congestible Network Service Markets. IEEE/ACM Trans.
Netw. 2016, 24, 3084–3097. [CrossRef]
191
Electronics 2019, 8, 50
31. Zou, M.; Ma, R.T.B.; Wang, X.; Xu, Y. On optimal service differentiation in congested network markets. In
Proceedings of the IEEE Conference on Computer Communications (INFOCOM), Atlanta, GA, USA, 1–4
May 2017; pp. 1–9.
32. Dai, W.; Jordan, S. ISP Service Tier Design. IEEE/ACM Trans. Netw. 2016, 24, 1434–1447. [CrossRef]
33. Nesse, P.J.; Gaivoronski, A.; Lonsethagen, H. Ecosystem, QoE and pricing of end to end differentiated
services. In Proceedings of the 6th International Conference on Information, Intelligence, Systems and
Applications (IISA), Corfu, Greece, 6–8 July 2015; pp. 1–7.
34. Gibbens, R.; Mason, R.; Steinberg, R. Internet service classes under competition. IEEE J. Sel. Areas Commun.
2000, 18, 2490–2498. [CrossRef]
35. Ma, R.T.B.; Misra, V. The public option: A nonregulatory alternative to network neutrality. IEEE/ACM Trans.
Netw. 2013, 21, 1866–1879. [CrossRef]
36. Wang, S.; Xuan, D.; Bettati, R.; Zhao, W. Providing absolute differentiated services for real-time applications
in static-priority scheduling networks. IEEE/ACM Trans. Netw. 2004, 12, 326–339. [CrossRef]
37. Nandy, B.; Ethridge, J.; Lakas, A.; Chapman, A. Aggregate flow control: Improving assurances
for differentiated services network. In Proceedings of the 20th Annual Joint Conference of
the IEEE-Computer-Society/IEEE-Communication-Society, Anchorage, AK, USA, 22–26 April 2001;
pp. 1340–1349.
38. Bouyoucef, K.; Khorasani, K. A robust distributed congestion-control strategy for differentiated-services
network. IEEE Trans. Ind. Electron. 2009, 56, 608–617. [CrossRef]
39. Farrahi, K.; Gatica-Perez, D. Discovering human routines from cell phone data with topic models. In
Proceedings of the 12th IEEE International Symposium on Wearable Computers, Pittsburgh, PA, USA, 28
September–1 October 2008; pp. 29–32.
40. Song, C.; Barabási, A.L. Limits of predictability in human mobility. Science 2010, 327, 1018–1021. [CrossRef]
[PubMed]
41. Fikir, O.B.; Yaz, I.O.; Ozyer, T. A movie Rating Prediction Algorithm with Collaborative Filtering. In
Proceedings of the International Conference on Advances in Social Networks Analysis and Mining
(ASONAM), Odense, Denmark, 9–11 August 2010; pp. 321–325.
42. Salter, J.; Antonopoulos, N. CinemaScreen Recommender Agent: Combining Collaborative and
Content-Based Filtering. IEEE Intell. Syst. 2006, 21, 35–41. [CrossRef]
43. Feknous, M.; Houdoin, T.; Guyader, B.L.; Biasio, J.D.; Gravey, A.; Gijon, J.A.T. Internet traffic analysis: A case
study from two major European operators. In Proceedings of the 2014 IEEE Symposium on Computers and
Communication (ISCC), Funchal, Portugal, 23–26 June 2014; pp. 1–7.
44. Lewis, R.M.; Torczon, V. Pattern search methods for linearly constrained minimization. SIAM J. Optim. 2000,
10, 917–941. [CrossRef]
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
192
electronics
Article
A Load Balancing Routing Mechanism Based on
SDWSN in Smart City
Xin Cui 1,2 , Xiaohong Huang 1 , Yan Ma 1, * and Qingke Meng 2
1 Institute of Network Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China;
[email protected] (X.C.); [email protected] (X.H.)
2 College of Computer Science and Technology, Shandong University of Technology, Zibo 255000, China;
[email protected]
* Correspondence: [email protected]
Abstract: In the wireless sensor network infrastructure of smart cities, whether the network traffic
is balanced will directly affect the service quality of the network. Because of the traditional WSN
(wireless sensor network) architecture, load balancing technology is difficult to meet the requirements
of adaptability and high flexibility. This paper proposes a load balancing mechanism based on
SDWSN (software defined wireless sensor network). This mechanism utilizes the advantages of a
centralized control SDN (software defined network) and flexible traffic scheduling. The OpenFlow
protocol is used to monitor the running status and link load information of the network in real
time. According to the bandwidth requirement of the data flow, the improved load balanced
routing is obtained by an Elman neural network. The simulation results show that the improved
SDSNLB (software-defined sensor network load balancing) routing algorithm has better performance
than LEACH (Low Energy Adaptive Clustering Hierarchy) protocol in balancing node traffic and
improving throughput.
1. Introduction
With the rapid development of smart cities, the requirements for the resource allocation
mechanism of wireless sensor networks are gradually increasing. In [1], wireless sensor networks are
the infrastructure of many fields in smart cities, including automotive electronics, avionics, building
automation and industrial automation. In [2], Over the past two decades, various sensing system
environments have been designed and deployed in cities, towards the realization of so-called smart
cities. Such systems are based on dedicated sensor nodes, as well as ubiquitous but not dedicated
devices such as smart phones and vehicle sensors. Due to the dynamic changes of the sensor network
structure, network resources (including the remaining energy of the nodes, available bandwidth,
etc.) are also constantly changing, and the requirements for the adaptability of routing protocols are
proposed. In particular, in wireless sensor networks, the routing protocol is not only the resource
allocation of a single node, but also the resource balancing problem of the overall network. In [3],
the architecture of a smart city can be divided into four layers, including sensing, networking, cloud
computing and applications. In the future, smart cities and smart sensors will be built based on sensor
technology, hybrid networks, cloud computing and storage, and big data analysis. By achieving the
load balancing of resources, the QoS (quality of service) can be improved and the lifetime of the whole
network can be prolonged. Therefore, it is an urgent problem to improve the routing optimization
of the communication link, enhance the efficiency of network deployment, and realize network load
balance in smart city sensor networks.
The problem of load balancing in WSN has been studied by a large number of scholars for a long
time. In order to solve the problem of load imbalance in wireless sensor networks, researchers put
forward many solutions. In [4], Based on LEACH, an improved LEACH protocol in WSNs is proposed.
The LEACH protocol acts as a low-power adaptive hierarchical routing protocol, randomly selecting
cluster heads in a cyclical manner to evenly distribute energy consumption in the network. In WSN,
sensor nodes depend on each other when forwarding information packets from a source station to
a base station by routing algorithm. Some routes may be better than others, which may result in an
unbalanced contention for different routes, as one route may be exhausted more often or faster than
others. In [5], they analyze this problem from the perspective of game theory and model the path
selection problem in WSN as an evolutionary anti-coordination routing game. In order to prolong
network lifetime, candidate forwarders should be selected so that load is balanced among nodes. In [6],
they proposed an ORR, an opportunistic routing protocol. In [7], they proposed a simple and effective
queue utilization based RPL (QU-RPL) that achieves load balancing and significantly improves the
end-to-end packet delivery performance compared to the standard RPL. QU-RPL is designed for
each node to select its parent node considering the queue utilization of its neighbor nodes as well as
their hop distances to an LLN border router (LBR), owing to its load balancing capability. In [8], a
framework is proposed for load balanced routing in WSN. In-network path tagging is used to monitor
the network traffic load of nodes. Based on this, nodes are identified as being relatively overloaded,
balanced or under loaded. A mitigation algorithm finds suitable new parents for switching from
overloaded nodes. The routing engine of the child of the overloaded node is then instructed to switch
its parent.
The above dynamic routing data forwarding mainly relies on the local node information, which
easily falls into the local optimum, while the global improved routing algorithm is difficult to distribute
and is not suitable for large-scale sensor networks.
SDN came into being, control and forwarding separation features provide effective way for WSN
routing algorithms. As shown in Figure 1, SDN−based network architecture will be more flexible, and
application upgrades will be more simplified.
This paper discusses the WSN architecture based on SDN. For the multi-path optimized SDWSN
load balancing problem, a routing scheme based on an Elman neural network for improved solution is
proposed. In order to minimize the maximum link utilization in the network, this paper establishes a
mathematical model based on multi-path routing technology while satisfying the quality of service,
and the model is simulated and verified. The results show that the load balancing strategy can
minimize the maximum link utilization in the network, and fully utilize the network link resources
to reduce intra-domain delay and extend network lifetime. This paper summarizes and analyzes the
SDN technology, and designs the load balancing model of the data plane and control plane in the
SDWSN, which provides a new solution for the load balancing problem. Our major contribution can
be summarized as follows:
194
Electronics 2019, 8, 273
The algorithm model combines the hierarchical structure of an Elman neural network with the
clustering structure of a wireless sensor network routing protocol, and designs an Elman neural
network model in each cluster structure. By designing a neural network algorithm model, a little
amount of data information reflecting the characteristics of the original data is obtained. The fused
feature data is transmitted to the controller node for quickly performing load balancing of the sensor
node link.
We analyze and derive the proposed traffic matrix clustering algorithm, which describes the
dynamic adaptive adjustment process. The central controller performs a cluster analysis and
adjustment according to the flow matrix of each controller, quickly combining the sensor node traffic
data to determine the output of the improved path matrix.
In addition, because the fairness of the path selection strategy is very important to load balancing,
we use the principle of max-min to measure the uniformity of traffic. The max-min means that when
there are multiple routing schemes, the routing scheme with the smallest bandwidth utilization in the
network is selected.
The rest of the paper is organized as follows: related work about routing protocol to resolve
traffic load is summarized in Section 2. In Section 3, system framework and problem analysis are
described. Section 4 formulates the traffic load allocation with end to end multipath, proposes the
SDSNLB algorithm, and the improved solution. Section 5 shows the performance evaluation and
simulation. In Section 6, a summary conclusion is derived.
2. Related Work
In [9], it is proposed that traditional sensor networks are inflexible due to over-reliance on
proprietary services, so data and control separation modes are suitable for wireless sensor networks.
They also point out the challenges of this wireless sensor network combined with software-defined
networks, as well as the necessary basic design load balancing requirements. In [10], a new mobile
network architecture based on OpenFlow to achieve centralized control of energy-aware on demand
for load balancing is proposed. In [11], the research results of the software-defined wireless sensor
network into actual hardware systems are translated. The OpenFlow switch built a software-defined
wireless sensor network platform and runs a traffic-aware routing algorithm on it. The Open DayLight
cluster can accurately analyze the data. The flow direction in the network proves that the traffic-aware
routing algorithm can improve network utilization and reduce controller response time. Although
these new WSN architectures can solve some of the problems of traditional WSN, we should also see
that the resource allocation design of software defined wireless sensor networks is not perfect and the
research on load balancing needs to be further improved.
In [12], they propose a QoS-based multi-path routing protocol in SDN. In order to meet the QoS
requirements of network applications, this protocol designs a multi-path routing protocol based on
SDN, which significantly improves the utilization rate of idle resources in the search space. In [13],
they present a unified multi-layer architecture with multiple controllers and a dynamic orchestra
plane for software defined multi-domain optical networks. In [14], a framework for multi-layer;
multi-vendor optical network management using open standards-based SDN is proposed. In [15],
a routing algorithm based on SDN technology is proposed, which is used for a routing calculation
between AS (Autonomous Systems). The above documents, in the SDWSN network architecture, can
solve some unsolved problems of traditional routing protocol, but cannot respond in real time and be
dynamic in the aspect of load balancing of traffic.
In [16], a new control system based on the integration of SDN and IoT in smart city environments
is proposed. This control system actuates when an emergency happens, modifies dynamically the
routes of normal, emergency urban traffic in order to reduce the time that the emergency resources
need to get to the emergency area. In [17], a novel routing protocol applied SDN in wireless multi-hop
network is proposed. The routing protocol provide a shortest path, disjoint multipath routing for
nodes, and its network lifetime is longer. In [18], they highlight the application challenges faced by
195
Electronics 2019, 8, 273
wireless sensor networks for surveillance environments, those faced by the proposed approaches,
as well as opportunities that can be realized on applications of SDWSN. In the SDWSN network
architecture, the above literature focuses on the special functions that should not be ignored when
trying to improve the network function, however, the load balancing design of the traffic is insufficient.
In summary, the research results of the routing protocols in the classic wireless sensor networks
have been quite abundant. The software-defined routing protocols for new network architectures have
also achieved preliminary research results. However, the software defined wireless sensor network
technology is still immature and needs to be explored and studied in many aspects. It is of great
significance to conduct in-depth research on its routing protocols.
There are three basic roles in this model, namely the master node, the central node, and the normal
node. The master node acts as a controller for the entire network structure. This is the central execution
unit of programmable control, which controls the real-time status of the network, such as network
topology, routing, and routing restrictions, and implements the management and control functions of
the entire network. The center node is similar to the OpenFlow switch in SDN, the network device
maintains a Flow Table and processes the data stream only through the Flow Table. The generation,
maintenance, and delivery of the Flow Table are completely implemented by an external controller. As
shown in Figure 3, it is responsible for the matching and forwarding of data streams in wireless sensor
networks. A normal user node is only responsible for receiving and executing data streams.
196
Electronics 2019, 8, 273
A major feature of SDN networks is the separation of the control layer and the data layer. The
controller can obtain the topology of the entire network. At the same time, it can obtain real-time
network status information from the switch, including link load, delay, etc. We can develop a
load-balancing routing strategy for forwarding packets at the control layer.
Parameters Meaning
V, E The set of all devices and the set of links between them
C(e) The capacity of link e, e∈E
l(e) The load of link e, e∈E
(s,t) The traffic of between the nodes s,t by link e
fe
TM The traffic matrix
TM(s,t) The traffic from the routing node s to node t
U(s,t) The utilization of link e
A The set of all link utilization
m The amount of utilization contained in A
The connection weight between the i-th hidden layer (or input layer) to the j-th
xi,j
output layer (or hidden layer)
βj The output value of the jth input layer (or hidden layer)
ŷi The output value of the i-th output layer
yi The expected value of the i-th output layer
K The number of expected cluster centers
θN The minimum number of samples in each cluster domain
θS The standard deviation of the sample distance distribution in a cluster domain
The minimum distance between two cluster centers. If it is less than this number,
θC
the two clusters are merged
L The maximum number of cluster centers that can be merged in one iteration
I The number of iterations
Sj The cluster domain of traffic matrix
Nj The number of traffic matrices in S j
n Dimension of sample feature vector
197
Electronics 2019, 8, 273
Definition 1. End-to-end path: A transmission line consisting of a series of store-and-forward nodes, transfer
data information from the source to the destination.
Definition 2. Available link bandwidth: Assume that an end-to-end path contains n links, C(e) is the initial
capacity of link e. The carried traffic is l(e) , Define the available link bandwidth is C(e) − l(e) . The available link
bandwidth reflects the link characteristics actually transmitted.
Definition 3. Link Bandwidth Utilization: For ∀(s, t) ∈ E, the bandwidth utilization of the link is U(s,t) =
l(s,t)
C(s,t) × 100%.
Definition 4. Average utilization of links: The average utilization of links in the network is the average of the
∑U U(s,t)
(s,t) ∈ A
bandwidth utilization of all links, defined as U(s,t) = k .
Because the fairness of the path selection strategy is quite important to load balancing, we derive
a load balancing objective function by using the fairness principle of Min-Max. Therefore, the objective
function of link load balancing is as follows:
2
∑U (s,t)∈ A (U(s,t) −U(s,t) )
Objective function: minimize y = m
Subject to: ⎧
⎪
⎨ − TM(s,t) j = s
(s,t) (s,t)
∑ ∑ f (i,j) − ∑ f ( j,k) = TM(s,t) j = t
⎪
i < j(i,j)∈ E k > j( j,k)∈ E ⎩ 0j = s, t
(s,t)
l(e) = ∑(s,t)∈v∗v f e ≤ C(e) e ∈ E
(s,t)
fe ≥ 0e ∈ E; s, t ∈ v
The Elman neural network, which is a typical dynamic recurrent neural network, which adds a
receiving layer to the hidden layer as a one-step delay operator to achieve the purpose of memory,
thus enabling it. The system has the ability to adapt to time-varying characteristics and enhances the
global stability of the network. It has more computing power than the feed forward neural network,
and is very suitable for establishing prediction models for nonlinear data such as network traffic time
series. However, the traditional Elman network uses the gradient descent method to train the network
parameters, but the gradient descent method has the disadvantages of slow convergence and easily
falls into local minimum values. Therefore, we use the cluster and parameter adjustment methods to
train network parameters, and achieve the goal of rapid optimization.
During Elman’s learning of the sample, the error is distributed among the neurons in each layer.
According to the error, the least squares method is used to solve the error.
Then there exists ∑nj=1 xij β j = yi (i = 1, 2, 3, . . . , m)
⎛ ⎞ ⎛ ⎞
⎛ ⎞ β1 y1
x11 ··· x1n ⎜ ⎟ ⎜ ⎟
⎜ .. ⎟β = ⎜ β2 ⎟ ⎜ y2 ⎟
X = ⎝ ... ..
. . ⎠
⎜ . ⎟y =
⎜ . ⎟
⎜ .
⎜ .
⎟
⎟
⎝ . ⎠ ⎝ . ⎠
xm1 ··· xmm
β3 yn
198
Electronics 2019, 8, 273
n n 2 n 2
Q= ∑ e2 = ∑ (yi − ŷi ) = ∑ (yi − βˆ0 − βˆ1 × β1 − βˆ2 × β2 − · · · − βˆn × βn )
i =1 i =1 i =1
β0
xij = β̂ j + i = 1, 2, 3, · · · m; j =1, 2, 3, · · · n
n × βi
Constantly determines the predicted value and adjusts the parameter, until the difference between
the predicted value and the expected value ends within the allowable interval.
1
Zj = ∑ TMj = 1, 2, · · · , Nc
Nj TM ∈S j
5. Calculate the average distance between the traffic matrix and cluster centers in each clustering
domain S j
1 # #
Dj =
Nj TM∑ #TM − Zj # j = 1, 2, · · · , Nc
∈S j
199
Electronics 2019, 8, 273
6. Calculating the average of the distances between clusters of all link matrices and the
corresponding clustering domain.
1 N
D = ∑ TM j D j
N j =1
Dij = Zi − Zj i = 1, 2, · · · Nc − 1; j = i + 1, · · · , Nc
12. Compare the values of Dij and θc , The value of Dij < θc is arranged incrementally by the
minimum distance.
13. Merge two cluster centers Zik and Zjk with distance Dik jk to get the new center.
1
ZK∗ = Nik Zik + Njk Zjk k = 1, 2, · · · , L
Nik + Njk
14. If the last iterative operation (the L-th time), the algorithm ends.
Definition 5. K-L distance: Let the random variable x be in the two probability distributions P( x) and q( x) . The
K-L distance is defined as:
n P( x)
I(Q P) = ∑ P( x) × log
i =1
q( x)
Definition 6. I-Projection: Given a joint probability distribution set Q( x) and P( x) , if Q( x) ∈ Q, and satisfy
I(Q P) = I(Q P)
200
Electronics 2019, 8, 273
Q( x) is I-Projection of P( x) .For a joint probability distribution set, if the constraint condition p(Y ) is
satisfied, I-Projection of p(Y ) on R(Y ) as follows:
0 P (Y ) = 0
Q( x) = R (Y )
P( x) × P (Y ) P (Y ) = 0
By iterating the constraints, the probability of all elements is estimated by minimizing the K−L
distance. Through iterative calculations, adjustments are made while the constraints are met, so that
the final result satisfies the maximum likelihood estimate.
5. Performance Evaluation
In this paper, the SDSNLB algorithm was simulated and tested by Matlab. In the simulation
test, the wireless sensor network model consists of one center controller and three controllers, each
controller is connected to control 10 sensors. In the subsequent tests, the number of sensor nodes was
increased from 10 to 26, and the messages in the topology were fed back. The controller was operating
normally and was able to process and process each message. In practical applications, the node layout
is more dispersed, the number of hops from the node to the controller is different, and the message
that the node interacts with the controller is concentrated at the same time is extremely unlikely, so the
controller can efficiently process the incoming message.
In order to better demonstrate the effectiveness of the improved algorithm, the SDSNLB algorithm,
the LEACH and improved LEACH protocol algorithm were compared and simulated. The LEACH
protocol is a classic clustering-based routing protocol proposed in the WSN. Despite the shortcomings,
studying the basic clustering protocol LEACH can help to better understand other clustering protocols.
In addition, the hierarchical organization of the LEACH protocol is suitable for the dynamic distribution
of resources. The cluster head node in the cluster can be regarded as a controller, and the cluster
member node can be regarded as a node user, thereby better performing simulation. The improved
LEACH algorithm is designed to extend network lifetime and improve efficient data transmission
through balanced elections. The main analysis and comparison of the three algorithms on the network
node link bandwidth utilization, network throughput, and network jitter.
Figure 4 shows the experimental results of the data flow under three different algorithms. As can
be seen from the figure, when the conventional LEACH protocol algorithm is used, in a period of 0 to
10 s, the data flow in the network is relatively simple. Therefore, the effective throughput of the data
stream is close to the uplink rate. And after 10 s, as the data traffic increases, the effective throughput of
the data stream is significantly reduced. For the improved LEACH algorithm, the effective throughput
of the data stream is close to the uplink rate from 0 to 20 s, and after 20 s, the effective throughput
decreases. When using the SDSNLB algorithm, the effective throughput of the data stream approaches
the uplink rate in 0 to 100 s.
In Figure 5, it can be seen that when there are multiple data streams in the network, the load
balancing algorithm proposed in this paper can reasonably schedule the data flow according to the
load of the actual gateway egress node, and the final traffic does not exceed the uplink rate of the link.
The average bandwidth utilization is maintained at around 1.
201
Electronics 2019, 8, 273
Figure 6 shows the performance of the link load jitter. When running LEACH protocol, the link
load jitter is the highest. Compared with LEACH protocol, the standard deviation of link load in
improved LEACH is smaller, but the link load jitter is still obvious. When the load balancing algorithm
SDSNLB is running, the load standard deviation of all links in the network is minimum, the traffic load
is more evenly distributed in the network link. Due to the load balancing algorithm proposed in this
paper, it is possible to perform reasonable scheduling in real time according to the current distribution
of traffic load in the network, so as to avoid premature traffic overload of individual transmission links
in the network, thereby improving network performance.
From the above experimental results and analysis, the load balancing mechanism proposed in this
paper can be verified. Comprehensive calculations were performed by an Elman neural network using
software-defined features. The clustered feature data is transmitted to the controller node for fast load
balancing of the sensor link, which can improve the average bandwidth utilization of the network and
reduce the link load jitter of the network, thereby improving the overall performance of the network.
202
Electronics 2019, 8, 273
Figure 6. Link load jitter varies with the number of data streams.
6. Conclusions
The existence of a diversity set of paths for sensor nodes in SDWSN raises many technical issues
related to data routing, where some routes become preferable for the nodes and lead to an imbalance.
In order to improve the route optimization of the communication link and realize the load balancing of
the network in the smart city sensor network, based on the characteristics of SDN centralized control
and flexible traffic scheduling, the Elman neural network is used for the optimization calculation
and the improved load balancing forwarding path is obtained. The simulation results show that the
load balancing algorithm proposed in this paper can improve the average bandwidth utilization and
reduce the link load jitter of the network, thus improving the performance of the entire network. It
can also provide programmable data flow control method for software-defined sensor networks. The
research in this paper has practical guidance and application significance for the smart city wireless
infrastructure node link load balancing optimization problem.
Author Contributions: For this articles, individual contributions are as follows, conceptualization, X.H. and X.C.;
methodology, X.C.; software, Q.M.; resources, Y.M.; writing—original draft preparation, X.C.; writing—review
and editing, X.H., Y.M. and X.C.; funding acquisition, X.H. and X.C.
Funding: This research was funded by “Ministry of Education China Mobile Research Fund Project, grant number
MCM20160304” and “National College Student Innovation Training Project, grant number 201810433023”.
Conflicts of Interest: The authors declare no conflict of interest.
References
1. Park, P.; Ergen, S.C.; Fischione, C.; Lu, C.; Johansson, K.H. Wireless Network Design for Control Systems: A
Survey. IEEE Commun. Surv. Tutor. 2018, 20, 978–1013. [CrossRef]
2. Du, R.; Santi, P.; Xiao, M.; Vasilakos, A.V.; Fischione, C. The sensable city: A survey on the deployment and
management for smart city monitoring. IEEE Commun. Surv. Tutor. 2018. [CrossRef]
3. Qiu, T.; Chen, N.; Li, K.; Atiquzzaman, M.; Zhao, W. How Can Heterogeneous Internet of Things Build Our
Future: A Survey. IEEE Commun. Surv. Tutor. 2018, 20, 2011–2017. [CrossRef]
4. Ying, Z.; Peisong, L.; Lin, M. Research on Improved Low-Energy Adaptive Clustering Hierarchy Protocol in
Wireless Sensor Networks. Shanghai Jiao Tong Univ. Sci. 2018, 23, 613–619.
5. Attiah, A.; Amjad, M.F.; Chatterjee, M.; Zou, C. An evolutionary routing game for energy balance in Wireless
Sensor Networks. Comput. Netw. 2018, 138, 31–43. [CrossRef]
203
Electronics 2019, 8, 273
6. So, J.; Byun, H. Load-Balanced Opportunistic Routing for Duty-Cycled Wireless Sensor Networks. IEEE
Trans. Mob. Comput. 2017, 16, 1940–1955. [CrossRef]
7. Kim, H.S.; Kim, H.; Paek, J.; Bahk, S. Load Balancing under Heavy Traffic in RPL Routing Protocol for Low
Power and Lossy Networks. IEEE Trans. Mob. Comput. 2017, 16, 964–979. [CrossRef]
8. Kamal, A.R.M.; Hamid, A. Supervisory routing control for dynamic load balancing in low data rate wireless
sensor networks. Wirel. Netw. 2017, 23, 1085–1099. [CrossRef]
9. Kobo, H.I.; Abu-Mahfouz, A.M.; Hancke, G.P. A Survey on Software-Defined Wireless Sensor Networks:
Challenges and Design Requirements. IEEE Access 2017, 5, 186–197. [CrossRef]
10. Donato, C.; Serrano, P.; De La Oliva, A.; Banchs, A.; Bernardos, C.J. An openflow architecture for
energy-aware traffic engineering in mobile networks. Netw. IEEE 2015, 29, 54–60. [CrossRef]
11. Ariman, M.; Secinti, G.; Erel, M.; Canberk, B. Software defined wireless network testbed using Raspberry
Pi of switches with routing add-on. In Proceedings of the 2015 IEEE Conference on Network Function
Virtualization and Software Defined Network (NFV-SDN), San Francisco, CA, USA, 18–21 November 2015.
12. Chemeritskiy, E.; Smeliansky, R. On QoS Management in SDN by Multipath Routing. In Proceedings of
the 2014 International Science and Technology Conference (Modern Networking Technologies) (MoNeTeC),
Moscow, Russia, 28–29 October 2014.
13. Yang, H.; Cui, Y.; Zhang, J. Unified Multi-Layer among Software Defined Multi-Domain Optical Networks.
Electronics 2015, 4, 329–338. [CrossRef]
14. Cusatis, D. Reference Architecture for Multi-Layer Software Defined Optical Data Center Networks.
Electronics 2015, 4, 633–650. [CrossRef]
15. Huang, L.; Zhang, Y. Research on Application of ONF OpenFlow-Based SDN Typical Architecture.
Appl. Mech. Mater. 2014, 543, 3692–3695. [CrossRef]
16. Rego, A.; Garcia, L.; Sendra, S.; Lloret, J. Software Defined Network-based control system for an efficient
traffic management for emergency situations in smart cities. Future Gener. Comput. Syst. 2018, 88, 243–253.
[CrossRef]
17. Wang, J.; Miao, Y.; Zhou, P.; Hossain, M.S.; Rahman, S.M.M. A software defined network routing in wireless
multihop network. J. Netw. Comput. Appl. 2017, 85, 76–83. [CrossRef]
18. Modieginyane, K.M.; Letswamotse, B.B.; Malekian, R.; Abu-Mahfouz, A.M. Software defined wireless sensor
networks application opportunities for efficient network management: A survey. Comput. Electr. Eng. 2018,
66, 274–287. [CrossRef]
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).
204
MDPI
St. Alban-Anlage 66
4052 Basel
Switzerland
Tel. +41 61 683 77 34
Fax +41 61 302 89 18
www.mdpi.com