HOSPITAL SERVICES Tercera Entrega1
HOSPITAL SERVICES Tercera Entrega1
HOSPITAL SERVICES Tercera Entrega1
discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/274390870
READS
233
2 authors, including:
Oscar Barros
University of Chile
40 PUBLICATIONS 148 CITATIONS
SEE PROFILE
All in-text references underlined in blue are linked to publications on ResearchGate, Available from: Oscar Barros
letting you access and read them immediately. Retrieved on: 17 May 2016
1
1
Oscar Barros , Richard Weber, Carlos Reveco, Eduardo Ferro, and Cristian Julio
Abstract:
Demand forecasting and capacity management are complicated tasks for certain healthcare
services due to the inherent uncertainty, complex relationships, and typically high public exposure
involved. Health service demand in three Chilean hospitals has been studied concluding that it
can be forecast with high accuracy using Neural Networks and Support Vector Regression. This
investigation has allowed us design a process to manage demand by transforming the respective
demand forecasts into the resources needed to proper attention. Comparing required resources
with available resources and simulating various scenarios permits taking corrective actions when
capacity is not aligned with demand.
The proposed forecasting methods and the capacity management process have been accepted
by hospital management and staff and are currently in use in one hospital. To support the efficient
use of the developed forecasting and management methods, advanced IT systems have been
implemented that allow the routine use of the respective processes. We are currently
implementing processes and systems in one of the other participating hospitals. The results have
been so encouraging that National Health Authorities are considering the extension of the
proposed demand forecasting and management practices to close to one hundred public
hospitals in Chile.
1
Corresponding author: [email protected]; Republica 701, Santiago, Chile, tel. 562
9784037, fax 562 9784011
2
1. INTRODUCTION
Public hospitals in Chile have, in general, more demand for health services than available
capacity permits to attend within a reasonable time frame. Hence it is important for a hospital to
forecast demand with great precision, in order to adjust capacity or take alternative courses of
action, e.g. transferring patients to other facilities. For example, it is possible to discharge patients
from a hospital to a local health service center for non-complex pathologies; also private services
can be hired in case of an emergency that cannot be treated at a public hospital. Since demand
forecasts are not sufficient on their own, but serve as input for hospital management, it is required
that service demand be predicted not only on an aggregated level but for different pathology
types separately, which makes them technically more demanding.
The forecasted demand for each pathology type allows determining the required resources,
such as doctors of different specialties, reception areas, emergency room cubicle capacity and
operating room capacity. Comparing the resources needed to satisfy demand with available
capacity permits making decisions to adjust capacity or prevent or transfer demand.
Public hospitals in Chile, which process 75% of the country’s demand for health services
(MIDEPLAN, 2006) are not using any formal way of forecasting demand and managing capacity.
Current procedures are informal and defined based on the experience of the participants in the
process; furthermore such procedures are mainly oriented to solving the problem of excess
demand when it occurs. To be fair, there are some informal attempts to foresee how bad the
winter period, when most excess demand is produced, is going to be and to make some
decisions regarding the number of doctors and hospital beds that will be made available during
this season at a given hospital.
Given the situation outlined, we agreed with the Chilean Health Authority to perform an
applied research program that would use state-of-the-art analytical tools, process design
methodologies, and IT to develop a general solution for demand forecasting and capacity
management that could eventually be used at all Chilean hospitals.
We started the research in March, 2009 and selected three hospitals to be studied to
develop the methods, processes, and systems that will eventually be used in all Chilean
hospitals.
Demand forecasting and management is part of a larger design that intends to provide a
systematic solution to global hospital management. Such a solution is based on the design of a
general process structure that we developed for hospitals and that defines the management
processes which are needed to ensure a predefined service level for patients and to optimize the
use of the required resources. The general process structure allowed us to determine the key
processes where implementation of new practices would generate most value (Barros and Julio,
2010, 2011). In agreement with health authorities we selected the process described here and
another one related to operating room scheduling. In each of the selected hospitals we evaluated
3
the current situation of demand forecasting and capacity management to determine the feasibility
of introducing analytical and formal practices to improve the respective processes.
The results we present in this paper have been developed in collaboration with hospital
staff. They reviewed each of the steps described below, which led to a working process for
forecasting and managing demand. Emphasis is also given to the experiences we documented
during this work and that could be beneficial in similar future projects.
Section 2 of this paper reviews the literature on the use of analytical methods in forecasting
and other experiences in hospital capacity management. Section 3 presents how hospital
demand has been modeled using several methods with the results obtained. The processes that
convert forecasts into the resources needed to satisfy demand and manage capacity are
described in Section 4. Section 5 presents conclusions and provides suggestions for future work.
There is another line of demand forecasts focused on services. In it the variable to predict
is the number of clients who will demand the service, in order to manage capacity needed to
provide a given level of service. In a recent work, joint demand and capacity management have
been proposed for services in a restaurant (Hwang et al, 2010) where the main focus lies on
optimizing revenue for a given dynamic demand without considering, however, demand
forecasting explicitly. A similar study has been proposed for scheduling elective surgery under
uncertainty (Min and Yih, 2010) but again without considering uncertain demand which is the
main focus of our paper.
In the case of hospital services the capacity is determined by available physical facilities,
such as medical cubicles, operating rooms and beds, and human resources, such as doctors,
who perform diagnostic procedures and treatments on patients. This capacity should be planned
to guarantee a given service level and optimize use of resources; for this an accurate forecast of
the number and type of patients who will arrive in the future is needed.
Many different methods have been proposed for forecasting (Armstrong, 2001; Box et al,
1994), and several studies compare such methods in terms of accuracy of results. One of these
studies that is relevant to our work compares Neural Networks with other econometric methods
and concludes that the former give, in general, better results (Adya and Collopy, 1998). As will be
shown below, in our experiments the technique of Support Vector Regression can even
outperform Neural Networks.
Few studies of formal demand forecast in the health area have been published. Some of
these have focused mostly on predicting the number of beds required to meet emergency
demand (Jones et al, 2002; Schweigler et al, 2009; Farmer and Emani, 1990). These studies
have focused on forecasting demand in the emergency room where all patients must be attended
to, even with a considerable delay. This is important because there is no possibility of changing
the appointment to another date, or of having patients leave without attention, which is relevant to
4
the input data, because historical demand is equal to the number of patients attended. This fact
will be important for the present work, since we were only able to find good data for emergency
services. Several studies have shown, however, that in practice a small difference between
patient arrival and care service could exist (Kennedy et al, 2008) a fact that has been taken care
of in our system (see Section 4.4). Another work that uses an approach similar to ours is reported
in Shirxia et al, (2009) but we will show that our approach provides superior results. For capacity
management the usual procedure has been to simulate the flow of patients through emergency
facilities. None of the papers we have reviewed considers an explicit state of the art demand
forecasting technique, except the one by Marmor et al, (2009) that estimates demand based on a
long term moving average over the demand. Other papers that use the common approach of
static arrival distribution are the following: Garcia et al, (1995); Samaha et al, (2003); Rojas and
Garavito, (2008); and Khurma and Bacioiu, (2008).
However, to turn this quality data into useful information for the forecasting models, further
analyses and a series of transformations were necessary. By analyzing the demand that arrives
at the emergency department outliers were detected. We found that two months had substantially
higher demand than the average of the remainder of the months and decided therefore to replace
them with the respective average; see Figure 1. In both cases of removed outliers one particular
situation occurred: a special kind of flu virus led to the abnormally increased demand which
consequently could not be predicted based on historical demand data. As a solution we propose
to use expert knowledge of the physicians with experience in emergency room data in order to
adjust the forecast proposed by our system in cases where such special events happen.
12000
11000
10000
Number of Patients
9000
8000
7000
6000 Actual Demand
Figure 1: Actual vs. Adjusted Demand per Month in Luis Calvo Mackenna Hospital
When data is disaggregated by pathology type, e.g. medical and surgical, we notice huge
differences: the first one is much more volatile since it depends on factors such as temperature
and influenza like illness rate, as suggested in Jones et al, (2002) while the second one is more
stable, as shown in Figures 2 and 3. From the data it is also possible to conclude that medical
demand comprises 70% of the emergency cases and surgical demand corresponds to 30% of the
cases.
Figure 2: Medical demand for HLCM Figure 3: Surgical demand for HLCM
Demands at HEGC and HLCM have a very similar behavior, since both are children
hospitals with comparable size and target populations. HSBA data also follows a similar pattern.
6
On arrival at the emergency facilities each patient is registered, including personal data,
time of arrival, diagnosis, and classification according to severity of illness. For the purposes of
this work we obtained all this historical data for the three hospitals as follows:
For the purpose of capacity management it would also be interesting to have the exact time
when medical attention starts. This could differ significantly from arrival time but it has not been
registered to date.
Unusual demand for treatment of pathologies that appear occasionally, such as allergies
and A H1N1, was also discarded, because there was not enough data to detect a pattern; and, in
general, outliers were discarded replacing them with an average as mentioned earlier. Daily
individual data for patients was aggregated for each month to conform to the time series that we
modeled.
This data cleaning procedure was also performed to HEGC and HSBA data.
The particular type of network we used is the Multi-layer Perceptron (MLP). Its basic units
are neurons that are grouped in layers and are connected by means of weighted links between
two layers. Each neuron receives inputs from other neurons and generates a result that depends
only on the information locally available and which serves as input to other neurons. The
architecture of the network is shown in Figure 4.
Each neuron operates according to the structure in Figure 5, where the output y is
determined as a function of the weighted inputs.
Output
Neuron
Weight
Input
Function f in Figure 5 is called the activation function and may take different forms; the
most commonly used one for continuous outputs is the logistic function, as shown in Eq. (1).
The network was trained with the above mentioned historical data. The basic idea is that
previous data predicts a given future month. In particular we assumed that the pattern was
seasonal and therefore used previous values of the month we want to predict as some of the
inputs to the model. The structure of the network consists of an output layer with one neuron that
generates the desired forecast. The input layer contains the variables we will use to explain the
demand. In the hidden layer we used a number of neurons between input and output neurons,
since a high number will tend to copy the data (over fitting) and a small number will not produce
good forecasts.
As mentioned already, previous months were used as input data. However, there are
months that are more relevant than others. We tried to select relevant attributes using a genetic
algorithm, as suggested in Shirxia et al, (2009), but results were not encouraging. In Shirxia et al,
(2009) a common pitfall in neural network design was made, which is to separate the data set into
just two groups: one for training and one for testing (Zhang, 2007). This results in trying to
minimize the error over the testing data and leads to an over fitting of the resulting model. In our
case, we divided the data into three sets: 70% for training; 20% for testing, where the network is
trained to minimize the test error. The third set with 10% of the data is independently used to
validate results. This use of an independent set provides a better evaluation of future results.
Regarding the network architecture we tested several parameters, such as the number of
epochs to use, the learning rate, and the number of hidden neurons. Best results were obtained
for 10,000 training epochs, maintaining the model with minimum error in the training set; a
learning rate of 0.2 with a momentum of 0.3. Also, decaying was introduced, but this only helps to
get to the solution faster with no significant changes in results.
Based on results which will be shown later, we selected a Neural Network with 18 input
neurons. If N is the index of the month to be forecast , three neurons corresponding to the values
of the same month in previous years, N-12, N-24, and N-36, were included; 3 neurons
representing the tendency between months given by the differences between N-12 and N-13, N-
8
24 and N-25, N-36 and N-37 and a set of 12 binary variables to represent the months of the year
are also part of the network`s input layer. This provided a solution that can forecast up to a year
in advance and takes account of tendencies. Thus the network has 18 input neurons plus an
additional bias neuron that helps to separate cases and allows having smaller Neural Networks
than without this bias.
The output layer contains simply one neuron that generates the forecasted demand in
month N. The hidden layer contains 10 neurons providing the model an adequate degree of
freedom, usually calculated by (Number of input neurons + Number of output neurons)/2. The
resulting network is shown in Figure 6.
Another method we tested is Support Vector Regression (Chen and Schölkopf, 2005;
Hofmann et al, 2008; Smola and Schölkopf, 2004), which is a variation of Vector Support
Machines (SVM) based on the following idea. SV regression (SVR) performs linear regression in
9
a high-dimensional feature space generated by a kernel function as described below, using the -
insensitive loss function proposed by Vapnik, (1995). This function allows a tolerance degree to
errors not greater than as shown in Figure 7. The description is based on the structure and
terminology used in Smola and Schölkopf, (2004).
With and
In Eq. (3), denotes the dot product in . When the identity function is used, i.e.
, no transformation is carried out and linear SVR models are obtained.
The goal when using the -insensitive loss function is to find a function that fits given
training data with a deviation less or equal to and, at the same time, is as flat as possible in
order to reduce model complexity. This means that one seeks a small weight vector . One way
to ensure this is by minimizing the norm (Smola and Schölkopf, 2004), leading to the
following optimization problem:
s.t.
10
Figure 7: Support Vector Regression to Fit a Tube with Radius ε to the Data and
Positive Slack Variables ξi
This is known as the primal problem of the SVR algorithm. The objective function takes into
account generalization ability and accuracy in the training set, and embodies the structural risk
minimization principle (Vapnik, 1998). Parameter C > 0 determines the trade-off between
generalization ability and accuracy in the training data, and the value up to which deviations
larger than are tolerated. The -intensive loss function has been defined as in Eq. 10.
(10)
It is more convenient to represent this optimization problem in its dual form. For this
purpose, a Lagrange function is constructed and, once applying saddle point conditions, the dual
problem in Eqs. (11) to (14) is obtained (Vapnik, 1995).
s.t.
11
This is the quadratic optimization problem that has to be solved to obtain the solution of the
SVR model, which is a function of the dual variables and . Using saddle point conditions it
can be shown that Eq. (15) holds (Vapnik, 1998). Replacing this expression in Eq. (3), the final
solution of the SVR algorithm is obtained as Eq. (16).
3.3. Results
We used Mean Average Percentage Error (MAPE) and Mean Square Error (MSE) as
performance measures to determine model accuracy, as defined in Eqs. (17) and (18).
12
For the Linear Regression, Weighted Moving Average, and SVR the same inputs as the
ones described for the Neural Network were used (except for the bias). Results obtained using
these four methods for the validation sets of all hospitals are displayed in Table 2.
Weighted Moving
Linear Regression Neural Network SVR
Average
HLCM Medical
12.67% 150,686 7.53% 144,729 7.45% 161,689 5.61% 154,861
Demand
HLCM Surgery
6.54% 27,097 7.36% 20,137 8.99% 22,947 5.09% 25,199
Demand
HEGC Medical
15.91% 3,114,376 16.5% 1,978,332 7.7% 1,043,753 6.86% 606,324
Demand
HEGC Surgery
8.55% 14,302 8.96% 11,730 8.3% 12,155 5.88% 8,120
Demand
HEGC Orthopedic
8.41% 35,940 8.60% 28,247 5.12% 29,851 4.44% 25,460
Surgery Demand
HSBA Medical
8.27% 3,125,071 11.83 % 850,342 7.9% 1,226,165 6.97% 643,984
Demand
HSBA Maternity
10.54% 23,738 6.98% 12,408 10.6% 38,629 3.24% 7,867
Demand
As shown in Table 2, in four out of seven cases best results are obtained with SVR, when
using MSE as criterion to compare the performance of the different models. When using MAPE
as criterion for comparison, SVR appears as the best option for demand forecasting in all cases.
These results were obtained using Rapid Miner 4.6.000, the Neural Network library from WEKA
and SVR from LIBSVM (Chang and Lin, 2001) Library but using Rapid Miner as graphic user
interface (GUI).
Figures 8 and 9 display the results graphically showing forecast with SVR and actual
demand for HLCM, with a 90% confidence interval for the forecast. This interval has been
calculated based on the hypothesis that the forecast error has a normal distribution with a mean
zero. This hypothesis has been confirmed using a Kolmogorov-Smirnov test.
13
7000
6500
6000
5500
Number of Patients
5000
4500 Actual Demand
4000 Forecast
3500
Upper Bound
3000
2500 Lower Bound
2000
1400
1300
1200
1100
Number of Patients
1000
900 Actual Demand
800 Forecast
700
Upper Bound
600
500 Lower Bound
400
Similar results are shown in Figures 10, 11 and 12 for HEGC, and in Figures 13 and 14 for
HSBA.
14
10000
9000
Number of Patients 8000
7000
6000 Actual Demand
5000 Forecast
4000 Upper Bound
3000 Lower Bound
2000
1400
1300
1200
1100
Number of Patients
1000
900 Actual Demand
800 Forecast
700
Upper Bound
600
500 Lower Bound
400
3000
2500
Number Of Patients
2000
Actual Demand
1500
Forecast
1000 Upper Bound
Lower Bound
500
9000
8000
Number of Patients
7000
1700
1600
1400
Actual Demand
1300
Forecast
1200 Upper Bound
1100 Lower Bound
1000
Based on the results presented above, we conclude that Support Vector Regression is an
appropriate method for predicting demand in hospitals, but without discarding the possibility of
using simpler methods that may provide acceptable results under certain conditions. Since all the
aforementioned models generate forecasts in less than one minute on a standard PC, the run
time is irrelevant for the proposed monthly use f the algorithm.
As mentioned earlier, medical hours is one of the most scarce and expensive resources
in Chilean public hospitals. To estimate the number of medical hours required to attend the
expected demand in the emergency service, the following distributions are considered:
For the purpose of this paper, the capacity management analysis, results, and
recommendations presented in this section will focus on the emergency service of the Luis Calvo
Mackenna Hospital.
17
Category Description
C1 Dying Patient
C2 High Risk Patient
C3 Low Risk Patient
C4 No risk Patient
As shown in Figure 15, the illness severity distribution varies across the different months of
the year. Nevertheless, the severity distribution per month remains relatively stable over the
years. Therefore, in the following calculations each month will be considered to have a
deterministic distribution of patients for each category.
18
60%
50%
Patients per Category (%)
40%
30%
C1
C2
20% C3
C4
10%
0%
Month
Given the emergency patients forecast and the illness severity distribution, the expected
number of patients per category can be calculated. In order to determine the number of doctors
required to attend such demand, the next step is to characterize the behavior of the attention time
for each category. For this purpose, a representative sample of C1, C2, C3 and C4 individuals
was used.
Each C1 patient is referred to the reanimation room for resuscitation, upon its arrival to the
emergency service. When this occurs, and depending on the complexity of the surgery or
diagnosis, between one and three the doctors currently working in the attention cubicles leave
immediately their activities to focus on the dying patient. After the medical attention, the time
required to stabilize and treat the C1 patient is registered in a logbook, along with the names of
the doctors that performed the medical procedure. Using this information, we run a Kolmogorov-
Smirnov test to determine the distribution of the C1 patients´ attention time. We concluded that it
follows a log normal distribution with a mean of 108 minutes and a standard deviation of 121
minutes. We also noticed that the number of doctors required to attend these patients has a
19
distribution highly concentrated in two doctors, therefore using this value for the following
calculations.
When trying to characterize the consults of C2 patients, the data used did not provide
enough information to determine a distribution of the attention time. However, in a discussion with
doctors a consensus was reached in that the average time to attend C2 patients is 60 minutes,
with a standard deviation of 20 minutes. A normal distribution was chosen to represent the
behavior of this attention time. Finally, and with a high level of confidence, we determined the
distribution of the attention time for C3 and C4 patients as lognormal with means of 10 and 7
minutes, and standard deviations of 7 and 3 minutes, respectively. The non-dying patients are
attended by only one doctor.
The time distributions presented above provide a stochastic basis to estimate the time
that doctors will spend to attend the patients from each category, expected to arrive to the
emergency room. A summary of the attention time distributions found for the different severity
categories is presented in Table 4. The number of doctors required to attend each patient per
category is presented in Table 5.
8%
On the supply side, the total available medical hours per month are determined by the
simple multiplication of the number of doctors available by the number and length of shifts per
doctor in that period of time. In the case of HLCM, the number of doctors does not vary inter- or
intra- shifts. On the demand side, a simple method to calculate the medical hours required to
meet the forecasted demand is by considering a deterministic monthly behavior obtained from the
model, divided uniformly within each month and distributed within each day as presented in
Figure 19. As explained above, the severity distribution of these patients can be considered as
deterministic for each month. With these considerations regarding the expected demand, the
forecasted number of patients per category can be calculated multiplying the total number of
forecasted patients by the proportion of patients per category.
The final step is to convert the demand per category into medical hours, distributed along
each hour of the day. To get a quick idea of the medical hours required to meet such demand, we
multiplied the forecasted number of patients per category by the mean of the corresponding
attention time distributions presented in Table 4. Table 6 illustrates the expected behavior of
demand during the day and the availability and rate of use of the medical resources.
Arrival Time Available Resources Required Resources Medical Hours Available Occupation
[Medical Hours/ [Medical Hours/ [Avail. Resources – Req. Rate (%)
Month] Month] Resources]
0:00 - 0:59 90 41 49 46%
1:00 - 1:59 90 24 66 27%
2:00 - 2:59 90 15 75 17%
21
With these simple calculations, several interesting observations arise regarding the medical
resources in the emergency service. For example, the period from 0:00 until 8:00 shows a high
rate of idle resources, while between 10:00 and 21:00 the medical resources are overly utilized.
From the management point of view, for instance, some doctors from the night shift could be
reassigned to work during peak hours, but always remaining prepared to meet a potential
emergency by having one doctor on duty at home during the night.
The forecast detailed in Section 3 has an error with a normal distribution. To simulate the
different demand scenarios for each month, the forecast was adjusted several times by different
22
values sampled from the normal distribution of the error. Due to the stability of its daily behavior,
the demand of each scenario was distributed uniformly across every day of the month. The daily
demand was further disaggregated into hourly demand using the distribution shown in Figure 16.
As a consequence, we were able to generate several scenarios of monthly demand
disaggregated per hour. Using the hourly forecasted demand from each of the scenarios
generated as described above, the average forecasted demand was calculated for each hour of
the day. We assumed that the hourly demand arrives according to a Poisson process; then this
average corresponds to the mean of the Poisson distribution per hour.
Upon their arrival at the emergency service, patients are categorized and served
according to the time distributions presented in Section 4.1, which are also stochastic. Now that
the stochastic behavior of the demand and the medical attention has been incorporated into the
problem, we will discuss the construction of the simulation model and its role in the management
of hospital capacity.
The simulation model allows us to observe how the expected flow of patients will use the
different services offered in the facilities of the hospital, and how the available capacity performs
when attending such demand. As a consequence, capacity can be redistributed or adjusted with
the objective of eliminating bottlenecks and reducing idle resources. This provides a powerful
decision tool for managing capacity in such a way that a given service level can be guaranteed at
minimum cost.
a) Configuration Management
In this section, two main designs of the system will be contrasted with the expected
demand: the current configuration and a Fast Track configuration with Triage.
In the current configuration, only dying patients are given priority when arriving at the
emergency service. They are immediately taken to the resuscitation service for stabilization, and
then referred to the operating room or the intensive care unit service. Patients who are not
critically ill must provide their personal data upon their arrival and subsequently wait for medical
attention. Therefore, the relative importance in terms of severity of illness is not considered for
these patients. The admission time is distributed uniformly between 5 and 10 minutes. After
medical attention, the patients can be referred for hospitalization, for diagnostic testing, or
immediate discharge. The hospitalization service does not belong to the emergency service and
hence does not use its medical resources. The time in diagnostic test services is distributed
uniformly between 2 and 4 hours; patients are usually requested to bring the test results back to
the doctor within the same day of the evaluation.
The Fast Track configuration includes a Triage to categorize the patients upon their
arrival at the emergency service, which is performed by a nurse. The reason behind the creation
of the Triage lies in the importance of providing medical attention promptly to patients with the
most urgent needs (C2 and C3). Half of the patients categorized as C4 in the Triage are referred
to the Fast Track attention, which is performed by a doctor who does educational activities with
23
medical students from 10:00 to 15:00. This allows reducing the average waiting time within these
hours with resources that otherwise would not be used. The rest of the configuration remains as
in the current system.
In both configurations outlined above, the doctors shift structure consists of two 12-hour
shifts (day and night) with 3 doctors attending in each of them. For each configuration, we
developed a simulation model that includes the demand and emergency service characterizations
presented earlier. An example of the models is shown in Figure 17.
As stated above, the average LOW will be used as the main criterion to compare the
performance of the system designs. This metric was calculated weighing the demand per
category by its respective average LOW. The results for this metric for the Base and Fast Track
simulated configurations are presented in Table 7.
Configuration (3 doctors day and night) Avg. (min) Std. Dev. (min)
Base Case 64.2 1.2
Fast-Track with Triage 57.3 0.9
Based on the scenarios run in the simulation, a 95% confidence interval was generated
for the LOW of each configuration. The intervals obtained were (55.5, 59.1) and (61.8, 66.6) for
the Base Case and Fast Track with Triage, respectively. To test if the LOW differs significantly
between these two configurations we applied the procedure proposed by Law and Kelton (1982).
This comparison is established based on the difference of their respective statistical distributions,
as displayed in Table 8. Since the confidence interval does not contain the value 0, we confirm
that the difference shown in Table 7 is statistically significant.
The simulation model resembles the actual behavior of the system, since current
average LOW is within the confidence interval of the simulated Base case.
The main bottleneck occurs in the medical consults and during the day-shift, as
addressed in section 4.3.
The Fast Track Box with Triage reduces the average LOW in 6.9 minutes, which
corresponds to a 10.8% reduction of the current average waiting time.
b) Resource Management
After deciding which configuration performs better on the emergency service, the next
question to be addressed is related to the impact that a redistribution, reduction, or addition of
medical resources would generate on the performance of the system. The resource management
analysis, then, will be performed for the Fast Track configuration only.
The first issue we noticed was that the current shift structure, including the number of
doctors per shift, was not constructed based on the daily behavior of the demand, presented in
Table 5 and previously in this section. The simulation model was then run for several
assignments and number of doctors per shift under the Fast Track configuration with Triage and
assuming a stochastic demand.
If the current structure of two 12-hours shifts is maintained, an initial scenario would
consider only redistributing the six doctors available in a different manner. Given the greater
arrival of patients during the day, as observed in Table 6, a possible redistribution could include
the reassignment of a doctor from the night to the day shift. As a consequence, four doctors
would attend during the day shift and only two at night. The average LOW of this scenario would
be 45.1 minutes.
25
The simulation was run using from 5 to 7 doctors within 24 hours, and distributed as
explained above. The idea behind analyzing the reduction of the current number of doctors is to
assess whether the performance of the system is affected in a significant manner when these
resources are lacking, either by management decision or by absenteeism. The average LOW for
different numbers and assignments of resources are summarized in Figure 18, including the 95%
confidence interval for each of the points.
90
82,8
80
70
LOW (min)
60
46,3 Average LOW
50 45,1
40,5 40,2 Upper Bound
40
Lower Bound
30
20
5 5,5 6 6,5 7
Medical Resources (Number of Doctors)
Figure 18: Average LOW and Confidence Intervals for Different Numbers of Doctors
As expected, the addition of medical resources improves the service quality, measured in
average LOW. The interesting result is that the average LOW decreases dramatically when
reducing the number of medical resources from 5 to 5.5 doctors, while it decreases more
gradually when new resources are added. To test whether the LOW difference between all the
scenarios included in Table 18 is statistically significant we applied again the procedure proposed
by Law and Kelton (1982). Table 9 shows the confidence intervals when comparing the LOW of
these scenarios. As it can be observed, increasing from 5 to 5.5 doctors provides a significant
improvement to the performance of the system, while the change between 5.5 and 6 doctors
does not. Nevertheless, increasing from 5.5 to 6.5 doctors does show statistical significance.
26
The previous analysis of the system performance provides hospital managers a decision
tool for determining the number and distribution of medical resources on the emergency service,
based on a cost/benefit analysis of resources and service improvement.
The forecasting method and the capacity management process proposed in this paper have
been validated and accepted by hospital managers and staff, and are currently in use in one of
the hospitals. For this to be possible, we embedded the forecasting model and resources
management logic in support computing systems we developed, which may be used in daily work
practices. We are currently implementing these processes and systems in one of the hospitals
included in this study. The results have been so encouraging that National Health Authorities are
considering to extend the demand forecasting and management practices we have designed to
close to one hundred public hospitals in Chile.
Acknowledgements: The second author is grateful for the support provided by the Complex
Engineering Systems Institute (ICM: P-05-004-F, CONICYT: FBO16) (www.isci.cl).
27
References
Aburto, L., Weber, R. Improved supply chain management based on hybrid demand forecasts.
Applied Soft Computing 2007; 7; 1; 136-144
Adya M, Collopy F. How effective are neural nets at forecasting and prediction? A review and
Evaluation. Journal of Forecasting 1998; 17; 451-461
Armstrong J S. (Ed.). Principles of forecasting. Kluwer Academic Publishers: Norwell, MA; 2001
Barros O., Julio C., "Enterprise and process architecture patterns", Business Process
Management Journal 2011; 17; 4; 598 – 618
Box G E H Jenkins G M, Reinsel G C. Time Series Analysis, Forecasting and Control, 3rd Ed.
Prentice-Hall: Englewood Cliffs, NJ; 1994
Chang C C, Lin C J. LIBSVM: A Library for Support Vector Machines[EB/OL], 2001. Software
available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
Chen P H, Lin C. J., and Schölkopf B., A tutorial on ν-support vector machines, Appl. Stoch.
Models. Bus. Ind. 2005, 21, 111-136.
Farmer, R D T, Emami, J. Models for forecasting hospital bed requirements in the acute sector.
Journal of Epidemiology and Community Health 1990; 44; 307-312
García M L, Centeno M A, Rivera C, and DeCario N, Reducing Time in an Emergency Room Via
a Fast-Track, Winter Simulation Conference, 1995, 1048-1053
Hwang J, Gao L, Jang W. Joint Demand and Capacity Management in a Restaurant System.
European Journal of Operational Research, in press
Law A.M., Kelton W.D. Simulation modeling and analysis. Mc Graw Hill, 2001
Min D, Yih Y. Scheduling Elective Surgery under Uncertainty and Downstream Capacity
Constraints. European Journal of Operational Research, to appear,
Rojas L M, Garavito L A. Analysing the Diana Turbay CAMI emergency and hospitalization
processes using an Arena 10.0 simulation model for optimal human resource distribution, Revista
Ingeniería e Investigación 2008; 28;1; 146-153.
Samaha S, Armel W S, Stark D W. The Use of Simulartion to Reduce the Length of Stay in an
Emergency Department, Winter Simulation Conference, 2003, 1907-1911
Smola A J, Schölkopf B. A tutorial on support vector regression. Statistics and Computing 2004;
14; 3
Zhang G P. Avoiding pitfalls in neural network research. IEEE Transactions on Systems, Man and
Cybernetics—Part C: Applications and Reviews 2007; 37; 3-13