Notes
Notes
Notes
S EMESTER 2
APPM2021
Course Notes
by
Authors
2023
Contents
Contents i
1 Introduction 1
1.1 Assumed background for the course . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.2 Review of the Modelling Process . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
1.3 Some popular real-life systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
1.3.1 Physical systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
1.3.2 Biological Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.4 Systems of differential Equations . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.4.1 Categories of ODE Systems . . . . . . . . . . . . . . . . . . . . . . . . . . 7
1.4.2 Solutions of ODE Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
1.5 Basic terminology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
1.6 Qualitative Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
i
4.2.1 Direction field . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
4.2.2 Simple Isoclines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
4.2.3 Separatrices (straight line trajectories) . . . . . . . . . . . . . . . . . . . 20
4.3 Phase Diagrams of 2D Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
4.4 Characterising Critical Points . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
4.5 Finding the shape of trajectories analytically . . . . . . . . . . . . . . . . . . . . 23
4.6 Obtaining solution curves from the phase diagram . . . . . . . . . . . . . . . . . 24
4.7 Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
6 Linear Stability 34
6.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
6.2 Types of equilibria (Linear systems) . . . . . . . . . . . . . . . . . . . . . . . . . . 34
6.3 Stability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
6.4 Eigenvalues and linear stability . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
6.5 Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
7 Nonlinear stability 43
7.1 Linearization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
7.1.1 Taylor’s Theorem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
7.1.2 Linearization Theorem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
7.2 Local stability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
7.3 Limit Cycles . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
7.4 Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
ii
9 Discrete systems 60
9.1 Why Discrete Models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
9.2 From Difference Equations to Discrete Systems . . . . . . . . . . . . . . . . . . . 60
9.3 Discrete First Order Equations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
9.3.1 Equilibrium Solutions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
9.3.2 General Solutions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
9.3.3 Stability Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
9.4 Discrete Second Order Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
9.4.1 Linear Stability Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
9.4.2 Nonlinear Stability Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . 69
iii
Chapter 1
Introduction
Mathematical modelling is a topic that looks into the use of various models, presented in
the form of techniques to analyse problems that arise in real life. Such techniques include
differential equations, numerical techniques, optimisation techniques. etc. No matter what
technique is used the process of employing it is the same.
• Rate of change.
• Concavity.
4. Linear algebra
• Matrix algebra.
1
5. Matlab Use
Reasonable use of Matlab will be assumed from your experience with the two topics done
in the first semester. In particular, you should know how to use Matlab to solve ODE’s
numerically. A brief review of the process is given in another section later.
• Set objectives.
• Define variables.
• Analytical or computational
• Check if the model agrees with assumptions and certain conditions that should be
satisfied.
• Qualitative solution.
• Analytic solution.
2
• Does the model answer all the questions necessary to understand the
system/problem?
In this module, we shall focus on problems that can be modelled using differential or
difference equations. Because the approach is already selected for the particular problems,
we shall employ Steps 3 to 5 most of the time.
3
Figure 1.1: Spring Mass
4
1.3.2 Biological Systems
Example 1.3 Single species model
In an introductory module to mathematical modelling, you may have come across a solution
to the model
dN
= r N, (1.1)
dt
describing the growth of a population of a single species. At that point, you may have been
interested in finding a solution to the system without really understanding the meaning of
the solution as it relates to describing how population growth is expected to develop with
time. The conditions under which it will grow or decline. In this module, we shall revisit
such models and derive more information about the system’s behaviour.
5
Discrete Systems
Example 1.6 (Discrete Model) Although many models are based on the assumption that
events occur over continuous time, there are many situations in which observations are
taken in discrete time. Population census is a typical example of this case. This makes it
necessary to use discrete models which can be analysed in ways similar to those used for
continuous systems. In some cases, the behaviour of such discrete models may be quite
different from their continuous counterparts, for the same system.
The above list of examples is not exhaustive, but illustrative of the many dynamical systems
that can be modelled with systems of differential equations. Although solutions of the
systems are the most desirable thing to obtain, we shall focus our study of such systems on
analyzing them in an effort to get some understanding of their behaviour that can put
some light on their future states. Such an analysis is often the only thing possible to do
since solutions may not be obtainable. We shall use specific models related to the above in
exercises in the future.
d x1
= f 1 (t , x 1 , x 2 , ....., x n )
dt
d x2
= f 2 (t , x 1 , x 2 , ....., x n )
dt
.
d xn
= f n (t , x 1 , x 2 , ....., x n ), (1.2)
dt
where f i , i = 1, 2, ..., n are continuously differentiable functions. Another way to write the
above equation is
d x(t )
= f(x) or x0 = f. (1.3)
dt
Such a system may also arise as a transformation of an n-th order differential equation. At
any time t , x = (x 1 (t ), x 2 (t ), ...x n (t )) describes the state of the system.
6
1.4.1 Categories of ODE Systems
There are three broad categories of ODE systems. If the function f has no explicit
term/expression in the variable t then the system is said to be autonomous. Thus an
autonomous system has the general form
d x1
= f 1 (x 1 , x 2 , ....., x n )
dt
d x2
= f 2 (x 1 , x 2 , ....., x n )
dt
.
d xn
= f n (x 1 , x 2 , ....., x n ), (1.4)
dt
In such a case the subsequent state of the system is dependent only on the current state
and not on time. The functions f i may be linear or non-linear in the variables x i (t ). If there
exists at least one nonlinear term, then the system is said to be nonlinear. Some systems do
not have any constant terms appearing on the right-hand side. Such systems are said to be
homogeneous, otherwise, they are said to be non-homogeneous. In this module, we shall
be discussing autonomous systems, both linear and nonlinear.
Using the analogy of a particle in space, the state of a system describes the position of the
particle at any time t is (x 1 (t ), x 2 (t ), ..., x n (t )). As t changes the position changes also with
respect to t in the phase space. As this happens the position traces a path known as the
7
phase path or phase path. Corresponding to each initial state or position, there is a unique
trajectory. A collection of these phase paths generated by choosing different initial states
gives a phase portrait of the systems. No trajectories cross over each other in the phase
space.
An equilibrium solution is that of the system in which the system remains for any
subsequent time. At this point, the system is said to be in equilibrium. In general, this is the
solution of the system
dx
= f(x) = 0. (1.5)
dt
At a point x, displaced from the critical point, either x0 =f(x) > 0 or f(x) < 0. This in turn
means that the rate of change is either increasing or decreasing. Determination of the
equilibrium solution, x e , is normally the starting point when analysing a system. The
equilibrium solution is also commonly called a fixed point, stationery point, critical
point, or steady-state solution. All these terms will be used interchangeably.
At any point besides the critical point, the system state (the positions of the particle) is
changing in a specific direction. The net direction of change is given by x0 , a gradient (or
direction) vector whose components are x0i , i = 1, 2, ..., n. As t changes, this direction also
changes. A collection of direction vectors is called a direction field. Note that the direction
of change at a point is the direction of the tangent to the curve at that point.
If it is possible to solve the system for x i (t ), i = 1, 2, ..., n, these are called the time series
solutions of the system.
• Analysing the behaviourof the system in the neighbourhood of the critical point(s).
• Determining the stability of the critical points by analysing the phase diagrams and
using other algebraic techniques available.
8
Chapter 2
2.1 Introduction
Reading : Zill and Cullen Chapter 2 (p39-49) (NB: Zill uses the notation y = y(x) instead of
x = x(t ).)
NB: Zill uses the notation y = y(x) instead of x = x(t ).
dx
x0 = = f (x) (2.1)
dt
dx
Only one solution x(t ) is sought for this system. If we recall from basic calculus, dt
dx
describes the rate of change in x with respect to t . At any point t, dt
can be evaluated. Thus
any value of t corresponds to a (phase) point (x(t ), x 0 ) = (x, f (x)). As t changes, the trace of
the points generates a phase path.
x 0 = f (x) = 0. (2.2)
At a point x, displaced from the critical point, either x 0 = f (x) > 0 or x 0 = f (x) < 0.
9
Activity 2.1
Suppose x is a function of t . Illustrate by means of sketches the following cases:
1. When x is increasing at an increasing rate;
2. When x is increasing at a decreasing rate;
3. When x is decreasing at an increasing rate;
4. When x is decreasing at a decreasing rate
We will associate with x 0 > 0 a movement from left to right, and x 0 < 0 a movement from
right to left along the plot of x against x 0 . The phase plane of a 1D system is that of x against
f (x). As such the phase plot can be drawn without using a direct dependence on t. Thus
the dependence on t can be eliminated and the resulting equation is called the phase plane
differential equation.
For a phase diagram, we plot x against x 0 or f (x). The graph of f (x) is a straight line
through the origin, the critical point (0, 0) in this case. However, the orientation of the line
depends on whether a > 0 or a < 0
Case 1: a > 0
ax > 0 if x > 0 and ax < 0 if x < 0. So as x gets positively large, x 0 > 0, and hence a positive
move (left to right). Similarly, as we move away from 0 in the negative direction, x 0 < 0,
hence the phase point moves from right to left.
Case 2: a < 0
Activity 2.2
1. Draw a phase path similar to the one in Case 1.
2. Study the movements for x > 0 and x < 0.
3. Mark the directions on the diagram.
Later on, we will focus on the meaning of the direction of the phase path relative to the
critical point.
10
Activity 2.3
For each of the systems
(i ) x 0 = ax 3 ; (i i ) x 0 = x 2 − 1; (i i i ) x 0 = ax 2
1. Determine the equilibrium point(s).
2. Plot the phase diagrams associated. with the cases a > 0 and a < 0.
3. Specify the type of equilibria in each case.
• Attractor : if arrows directed is towards the critical point on both sides. (see Example
2.1, (Case 2) and Activity 2.3 (i i ) (x e = −1).
• Repeller: if arrows are directed away from the critical point on both sides.(see
Example 2.1, (Case 1) and Activity 2.3 (i i ) (x e = 1).
• Shunt: if arrows do not change direction on either side of the critical point; i.e.
towards it on one side and away from it on the other. (see Activity 2.3 (i i ) ).
11
2.5 Solutions of ID systems
Solutions of 1D systems can be obtained by the standard analytic methods of solving first
order differential equations. A plot of x as a function of t gives the graph of the required
solution, also called the time series solution.
dx 1
Example 2.2 The time series solution of dt
= x 2 is x = −t +c
. The particular solution
corresponds to a particular condition, x(t 0 ) = x 0
Activity 2.4
Consider again the phase portrait of the system x 0 = x 2 − 1 in Activity 2.3.
1. Use the phase portrait of the system to sketch the solution plot of the system
for x(0) > 1, 0 < x(0) < 1, x(0) < −1.
2. Now solve the differential equation x 0 = x 2 −1, for the cases x(0) = 2, x(0) = 0.5,
x(0) = −2. Plot these solutions on the same axes, for t > 0.
3. Compare the above plots.
2.6 Exercises
1. For each autonomous system given below
dx
i) dt = x 2 − 3x
dx
ii) dt
= (x − 2)4
dx
iii) dt
= x ln (x + 2)
2. Use the phase portraits in 1. above to sketch the time series solution of the systems.
3. Solve the equations in 1(c)i and 1(c)ii above analytically. Plot them and compare them
with your sketches in 2.
4. Use MATLAB or other sofware to draw the phase portraits and solutions for the systems
in 1.
12
Chapter 3
We now want to apply our knowledge of solving and analysing systems to real life
situations. Systems modelled by 1D systems occur in various disciplines. Here we start
with an application to population dynamics.
Activity 3.1
1. Find the equilibrium point(t) of the above system.
2. Draw a phase portrait for the system.
3. What is/are the type(s) of critical point (s).
In reality no population will grow exponentially because as the population gets larger, there
is likely to be crowding, which in turn may result in greater competition for the limited
resources. The effect of this is that the growth rate r will now be density-dependent, and
will be more likely to diminish with time.
13
If the growth rate r is dependent on population size (density) (i.e. r = r (N )), then equation
(3.1) becomes
dN
= N r (N ). (3.2)
dt
First a few notes about r (N )
• As N increases r (N ) decreases
• For large N , r (N ) has been shown to be negative r The simplest form is a straight line:
r (N ) = a − bN where a > 0 is the growth rate without environmental influences, and
b > 0 is the effect of increased population density.
NB: When b = 0, then the density-independent model (3.1) hods. Thus the
density-dependent model (3.2) becomes
dN
= N (a − bN ) (3.3)
dt
Note that this is now a nonlinear system and the equilibrium population is attained when
the rate of change of the population is zero.
Activity 3.2
Draw a phase portrait, of the model as given in 3.3 for a, b > 0, showing clearly
the direction arrows on the path.
So we can let a = r, b = r /K , and, write the logistic equation in the alternative form
dN r
= N (r − N ) (3.4)
dt K
Note here that f (K ) = 0. i.e. when N = k, N 0 = 0.
14
3.2.1 Solution of the Logistic Model
Activity 3.3
Show that the solution of the logistic equation is
aN0
N (t ) = (3.5)
bN0 + (a − b)e −at
A solution curve for 0 < N0 < K is shown on the diagram. Problem 1 in the next exercise
gives an opportunity to sketch the (time series) solutions of the logistic equation for different
values of N0 . Note that no matter how close N0 is chosen to 0, the solution will grow fast
at the early stages (away from N = ba , the equilibrium level. As t → ∞, e −at → 0. Hence
aN0
N (t ) → bN0 = ba .
3.3 Exercises
1. Computer Exercise Consider again the logistic model (3.4) with K = 100.
dv
m = mg − kv
dt
where k is a positive constant of proportionality and g is the acceleration due to
gravity (a constant), governs the velocity v of a body of mass m falling under the
influence of gravity.
15
3. The model for the spread of a virus in an isolated university campus of 1000 students
is given by
dx
= kx(1000 − x)
dt
where k is a constant and x in the number of infected students. Suppose a student
carrying a flu virus returns to campus.
b) If it is assumed that the rate at which the virus spreads is proportional not only
to the number x of infected students but also to the number of students not
infected, determine the number of infected students after 6 days if it is further
observed that after 4 days, 50 students are infected. (Ans: 276 students)
dN
= N (1 − 0.0005N ), N (0) = 1
dt
a) How many supermarkets are expected to adopt the new procedure over a long
period of time. Illustrate this on a phase portrait.
c) Solve the initial-value problem (you may use MATLAB) and graph its solution.
How many supermarkets are expected to adopt the new technology when t = 10?
16
Chapter 4
Many physical systems that change with time are modelled by differential/difference
equations of order higher than one. A transformation of these equations lead to systems
consisting of a set of first-order differential equations (see equation(1.4)) to be solved
simultaneously for the dependent variables.
The state of the system at any time t is defined by the point (x(t ), y(t )). Note that although
the variables x and y are functions of t , for autonomous systems there is no term that
involves t explicitly. Hence the subsequent state of the system depends on the current state
and not on t .
If for some constants a, b, c, d , k1 and k2, the functions f and g have the form
then the system is said to be linear. Otherwise, it is nonlinear. If in the expressions of f and
g , the constants, k1 and k2 are both zero, the system is said to be homogeneous, otherwise,
it is non-homogeneous.
A solution of the above system is a pair of functions x(t ) and y(t ) such that (4.1) is true.
The graph of such a solution in x y-space is a trajectory(or path) of the points (x(t ), y(t ))
17
generated by choosing different values of t . If we are given x(0) and y(0), we might expect
that x(t ) and y(t ) would be uniquely determined for all t . In our study, we will assume that
f , g ∈ C 1 functions. It is useful to think of x and y as the coordinates in an x y -plane. A
solution (x(t ), y(t )) then describes a parametric curve in this plane. For each value of the
parameter, t a point of the plane is given. Another way to think of these trajectories is that
they are contours of the surface defined by the solution of the 2D system. If t is time, then
(x(t ), y(t )) is a moving point that follows the trajectory.
If the moving point starts from the same point x 0 , y 0 but at a different time, it will follow the
same trajectory. There is exactly one trajectory through each point x 0 , y 0 in the region
where f and g are C 1 . Different trajectories do not intersect.
We now describe some features that arise in the analysis of systems: equilibrium solutions,
simple isoclines, and separatrices.
dx
= f (x, y) = 0, (4.3)
dt
dy
= g (x, y) = 0, (4.4)
dt
which can be done using standard algebraic techniques. Other terms used for the
equilibrium solution are critical point, stationary point, steady-state solution.
Several possibilities can arise in the search for critical points of 2D systems. The
equilibrium the equation may have no solution, one solution or multiple solutions.
For linear, homogeneous systems, the equilibrium equations have the form
ax + b y = 0
(4.5)
cx + d y = 0
or
" #" # " #
a b x 0
= (4.6)
c d y 0
18
which can be interpreted as the intersection of the two lines f (x, y) = 0 and g (x, y) = 0.
1. Exactly one critical point (at the intersection of the two lines), still exist if the
determinant ad − bc 6= 0.
2. Parallel lines, in which case there are no critical points.
3. Two lines coincide, which means the whole line consists of critical points.
4. a = b = 0 or c = d = 0 or both, which means the lines are degenerate.
Activity 4.1
For each system given below determine the critical point(s), if they exist.
dx dy
(a) dt
= −y; dt
=x
(b) x = 3x + 2y; y 0 = 2x − 2y
0
(c) x 0 = −x − y + 8; y 0 = 2x − y − 4
(d ) x 0 = y; y 0 = x 2
(e) x 0 = y; y 0 = 2x − x 2
Once the equilibrium solution(s) (x e , y e ) have been determined the process of analysing
the behaviour of the system for any displaced position (x, y) around it can be done. Let’s
discuss more concepts in the 2D context that will assist in doing this.
Recall that geometrically, the direction is a directed vector. Thus the x-direction is
horizontal and the y-direction is vertical. The direction of (x, y) is thus the resultant vector
dx dy
from a combination of dt
and dt
.
The net direction of x and y at the point (x, y) is the gradient vector of the solution curve at
that point, given by the sum of the x- and y- direction vectors. The possible combinations
of x 0 and y 0 are as shown on the diagram in Figure 4.1
19
Figure 4.1: Direction field
As the position of (x, y) changes with t , different gradient vectors can be determined at
each position, and a collection of these forms the direction field. Note that the overall
magnitude and direction are determined by f (x, y) and g (x, y) on the right-hand side of
(4.1). Hence it is sufficient to determine the direction from the signs of f (x, y) and g (x, y),
which are in turn determined by the signs of x and y. The phase plane in the 2D case
consists of the x- and y-axes.
Here is another way to determine the resultant direction/gradient vector. If we assume that
dx
dt
6= 0 so that t is an inverse function of x and y(t ) is a composite function of x, then we
have
dy
dt dy dt dy
dx
= = . (4.7)
dt dx dx
dt
Thus the direction/gradient of a phase path at the point (x, y) can also be obtained from
d y g (x, y)
= . (4.8)
d x f (x, y)
d x f (x, y)
= . (4.9)
d y g (x, y)
20
separatrices, hence they are also called asymptotes.
p
(d − a) ± (a − d )2 + 4bc
m= , b 6= 0. (4.11)
2b
General steps
b) Determine the direction field on all sides of the simple isoclines; i.e Find where
x 0 > 0, x 0 < 0, y 0 > 0, y 0 < 0.
dy dy
In the form of (4.10), this determining where dx
> 0, dx
< 0.
3. Sketch the curves by sketching several paths that follow the net directions, starting at
different points. (The initial points represent the initial conditions of the system.)
For the linear system (4.2), the simple isoclines and the direction field are easily
determined as:
21
x-direction y-direction
ẋ = 0 when y = − ba x ẏ = 0 when y = − dc x
ẋ > 0 when y > − ba x ẏ > 0 when y > − dc x
ẋ < 0 when y < − ba x ẏ < 0 when y < − dc x
Example 4.1
Consider the system:
dx dy
= x − y; = 5x − y, (4.12)
dt dt
whose critical point is (0, 0). The simple isoclines, orientation and directions are
summarised in the following table:
Orient./dir. Line/region
ẋ = 0 y = x (| on this line)
ẋ > 0 y < x(→ below line)
ẋ < 0 y >x ( above line)
ẏ = 0 y = 5x(- on this line)
ẏ > 0 y < 5x ( ↑ below line)
ẏ < 0 y > 5x ( ↓ above line)
Activity 4.2
Draw the phase portrait for the systems
dx dy
(a) dt
= −y; dt
=x
dx dy
(b) dt
= x + y; dt
= −x
0 0
(c) x = −x − y + 8; y = 2x − y − 4
(d ) x 0 = x 2 − 2x; y0 = y
Identifying all critical points, isoclines and asymptotes, as well as showing the
directions, Also state the nature of the critical points (i.e. attractor,... etc).
Exercise 4.1
Draw the phase diagram of the system
dx dy
= x(1 + y); =x−y (4.13)
dt dt
22
the critical points can be further characterised as stable or unstable. For now, based on
the phase portraits, we can characterise a critical point either as asymptotically stable if the
arrows flow towards the critical point (an attractor), or unstable if they flow outwards from
the critical point (a repeller). Apart from these two scenarios, the direction field may have
neither of them or a combination of them. The various types of critical points are shown on
a separate page in Figure 4.2. Later on, we will discuss how to characterise critical points
based on algebraic conditions when we discuss stability in more detail.
x 0 = ax + b y, y0 = cx + d y (4.14)
dy f (x, y)
= , (4.15)
d x g (x, y)
which describes the relationship between x and y, This is a first-order differential equation
which in many cases, can be solved using analytical methods. The solution of this equation
has the form h(x, y) = 0. Different values of the parameters will give rise to different curves
for the above relationship. These are the trajectories of the system, hence giving the phase
portrait thereof.
It is important to note that plotting the trajectories from the solution of the equations may
not be easy because of their complexities. However, the phase portrait approach will
normally always work.
We consider again the previous examples and solve the phase equation to find the
equations for the trajectories.
Example 4.2
dy
For the system x 0 = y, y 0 = x we have dx
= xy . This is a separable equation and so we can
write it as yd y = xd x and solve it to find
y 2 x2
= + c 1 or y 2 − x 2 = c. (4.16)
2 2
23
This is the equation of a hyperbola centred at (0, 0). By varying c we obtain the family of
hyperbolae on the x y-plane.
Activity 4.3
Find the equation of the solution curves of the system in Example 4.1
Although it is possible to find solutions of the first-order phase differential equations’ the
plots of their solutions may not be so trivial. Hence phase diagrams are better sketched
from the techniques discussed earlier.
Exercise 4.2
Sketch the solution curves corresponding to a (i ) repelling spiral, (i i ) a saddle point.
24
4.7 Exercises
1. For each of the systems given below:
a) Find the equilibrium point(s).
b) Plot the phase diagram that clearly shows the trajectories and their directions.
(i) x 0 = x − 2y, y 0 = 3x − 4y
(ii) x 0 = 3x + 2y, y 0 = −2x − 2y
(iii) x 0 = −x − y + 8, y 0 = 2x − y − 4
(iv) x 0 = x − y, y 0 = x2 − 1
(v) x 0 = ye y , y 0 = 1 − x2
(vi) x 0 = −3x + 6x y, y 0 = 2y − x y
(vii) x 0 = x 2 − y 2 − 1, y 0 = 2y
2. Given below are the parameters a, b, c, and d associated with various linear systems. For
each system defined by this set of parameters,
a) Find the critical point(s) of the system and specify their type.
b) Sketch the phase diagram for the system.
(i) a = 0, b = 1, =¸ − 4, d = 0
(ii) a = 1, b = 3, c = 1, d = −1
(iii) a = 2, b = 1, c = 1, d = 2
(vi) a = −3, b = −2, c = 1, d = −5
(v) a = 1, b = 2, c = −1, d = −2
(vi) a = 3, b = −1, c = 1, d = 2
(vii) a = 3, b = −18, c = 2, d = −9
3. Discuss the nature and stability of the simple critical points of the system corresponding
to the following nonlinear equation
d 2x dx
2
+6 − x 2 + 4x = 0
dt dt
25
26
Figure 4.4: Time series solutions for the attracting spiral above
27
Chapter 5
It has been noted that the solution to the system (4.2) is a pair of functions (x(t ), y(t )). You
know by now that each initial value corresponds to a trajectory or integral curve generated
by the pair (x(t ), y(t )). The phase diagram depicts the evolution of the system state from
arbitrary initial states.
We now discuss two methods used to determine the solution of a given linear autonomous
system (4.2),
x 0 = ax + b y [1], y 0 = c x + d y [2]. (5.1)
28
[2] ÷ c and solve for x :
1 dy d 1 dy d
= x + y, → x= − y, c 6= 0. (5.3)
c dt c c dt c
Differentiating the last equation with respect to t gives
dx 1 d2y d d y
= − . (5.4)
dt c dt2 c dt
Hence, [1] becomes
1 d2y d d y 1 dy d
µ ¶
− =a − y +by (5.5)
c dt2 c dt c dt c
or
d2y dy
2
− (a + d ) + (ad − bc)y = 0, (5.6)
dt dt
which is a second-order differential equation with constant coefficients. To solve it, the
characteristic equation is
λ2 − (a + d )λ + (ad − bc) = 0, (5.7)
and
1 dy d
x(t ) = − y, c 6= 0
c dt c (5.10)
(λ1 − d ) λ1 t (λ2 − d ) λ2 t
= c1 e + c2 e
c c
Each of the above solutions can be plotted separately for a portrait of how each variable
changes with time. The phase plot is that of x(t ) against y(t ).
or
du
= Au, (5.12)
dt
29
where we have let u 1 (t ) = x(t ) and u 2 (t ) = y(t ).
The advantage of using this format is that it is easily generalised to solve larger systems.
du
= ûλe λt . (5.14)
dt
Hence
du
= Au = A ûe λt = ûλe λt , (5.15)
dt
from which
" #" # " #
a b x̂ x̂
Au = ûλ, or =λ , (5.16)
c d ŷ ŷ
(a − λ)(d − λ) − bc = λ2 − (a + d )λ + ad − bc = 0,
the same characteristic equation obtained in the first method, whose two roots are given by
p
(a + d ) ± (a + d )2 − 4(ad − bc)
λ= .
2
In vector form the solution is
where û1 and û2 are the eigenvectors corresponding to λ1 and λ2 respectively. Also, c 1 and
c 2 are arbitrary constants (associated with the roots λi ).
30
Note that the two solutions given by (5.19) are explicitly
Three types of general solutions associated with the various cases about the roots λ1 and λ2
arise:
is
u = c 1 û1 cos βt + i c 2 û2 sin βt .
¡ ¢ ¡ ¢
Actually, the fact that λ1 = λ2 leads to the fact that û1 and û2 are conjugate vectors, i.e. û2 =
û1 . If we let
1 i
v̂1 = (û1 + û2 ), v̂2 = (−û1 + û2 ),
2 2
then manipulation of the two solutions gives v̂1 and v̂2 as real vectors. This leads to a more
general solution,
31
Figure 5.1: Solutions for different values of λ1 and λ2
32
5.3 Exercises
For each system below find the eigenvalues and their corresponding eigenvectors. Hence
deduce the solutions of the systems.
a) x 0 = 2x + 3y, y 0 = 2x + y
dx dy
b) = −x + 3y,
dt dt = −3x + 5y
à !
2 8
c) X0 = X
−1 −2
33
Chapter 6
Linear Stability
6.1 Introduction
Two issues will be discussed here concerning the equilibrium solutions:
1. The type of field created by the trajectories around the critical points; i.e. the shape of
trajectories.
The eigenvalues are the same roots obtained in the previous section from solving the
characteristic equation.
λ2 − (a + d )λ + ad − bc = 0, (6.1)
as p
(a + d )2 − 4(ad − bc)
(a + d ) ±
λ1 , λ2 = .
2
In terms of the given matrix A, the expressions, a + d and ad − bc, are respectively the trace
and determinant of A. i.e. a + d = t r (A), and ad − bc = d et (A).
34
To simplify our notation let
T = a + d (the trace)
D = ad − bc (the determinant)
∆ = T 2 − 4D (the discriminant)
The types of roots (eigenvalues) for a given system are determined by the discriminant ∆:
The various types of eigenvalues lead to different equilibrium states of the system. These
equilibrium states are described by the limit of the solutions (5.19) at infinity. We want to
characterise the equilibrium states using the eigenvalues, even without knowledge of the
solutions.
The following broad categories of critical points can be associated with the various
eigenvalue types:
Figure 6.1: Nodes: a) Stable (λ1 , λ2 < 0) , b) Unstable (λ1 , λ2 > 0).
35
ii) Case 2: λ1 and λ2 have opposite signs; i.e. λ1 < 0 < λ2 or λ2 < 0 < λ1 . In terms of (5.19),
one of the exponential terms will decrease while the other increases. Note that since the
decreasing term never vanishes, the trajectories will not reach the critical point, but will get
closer and then divert away. Hence the critical point is a saddle point.
Figure 6.3: Degenerate nodes (λ1 = λ2 = λ) a) Unstable improper nodes b) Stable improper
nodes c) Unstable Star point d) Stable Star point.
36
3. Complex conjugate roots: λ1 , λ2 = α ± βi :
Here ∆ < 0 (or T 2 < 4D). Two types of critical points arise for this case:
i) Case 1: A Centre: arises when Re(λi ) = α = 0 (pure imaginary roots). this is better seen in
terms of (5.25)-(5.26). When α = 0, the exponential factor reduces to 1, leaving only the
trigonometric terms, Hence a periodic behaviour of the solutions will occur. Sometimes
this critical point is referred to as a focus.
ii) Case 2: A Spiral focus occurs if α, β 6= 0 and the trajectories around the equilibrium point
have spiral shapes. In (5.25)-(5.26), depending on whether α > 0 or α < 0, the solutions will
get larger or smaller, respectively, due to the exponential term. Thus the amplitude will vary
with time. At the same time some periodic behaviour, attributed to the trigonometric
factors will occur. Thus spiral curves will be generated from different initial points.
The orientation of the spirals depends on whether α and β have the same or opposite signs.
Figure 6.5: Above are Spiral Foci (α, β 6= 0) a) Stable, b) Unstable; Below are degenerates c)
Stable, d) Unstable
37
6.3 Stability
The phase plane equation alone is not enough to determine the stability of the critical
points of a given system. Time dependence must be considered.
We want to understand the stability of the equilibrium solutions of the system (4.1).
Suppose a system is slightly displaced from its equilibrium state and then allowed to evolve
with time. Stability is about the behaviour of the solution if the system is displaced from its
equilibrium state.
In broad terms, a critical point of a given system may either be stable or unstable.
Definition 6.1 The critical point P (x e , y e ) is called stable if for every radius r 0 > 0 we can
find another radius r 1 > 0 (possibly smaller) such that any trajectory that passes through a
point inside the circle with centre P and radius r 1 will thereafter stay inside the circle with
centre P and radius r 0 . An equilibrium point that is not stable is called unstable.
1. Stable: if for an initial point x 0 within a radius R of the critical point, the solution will
remain within this radius for any future time.
2. Asymptotically stable: if with time, it will return to its equilibrium state. On the phase
diagram, the direction field (arrows) will be towards the critical point. Thus an attractor is a
stable critical point.
3. Unstable: if it will be driven away from its equilibrium state as time increases. Here the
direction field (arrows) will be outward, away from the critical point. Hence a repeller is
unstable.
4. Neutrally stable: if the system oscillates indefinitely about, the equilibrium values after
the system is displaced from the equilibrium position. These are illustrated in Figure (6.6).
38
Figure 6.6: Stability scenarios
The question at this point is whether we always have to drag the phase portrait in order
to deduce the stability of the critical points. In some situations even plotting the phase
diagram may not be straight forward, and yet we will still be interested in understanding
the behaviour of the system about the critical points. In this section, we discuss ways of
determining stability properties without drawing the phase portraits, in a similar way that
we were able to determine the type of critical points.
Since the exponent, λt , of the solutions is associated with the characteristic roots of the
system, it seems logical to associate the behaviour of the solutions with the type and sign of
these eigenvalues. Thus an analysis of the stability of the systems can be derived from
knowledge of these eigenvalues.
39
Continuing with the notation
used earlier to categorise the equilibrium points by type, we now use these same conditions
to determine stability. A summary of the conditions and characterisation of the equilibrium
points for linear systems is now presented:
N B.: If D = 0 (i.e. ad = bc) then the system has an equilibrium point at any point along the
straight line ax + b y = 0. This is Case 1C in the above summary table.
40
Theorem (Stability Criteria-Linear systems)
An equilibrium solution is
• Stable if the real parts of both roots are less than zero (negative).
• Unstable if the real part of at least one is greater than zero (positive).
• Neutrally stable if the real part of one root equals zero and the other is less than or
equal to zero (unless both roots are identically zero)
Thus the linear system is stable if the eigenvalues lie in the upper left part of the complex
plane. If the eigenvalues are purely imaginary, the linear system has a centre and the
critical point is neutrally stable, but not asymptotically stable.
The above characterisation (type and stability) of the critical points can be summarised on
a T D-plane as shown in Figure 6.7
Figure 6.7: Diagram from Zill Cullen nineth edition indicating types of critical points for the
various values of T, D, and ∆ of a linear system
41
From the diagram in Figure 6.7, we note that:
1. The case ∆ = 0 corresponds to the parabola D = T 2 /4. The other types of equilibria are
either below ∆ > 0 or above ∆ < 0 this parabola.
2. Saddle points appear on the part of the plane below the T -axis. The small axes indicate
that the roots are real and have opposite signs.
3. Roots falling on the space above the T -axis and below the parabola would yield nodes.
4. Roots between the D-axis and the parabola correspond to foci and centres.
It is useful to be able to read this summary and extract information about the type of roots.
6.5 Exercises
1. Determine the type and stability of the models in the exercises of the previous section.
a) Discuss the type and stability of the equilibrium points. Compare your findings
using the phase diagrams obtained earlier.
42
Chapter 7
Nonlinear stability
Reading from Zill: Chapter 10. Unlike linear systems, stability analysis of nonlinear systems
is complicated by the possible existence of more than one critical point. Thus for nonlinear
systems, it is normal to speak of local stability since the behaviour of the system around a
particularly critical point may be different from the behaviour around another critical
point. One critical point may be stable while another critical point of the same system may
be unstable.
x 0 = f (x, y)
(7.1)
y 0 = g (x, y)
For nonlinear systems, the above form can be used only as an approximation of the given
system. The transformation of a nonlinear system to the above form is called the
linearization of the nonlinear system. Under certain conditions, the stability of the
nonlinear systems can then be deduced from that of its approximate linear system. It turns
out that under such suitable conditions, whatever stability condition is revealed by the
approximate linear system holds true for the nonlinear system it approximates. It is
important to point out that nonlinear systems can be approximated by such linearization
in some cases and not in others. hence this technique needs to be applied cautiously.
43
7.1 Linearization
The stability analysis of nonlinear systems is based on the following Taylor theorem for more
than one variable:
or
f (x 0 + h, y 0 + k) = f (x 0 , y 0 ) + h f x (x 0 , y − 0) + k f y (x 0 , y 0 ) + .... (7.4)
We apply this result and find an approximation of the given nonlinear system by using a
Taylor expansion of f (x, y) and g (x, y) near an equilibrium point (x e , y e )
We begin by supposing an equilibrium point of the nonlinear system is (0, 0). Then for
points (x, y) near (0, 0) we can use Taylor’s theorem to write
Combining the above two expansions provides a way of writing the given nonlinear system
as
x 0 = ax + b y + Φ1 (x, y)
y 0 = c x + d y + Φ2 (x, y)
or
à ! à ! à !à ! à !
x0 x a b x Φ1 (x, y)
=A = + . (7.5)
y0 y c d y Φ2 (x, y)
à ! à !
x0 x
=A . (7.6)
y0 y
N.B. A is the Jacobian of f (x, y) and g (x, y) evaluated at the equilibrium point (x e , y e ).
44
Definition 7.1 An equilibrium point is said to be simple if its linearised system xr has no
zero eigenvalues; i.e. if d et (A) 6= 0
Definition 7.2 A simple critical point is called hyperbolic if A in its linearization of Ax has
no eigenvalues with zero real parts; i.e Re(λi ) 6= 0 for all i.
Example 7.1
Consider the system
x 0 = x + 2y + x 2 , y 0 = 2x + y + x y 2 .
a = f x (x e , y e ), b = f y (x e , y e ), c = g x (x e , y e ), and d = g y (x e , y e ) (7.7)
Definition 7.3 The equilibrium point (x e , y e ) is called isolated if there is some circle around
which there are no other stationary points of the system. This is automatic if ad − bc 6= 0 for
the matrix. A of the linear approximation to the system near (x e , y e ).
Activity 7.1
Consider the system
x 0 = y, y 0 = 2x + x 2 (7.8)
1. Recall/Identify the critical points of the system. Determine whether they are
isolated. isolated.
2. write a linear approximation of the system about each of the critical points.
45
7.1.2 Linearization Theorem
If we are going to use an approximation of the given system, we need to be certain that any
conclusions about the type and stability of critical points derived from the linearized
system, will be related and informative of the type and stability of the critical points of the
original nonlinear system. This is, is the structure of the nonlinear system the same as that
of its linearization? The following theorem provides conditions for the equivalence of the
two systems.
Theorem 7.1 Let the nonlinear system (4.1) have a simple critical point (0, 0) (for
simplicity). Then the neighbourhood U of this equilibrium, the phase portraits of the
nonlinear system (4.1) and its linearization in (7.7) are equivalent.
In other words, if λi are the eigenvalues of the linearised system, then so long as the critical
point is simple, the nonlinear system and the corresponding linearised system are
equivalent.
In fact, provided ad − bc 6= 0 and the matrix A has distinct eigenvalues that are not purely
imaginary, the stationary points of the nonlinear system and its linear approximation will
always be of the same type.
Exceptions:
• ad − bc = 0: at least one root is 0 - the phase portrait of the system and its linear
approximation may differ.
• Eigenvalues of A are equal and nonzero - stability may be the same but the type may
differ; e.g. Linear has a node and nonlinear has a spiral point.
Thus near a simple critical point the system is structurally stable - it is robust to small
perturbations. So if a critical point is simple it is enough to study the linearization Ax, as if
it was a linear system x 0 = Ax.
Because we have performed a transformation for points assumed to be near the particular
equilibrium point, we say that the stability analysis is local. Locally, we can use
characterisation of the stability using the theory of linear systems. Each point, if isolated,
has to be studied separately.
46
7.2 Local stability
Stability of nonlinear systems is determined by the linear approximation to the system at
the equilibrium point, provided that the coefficients of the linearised system are such that
ad − bc 6= 0 and the linear approximation does rot have a centre.
dy
= c(x − x e ) + d (y − y e ), (7.10)
dt
be the linear approximation to the system near (x e , y e ). Assume that ad − bc 6= 0. Then the
given
à equilibrium
! point is asymptotically stable if the real parts of the eigenvalues of
a b
A= are both negative and is unstable if at least one of those real parts is positive.
c d
Following the above synopsis we can summarise the nature of critical points for nonlinear
systems in Figure 7.1.
Example 7.2
The system
x 0 = y, y 0 = 2x − x 2 ,
has the points at (0, 0) and (2, 0). (0, 0) is a simple critical point (Φ(x, y) = x 2 and is a saddle
point.
For the critical point (2, 0) we make a change of variable z = x − 2 (i.e. x = z + 2) and obtain
the system
z 0 = y, y 0 = −2z − z 2 .
The point (0, 0) is a centre of the corresponding linear system. From this we have that (0, 0)
is either a centre or a spiral focus for the original system. We further observe that a
trajectory C passing through the positive x-axis near (0, 0) must intersect the negative
x-axis. But the last system is changed if we replace y by −y and t by −t . which implies that
C is closed. Therefore (0, 0) is a centre, so (2, 0) is a centre for the original system.
Activity 7.2
Use linearization to determine the type and stability of the system
x 0 = y − x 2 + 2, y 0 = x 2 − x y.
47
Figure 7.1: Diagram from Zill Cullen nineth edition indicating types of critical points for the
various values of T, D, and ∆ when analysing a nonlinear system
Example 7.3
dx
= µx − ωy − x(x 2 + y 2 ) = f (x, y, µ, ω), (7.11)
dt
dy
= µy + ωx − y(x 2 + y 2 ) = g (x, y, µ, ω), (7.12)
dt
Where µ and ω are parameters. The equilibrium point ls determined from
µy + ωx − y(x 2 + y 2 ) = 0, (7.14)
48
Multiplying (7.13) by y and (7.14) by x and subtracting leads to
µx y − ωy 2 = ωx 2 + µx y,
and λ = µ ± ωi . Thus the type and stability of the critical point depends on the sign of µ:
If µ < 0, the system has a stable spiral focus at (0, 0).
If µ = 0, the system has a neutrally stable centre at (0, 0).
If µ < 0, the system has an unstable spiral focus.
The following points are important and they describe the nature of limit cycles:
The above points are typical of limit cycles in general. There is a change of stability is
certain parameters change from being negative to being positive. Also the limit cycles are
isolated in terms of the trajectories immediately around them.
The question may arise, how do we know whether we have a limit cycle or a periodic
solution?
Figure 7.2
49
7.4 Exercises
1. Use linearization, where appropriate, to determine the type and stability of the critical
points of systems below. Sketch the phase portraits.
a) x 0 = −4y + 2x y − 8, y 0 = 4y 2 − x 2
a) x 0 = x 2 − y 2 − 1, y 0 = 2y
a) x 0 = ye y , y 0 = 1 − x2
a) x 0 = x − y, y 0 = x2 − 1
a) x 0 = 1 − 2x y, y 0 = 2x y − y
a) x 0 = y − x 2 + 2, y 0 = x2 − x y
2. Discuss the nature and stability of the critical points of the system modelled by the
following nonlinear system obtained from the differential equation.
d 2x dx
2
+6 − x 2 + 4x = 0.
dt dt
3. Consider the system
x 0 = y + x(1 − x 2 − y 2 )
y 0 = −x + y(1 − x 2 − y 2 )
a) Show that the transformation x = r cos (θ), and y = r sin (θ) , leads to the system
r 0 = r (1 − r 2 ), θ 0 = −1. (7.15)
b) Use the transformed system to show that the system has a limit cycle. Describe the limit
cycle and determine whether it is stable.
c) Use linearization to determine stability of the system. Does this method help to determine
stability of the system? Explain.
50
Chapter 8
1. Identify the two parameters involved in the system (the values that have to be known).
Identify also the equilibrium position of the system.
2. Now suppose the body is displaced slightly of its equilibrium position and then
released from rest. Identify and describe the two forces acting in the system.
4. Write a mathematical expression that represents the fact that the upward force is
opposite the downward force and proportional to the displacement of the body from
equilibrium.
d 2x
= −ω2 x (8.1)
dt2
51
8.1.2 Qualitative analysis
In order to apply the techniques we have discussed for sketching phase diagrams we need
to convert this second order differential equation to an equivalent system of linear first
order equations.
Activity 8.2
3. Use the phase diagram to deduce the oscillatory behaviour of the system.
• y = dd xt gives the velocity of the body. Thus y = 0 means the body is at rest.
dy 2
• dt = dd t x2 is acceleration, which we associate with the restoring force from the spring.
d 2x
¶
(NB: m 2 = F = −kx.
dt
Models of interacting populations are examples of nonlinear models. Earlier in the module
the ways in which populations was mentioned. Now we look at related models more closely.
The most general form of a model for interating populations of sizes x and y is given by
dx
= x(a − bx − k y) (8.2)
dt
dy
= y(c − d y − σx) (8.3)
dt
where a, b, c, d , k, and σ are positive constants of proportionality. The following activity is
meant to spark some thoughts about the population system.
Activity 8.3
52
Suppose x, y 6= 0. (What does this assumption mean?)
1. Let b = k = d = σ = 0.
(b) How do each species grow? Does the interaction affect the growth of the species?
(a) How does this affect the rate of growth of each species?
(b) Does the presence of one species affect the other species? Explain.
(a) Describe how the species interact in this case and how their growth rate is
affected.
A Predator-prey Model
One of the popular models of a predator-prey intraction is due to Lotka and Volterra, and
has the general form:
dx
= x(a − bx − c y) (8.4)
dt
dy
= y(−k + λx) (8.5)
dt
Activity 8.4
1. Which of the variables x and y is associated with prey, and which one with predator.
2. Describe the meaning of each constant in the model. The Case of Unlimited Food
Source for the Prey (b = 0)
53
The Case of Unlimited Food Source for the Prey (b = 0)
The above model is further simplified by assuming that there resources are available in
abundance to support the prey population. Under this assumption the above system
becomes
dx
= x(a − c y) (8.6)
dt
dy
= y(−k + λx) (8.7)
dt
Activity 8.5
1. Describe the situations represented by x = 0 and y = 0 and their effect on the system.
3. The prey:
Describe the conditions under which the prey population is at equilibrium, increasing
and declining in terms of the constants and the predator population.
4. Do a similar investigation for the predator, stating the effect of an increase in the
constants k and λ.
6. Discuss the stability of the system using (a) The phase diagram; (b) Linearisation.
Activity 8.6
4. Suppose the mass is displaced slightly from the equilibrium position and held in that
position. Describe all the forces acting in this system and express them in
mathematical form.
54
5. If the mass is released from its displaced position, show that the motion will be
described by the equation
d 2θ
+ q sin (θ) = 0, q > 0 (8.8)
dt2
10. Compare the two approaches to the analysis of the system. Which one was easier?
Which one revealed more information? You will have the opportunity to explore
pendulum further in the tutorials. Other variations of the system will also be
investigated.
There are a number of areas where sytems are modelled by nonlinear systems. Here a few
are presented.
dVC
C = IC , (capacitor) (8.9)
dt
VR = f (I R ) , (resistor) (8.10)
d IL
L = VL , (inductor) (8.11)
dt
where VC represents the voltage across the capacitor, I R represents the current through the
resistor, and so on. The function f (x) is called the V − I characteristic of the resistor. In the
classical linear model of the RLC circuit we assume that f (x) = R x where R is the
resistance. Kirchoff’s current law states that the sum of the currents flowing into a node
equals the sum of the currents flowing out. Kirchoff’s voltage law states that the sum of the
voltage drops along a closed loop must add up to zero. Determine the behaviour of this
55
circuit over time in the case where L = 1,C = 1/3, and f (x) = x 3 + 4x.
ẋ 2 = x 1 , VR = x 13 + 4x 1 , ẋ 1 = VL , x 2 + VR + VL = 0
ẋ 1 = −x 13 − 4x 1 − x 2 , ẋ 2 = 3x 1
The system has an equilibrium point at (0, 0). We perform an analysis of the system based
In terms of the physical system, the overall behaviour can be described in terms of two
quantities: the current through the resistor and the voltage drop across the capacitor.
Regardless of the initial state of the circuit, both quantities eventually tend to zero.
Furthermore it is eventually true that either voltage is positive and current is negative, or
vice versa. The behaviour of other quantities of interest can be described in terms of these
two variables (based on the equations of the system). For example x 1 actually represents
the current through any branch of the circuit loop.
Various models have been developed for the study of the epidemics. On of the simplest one
supposes that β is the rate at which susceptibles are infected, and γ is the rate at which
56
current infectives become isolated. Then the dynamics of the disease is described by
dx
= −βx y
dt
dy
= βx y − γy (8.12)
dt
dz
= γy
dt
57
8.3 Exercises
1. Consider the model of a simple pendulum governed by the system
• What is the physical interpretation of the extra term (first derivative term)?
• Use the analysis of the linearised system to determine local stability near the
equilibrium points.
• Sketch a phase portrait of the system for −2π < θ < 2π.
d 2x
+ x − x3 = 0 (8.14)
dt2
• Use linearisation to determine the stability of the systems.
• Use a numerical solver to obtain the phase plot and solutions of the two systems
using the initial conditions x(0) = 2, ẋ(0) = 0 and x(0) = 2, ẋ(0) = −3 in turn.
Compare your results with the conclusions drawn in (a) above.
give a deterministic model of the problem. Find the equations of the phase paths and
sketch the phase diagram. Show that, when initially y = 1, and x = N , the number of
people who ultimately never hear the rumour is x 1 , where
³x ´
1
2N + 1 − 2x 1 + N log =0
N
58
4. In a simple model of a national economy, I˙ = I − αC , Ċ = β(I −C −G), where I is the
national income, C is the rate of consumer spending, and G the rate of government
expenditure; the constants α and β satisfy 1 < α < ∞, 1 ≤ β < ∞.
2
Discuss an economy in which G = G 0 + k I , and show that there are two equilibrium
states.
5. The blue whale and fin whale are two similar species that inhabit the same areas.
Hence, they are thought to compete. The intrinsic growth rate is estimated at 5% per
year for the blue whale and 8% per year for the fin whale. The environmental carrying
capacity (the maximum number of whales that the environment can support) is
estimated at 150000 blues and 400000 fins. The extent to which the whales compete
is unknown. In the last 100 years intense harvesting has reduced the whale
population to around 5000 blues and 70000 fins. Using the logistic growth of the
individual populations determine whether the blue whale become extinct?
59
Chapter 9
Discrete systems
or
x k = f (x k−1 , x k−2 , . . . , x k−n ) (general) (9.1)
60
with the initial conditions x 0 , x 1 , . . . , x n−1 given.
Thus the first and second-order difference equations have the respective general forms:
The system (9.1) can be reduced to a system of first order difference equations by defining
variables as follows
y 1 (k) = x k−n = y 2 (k − 1)
y 2 (k) = x k−n+1 = y 3 (k − 1) (9.5)
..
.
y n−1 (k) = y n (k − 1)
(9.6)
y n (k) = x k
The resulting system has the form
y 1 (k) = y 2 (k − 1)
y 2 (k) = y 3 (k − 1)
.. (9.7)
.
¡
y n (k) = F y 1 (k − 1), . . . , y n (k − 1)
if nonlinear, and
0 1 ... 0
..
y 1 (k)
0 0 . 0 y 1 (k − 1)
.. .. ..
..
. =
. . 0
.
(9.8)
y n (k)
0 ... 0 1 y n (k − 1)
an . . . a2 a1
or y(k) = Ay(k − 1)
The analysis of discrete systems is analogous to that of systems of ODE’s.
x k+1 = f (x k )
61
x k+1 = ax k + b, x 0 given (Non-homogeneous) (9.10)
x k+1 − x k = 0 or x e = f (x e ) (9.11)
b
in particular for (9.10) the equilibrium point is x e = 1−a .
First consider equation (9.9). Starting with a given x 0 , successive substitution yields
x 1 = ax 0
x 2 = ax 1 = a 2 x 0
:
xn = a n x0
x 1 = ax 0 + b
x 2 = ax 1 + b = a (ax 0 + b) + b = a 2 x 0 + (a + 1)b
..
.
x n = a n x 0 + a n−1 + a n−2 + . . . + 1 b
¡ ¢
1 − an
= a n x0 + b
1−a
Hence the general solution for the non-homogeneous case is
k
xk = a k x 0 + 1−a
1−a
b
62
b b
µ ¶
k
=a x0 − + , a 6= 1 (9.13)
1−a 1−a
= x c (k) + x p (9.14)
where x c (k) and x p = x e denote the complementary and particular solution of the equation.
x k = (x 0 − x e ) a k + x e (9.16)
Stability in this case means x k → x e at t → ∞. For this to happen, |a| < 1, must hold for
both solutions; i.e. −1 < a < 1. If 0 < a < 1, a k → 0 as t → ∞ in positive descending steps.
If −1 < a < 0, x k → x e with alternating steps on either side of x e (oscillations) (see Figure
-reffigdec). In either case the solution (or the system) is stable.
If |a| > 1, x k will diverge from x e , i.e. a k will climb up the steps indefinetely in larger and
larger steps if 1 < a or in alternating steps if a < −1 (see Fig 9.1). In either case the solution
(or system) is unstable.
63
Figure 9.2: Geometric and Oscillatory increase: |a|>1
Phase Diagrams
Constructing phase diagrams for first order discrete equations involves plotting x k against
x k+1 in the x k , x k+1 -plane. ’The equilibrium point x e in (67) is at the intersection of the
graphs of x k+1 = x k (a 45◦ -line) and x k+1 = f (x k ).
Further we note that in (65) and (66), f (x) = ax + b with b equal or not equal to zero. In
both cases f 0 (x) = f 0 (x e ) = a. Thus the requirement for stability that |a| < 1 is equivalent to
saying f 0 (x e ) |< 1
Also, phase diagrams can be used to sketch the graphs of the soiutions of the given
equations, in the same way that it is done for continuous time.
By observing that the coefficient a in the linear systems is the derivative of f (x k ) with
respect to :
64
Figure 9.3: Geometric and Oscillatory increase: |a|>1
x k , it is natural to generalise and say that stability of first order systems, linear or nonlinear
can be deduced from f 0 (x e ). More specifically, the system x k+1 = f (x k ) is stable if ¯ f 0 (x e )¯ <
¯ ¯
¡ ¢
y k+1 = g x k , y k (9.18)
which may be given as is, or obtained from converting a second order difference equation
x k+1 = f (x k−1 , x k )
65
The linear case is " # " #" #
y 1 (k + 1) a b y 1 (k)
= (9.19)
y 2 (k + 1) c d y 2 (k)
which may result from converting the linear difference equation
¡ ¢ ¡ ¢
xe = f xe , y e , y e = g xe , y e (9.21)
simultaneously.
Phase diagrams for discrete second order systems are constructed in the same way as for
the ODE systems. The only difference is that the points are discrete and connected as
continuous curves only as a visual aid (Figure 9.4).
Figure 9.4: Phase diagram and solution sketch for a 2-D system
Eigen values of system (9.19) can be obtained in the same way as in the continuous case.
The same eigenvalues can be obtained by solving the equation
λ2 − a 1 λ − a 2 = 0
66
if the former is equivalent to the later (by conversion). The stability condition for discrete
systems differs from that of continuous systems. Hence the following definition is
important to note.
Definition 9.1 An equilibrium point is called asymptotically stable if |λi | < 1 for all i ; i.e. all
eiqenvalues lie inside the unit circle. N.B.
• "All" means all cases of the roots of the characteristic equation, real and complex.
We can also use the notation used before. The characteristic equation is P (λ) = λ2 −T λ+D =
0 and 4 = T 2 − 4D. The stability conditions of discrete systems are equivalently
which imply
|D| < 1 and |T | < 1 + D
2. 2. Case 2: 4 = 0, λ1 = λ2 = λ
3. Case 3: 4 < 0, λ = α ± βi
Note that even if α, the real part of the eigenvalues, is zero, there can still be a spiral
focus.
67
Solutions of Linear Second Order Systems
The solution of
y k+1 = Ay k y(0) = y 0
is, by iteration
yk = Ak y0, for any t
yk = Ayk−1 + b, y(0) = y0
is
yk = c 1 v1 λk1 + c 2 v2 λk2 + ye (9.23)
68
9.4.2 Nonlinear Stability Analysis
As for continuous systems, local stability can be determined from the linearised systems
near the equilibrium points.
2 > 1 + D > |T |
¡ ¢
i.e. If both eigenvalues |λi | < 1, x e , y e is stable.
In the next section we discuss selected examples of disctrete systems and their analysis.
69
Appendix
Example A.1
The ODE
y 00 + 2y 0 − 5y = x 2
has the equivalent first order system
y 10 = y 2
y 20 = x 2 + 5y 1 − 2y 2
Any n-th order differential equation can be converted to an equivalent system of first order
equations by setting the dependent variable in the original equation to be a (preferably)
indexed variable and then taking derivatives of the new variables and assigning them names,
up to the highest required derivative. Suppose a system is represented by the n-th order ODE
Let y = y 1 . So that
y 10 = y 2
y 20 = y 3
..
.
0
y n−1 = yn
y n0 = y n = f (t , y) − â 0 (t )y 1 − â 1 (t )y 2 − . . . − â n−1 (t )y n
ak
where â k = an
. Note that the system consists of n differetnial equations. Once the system is
in this form, standard numerical techniques can be used for analysis.
70
Example A.2 Conversion from ODE to linear systems
d2y dy
To convert the differential equation t 2 d t 2 − 7t d t + 16y = 0 we can let
d y d y1 d y2 d 2 y
y = y1, = = y2, =
dt dt dt dt2
This leads to the system
d y1
= y2
dt
d y2
¶
1 ¡ ¢ 1 1
= 2 −16y 1 + 7t y 2 = −16 2 y 1 + 7 y 2
dt t t t
Note
71