1. Background
Mullen, et al. [1] describe the mechanism of viral oncolysis, while Chiocca [2] presents several oncolytic viruses, and Aghi, et al. [3] discuss the various oncolytic viral therapies. Novozhilov, et al. [4] mathematically modeled tumor therapy with oncolytic viruses. Kelly and Russell [5] present the history of oncolytic viruses from genesis to genetic engineering. Alonso, et al. [6] showed that the combination of the oncolytic adenovirus ICOVIR-5 with chemotherapy provides an enhanced anti-glioma effect. Zurakowski and Wodarz [7] discuss various model-driven approaches for in vitro combination therapy using ONYX-015 replicating oncolytic adenovirus. Wong, et al. [8] present strategies for overcoming the obstacles in using oncolytic viruses for cancer therapy. Ottolino, et al. [9] provide intelligent designs combining therapy with oncolytic viruses. Komarova and Wodarz [10] present ODE models for oncolytic virus dynamics. Eager and J. Nemunaitis [11] researched the various clinical development directions in oncolytic viral therapy. Agarwal and Bhadauria [12] modelled and analyzed tumor therapy with an oncolytic virus. Bagheri, et al. [13] provide a dynamical systems model for combinatorial cancer therapy that enhances oncolytic adenovirus efficacy by MEK-inhibition. Tian [14] shows the replicability of oncolytic virus, defining conditions in tumor virotherapy. Donnelly, et al. [15] present the recent clinical experiences with oncolytic viruses. Russell, et al [16] provide a discussion of oncolytic virotherapy. Zhou, et al. [17] present the clinical research progress for oncolytic adenovirus targeting cancer therapy. Patel and Kratzke [18] discuss the first wave of translational clinical trials in oncolytic virus therapy for cancer. Wang, et al. [19] show that the lytic cycle is a defining process in oncolytic virotherapy. Kim, et al. [20] discuss the quantitative impact of immunomodulation versus oncolysis with a cytokine-expressing virus therapeutic. Si and Zhang [21] discuss the control exponential growth of tumor cells with the slow spread of an oncolytic virus. Chen and Su [22] provide an improved model of tumor therapy with an oncolytic virus. Simpson, et al. [23] discussed the recent advances in cancer immunotherapy via combining oncolytic virotherapy with chemotherapy. Su, et al. [24] developed an optimal control model of tumor treatment with oncolytic virus and MEK Inhibitor. Malinzi, et al. [25] developed a mathematical and optimal control analysis on the enhancement of chemotherapy using oncolytic virotherapy. Adi-Kusumo, et al. [26] showed the existence of a Hopf Bifurcation on a cancer therapy model by oncolytic virus involving the malignancy effect and therapeutic efficacy. This work aims to perform bifurcation analysis and multiobjective nonlinear control (MNLMPC) studies in three oncolytic virus models, which are discussed in Adi-Kusumo, et al. [26] (model 1) Su, et al. [24](model 2), and Malinzi, et al. [25](model 3). The paper is organized as follows. First, the model equations are presented, followed by a discussion of the numerical techniques involving bifurcation analysis and multiobjective nonlinear model predictive control (MNLMPC). The results are then presented, followed by the discussion and conclusions.
2. Model equations
Model 1 [26]
The ODE set representing the first model is
xval and yval represent the uninfected cancer cells and the infected ones by oncolytic viruses.
The base parameters are
Model 2 Su, et al. [24]
The model equations are
xval, 𝑦val, and vval stand for the population of uninfected cells, infected tumor cells, and oncolytic viruses, and zval represents the average expression level of CAR on the surface of the cells. The base parameter values are
Model 3 Malinzi, et al. [25]
Here, (uval, iva, vval,cval) represent the uninfected tumour density, virus-infected tumour cell density, free virus particles, and drug concentration, respectively. u1 and u2 are the control parameters.
The base parameter values are
3. Bifurcation analysis
The MATLAB software MATCONT is used to perform the bifurcation calculations. Bifurcation analysis deals with multiple steady states and limit cycles. Multiple steady states occur because of the existence of branch and limit points. Hopf bifurcation points cause limit cycles. A commonly used MATLAB program that locates limit points, branch points, and Hopf bifurcation points is MATCONT [27,28]. This program detects Limit points (LP), branch points (BP), and Hopf bifurcation points(H) for an ODE system
x ∈ Rn Let the bifurcation parameter be α. Since the gradient is orthogonal to the tangent vector,
The tangent plane at any point must satisfy.
Where A is
Where is the Jacobian matrix? For both limit and branch points, the matrix must be singular. The n+1th component of the tangent vector Zn+1 = 0 for a limit point (LP), and a branch point (BP), the matrix must be singular. At a Hopf bifurcation point,
@ indicates the bialternate product while is the n-square identity matrix. Hopf bifurcations cause limit cycles and should be eliminated because limit cycles make optimization and control tasks very difficult. More details can be found in Kuznetsov [29,30] and Govaerts [31].
Hopf bifurcations cause unwanted oscillatory behavior and limit cycles. The tanh activation function (where a control value u is replaced by ) (u tanh u/ε) is commonly used in neural nets [32-34] and optimal control problems [35] to eliminate spikes in the optimal control profile. Hopf bifurcation points cause oscillatory behavior. Oscillations are similar to spikes, and the results in Sridhar [36] demonstrate that the tanh factor also eliminates the Hopf bifurcation by preventing the occurrence of oscillations. Sridhar [36] explained with several examples how the activation factor involving the tanh function successfully eliminates the limit cycle causing Hopf bifurcation points. This was because the tanh function increases the period of the oscillatory behavior, which occurs in the form of a limit cycle caused by Hopf bifurcations.
4. Multiobjective Nonlinear Model Predictive Control (MNLMPC)
Flores Tlacuahuaz, et al. [37] developed a multiobjective nonlinear model predictive control (MNLMPC) method that is rigorous and does not involve weighting functions or additional constraints. This procedure is used for performing the MNLMPC calculations. Here
(j = 1, 2..n) represents the variables that need to be minimized/maximized simultaneously for a problem involving a set of ODEs.
tf Being the final time value, n is the total number of objective variables, and u is the control parameter. This MNLMPC procedure first solves the single-objective optimal control problem, independently optimizing each of the variables. The minimization/maximization of will lead to the values. Then the optimization problem that will be solved is
This will provide the values of u at various times. The first obtained control value of u is implemented, and the rest are discarded. This procedure is repeated until the implemented and the first obtained control values are the same, or if the Utopia point where (
for all j) is obtained.
Pyomo [38] is used for these calculations. Here, the differential equations are converted to a Nonlinear Program (NLP) using the orthogonal collocation method. The NLP is solved using IPOPT [39] and confirmed as a global solution with BARON [40].
The steps of the algorithm are as follows.
- Optimize and obtain at various time intervals, ti. The subscript i is the index for each time step.
- Minimize
and get the control values for various times.
- Implement the first obtained control values.
- Repeat steps 1 to 3 until there is an insignificant difference between the implemented and the first obtained value of the control variables or if the Utopia point is achieved. The Utopia point is when for all j.
Sridhar [41] proved that the MNLMPC calculations converge to the Utopia solution when the bifurcation analysis revealed the presence of limit and branch points. This was done by imposing the singularity condition on the co-state equation [42]. If the minimization of lead to the value and the minimization of lead to the value, the MNLPMC calculations will minimize the function. The multiobjective optimal control problem is
Differentiating the objective function results in
The Utopia point requires that both are zero. Hence
The optimal control co-state equation [42] is
λi Is the Lagrangian multiplier. Is this the final time? The first term in this equation is 0, and hence.
At a limit or a branch point, the set of ODE
fx is singular. Hence, there are two different vector values for where and. In between, there is a vector where. This, coupled with the boundary condition, will lead to. This makes the problem an unconstrained optimization problem, and the only solution is the Utopia solution.
5. Results
Model 1
When pval was used as the bifurcation parameter, a Hopf bifurcation point was located at (xval, yval, pval) values of (3.086053, 55.448945, -0.898380). This is shown in Figure 1a. The limit cycle caused by this Hopf bifurcation point is shown in Figure 1b. When pval was changed to pval(tanh(pval)), the Hopf bifurcation point disappears, validating the analysis in Sridhar [36] where it is demonstrated with several examples that the activation factor involving the tanh function successfully eliminates the limit cycle causing Hopf bifurcation points. This is shown in Figure 1c. When r2 was used as the bifurcation parameter, a branch point was located at
Figure 1a: Bifurcation Analysis in Model 1, indicating Hopf bifurcation.
Figure 1b: Bifurcation Analysis in Model 1, indicating a limit cycle caused by a Hopf bifurcation.
Figure 1c: Bifurcation Analysis in Model 1 (Hopf bifurcation eliminated by tanh activation function).
(xval, yval, r2) values of ( 0.000000 50.049900 4.003996 ). This is shown in Figure 1d.
Figure 1d: Bifurcation Analysis in Model 1, indicating Branch Point.
For the MNLMPC calculations,
were minimized individually and led to values of 200 and 0. pval was the control parameter. The multiobjective optimal control problem will involve the minimization of the subject to the equations governing Model 1. This led to a value of zero (the Utopia solution). The MNLMPC value of pval was 0.54427. Figures 1e-1g show the various MNLMPC profiles.
Figure 1e: MNLMC( Model 1) yval
vs t
Figure 1f: MNLMC (Model 1) xval
vs. t.
Figure 1g: MNLMC (Model 1) pval
vs. t.
Model 2
In model 2, when bifurcation analysis was performed, with u as a parameter, a branch point was located at (xval, yval, vval,zval,u) values of ( 9.e + 08, 0,0, 1.043561, 0.582576 ). This is seen in Figure 2a.
Figure 2a: Bifurcation Analysis in Model 2, indicating a branch point.
For the MNLMPC calculations, xval(0) was set as 400 and was minimized individually, yielding values of 400, 0, and 0. The multiobjective optimal control problem will involve the minimization of the
subject to the equations governing Model 2. This led to a value of zero (the Utopia solution). The MNLMPC value of u was 0.932. Figures 2b-2d, and 2e show the various MNLMPC profiles for Model 2.
Figure 2b: MNLMC (Model 2) xval
vs. t.
Figure 2c: MNLMC (Model 2) yval
vs. t.
Figure 2d: MNLMC (Model 2) vval
vs. t.
Figure 2e: MNLMC (Model 2) u
vs. t.
Model 3
In model 3, when bifurcation analysis was performed, with as a parameter, a branch point was located at values of. (0, 50, 0, 0.119904, 0.000065). Additionally, a limit point was found at values of (0.009703, 50.002421, 0, 0.119904, 0.000065). This is shown in Figure 3a.
Figure 3a: Bifurcation Analysis in Model 3 indicating Branch Point and limit point.
For the MNLMPC calculations, uval(0) was set as 1000, ival(0) was set as 75. They were minimized individually, yielding values of 6.1539610796052817e+04 and 75. The multiobjective optimal control problem will involve the minimization of the
subject to the equations governing Model 3. This led to a value of zero (the Utopia solution). The MNLMPC value of u1 and u2 (the two control parameters) were 7.863627108510299e-07 and 16.542884153050405. Figures 3b-3g show the various MNLMPC profiles for Model 3.
Figure 3b: MNLMPC in Model 3 vval
vs. t.
Figure 3c: MNLMPC in Model 3 ival
vs. t.
Figure 3d: MNLMPC in Model 3 cval
vs. t.
Figure 3e: MNLMPC in Model 3 uval
vs. t.
Figure 3f: MNLMPC in Model 3 u1
vs. t.
Figure 3g: MNLMPC in Model 3 u2
vs. t.
6. Discussion of results
Model 1 exhibits a Hopf bifurcation point, which is eliminated using an activation factor involving a tanh function, validating the analysis in Sridhar [36]. All three models exhibit branch points. These branch points enable the MNLMC calculations to yield the Utopia solution, validating the analysis in Sridhar [41]. The following paragraphs explain the cause of the occurrence of the branch points.
Theorem
If one of the functions in a dynamic system is separable into two distinct functions, a branch point singularity will occur in the system.
Proof
Consider a system of equations.
x ∈ Rn . Defining the matrix A as
α Is the bifurcation parameter. The matrix A can be written in a compact form as
The tangent at any point x; (
) must satisfy
The matrix must be singular at both limit and branch points. The n+1th component of the tangent vector Zn+1 = 0 at a limit point (LP), and for a branch point (BP), the matrix must be singular.
Any tangent at a point y that is defined by
) must satisfy.
For a branch point, there must exist two tangents at the singularity. Let the two tangents be z and w. This implies that
Consider a vector v that is orthogonal to one of the tangents (say z). v can be expressed as a linear combination of z and w (
). Since z and v are orthogonal,
. Hence, this implies that B is singular.
Let any of the functions fi be separable into 2 functions
as
At steady-state
and this will imply that either or both must be 0. This implies that the two branches will meet at a point where both are 0.
At this point, the matrix B will be singular, as a row in this matrix would be
However,
This implies that every element in the row would be 0, and hence the matrix B would be singular. The singularity in B implies that there exists a branch point.
In model 1, a branch point was located at
(xval, yval) values of ( 0.000000 50.049900 ). Here, the two distinct functions can be obtained from the first equation in Model 1
The 2 distinct function branches are
and
The values satisfy both the above equations, confirming the correctness of the theorem.
In model 2, a branch point was located at (xval, yval, vval,zval,u) values of ( 9.e+08; 0;0; 1 .043561 0.582576 ). The two distinct functions can be seen from the second equation of Model 2,
Here, the two distinct function branches are
and
Substituting
Satisfies both the above equations, confirming the correctness of the theorem.
In model 3, a branch point was located at values of. (0, 50, 0, 0.119904, 0.000065) and the two distinct branches can be obtained from the first equation in model 3, which is
These 2 branches are
and
Substituting
Satisfies both the above equations, confirming the correctness of the theorem.
Conclusion
Bifurcation analysis and multiobjective nonlinear control (MNLMPC) studies in three oncolytic virus models. The bifurcation analysis revealed the existence of a Hopf bifurcation point in one of the models and branch points in all three models. The Hopf bifurcation point was eliminated using an activation factor that involves the tanh function. The branch points (which cause multiple steady-state solutions from a singular point) are very beneficial because they enable the Multiobjective nonlinear model predictive control calculations to converge to the Utopia point (the best possible solution) in the models. It is proven (with computational validation) that the branch points were caused because of the existence of two distinct separable functions in one of the equations in each dynamic model. A theorem was developed to demonstrate this fact for any dynamic model. A combination of bifurcation analysis and Multiobjective Nonlinear Model Predictive Control(MNLMPC) for dynamic models involving oncolytic viral therapy is the main contribution of this paper.
Data availability statement
All data used is presented in the paper
Conflict of interest
The author, Dr. Lakshmi N Sridhar, has no conflict of interest.