Abstract
This paper establishes the existence of a unique nonnegative continuous viscosity solution to the HJB equation associated with a linear-quadratic stochastic control problem with singular terminal state constraint and possibly unbounded cost coefficients. The existence result is based on a novel comparison principle for semi-continuous viscosity sub- and supersolutions for PDEs with singular terminal value. Continuity of the viscosity solution is enough to carry out the verification argument.
Similar content being viewed by others
1 Introduction
Let \(T \in (0,\infty )\) and let \((\Omega ,{\mathcal {F}},({\mathcal {F}}_t)_{t\in [0,T]},{\mathbb {P}})\) that satisfies the usual conditions and carries a Poisson process N and an independent \(\tilde{d}\)-dimensional standard Brownian motion W. We analyze the linear-quadratic stochastic control problem
subject to the state dynamics
and the terminal state constraint
We assume that \(\theta \) is a positive constant, that the cost coefficients \(\eta ,\lambda ,\gamma \) are continuous and of polynomial growth, that \(\eta \) is twice continuously differentiable and that the diffusion coefficients \(b,\sigma \) are Lipschitz continuous. We prove the existence of a unique continuous viscosity solution to the resulting HJB equation and give a representation of the optimal control in terms of the viscosity solution.
Control problems of the form (1.1) to (1.3) arise in models of optimal portfolio liquidation under market impact when a trader can simultaneously trade in a primary venue and a dark pool. Dark pools are alternative trading venues that allow investors to reduce market impact and hence trading costs by submitting liquidity that is shielded from public view. Trade execution is uncertain, though, as trades will be settled only if matching liquidity becomes available. In such models, \(X^{\xi ,\mu }\) describes the portfolio process when the traders submits orders at rates \(\xi \) to the primary venue for immediate execution and orders of sizes \(\mu \) to the dark pool. Dark pools executions are governed by the Poisson process N with rate \(\theta \). The process \(\eta \) describes the instantaneous market impact; it often describes the so-called market depth. The process \(\gamma \) describes adverse selection costs associated with dark pool trading while \(\lambda \) usually describes market risk, e.g. the volatility of a portfolio holding.
Starting with the work of Almgren and Chriss [1] portfolio liquidation problems have received considerable attention in the financial mathematics and stochastic control literature in recent years; see [3, 9, 10, 12, 15,16,17, 20, 21, 23] and references therein for details. From a mathematical perspective one of their main characteristics is the singular terminal condition of the value function induced by the terminal state constraint (1.3). The constraint translates into a singular terminal state constraint on the associated HJB equation and causes significant difficulties in proving the existence and, even more so, the uniqueness of solutions to that equation.
Under a continuity and polynomial growth condition on the cost coefficients \(\eta ,\lambda ,\gamma \) it has been shown in [10] that the HJB equation admits at most one continuous viscosity solution of polynomial growth. The proof used a comparison principle for continuous viscosity solutions to PDEs with singular terminal value. Since the comparison principle applies only to continuous functions, it can not be used to establish the existence of a viscosity solution. Instead, it was shown in [10] that a (unique) classical solution to the HJB equation exists under strong boundedness and regularity assumptions on the model parameters. In this paper we prove a novel comparison principle for semi-continuous viscosity solutions for PDEs with singular terminal value from which we deduce the existence of a continuous viscosity solution to our HJB equation using Perron’s method. The existence of a continuous viscosity solution is enough to carry out the verification arguments and to give a representation of the optimal control in feedback form.
There are several papers that provide verification arguments without assuming continuity of viscosity solutions. For instance, a utility optimization problem with delays and state constraints has been considered in [8]. The authors solved in the viscosity sense the associated HJB equation under the assumption that the utility function satisfies the Inada condition, a condition that is not satisfied in our model. In [6], the authors studied the general verification result for stochastic impulse control problems, assuming that a comparison principle for discontinuous viscosity solutions of the HJB equation holds. This is a very strong hypothesis that can be avoided in our case. The linear-quadratic structure of our control problem allows us to characterize the value in terms of a PDE without jumps, and the verification argument can be given in terms of the associated FBSDE after the existence of the viscosity solution has been established.
To the best of our knowledge, existence of continuous solutions to HJB equations associated with control problems of the form (1.1) to (1.3) has so far only been established under \(L^\infty \) assumptions on the model parameters. The existence of unique continuous viscosity solution was established when \(\eta \) is a constant and \(\lambda \) is of polynomial growth in [4]. Existence and uniqueness of solutions in suitable Sobolev spaces for bounded stochastic cost and diffusion coefficients was proved in [9, 13]; classical solutions were considered in [10].
The restriction to constant market impact terms and/or bounded impact functions and diffusion coefficients is unsatisfactory. In a portfolio liquidation framework, it is natural to choose a two-dimensional driving factor where the first component is a mean-reverting process, e.g. an Ornstein–Uhlenbeck process that describes a liquidity index and the second component is a geometric Brownian motion with zero drift that describes the dynamics of the unaffected stock price process. It is then natural to chose \(\eta \) to be a strictly monotone unbounded function of the liquidity index and \(\lambda \) to be the square of the geometric Brownian motion so that market risk is measured by the volatility of the portfolio value. Our results apply to such setting.
The papers [3, 17, 21] allow for unbounded coefficients. They characterize the value function as the minimal solution to some BSDE with singular terminal value. BSDEs with singular terminal value were first studied in [20]. In [21] the same author showed that the minimal solution to a certain singular BSDE yields a probabilistic representations of a (possibly discontinuous) viscosity solution to the associated PDE. Our comparison result yields sufficient conditions for this minimal viscosity solution to be the unique (and hence continuous) solution. This complements the analysis is [3, 17]. The existence (and uniqueness) of minimal solutions to BSDEs with singular terminal values for more general drivers has recently been established in [11] under (suitable regularity and) boundedness assumptions on the model parameters. The framework in [23] allows for unbounded coefficients but requires strong a priori estimates on the market impact term that are not satisfied in our main example. Complementing the analysis in [23] our results show when value function derived in terms of Dawson-Watson superprocesses therein solves the HJB equation in the viscosity sense.
The remainder of this paper is organized as follows. In Sect. 2, we summarize our main results. The existence of viscosity solution is proved in Sect. 3.1; the verification argument is carried out in Sect. 3.2. Section 4 is devoted to an extension of our uniqueness result to a non-Markovian model with unbounded coefficients.
Notation. We denote by \(C_b({\mathbb {R}}^d)\) the set of all functions \(\phi :{\mathbb {R}}^d\rightarrow {\mathbb {R}}\) which are continuous and bounded on \({\mathbb {R}}^d\). For a given \(m\ge 0,\) we define \(C_m({\mathbb {R}}^d)\) to be set of continuous functions that have at most polynomial growth of order m, i.e. the set of functions \(\phi \in C({\mathbb {R}}^d)\) such that
This space is a Banach space when endowed with the norm
Let I be a compact subset of \({\mathbb {R}}\). A function \(\phi \) belongs to \(USC_m(I\times {\mathbb {R}}^d)\) (or \(LSC_m(I\times {\mathbb {R}}^d))\) if it has at most polynomial growth of order m in the second variable uniformly with respect to \(t\in I\) and is upper (lower) semi-continuous on \(I\times {\mathbb {R}}^d\). Whenever the notation \(T^-\) appears in the definition of a function space we mean the set of all functions whose restrictions satisfy the respective property when \(T^-\) is replaced by any \(s<T\), e.g.,
Throughout, all equations and inequalities are to be understood in the a.s. sense. We adopt the convention that C is a constant that may vary from line to line.
2 Assumptions and Main Results
For each initial state \((t,y,x)\in [0,T)\times {\mathbb {R}}^{d}\times {\mathbb {R}}\) we define by
the value function of the control problem (1.1) subject to the state dynamics
Here, \(\xi =(\xi _s)_{s\in [t,T]}\) describes the rates at which the agent trades in the primary market, while \(\mu =(\mu _s)_{s\in [t,T]}\) describes the orders submitted to the dark pool. The infimum is taken over the set \({\mathcal {A}}(t,x)\) of all admissible controls, that is, over all pairs of controls \((\xi ,\mu )\) such that \(\xi \) is progressively measurable, such that \(\mu \) is predictableFootnote 1 and such that the resulting state process
satisfies the terminal state constraint
The expected costs associated with an admissible liquidation strategy \((\xi ,\mu )\) are given by
where the running cost function \(c(y,x,\xi ,\mu )\) is given by
Remark 2.1
We assume that the cost function is quadratic in the controls and the state variable. A generalization to general powers \(p>1\) as in [10] can be established using similar arguments but renders the notation more cumbersome.
The dynamic programming principle suggests that the value function satisfies the HJB equation
where
denotes the infinitesimal generator of the factor process and the Hamiltonian H is given by
The quadratic cost function suggests an ansatz of the form \(V(t,y,x)=v(t,y)|x|^2\). The following result confirms this intuition. Its proof can be found in [10, Section 2.2].
Lemma 2.2
A nonnegative function \(v:[0,T)\times {\mathbb {R}}^d\rightarrow [0,\infty )\) is a (sub/super) solution to the PDE
where
if and only if \(v(t,y)|x|^2\) is a (sub/super) solution to the HJB equation (2.4). In this case the infimum in (2.4) is attained at
and
2.1 Assumptions
In order to prove the existence of a unique non-negative continuous viscosity solution of polynomial growth to our HJB equation we assume throughout that the factor process
satisfies the following condition.
Assumption 2.3
The coefficients \(b:{\mathbb {R}}^d\rightarrow {\mathbb {R}}^d\) and \(\sigma :{\mathbb {R}}^d\rightarrow {\mathbb {R}}^{d\times {\tilde{d}}}\) are Lipschitz continuous.
The preceding assumption guarantees that the SDE (2.9) has a unique strong solution \((Y_s^{t,y})_{s\in [t,T]}\) for every initial state \((t,y)\in [0,T]\times {\mathbb {R}}^d\) and that the mapping \((s,t,y) \mapsto Y^{t,y}_s\) is a.s. continuous. We repeatedly use the following well known estimates; cf. [18, Corollary 2.5.12]. For all \(m\ge 0,\) there exists a constant \(C>0\) such that for all \(y\in {\mathbb {R}}^d, 0\le t\le s\le T,\)
Furthermore, we assume that the cost coefficients are continuous and of polynomial growth and that \(\eta \) is twice continuously differentiable and satisfies a mild boundedness condition.
Assumption 2.4
The cost coefficients satisfy the following conditions:
-
(i)
The coefficients \(\eta ,\gamma ,\lambda ,1/\eta :{\mathbb {R}}^d\rightarrow [0,\infty )\) are continuous and of polynomial growth.
-
(ii)
\(\eta \in C^2\) and \(\Vert \frac{{\mathcal {L}} \eta }{\eta }\Vert \) is bounded.
Remark 2.5
The preceding assumption is satisfied if, for instance Y is a geometric Brownian motion or an Ornstein–Uhlenbeck (OU) process and
In both cases, condition (2.13) in [23] is violated. Our assumptions are also weaker than those in [10]. For instance, OU processes do not generate analytic semigroups, they do not satisfy the assumptions therein.
2.2 Main Results
Before stating our first main result, we recall the notion of viscosity solutions for parabolic equations that will be used in this paper. The following definition can be found in [7, Section 8].
Definition 2.6
For semicontinuous functions \(v:[0,T)\times {\mathbb {R}}^d\rightarrow {\mathbb {R}}\) we use the following solution concepts for the parabolic PDE:
where \(G:[0,T)\times {\mathbb {R}}^d\times {\mathbb {R}}\times {\mathbb {R}}^d\times {\mathbb {S}}^d\rightarrow {\mathbb {R}}\) and \({\mathbb {S}}^d\) denotes the set of symmetric \(d\times d\) matrices.
-
(i)
\(v \in USC_m([0,T^-]\times {\mathbb {R}}^d)\) is a (strict) viscosity subsolution if for every \(\varphi \in C^{1,2}_{loc}([0,T)\times {\mathbb {R}}^d)\) such that \(\varphi \ge v\) and \(\varphi (t,y)=v(t,y)\) at a point \((t,y)\in [0,T)\times {\mathbb {R}}^d\) it holds
$$\begin{aligned} -\partial _t \varphi (t,y)-G(t,y,v(t,y),D_y\varphi (t,y),D^2_y\varphi (t,y))(<)\le 0.\end{aligned}$$ -
(ii)
\(v\in LSC_m([0,T^-]\times {\mathbb {R}}^d)\) is a (strict) viscosity supersolution if for every \(\varphi \in C^{1,2}_{loc}([0,T)\times {\mathbb {R}}^d)\) such that \(\varphi \le v\) and \(\varphi (t,y)=v(t,y)\) at a point \((t,y)\in [0,T)\times {\mathbb {R}}^d\) it holds
$$\begin{aligned}-\partial _t \varphi (t,y)-G(t,y,v(t,y),D_y\varphi (t,y),D^2_y\varphi (t,y))(>)\ge 0.\end{aligned}$$ -
(iii)
v is a viscosity solution if v is both viscosity sub- and supersolution.
We are now ready to state the main result of this paper. Its proof is given in Sect. 3 below.
Theorem 2.7
Under Assumptions 2.3, 2.4, the singular terminal value problem
with the nonlinearity F given in (2.6) admits a unique nonnegative viscosity solution in
for some \(m\ge 0.\)
The next result states that both the value function and the optimal controls are given in terms of the unique viscosity solution to the HJB equation. The particular form of the feedback has been established in the literature before. What the proposition shows is that having a continuous viscosity solution to the HJB equation is enough to carry out the verification argument.
Proposition 2.8
Under Assumptions 2.3 ,2.4, let v be the unique nonnegative viscosity solution to the singular terminal value problem (2.12). Then, the value function (2.1) is given by \(V(t,y,x)=v(t,y)|x|^2\), and the optimal control \((\xi ^*,\mu ^*)\) is given in feedback form by
In particular, the resulting optimal portfolio process \((X^*_s)_{s\in [t,T]}\) is given by
Let us close this section with a model of optimal portfolio liquidation where market impact is driven by an Ornstein–Uhlenbeck process while market risk is driven by a geometric Brownian motion. Specifically, let \(Y=(Y^1, Y^2)\) be the diffusion process given by
where \(W^1\) and \(W^2\) are two (possibly correlated) Brownian motions, and let
The process \(Y^1\) specifies a liquidity indicator that fluctuates around a stationary level (normalized to zero) with the market impact increasing when below average liquidity is available and decreasing when above average liquidity is available. Instantaneous market risk, on the other hand is captured by the volatility of the portfolio value assuming that asset prices follow a geometric Brownian motion. For the above choice of model parameters all assumptions on the cost and diffusion coefficients are satisfied. Hence, there exists a unique optimal liquidation strategy.
Remark 2.9
To the best of our knowledge, numerical methods for simulating solutions to general PDEs with singular terminal values are still to be developed. At least two problems arise when simulating solutions to HJB equations with singular terminal state constraint. The most obvious problem is the singular terminal condition. This problem can potentially be overcome by noting that the function
satisfies the following PDE with finite terminal value, yet singular driver (see [10, 11] and Sect. 3 for details)
The knowledge of a unique classical solution to the transformed problem opens up the possibility to apply higher-order numerical schemes and obtain accurate solutions in acceptable computing time. One possibility could be to study a one-to-one mapping of the unbounded control set to a compact set combined with a discretisation of the control, similar to the idea applied to an optimal investment problem in [22]; an alternative approach based on monotonicity arguments is outlined in [11]. The second problem is to fix appropriate boundary conditions (in space) for the numerical simulations; a similar problem arises if the binding state constraint is replaced by a finite penalty term. The analysis in Sect. 3 shows that for the benchmark case of a risk neutral investor \((\sigma = 0)\),
for some \(C>0\) from which we deduce zero boundary conditions if \(\eta (y) \rightarrow 0\) for \(|y| \rightarrow \infty \). In general we can not expect the above inequality to be an equality, though, not even asymptotically when \(|y| \rightarrow \infty \). If we choose \(\sigma = 0\) and the dynamics
for the liquidity index, then the index is mean-reverting to the levels \({\pm } 1\), the “regimes of average liquidity”. Choosing \(\eta (y) = \frac{1}{1+y^2}\) all our assumptions on the model parameters are satisfied. In this case we may regard the interval \((-1,+1)\) as the low and the set \([-1,1]^c\) as the high liquidity regime. Since \(w(t,y) \rightarrow 0\) as \(|y| \rightarrow \infty \), the boundary problem can be dealt with.
3 Solution and Verification
3.1 Existence of Solutions
In this section, we prove Theorem 2.7. In a first step, we establish a comparison principle for semicontinuous viscosity solutions to (2.12). In view of the singular terminal state constraint we can not follow the usual approach of showing that if a l.s.c. supersolution dominates an u.s.c. subsolution at the boundary, then it also dominates the subsolution on the entire domain. Instead, we prove that if some form of asymptotic dominance holds at the terminal time, then dominance holds near the terminal time.
In a second step, we construct smooth sub- and supersolutions to (2.12) that satisfy the required asymptotic dominance condition. Subsequently, we apply Perron’s method to establish an u.s.c. subsolution and a l.s.c. supersolution that are bounded from above/below by the smooth solutions. From this, we infer that the semi-continuous solutions can be applied to the comparison principle, which then implies the existence of the desired continuous viscosity solution.
3.1.1 Comparison Principle
Throughout this section, we fix \(\delta \in (0,T]\) and for some \(m\ge 0,\) let \({{\overline{u}}} \in LSC_m([T-\delta ,T^-]\times {\mathbb {R}}^d)\) and \({\underline{u}} \in USC_m([T-\delta ,T^-]\times {\mathbb {R}}^d)\) be a viscosity super- and a viscosity subsolution to (2.12).
Proposition 3.1
Under Assumptions 2.3, 2.4, if, uniformly on \({\mathbb {R}}^d\),
and
then
Assumptions (3.1), (3.2) are uncommon in the viscosity literature. However, we shall only use the comparison result to establish the existence of a solution, not the uniqueness. As a result, we only need to guarantee that the semi-continuous solutions established through Perron’s method satisfy both assumptions.
The proof of the comparison principle is based on three auxiliary results. The first lemma is taken from [10, Lemma A.2]. It is a modification of [5, Lemma 3.7].
Lemma 3.2
The difference \(w:={\underline{u}}-{\overline{u}}\in USC_m([T-\delta ,T^-]\times {\mathbb {R}}^d)\) is a viscosity subsolution to
where
The next lemma constructs a smooth strict supersolution to (3.3) of polynomial growth.
Lemma 3.3
For every \(n\in {\mathbb {N}}\), there exists \(K_n\) large enough such that
satisfies
Proof
Direct calculations verify that \(h(t,y):=e^{K_n(T-t)}(1+|y|^2)^{\frac{n}{2}}\) satisfies \(-\partial _t h(t,y)-{\mathcal {L}} h(t,y)>0\) in \([T-\delta ,T)\times {\mathbb {R}}^d\) when \(K_n\) is chosen sufficiently large; see also [2, Proposition 5]. Here it is used that b and \(\sigma \) are Lipschitz and thus are of linear growth. Hence,
\(\square \)
The following lemma is key to the proof of the comparison principle.
Lemma 3.4
If \(n\in {\mathbb {N}}\) in Lemma 3.3 is chosen large enough, then independent of \(\alpha >0,\) the function
is either nonpositive or attains its supremum at some point \((t_{\alpha },y_{\alpha })\) in \([T-\delta ,T)\times {\mathbb {R}}^d.\)
Proof
Suppose that the supremum of \(\Phi _{\alpha }\) on \([T-\delta ,T)\times {\mathbb {R}}^d\) is positive and denote by \((t_k,y_k)\) a sequence in \([T-\delta ,T)\times {\mathbb {R}}^d\) approaching the supremum point. The representation
along with condition (3.1) shows that for any \(n>m,\)
Hence \(\lim \limits _{k} t_k<T.\) Furthermore, \(w\in USC_m([T-\delta ,T^-]\times {\mathbb {R}}^d)\) is bounded by a function of polynomial growth uniformly away from the terminal time. Choosing n large enough this shows that \(\lim \limits _{k} |y_k| < \infty \). As a result, the supremum is attained at some point \((t_{\alpha },y_{\alpha })\) because \(\Phi _{\alpha }\) is upper semicontinuous. This proves the assertion. \(\square \)
We are now ready to prove the comparison principle.
Proof of Proposition 3.1
Let us fix \(\alpha >0.\) By letting \(\alpha \rightarrow 0\) it is sufficient to show that the function \(\Phi _{\alpha }\) is nonpositive.
In view of Lemma 3.4, we just need to consider the case where there exists a point \((t_{\alpha },y_{\alpha }) \in [T-\delta ,T)\times {\mathbb {R}}^d\) such that
This inequality can be interpreted as \(w-\psi _{\alpha }\) having a global maximum at \((t_{\alpha },y_{\alpha })\), where
Since \(\psi _{\alpha }\) is smooth and w is a viscosity subsolution to (3.3),
By the mean value theorem along with the monotonicity of \(\partial _u F\), condition (3.2) and the fact that \(\partial _vF(y,v) \le -\frac{2v}{\eta (y)}\) we get that
Thus, Lemma 3.3 implies
Since \(l\le 0,\) we can conclude that \(\Phi _{\alpha }(t_{\alpha },y_{\alpha })\le 0,\) thus \(\Phi _{\alpha }\le 0.\) \(\square \)
3.1.2 Existence via Perron’s Method
Armed with our comparison principle, the existence of a viscosity solution to our HJB equation can be established using Perron’s method as soon as suitable sub- and supersolutions can be identified. In view of Assumption 2.4, \(\eta , \lambda \in C_m({\mathbb {R}}^d)\) for some \(m\ge 0\) and \(\Vert \frac{{\mathcal {L}} \eta }{\eta }\Vert \) is well-defined and finite. HenceFootnote 2
By a direct computation, we can find a constant \(K'\) large enough such that the function: \({{\hat{h}}}(t,y):=e^{K'(T-t)}(1+|y|^2)^{m/2}\) satisfying
Let us then define
Proposition 3.5
Under Assumption 2.3, 2.4 the functions \({\check{v}}, {{\hat{v}}}\) are a nonnegative classical sub- and supersolution to (2.12) on \([T-\delta ,T)\times {\mathbb {R}}^d,\) respectively.
Proof
To verify the supersolution property of \({{\hat{v}}}\), we first verify that
Recalling the definition (2.6) of F, we have since \({{\hat{v}}}\ge 0\),
Next, we apply the inequality \((u+v+w)^2\ge u^2+2uv\) for \(u,v,w\ge 0\) to the term \({{\hat{v}}}(t,y)^2\) to obtain
The definition of \(\delta \) yields \(1\ge \Vert \frac{{\mathcal {L}} \eta }{\eta }\Vert (T-t)\) for \(t\in [T-\delta , T)\) and so,
We conclude that
Next, we verify the subsolution property of \({\check{v}}\). By direct computation,
On the other hand, since \(\lambda ,\gamma \ge 0\), and \({\check{v}}\ge 0\) on \([T-\delta , T)\times {\mathbb {R}}^d\),
We estimate \({\check{v}}(t,y)^2\) using the inequality \((u-v)^2\le u^2-uv\) for \(u\ge v\ge 0\) and obtain,
Since \(e^{-2\theta (T-t)}\le e^{-\theta (T-t)}\), adding (3.9) and (3.10) yields
Using again that \(1\ge \Vert \frac{{\mathcal {L}} \eta }{\eta }\Vert (T-t)\) we obtain,
Thus,
\(\square \)
Proof of Theorem 2.7
From the definition of \({\check{v}}, {{\hat{v}}}\) we have
Then for \(\varepsilon =\frac{1}{2},\) there exists \(\delta _0\in (0,\delta ]\) such that for all \(t\in [T-\delta _0,T),\)
Since \(\eta \in C_m({\mathbb {R}}^d),\) we obtain from (3.11) that
In order to apply Perron’s method, we set
From Proposition 3.5 we know that \({\check{v}}\in {\mathcal {S}},\) so \({\mathcal {S}}\) is non-empty. Thus, the function
is well-defined and belongs to \(USC_m([T-\delta _0,T^-]\times {\mathbb {R}}^d)\). Classical argumentsFootnote 3 show that the upper semi-continuous envelope \(v^*\) which equals v is a viscosity subsolution to (2.12). From [24, Lemma A.2], the lower semi-continuous envelope \(v_*\) of v is also a viscosity supersolution to (2.12). Since \({\check{v}}\le v_*\le v^*\le {{\hat{v}}}, \) we have that for all \(t\in [T-\delta _0,T),\)
and
Hence, it follows from (3.12) that,
From our comparison principle [Proposition 3.1] we can then conclude that \(v^*=v\le v_*\text { on } [T-\delta _0,T)\times {\mathbb {R}}^d,\) which shows that v is the desired viscosity solution to (2.5) that belongs to \(C_m([T-\delta _0,T^-]\times {\mathbb {R}}^d)\).
By [2, Remark 6], there exists a unique viscosity solution \(v\in C_m([0,T-\delta _0]\times {\mathbb {R}}^d)\) to (2.5) when imposed at \(t=T-\delta _0\) with a terminal value in \(C_m({\mathbb {R}}^d).\) Hence from the comparison principle for continuous viscosity solutions [10, Lemma 3.1], we get a unique global viscosity solution
\(\square \)
Remark 3.6
If all the coefficients of the generator F and the SDE (2.9) are bounded, then one can show that twice differentiability of \(\eta \) is not needed; only a uniform continuity is required to choose continuous solutions which satisfying the conditions (3.1) and (3.2). Thus a unique viscosity solution can be obtained by the same argument above.
3.2 Verification
This section is devoted to the verification argument. Throughout, \(v\in C_m([0,T^-]\times {\mathbb {R}}^d)\) denotes the unique nonnegative viscosity solution to the singular terminal value problem (2.12). We will prove that the viscosity solution is indeed the value function to our stochastic control problem.
In a first step we are now going to show that the feedback control given in (2.13) is indeed admissible.
Lemma 3.7
The pair of feedback controls \((\xi ^*,\mu ^*)\) given by (2.13) is admissible.
Proof
Given the feedback form in (2.13), one can easily obtain that the pair of controls \((\xi ^*,\mu ^*)\) is admissible and the resulting portfolio process \((X_s^*)_{s\in [t,T]}\) is monotone. It remains to verify the liquidation constraint. Since \({\check{v}}\le v\le {{\hat{v}}}\) on \([T-\delta ,T)\) where \(\delta \) is defined in (3.6), it holds for any \(r\in [T-\delta ,T)\) that,
For \(s\in [T-\delta ,T),\)
The last inequality holds because \(\lim \limits _{r\rightarrow T} \frac{e^{\theta (T-r)}-1}{e^{\theta (T-r)}(T-r)}=\theta .\) As a result, \(X^*_{T-}=0\) and hence \(X^*_T=0.\) \(\square \)
It has been shown in [10, Lemma 5.2] that we may w.l.o.g restrict ourselves to admissible controls that result in a monotone portfolio process. We denote by \(\bar{{\mathcal {A}}}(t, x)\) the set of all admissible controls under which the portfolio process is monotone.
Next, we give a probabilistic representation of the viscosity solution to (2.12). In [21], the author showed that the possibly discontinuous minimal solution of a certain backward stochastic differential equation with singular terminal condition gives a probabilistic representation of the minimal viscosity solution of an associated partial differential equation; continuity of the solution was not established. However, continuity is necessary to carry out the verification argument. We obtain a solution to the corresponding FBSDE in a different way since the existence of the (continuous) viscosity solution has already been proved.
Proposition 3.8
Under Assumptions 2.3, 2.4, for any fixed \(\epsilon \in (0,T)\) and \((t,y)\in [\epsilon ,T)\times {\mathbb {R}}^d\), there exists a pair of processes \( (U^{t,y}, Z^{t,y})\in S^2_{{\mathcal {F}}}(t,T;{\mathbb {R}})\times L^2_{{\mathcal {F}}}(t,T;{\mathbb {R}}^{1 \times {\tilde{d}}})\) satisfying that \(U^{t,y}_t=v(t-\epsilon ,y)\) and for any \(\epsilon \le t\le r\le s\le T,\)
Proof
We consider the forward-backward system
and the corresponding PDE
where \(f(t,y):=F(y,v(t-\epsilon ,y))\) and F is defined in (2.6). Recalling the polynomial growth condition on the cost coefficients in Assumption 2.4 and the polynomial growth property of the solution v established in Theorem 2.7, we know that \(f\in C_{m^\prime }([\epsilon ,T]\times {\mathbb {R}}^d)\), for some \(m^{\prime }\ge m.\) Together with Assumption 2.3 and the fact that \( v(T-\epsilon ,\cdot )\in C_{m}({\mathbb {R}}^d)\), we conclude from [14, Theorem 2.1] that the system admits a unique solution
Let \( w(t,y):=U^{t,y}_t.\) By the Feynman-Kac formula [19, Theorem 3.2], w is the unique viscosity solution of (3.16) with driver f. Due to the time-homogeneity of the PDE in (2.12), viscosity solutions stay viscosity solutions when shifted in time. Let \({\tilde{v}}(t,y):=v(t-\epsilon ,y)\) on \([\epsilon ,T]\). By the definition of f, we see that \({\tilde{v}}\) is also a viscosity solution of (3.16) with driver f on \([\epsilon ,T]\). Hence it follows that \(w={\tilde{v}}\). By the Markov property, we have for any \(r\in [t,T]\) that \(0\le U^{t,y}_r=v(r-\epsilon ,Y^{t,y}_r).\) Thus \(U^{t,y}\) is also a solution to the following FBSDE:
\(\square \)
For any \(\epsilon \in (0,T),\) we can restrict our interval on \([t,T-\epsilon ]\) and repeat the arguments above without shifting in time. This yields a solution \( (\tilde{U}^{t,y}, {\tilde{Z}}^{t,y})\in S^2_{{\mathcal {F}}}(t,T-\epsilon ;{\mathbb {R}})\times L^2_{{\mathcal {F}}}(t,T-\epsilon ;{\mathbb {R}}^{1 \times {{\tilde{d}}}})\) satisfying that \({\tilde{U}}^{t,y}_t=v(t,y)\) and for any \(0\le t\le r\le s<T-\epsilon ,\)
Since \(\epsilon \) is arbitrary, a global solution on [0, T) can be obtained.
Corollary 3.9
Under Assumptions 2.3, 2.4, there exists processes \( ({\tilde{U}}^{t,y}, {\tilde{Z}}^{t,y})\in S^2_{{\mathcal {F}}}(t,T^-;{\mathbb {R}})\times L^2_{{\mathcal {F}}}(t,T^-;{\mathbb {R}}^{1 \times {{\tilde{d}}}})\) satisfying that \({\tilde{U}}^{t,y}_t=v(t,y)\) and for any \(0\le t\le r\le s<T,\)
The following lemma is key to the verification argument.
Lemma 3.10
Fix \(\epsilon \in (0,T)\) and \((t,y)\in [\epsilon ,T)\times {\mathbb {R}}^d\). For every \((\xi ,\mu )\in \bar{{\mathcal {A}}}(t,x)\) and \(s\in [t,T)\),
Proof
By Proposition 3.8, we know that \((U^{t,y},Z^{t,y})\) solves the following BSDE:
This allows us to apply to \(U_{s}^{t,y}|X_{s}^{\xi ,\mu }|^2\) the classical integration by parts formula for semimartingales in order to obtain
where \({{\widetilde{N}}}_r= N_r-\theta r\) denotes the compensated Poisson process. Moreover, \(|X^{\xi ,\mu }|\le |x|\) and \(|\mu |\le |x|\), due to the monotonicity of the portfolio process. Furthermore,
is a uniformly integrable martingale because
As a consequence, the above stochastic integrals are true martingales. Hence, recalling (2.8),
Since \(U_{t}^{t,y}=v(t-\epsilon ,y), U^{t,y}_r=v(r-\epsilon ,Y^{t,y}_r),\) we have
\(\square \)
We are now ready to carry out the verification argument.
Proof of Proposition 2.8
Let \((\xi ,\mu )\in \bar{{\mathcal {A}}}(t,x)\). By the liquidation constraint of \(X^{\xi ,\mu },\) letting \(s \rightarrow T\) yields
Hence,
Finally, by letting \(\epsilon \rightarrow 0\), we conclude
on \([0,T)\times {\mathbb {R}}^d\) by the continuity of v and the nonnegativity of J.
Using similar arguments to the proof of Proposition 3.10 on the BSDE (3.17), we can obtain that
By Lemma 2.2 equality holds in the preceding inequality if \(\xi =\xi ^{*}\) and \(\mu =\mu ^{*}.\) Thus,
from which we conclude that
This shows that the strategy \((\xi ^*,\mu ^*)\) is indeed optimal. \(\square \)
4 Uniqueness in the Non-markovian Framework
In this section we assume that the filtration is solely generated by the Brownian motion. The existence of a minimal nonnegative solution
to the BSDE
has been established in [3] under the assumption that \(\eta \in L^2_{\mathcal {F}}(0,T;{\mathbb {R}}_+)\), \(\eta ^{-1}\in L^1_{{\mathcal {F}}}(0,T;{\mathbb {R}}_+)\), \(\lambda \in L^2_{\mathcal {F}}(0,T^-;{\mathbb {R}}_+)\), and \({\mathbb {E}}[\int _0^T(T-t)^2\lambda _t\,dt]<\infty .\)
In this section we extend our uniqueness result to non-Markovian models and prove the existence of a unique nonnegative solution under the following conditions; they correspond to those in the Markovian setting.
Assumption 4.1
-
(i)
The process \(\eta \) is a positive Itô diffusion satisfying that \(d\eta _t=\alpha _t\,dt+\beta _t\,dW_t\) with \((\alpha ,\beta ) \in L^2_{{\mathcal {F}}}(0,T;{\mathbb {R}}\times {\mathbb {R}}^{1\times {\tilde{d}}})\).
-
(ii)
The processes \(\eta ,\eta ^{-1}\in L^{2}_{{\mathcal {F}}}(\Omega ;C([0,T];{\mathbb {R}}))\) and \(\eta ^{-1}\alpha \in L^\infty _{{\mathcal {F}}}(0,T;{\mathbb {R}})\).
-
(iii)
There exists a positive Itô diffusion \(h_t\) such that \(d h_t=\alpha ^{\prime }_t\,dt+\beta ^{\prime }_t\,dW_t\) with \((\alpha ^{\prime },\beta ^{\prime }) \in L^2_{{\mathcal {F}}}(0,T;{\mathbb {R}}\times {\mathbb {R}}^{1\times {\tilde{d}}})\) and \(h^{-1}\lambda , h^{-1}\alpha ^{\prime } \in L^\infty _{{\mathcal {F}}}(0,T;{\mathbb {R}})\).
Proposition 4.2
Let Asssumption 4.1 hold. Set \(\tau :=1/\Vert \eta ^{-1}\alpha \Vert _{L^\infty }\wedge T\) and \({\tilde{K}}:=\Vert h^{-1}\alpha ^{\prime }\Vert _{L^\infty }+\Vert h^{-1}\lambda \Vert _{L^\infty }.\) For any solution
to (4.1) the following estimates hold for \(T-\tau \le t< T\):
Proof
For \(0<\epsilon <\tau \) we define \((\overline{{\mathcal {Y}}_t}^\epsilon )_{t\in [T-\tau ,T-\epsilon )}\) by
We will show that these processes are supersolutions to (4.1) but with the singularity at \(t=T-\epsilon \),
Precisely,
where
and \(\overline{{\mathcal {Z}}}^{\epsilon }\in \bigcap _{t\in [T-\tau ,T-\epsilon )} L^2_{{\mathcal {F}}}(T-\tau ,t;{\mathbb {R}}^{1\times {\tilde{d}}})\). A calculation as in the proof of Proposition 3.5 verifies that for all \(T-\tau \le t<T-\epsilon \),
Indeed, applying the inequality \((u+v+w)^2\ge u^2+2uv\) for \(u,v,w\ge 0\) to the term \(|\overline{{\mathcal {Y}}_t}^\epsilon |^2\), we obtain that
Noting that \(\tau :=1/\Vert \eta ^{-1}\alpha \Vert _{L^\infty }\wedge T\), \(\Vert \eta ^{-1}\alpha \Vert _{L^\infty }(T-\epsilon -t)\le 1\) for \(t\in [T-\tau , T-\epsilon ),\) we have that
Recalling that \({\tilde{K}}:=\Vert h^{-1}\alpha ^{\prime }\Vert _{L^\infty }+\Vert h^{-1}\lambda \Vert _{L^\infty }\), we have that \({\tilde{K}}e^{{{\tilde{K}}}(T-\epsilon -t)}h_t-e^{\tilde{K}(T-\epsilon -t)}\alpha ^{\prime }_t\ge e^{\tilde{K}(T-\epsilon -t)}\lambda _t\ge \lambda _t.\) Therefore, we can conclude that \(g^\epsilon (t,\overline{{\mathcal {Y}}_t}^\epsilon )\ge \lambda _t-\frac{|\overline{{\mathcal {Y}}_t}^\epsilon |^2}{\eta _t}.\)
We now consider the difference of \({\mathcal {Y}}\) and \(\overline{{\mathcal {Y}}}^\epsilon \) for \(T-\tau \le t\le s<T-\epsilon \):
where
Note that \(\Delta \le 0.\) By the explicit representation of the solution to linear BSDEs,
Since \(\overline{{\mathcal {Y}}_s}^\epsilon \ge 0,\) \({\mathbb {E}}[\sup _{t\le s\le T-\epsilon }{\mathcal {Y}}_s]<+\infty \) due to \({\mathcal {Y}}\in L_{{\mathcal {F}}}^2(\Omega ;C([0,T^-];{\mathbb {R}}_+)),\) we can apply Fatou’s lemma to the expectation above as \(s\rightarrow T-\epsilon \) to obtain that \(\overline{{\mathcal {Y}}_t}^\epsilon -{\mathcal {Y}}_t\ge 0.\) Taking \(\epsilon \rightarrow 0\) we obtain the upper estimate. The lower estimate can be established by similar arguments. \(\square \)
Lemma 4.3
Suppose that Asssumption 4.1 holds. Let \(({\mathcal {Y}}, {\mathcal {Z}})\) be a solution of (4.1) in the space \(L_{{\mathcal {F}}}^2(\Omega ;C([0,T^-];{\mathbb {R}}_+))\times L_{\mathcal {F}}^2(0,T^-;{\mathbb {R}}^{1\times {\tilde{d}}})\). Let \(X^*_t=\exp (-\int ^t_0\frac{{\mathcal {Y}}_s}{\eta _s}\,ds)\) denote the associated portfolio process. Then \(X^*{\mathcal {Z}}\in L^2_{{\mathcal {F}}}(0,T;{\mathbb {R}}).\)
Proof
Let \(M_t={\mathcal {Y}}_tX^*_t+\int ^t_0\lambda _sX^*_s\,ds.\) Integration by parts yields
Hence, M is a nonnegative local martingale on [0, T) and in particular a nonnegative supermartingale. Thus, it converges almost surely in \({\mathbb {R}}\) as t goes to T. Similarly to (3.14), we use the lower estimate in (4.2) to obtain that for \(s\in [T-\tau ,T)\)
In view of the upper estimate in (4.2), we have that
where the constant C is independent of s. Thus, applying the dominated convergence theorem implies
Recalling the equation (4.3), we have that \(X^*{\mathcal {Z}}\in L^2_{{\mathcal {F}}}[0,T;{\mathbb {R}})\) and that M is indeed a nonnegative martingale on [0, T]. \(\square \)
It follows from [3, Proposition 4.4] that \({\mathcal {Y}}\) is the minimal solution of (4.1). Therefore, we can obtain the uniqueness result.
Theorem 4.4
Under Asssumption 4.1, there exists a unique solution to the BSDE (4.1) in \(L_{{\mathcal {F}}}^2(\Omega ;C([0,T^-];{\mathbb {R}}_+))\times L_{\mathcal {F}}^2(0,T^-;{\mathbb {R}}^{1\times {\tilde{d}}})\).
5 Conclusion
In this paper we established a novel comparison principle for viscosity solutions to HJB equations with singular terminal conditions arising in models of optimal portfolio liquidation under market impact. Our method is flexible enough to allow for possibly unbounded coefficients. The comparison principle allowed us to prove the existence of a unique continuous viscosity solution to the HJB equation and hence the existence of a unique optimal trading strategy. Without continuity it is typically impossible to study further regularity properties of the value function. Using our continuity result it is possible to prove that the value function is a \(\pi \)-strong solution to the HJB equation under mild additional conditions on the model parameters. This means that the value function can be approximated by \(C^{1,2}\) function uniformly on compact sets. Several other avenues are open for future research. For instance, it would clearly be desirable to weaken the regularity assumption on the unbounded market impact coefficient \(\eta \). The regularity assumption was needed to carry out the Taylor-type approximation of the value function at the terminal time.
Notes
We show later that we restrict ourselves to monotone portfolio processes so we could just as well assume that \(\mu \) is bounded.
We use the convention \(1/0=\infty \).
References
Almgren, R., Chriss, N.: Optimal execution of portfolio transactions. J. Risk 3, 5–39 (2001)
Alvarez, O., Tourin, A.: Viscosity solutions of nonlinear integro-differential equations. Ann. Inst. Henri Poincaré Anal. Non Linéaire 13, 293–317 (1996)
Ankirchner, S., Jeanblanc, M., Kruse, T.: BSDEs with singular terminal condition and a control problem with constraints. SIAM J. Control Optim. 52, 893–913 (2014)
Ankirchner, S., Kruse, T.: Price-sensitive liquidation in continuous-time, SSRN (2012)
Barles, G., Buckdahn, R., Pardoux, E.: Backward stochastic differential equations and integral-partial differential equations. Stochastics 60, 57–83 (1997)
Belak, C., Christensen, S., Seifried, F.T.: A general verification result for stochastic impulse control problems. SIAM J. Control Optim. 55, 627–649 (2017)
Crandall, M.G., Ishii, H., Lions, P.L.: User’s guide to viscosity solutions of second order partial differential equations. Bull. Am. Math. Soc. (N.S.) 27, 1–68 (1992)
Federico, S., Goldys, B., Gozzi, F.: HJB equations for the optimal control of differential equations with delays and state constraints, II: verification and optimal feedbacks. SIAM J. Control Optim. 49, 2378–2414 (2011)
Graewe, P., Horst, U., Qiu, J.: A non-markovian liquidation problem and backward SPDEs with singular terminal conditions. SIAM J. Control Optim. 53, 690–711 (2015)
Graewe, P., Horst, U., Séré, E.: Smooth solutions to portfolio liquidation problems under price-sensitive market impact. Stoch. Process. Appl. 128, 979–1006 (2018)
Graewe, P., Popier, A.: Asymptotic approach for backward stochastic differential equation with singular terminal condition, arXiv:1906.05154 (2019)
Horst, U., Naujokat, F.: When to cross the spread? Trading in two-sided limit order books. SIAM J. Financ. Math. 5, 278–315 (2014)
Horst, U., Qiu, J., Zhang, Q.: A constrained control problem with degenerate coefficients and degenerate backward SPDEs with singular terminal condition. SIAM J. Control Optim. 54, 946–963 (2016)
Karoui, N.E., Peng, S., Quenez, M.C.: Backward stochastic differential equations in finance. Mathemat. Financ. 7, 1–71 (1997)
Kratz, P.: An explicit solution of a nonlinear-quadratic constrained stochastic control problem with jumps: optimal liquidation in dark pools with adverse selection. Math. Oper. Res. 39, 1198–1220 (2014)
Kratz, P., Schöneborn, T.: Portfolio liquidation in dark pools in continuous time. Math. Financ. 25, 496–544 (2015)
Kruse, T., Popier, A.: Minimal supersolutions for BSDEs with singular terminal condition and application to optimal position targeting. Stoch. Process. Appl. 126, 2554–2592 (2016)
Krylov, N.V.: Controlled Diffusion Processes (Stochastic Modelling and Applied Probability). Springer, New York (1980)
Pardoux, É.: BSDEs, Weak Convergence and Homogenization of Semilinear PDEs. Springer, Dordrecht (1999)
Popier, A.: Backward stochastic differential equations with singular terminal condition. Stoch. Process. Appl. 116, 2014–2056 (2006)
Popier, A.: Integro-partial differential equations with singular terminal condition. Nonlinear Anal. 155, 72–96 (2017)
Reisinger, C., Forsyth, P.A.: Piecewise constant policy approximations to Hamilton–Jacobi–Bellman equations. Appl. Numer. Math. 103, 27–47 (2016)
Schied, A.: A control problem with fuel constraint and Dawson–Watanabe superprocesses. Ann. Appl. Probab. 23, 2472–2499 (2013)
Zhan, Y.: Viscosity Solutions of Nonlinear Degenerate Parabolic Equations and Several Applications, PhD thesis, University of Toronto (1999)
Acknowledgements
Open Access funding provided by Projekt DEAL.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Financial support by d-fine GmbH is gratefully acknowledged. We thank Paulwin Graewe for many discussions and valuable comments. We thank two anonymous referees for valuable comments and suggestions that greatly helped to improve the presentation of the results.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Horst, U., Xia, X. Continuous Viscosity Solutions to Linear-Quadratic Stochastic Control Problems with Singular Terminal State Constraint. Appl Math Optim 84, 1159–1184 (2021). https://doi.org/10.1007/s00245-020-09673-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00245-020-09673-4