---
abstract: 'For the rank regularized minimization problem, we introduce several classes of stationary points by the problem itself and its equivalent reformulations including the mathematical program with an equilibrium constraint (MPEC), the global exact penalty of the MPEC, and the surrogate yielded by eliminating the dual part of the exact penalty. A clear relation chart is established among these stationary points, which offers a guidance to choose an appropriate reformulation for seeking a low-rank solution. As a byproduct, for the positive semidefinite (PSD) rank regularized minimization problem, we also provide a weaker condition for a local minimizer of its MPEC reformulation to be the M-stationary point by characterizing the directional limiting normal cone to the graph of the normal cone mapping of the PSD cone.'
author:
- 'Yulan Liu[^1]  [and]{}  Shaohua Pan[^2]'
title: Several classes of stationary points for rank regularized minimization problems
---

[**Keywords:**]{} Rank regularized minimization problems; stationary points; matrix MPECs; calmness; directional limiting normal cone

[**Mathematics Subject Classification(2010):**]{} 90C26, 49J52, 49J53

Introduction {#sec1}
============

Let $\mathbb{R}^{m\times n}$ be the linear space of all $m\times n\ (m\le n)$ real matrices equipped with the trace inner product $\langle \cdot,\cdot\rangle$ and its induced norm $\|\cdot\|_F$, i.e., $\langle X,Y\rangle={\rm tr}(X^{\mathbb{T}}Y)$ for $X,Y\in\mathbb{R}^{m\times n}$. Given a function $f\!:\mathbb{R}^{m\times n}\to\mathbb{R}$, we are interested in the rank regularized problem: $$\label{rank-reg}
  \min_{X\in\mathbb{R}^{m\times n}}F(X):=\nu f(X)+{\rm rank}(X)+\delta_{\Omega}(X)$$ where $\nu>0$ is the regularization parameter and $\Omega\subseteq\mathbb{R}^{m\times n}$ is a closed convex set. Unless otherwise stated, we assume that $f$ is locally Lipschitz and $\widehat{\partial}f(X)=\partial\!f(X)$ for any $X\in\Omega$, where $\widehat{\partial}f(X)$ and $\partial\!f(X)$ are the regular and limiting subdifferential of $f$ at $X$, respectively; see Section \[sec2.1\] for their definitions. Such a model is frequently used to seek a low-rank matrix under the scenario where a tight estimation is unavailable for the rank of the target matrix, and is found to have a host of applications in a variety of fields such as statistics [@Negahban11], control and system identification [@Fazel03; @FPST13], signal and image processing [@Davenport16], finance [@Pietersz04], quantum tomography [@Gross11], and so on.

Owing to the combinatorial property of the rank function, the problem is generally NP-hard and it is impossible to achieve a global optimal solution by using an algorithm with polynomial-time complexity. So, it is common to obtain a desirable local optimal even feasible solution by solving a convex relaxation or surrogate problem. Although the nuclear-norm convex relaxation method [@Fazel02] is very popular, it has a weak ability to promote low-rank solutions and even fails to yielding low-rank solutions in some cases [@Miao16]. After recognizing this deficiency, some researchers pay their attentions to the nonconvex surrogates of low-rank optimization problems such as the log-determinant surrogate (see [@Fazel03; @Mohan12]) and the Schatten $p\ (0<p<1)$-norm surrogate [@LXW13]. As illustrated in [@Nie12], the efficiency of nonconvex surrogates depends on its approximation effect.

Recently, by the variational characterization of the rank function, the authors of [@BiPan17; @LiuBiPan18] reformulated the rank regularized problem as an equivalent MPEC and derived an equivalent surrogate from its global exact penalty. In order to illustrate this, let $\mathscr{L}$ denote the family of proper lower semi-continuous (lsc) convex functions $\phi\!:\mathbb{R}\to(-\infty,+\infty]$ with $$\label{phi-assump}
   {\rm int}({\rm dom}\,\phi)\supseteq[0,1],\ \phi(1)=1>t^*:=\mathop{\arg\min}_{0\le t\le 1}\phi(t)
   \ \ {\rm and}\ \ \phi(t^*)=0,$$ and for each $\phi\in\!\mathscr{L}$ let $\psi\!:\mathbb{R}\to(-\infty,+\infty]$ be the associated lsc convex function given by $$\label{phi-psi}
   \psi(t):=\!\left\{\!
              \begin{array}{cl}
                  \phi(t) &\textrm{if}\ t\in [0,1],\\
                   +\infty & \textrm{otherwise}.
                 \end{array}\right.$$ With $\phi\in\mathscr{L}$, the rank regularized problem can be equivalently reformulated as $$\begin{aligned}
\label{MPEC}
  &\min_{X,W\in\mathbb{R}^{m\times n}}\nu f(X)+{\textstyle\sum_{i=1}^m}\phi(\sigma_i(W))+\delta_{\Omega}(X)\nonumber\\
  &\quad\ \ {\rm s.t.}\ \ \|X\|_*-\langle W,X\rangle=0,\,\|W\|\le 1
 \end{aligned}$$ which is a matrix MPEC since the constraints $\|X\|_*-\langle W,X\rangle=0$ and $\|W\|\le 1$ are equivalent to $X\in\mathcal{N}_{\mathbb{B}}(W)$ with $
    \mathbb{B}\!:=\{Z\in\mathbb{R}^{m\times n}\,| \, \|Z\|\le 1\},
  $ i.e., the optimality condition of $W\in\mathop{\arg\max}_{Z\in \mathbb{B}}\langle X,Z\rangle$. Under a mild condition, it was shown in [@BiPan17; @LiuBiPan18] that the following penalized problem $$\begin{aligned}
\label{Epenalty-MPEC}
  &\min_{X,W\in\mathbb{R}^{m\times n}}\nu f(X)+{\textstyle\sum_{i=1}^m}\phi(\sigma_i(W))
          +\rho(\|X\|_*-\langle W,X\rangle)\nonumber\\
  &\quad\ \ {\rm s.t.}\ \ X\in\Omega,\,\|W\|\le 1
 \end{aligned}$$ is a global exact penalty of the MPEC in the sense that there exists $\overline{\rho}>0$ such that the problem associated to each $\rho\ge\overline{\rho}$ has the same global optimal solution set as does. With the conjugate function $\psi^*(s):=\sup_{t\in\mathbb{R}}\big\{st-\psi(t)\big\}$ of $\psi$, one may eliminate the dual variable $W$ in and get the following equivalent surrogate of the problem $$\label{surrogate}
  \min_{X\in\Omega}\Big\{\nu f(X)+\rho\|X\|_*-{\textstyle\sum_{i=1}^m}\psi^*(\rho\sigma_i(X))\Big\}.$$

As well known, when an algorithm is applied to nonconvex and nonsmooth optimization problems, one generally expects to achieve a stationary point, while the stationary points of equivalent reformulations may have a big difference. Thus, it is necessary to clarify the relation among the stationary points of defined by its equivalent reformulations. Moreover, such a clarification is prerequisite to describe the landscape of stationary points for the rank regularized problem . Motivated by this, in Section \[sec3\] we introduce the R(egular)-stationary point, the M-stationary point, the EP-stationary point and the DC-stationary point by the problem itself and its reformulation -, respectively, and explore the relation among the four classes of stationary points. Figure 1 in Section \[sec3\] shows that the set of M-stationary points is almost same as that of R-stationary points, the latter includes that of EP-stationary points under a rank condition, and the set of EP-stationary points coincides with that of DC-stationary points for some appropriate $\phi$. As a byproduct, for the PSD rank regularized minimization problem, we also provide a weaker condition than the one in [@DingSY14] for a local minimizer of its MPEC reformulation to be the M-stationary point, by the directional limiting normal cone to the graph of the normal cone mapping of the PSD cone $\mathbb{S}_{+}^n$.

We notice that some active research has been done for the stationary points of zero-norm constrained optimization problems (see, e.g., [@Burdakov16; @PanLN17; @Flegel05]); for example, Burdakov et al. [@Burdakov16] discussed the relation between the M-stationary point and the $S$-stationary point of their equivalent MPEC reformulation; and Pan et al. [@PanLN17] characterizes the first-order optimality condition which actually defines a class of stationary points by the tangent cone to the zero-norm constrained set. To the best of our knowledge, there are few works to study the stationary points of rank regularized optimization problems. For the special case $\Omega\subseteq\mathbb{S}_{+}^n$, the rank regularized problem can reduce to a mathematical program with semidefinite conic complementarity constraints (MPSCCC) and Ding et al. [@DingSY14] have established the connection among several class of stationary points for the MPSCCC, which are defined by the equivalent reformulations of the complementarity constraints. However, this work is concerned with the relation among the stationary points defined by different equivalent reformulations of the rank regularized problem , and aims to establish a clear relation chart for these stationary points so that the user can be guided to choose an appropriate reformulation to seek a low-rank solution.

Notation and preliminaries {#sec2}
==========================

Throughout this paper, a hollow capital means a finite dimensional vector space equipped with the inner product $\langle \cdot,\cdot\rangle$ and its induced norm $\|\cdot\|$. The notation $\mathbb{S}^n$ denotes the vector space of all $n\times n$ real symmetric matrices equipped with the Frobenius norm, and $\mathbb{S}_{+}^n$ means the set of all positive semidefinite matrices in $\mathbb{S}^n$. Let $\mathbb{O}^{m\times n}$ be the set of $m\times n$ matrices with orthonormal columns and denote $\mathbb{O}^{m\times m}$ by $\mathbb{O}^{m}$. For a given $X\in\mathbb{R}^{m\times n}$, we denote by $\|X\|_*$ and $\|X\|$ the nuclear norm and the spectral norm of $X$, respectively, and by $\sigma(X)\in\mathbb{R}^m$ the singular value vector arranged in a nonincreasing order; and write $\mathbb{O}^{m,n}(X):=\{(U,V)\in\mathbb{O}^{m}\times\mathbb{O}^n\,|\, X=U{\rm Diag}(\sigma(X))V^{\mathbb{T}}\}$. For a given $X\in\mathbb{R}^{m\times n}$ and two index sets $\alpha\subseteq\{1,\ldots,m\}$ and $\beta\subseteq\{1,\ldots,n\}$, $X_{\alpha\beta}$ means the submatrix consists of those entries $X_{ij}$ with $i\in\alpha$ and $j\in\beta$. We denote by $E$ and $e$ the matrix and the vector of all ones respectively whose dimension are known from the context, and by $I$ an identity matrix whose dimension is known from the context. For a given set $S$, $\delta_{S}$ denotes the indicator function of $S$, i.e., $\delta_{S}(x)=0$ if $x\in S$, otherwise $\delta_{S}(x)=+\infty$. For a given vector space $\mathbb{Z}$, $\mathbb{B}_{\mathbb{Z}}$ denotes the closed unit ball centered at the origin of $\mathbb{Z}$, and $\mathbb{B}_{\delta}(z)$ means the closed ball of radius $\delta$ centered at $z\in\mathbb{Z}$.

Normal cones and generalized differentials {#sec2.1}
------------------------------------------

Let $S\subset\mathbb{Z}$ be a given set. The regular normal cone to $S$ at a point $\overline{z}\in S$ is defined by $$\widehat{\mathcal{N}}_{S}(\overline{z})
   :=\Big\{v\in\mathbb{Z}\ |\ \limsup_{z\xrightarrow[S]{}\overline{z}}
   \frac{\langle v,z-\overline{z}\rangle}{\|z-\overline{z}\|}\le 0\Big\}$$ where the symbol $z\xrightarrow[S]{}\overline{z}$ signifies $z\to\overline{z}$ with $z\in S$, while the limiting normal cone to $S$ at $\overline{z}$ is defined as the outer limit of $\widehat{\mathcal{N}}_{S}(z)$ as $z\xrightarrow[S]{}\overline{z}$, i.e., $$\begin{aligned}
\label{NormDef}
   \mathcal{N}_{S}(\overline{z}):=\Big\{v\in \mathbb{Z}\,|\, \exists\, z^k\xrightarrow[S]{}\overline{z},v^k\to v {\ \ \rm with \ \ } v^k\in \widehat{\mathcal{N}}_{S}(z^k)\Big\}.
  \end{aligned}$$ The limiting normal cone $\mathcal{N}_{S}(\overline{z})$ is generally not convex, but the regular normal $\widehat{\mathcal{N}}_{S}(\overline{z})$ is always closed convex which is the negative polar of the contingent cone to $S$ at $\overline{x}$: $$\mathcal{T}_{S}(\overline{z}):=\big\{h\in\mathbb{Z}\ |\ \exists\, t_k\downarrow 0,\,
   h^k\to h\ {\rm with}\ \overline{z}+t_kh^k\in S\big\}.$$ When $S$ is convex, $\mathcal{N}_{S}(\overline{z})$ and $\mathcal{\widehat{N}}_{S}(\overline{z})$ are the normal cone in the sense of convex analysis [@Roc70]. The directional limiting normal cone to $S$ at $\overline{z}$ in a direction $u\in\mathbb{X}$ is defined by $$\label{Dir-LNcone}
   \mathcal{N}_{S}(\overline{z};u):=\Big\{z^*\in\mathbb{Z}\ |\ \exists\, t_k\downarrow 0,\,u^k\to u,z^{k*}\to z^*\ {\rm with}\
   z^{k*}\in\widehat{\mathcal{N}}_{S}(\overline{z}\!+\!t_ku^k)\Big\}.$$ By comparing with the definition of $\mathcal{N}_{S}(\overline{z})$, clearly, $\mathcal{N}_{S}(\overline{z};u)\subseteq \mathcal{N}_{S}(\overline{z})$ for any $u\in\mathbb{X}$.

Let $g\!: \mathbb{Z}\to[-\infty,+\infty]$ be an extended real-valued lsc function with $g(\overline{z})$ finite. The regular subdifferential of $g$ at $\overline{z}$, denoted by $\widehat{\partial}g(\overline{z})$, is defined as $$\widehat{\partial}g(\overline{z}):=\bigg\{z^*\in\mathbb{X}\ \big|\
    \liminf_{z\to \overline{z}\atop z\ne\overline{z}}
    \frac{g(z)-g(\overline{z})-\langle z^*,z-\overline{z}\rangle}{\|z-\overline{z}\|}\ge 0\bigg\};$$ and the (limiting) subdifferential of $g$ at $\overline{z}$, denoted by $\partial g(\overline{z})$, is defined as $$\begin{aligned}
\label{subgradientDef}
   \partial g(\overline{z})=\Big\{ z^*\in \mathbb{X}\,|\, \exists\, z^k\xrightarrow[g]{} z, z^{k,*}\to z^*\ {\rm \, such \, that\, }\ z^{k,*}\in \widehat{\partial}g(z^k)\Big\}.
  \end{aligned}$$ From [@RW98 Theorem 8.9] we know that there is close relation between the subdifferentials of $g$ at $\overline{z}$ and the normal cones of its epigraph at $(\overline{z},g(\overline{z}))$. Also, from [@RW98 Exercise 8.14], $$\widehat{\mathcal{N}}_{S}(z)=\widehat{\partial}\delta_{S}(z)
    \ \ {\rm and}\ \
   \mathcal{N}_{S}(z)=\partial\delta_{S}(z)\ \ {\rm for}\ z\in S.$$ In the sequel, we call a point $z$ at which $0\in\partial g(z)$ (respectively, $0\in\widehat{\partial}g(z)$) is called a limiting (respectively, regular) critical point of $g$. By [@RW98 Theorem 10.1], a local minimizer of $g$ is necessarily a regular critical point of $g$, and then a limiting critical point.

Lipschitz-like properties of multifunctions {#sec2.2}
-------------------------------------------

Let $\mathcal{F}\!:\mathbb{Z}\rightrightarrows\mathbb{W}$ be a given multifunction. Consider an arbitrary point $(\overline{z},\overline{w})\in{\rm gph}\mathcal{F}$ at which $\mathcal{F}$ is locally closed, where ${\rm gph}\mathcal{F}$ denotes the graph of $\mathcal{F}$. We recall from [@RW98; @DR09] the concepts of the Aubin property, calmness and metric subregularity of $\mathcal{F}$.

\[Aubin-def\] The multifunction $\mathcal{F}$ is said to have the Aubin property at $\overline{z}$ for $\overline{w}$ with modulus $\kappa>0$, if there exist $\varepsilon>0$ and $\delta>0$ such that for all $z,z'\in\mathbb{B}_{\varepsilon}(\overline{z})$, $$\mathcal{F}(z)\cap\mathbb{B}_{\delta}(\overline{w})\subseteq\mathcal{F}(z')
    +\kappa\|z-z'\|\mathbb{B}_{\mathbb{W}}.$$

\[calm-def\] The multifunction $\mathcal{F}$ is said to be calm at $\overline{z}$ for $\overline{w}$ with modulus $\kappa>0$ if there exist $\varepsilon>0$ and $\delta>0$ such that for all $z\in\mathbb{B}_{\varepsilon}(\overline{z})$, $$\label{calm-inclusion1}
    \mathcal{F}(z)\cap\mathbb{B}_{\delta}(\overline{w})
    \subseteq\mathcal{F}(\overline{z})+\kappa\|z-\overline{z}\|\mathbb{B}_{\mathbb{W}}.$$ If in addition $\mathcal{F}(\overline{z})\cap\mathbb{B}_{\delta}(\overline{w})=\{\overline{w}\}$, $\mathcal{F}$ is said to be isolated calm at $\overline{z}$ for $\overline{w}$.

By [@DR09 Exercise 3H.4], the restriction on $z\in\mathbb{B}_{\varepsilon}(\overline{z})$ in Definition \[calm-def\] can be removed. It is easily seen that the calmness of $\mathcal{F}$ is a “one-point” variant of the Aubin property, and the calmness of $\mathcal{F}$ at $(\overline{z},\overline{w})\in{\rm gph}\mathcal{F}$ is implied by its Aubin property or isolated calmness at this point. Notice that the calmness of $\mathcal{F}$ at $\overline{z}$ for $\overline{w}\in\mathcal{F}(\overline{z})$ is equivalent to the metric subregularity of $\mathcal{F}^{-1}$ at $\overline{w}$ for $\overline{z}\in\mathcal{F}^{-1}(\overline{w})$ by [@DR09 Theorem 3H.3].

The coderivative and graphical derivative of $\mathcal{F}$ are an convenient tool to characterize the Aubin property and the isolated calmness of $\mathcal{F}$, respectively. Recall from [@RW98] that the coderivative of $\mathcal{F}$ at $\overline{z}$ for $\overline{w}$ is the mapping $D^*\mathcal{F}(\overline{z}|\overline{w})\!:\mathbb{W}\rightrightarrows\mathbb{Z}$ defined by $$u\in D^*\mathcal{F}(\overline{z}|\overline{w})(v)\Longleftrightarrow
    (u,-v)\in\mathcal{N}_{{\rm gph}\,\mathcal{F}}(\overline{z},\overline{w}),$$ and the graphical derivative of $\mathcal{F}$ at $\overline{z}$ for $\overline{w}$ is the mapping $D\mathcal{F}(\overline{z}|\overline{w})\!:\mathbb{Z}\rightrightarrows\mathbb{W}$ given by $$v\in D\mathcal{F}(\overline{z}|\overline{w})(u)\Longleftrightarrow
    (u,v)\in\mathcal{T}_{{\rm gph}\,\mathcal{F}}(\overline{z},\overline{w}).$$

\[chara-Aubin\](See [@Mordu93 Theorem 5.7] or [@RW98 Theorem 9.40]) Suppose that $\mathcal{F}$ is locally closed at $(\overline{z},\overline{w})$. Then $\mathcal{F}$ has the Aubin property at $\overline{z}$ for $\overline{w}$ iff $D^*\mathcal{F}(\overline{z}|\overline{w})(0)=\{0\}$.

\[chara-icalm\](See [@KR92 Proposition 2.1] or [@Levy96 Proposition 4.1]) Suppose that $\mathcal{F}$ is locally closed at $(\overline{z},\overline{w})$. Then $\mathcal{F}$ is isolated calm at $\overline{z}$ for $\overline{w}$ iff $D\mathcal{F}(\overline{z}|\overline{w})(0)=\{0\}$.

Coderivative of the subdifferential mapping $\partial\|\cdot\|_*$ {#sec2.3}
-----------------------------------------------------------------

For a given $X\in\mathbb{R}^{m\times n}$ with SVD as $U[{\rm Diag}(\sigma(X))\ \ 0]V^{\mathbb{T}}$, by [@Watson92 Example 2] we have $$\label{subdiff-nnorm}
 \partial \|X\|_*=\Big\{[U_1\ \ U_2]\left[\begin{matrix}
                                       I &0\\
                                       0 & Z
                                       \end{matrix}\right]
                                       [V_1\ \ V_2]^{\mathbb{T}}\;|\; \|Z\|\leq 1\Big\}$$ where $U_1$ and $V_1$ are the submatrix consisting of the first $r={\rm rank}(X)$ columns of $U$ and $V$, respectively, and $U_2$ and $V_2$ are the submatrix consisting of the last $m\!-r$ columns and $n-r$ columns of $U$ and $V$, respectively. In this part we recall from [@LiuPan19] the coderivative of the subdifferential mapping $\partial\|\cdot\|_*$. For this purpose, in the sequel for two positive integers $k_1$ and $k_2$ with $k_2\ge k_1$, we denote by $[k_1,k_2]$ the set $\{k_1, k_1\!+\!1,\ldots,k_2\}$. For a given $\overline{Z}\in\mathbb{R}^{m\times n}$, define the following index sets associated to its singular values:

$$\begin{aligned}
\label{abg-index1}
   \!\alpha\!:=\!\{i\!\in\![1,m]\ |\ \sigma_i(\overline{Z})\!>\!1\},\
   \beta\!:=\!\{i\!\in\![1,m]\ |\ \sigma_i(\overline{Z})\!=\!1\},\ c=[m\!+\!1,n],\qquad\\
   \gamma:=\gamma_1\cup\gamma_0\ {\rm for}\ \gamma_1\!:=\big\{i\in [1,m]\ |\ 0<\sigma_i(\overline{Z})<1\big\},
   \gamma_0\!:=\!\big\{i\in [1,m]\ |\ \sigma_i(\overline{Z})=0\big\},
   \label{abg-index2}
  \end{aligned}$$

and let $\Omega_1,\Omega_2\in\mathbb{S}^{m}$ and $\Omega_3\in\mathbb{R}^{m\times (n-m)}$ be the matrices associated to $\sigma(\overline{Z})$ given by

$$\begin{aligned}
\label{Omega1}
   \big(\Omega_1\big)_{ij}
    &:=\left\{\begin{array}{cl}
          \frac{\min(1,\sigma_i(\overline{Z}))-\min(1,\sigma_j(\overline{Z}))}
          {\sigma_i(\overline{Z})-\sigma_j(\overline{Z})}& {\rm if}\ \sigma_i(\overline{Z})\ne\sigma_j(\overline{Z}),\\
           0 & {\rm otherwise}\\
   \end{array}\right.\ \ i,j\in\{1,2,\ldots,m\},\\
   \label{Omega2}
   \big(\Omega_2\big)_{ij}
   &:=\left\{\begin{array}{cl}
          \frac{\min(1,\sigma_i(\overline{Z}))+\min(1,\sigma_j(\overline{Z}))}
          {\sigma_i(\overline{Z})+\sigma_j(\overline{Z})}& {\rm if}\ \sigma_i(\overline{Z})+\!\sigma_j(\overline{Z})\ne 0,\\
           0 & {\rm otherwise}\\
   \end{array}\right.\ \ i,j\in\{1,2,\ldots,m\},\\
   \label{Omega3}
   \big(\Omega_3\big)_{ij}
   &:=\left\{\begin{array}{cl}
          \frac{\min(1,\sigma_i(\overline{Z}))}{\sigma_i(\overline{Z})}
          & {\rm if}\ \sigma_i(\overline{Z})\ne 0,\\
           0 & {\rm otherwise}\\
   \end{array}\right.\ \ i\in\{1,\ldots,m\},j\in\{1,\ldots,n\!-\!m\}.
  \end{aligned}$$

With the matrices $\Omega_1,\Omega_2\in\mathbb{S}^{m}$ and $\Omega_3\in\mathbb{R}^{m\times (n-m)}$, we define the following matrices

$$\label{Theta}
  \Theta_1:=\left[\begin{matrix}
            0_{\alpha\alpha} & 0_{\alpha \beta} &(\Omega_1)_{\alpha\gamma}\\
            0_{\beta\alpha}& 0_{\beta\beta}&E_{\beta\gamma}\\
            (\Omega_1)_{\gamma\alpha}& E_{\gamma\beta}&E_{\gamma\gamma}\\
           \end{matrix}\right],\
  \Theta_2:=\left[\begin{matrix}
             E_{\alpha\alpha} & E_{\alpha \beta} &E_{\alpha\gamma}\!-\!(\Omega_1)_{\alpha\gamma}\\
             E_{\beta\alpha}& 0_{\beta\beta}&0_{\beta\gamma}\\
             E_{\gamma\alpha}\!-\!(\Omega_1)_{\gamma\alpha}& 0_{\gamma\beta}&0_{\gamma\gamma}\\
            \end{matrix}\right],\\$$

$$\label{Sigma}
  \Sigma_1\!:=\!\left[\begin{matrix}
             (\Omega_2)_{\alpha\alpha} & (\Omega_2)_{\alpha\beta} & (\Omega_2)_{\alpha\gamma}\\
             (\Omega_2)_{\beta\alpha}& 0_{\beta\beta}&E_{\beta\gamma}\\
             (\Omega_2)_{\gamma\alpha}& E_{\gamma \beta}&E_{\gamma\gamma}\\
             \end{matrix}\right],
  \Sigma_2\!:=\!\left[\begin{matrix}
              E_{\alpha\alpha}\!-\!(\Omega_2)_{\alpha\alpha} & E_{\alpha \beta}\!-\!(\Omega_2)_{\alpha\beta}
              &E_{\alpha\gamma}\!-\!(\Omega_2)_{\alpha\gamma}\\
              E_{\beta\alpha}\!-\!(\Omega_2)_{\beta\alpha }& 0_{\beta \beta}&0_{\beta\gamma}\\
              E_{\gamma\alpha}\!-\!(\Omega_2)_{\gamma\alpha}& 0_{\gamma\beta}&0_{\gamma\gamma}\\
             \end{matrix}\!\right].$$

For the index set $\beta$, we denote the set of all partitions of $\beta$ by $\mathscr{P}(\beta)$. Define the set $$\mathbb{R}_{>}^{|\beta|}:=\big\{z\in\mathbb{R}^{|\beta|}\!:\ z_1\ge\cdots\ge z_{|\beta|}>0\big\}.$$ For any $z\in\mathbb{R}_{>}^{|\beta|}$, let $D(z)\in\mathbb{S}^{|\beta|}$ denote the first generalized divided difference matrix of $h(t)=\min(1,t)$ at $z$, which is defined as $$\label{Ddiff-matrix}
   (D(z))_{ij}:=\left\{\begin{array}{cl}
               \!\frac{\min(1,z_i)-\min(1,z_j)}{z_i-z_j}\in[0,1]&{\rm if}\ z_i\ne z_j,\\
                 0 &{\rm if}\ z_i=z_j\ge 1,\\
                1 & {\rm otherwise}.
                \end{array}\right.$$ Write $
   \mathcal{U}_{|\beta|}
   :=\big\{\overline{\Omega}\in\mathbb{S}^{|\beta|}\!:\ \overline{\Omega}=\lim_{k\to\infty}D(z^k),\,
   z^k\to e_{|\beta|},\, z^k\in\mathbb{R}_{>}^{|\beta|}\big\}.
 $ For each $\Xi_1\in\mathcal{U}_{|\beta|}$, by equation there exists a partition $(\beta_{+},\beta_{0},\beta_{-})\in\mathscr{P}(\beta)$ such that $$\label{Xi1-matrix}
   \Xi_1=\left[\begin{matrix}
          0_{\beta_{+}\beta_{+}}& 0_{\beta_{+}\beta_{0}}&(\Xi_1)_{\beta_{+}\beta_{-}}\\
          0_{\beta_{0}\beta_{+}}& 0_{\beta_{0}\beta_{0}}& E_{\beta_{0}\beta_{-}}\\
          (\Xi_1)_{\beta_{+}\beta_{-}}^{\mathbb{T}}&E_{\beta_{-}\beta_{0}}&E_{\beta_{-}\beta_{-}}
         \end{matrix}\right],$$ where each entry of $(\Xi_1)_{\beta_{+}\beta_{-}}$ belongs to $[0,1]$. Let $\Xi_2$ be the matrix associated to $\Xi_1$: $$\label{Xi2-matrix}
   \Xi_2=\left[\begin{matrix}
          E_{\beta_{+}\beta_{+}}& E_{\beta_{+}\beta_{0}}& E_{\beta_{+}\beta_{-}}\!-\!(\Xi_1)_{\beta_{+}\beta_{-}}\\
          E_{\beta_{0}\beta_{+}}& 0_{\beta_{0}\beta_{0}}& 0_{\beta_{0}\beta_{-}}\\
          E_{\beta_{-}\beta_{+}}\!-\!(\Xi_1)_{\beta_{+}\beta_{-}}^{\mathbb{T}}&0_{\beta_{-}\beta_{0}}&0_{\beta_{-}\beta_{-}}
         \end{matrix}\right].$$ Now we are in a position to give the coderivative of the subdifferential mapping $\partial\|\cdot\|_*$.

(See [@LiuPan19 Theorem 3.2])\[coderivative\] Fix an arbitrary $(X,W)\in\!{\rm gph}\,\partial\|\cdot\|_*$ and let $\alpha,\beta,\gamma$ and $c$ be defined by - with $\overline{Z}\!=X\!+W$. Let $(\overline{U},\overline{V})\in\mathbb{O}^{m,n}(\overline{Z})$ with $\overline{V}=[\overline{V}_1\ \ \overline{V}_2]$ where $\overline{V}_1\in\mathbb{O}^{n\times m}$ and $\overline{V}_2\in\mathbb{O}^{n\times (n-m)}$, and for each $H\in\mathbb{R}^{m\times n}$ write $\widetilde{H}=\overline{U}^{\mathbb{T}}\!H\overline{V}$ and $\widetilde{H}_1=\overline{U}^{\mathbb{T}}\!H\overline{V}_1$. Then, $(G,H)\in\mathcal{N}_{{\rm gph}\,\partial \|\cdot\|_*}(X,W)$ iff the following relations hold

$$\begin{aligned}
\label{equa1-normal}
  \Theta_1\circ\mathcal{S}(\widetilde{H}_1)+\Theta_2\circ \mathcal{S}(\widetilde{G}_1)
    +\Sigma_1\circ \mathcal{X}(\widetilde{H}_1)+\Sigma_2\circ \mathcal{X}(\widetilde{G}_1)=0,\qquad\qquad\\
    \label{equa2-normal}
   \widetilde{G}_{\alpha c}+(\Omega_3)_{\alpha c}\circ
   (\widetilde{H}_{\alpha c}-\widetilde{G}_{\alpha c})=0,\,\widetilde{H}_{\beta c}=0,\,
   \widetilde{H}_{\gamma c}=0,\qquad\qquad\quad\\
   \label{equa3-normal}
   (\widetilde{G}_{\beta\beta},\widetilde{H}_{\beta\beta})\in\!
   \bigcup_{Q\in\mathbb{O}^{|\beta|}\atop \Xi_1\in\mathcal{U}_{|\beta|}}
   \!\left\{(M,N)\ \bigg|\!\left.\begin{array}{ll}
    \Xi_1\circ\widehat{N}+\Xi_2\circ \mathcal{S}(\widehat{M})+\Xi_2\circ \mathcal{X}(\widehat{N})=0\\
    \quad {\rm with}\ \widehat{N}=Q^{\mathbb{T}}NQ,\,\widehat{M}=Q^{\mathbb{T}}MQ,\\
    \quad Q_{\beta_0}^{\mathbb{T}}MQ_{\beta_0}\preceq 0,\
     Q_{\beta_0}^{\mathbb{T}}NQ_{\beta_0}\succeq 0
   \end{array}\right.\!\right\}
 \end{aligned}$$

where $\mathcal{S}\!:\mathbb{R}^{m\times m}\to\mathbb{S}^m$ and $\mathcal{X}\!:\mathbb{R}^{m\times m}\to\mathbb{R}^{m\times m}$ are linear the mappings defined by $$\label{ST-oper}
   \mathcal{S}(Y):=(Y\!+\!Y^{\mathbb{T}})/2\ \ {\rm and}\ \
   \mathcal{X}(Y):=(Y\!-\!Y^{\mathbb{T}})/2
   \quad\ \forall\, Y\in\mathbb{R}^{m\times m},$$ and the notation “$\circ$” denotes the Hardmard product operator of two matrices.

Four classes of stationary points and their relations {#sec3}
=====================================================

To introduce the four classes of stationary points for the problem , with each $\phi\in\!\mathscr{L}$, we write $\widehat{\phi}(t)\!:=\!\phi(|t|)$ for $t\in\mathbb{R}$ and $\widehat{\Phi}(x)\!:={\textstyle\sum_{i=1}^m}\widehat{\phi}(x_i)$ for $x\in\mathbb{R}^m$; and with the associated $\psi$, write $\widehat{\psi}(t)\!:=\!\psi(|t|)$ for $t\in\mathbb{R}$ and $\widehat{\Psi}(x)\!:={\textstyle\sum_{i=1}^m}\widehat{\psi}(x_i)$ for $x\in\mathbb{R}^m$. Clearly, $\widehat{\Phi}$ and $\widehat{\Psi}$ are absolutely symmetric, i.e., $\widehat{\Phi}(Px)=\widehat{\Phi}(x)$ and $\widehat{\Psi}(Px)=\widehat{\Psi}(x)$ for any $m\times m$ signed permutation matrix $P$. Also, $\widehat{\Phi}\circ\sigma$ is globally Lipschitz continuous over the ball $\mathbb{B}$. The following equivalent relations are often used in the subsequent analysis

$$\begin{aligned}
\label{XW-equa1}
   \|X\|_*-\langle X,W\rangle=0,\|W\|\le 1
   \Longleftrightarrow W\in\mathop{\arg\max}_{Z\in\mathbb{B}}\,\langle Z,X\rangle\Longleftrightarrow X\in\mathcal{N}_{\mathbb{B}}(W)\quad\ \\
   \label{XW-equa2}
   \qquad\qquad\qquad\qquad\qquad\qquad\quad\Longleftrightarrow W\in\partial\|\cdot\|_*(X)
   \Longleftrightarrow (X,W)\in{\rm gph}\,\partial\|\cdot\|_*
  \end{aligned}$$

R-stationary point {#sec3.1}
------------------

Recall that $\overline{X}\in\mathbb{R}^{m\times n}$ is a regular critical point of $F$ if $0\in\widehat{\partial}F(\overline{X})$. Since the rank function is regular by [@WuPanBi18 Lemma 2.1] and [@Lewis05 Corollary 7.5], by combining with the assumption on $f$, from [@RW98 Corollary 10.9] we have $\widehat{\partial}F(\overline{X})\supseteq\partial\!f(\overline{X})
   +\partial{\rm rank}(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})$. In view of this, we introduce the following R-stationary point of the problem .

\[Def-Rspc\] A matrix $\overline{X}\in\mathbb{R}^{m\times n}$ is called a R-stationary point of the problem if $$0\in \nu\partial\!f(\overline{X})+\partial{\rm rank}(\overline{X})
     +\mathcal{N}_{\Omega}(\overline{X}).$$

Clearly, every R-stationary point of is a regular critical point of $F$. By the given assumption on $f$ and [@RW98 Exercise 10.10], for any $X\in\Omega$ it holds that $$\partial\!F(X)\subset \nu\partial\!f(X)+\partial({\rm rank}+\delta_{\Omega})(X).$$ Thus, when $\partial({\rm rank}+\delta_{\Omega})(\overline{X})
  \subset \partial{\rm rank}(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})$, the limiting critical point of $F$ is same as its regular critical point, and coincides with the R-stationary point of .

M-stationary point {#sec3.1}
------------------

By invoking the relation , clearly, the MPEC can be compactly written as $$\label{EMPEC1}
    \min_{X,W\in\mathbb{R}^{m\times n}}\Big\{\widetilde{F}(X,W):=\nu f(X)+\widehat{\Phi}(\sigma(W))
    +\delta_{\Omega}(X)+\delta_{{\rm gph}\partial\|\cdot\|_*}(X,W)\Big\}.$$ Moreover, under a suitable constraint qualification (CQ), the following inclusion holds: $$\partial\widetilde{F}(X,W)\subseteq \big[\nu \partial\!f(X)+\mathcal{N}_{\Omega}(X)\big]\times
    \partial(\widehat{\Phi}\circ\sigma)(W)+\mathcal{N}_{{\rm gph}\partial\|\cdot\|_*}(X,W).$$ Motivated by this, we introduce the M-stationary point of the problem as follows.

\[Def-Mspc\] A matrix $\overline{X}\in\mathbb{R}^{m\times n}$ is called an M-stationary point of the problem associated to $\phi\in\mathscr{L}$ if there exist $\overline{W}\in\partial\|\cdot\|_*(\overline{X})$ and $\Delta W\in\partial(\widehat{\Phi}\circ\sigma)(\overline{W})$ such that $$\label{M-equa}
    0\in \nu \partial\!f(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})
    +D^*\partial\|\cdot\|_*(\overline{X}|\overline{W})(\Delta W).$$

\[M-Spoint\] When $\Omega\subseteq\mathbb{S}_{+}^n$, the rank regularized problem can be reformulated as $$\begin{aligned}
\label{SDPMPEC}
  &\min_{X,W\in\mathbb{S}^{n}}\nu f(X)+{\textstyle\sum_{i=1}^m}\phi(\sigma_i(W))+\delta_{\Omega}(X)\nonumber\\
  &\quad {\rm s.t.}\ \ \langle I-W,X\rangle=0,\,W\in\mathbb{S}_{+}^n,\, I-W\in\mathbb{S}_{+}^n.
 \end{aligned}$$ Notice that $\langle I-W,X\rangle=0,X\in\mathbb{S}_{+}^n,W\in\mathbb{S}_{+}^n$ and $I-W\in\mathbb{S}_{+}^n$ iff $(X,W\!-I)\in{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}$ and $W\in\mathbb{S}_{+}^n$. So, for this case, $\overline{X}\in\Omega$ is an M-stationary point if and only if there exist $(\overline{Y},\Delta Y)\in\mathbb{S}_{+}^n\times\mathbb{S}^n$ with $\overline{Y}\!-I\in\mathcal{N}_{\mathbb{S}_{+}^n}(\overline{X})$ and $\Delta Y\in\partial(\widehat{\Phi}\circ\sigma)(\overline{Y})+\mathcal{N}_{\mathbb{S}_{+}^n}(\overline{Y})$ such that $$0\in \nu \partial\!f(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})
    +D^*\mathcal{N}_{\mathbb{S}^n_+}(\overline{X}|\overline{Y}\!-I)(-\Delta Y),$$ or equivalently, there exist $\overline{Y}\!\in\mathbb{S}_{+}^n$ with $\overline{Y}\!-I\in\mathcal{N}_{\mathbb{S}_{+}^n}(\overline{X})$ and $(\overline{\Gamma}_1,\overline{\Gamma}_2)\in
  \mathbb{S}^n\times\mathbb{S}^{n}$ such that

\[MpointR-equa1\] 0f()+\_1+\_(),\
\[MpointR-equa2\] 0()()-\_2+\_[\^n\_+]{}(),\
\[MpointR-equa3\] \_1D\^\*\_[\^n\_+]{}(|-I)(-\_2).

For this class of stationary points, we have the following proposition that is the key to achieve the relation between the M-stationary point and the R-stationary point.

\[prop-Mspc\] Let $\mathscr{L}_1$ denote the family of those $\phi\in\!\mathscr{L}$ that is differentiable on $(0,1]$. If $\overline{X}$ is an M-stationary point of the problem associated to $\phi\in\!\mathscr{L}_1$, then there exist $\overline{W}\in\partial\|\cdot\|_*(\overline{X})$ and $\Delta\Gamma\in\nu\partial\!f(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})$ such that for the index sets $\alpha,\beta,c,\gamma,\gamma_1$ and $\gamma_0$ defined as in - with $\overline{Z}=\overline{X}+\overline{W}$ and $(\overline{U},\overline{V})\in\mathbb{O}^{m,n}(\overline{Z})$, $$\label{DetaGamma}
    \Delta \Gamma\!=\overline{U}\!\left[\begin{matrix}
    0_{\alpha\alpha}&0_{\alpha\beta}&0_{\alpha\gamma}&0_{\alpha c}\\
    0_{\beta\alpha} &(\Delta\widetilde{\Gamma})_{\beta\beta}
    &(\Delta\widetilde{\Gamma})_{\beta\gamma}&(\Delta\widetilde{\Gamma})_{\beta c}\\
       0_{\gamma\alpha}&(\Delta\widetilde{\Gamma})_{\gamma\beta}
       &(\Delta\widetilde{\Gamma})_{\gamma\gamma}&(\Delta\widetilde{\Gamma})_{\gamma c}
     \end{matrix}\right]\!\overline{V}^{\mathbb{T}}\ \ {\rm for}\
    \Delta\widetilde{\Gamma}\!=\!\overline{U}^{\mathbb{T}}\!\Delta\Gamma\overline{V}, \mathcal{S}[(\Delta\widetilde{\Gamma})_{\beta\beta}]\!=0.$$ In particular, if $\phi'(t)\ne 0$ for all $t\in(0,1)$, then $\gamma_1=\emptyset$; and if $0\notin\partial\widehat{\phi}(0)$, then $\gamma_0=\emptyset$.

Let $\overline{X}$ be an M-stationary point of the problem associated to $\phi\in\!\mathscr{L}_1$. By Definition \[Def-Mspc\], there exist $\overline{W}\in\partial\|\cdot\|_*(\overline{X})$ and $\Delta W\in\partial(\widehat{\Phi}\circ\sigma)(\overline{W})$ such that holds. So, there exists $\Delta\Gamma\in\nu \partial f(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})$ such that $-\Delta\Gamma\in D^*\partial\|\cdot\|_*(\overline{X}|\overline{W})(\Delta W)$. We argue that $\Delta\Gamma$ has the form of . Since $(\overline{U},\overline{V})\in\mathbb{O}^{m,n}(\overline{Z})$, from $\overline{W}\in\partial\|\cdot\|_*(\overline{X})$,

$$\begin{aligned}
\label{XbarSVD}
  \overline{X}&=\overline{U}\left[\begin{matrix}
                   {\rm Diag}(\sigma_{\alpha}(\overline{Z})\!-\!e_{\alpha})& 0_{\alpha\beta}&0_{\alpha\gamma}&0_{\alpha c}\\
                   0_{\beta\alpha} &  0_{\beta\beta} &  0_{\beta\gamma}&0_{\beta c}\\
                   0_{\gamma\alpha}&0_{\gamma\beta}  & 0_{\gamma\gamma}&0_{\gamma c}
                   \end{matrix}\right]\overline{V}^{\mathbb{T}},\\
  \label{YbarSVD}
  \overline{W}&=\overline{U}\left[\begin{matrix}
                   I_{\alpha\alpha}& 0_{\alpha\beta}&0_{\alpha\gamma}&0_{\alpha c}\\
                   0_{\beta\alpha} & I_{\beta\beta} &  0_{\beta\gamma}&0_{\beta c}\\
                   0_{\gamma\alpha}&0_{\gamma\beta}  & {\rm Diag}(\sigma_{\gamma}(\overline{Z}))&0_{\gamma c}
                   \end{matrix}\right]\overline{V}^{\mathbb{T}}.
  \end{aligned}$$

Since $\widehat{\Phi}$ is absolutely symmetric and $\Delta W\!\in\partial(\widehat{\Phi}\circ\sigma)(\overline{W})$, by [@Lewis95 Corollary 2.5] and equation there exist $(\widehat{U},\widehat{V})\in\mathbb{O}^{m,n}(\overline{W})$ and $\overline{w}\in\partial\widehat{\Phi}(\sigma(\overline{W}))$ such that $$\label{DetaW}
   \Delta W=\widehat{U}[{\rm Diag}(\overline{w})\ \ 0]\widehat{V}^{\mathbb{T}}.$$ From $\overline{w}\in\partial\widehat{\Phi}(\sigma(\overline{W}))$, the definition of $\widehat{\Phi}$ and equation , it follows that $$\label{equa-barw}
   \overline{w}_i=\phi'(1)\ {\rm for}\ i\in\alpha\cup\beta;\ \
   \overline{w}_i=\phi'(\sigma_{i}(\overline{Z}))\ {\rm for}\ i\in\gamma_1;\ \
   \overline{w}_i\in\partial\widehat{\phi}(0)\ {\rm for}\ i\in\gamma_0.$$ Without loss of generality, we assume that the matrix $\overline{Z}$ has $r$ distinct singular values belonging to $(0,1)$. Let $\overline{\mu}_1>\overline{\mu}_2>\cdots>\overline{\mu}_{r}$ be the $r$ distinct singular values and write $$a_k\!:=\big\{i\in\gamma_1\ |\ \sigma_i(\overline{Z})\!=\overline{\mu}_k\big\}\ \ {\rm for}\ \
   k=1,2,\ldots,r.$$ Since $(\widehat{U},\widehat{V})\in\mathbb{O}^{m,n}(\overline{W})$, from equation and [@DingST14 Proposition 5], there exist a block diagonal matrix $\widehat{Q}={\rm Diag}(Q_0,Q_1,\ldots,Q_r)$ with $Q_0\in\mathbb{O}^{|\alpha|+|\beta|}$ and $Q_k\in \mathbb{O}^{|a_k|}$ for $k=1,2,\ldots,r$, and orthogonal matrices $Q'\in \mathbb{O}^{|\gamma_0|}$ and $Q''\in \mathbb{O}^{|\gamma_0\cup c|}$ such that $$\widehat{U}=\overline{U}\left[\begin{matrix}
              \widehat{Q} &0\\
              0 & Q'
              \end{matrix}\right]
   \ \ {\rm and}\ \
  \widehat{V}=\overline{V}\left[\begin{matrix}
   \widehat{Q}&0\\
    0 & Q''
    \end{matrix}\right].$$ Together with equations and , it is not difficult to obtain that $$\Delta W=\overline{U}
   \left[\begin{matrix}
      {\rm Diag}(\overline{w}_{\alpha\cup\beta\cup\gamma_1}) & 0\\
      0 &Q'{\rm Diag}(\overline{w}_{\gamma_0})(Q_{\gamma_0}'')^{\mathbb{T}}
      \end{matrix}\right]\overline{V}^{\mathbb{T}},$$ and consequently $$\label{detaW-equa1}
  \Delta\widetilde{W}\!:=\overline{U}^{\mathbb{T}}\Delta W\overline{V}
   =\left[\begin{matrix}
      {\rm Diag}(\overline{w}_{\alpha\cup\beta\cup\gamma_1}) & 0\\
      0 &Q'{\rm Diag}(\overline{w}_{\gamma_0})(Q_{\gamma_0}'')^{\mathbb{T}}
      \end{matrix}\right].$$ Since $(-\Delta\Gamma,-\Delta W)\in\!\mathcal{N}_{{\rm gph}\,\partial \|\cdot\|_*}(\overline{X},\overline{W})$, by equation - of Lemma \[coderivative\], we get

$$\begin{aligned}
\label{normal1-equa1}
  \Theta_1\circ\mathcal{S}(\Delta\widetilde{W}_1)+\Theta_2\circ \mathcal{S}(\Delta\widetilde{\Gamma}_1)
    +\Sigma_1\circ \mathcal{X}(\Delta\widetilde{W}_1)+\Sigma_2\circ \mathcal{X}(\Delta\widetilde{\Gamma}_1)=0,\\
    \label{normal1-equa2}
   (\Delta\widetilde{\Gamma})_{\alpha c}+(\Omega_3)_{\alpha c}\circ
   [(\Delta\widetilde{W})_{\alpha c}-(\Delta\widetilde{\Gamma})_{\alpha c}]=0,\ (\Delta\widetilde{W})_{\beta c}=0,\
   \ (\Delta\widetilde{W})_{\gamma c}=0
 \end{aligned}$$

where $\Delta\widetilde{\Gamma}_1\!:=\overline{U}^{\mathbb{T}}\Delta\Gamma\overline{V}_{\!\alpha\cup\beta\cup\gamma},
 \Delta\widetilde{W}_1\!:=\overline{U}^{\mathbb{T}}\Delta W\overline{V}_{\!\alpha\cup\beta\cup\gamma}$, and the matrices $\Theta_1,\Theta_2,\Sigma_1$ and $\Sigma_2$ are defined as in Section \[sec2.3\]. Notice that $[\Delta\widetilde{W}_1]_{\alpha\cup\beta\cup\gamma_1,\alpha\cup\beta\cup\gamma_1}$ is a diagonal matrix by equation . Together with - and -, it follows that

$$\begin{aligned}
\label{normal2-equa1}
  (\Delta \widetilde{W})_{\alpha c}=0,\,(\Delta \widetilde{\Gamma})_{\alpha c}=0,\,
  (\Delta \widetilde{W})_{\gamma\gamma}=0,\qquad\\
  \label{normal2-equa11}
  [\mathcal{S}(\Delta\widetilde{\Gamma}_1)]_{\alpha\alpha}
  +(\Sigma_2)_{\alpha\alpha}\circ[\mathcal{X}(\Delta\widetilde{\Gamma}_1)]_{\alpha\alpha}=0,\qquad\\
  \label{normal2-equa2}
  (\Theta_2)_{\alpha\beta}\circ [\mathcal{S}(\Delta\widetilde{\Gamma}_1)]_{\alpha\beta}
  +(\Sigma_2)_{\alpha\beta}\circ [\mathcal{X}(\Delta\widetilde{\Gamma}_1)]_{\alpha\beta}=0,
  \\\label{normal2-equa3}
  (\Theta_2)_{\beta\alpha}\circ [\mathcal{S}(\Delta\widetilde{\Gamma}_1)]_{\beta\alpha}
  +(\Sigma_2)_{\beta\alpha}\circ[\mathcal{X}(\Delta\widetilde{\Gamma}_1)]_{\beta\alpha}=0,\\
  \label{normal2-equa4}
  (\Theta_2)_{\alpha\gamma}\circ[\mathcal{S}(\Delta\widetilde{\Gamma}_1)]_{\alpha\gamma}
  +(\Sigma_2)_{\alpha\gamma}\circ[\mathcal{X}(\Delta\widetilde{\Gamma}_1)]_{\alpha\gamma}=0,\\
  \label{normal2-equa5}
  (\Theta_2)_{\gamma\alpha}\circ[\mathcal{S}(\Delta\widetilde{\Gamma}_1)]_{\gamma\alpha}
  +(\Sigma_2)_{\gamma\alpha}\circ[\mathcal{X}(\Delta\widetilde{\Gamma}_1)]_{\gamma\alpha}=0.
  \end{aligned}$$

Notice that is equivalent to $
   (E+\Sigma_2)_{\alpha\alpha}(\Delta\widetilde{\Gamma}_1)_{\alpha\alpha}
   +(E-\Sigma_2)_{\alpha\alpha}(\Delta\widetilde{\Gamma}_1^{\mathbb{T}})_{\alpha\alpha}=0
 $ which, by the fact that the entries of $\Sigma_{2}$ belongs to $(0,1)$, implies that $(\Delta\widetilde{\Gamma}_1)_{\alpha\alpha}=0$. Notice that equations (\[normal2-equa2\]) and (\[normal2-equa3\]) can be equivalently written as

$$\begin{aligned}
\label{normal3-equa1}
  (\Theta_2+\Sigma_2)_{\alpha\beta}\circ (\Delta\widetilde{\Gamma}_1)_{\alpha\beta}=(\Sigma_2-\Theta_2)_{\alpha\beta}\circ (\Delta\widetilde{\Gamma}_1^{\mathbb{T}})_{\alpha\beta},\\
  \label{normal3-equa2}
  (\Theta_2+\Sigma_2)_{\beta\alpha}\circ (\Delta\widetilde{\Gamma}_1)_{\beta\alpha}=(\Sigma_2-\Theta_2)_{\beta\alpha}\circ (\Delta\widetilde{\Gamma}_1^{\mathbb{T}})_{\beta\alpha}.
  \end{aligned}$$

Since $[(\Delta\widetilde{\Gamma}_1)_{\beta\alpha}]^{\mathbb{T}}=(\Delta\widetilde{\Gamma}_1^{\mathbb{T}})_{\alpha\beta}$ and $[(\Delta\widetilde{\Gamma}_1^{\mathbb{T}})_{\beta\alpha}]^{\mathbb{T}}=(\Delta\widetilde{\Gamma}_1)_{\alpha\beta}$, by imposing the transpose to the both sides of equality (\[normal3-equa2\]) we immediately obtain that $$(\Delta\widetilde{\Gamma}_1^{\mathbb{T}})_{\alpha\beta}
  =\big[(\Sigma_2-\Theta_2)_{\alpha\beta}\oslash(\Theta_2+\Sigma_2)_{\alpha\beta}\big]
    \circ (\Delta\widetilde{\Gamma}_1)_{\alpha\beta}$$ where “$\oslash$” denotes the entries division operator of two matrices. Substituting this equality into yields that $(\Delta\widetilde{\Gamma}_1)_{\alpha\beta}=0$, and then $(\Delta\widetilde{\Gamma}_1)_{\beta\alpha}=0$. Similarly, from and , we can obtain $(\Delta\widetilde{\Gamma}_1)_{\alpha\gamma}=0$ and $(\Delta\widetilde{\Gamma}_1)_{\beta\gamma}=0$. Thus, $$\overline{U}^{\mathbb{T}}\Delta\Gamma \overline{V}=\Delta\widetilde{\Gamma}
    =\left[\begin{matrix}
       0_{\alpha\alpha}&0_{\alpha\beta}&0_{\alpha\gamma}&0_{\alpha c}\\
       0_{\beta\alpha} &(\Delta\widetilde{\Gamma})_{\beta\beta}
       &(\Delta\widetilde{\Gamma})_{\beta\gamma}&(\Delta\widetilde{\Gamma})_{\beta c}\\
       0_{\gamma\alpha}&(\Delta\widetilde{\Gamma})_{\gamma\beta}
       &(\Delta\widetilde{\Gamma})_{\gamma\gamma}&(\Delta\widetilde{\Gamma})_{\gamma c}
     \end{matrix}\right].$$ Thus, to complete the proof of the first part, we only need to argue that $\mathcal{S}[(\Delta\widetilde{\Gamma})_{\beta\beta}]=0$. Since $(-\Delta\Gamma,-\Delta W)\in\!\mathcal{N}_{{\rm gph}\,\partial \|\cdot\|_*}(\overline{X},\overline{W})$, by there exist $Q\in\mathbb{O}^{|\beta|}$ and $\Xi_1\in\mathcal{U}_{|\beta|}$ having the form for some partition $(\beta_{+},\beta_{0},\beta_{-})$ of $\beta$ such that $$\begin{aligned}
\label{normal4-equa1}
    \Xi_1\circ Q^{\mathbb{T}}(\Delta\widetilde{W})_{\beta\beta}Q
    +\Xi_2\circ \mathcal{S}\big[Q^{\mathbb{T}}(\Delta\widetilde{\Gamma})_{\beta\beta}Q\big]
    +\Xi_2\circ \mathcal{X}\big[Q^{\mathbb{T}}(\Delta\widetilde{W})_{\beta\beta}Q\big]=0,\\
    Q_{\beta_0}^{\mathbb{T}}(\Delta\widetilde{\Gamma})_{\beta\beta}Q_{\beta_0}\succeq 0,\
    Q_{\beta_0}^{\mathbb{T}}(\Delta\widetilde{W})_{\beta\beta}Q_{\beta_0}\preceq 0
    \qquad\qquad\qquad
  \label{normal4-equa2}
  \end{aligned}$$ where the matrix $\Xi_2$ associated with $\Xi_1$ has the form of . From and the first equality in , $(\Delta\widetilde{W})_{\beta\beta}={\rm Diag}(\overline{w}_{\beta})=\phi'(1)I$. Notice that $\phi'(1)>0$ by . We deduce $\beta_0=\emptyset$ from the second inequality of . Since $\mathcal{X}[Q^{\mathbb{T}}(\Delta\widetilde{W})_{\beta\beta}Q]=0$, reduces to $$\Xi_1\circ(Q^{\mathbb{T}}{\rm Diag}(\overline{w}_{\beta})Q)
    +\Xi_2\circ \mathcal{S}\big[Q^{\mathbb{T}}(\Delta\widetilde{\Gamma})_{\beta\beta}Q\big]=0.$$ Since $Q^{\mathbb{T}}{\rm Diag}(\overline{w}_{\beta})Q\succ 0$, by using the expressions of $\Xi_1$ and $\Xi_2$ we have $\beta_{-}=\emptyset$, and then the last equality reduces to $0=\mathcal{S}\big[Q^{\mathbb{T}}(\Delta\widetilde{\Gamma})_{\beta\beta}Q\big]
  =\mathcal{S}[(\Delta\widetilde{\Gamma})_{\beta\beta}]$. Thus, we complete the proof of the first part. By combining $(\Delta \widetilde{W})_{\gamma\gamma}=0$ with and , it is easy to see that if $\phi'(t)\ne 0$ for any $t\in(0,1)$, then $\gamma_1=\emptyset$; and if $0\notin\partial\widehat{\phi}(0)$, then $\gamma_0=\emptyset$.

Now we state the relation between the M-stationary point and the R-stationary point.

\[prop-MWrelation\] If $\overline{X}$ is an M-stationary point of the problem associated to $\phi\in\!\mathscr{L}_1$, then it is also a R-stationary point. Conversely, if $\overline{X}$ is a R-stationary point of , then it is an M-stationary point associated to those $\phi\in\!\mathscr{L}$ with $0\in\partial\widehat{\phi}(0)$.

Let $\overline{X}$ be an M-stationary point of associated to $\phi\in\!\mathscr{L}_1$. By Proposition \[prop-Mspc\], there exist $\overline{W}\in\partial\|\cdot\|_*(\overline{X})$ and $\Delta\Gamma\in\nu\partial\!f(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})$ such that for the index sets $\alpha,\beta,c,\gamma,
  \gamma_1,\gamma_0$ defined as in - with $\overline{Z}=\overline{X}+\overline{W}$ and $(\overline{U},\overline{V})\in\mathbb{O}^{m,n}(\overline{Z})$, the matrix $\Delta\Gamma$ takes the form of . Let $
  \Delta\widetilde{Z}=
  \left[\begin{matrix}
   (\Delta\widetilde{\Gamma})_{\beta\beta} &(\Delta\widetilde{\Gamma})_{\beta\gamma}
   &(\Delta\widetilde{\Gamma})_{\beta c}\\
  (\Delta\widetilde{\Gamma})_{\gamma\beta}&(\Delta\widetilde{\Gamma})_{\gamma\gamma}
  &(\Delta\widetilde{\Gamma})_{\gamma c}
  \end{matrix}\right].
  $ Take $(P,P')\in\mathbb{O}^{m-|\alpha|,n-|\alpha|}(\Delta\widetilde{Z})$. Write $\widetilde{U}=[\overline{U}_{\alpha}\ \ \overline{U}_{\!\beta\cup\gamma}P]$ and $\widetilde{V}=[\overline{V}_{\alpha}\ \ \overline{V}_{\!\beta\cup\gamma\cup c}P']$. Then, $$\Delta\Gamma=\widetilde{U}\left[\begin{matrix}
       0_{\alpha\alpha}& 0_{\alpha,\beta\cup\gamma} & 0_{\alpha c}\\
       0_{\beta\cup\gamma,\alpha} & {\rm Diag}(\sigma(\Delta\widetilde{Z}))&0_{\beta\cup\gamma,c}
     \end{matrix}\right]\widetilde{V}^{\mathbb{T}}.$$ By the definitions of $\widetilde{U}$ and $\widetilde{V}$ and , it is easy to check that $(\widetilde{U},\widetilde{V})\in\mathbb{O}^{m,n}(\overline{X})$. Notice that ${\rm rank}(\overline{X})=|\alpha|$. From [@Le13 Theorem 4], we have $-\Delta\Gamma\in \partial {\rm rank}(\overline{X})$. Thus, $0\in \partial {\rm rank}(\overline{X})+\nu\partial\!f(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})$. From Definition \[Def-Rspc\], $\overline{X}$ is a R-stationary point.

Now let $\overline{X}$ be a R-stationary point of with ${\rm rank}(\overline{X})=\overline{r}$. Suppose that $\overline{r}>1$. Take $\phi\in\!\mathscr{L}$ with $0\in\partial\widehat{\phi}(0)$. By Definition \[Def-Rspc\], there is $\Delta\Gamma\in\!\nu\partial\!f(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})$ such that $-\Delta\Gamma\in \partial {\rm rank}(\overline{X})$. Along with [@Le13 Theorem 4], there exists $(\overline{U},\overline{V})\in\mathbb{O}^{m,n}(\overline{X})$ such that $$-\Delta\Gamma=\overline{U}[{\rm Diag}(\overline{x})\ \ 0]\overline{V}^{\mathbb{T}}
    \ \ {\rm with}\ \ \overline{x}_i=0\ \ {\rm for}\ \ i=1,2,\ldots,\overline{r}.$$ Next we proceed the arguments by $t^*=0$ and $t^*\ne 0$, where $t^*$ is same as in .

[**Case 1:**]{} $t^*=0$. Take $\overline{W}:=\overline{U}_1\overline{V}_1^{\mathbb{T}}$, where $\overline{U}_1$ and $\overline{V}_1$ are the matrix consisting of the first $\overline{r}$ columns of $\overline{U}$ and $\overline{V}$, respectively. Clearly, $\overline{W}\in\partial\|\cdot\|_*(\overline{X})$ and $(\overline{U},\overline{V})\in\mathbb{O}^{m,n}(\overline{Z})$ with $\overline{Z}=\overline{X}+\overline{W}$. Let $\alpha,\beta,c,\gamma_0,\gamma_1$ be defined as before. Clearly, $\beta=\emptyset=\gamma_1$. Take $$\label{equa-barw1}
   \overline{w}_i=\phi_{-}'(1)\ \ {\rm for}\ i\in\alpha\ \ {\rm and}\ \
   \overline{w}_i=0\in\partial\widehat{\phi}(0)\ \ {\rm for}\ i\in\gamma_0.$$ Since $\phi$ is convex, from [@RW98 Proposition 10.19(i)] it follows that $
   \overline{w}_i\in\partial\widehat{\phi}(1)
 $ for $i\in\alpha$. Then $\Delta W\!=\overline{U}[{\rm Diag}(\overline{w})\ \ 0]\overline{V}^{\mathbb{T}}
  \!\in\partial(\widehat{\Phi}\circ\sigma)(\overline{W})$. Let $\Delta\widetilde{\Gamma}\!:=\overline{U}^{\mathbb{T}}\Delta\Gamma\overline{V}$ and $\Delta\widetilde{W}\!:=\overline{U}^{\mathbb{T}}\Delta W\overline{V}$. Clearly, $\mathcal{X}(\Delta\widetilde{\Gamma}_1)=\mathcal{X}(\Delta\widetilde{W}_1)=0$ where $\Delta\widetilde{\Gamma}_1:=\overline{U}^{\mathbb{T}}\Delta\Gamma\overline{V}_1$ and $\Delta\widetilde{W}_1:=\overline{U}^{\mathbb{T}}\Delta W\overline{V}_1$ with $\overline{V}_1$ being the matrix consisting of the first $m$ columns of $\overline{V}$. Together with $\Theta_2$ and $\Sigma_2$ defined as in Section \[sec2.3\], it is immediate to verify that $(-\Delta\widetilde{\Gamma},-\Delta\widetilde{W})$ satisfies

$$\begin{aligned}
  \Theta_1\circ\mathcal{S}(\Delta\widetilde{W}_1)+\Theta_2\circ \mathcal{S}(\Delta\widetilde{\Gamma}_1)
    +\Sigma_1\circ \mathcal{X}(\Delta\widetilde{W}_1)+\Sigma_2\circ \mathcal{X}(\Delta\widetilde{\Gamma}_1)=0,\\
   (\Delta\widetilde{\Gamma})_{\alpha c}+(\Omega_3)_{\alpha c}\circ
   [(\Delta\widetilde{W})_{\alpha c}-(\Delta\widetilde{\Gamma})_{\alpha c}]=0,
   \ (\Delta\widetilde{W})_{\beta c}=0,\,\ (\Delta\widetilde{W})_{\gamma c}=0.
 \end{aligned}$$

Since $\beta=\emptyset$, from Lemma \[coderivative\] it follows that $(-\Delta\Gamma,-\Delta W)\in\mathcal{N}_{{\rm gph}\,\partial\|\cdot\|_*}(\overline{X},\overline{W})$, i.e., $-\Delta\Gamma\in\!D^*\partial\|\cdot\|_*(\overline{X}|\overline{W})(\Delta W)$. By Definition \[Def-Mspc\], $\overline{X}$ is M-stationary associated to $\phi$.

[**Case 2:**]{} $t^*\ne 0$. Now $t^*\in (0,1)$. Take $\overline{W}:=\overline{U}_1\overline{V}_1^{\mathbb{T}}+t^*\overline{U}_2\overline{V}_2^{\mathbb{T}}$, where $\overline{U}_2$ and $\overline{V}_2$ are the matrix consisting of the last $m-\overline{r}$ and $n-\overline{r}$ columns of $\overline{U}$ and $\overline{V}$, respectively. Clearly, $\overline{W}\in\partial\|\cdot\|_*(\overline{X})$ and $(\overline{U},\overline{V})\in\mathbb{O}^{m,n}(\overline{Z})$ with $\overline{Z}=\overline{X}+\overline{W}$. Let $\alpha,\beta,c$ and $\gamma=\gamma_0\cup\gamma_1$ be defined as before. Then $\beta=\emptyset$ and $\gamma_0=\emptyset$. Let $\Delta W=\overline{U}[{\rm Diag}(\overline{w})\ \ 0]\overline{V}^{\mathbb{T}}$ with $$\label{equa-barw1}
   \overline{w}_i=\phi_{-}'(1)\ \ {\rm for}\ i\in\alpha\ \ {\rm and}\ \
   \overline{w}_i=0\in\partial\phi(t^*)\ \ {\rm for}\ i\in\gamma_1.$$ Using the same arguments as those for Case 1 can prove that $\overline{X}$ is M-stationary.

When $\overline{r}=0$, choose $\overline{W}=0$. Clearly, $\overline{W}\in\partial\|\cdot\|_*(\overline{X})$ since $\overline{X}=0$. Write $\overline{Z}=\overline{X}+\overline{W}$. Then, $\alpha=\beta=\emptyset=\gamma_1$. Take $\Delta W=0$. Since $0\in\partial\widehat{\phi}(0)$, we have $\Delta W\in\partial(\widehat{\Phi}\circ\sigma)(\overline{W})$. Moreover, by Lemma \[coderivative\] it is easy to check that $
   D^*\partial\|\cdot\|_*(\overline{X}|\overline{W})(\Delta W)=\mathbb{R}^{m\times n}.
 $ Thus, $\overline{X}$ is M-stationary associated to $\phi$. The proof is then completed.

To close this subsection, we provide a condition for a local minimizer of the MPEC associated with $\phi\in\!\mathscr{L}$ to be an M-stationary point associated to $\phi$.

\[necess1\] Let $(\overline{W},\overline{X})$ be a local minimizer of the MPEC associated to $\phi\in\!\mathscr{L}$. Then $\overline{X}$ is an M-stationary point of the problem associated to $\phi$, provided that $$\label{assump-Mspc}
   \mathcal{N}_{{\rm gph}\,\mathcal{N}_{\mathbb{B}}\cap(\mathbb{R}^{m\times n}\times\Omega)}(\overline{W},\overline{X})
   \subseteq \mathcal{N}_{{\rm gph}\,\mathcal{N}_{\mathbb{B}}}(\overline{W},\overline{X})+\{0\}\times\mathcal{N}_{\Omega}(\overline{X})$$ where $\mathbb{B}:=\{Z\in \mathbb{R}^{m\times n}\,|\, \|Z\|\leq 1\}$, and if in addition $\phi\in\!\mathscr{L}_1$, $\overline{X}$ is a $R$-stationary point.

By invoking the relation , $(W,X)$ is a feasible point of if and only if $(W,X)\in{\rm gph}\,\mathcal{N}_{\mathbb{B}}\cap(\mathbb{R}^{m\times n}\times \Omega)$. This implies that can be compactly written as $$\min_{X,W\in\mathbb{R}^{m\times n}}\Big\{\nu f(X)+\widehat{\Phi}(\sigma(W))
   +\delta_{{\rm gph}\,\mathcal{N}_{\mathbb{B}}\cap(\mathbb{R}^{m\times n}\times \Omega)}(W,X)\Big\}.$$ From the local optimality of $(\overline{W},\overline{X})$, the assumption on $f$, the Lipschitz continuity of $\widehat{\Phi}\circ \sigma$ over the ball $\mathbb{B}$, and [@RW98 Theorem 10.1 $\&$ Exercise 10.10], it follows that $$0\in\partial\widetilde{f}(\overline{W},\overline{X})+\partial(\widehat{\Phi}\circ\sigma)(\overline{W})\times \{0\}
     +\mathcal{N}_{{\rm gph}\,\mathcal{N}_{\mathbb{B}}\cap(\mathbb{R}^{m\times n}\times \Omega)}(\overline{W},\overline{X})$$ where $\widetilde{f}(W,X)\equiv \nu f(X)$. Together with the inclusion and [@RW98 Exercise 10.10], $$\label{inclusion1}
   0\in \{0\}\times\nu\partial f(\overline{X})+\mathcal{N}_{{\rm gph}\,\mathcal{N}_{\mathbb{B}}}(\overline{W},\overline{X})+\{0\}\times\mathcal{N}_{\Omega}(\overline{X})
      +\partial(\widehat{\Phi}\circ\sigma)(\overline{W})\times \{0\}$$ which is equivalent to saying that there exists $(-\Delta W,\Delta X)\in\mathcal{N}_{{\rm gph}\,\mathcal{N}_{\mathbb{B}}}(\overline{W},\overline{X})$ such that $$\left\{\begin{array}{l}
           0\in \partial(\widehat{\Phi}\circ\sigma)(\overline{W}) -\Delta W\\
           0\in \nu\partial f(\overline{X})+\Delta X +\mathcal{N}_{\Omega}(\overline{X}).
          \end{array}\right.$$ Notice that $(-\Delta W,\Delta X)\in\mathcal{N}_{{\rm gph}\,\mathcal{N}_{\mathbb{B}}}(\overline{W},\overline{X})$ if and only if $\Delta X\in D^*\partial\|\cdot\|_*(\overline{X}|\overline{W})(\Delta W)$. So, equation is equivalent to saying that there exists $\Delta W\in\partial(\widehat{\Phi}\circ\sigma)(\overline{W})$ such that $$0\in\nu\partial f(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})
   +D^*\partial\|\cdot\|_*(\overline{X}|\overline{W})(\Delta W).$$ In addition, notice that $\overline{X}\in\mathcal{N}_{\mathbb{B}}(\overline{W})$ which is equivalent to $\partial\|\cdot\|_*(\overline{X})$ by . Thus, by Definition \[Def-Mspc\], $\overline{X}$ is an M-stationary point of the problem associated to $\phi$. The second part is a direct consequence of Theorem \[prop-MWrelation\]. The proof is completed.

\[optimality-Mspc\] [**(i)**]{} If $\Omega=\mathbb{R}^{m\times n}$, the inclusion automatically holds. If $\Omega\subset\mathbb{R}^{m\times n}$, by [@Ioffe08 Page 211] the inclusion is implied by the calmness of the following multifunction $$\label{HuaM}
  \mathcal{M}(Y_1,Y_2):=\Big\{(W,X)\in\mathbb{R}^{m\times n}\times\Omega\ |\
   (W,X)\in{\rm gph}\,\mathcal{N}_{\mathbb{B}}-(Y_1,Y_2)\Big\}.$$ at the origin for $(\overline{W},\overline{X})$, where $(\overline{W},\overline{X})$ is an arbitrary feasible point of the MPEC .

[**(ii)**]{} When $\Omega\subseteq\mathbb{S}^n_+$, together with and the Lipschitz continuity of $\widehat{\Phi}\circ \sigma$ in $\mathbb{B}$, in order to achieve the conclusion of Proposition \[necess1\], we need to replace the inclusion by $$\mathcal{N}_{C}(\overline{W},\overline{X})
   \subseteq \mathcal{N}_{{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^n}}(\overline{X},\overline{W}\!-I)
   +\mathcal{N}_{\mathbb{S}_{+}^n}(\overline{W})\times\mathcal{N}_{\Omega}(\overline{X})$$ where $C:=\{(W,X)\in\mathbb{S}_{+}^n\times\Omega\ |\ (X,W-I)\in{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^n}\}$. By invoking [@Ioffe08 Page 211], this inclusion is implied by the calmness of the following multifunction $$\begin{aligned}
\label{HuaM2}
  \mathcal{M}(Y_1,Y_2):=\Big\{(W,X)\in \mathbb{S}_{+}^n\times  \Omega\,|\,
  (X,W-I)\in {\rm gph}\mathcal{N}_{\mathbb{S}^n_+}-(Y_1,Y_2)\Big\}
 \end{aligned}$$ at the origin for $(\overline{W},\overline{X})$, where $(\overline{W},\overline{X})$ is an arbitrary feasible point of the MPEC . By the definition of calmness, it is easy to check that the calmness of $\mathcal{M}$ at the origin for $(\overline{W},\overline{X})$ is implied by that of $\mathcal{\widetilde{M}}$ in with $\Omega_x=\Omega$ and $\Omega_y=\mathbb{S}_{+}^n$ at the corresponding point, while by Theorem \[DireNorm\] the latter holds if for any $0\ne H=(H_1;H_2)\in\!\mathcal{T}_{\Omega}(\overline{X})
 \times\mathcal{T}_{\mathbb{S}^n_+}(\overline{W})$ such that $
    (H_1,H_2) \in\!\mathcal{T}_{{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}}(\overline{X},\overline{W}-I),
 $ the following implication relation holds: $$\begin{aligned}
\label{DireInclusion0}
 \left.\begin{array}{r}
 \Gamma_1\in-\mathcal{N}_{\Omega}(\overline{X};H_1), \ \ \Gamma_2\in -\mathcal{N}_{\mathbb{S}^n_+}(\overline{W};H_2)\\
 (\Gamma_1,\Gamma_2)\in
 \mathcal{N}_{{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}}((\overline{X},\overline{W}-I);( H_1,H_2))
 \end{array}\right\}\Longrightarrow
 \left(\begin{matrix}
  \Gamma_1\\ \Gamma_2
  \end{matrix}\right)=0.
 \end{aligned}$$ For the characterization of $\mathcal{N}_{{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}}((\overline{X},\overline{W}-I);( H_1,H_2))$, please refer to Appendix.

EP-stationary points {#subsec3.2}
--------------------

By the definition of the function $\widehat{\Psi}$, clearly, the problem can be compactly written as $$\begin{aligned}
\label{rankreg-penalty1}
   &\min_{X,W\in\mathbb{R}^{m\times n}}\!\Big\{\nu f(X)+\delta_{\Omega}(X)+\widehat{\Psi}(\sigma(W))
   +\rho(\|X\|_*\!-\langle W,X\rangle)\Big\}.
  \end{aligned}$$ Based on this equivalent reformulation, we introduce the following stationary point.

\[EP-spc\] A matrix $\overline{X}\in\mathbb{R}^{m\times n}$ is said to be an EP-stationary point of the problem associated to $\phi\in\!\mathscr{L}$ if there exist a constant $\rho>0$ and $\overline{W}\!\in\mathbb{B}$ such that $$\label{EP-equa}
     \rho \overline{X}\in\partial(\widehat{\Psi}\circ\sigma)(\overline{W})\ \ {\rm and}\ \
     0\in \nu\partial\!f(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})
     +\rho\big[\partial\|\cdot\|_*(\overline{X})-\overline{W}\big].$$

By the given assumption on $f$ and the Lipschitz continuity of $\widehat{\Phi}\circ\sigma$ in $\mathbb{B}$, if $(\overline{X},\overline{W})$ is a limiting critical point of the objective function of , it is an EP-stationary point of . Thus, every local optimal solution of is an EP-stationary point of .

The following proposition characterizes a key property of the EP-stationary point.

\[prop-EPspc\] Suppose that $\overline{X}\in\mathbb{R}^{m\times n}$ is an EP-stationary point of associated to $\phi\in\!\mathscr{L}$. Then, there exist $\overline{W}\in\mathbb{B}$ and $(\overline{U},\overline{V})
  \in\mathbb{O}^{m,n}(\overline{W})\cap\mathbb{O}^{m,n}(\overline{X})$ such that ${\rm rank}(\overline{X})\ge |\{i\ |\ \sigma_i(\overline{W})>t^*\}|$, and there exists $\Delta\Gamma\in\nu\partial\!f(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})$ such that $$\label{EP-detaX}
    \Delta\Gamma\in\!\left\{\overline{U}\left[\begin{matrix}
                            0 & 0\\
                             0 & \rho Z
                   \end{matrix}\right]\overline{V}^{\mathbb{T}} |\,
    Z\in\mathbb{R}^{(m-|\theta_1|)\times(n-|\theta_1|)}\ {\rm with}\
    \theta_1\!=\{i\ |\,\sigma_i(\overline{W})=1\},\|Z\|\!<1\right\}.$$

Since $\overline{X}$ is an EP-stationary point of the problem , there exist a constant $\rho>0$ and a matrix $\overline{W}\in\mathbb{B}$ such that the inclusions in hold. Define the index sets $$\theta_2:=\big\{i\ |\ \sigma_i(\overline{W})\in(0,1)\big\}\ \ {\rm and}\ \
    \theta_0:=\big\{i\ |\ \sigma_i(\overline{W})=0\big\}.$$ Since $\rho\overline{X}\in\partial(\widehat{\Psi}\circ\sigma)(\overline{W})$, by [@Lewis95 Corollary 2.5] there exists $(\overline{U},\overline{V})\!\in\!\mathbb{O}^{m,n}(\overline{W})$ such that $$\rho\overline{X}=\overline{U}\big[{\rm Diag}(\sigma(\overline{X}))\ \ 0\big]\overline{V}^{\mathbb{T}}
   \ \ {\rm and}\ \ \sigma(\overline{X})\in\partial \widehat{\Phi}(\sigma(\overline{W})).$$ Notice that $\sigma_1(X)\ge\cdots\ge\sigma_m(X)$ with $\sigma_i(X)\in\partial\psi(1)$ for $i\in\theta_1$, $\sigma_i(X)\in\partial\psi(\sigma_i(\overline{W}))$ for $i\in\theta_2$ and $\sigma_i(X)\in\partial\widehat{\psi}(0)$ for $i\in\theta_0$. Since $\partial\psi(t)\subset(0,+\infty)$ for any $t>t^*$, we have ${\rm rank}(\overline{X})\ge |\{i\ |\ \sigma_i(\overline{W})>t^*\}|$, and the first part follows. Since $(\overline{X},\overline{W})$ satisfies the second inclusion of , there exist $\Delta\Gamma\in\nu\partial f(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})$ such that $-\Delta\Gamma\in\rho[\partial\|\cdot\|_*(\overline{X})-\overline{W}]$. Write $\overline{r}={\rm rank}(\overline{X})$. From the SVD of $\overline{X}$ in the last equation and equation , we have $$\partial\|\cdot\|_*(\overline{X})
    =\Big\{\overline{U}_1\overline{V}_1^{\mathbb{T}}+\overline{U}_2\Gamma\overline{V}_2^{\mathbb{T}}\ |\
    \|\Gamma\|\le 1,\Gamma\in\mathbb{R}^{(m-\overline{r})\times(n-\overline{r})}\Big\},$$ where $\overline{U}_1$ and $\overline{V}_1$ are the matrix consisting of the first $\overline{r}$ columns of $\overline{U}$ and $\overline{V}$, respectively, and $\overline{U}_2$ and $\overline{V}_2$ are the matrices consisting of the last $m-\overline{r}$ and $n-\overline{r}$ columns of $\overline{U}$ and $\overline{V}$, respectively. Together with $-\Delta\Gamma\in\rho[\partial\|\cdot\|_*(\overline{X})-\overline{W}]$ and $\overline{W}=\overline{U}[{\rm Diag}(\sigma(\overline{W}))\ \ 0]\overline{V}^{\mathbb{T}}$, the inclusion in holds. In fact, the matrix $Z$ in the set of has the following form $$\left[\begin{matrix}
            {\rm Diag}(e_{\overline{r}-|\theta_1|}) & 0\\
                     0 & \Gamma
       \end{matrix}\right]-
       \left[\begin{matrix}
            {\rm Diag}(\sigma_{\theta_2'}(\overline{W})) & 0\\
                     0 &  {\rm Diag}(\sigma_{\theta_0}(\overline{W}))
       \end{matrix}\right]$$ for some $\Gamma\in\mathbb{R}^{(m-\overline{r})\times(n-\overline{r})}$ with $\|\Gamma\|\le 1$, where $\theta_2':=\{i\in\theta_2\ |\ \sigma_i(\overline{W})\le t^*\}$.

\[remark-EP\] If $\overline{X}$ is an EP-stationary point of and the associated $\overline{W}\in\mathbb{B}$ is such that $|\theta_1|={\rm rank}(\overline{X})$, then by Definition \[Def-Rspc\] and [@Le13 Theorem 4] $\overline{X}$ is a R-stationary point of . However, when $\overline{X}$ is a R-stationary point, it is not necessarily EP-stationary.

DC-stationary point {#sec3.3}
-------------------

With the conjugate $\widehat{\Psi}^*$ of $\widehat{\Psi}$, the surrogate problem can be equivalently written as $$\label{Lip-surrogate}
    \min_{X\in\mathbb{R}^{m\times n}}\!\Big\{\nu f(X)+\delta_{\Omega}(X)+\rho\|X\|_*-\widehat{\Psi}^*(\rho\sigma(X))\Big\}.$$ By [@Lewis95 Lemma 2.3], we know that $\widehat{\Psi}^*$ is also absolutely symmetric. Along with its lsc and convexity, from [@Lewis95 Corollary 2.6] it follows that $\widehat{\Psi}^*\circ \sigma$ is an absolutely symmetric convex function on $\mathbb{R}^m$. Thus, $\delta_{\Omega}(X)+\rho\|X\|_*-(\widehat{\Psi}^*\circ\sigma)(\rho X)$ is a DC function on $\mathbb{R}^{m\times n}$. In view of this, we present the following DC-stationary point by the reformulation .

\[Def-LSspc\] A matrix $\overline{X}\in\mathbb{R}^{m\times n}$ is called a DC-stationary point of the problem associated to $\phi\in\!\mathscr{L}$ if there exists a constant $\rho>0$ such that $$\label{DC-equa}
     0\in \nu \partial f(\overline{X})+\mathcal{N}_{\Omega}(\overline{X})
       +\rho\partial\|\cdot\|_*(\overline{X})
      -\rho\partial(\widehat{\Psi}^*\circ \sigma)(\rho\overline{X}).$$

When $f$ is convex, the problem is a DC program, and now $\overline{X}\in\mathbb{R}^{m\times n}$ is a DC-stationary point if and only if it is a critical point of the objective function of defined by Pang et al.[@PangMOR17]. It is worthwhile to point out that the limiting critical point of the objective function of is a DC-stationary point, but the converse does not hold. For the discussion on the DC-stationary point, the reader may refer to [@PangMOR17]. Here, we focus on the relation between the DC-stationary point and the EP-stationary point.

\[prop-LSspc\] Let $\overline{X}$ be a DC-stationary point of associated to $\phi\in\!\mathscr{L}$. Suppose that $$\label{cond1-phi}
    \partial\psi(0)=\partial\widehat{\psi}(0)\ {\rm and}\
    \widehat{\psi}^*\ {\rm is\ differentiable\ on}\ \mathbb{R}_{+}\ {\rm with}\
    (\psi^*)'(0)=(\widehat{\psi}^*)'(0).$$ Then $\overline{X}$ is an EP-stationary point. Conversely, if $\overline{X}$ is an EP-stationary point associated to $\phi\in\Phi$ with $\phi$ nondecreasing on $[0,1]$, then $\overline{X}$ is necessarily a DC-stationary point.

From the symmetry of $\widehat{\psi}$, it follows that $\widehat{\psi}^*(s)=\psi^*(|s|)$ for any $s\in\mathbb{R}$. Together with the given assumption, we have $(\widehat{\psi}^*)'(s)=(\psi^*)'(s)$ for any $s\ge 0$. By the differentiability of $\widehat{\psi}^*$ on $\mathbb{R}_{+}$, clearly, $\widehat{\Psi}^*$ is differentiable on $\mathbb{R}_{+}^m$. Along with its absolute symmetry and convexity, from [@Lewis95 Theorem 3.1] it follows that $\widehat{\Psi}^*\circ \sigma$ is differentiable in $\mathbb{R}^{m\times n}$, and consequently $
     \partial(\widehat{\Psi}^*\circ\sigma)(\rho\overline{X})
     =\{\nabla(\widehat{\Psi}^*\circ\sigma)(\rho\overline{X})\}.
   $ Since $\overline{X}$ is a DC-stationary point of , there exists a constant $\rho>0$ such that holds. Take $(\overline{U},\overline{V})\in\!\mathbb{O}^{m,n}(\overline{X})$. Let $$\overline{W}\!:=\overline{U}[{\rm Diag}(\overline{w})\ \ 0]\overline{V}^{\mathbb{T}}
     \ \ {\rm with}\ \ \overline{w}_i=(\psi^*)'(\rho\sigma_i(\overline{X}))
     \ \ {\rm for}\ i=1,2,\ldots,m.$$ Since $\psi$ is a closed proper convex function, we have ${\rm range}\,\partial\psi^*\subseteq{\rm dom}\psi=[0,1]$ by [@Roc70 Section 23], which implies that $\overline{w}_i\in[0,1]$ for $i=1,\ldots,m$ and consequently $\|\overline{W}\|\le1$. Combining $\overline{w}_i=(\psi^*)'(\rho\sigma_i(\overline{X}))$ with [@Roc70 Corollary 23.5.1], we obtain $$\rho\sigma_i(\overline{X})\in\partial\psi(\overline{w}_i)\subseteq\partial\widehat{\psi}(\overline{w}_i)
    \ \ {\rm for}\ \ i=1,2,\ldots,m,$$ where the second inclusion is due to $\overline{w}_i\in[0,1]$ and $\partial\psi(0)=\partial\widehat{\psi}(0)$. By the definition of $\widehat{\Psi}$, it is not hard to obtain $\rho\overline{X}\in\partial(\widehat{\Psi}\circ\sigma)(\overline{W})$. Thus, by Definition \[EP-spc\] and , to achieve the first part we only need to argue that $\overline{W}=\nabla(\widehat{\Psi}^*\circ\sigma)(\rho\overline{X})$. Recall that $\overline{w}_i\in(\psi^*)'(\rho\sigma_i(\overline{X}))$ for each $i$ and $(\psi^*)'(s)=(\widehat{\psi}^*)'(s)$ for all $s\ge 0$, we have $\overline{w}_i=(\widehat{\psi}^*)'(\rho\sigma_i(\overline{X}))$ for each $i$. This along with the expression of $\widehat{\Psi}^*$ means that $\overline{W}=\nabla(\widehat{\Psi}^*\circ\sigma)(\rho\overline{X})$.

Now suppose $\overline{X}$ is a EP-stationary point associated to $\phi\in\!\mathscr{L}$ with $\phi$ nondecreasing on $[0,1]$. Then, there exist $\rho>0$ and $\overline{W}\in\mathbb{B}$ such that the inclusions in hold. Notice that $\psi$ is nondecreasing and convex. Hence, $\widehat{\psi}$ is convex. Together with its absolute symmetry and convexity, it follows that $\widehat{\Psi}$ is absolutely symmetric and convex. From [@Lewis95 Corollary 2.5] it follows that $\widehat{\Psi}\circ\sigma$ is convex over $\mathbb{R}^{m\times n}$. From $\rho\overline{X}\in\partial(\widehat{\Psi}\circ\sigma)(\overline{W})$, we get $\overline{W}\in\partial(\widehat{\Psi}\circ\sigma)^*(\rho\overline{X})$. By the von Neumman trace inequality, it is easy to check that $(\widehat{\Psi}\circ\sigma)^*=\widehat{\Psi}^*\circ\sigma$, and then $\overline{W}\in\partial(\widehat{\Psi}^*\circ\sigma)(\rho\overline{X})$. Together with the second inclusion in and Definition \[Def-LSspc\], we conclude that $\overline{X}$ is a DC-stationary point of .

To sum up the previous discussions, we obtain the relations as shown in Figure 1, where $\theta_1$ is the index set defined as in and $\mathscr{L}_2$ denotes the family of those $\phi\in\!\mathscr{L}$ that is nondecreasing on $[0,1]$. We see that the set of R-stationary points is almost same as that of M-stationary points and includes that of EP-stationary points under the rank condition $|\theta_1|={\rm rank}(\overline{X})$, while for some $\phi$ the set of EP-stationary points coincides with that of DC-stationary points, for example, the following special $\phi$.

Let $\phi(t)=\frac{a-1}{a+1}t^2+\frac{2}{a+1}t\ (a>1)$ for $t\in \mathbb{R}$. Clearly, $\phi\in\!\mathscr{L}_1\cap\mathscr{L}_2$. Also, $$\psi(t)=\left\{\!\begin{array}{cl}
                      \frac{a-1}{a+1}t^2+\frac{2}{a+1}t &{\rm if}\ 0\leq t\le 1\\
                       \infty & {\rm otherwise}
                \end{array}\right.{\rm and}\
  \widehat{\psi}(t)=\left\{\!\begin{array}{cl}
                      \frac{a-1}{a+1}t^2+\frac{2}{a+1}t &{\rm if}\  0\leq t\leq 1,\\
                      \frac{a-1}{a+1}t^2-\frac{2}{a+1}t &{\rm if}\ -1\leq t\le 0,\\
                       \infty & {\rm otherwise}.
                \end{array}\right.$$ After an elementary calculation, the conjugate $\psi^*$ and $\widehat{\psi}^*$ of $\psi$ and $\widehat{\psi}$ take the form of $$\psi^*(\omega)=\left\{\!\begin{array}{cl}
                      0 & \textrm{if}\ \omega\leq \frac{2}{a+1},\\
                       \frac{((a+1)\omega-2)^2}{4(a^2-1)}& \textrm{if}\ \frac{2}{a+1}<\omega\le \frac{2a}{a+1},\\
                      \omega-1 & \textrm{if}\ \omega>\frac{2a}{a+1}.
                \end{array}\right.\ {\rm and}\ \
    \widehat{\psi}^*(\omega)=\psi^*(|\omega|).$$ It is easy to check that $\phi$ satisfies the conditions in and is nondecreasing in $[0,1]$.

![image](ff.jpg){width="95.00000%"}

M-stationary point of MPSCCC {#sec4}
============================

In Section \[sec3.1\], the MPEC is the key to characterize the M-stationary point of . When $\Omega\subseteq\mathbb{S}_{+}^n$, it corresponds to which is a special case of the following MPSCCC $$\begin{aligned}
\label{MPSDCC}
  &\min\limits_{x\in\Omega_x,y\in\Omega_y}\varphi(x,y)\nonumber\\
  &\quad\ {\rm s.t.}\ (f(x,y),g(x,y))\in {\rm gph}\mathcal{N}_{\mathbb{S}^n_+},
 \end{aligned}$$ where $\Omega_x\subseteq\mathbb{X}$ and $\Omega_y\subseteq\mathbb{Y}$ are the closed sets, $\varphi\!:\mathbb{X}\times\mathbb{Y}\to \mathbb{R}$ and $f,g\!:\mathbb{X}\times \mathbb{Y} \to \mathbb{S}^n$ are smooth functions. For this class of problems, since the Robinson CQ does not hold, it is common to seek an M-stationary point which is weaker than the classical KKT point (also called the strong stationary point). In this section, we shall provide a weaker condition for a local minimizer of to be the M-stationary point. For this purpose, we need the multifunction $\mathcal{\widetilde{M}}\!:\mathbb{X}\times \mathbb{Y}\times\mathbb{S}^n\times\mathbb{S}^n
 \rightrightarrows \mathbb{X}\times \mathbb{Y}$ defined as follows: $$\begin{aligned}
\label{Mdefinity}
  \mathcal{\widetilde{M}}(u,v,\xi,\eta):=\Big\{(x,y)\in \mathbb{X}\times \mathbb{Y}\ |\
  u\in -x+ \Omega_{x},v\in -y+ \Omega_{y}, \nonumber\\
  \qquad(\xi,\eta)\in -(f(x,y),g(x,y))+{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}\Big\}.
 \end{aligned}$$ By [@DingSY14 Proposition 2.1 and Theorem 2.1], it is immediate to have the following result.

\[theorem41\] Let $(\overline{x},\overline{y})$ be a local minimizer of . If the perturbed mapping $\mathcal{\widetilde{M}}$ is calm at the origin for $(\overline{x},\overline{y})$, then $(\overline{x},\overline{y})$ is an M-stationary point of the problem .

By [@GK16 Corollary 1], one may achieve the calmness of $\widetilde{M}$ at the origin for $(\overline{x},\overline{y})$ by the directional limiting normal cone to ${\rm gph}\mathcal{N}_{\mathbb{S}^n_+}$. That is, the following result holds.

\[DireNorm\] Consider an arbitrary $(\overline{x},\overline{y})\in \mathcal{\widetilde{M}}(0,0,0,0)$. If for any $0\ne w=(w_1;w_2)\in\!\mathcal{T}_{\Omega_{x}}(\overline{x})
 \times\mathcal{T}_{\Omega_{y}}(\overline{y})$ such that $
   \left(\begin{matrix}f'(\overline{x},\overline{y})\\
   g'(\overline{x},\overline{y})\end{matrix}\right)w
  \in\!\mathcal{T}_{{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}}(f(\overline{x},\overline{y}),g(\overline{x},\overline{y})),
 $ the implication holds: $$\begin{aligned}
\label{DireInclusion}
 \left.\begin{array}{r}
 d_1\in\mathcal{N}_{\Omega_{x}}(\overline{x};w_1),\,
 d_1+\nabla_{x} f(\overline{x},\overline{y})\Lambda+\nabla_{x} g(\overline{x},\overline{y})\Delta=0  \\
  d_2\in\mathcal{N}_{\Omega_{y}}(\overline{y};w_2),\,
 d_2+\nabla_{y} f(\overline{x},\overline{y})\Lambda+\nabla_{y}g(\overline{x},\overline{y})\Delta =0\\
  \widetilde{w}=( f _x'(\overline{x},\overline{y})w_1+f_{y}'(\overline{x},\overline{y})w_2,
  g_x'(\overline{x},\overline{y})w_1+g_{y}'(\overline{x},\overline{y})w_2)\\
 (\Lambda,\Delta)\in\mathcal{N}_{{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}}((f(\overline{x},\overline{y}),g(\overline{x},\overline{y}));\widetilde{w})
 \end{array}\right\}\Longrightarrow
 \left(\begin{matrix}
  d_1\\ d_2\\ \Lambda\\ \Delta
  \end{matrix}\right)=0,
 \end{aligned}$$ then the multifunction $\widetilde{M}$ is calm at the origin for $(\overline{x},\overline{y})$.

\[PSDremark\] [**(i)**]{} Notice that $(\Delta x, \Delta y)\in D\mathcal{\widetilde{M}}((0,0,0,0)|(\overline{x},\overline{y}))
 (\Delta u,\Delta v,\Delta \xi, \Delta \eta)$ iff

\[M-tagent1\] \_1:=f\_x’(,)x+f\_[y]{}’(,)y+,\
\_2:=g\_x’(,)x+g\_[y]{}’(,)y+,\
u+x\_[\_x]{}(), v+y\_[\_y]{}(),\
\_2D\_[\^n\_+]{}(f(,)|g(,))(\_1).

Together with Lemma \[chara-icalm\], there is no nonzero $ w=(w_1;w_2)\in
 (\mathcal{T}_{\Omega_{x}}(\overline{x})\times\mathcal{T}_{\Omega_{y}}(\overline{y}))$ such that $
   \left(\begin{matrix}f'(\overline{x},\overline{y})\\
   g'(\overline{x},\overline{y})\end{matrix}\right)w
  \in \mathcal{T}_{{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}}(f(\overline{x},\overline{y}),g(\overline{x},\overline{y}))
 $ if and only if $\mathcal{\widetilde{M}}$ is isolated calmness at the origin for $(\overline{x},\overline{y})$. Thus, Theorem \[DireNorm\] is stating that if $\mathcal{\widetilde{M}}$ is not isolated calm and the implication in holds, then $\mathcal{\widetilde{M}}$ is necessarily calm at the origin for $(\overline{x},\overline{y})$.

[**(ii)**]{} Notice that $(\Delta u,\Delta v,\Delta \xi, \Delta \eta)\in D^*\mathcal{\widetilde{M}}((\overline{x},\overline{y})|(0,0,0,0))
 (-\Delta x, -\Delta y)$ if and only if

\[M-normal1\] x\_x f(,)+\_[x]{} g(,)+u,  u\_[\_[x]{}]{}(),\
\[M-normal2\] y\_y f(,)+\_[y]{} g(,)+v,  v\_[\_[y]{}]{}(),\
\[M-normal3\] D\^\*\_[\^n\_+]{}(f(,)|g(,))(-).

Together with Lemma \[chara-Aubin\], the Aubin property of $\mathcal{\widetilde{M}}$ is equivalent to the implication $$\begin{aligned}
\label{AubinInclusion}
 \left.\begin{array}{r}
 0\in \nabla_x f(\overline{x},\overline{y})\Delta \xi+\nabla_{x} g(\overline{x},\overline{y})\Delta \eta
 +\Delta u\\
 0\in  \nabla_y f(\overline{x},\overline{y})\Delta \xi+\nabla_{y} g(\overline{x},\overline{y})\Delta \eta
 +\Delta v\\
 \Delta u\in \mathcal{N}_{\Omega_{x}}(\overline{x}), \Delta v\in \mathcal{N}_{\Omega_{y}}(\overline{y}) \\
 (\Delta\xi,\Delta \eta)\in \mathcal{N}_{{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}}(f(\overline{x},\overline{y}),g(\overline{x},\overline{y}))
 \end{array}
\right\}\Longrightarrow (\Delta u, \Delta v,\Delta \xi, \Delta \eta)=0.\end{aligned}$$ Since $\mathcal{N}_{{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}}((f(\overline{x},\overline{y}),g(\overline{x},\overline{y}));(d_1,d_2))
 \subset\!\mathcal{N}_{{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}}(f(\overline{x},\overline{y}),g(\overline{x},\overline{y}))$ for $(d_1,d_2)\in\!\mathbb{S}^n\times \mathbb{S}^n$, the implication in is weaker than the one in which is precisely the M-stationary point condition given in [@DingSY14 Theorem 6.1(i)]. For the characterization of the directional normal cone $\mathcal{N}_{{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}}((f(\overline{x},\overline{y}),g(\overline{x},\overline{y}));(d_1,d_2))$, the reader refers to Appendix.

To close this section, we illustrate Theorem \[DireNorm\] by the following special example $$\begin{aligned}
\label{example}
  &\min\limits_{x\in\mathbb{R}^3,y\in\mathbb{R}^3}\|x\|^2+\|y\|^3\nonumber\\
  &\quad\ {\rm s.t.}\ \ (\mathcal{A}(x)+C,\mathcal{A}(y)+D)\in {\rm gph}\mathcal{N}_{\mathbb{S}_{+}^3},
 \end{aligned}$$ where $C={\rm Diag}(1,0,0)$, $D={\rm Diag}(0,0,-1)$, and $\mathcal{A}\!:\mathbb{R}^3\to\mathbb{S}^3$ is the linear mapping $$\mathcal{A}(x):=\left(\begin{matrix}
                        x_1 & x_3 & x_2\\
                       x_3 & x_2 & x_1\\
                        x_2 & x_1 & x_3
                       \end{matrix}\right)\quad\ \forall x\in\mathbb{R}^3.$$ Consider $\overline{x}=(0,0,0)^{\mathbb{T}}$ and $\overline{y}=(0,0,0)^{\mathbb{T}}$. Write $X:=f(\overline{x},\overline{y})$ and $Y:=g(\overline{x},\overline{y})$. Clearly, $(X,Y)=(C,D)\in {\rm gph}\mathbb{S}_{+}^3$. Moreover, the index sets $\alpha,\beta$ and $\gamma$ defined by with $A=X+Y$ satisfy $\alpha=\{1\}, \beta=\{2\}$ and $\gamma=\{3\}.$ Fix an arbitrary $0\ne w=(w_1;w_2)\in\mathbb{R}^3\times \mathbb{R}^3$ with $w_1=(w_{11},w_{12},w_{13})^{\mathbb{T}}$ and $w_2=(w_{21},w_{22},w_{23})^{\mathbb{T}}$ such that $(G,H)\in\!\mathcal{T}_{{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}}(f(\overline{x},\overline{y}),
 g(\overline{x},\overline{y}))$, where $G=f_x'(\overline{x},\overline{y})w_1+f_{y}'(\overline{x},\overline{y})w_2$ and $H=g_x'(\overline{x},\overline{y})w_1+g_{y}'(\overline{x},\overline{y})w_2$. Since $(G,H)\in\!\mathcal{T}_{{\rm gph}\mathcal{N}_{\mathbb{S}^n_+}}(f(\overline{x},\overline{y}),
 g(\overline{x},\overline{y}))$, by the expressions of $f$ and $g$ it is not hard to obtain $$G=\left(\begin{matrix}
    0 & 0& w_{12}\\
   0&w_{12}&0 \\
   w_{12} & 0 &0\end{matrix}\right)\ \ {\rm and}\ \
   H= \left(\begin{matrix}
   0 & 0 & w_{22}\\
   0& w_{22} &0 \\
  w_{22} & 0 & 0
  \end{matrix}\right).$$ with $0\leq w_{12}\perp w_{22}\leq 0$ and $w_{12}+w_{22}\neq 0$. Then $B:=\!P_{\beta}^{\mathbb{T}}(G\!+\!H)P_{\beta}=w_{12}+w_{22}$. Let $(d_1,d_2)\in\mathbb{R}^3\times\mathbb{R}^3$ and $(\Lambda,\Delta)\in\mathbb{S}^3\times\mathbb{S}^3$ satisfy the conditions on the left hand side of . Since $\Omega_{x}=\Omega_{y}=\mathbb{R}^3$, we have $(d_1,d_2)=0$. Thus, $$\begin{aligned}
\label{temp-equa31}
   &\nabla_{x} f(\overline{x},\overline{y})\Lambda+\nabla_{x} g(\overline{x},\overline{y})\Delta
   =\left(\begin{matrix}
             \Lambda_{11}+2\Lambda_{23}\\
              \Lambda_{22}+2\Lambda_{13}\\
               2\Lambda_{12}+\Lambda_{33}
        \end{matrix}\right)=0,\\
 \label{temp-equa32}
   &\nabla_{y} f(\overline{x},\overline{y})\Lambda+\nabla_{y}g(\overline{x},\overline{y})\Delta
   =\left(\begin{matrix}
        \Delta_{11}+2\Delta_{23}\\
                    \Delta_{22}+2\Delta_{13}\\
                    2\Delta_{12}+\Delta_{33}
                  \end{matrix}\right)=0.
 \end{aligned}$$

[**Case 1: $w_{12}>0$.**]{} Now we have $w_{22}=0$, and the index sets $\pi,\delta$ and $\nu$ defined by with $B$ satisfy $\pi=\{1\},\delta=\emptyset$ and $\nu=\emptyset$. From Theorem \[cc-coderivate\] in Appendix, it follows that $(\Lambda,\Delta)\in\!\mathcal{N}_{{\rm gph}\mathcal{N}_{\mathbb{S}_{+}^3}}((X,Y);(G,H))$ if and only if $$\Lambda=\left(\begin{matrix}
   0 & 0& \Lambda_{13}\\
   0&0&\Lambda_{23} \\
   \Lambda_{13}&\Lambda_{23}&\Lambda_{33}
   \end{matrix}\right)\ \ {\rm and}\ \
   \Delta=\left(\begin{matrix}
   \Delta_{11} & \Delta_{12}& \Delta_{13}\\
   \Delta_{12}&\Delta_{22}&0 \\
   \Delta_{13}&0&0
   \end{matrix}\right)\ {\rm with}\ \Lambda_{13}+\Delta_{13}=0.$$ Together with and , we get $\Lambda=0$ and $\Delta=0$. Thus, $(d_1,d_2,\Lambda,\Delta)=(0,0,0,0)$.

[**Case 2: $w_{12}=0$.**]{} Now we have $w_{22}<0$, and consequently the index sets $\pi,\delta$ and $\nu$ defined by with $B$ satisfy $\pi=\emptyset,\delta=\emptyset$ and $\nu=\{1\}$. From Theorem \[cc-coderivate\] in Appendix, it follows that $(\Lambda,\Delta)\in\!\mathcal{N}_{{\rm gph}\mathcal{N}_{\mathbb{S}_{+}^3}}((X,Y);(G,H))$ if and only if $$\Lambda=\left(\begin{matrix}
   0 & 0& \Lambda_{13}\\
   0&\Lambda_{22}&\Lambda_{23} \\
   \Lambda_{13}&\Lambda_{23}&\Lambda_{33}
   \end{matrix}\right)\ \ {\rm and}\ \
   \Delta=\left(\begin{matrix}
   \Delta_{11} & \Delta_{12}& \Delta_{13}\\
   \Delta_{12}&0&0 \\
   \Delta_{13}&0&0
   \end{matrix}\right)\ {\rm with}\ \Lambda_{13}+\Delta_{13}=0.$$ Together with and , we get $\Lambda=0$ and $\Delta=0$. Thus, $(d_1,d_2,\Lambda,\Delta)=(0,0,0,0)$.

The above arguments show that the implication holds, and then the condition in Theorem \[DireNorm\] is satisfied. Thus, the global minimizer $(\overline{x},\overline{y})$ is a M-stationary point of , but by [@DingSY14 Theorem 6.1(i)] we can not judge whether $(\overline{x},\overline{y})$ is a M-stationary or not.

[**Acknowledgement**]{} This work is supported by the National Natural Science Foundation of China under project No.11571120 and No.11701186.

[1]{}

, [*Multistage convex relaxation approach to rank regularized minimizataion problems based on equivalent mathematical program with a generalized complementarity constraint*]{}, SIAM Journal on Control and Optimization, 55(2017): 2493-2518.

, [*Mathematical programs with cardinality constraints: reformulation by complementarity-type conditions and a regularization method*]{}, SIAM Journal of Optimization, 26(2016): 397-425.

, [*An overview of low-rank matrix recovery from incomplete observations*]{}, IEEE Journal of Selected Topics in Signal Processing, 10(2016): 608-622.

, [*An introduction to a class of matrix cone programming*]{}, Mathematical Programming, 144(2014): 141-179.

, [*First order optimality conditions for mathematical programs with semidefinite cone complementarity constraints*]{}, Mathematical Programming, 144(2014): 141-179.

, [*Implicit Functions and Solution Mappings*]{}, Springer Monographs in Mathematics, LLC, New York, 2009.

, [*Matrix Rank Minimization with Applications*]{}, Stanford University, PhD thesis, 2002.

, [*Log-det heuirstic for matrix rank minimization with applications to Hankel and Euclidean distance matrices*]{}, American Control Conference, 2003. Proceedings of the 2003, 3: 2156-2162.

, [*Hankel matrix rank minimization with applications to system identification and realization*]{}, SIAM Journal on Matrix Analysis, 34(2013): 946-977.

, [*On M-stationary points for mathematical programs with equilibrium constraints*]{}, Journal of Mathematical Analysis and Applications, 310(2005): 286-302.

, [*Lipschitz and Holder stability of optimization problems and generalized equations*]{}, Mathematical Programming, 158(2016): 35-75.

, [*Recovering low-rank matrices from few coefficients in any basis*]{}, IEEE Transactions on Information Theory, 57(2011): 1548-1566.

, [*On metric and calmness qualification conditions in subdifferential calculus*]{}, Set-Valued Analysis, 16(2008): 199–227.

, [*Sensitivity analysis for nonsmooth generalized equations*]{}, Mathematical Programming, 55(1992): 193-212. , [*Improved iteratively reweighted least squares for unconstrained smoothed $\ell_q$ minimization*]{}, SIAM Journal on Numerical Analysis, 51 (2013): 927-957.

, [*On eigenvalues of matrices dependent on a parameter*]{}, Numerische Mathematik, 6(1964): 377-387.

, [*Generalized subdifferentials of the rank function*]{}, Optimization Letters, 7(2013):731-743.

, [*Implicit multifunction theorems for the sensitivity analysis of variational conditions*]{}, Mathematical Programming, 74(1996): 333-350.

, [*Nonsmooth analysis of singular values*]{}, Set-Valued Analysis, 13(2005): 213-241.

, [*The convex analysis of unitarily invariant matrix functions*]{}, Jounral of Convex Analysis, 2(1995): 173-183.

, [*Equivalent Lipschitz surrogates for zero-norm and rank optimization problems*]{}, Journal of Global Optimization, 72(2018): 679-704.

, [*Regular and limiting normal cones to the graph of the subdifferential mapping of the nuclear norm*]{}, Set-Valued and Variational Analysis, 27(2019): 71-85.

, [*A rank-corrected procedure for matrix completion with fixed basis coefficients*]{}, Mathematical Programming, 159(2016): 289–338.

, [*Iterative reweighted algorithm for matrix rank minimization*]{}, Journal of Machine Learning Research, 13(2012): 3441-3473.

, [*Complete characterization of openess, metric regularity, and Lipschitzian properties of multifunctions*]{}, Transactions of the American Mathematical Society, 340(1993): 1-35.

, [*Estimation of (near) low-rank matrices with noise and high-dimensional scaling*]{}, Annals of Statistics, 39(2011): 1068-1097.

, [*Low-rank matrix recovery via efficient schatten p-norm minimization*]{}, In Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, 2012: 655-661.

, [*Restricted robinson constraint qualification and optimality for cardinality-constrained cone Programming*]{}, Journal of Optimziation Theory and Application, 175(2017): 104-118.

, [*Computing B-stationary points of nonsmooth dc programs*]{}, Mathematics of Operations Research, 42(2017): 95-118.

, [*Rank reduction of correlation matrices by majorization*]{}, Quantitative Finance, 4(2004): 649-662.

, [*Convex Analysis*]{}, Princeton University Press, 1970.

, [*Variational Analysis*]{}, Springer, 1998.

, [*Semismooth matrix valued functions*]{}, Mathematics of Operations Research, 27(2002): 150-169.

, [*Second-order directional derivatives of all eigenvalues of a symmetric matrix*]{}, Nonlinear analysis, 46(2001): 1133-1150.

, [*Characterization of the subdifferential of some matrix norms*]{}, Linear Algebra and Applications, 170(1992): 33-45.

, [*Mathematical programs with semidefinite cone complementary constraints: constraint qualifications and optimality conditions*]{}, Set-Valued and Variational Analysis, 22(2014): 155-187.

, [*KL property of exponent $1/2$ for zero-norm regularized quadratic function on sphere and its application*]{}, arXiv:1811.04371, 2018.

[**Appendix: Directional limiting normal cone to ${\rm gph}\mathcal{N}_{\mathbb{S}_{+}^n}$**]{}

In this part we characterize the directional limiting normal cone to ${\rm gph}\mathcal{N}_{\mathbb{S}_{+}^n}$. For this purpose, for a given $A\in\mathbb{S}^n$, we denote by $\lambda(A)\in\mathbb{R}^n$ the eigenvalue vector of $A$ arranged in a nonincreasing order and write $\mathbb{O}^n(A):=\{P\in\mathbb{O}^n\ |\ A=P{\rm Diag}(\lambda(A))P^{\mathbb{T}}\}$.

Fix an arbitrary $(X,Y)\in{\rm gph}\mathcal{N}_{\mathbb{S}_{+}^n}$ and write $A\!=X\!+Y$. Suppose that $A$ has the eigenvalue decomposition $A=P{\rm Diag}(\lambda(A))P^\mathbb{T}$ where $P\in\mathbb{O}^n(A)$. Define the index sets $$\label{index}
   \alpha:=\{i\,|\,\ \lambda_i(A)>0\},\ \beta:=\{i\,|\,\ \lambda_i(A)=0\}\ \ {\rm and}\ \
   \gamma:=\{i\,|\,\ \lambda_i(A)<0\}.$$ For given $G,H\in\mathbb{S}^n$, by the eigenvalues of $B\!:=\!P_{\beta}^{\mathbb{T}}(G\!+\!H)P_{\beta}$ we define the index sets: $$\label{pinu}
  \pi\!:=\!\big\{i\in[1,|\beta|]\,|\, \lambda_i(B)\!>0\big\},
  \delta\!:=\!\big\{i\in[1,|\beta|]\,|\,\lambda_i(B)=0\big\},
  \nu\!:=\!\big\{i\in[1,|\beta|]\,|\, \lambda_i(B)\!<0\big\}.$$ For the index set $\delta$, we denote the set of all partitions of $\delta$ by $\mathscr{P}(\delta)$. Define the set $$\mathbb{R}_{\gtrsim}^{|\delta|}:=\big\{z\in\mathbb{R}^{|\delta|}\!:\ z_1\ge\cdots\ge z_{|\delta|}\big\}.$$ For any $z\in\mathbb{R}_{\gtrsim}^{|\delta|}$, let $D(z)\in\mathbb{S}^{|\delta|}$ denote the first generalized divided difference matrix of $h(t)=\max(t,0)$ at $z$, which is defined as $$\label{Ddiff-matrix1}
   (D(z))_{ij}:=\left\{\begin{array}{cl}
               \!\frac{\max(0,z_i)-\max(0,z_j)}{z_i-z_j}\in[0,1]&{\rm if}\ z_i\ne z_j,\\
                 1 &{\rm if}\ z_i=z_j>0,\\
                 0 & {\rm otherwise}.
                \end{array}\right.$$ Write $
   \mathcal{U}_{|\beta|}
   :=\big\{\overline{\Omega}\in\mathbb{S}^{|\delta|}\!:\ \overline{\Omega}=\lim_{k\to\infty}D(z^k),\,
   z^k\to 0,\, z^k\in\mathbb{R}_{\gtrsim}^{|\delta|}\big\}.
  $ Let $\widehat{\Xi}_1\in\mathcal{U}_{|\delta|}$. By the definition of $\mathcal{U}_{|\delta|}$, there exists a partition $(\delta_{+},\delta_{0},\delta_{-})\in\mathscr{P}(\delta)$ such that $$\widehat{\Xi}_1=\!\left[\begin{matrix}
       E_{\delta_{+}\delta_{+}}&E_{\delta_{+}\delta_{0}}& (\widehat{\Xi}_1)_{\delta_{+}\delta_{-}}\\
       E_{\delta_{0}\delta_{+}}&0& 0\\
       (\widehat{\Xi}_1)^\mathbb{T}_{\delta_{+}\delta_{-}}&0&0
       \end{matrix}\right]\in\mathbb{S}^{|\delta|}$$ where every entry of $(\widehat{\Xi}_1)_{\delta_{+}\delta_{-}}$ belongs to $[0,1]$. We also write $\widehat{\Xi}_2=E-\widehat{\Xi}_1$, i.e., $$\widehat{\Xi}_2:=\!\left[\begin{matrix}
       0&0& E_{\delta_{+}\delta_{-}}\!-\!(\widehat{\Xi}_1)_{\delta_{+}\delta_{-}}\\
       0&0& E_{\delta_{0}\delta_{-}}\\
       (E_{\delta_{+}\delta_{-}}\!-\!(\widehat{\Xi}_1)_{\delta_{+}\delta_{-}})^{\mathbb{T}}
       &E_{\delta_{-}\delta_{0}}&E_{\delta_{-}\delta_{-}}
       \end{matrix}\right].$$ Next we provide a characterization for the direction limiting normal cone to ${\rm {gph}\mathcal{N}_{\mathbb{S}^n_+}}$.

\[cc-coderivate\] Consider an arbitrary point $(X,Y)\in{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^n}$. Let $A=X+Y$ have the eigenvalue decomposition as above with $\alpha,\beta,\gamma$ defined by . Then, for any given $(G,H)\in\mathbb{S}^n\times\mathbb{S}^n$ with $\pi,\delta$ and $\nu$ defined as in for $B:=\!P_{\beta}^{\mathbb{T}}(G+H)P_{\beta}$, it holds that $(X^*,Y^*)\in\!\mathcal{N}_{{\rm gph}\mathcal{N}_{\mathbb{S}_{+}^n}}((X,Y);(G,H))$ if and only if $(G,H)$ and $(X^*,Y^*)$ satisfy

\[GHmatrix1\] G=PP\^,  H=PP\^,\
\[GHmatrix2\] (E\_-\_)\_+\_\_=0 , \_=\_[\_[+]{}\^[||]{}]{}(\_+\_)

and

\[XYstar1\] X\^\*=PP\^, Y\^\*=PP\^,\
\[XYstar2\] \_\_\^\* +(E\_-\_)(\_\^\*)=0, (\_\^\*,\_\^\*) \_[[gph]{}\_[\_[+]{}\^[||]{}]{}]{}(0,0) [with]{}\
\_[[gph]{}\_[\_[+]{}\^[||]{}]{}]{}(0,0) =\_[Q\^[||]{}\_1\_[||]{}]{} {(U\^\*,V\^\*) | .

[ll]{} \_1(Q\^U\^\*Q)+\_2(Q\^V\^\*Q)=0,\
Q\_[\_0]{}\^U\^\*Q\_[\_0]{}0, Q\_[\_0]{}\^V\^\*Q\_[\_0]{}0

.}

where $$\Xi_1:=\!\left[\begin{matrix}
       E_{\pi\pi} &E_{\pi\delta}& \Gamma_{\pi\nu}\\
       E_{\delta\pi} &\widehat{\Xi}_1& 0\\
       (\Gamma_{\pi\nu})^{\mathbb{T}} &0& 0\\
       \end{matrix}\right]\ \ {\rm and}\ \
     \Xi_2:=\!\left[\begin{matrix}
       0_{\pi\pi} &0_{\pi\delta}& E_{\pi\nu}- \Gamma_{\pi\nu}\\
       0_{\delta\pi} &\widehat{\Xi}_2& E_{\delta\pi}\\
       (E_{\pi\nu}- \Gamma_{\pi\nu})^{\mathbb{T}} &E_{\nu\delta}&E_{\nu\nu}\\
       \end{matrix}\right]$$ with $\Gamma_{ij}=\frac{\max(0,\lambda_i(B))-\max(0,\lambda_j(B))}{\lambda_i(B)-\lambda_j(B)}$ for each $(i,j)\in\pi\times\nu$.

“$\Longrightarrow$”. Since $(X^*,Y^*)\in\!\mathcal{N}_{{\rm gph}\mathcal{N}_{\mathbb{S}_{+}^n}}((X,Y);(G,H))$, there exist sequences $t_k\downarrow 0$ and $(G^k,H^k,X^k,Y^k)\to(G,H,X^*,Y^*)$ with $
    (X^k,Y^k)\in\widehat{\mathcal{N}}_{{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^n}}(X\!+t_kG^k,Y\!+t_kH^k)
  $ for each $k$. Since $(X\!+t_kG^k,Y\!+t_kH^k)\in{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^n}$ for each $k$, it holds that $$X+t_kG^k=\Pi_{\mathbb{S}_{+}^n}(X+Y+t_k(G^k\!+\!H^k)).$$ Notice that $X=\Pi_{\mathbb{S}_{+}^n}(X\!+\!Y)$ since $(X,Y)\in{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^n}$ and the projection operator $\Pi_{\mathbb{S}_{+}^n}(\cdot)$ is directionally differentiable everywhere in the Hadamard sense. Taking the limit to the last equality, we obtain $
    G=\Pi_{\mathbb{S}_{+}^n}'(X\!+\!Y;G\!+\!H).
  $ By the expression of $\Pi_{\mathbb{S}_{+}^n}'(X\!+\!Y;G\!+\!H)$ in [@Sun02], it follows that $G$ and $H$ satisfy -. Write $A^k\!:=(X+Y)+t_k(G^k+H^k)$. For each $k$, let $A^k$ have the spectral decomposition $A^k=(P^k)^{\mathbb{T}}{\rm Diag}(\lambda(A^k))P^k$ with $P^k\in\mathbb{O}^n(A^k)$. Since $\lambda(A)=\lim_{k\to\infty}\lambda(A^k)$, we have $\lambda_i(A^k)>0$ for $i\in\alpha$ and $\lambda_i(A^k)<0$ for $i\in\gamma$ when $k$ is sufficiently large, and $\lim_{k\to\infty}\lambda_i(A^k)=0$ for $i\in\beta$. Since $\{P^k\}$ is bounded, we may assume (if necessary taking a subsequence) that $\{P^k\}$ converges to $\widehat{P}\in\mathbb{O}^n(A)$. Since $P\in\mathbb{O}^n(A)$, there exists $Q\in\mathbb{O}^{|\beta|}$ such that $\widehat{P}=[P_{\alpha}\ \ P_{\beta}Q\ \ P_{\gamma}]$. We assume (if necessary taking a subsequence) that there is a partition $(\beta_{+},\beta_{0},\beta_{-})$ of $\beta$ such that $$\lambda_i(A^k)>0\ \ \forall i\in\beta_{+},\ \lambda_i(A^k)=0\ \ \forall i\in\beta_{0}\ \ {\rm and}\ \
    \lambda_i(A^k)<0\ \ \forall i\in\beta_{-}\quad{\rm for\ each}\ k.$$ In addition, from [@Lan64 Theorem 7] or [@Torki01 Proposition 1.4], it follows that $$\label{Ak-beta}
    \lambda_i(A^k)=t_k\lambda_{l_i}\big[P_{\beta}^{\mathbb{T}}(G^k\!+\!H^k)P_{\beta}\big]+o(t_k)
    \quad\ \forall i\in\beta$$ where $l_i$ is the number of eigenvalues that are equal to $\lambda_i(A)$ but are ranked before $i$ (including $i$). Write $B^k:=P_{\beta}^{\mathbb{T}}(G^k\!+\!H^k)P_{\beta}$ for each $k$. Since $\lambda(B)=\lim_{k\to\infty}\lambda(B^k)$, we have $\lambda_i(B^k)>0$ for $i\in\pi$ and $\lambda_i(B^k)<0$ for $i\in\nu$ when $k$ is sufficiently large, and $\lim_{k\to\infty}\lambda_i(B^k)=0$ for $i\in\delta$. By further taking a subsequence if necessary, we may assume that there exists a partition $(\delta_{+},\delta_{0},\delta_{-})$ of $\delta$ such that for each $k$, $$\lambda_i(B^k)>0\ \ \forall i\in\delta_{+},\ \lambda_i(B^k)=0\ \ \forall i\in\delta_{0}\ \ {\rm and}\ \
    \lambda_i(B^k)<0\ \ \forall i\in\delta_{-}.$$ This means that $\pi\cup\delta_{+}=\beta_{+}-|\alpha|$ and $\nu\cup\delta_{-}=\beta_{-}-|\alpha|$, and then $\delta_0=\beta_0-|\alpha|$. For convenience, we write $\overline{\pi}=\pi+|\alpha|,\,\overline{\delta}=\delta+|\alpha|$ and $\overline{\nu}=\nu+|\alpha|$. Then, we have $$\{i\,|\,\ \lambda_i(A^k)>0\}=\alpha\cup\overline{\pi}\cup\overline{\delta}_{+},\
   \{i\,|\,\ \lambda_i(A^k)=0\}=\overline{\delta}_0,\
   \{i\,|\,\ \lambda_i(A^k)<0\}=\overline{\delta}_{-}\cup\overline{\nu}\cup\gamma.$$ Since $
    (X^k,-Y^k)\in\widehat{\mathcal{N}}_{{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^n}}(X\!+t_kG^k,Y\!+t_kH^k),
  $ by [@WZZ14 Corollary 3.2] it follows that $$\label{temp-equa0}
   \Theta_1^k\circ\widetilde{X}^k+\Theta_2^k\circ(-\widetilde{Y}^k)=0,\ \widetilde{X}_{\overline{\delta}_{0}\overline{\delta}_{0}}^k\succeq 0
   \ \ {\rm and}\ \ \widetilde{Y}_{\overline{\delta}_{0}\overline{\delta}_{0}}^k\succeq 0$$ with $\widetilde{X}^k=(P^k)^{\mathbb{T}}X^kP^k$ and $\widetilde{Y}^k=(P^k)^{\mathbb{T}}Y^kP^k$, where $\Theta_1^k$ and $\Theta_2^k$ take the following form $$\label{Theta1k}
    \Theta_1^k=\left[\begin{matrix}
    E_{\alpha\alpha}&E_{\alpha\overline{\pi}}&E_{\alpha\overline{\delta}_{+}}&E_{\alpha\overline{\delta}_0}
    &\Sigma_{\alpha\overline{\delta}_{-}}^k&\Sigma_{\alpha\overline{\nu}}^k&\Sigma_{\alpha\gamma}^k\\
    E_{\overline{\pi}\alpha}&E_{\overline{\pi}\overline{\pi}}&E_{\overline{\pi}\overline{\delta}_{+}}&E_{\overline{\pi}\overline{\delta}_0}
    &\Sigma_{\overline{\pi}\overline{\delta}_{-}}^k&\Sigma_{\overline{\pi}\overline{\nu}}^k&\Sigma_{\overline{\pi}\gamma}^k\\
    E_{\overline{\delta}_{+}\alpha}&E_{\overline{\delta}_{+}\overline{\pi}}&E_{\overline{\delta}_{+}\overline{\delta}_{+}}
    &E_{\overline{\delta}_{+}\overline{\delta}_0}
    &\Sigma_{\overline{\delta}_{+}\overline{\delta}_{-}}^k&\Sigma_{\overline{\delta}_{+}\overline{\nu}}^k&\Sigma_{\overline{\delta}_{+}\gamma}^k\\
    E_{\overline{\delta}_0\alpha}&E_{\overline{\delta}_0\overline{\pi}}&E_{\overline{\delta}_0\overline{\delta}_{+}}&0&0&0 &0\\
    (\Sigma_{\alpha\overline{\delta}_{-}}^k)^{\mathbb{T}}&(\Sigma_{\overline{\pi}\overline{\delta}_{-}}^k)^{\mathbb{T}}
    &(\Sigma_{\overline{\delta}_{+}\overline{\delta}_{-}}^k)^{\mathbb{T}}&0&0&0&0\\
   (\Sigma_{\alpha\overline{\nu}}^k)^{\mathbb{T}}&(\Sigma_{\overline{\pi}\overline{\nu}}^k)^{\mathbb{T}}
   &(\Sigma_{\overline{\delta}_{+}\overline{\nu}}^k)^{\mathbb{T}}&0 & 0&0 &0\\
    (\Sigma_{\alpha\gamma}^k)^{\mathbb{T}}&(\Sigma_{\overline{\pi}\gamma}^k)^{\mathbb{T}}
    &(\Sigma_{\overline{\delta}_{+}\gamma}^k)^{\mathbb{T}}&0 & 0&0 &0
    \end{matrix}\right]$$ and $$\label{Theta2k}
   \!\Theta_2^k\!=\!\left[\begin{matrix}
    0_{\alpha\alpha}&0_{\alpha\overline{\pi}}&0_{\alpha\overline{\delta}_{+}}&0_{\alpha\overline{\delta}_{0}}
    &\widetilde{\Sigma}_{\alpha\overline{\delta}_{-}}^k&\widetilde{\Sigma}_{\alpha\overline{\nu}}^k &\widetilde{\Sigma}_{\alpha\gamma}^k\\
    0_{\overline{\pi}\alpha}&0_{\overline{\pi}\overline{\pi}}&0_{\overline{\pi}\overline{\delta}_{+}}&0_{\overline{\pi}\overline{\delta}_{0}}
    &\widetilde{\Sigma}_{\overline{\pi}\overline{\delta}_{-}}^k&\widetilde{\Sigma}_{\overline{\pi}\overline{\nu}}^k
    &\widetilde{\Sigma}_{\overline{\pi}\gamma}^k\\
    0_{\overline{\delta}_{+}\alpha}&0_{\overline{\delta}_{+}\overline{\pi}}&0_{\overline{\delta}_{+}\overline{\delta}_{+}}
    &0_{\overline{\delta}_{+}\overline{\delta}_{0}} &\widetilde{\Sigma}_{\overline{\delta}_{+}\overline{\delta}_{-}}^k
    &\widetilde{\Sigma}_{\overline{\delta}_{+}\overline{\nu}}^k&\widetilde{\Sigma}_{\overline{\delta}_{+}\gamma}^k\\
    0_{\overline{\delta}_0\alpha}&0_{\overline{\delta}_{0}\overline{\pi}}&0_{\overline{\delta}_{0}\overline{\delta}_{+}}
    &0_{\overline{\delta}_0\overline{\delta}_0}&E_{\overline{\delta}_0\overline{\delta}_{-}}&E_{\overline{\delta}\overline{\nu}}&E_{\overline{\delta}\gamma}\\
    (\widetilde{\Sigma}_{\alpha\overline{\delta}_{-}}^k)^{\mathbb{T}}
    &(\widetilde{\Sigma}_{\overline{\pi}\overline{\delta}_{-}}^k)^{\mathbb{T}}
    &(\widetilde{\Sigma}_{\overline{\delta}_{+}\overline{\delta}_{-}}^k)^{\mathbb{T}}
    &E_{\overline{\delta}_{-}\overline{\delta}_{0}}&E_{\overline{\delta}_{-}\overline{\delta}_{-}}
    &E_{\overline{\delta}_{-}\overline{\nu}} &E_{\overline{\delta}_{-}\gamma} \\
    (\widetilde{\Sigma}_{\alpha\overline{\nu}}^k)^{\mathbb{T}}
    &(\widetilde{\Sigma}_{\overline{\pi}\overline{\nu}}^k)^{\mathbb{T}}
    &(\widetilde{\Sigma}_{\overline{\delta}_{+}\overline{\nu}}^k)^{\mathbb{T}}
    &E_{\overline{\nu}\overline{\delta}_{0}}&E_{\overline{\nu}\overline{\delta}_{-}}
     &E_{\overline{\nu}\overline{\nu}}& E_{\overline{\nu}\gamma}\\
    (\widetilde{\Sigma}_{\alpha\gamma}^k)^{\mathbb{T}}&(\widetilde{\Sigma}_{\overline{\pi}\gamma}^k)^{\mathbb{T}}
    &(\widetilde{\Sigma}_{\overline{\delta}_{+}\gamma}^k)^{\mathbb{T}}
    &E_{\gamma\overline{\delta}_{0}} &E_{\gamma\overline{\delta}_{-}}& E_{\gamma\overline{\nu}}&E_{\gamma\gamma}
    \end{matrix}\right]$$ with $\Sigma_{ij}^k\!:=\!\frac{\max(0,\lambda_i(A^k))-\max(0,\lambda_j(A^k))}{\lambda_i(A^k)-\lambda_j(A^k)}$ and $\widetilde{\Sigma}_{ij}^k\!:=E_{ij}^k-\!\Sigma_{ij}^k$. It is immediate to have that $$\widetilde{X}^k\to
    \!\left[\begin{matrix}
      \widetilde{X}_{\alpha\alpha}^*& \widetilde{X}_{\alpha\beta}^*Q&\widetilde{X}_{\alpha\gamma}^*\\
      Q^{\mathbb{T}}(\widetilde{X}_{\alpha\beta}^*)^{\mathbb{T}}& Q^{\mathbb{T}}\widetilde{X}_{\beta\beta}^*Q&Q^{\mathbb{T}}\widetilde{X}_{\beta\gamma}^*\\
      (\widetilde{X}_{\alpha\gamma}^*)^{\mathbb{T}}& (\widetilde{X}_{\beta\gamma}^*)^{\mathbb{T}}Q&\widetilde{X}_{\gamma\gamma}^*\\
      \end{matrix}\right]\ {\rm and}\
    \widetilde{Y}^k\to
    \!\left[\begin{matrix}
      \widetilde{Y}_{\alpha\alpha}^*& \widetilde{Y}_{\alpha\beta}^*Q&\widetilde{Y}_{\alpha\gamma}^*\\
      Q^{\mathbb{T}}(\widetilde{Y}_{\alpha\beta}^*)^{\mathbb{T}}& Q^{\mathbb{T}}\widetilde{Y}_{\beta\beta}^*Q&Q^{\mathbb{T}}\widetilde{Y}_{\beta\gamma}^*\\
      (\widetilde{Y}_{\alpha\gamma}^*)^{\mathbb{T}}& (\widetilde{Y}_{\beta\gamma}^*)^{\mathbb{T}}Q&\widetilde{Y}_{\gamma\gamma}^*\\
      \end{matrix}\right].$$ By the expression of $\Sigma_{ij}^k$ for $(i,j)\in(\alpha\cup\overline{\pi}\cup\overline{\delta}_{+})\times(\overline{\delta}_{-}\cup\overline{\nu}\cup\gamma)$ and equation , $$\begin{aligned}
    \lim_{k\to\infty}\Sigma_{\alpha\overline{\delta}_{-}}^k=E_{\alpha\overline{\delta}_{-}},\
    \lim_{k\to\infty}\Sigma_{\alpha\overline{\nu}}^k\!=E_{\alpha\overline{\nu}},\
    \lim_{k\to\infty}\Sigma_{\alpha\gamma}^k\!=\Sigma_{\alpha\gamma},
     \lim_{k\to\infty}\Sigma_{\overline{\delta}_{+}\overline{\nu}}^k\!=0_{\overline{\delta}_{+}\overline{\nu}},\\
    \lim_{k\to\infty}\Sigma_{\overline{\pi}\overline{\delta}_{-}}^k\!=E_{\overline{\pi}\overline{\delta}_{-}},\
     \lim_{k\to\infty}\Sigma_{\overline{\pi}\overline{\nu}}^k\!=\Sigma_{\overline{\pi}\overline{\nu}},\
    \lim_{k\to\infty}\Sigma_{\overline{\pi}\gamma}^k\!=0_{\overline{\pi}\gamma},
    \lim_{k\to\infty}\Sigma_{\overline{\delta}_{+}\gamma}^k\!=0_{\overline{\delta}_{+}\gamma},
  \end{aligned}$$ where $\Sigma_{ij}=\frac{\max(0,\lambda_{i-|\alpha|}(B))-\max(0,\lambda_{j-|\alpha|}(B))}{\lambda_{i-|\alpha|}(B)-\lambda_{j-|\alpha|}(B)}$ for $(i,j)\in\overline{\pi}\times\overline{\nu}$. Thus, there exists $\widehat{\Xi}_1\in\mathcal{U}_{|\delta|}$ such that $\widehat{\Xi}_1$ and the associated matrices $\widehat{\Xi}_2$, $\Xi_1$ and $\Xi_2$ satisfy $$\lim_{k\to\infty}\Theta_1^k=
    \Theta_1+\left[\begin{matrix}
     0_{\alpha\alpha}&0_{\alpha\beta}&0_{\alpha\gamma}\\
     0_{\beta\alpha}&\Xi_1&0\\
     0_{\alpha\gamma}&0&0\\
     \end{matrix}\right]\ \ {\rm and}\ \
    \lim_{k\to\infty}\Theta_2^k=
     \Theta_2+\left[\begin{matrix}
     0_{\alpha\alpha}&0_{\alpha\beta}&0_{\alpha\gamma}\\
     0_{\beta\alpha}&\Xi_2&0\\
     0_{\alpha\gamma}&0&0\\
     \end{matrix}\right].$$ Taking the limit $k\to\infty$ to , we have that $(X^*,Y^*)$ satisfies the condition -.

“$\Longleftarrow$”. Let $(G,H)$ and $(X^*,Y^*)$ satisfy - and -, respectively. We shall prove that there exist sequences $t_k\downarrow 0$ and $(G^k,H^k,X^k,Y^k)\to(G,H,X^*,Y^*)$ with $
    (X^k,-Y^k)\in\widehat{\mathcal{N}}_{{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^n}}(X\!+t_kG^k,Y\!+t_kH^k)
  $ for each $k$. Let $B$ have the spectral decomposition $B=U{\rm Diag}(\lambda(B))U^{\mathbb{T}}$ and write $\widehat{P}=[P_{\alpha}\ \ P_{\beta}U\ \ P_{\gamma}]$. Since $(\widetilde{X}_{\beta\beta}^*,-\widetilde{Y}_{\beta\beta}^*)\in
  \mathcal{N}_{{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^{|\beta|}}}(0,0)$, there exist an orthogonal matrix $Q\in\mathbb{O}^{|\beta|}$ and $\widehat{\Xi}_1\in\mathcal{U}_{|\delta|}$ such that $$\label{temp-equa01}
   \Xi_1\circ Q^{\mathbb{T}}\widetilde{X}_{\beta\beta}^*Q
   +\Xi_2\circ(-Q^{\mathbb{T}}\widetilde{Y}_{\beta\beta}^*Q)=0,\,
   Q_{\delta_{0}}^{\mathbb{T}}\widetilde{X}_{\beta\beta}^*Q_{\delta_{0}}\succeq 0
   \ \ {\rm and}\ \ Q_{\delta_{0}}^{\mathbb{T}}\widetilde{Y}_{\beta\beta}^*Q_{\delta_{0}}\succeq 0.$$ Since $\widehat{\Xi}_1\in\mathcal{U}_{|\delta|}$, we know that there exists a sequence $\{z^k\}\in\mathbb{R}_{\gtrsim}^{|\delta|}$ converging to $0$ such that $\widehat{\Xi}_1=\lim_{k\to\infty}D(z^k)$. Without loss of generality, we can assume that there exists a partition $(\delta_{+},\delta_{0},\delta_{-})\in\mathscr{P}(\delta)$ such that for all $k$, $$z_i^k>0\quad \forall i\in\delta_{+},\quad z_i^k=0\quad \forall i\in\delta_{0}
    \ \ {\rm and}\ \ z_i^k<0\quad \forall i\in\delta_{-}.$$ For each $k$, with $x^k=[\lambda_{\pi}(B);z_{\delta_{+}}^k;0_{\delta_{0}};0_{\delta_{-}};0_{\nu}]$ and $y^k=[0_{\pi};0_{\delta_{+}};0_{\delta_{0}};z_{\delta_{-}}^k;\lambda_{\nu}(B)]$, define $$\widehat{G}^k=\widehat{P}\left[\begin{matrix}
       \widetilde{G}_{\alpha\alpha}&\widetilde{G}_{\alpha\beta}&\widetilde{G}_{\alpha\gamma}\\
       \widetilde{G}_{\alpha\beta}^{\mathbb{T}}&{\rm Diag}(x^k)&0\\
       \widetilde{G}_{\alpha\gamma}^{\mathbb{T}}&0& 0
       \end{matrix}\right]\widehat{P}^{\mathbb{T}}\ \ {\rm and}\ \
    \widehat{H}^k=\widehat{P}\left[\begin{matrix}
       0_{\alpha\alpha}&0_{\alpha\beta}&\widetilde{H}_{\alpha\gamma}\\
       0_{\beta\alpha}&{\rm Diag}(y^k)&\widetilde{H}_{\beta\gamma}\\
       \widetilde{H}_{\alpha\gamma}^{\mathbb{T}}&\widetilde{H}_{\beta\gamma}^{\mathbb{T}}& \widetilde{H}_{\gamma\gamma}
    \end{matrix}\right]\widehat{P}^{\mathbb{T}}.$$ Clearly, for each $k$, $(\widehat{G}^k,\widehat{H}^k)$ satisfies equation -, which is equivalent to saying that $(\widehat{G}^k,\widehat{H}^k)\in\mathcal{T}_{{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^n}}(X,Y)$. Thus, for each $k$, there exist $t_{k_j}\downarrow 0$ and $(\widehat{G}^{k_j},\widehat{H}^{k_j})\to(\widehat{G}^k,\widehat{H}^k)$ as $j\to\infty$ such that $(X,Y)+t_{k_j}(\widehat{G}^{k_j},\widehat{H}^{k_j})\in{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^n}$ for each $j$. By this, we can find sequences $t_k\downarrow 0$ and $(G^k,H^k)\to(G,H)$ such that $(X+t_kG^k,Y+t_kH^k)\in{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^n}$ for each $k$. For each $k$, write $A^k=X+Y+t_k(G^k+H^k)$ and define $\Theta_1^k\in\mathbb{S}^n$ and $\Theta_2^k\in\mathbb{S}^n$ as in and , respectively, except that $\Sigma_{\alpha\gamma}^k$ is replaced by $\Sigma_{\alpha\gamma}$. By the proof of the previous necessity, for all sufficiently large $k$ (if necessary taking a subsequence of $\{A^k\}$), $$\{i\,|\, \lambda_i(A^k)>0\}=\alpha\cup\overline{\pi}\cup\overline{\delta}_{+},\,
    \{i\,|\,\lambda_i(A^k)=0\}=\overline{\delta}_{0},\
    \{i\,|\, \lambda_i(A^k)<0\}=\overline{\delta}_{-}\cup\overline{\nu}\cup\gamma$$ where $\overline{\pi}$ and $\overline{\nu}$ are the same as before and $\overline{\delta}=\delta+|\alpha|$. Next for each $k$ we shall define the matrices $\widetilde{X}^k\in\mathbb{S}^n$ and $\widetilde{Y}^k\in\mathbb{S}^n$. Let $i,j\in\{1,2,\ldots,n\}$. If $(i,j)$ and $(j,i)$

[**Case 1:**]{} $(i,j)$ or $(j,i)\in\alpha\times(\overline{\delta}_{-}\cup\overline{\nu})$. In this case, we have $\widetilde{X}_{ij}^*=0$ by . Define $$\label{abminus}
    \widetilde{Y}_{ij}^k\equiv\widetilde{Y}_{ij}^*\ \ {\rm and}\ \
    \widetilde{X}_{ij}^k=\frac{1-\Sigma_{ij}^k}{\Sigma_{ij}^k}\widetilde{Y}_{ij}^k.$$ Since $\Sigma_{ij}^k\to 1$ in this case, it immediately follows that $(\widetilde{X}_{ij}^k,\widetilde{Y}_{ij}^k)\to (\widetilde{X}_{ij}^*,\widetilde{Y}_{ij}^*)$.

[**Case 2:**]{} $(i,j)$ or $(j,i)\in\overline{\pi}\times\gamma$. Now we have $\widetilde{Y}_{ij}^*=0$ by equation . Define $$\label{bpg}
    \widetilde{X}_{ij}^k\equiv\widetilde{X}_{ij}^*\ \ {\rm and}\ \
    \widetilde{Y}_{ij}^k=\frac{\Sigma_{ij}^k}{1-\Sigma_{ij}^k}\widetilde{X}_{ij}^k.$$ Notice that $\Sigma_{ij}^k\to 0$ in this case. It immediately follows that $(\widetilde{X}_{ij}^k,\widetilde{Y}_{ij}^k)\to (\widetilde{X}_{ij}^*,\widetilde{Y}_{ij}^*)$.

[**Case 3:**]{} $(i,j)$ or $(j,i)\in\overline{\pi}\times\overline{\nu}$. Now $\Sigma_{ij}^k=\frac{\lambda_i(A^k)}{\lambda_i(A^k)^k-\lambda_j(A^k)}
  =\frac{\lambda_{l_i}(G^k+H^k)}{\lambda_{l_i}(G^k+H^k)-\lambda_{l_j}(G^k+H^k)}$ for each $k$. Together with the definition of $\Xi_1$, $\Sigma_{ij}^k\to(\Xi_1)_{i'j'}$ with $i'=i-|\alpha|$ and $j'=j-|\alpha|$.

[**Subcase 3.1:**]{} $(\Xi_1)_{ij}\ne 1$. Then $\Sigma_{ij}^k\ne 1$ for all sufficiently large $k$. We define $$\label{bpbm1}
    \widetilde{X}_{ij}^k\equiv Q_i^{\mathbb{T}}\widetilde{X}_{\beta\beta}^*Q_j\ \ {\rm and}\ \
    \widetilde{Y}_{ij}^k=\frac{\Sigma_{ij}^k}{1-\Sigma_{ij}^k}\widetilde{X}_{ij}^k.$$ From equation , it follows that $\widetilde{Y}_{ij}^k\to\frac{(\Xi_1)_{ij}}{1-(\Xi_1)_{ij}}Q_i^{\mathbb{T}}\widetilde{X}_{\beta\beta}^*Q_j
  =Q_i^{\mathbb{T}}\widetilde{Y}_{\beta\beta}^*Q_j$.

[**Subcase 3.2:**]{} $(\Xi_1)_{ij}=1$. Since $\Sigma_{ij}^k\ne 0$ for all sufficiently large $k$, we define $$\label{bpbm2}
    \widetilde{Y}_{ij}^k\equiv Q_i^{\mathbb{T}}\widetilde{Y}_{\beta\beta}^*Q_j\ \ {\rm and}\ \
    \widetilde{X}_{ij}^k=\frac{1-\Sigma_{ij}^k}{\Sigma_{ij}^k}\widetilde{Y}_{ij}^k.$$ From equation , it follows that $\widetilde{X}_{ij}^k\to\frac{1-(\Xi_1)_{ij}}{(\Xi_1)_{ij}}Q_i^{\mathbb{T}}\widetilde{Y}_{\beta\beta}^*Q_j
  =Q_i^{\mathbb{T}}\widetilde{X}_{\beta\beta}^*Q_j$.

[**Case 4:**]{} $(i,j)$ or $(j,i)\in(\beta\times\beta)\backslash(\overline{\pi}\times\overline{\nu})$. In this case we define $$\label{bb}
    \widetilde{X}_{ij}^k=Q_i^{\mathbb{T}}\widetilde{X}_{\beta\beta}^*Q_j\ \ {\rm and}\ \
    \widetilde{Y}_{ij}^k\equiv Q_i^{\mathbb{T}}\widetilde{Y}_{\beta\beta}^*Q_j.$$

[**Case 5:**]{} $(i,j)$ or $(j,i)\notin(\alpha\times\overline{\nu})\cup(\overline{\pi}\times\gamma)\cup(\beta\times\beta)$. In this case we define $$\label{othercase}
    \widetilde{X}_{ij}^k\equiv\widetilde{X}_{\beta\beta}^*\ \ {\rm and}\ \
    \widetilde{Y}_{ij}^k\equiv \widetilde{Y}_{\beta\beta}^*.$$

Now for each $k$ we define $X^k=\widehat{P}\widetilde{X}^k\widehat{P}^{\mathbb{T}}$ and $Y^k=\widehat{P}\widetilde{Y}^k\widehat{P}^{\mathbb{T}}$. Then, from -, it follows that $(\widehat{P}^{\mathbb{T}}X^k\widehat{P},\widehat{P}^{\mathbb{T}}Y^k\widehat{P})
  =(\widetilde{X}^k,\widetilde{Y}^k)\to (X^*,Y^*)$ as $k\to\infty$, and moreover, $$\Theta_1^k\circ(\widehat{P}^{\mathbb{T}}X^k\widehat{P})
    +\Theta_2^k\circ(-\widehat{P}^{\mathbb{T}}Y^k\widehat{P})=0,\quad k=1,2,\ldots,$$ Moreover, from equations and the last inequalities in , it follows that $$Q_{\beta_0}^{\mathbb{T}}\widetilde{X}^kQ_{\beta_0}\equiv
    Q_{\beta_0}^{\mathbb{T}}\widetilde{X}_{\beta\beta}^*Q_{\beta_0}\succeq 0\ \ {\rm and}\ \
    Q_{\beta_0}^{\mathbb{T}}\widetilde{Y}^kQ_{\beta_0}\equiv
    Q_{\beta_0}^{\mathbb{T}}\widetilde{Y}_{\beta\beta}^*Q_{\beta_0}\succeq 0,\quad k=1,2,\ldots.$$ By [@WZZ14 Corollary 3.2], we have that $(-X^k,Y^k)\in\widehat{\mathcal{N}}_{{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^n}}(\overline{X}^k,\overline{Y}^k)$ for each $k$ with $(X^*,Y^*)=\lim_{k\to\infty}(X^k,Y^k)$. To sum up, there exist $t_k\downarrow 0$ and $(G^k,H^k,X^k,Y^k)\to(G^*,H^*,X^*,Y^*)$ with $
    (-X^k,Y^k)\in\widehat{\mathcal{N}}_{{\rm gph}\,\mathcal{N}_{\mathbb{S}_{+}^n}}(\overline{X}\!+t_kG^k,\overline{Y}\!+t_kH^k)
  $ for each $k$.

[^1]: School of Applied Mathematics, Guangdong University of Technology, Guangzhou.

[^2]: Corresponding author(shhpan@scut.edu.cn), School of Mathematics, South China University of Technology, Guangzhou.
