Normalized Solutions and Critical Growth in Fractional Nonlinear Schrödinger Equations with Potential

Abstract

We investigate the existence of positive normalized (mass-constrained) solutions for the fractional nonlinear Schrödinger equation ${(-\Delta )}^{s}v+V\left(x\right)v=\lambda v+{\mu \left|v\right|}^{p-2}v+{\left|v\right|}^{2_s^{*}-2}v\mathrm{in}{\mathbb{R}}^N,{\parallel v\parallel }_2^2=b^2,$ where $N>2s$, $s\in (0,1)$, $\mu >0$, $p\in (2,2_s^{*})$, and $2_s^{*}={\displaystyle \frac{2N}{N-2s}}$. Here, $\lambda \in \mathbb{R}$ denotes the Lagrange multiplier associated with the prescribed mass $b>0$. The potential $V\in C^1\left({\mathbb{R}}^N\right)$ is allowed to be nonconstant and satisfies $V\left(x\right)\to V_{\infty }$ as $\left|x\right|\to \infty$; moreover, the perturbations induced by $V-V_{\infty }$ and $x·\nabla V$ are assumed to be small in the quadratic-form sense compared with the fractional Dirichlet form ${\parallel (-\Delta )}^{s/2}{v\parallel }_2^2$. Using the Caffarelli–Silvestre extension, we establish a Pohozaev identity adapted to the presence of $V\left(x\right)$ and introduce a Pohozaev manifold on the $L^2$-sphere. Combining Jeanjean’s augmented functional approach with a splitting analysis at the Sobolev-critical level, we construct compact Palais–Smale sequences below a suitable critical energy level. As a consequence, we prove the existence of positive normalized solutions for small masses $b\in (0,b_0)$ in the $L^2$-critical and $L^2$-supercritical regimes (with respect to the lower-order power p).

1. Introduction

In this paper, we mainly study the fractional nonlinear Schrödinger equations with both critical growth and nontrivial potential

$$\left\{\begin{array}{c}{(-\Delta )}^{s}v+V\left(x\right)v=\lambda v+{\mu \left|v\right|}^{p-2}v+{\left|v\right|}^{2_s^{*}-2}v,x\in {\mathbb{R}}^N,\hfill \\ {\parallel v\parallel }_2^2=b^2,\hfill \end{array}\right.$$

(1)

where $N>2s$, $s\in (0,1)$, $\mu >0$, $b>0$, $p\in (2,2_s^{*})$, and $2_s^{*}={\displaystyle \frac{2N}{N-2s}}$. Here, $\lambda \in \mathbb{R}$ denotes the Lagrange multiplier associated with the mass constraint ${\parallel v\parallel }_2=b$. The fractional Laplacian operator ${(-\Delta )}^s$ may be defined as

$$\begin{array}{c}\hfill {(-\Delta )}^{s}v\left(x\right)=C(N,s)\mathrm{P}.\mathrm{V}.{\int }_{{\mathbb{R}}^N}{\displaystyle \frac{v\left(x\right)-v\left(y\right)}{{|x-y|}^{N+2s}}}\mathrm{d}y,x\in {\mathbb{R}}^N,\end{array}$$

(2)

for $v\in C_0^{\infty }\left({\mathbb{R}}^N\right)$, where $C(N,s)$ denotes a suitable positive normalizing constant and $\mathrm{P}.\mathrm{V}.$ stands for the principal value that may be regarded as the infinitesimal generators of Lévy stable diffusion processes (see [1,2,3]). In particular, these works analyze the existence/stability and dynamical properties of solitary waves in (fractional/pseudo-relativistic) Schrödinger-type models. For background on the fractional Laplacian and on fractional Sobolev spaces, we refer, for instance, to [4,5,6,7]. Here, references [4,6] are monographs on nonlocal diffusion/variational methods, reference [5] surveys fractional Sobolev spaces, and [7] provides probabilistic/physical intuition for the fractional Laplacian. We mainly study Equation (1), which is the stationary equation satisfied by the standing wave solutions to the following time-dependent fractional Schrödinger equation:

$$i{\Psi }_t={(-\Delta )}^s\Psi +V\left(x\right)\Psi -{\mu |\Psi |}^{p-2}\Psi -{|\Psi |}^{2_s^{*}-2}\Psi ,$$

(3)

where $\Psi$ has the form

$$\Psi (t,x)=e^{-i\lambda t}v\left(x\right),(t,x)\in (0,\infty )\times {\mathbb{R}}^N,$$

where $v:{\mathbb{R}}^N\to \mathbb{C}$ is a time-independent function leading to the study of Equation (3), i is the imaginary unit, and $\Psi (t,x)$ represents the quantum mechanical probability amplitude for a given unit mass particle to have position x at time t (the corresponding probability density is ${|\Psi |}^2$), under a confinement induced by the potential V. Equation (3) has special significance in fractional quantum mechanics, where it is used to study particles on random fields modeled by Lévy processes. Laskin [8] formalized the path integral of Lévy processes and the fractional Schrödinger equation of fractional quantum mechanics based on the path integral ideas of Feynman and Hibbs. For further physical background on Equation (3), we recommend that the readers refer to [9].

To search for standing waves in Equation (3), there are two different methods: one treats the frequency $\lambda$ as a fixed value, while the other treats the frequency $\lambda$ as an unknown quantity and specifies the mass. The issue of fixed-frequency $\lambda$ has been widely studied in the literature (see [10,11,12,13] and the references cited therein). The fixed-frequency approach has been developed for the existence of bound/ground states and concentration phenomena, including critical growth and potential effects. In the latter case, it appears particularly interesting from a physical perspective, as $\lambda$ appears as a Lagrange multiplier under mass constraints—see [14,15,16].

Here, we would like to mention Jin and Zhang [17]. When $s=1$, Equation (1) becomes the classical Schrödinger equation with nonlinear terms and a potential, as shown below:

$$\left\{\begin{array}{cc}\hfill -\Delta v+V\left(x\right)v& =\lambda v+{\mu \left|v\right|}^{p-2}v+{\left|v\right|}^{2^{*}-2}v,\hfill \\ \hfill {\parallel v\parallel }_2^2=b^2>0.\end{array}\right.$$

(4)

Jin and Zhang [17] utilized the fibering map method and the Pohozaev identity to analyze the solutions of Equation (4) in the critical and supercritical cases.

When $s\in (0,1)$, Peng and Xia [18] have studied the following equation:

$$\left\{\begin{array}{c}{(-\Delta )}^{s}v+V\left(x\right)v+\omega v={\left|v\right|}^{p-2}v,\hfill \\ {\parallel v\parallel }_2^2=b^2>0,\hfill \end{array}\right.$$

(5)

where $(v,\omega )\in H^s\left({\mathbb{R}}^N\right)\times {\mathbb{R}}^{+}$. When the potential $V\in C^1\left({\mathbb{R}}^N\right)$, $V\left(x\right)>0$, ${lim}_{\left|x\right|\to \infty }V\left(x\right)=0$, and $|x\nabla V\left(x\right)|\le \gamma V\left(x\right)$ with $\gamma >0$, the existence of a solution to Equation (5) depends on the potential V that is obtained. Moreover, Peng and Xia [18] proposed a novel minimax structure, constructed auxiliary functionals and scaling transformations, and handled the possible energy loss by means of the splitting lemma to establish the existence of normalized solutions for the fractional-order Schrödinger equation.

In [17], for the classical case $s=1$, the normalized solutions of the Schrödinger equation with potential and nonlinear terms were studied. A method was proposed to overcome the lack of compactness of Palais–Smale sequences by proving that both the energy functional and the augmented energy functional possess the Mountain-Pass geometry. Furthermore, it was shown that the Palais–Smale sequence converges to the Pohozaev manifold, which ensures the existence of a normalized solution. In [18], when $s\in (0,1)$, the nonlocal version of the splitting lemma is particularly instructive.

If $f\left(v\right)={\mu \left|v\right|}^{p-2}v+{\left|v\right|}^{2_s^{*}-2}v$, then $f(\Psi )=e^{-i\lambda t}f\left(v\right)$; Equation (1) can be reduced to

$$\begin{array}{c}\hfill {(-\Delta )}^{s}v+V\left(x\right)v=f\left(v\right)+\lambda v,\end{array}$$

(6)

with v satisfying the following sphere

$$\begin{array}{c}\hfill S_b:=\left\{v\in H^s\left({\mathbb{R}}^N\right):{\parallel v\parallel }_2^2=b^2\right\}.\end{array}$$

(7)

Therefore, a solution v satisfying Equation (6) is called a normalized solution. Based on Equations (6) and (7), we define

$$\begin{array}{c}\hfill E_{\mu ,V}\left(v\right)={\displaystyle \frac{1}{2}}{\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2+{\displaystyle \frac{1}{2}}{\int }_{{\mathbb{R}}^N}V\left(x\right)v^2\mathrm{d}x-{\int }_{{\mathbb{R}}^N}F\left(v\right)\mathrm{d}x,\end{array}$$

(8)

where $F\left(v\right)={\int }_0^{v}f\left(t\right)\mathrm{d}t={\displaystyle \frac{\mu }{p}}{\left|v\right|}^p+{\displaystyle \frac{1}{2_s^{*}}}{\left|v\right|}^{2_s^{*}}$, and define

$${\parallel (-\Delta )}^{{\displaystyle \frac{s}{2}}}{v\parallel }_2^2={\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2.$$

1.1. Zero-Potential Case ($V\equiv 0$)

First, we introduce the power-type nonlinearity $f\left(v\right)={\left|v\right|}^{p-2}v$ and consider

$${(-\Delta )}^s{V}_{\lambda ,s}+\lambda V_{\lambda ,s}={\left|V_{\lambda ,s}\right|}^{p-2}{V}_{\lambda ,s},x\in {\mathbb{R}}^N,\lambda >0.$$

(9)

Let $V_{\lambda ,s}\in H_{\mathrm{rad}}^s\left({\mathbb{R}}^N\right)$ be the positive radial ground state (unique in the radial class, see [19]). By translation invariance, we may assume it is centred at the origin. For any scaling factor $\sigma >0$, define

$$V_{\lambda ,s,\sigma }\left(x\right)={\sigma }^{{\displaystyle \frac{1}{p-2}}}{V}_{\lambda ,s}({\sigma }^{{\displaystyle \frac{1}{2s}}}x),x\in {\mathbb{R}}^N.$$

Because ${(-\Delta )}^s(v({\sigma }^{{\displaystyle \frac{1}{2s}}}·))=\sigma {(-\Delta )}^{s}v({\sigma }^{{\displaystyle \frac{1}{2s}}}·)$, $V_{\lambda ,s,\sigma }$ solves

$${(-\Delta )}^s{V}_{\lambda ,s,\sigma }+\left(\sigma \lambda \right)V_{\lambda ,s,\sigma }={\left|V_{\lambda ,s,\sigma }\right|}^{p-2}{V}_{\lambda ,s,\sigma }.$$

Changing variables $y={\sigma }^{{\displaystyle \frac{1}{2s}}}x$ yields

$$\begin{array}{cc}\hfill \parallel V_{\lambda ,s,\sigma }{\parallel }_2^2& ={\int }_{{\mathbb{R}}^N}{\sigma }^{{\displaystyle \frac{2}{p-2}}}{\left|V_{\lambda ,s}({\sigma }^{{\displaystyle \frac{1}{2s}}}x)\right|}^2\mathrm{d}x\hfill \\ & ={\sigma }^{{\displaystyle \frac{2}{p-2}}-{\displaystyle \frac{N}{2s}}}{\int }_{{\mathbb{R}}^N}{\left|V_{\lambda ,s}\left(y\right)\right|}^2\mathrm{d}y\hfill \\ & ={\sigma }^{{\displaystyle \frac{4s-(p-2)N}{2s(p-2)}}}{\parallel V_{\lambda ,s}\parallel }_2^2.\hfill \end{array}$$

Denote the $L^2$-critical exponent by ${\displaystyle \overline{p}:=2+\frac{4s}{N}}$:

• If $p\ne \overline{p}$, then for each $b>0$ there exists a unique scaling $\sigma \left(b\right)>0$ such that $\parallel V_{\lambda ,s,\sigma \left(b\right)}{\parallel }_2=b$. Hence, Equation (9) admits a unique positive radial normalised solution $v\in S_b$ for all $p\in (2,\overline{p})\cup (\overline{p},2_s^{})$.
• If $p=\overline{p}$, the exponent above vanishes; thus, $\parallel V_{\lambda ,s,\sigma }{\parallel }_2\equiv {\parallel V_{\lambda ,s}\parallel }_2$, and a normalized solution exists iff $\parallel V_{\lambda ,s}{\parallel }_2^2=b^2$.

Moreover, Equation (8) is intimately related to dilation, preserving the $L^2$-norm; we define

$$\begin{array}{c}\hfill v_h\left(x\right):=h^{{\displaystyle \frac{N}{2}}}v\left(hx\right),h>0.\end{array}$$

(10)

This scaling leads to the following relations:

$$\parallel v_h{\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2=h^{2s}{\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2,\parallel v_h{\parallel }_p^p=h^{{\displaystyle \frac{N(p-2)}{2}}}{\parallel v\parallel }_p^p.$$

In particular, recalling ${\gamma }_{p,s}:={\displaystyle \frac{N(p-2)}{2ps}}$, we have ${\displaystyle \frac{N(p-2)}{2}}=sp{\gamma }_{p,s}$ and hence $\parallel v_h{\parallel }_p^p=h^{sp{\gamma }_{p,s}}{\parallel v\parallel }_p^p$. Moreover, since $2_s^{*}={\displaystyle \frac{2N}{N-2s}}$, one checks that $\parallel v_h{\parallel }_{2_s^{*}}^{2_s^{*}}=h^{s{2}_s^{*}}{\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}$.

Thus, to have the balance $h^{2s}=h^{{\displaystyle \frac{N(p-2)}{2}}}$ for all $h\ne 1$, it is necessary that $p=\overline{p}$. For a fixed $v\in S_b$, the sign of $p-\overline{p}$ governs the behavior of the fibering map $h\mapsto E_{\mu }\left(v_h\right)$.

It is useful to introduce the following fractional Gagliardo–Nirenberg–Sobolev inequality [19]:

$$\begin{array}{c}\hfill {\parallel v\parallel }_{L^p}\le C_{N,p,s}{\parallel v\parallel }_{D^s}^{{\gamma }_{p,s}}{\parallel v\parallel }_{L^2}^{1-{\gamma }_{p,s}},\forall v\in H^s\left({\mathbb{R}}^N\right).\end{array}$$

(11)

It is straightforward that

$$p{\gamma }_{p,s}=\left\{\begin{array}{cc}=2,\hfill & p=\overline{p}:=2+{\displaystyle \frac{4s}{N}},\hfill \\ >2,\hfill & \overline{p}<p<2_s^{}:={\displaystyle \frac{2N}{N-2s}},\hfill \end{array}\right.$$

and, from $2_s^{}:={\displaystyle \frac{2N}{N-2s}}$, we obtain ${\gamma }_{2_s^{*}}=1$. For $p\in (\overline{p},2_s^{*})$, the functional $E_{\mu }$ is unbounded on $S_b$.

For $p=2_s^{*}$, Equation (11) reduces to the following fractional Sobolev inequality [20]:

$$\begin{array}{c}\hfill S_s{\parallel v\parallel }_{2_s^{*}}^2\le {\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2,\end{array}$$

(12)

where

$$\begin{array}{c}\hfill S_s:=\underset{v\in H^s\left({\mathbb{R}}^N\right)\setminus \left\{0\right\}}{inf}{\displaystyle \frac{{\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2}{{\left({\int }_{{\mathbb{R}}^N}{\left|v\right|}^{2_s^{*}}\mathrm{d}x\right)}^{\frac{2}{2_s^{*}}}}}\end{array}$$

(13)

is defined as the sharp constant for the embedding $H^s\left({\mathbb{R}}^N\right)\hookrightarrow L^{2_s^{*}}\left({\mathbb{R}}^N\right)$.

It is well known from [20] that equality in the fractional Sobolev inequality Equation (12) is achieved by a family of functions, up to translations and dilations, of the form

$$\begin{array}{c}\hfill {\tilde{V}}_{\epsilon ,y,s}\left(x\right)=M_{N,s}{\left({\displaystyle \frac{\epsilon }{{\epsilon }^2+{|x-y|}^2}}\right)}^{{\displaystyle \frac{N-2s}{2}}},\epsilon >0,y\in {\mathbb{R}}^N,\end{array}$$

(14)

where $M_{N,s}>0$ is chosen so that

$${\parallel (-\Delta )}^{s/2}{\tilde{V}}_{\epsilon ,y,s}{\parallel }_2^2=S_s{\parallel {\tilde{V}}_{\epsilon ,y,s}\parallel }_{2_s^{*}}^2.$$

Moreover, all positive solutions of ${(-\Delta )}^{s}u=u^{2_s^{*}-1}$ in ${\mathbb{R}}^N$ are given by the family Equation (14), up to translations and dilations.

Recently, Zhen and Zhang [21] investigated the following elliptic problems characterized by combined nonlinear terms containing the fractional Sobolev critical exponent:

$$\left\{\begin{array}{c}{(-\Delta )}^{s}v=\lambda v+{\mu \left|v\right|}^{p-2}v+{\left|v\right|}^{2_s^{*}-2}v;\hfill \\ {\parallel v\parallel }_2^2=b^2,v\in H^s\left({\mathbb{R}}^N\right).\hfill \end{array}\right.$$

(15)

Define the associated Pohozaev functional as

$$P_{\mu }\left(v\right)={s\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2-\mu {\gamma }_{p,s}{s\parallel v\parallel }_p^p-s{\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}.$$

Additionally, let

$$\begin{array}{c}\hfill m_b=\underset{\begin{array}{c}v\in P_{\mu }\end{array}}{inf}{E}_{\mu },\end{array}$$

(16)

where

$$\begin{array}{c}\hfill E_{\mu }\left(v\right)={\displaystyle \frac{1}{2}}{\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2-{\displaystyle \frac{\mu }{p}}{\parallel v\parallel }_p^p-{\displaystyle \frac{1}{2_s^{*}}}{\parallel v\parallel }_{2_s^{*}}^{2_s^{*}},v\in H^s\left({\mathbb{R}}^N\right).\end{array}$$

(17)

Zhen and Zhang [21] proved that, when $p\in (2,2_s^{*})$, the estimate in Equation (34) holds provided that $N>2s$, $\mu >0$, $b>0$, and $\mu b^{p(1-{\gamma }_{p,s})}<{\alpha }_{N,p,s}$. Let $v_{\mu }$ be the corresponding positive ground-state solution obtained in ([21], Theorems 1.1–1.3); then, the following conclusions hold:

(1)

$2<p<\overline{p}=2+\frac{4s}{N},m_b\to 0,{\parallel v_{\mu }\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2\to 0\mathrm{as}\mu \to 0^{+};$

(2)

$\overline{p}\le p<2_s^{*}=\frac{2N}{N-2s},m_b\to \frac{s}{N}{S}_s^{\frac{N}{2s}},{\parallel v_{\mu }\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2\to S_s^{\frac{N}{2s}}\mathrm{as}\mu \to 0^{+}.$

Next, we present some theorems about situations where there is no potential from [21].

Theorem 1. 

Let $N>2s$, $b>0$, and $\mu >0$, and suppose $2<p=\overline{p}$. If

$$\mu b^{{\displaystyle \frac{4s}{N}}}<\overline{p}{\left(2C_{N,\overline{p},s}^{\overline{p}}\right)}^{-1},$$

then $E_{\mu }{|}_{S_b}$ has a ground state v with the following properties: v is positive and radially symmetric, and solves Equation (15) for some $\lambda <0$. Moreover, $0<m_b<\frac{s}{N}{S}_s^{\frac{N}{2s}}$, and v is a Mountain-Pass-type point.

Theorem 2. 

Let $N>2s$, $b,\mu >0$, and $2<p<2_s^{*}$. If one of the following conditions holds:

(1)

$N>4s\mathit{and}\mu b^{p(1-{\gamma }_{p,s})}<{\displaystyle \frac{S_s^{\frac{Np(1-{\gamma }_{p,s})}{4s}}}{{\gamma }_{p,s}}};$

(2)

$N={\displaystyle \frac{p}{p-1}}2s\mathit{and}\mu b^{p(1-{\gamma }_{p,s})}<{\displaystyle \frac{S_s^{\frac{Np(1-{\gamma }_{p,s})}{4s}}}{{\gamma }_{p,s}}};$

(3)

$N=4s\mathit{or}{\displaystyle \frac{p}{p-1}}2s<N\mathit{<}4s\mathit{or}2s<N<{\displaystyle \frac{p}{p-1}}2s,$

then $E_{\mu }{|}_{S_b}$ has a ground state v with the following properties: v is a positive, radially symmetric function and solves Equation (15) for some $\lambda <0$. Moreover,

$$0<m_b<{\displaystyle \frac{s}{N}}{S}_s^{N/\left(2s\right)},$$

and $m_b$ is a critical point of Mountain-Pass type.

In contrast to the case $V\equiv 0$ discussed in Section 1.1, the presence of a nontrivial potential $V\left(x\right)$ introduces additional analytical difficulties, particularly in verifying the compactness of Palais–Smale sequences.

1.2. Nonzero-Potential Case ($V\ne 0$)

In this case, the variational method is typically employed to obtain solutions of Equations (6) and (7); for instance, see [18,21,22]—these references establish variational frameworks for normalized solutions with nonzero potentials and discuss the compactness difficulties arising from the constraint.

1.2.1. $L^2$-Subcritical Growth

Suppose that f has $L^2$-subcritical growth of the form

$$f\left(v\right)=\sum _{1\le j\le k}{a}_j{\left|v\right|}^{{\sigma }_j-2}v,$$

where $k\ge 1$, $N\ge 2$, $a_j>0$, and $2\le {\sigma }_j\le \overline{p}=2+{\displaystyle \frac{4s}{N}}$. $E_V$ (see Equation (8)) admits a lower bound on $S_b$. The main challenge lies in deriving suitable subadditive inequalities for the associated constrained minimization problem.

In [22], when $N\ge 2$, Liu and Zhou introduced the following assumptions on the potential $V\left(x\right)$:

• $\left(W\mathit{0}\right) V\left(x\right)\in C({\mathbb{R}}^N,\mathbb{R})\mathrm{and}{inf}_{x\in {\mathbb{R}}^N}V\left(x\right)>-\infty ;$
• $\left(W\mathit{1}\right) V\left(x\right)\le {lim}_{\left|x\right|\to \infty }V\left(x\right):=V_{\infty }\in (0,+\infty ).$

They further employed iterative techniques to deduce a subadditive inequality for the $L^2$-constrained minimization problem, and proved the existence of normalized solutions under the mass-subcritical growth condition.

1.2.2. Mass-Supercritical Growth and Below-Sobolev-Critical Growth

Suppose that f has $L^2$-supercritical growth, such as,

$$f\left(v\right)=\sum _{1\le j\le k}{a}_j{\left|v\right|}^{{\sigma }_j-2}v,$$

where $k\ge 1$, $a_j>0$, and for each j,

$$\overline{p}<{\sigma }_j<2_s^{*}\mathrm{whenever}N>2s,$$

while

$$\overline{p}<{\sigma }_j\mathrm{whenever}N=s\mathrm{or}N=2s.$$

The energy functional $E_{\mu ,V}$ is unbounded from below on $S_b$. The existence of solutions to Equations (6) and (7) is often obtained by means of the Mountain-Pass geometry.

It is necessary to verify that $E_{\mu ,V}$ is unbounded from below on $S_b$. A major difficulty arises here: the lack of compactness of the working space $H^s\left({\mathbb{R}}^N\right)$, which leads to the Palais–Smale (P–S) sequence, may diverge, making it impossible to obtain a solution directly using standard variational methods (such as Mountain Pass). To elaborate, we may consider the following typical conditions, which were used by Peng and Xia [18]:

• $\left(M\mathit{0}\right) V\left(x\right)\in C^1\left({\mathbb{R}}^N\right),V\left(x\right)\ge 0,{lim}_{\left|x\right|\to \infty }V\left(x\right)=0,|x\nabla V\left(x\right)|\le {\rm Y}V\left(x\right),\mathrm{for}\mathrm{some}$ constants ${\rm Y}>0$.
• $(M\mathit{1}) V\left(x\right)\in L^{\infty }\left({\mathbb{R}}^N\right),\mathrm{and}0<{\parallel V\parallel }_{L^{\infty }\left({\mathbb{R}}^N\right)}<2\kappa ,\mathrm{w}\mathrm{h}\mathrm{e}\mathrm{r}\mathrm{e}\kappa =min\left\{1,{\displaystyle \frac{p(2s-N)+2N}{(p-2)({\rm Y}+2s)}}·{\displaystyle \frac{m_{\rho }}{{\rho }^2}}\right\}.$
• $(M2) {\parallel V\parallel }_{L^{{\displaystyle \frac{N}{2}}}\left({\mathbb{R}}^N\right)}<min\left\{{\displaystyle \frac{2N(p-2)}{N(p-2)-4s}}\left(2^{{\displaystyle \frac{N(p-2)-4s}{2N(p-2)}}}-1\right)·{\displaystyle \frac{m_{\rho }}{\parallel U_{\rho }{\parallel }_{2_s^{*}}^2}},{\displaystyle \frac{N(p-2)-4s}{2{\rm Y}{A}^2}},{\displaystyle \frac{\left(p\right(2s-N)+2N)\left(N\right(p-2)-4s)}{2N{(p-2)}^2{A}^2({\rm Y}+2s)+2p{A}^2(p(2s-N)+2N)}}\right\}$.

Above,

$$A={\displaystyle \frac{\Gamma \left(\frac{N-2s}{2}\right)}{2^{2s}{\pi }^s\Gamma \left(\frac{N+2s}{2}\right)}}{\left({\displaystyle \frac{\Gamma \left(N\right)}{\Gamma \left(\frac{N}{2}\right)}}\right)}^{{\displaystyle \frac{2s}{N}}},$$

where $\Gamma$ denotes the Gamma function and A is the Aubin–Talenti constant (see [20]), that is, the best constant in the Sobolev embedding $H^s\left({\mathbb{R}}^N\right)\hookrightarrow L^{2_s^{*}}\left({\mathbb{R}}^N\right)$. Under the above assumptions, Peng and Xia [18] showed that the energy functional remains compact on a certain level set by imposing the above restrictions on $V\left(x\right)$.

1.3. Existence Results for Fractional Schrödinger Equations with Sobolev-Critical Growth

From the above-mentioned literature, most of them do not directly address nonlinearities of Sobolev-critical type. Inspired by [21], which treats the non-potential case, we now turn our attention to Equation (1) in the presence of $L^2$-critical and $L^2$-supercritical. Accordingly, we introduce the following assumptions, which are used in the subsequent proof:

(V0)

${lim}_{\left|x\right|\to \infty }V\left(x\right)={sup}_{x\in {\mathbb{R}}^N}V\left(x\right)=:V_{\infty }<\infty$ and there exists ${\sigma }_1>0$ such that

$$\begin{array}{c}\hfill {\int }_{{\mathbb{R}}^N}|V-V_{\infty }|v^2\mathrm{d}x\le {\sigma }_1{\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2,\forall v\in H^s\left({\mathbb{R}}^N\right);\end{array}$$

(18)

(V1)

$\mathrm{Let}W\left(x\right):=\frac{1}{2}(\nabla V\left(x\right)·x)$,

$$\begin{array}{c}\hfill |{\int }_{{\mathbb{R}}^N}\left(\frac{1}{2}(V-V_{\infty })+\frac{1}{p{\gamma }_{p,s}s}W\right)v^2\mathrm{d}x|\le {\sigma }_2{\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2,\forall v\in H^s\left({\mathbb{R}}^N\right);\end{array}$$

(19)

(V2)

There exists ${\sigma }_3>0$ such that

$$\begin{array}{c}\hfill |{\int }_{{\mathbb{R}}^N}W{v}^2\mathrm{d}x|\le {\sigma }_3{\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2,\forall v\in H^s\left({\mathbb{R}}^N\right);\end{array}$$

(20)

(V3)

for any $x\in {\mathbb{R}}^N$, $s\in (0,1)$, there holds

$$\begin{array}{c}\hfill (sV\left(x\right)+W\left(x\right))<V_{\infty }.\end{array}$$

(21)

Remark 1. 

Assumptions (V0)–(V2) are fractional form-boundedness conditions: they require that the quadratic forms generated by $V-V_{\infty }$ and $W\left(x\right)={\displaystyle \frac{1}{2}}x·\nabla V\left(x\right)$ be small perturbations of the fractional Dirichlet form ${\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2$. A convenient sufficient condition is the following: if $V-V_{\infty }\in L^{{\displaystyle \frac{N}{2s}}}\left({\mathbb{R}}^N\right)$ and $\parallel V-V_{\infty }{\parallel }_{L^{{\displaystyle \frac{N}{2s}}}}$ is small enough, then, by Hölder’s inequality and the Sobolev embedding $H^s\left({\mathbb{R}}^N\right)\hookrightarrow L^{2_s^{*}}\left({\mathbb{R}}^N\right)$, one obtains Equation (18). Similarly, if $W\in L^{{\displaystyle \frac{N}{2s}}}\left({\mathbb{R}}^N\right)$ with small norm, then Equations (19) and (20) follow. Typical examples include

$$V\left(x\right)=V_{\infty }+{\displaystyle \frac{c}{{(1+|x|}^2{)}^{\frac{\alpha }{2}}}}\mathit{with}\alpha >2s\mathit{and}\left|c\right|\mathit{small}.$$

Assumption (V3) is a virial-type strict inequality ensuring that the potential part does not destroy the Pohozaev geometry; it is satisfied, for instance, by radial potentials for which $r\mapsto V\left(r\right)$ is nonincreasing and $sV\left(r\right)+{\displaystyle \frac{r}{2}}{V}^{\prime }\left(r\right)<V_{\infty }$ for all $r>0$.

In assumption (V0), when $V_{\infty }\ne 0$, we may perform the change of variables $(V,\lambda )\mapsto (V-V_{\infty },\lambda -V_{\infty })$. Therefore, up to this transformation, we may assume that $V_{\infty }=0$.

Under the assumption $V_{\infty }=0$, Equation (1) can be viewed as a perturbation of the problem studied in [21,23], whose associated energy functional is given by

$$E_{\mu ,V}\left(v\right)={\displaystyle \frac{1}{2}}{\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2+{\displaystyle \frac{1}{2}}{\int }_{{\mathbb{R}}^N}V\left(x\right)v^2\mathrm{d}x-{\displaystyle \frac{\mu }{p}}{\parallel v\parallel }_p^p-{\displaystyle \frac{1}{2_s^{*}}}{\parallel v\parallel }_{2_s^{*}}^{2_s^{*}},v\in H^s\left({\mathbb{R}}^N\right).$$

When $p\in [\overline{p},2_s^{*})$, the normalization of problem (([21], Theorems 1.1–1.3) and ([23], Theorems 1.1 and 1.2)) was obtained via Jeanjean’s Mountain-Pass approach [24]. Furthermore, the methods described in ([14] Lemma 2.4) and ([18] Lemma 2.1) are used to overcome the lack of compactness in the nonlocal setting. In this paper, we first aim to preserve the Mountain-Pass geometry induced by V in the energy functional $E_{\mu ,V}$ on $S_b$, and then resolve the compactness deficiency in the critical and supercritical cases of p. Finally, under assumptions (V0)–(V3) on V, we derive the corresponding Pohozaev identity for Equation (1).

If $V\in C^1\left({\mathbb{R}}^N\right)$, Equations (18) and (20) hold; any solution to Equation (6) will satisfy

$$\begin{array}{c}\hfill P_{\mu ,V}\left(v\right):={s\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2-{\int }_{{\mathbb{R}}^N}W\left(x\right)v^2\mathrm{d}x-\mu {\gamma }_{p,s}{s\parallel v\parallel }_p^p-s{\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}=0.\end{array}$$

(22)

Through Equation (22), we now state our main results.

Theorem 3. 

Suppose that $N>2s$, and $V\in C^1\left({\mathbb{R}}^N\right)$ satisfies assumptions (V0), (V1), and (V3). If $p=\overline{p}$, ${\sigma }_1<1$ and ${\sigma }_2<{\displaystyle \frac{s}{N}}$, then there exists a positive constant $b_0=b_0(\mu ,p,N)$ such that, for every $b\in (0,b_0)$, Equation (1) possesses a positive solution.

Theorem 4. 

Suppose that $N>2s$, and $V\in C^1\left({\mathbb{R}}^N\right)$ satisfies (V0), (V1), and (V3). If $p\in (\overline{p},2_s^{*})$, ${\sigma }_1<1$, and ${\sigma }_2<{\displaystyle \frac{1}{2}}-{\displaystyle \frac{1}{p{\gamma }_{p,s}}},$ then there exists a positive constant $b_0=b_0(\mu ,p,N)$ such that, for every $b\in (0,b_0)$, Equation (1) possesses a positive solution.

Remark 2. 

The restriction $b\in (0,b_0)$ in Theorems 3 and 4 is used to keep the Mountain-Pass level strictly below the fractional critical threshold ${\displaystyle \frac{s}{N}}{S}_s^{{\displaystyle \frac{N}{2s}}}$, which is the energy of the Sobolev optimizer. This prevents the appearance of critical bubbles and guarantees the compactness of constrained Palais–Smale sequences. In the $L^2$-critical case $p=\overline{p}$, the smallness of b is additionally related to the $L^2$-scaling invariance. The existence theory for large masses and multiplicity/uniqueness questions remain interesting open problems in the presence of a nonconstant potential and critical growth.

Main Novelties

Compared with the critical fractional problem without potential [21] and with the local normalized problem with potential [17], our analysis addresses simultaneously the nonlocal operator ${(-\Delta )}^s$, a nonconstant potential $V\left(x\right)$, and the presence of the Sobolev-critical term ${\left|v\right|}^{2_s^{*}-2}v$ under the $L^2$-constraint. The main new ingredients are the following:

• A full-space Pohozaev identity for Equation (1) with nonconstant $V\left(x\right)$ obtained through the Caffarelli–Silvestre extension and a careful treatment of the boundary terms at infinity;
• A Pohozaev manifold on the $L^2$-sphere tailored to the $L^2$-critical/-supercritical scaling, which restores the missing compactness and yields bounded constrained Palais–Smale sequences;
• A fractional splitting analysis at the critical level, combined with a sharp energy threshold, which rules out the loss of compactness caused by translation and critical bubbling.

Scope. We stress that our results concern stationary normalized states of Equation (1) on ${\mathbb{R}}^N$. Topics such as time-dependent stabilization, dispersive dynamics, or energy decay for fractional-wave/Schrödinger models require different tools and are not addressed here; we added a brief discussion and point to the literature (see [25]).

The structure of this paper is organized as follows. In Section 2, we present some preliminaries to facilitate the subsequent proofs. In Section 3, we establish this strict upper bound by constructing a specific path, thereby showing that the Mountain-Pass level of $E_{\mu ,V}$ satisfies $m_b<{\displaystyle \frac{s}{N}}{S}_s^{N/\left(2s\right)}$ (see Lemmas 1 and 9). In Section 4, we utilize an augmented energy functional technique to construct a bounded Palais–Smale sequence whose energy converges to $m_b$ and which asymptotically satisfies the Pohozaev identity. In Section 5, we prove that this bounded Palais–Smale sequence $\left\{v_n\right\}$ possesses a strongly convergent subsequence. The limit of this subsequence yields the desired solution, thereby completing the proof of Theorems 3 and 4.

2. Preliminaries

Let $S_s$ be the best fractional Sobolev constant given in Equation (13), and let $C_{N,p,s}$ be the optimal constant in the fractional Gagliardo–Nirenberg inequality Equation (11). We denote by $v_h$ the $L^2$-preserving scaling defined in Equation (10).

We denote by $H^s\left({\mathbb{R}}^N\right)$ the fractional Sobolev space endowed with the norm

$${\parallel v\parallel }_{H^s}={\left({\int }_{{\mathbb{R}}^N}{|(-\Delta )}^{{\displaystyle \frac{s}{2}}}{v|}^2\mathrm{d}x+{\int }_{{\mathbb{R}}^N}{\left|v\right|}^2\mathrm{d}x\right)}^{{\displaystyle \frac{1}{2}}},$$

and the inner product

$${\langle u,v\rangle }_{H^s\left({\mathbb{R}}^N\right)}={\int }_{{\mathbb{R}}^N}{(-\Delta )}^{{\displaystyle \frac{s}{2}}}u{(-\Delta )}^{{\displaystyle \frac{s}{2}}}v\mathrm{d}x+{\int }_{{\mathbb{R}}^N}uv\mathrm{d}x.$$

Let $D^s\left({\mathbb{R}}^N\right)$ be the completion of $C_c^{\infty }\left({\mathbb{R}}^N\right)$ with respect to the inner product

$${\langle u,v\rangle }_{D^s\left({\mathbb{R}}^N\right)}=C(N,s){\int }_{{\mathbb{R}}^{2N}}{\displaystyle \frac{\left(u\right(x)-u(y\left)\right)\left(v\right(x)-v(y\left)\right)}{{|x-y|}^{N+2s}}}\mathrm{d}x \mathrm{d}y,$$

and the corresponding norm

$${\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2={\int }_{{\mathbb{R}}^N}|{(-\Delta )}^{\frac{s}{2}}v{|}^2\mathrm{d}x=C(N,s){\int }_{{\mathbb{R}}^{2N}}{\displaystyle \frac{{|v\left(x\right)-v\left(y\right)|}^2}{{|x-y|}^{N+2s}}}\mathrm{d}x \mathrm{d}y.$$

For $2<p<2_s^{*}$, the Pohozaev identity associated with the equation

$$\begin{array}{c}\hfill {(-\Delta )}^{s}v=\lambda v+{\mu \left|v\right|}^{p-2}v+{\left|v\right|}^{2_s^{*}-2}v,\mathrm{in}{\mathbb{R}}^N.\end{array}$$

(23)

If $v\in H^s\left({\mathbb{R}}^N\right)$ is a solution of Equation (23), then, by ([21], Lemma 2.1), it satisfies the Pohozaev identity

$$\begin{array}{c}\hfill P_{\mu }\left(v\right):={s\parallel v\parallel }_{D^s}^2-\mu {\gamma }_{p,s}s{\int }_{{\mathbb{R}}^N}{\left|v\right|}^p\mathrm{d}x-s{\int }_{{\mathbb{R}}^N}{\left|v\right|}^{2_s^{*}}\mathrm{d}x=0.\end{array}$$

(24)

Next, we present some preliminary results. We give the Pohozaev identity for $v\in H^s\left({\mathbb{R}}^N\right)$, solving

$$\begin{array}{c}\hfill {(-\Delta )}^{s}v+V\left(x\right)v=\lambda v+{\mu \left|v\right|}^{p-2}v+{\left|v\right|}^{2_s^{*}-2}v,\mathrm{in}{\mathbb{R}}^N.\end{array}$$

(25)

Let $h>0$, $v\in S_b$, denoting the energy functional along the fiber generated by $v_h$; we define

$$\begin{array}{c}\hfill E_{\mu ,V}\left(v_h\right)={\displaystyle \frac{h^{2s}}{2}}{\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2+{\displaystyle \frac{1}{2}}{\int }_{{\mathbb{R}}^N}V\left(h^{-1}x\right)v^2\mathrm{d}x-\mu h^{sp{\gamma }_{p,s}}{\displaystyle \frac{{\parallel v\parallel }_p^p}{p}}-{\displaystyle \frac{1}{2_s^{*}}}{h}^{s{2}_s^{*}}{\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}.\end{array}$$

(26)

We now prove that solutions of Equation (25) satisfy the Pohozaev identity $P_{\mu ,V}\left(v\right)=0$ defined in Equation (22).

Lemma 1. 

Assume $N>2s$, $V\in C^1\left({\mathbb{R}}^N\right)$, and (V2) holds. Let $W\left(x\right):={\displaystyle \frac{1}{2}}x·\nabla V\left(x\right)$. Then, for any $v\in H^s\left({\mathbb{R}}^N\right)$,

$$\begin{array}{c}\hfill {\left.{\displaystyle \frac{\mathrm{d}}{\mathrm{d}t}}{\int }_{{\mathbb{R}}^N}V\left({\displaystyle \frac{x}{t}}\right)v^2\left(x\right)\mathrm{d}x\right|}_{t=1}=-2{\int }_{{\mathbb{R}}^N}W\left(x\right)v^2\left(x\right)\mathrm{d}x.\end{array}$$

(27)

Proof. 

First, consider $v\in C_c^{\infty }\left({\mathbb{R}}^N\right)$ and define

$$\phi \left(t\right)={\int }_{{\mathbb{R}}^N}V\left({\displaystyle \frac{x}{t}}\right)v^2\left(x\right)\mathrm{d}x.$$

Making the change of variables $y=x/t$ gives

$$\phi \left(t\right)=t^N{\int }_{{\mathbb{R}}^N}V\left(y\right)v^2\left(ty\right)\mathrm{d}y.$$

Differentiating,

$${\phi }^{\prime }\left(t\right)=N{t}^{N-1}{\int }_{{\mathbb{R}}^N}V\left(y\right)v^2\left(ty\right)\mathrm{d}y+2t^N{\int }_{{\mathbb{R}}^N}V\left(y\right)v\left(ty\right)\nabla v\left(ty\right)·y\mathrm{d}y.$$

At $t=1$,

$$\begin{array}{c}\hfill {\phi }^{\prime }\left(1\right)=N{\int }_{{\mathbb{R}}^N}V\left(x\right)v^2\left(x\right)\mathrm{d}x+2{\int }_{{\mathbb{R}}^N}V\left(x\right)v\left(x\right)\nabla v\left(x\right)·x\mathrm{d}x.\end{array}$$

(28)

Consider $F\left(x\right)=V\left(x\right)v^2\left(x\right)x$. Since v has compact support, by the divergence theorem,

$$0={\int }_{{\mathbb{R}}^N}\nabla ·F\mathrm{d}x={\int }_{{\mathbb{R}}^N}\left(\langle \nabla V\left(x\right),x\rangle v^2\left(x\right)+2V\left(x\right)v\left(x\right)\nabla v\left(x\right)·x+NV\left(x\right)v^2\left(x\right)\right)\mathrm{d}x,$$

hence,

$$2{\int }_{{\mathbb{R}}^N}Vv\nabla v·x\mathrm{d}x=-{\int }_{{\mathbb{R}}^N}\langle \nabla V,x\rangle v^2\mathrm{d}x-N{\int }_{{\mathbb{R}}^N}V{v}^2\mathrm{d}x.$$

Substituting into Equation (28) yields

$${\phi }^{\prime }\left(1\right)=-{\int }_{{\mathbb{R}}^N}\langle \nabla V\left(x\right),x\rangle v^2\left(x\right)\mathrm{d}x=-2{\int }_{{\mathbb{R}}^N}W\left(x\right)v^2\left(x\right)\mathrm{d}x.$$

For general $v\in H^s\left({\mathbb{R}}^N\right)$, take $v_n\in C_c^{\infty }\left({\mathbb{R}}^N\right)$ with $v_n\to v$ in $H^s$. Using the form-boundedness assumption Equation (20), $v\mapsto {\int }_{{\mathbb{R}}^N}W{v}^2\left(x\right)\mathrm{d}x$ is continuous with respect to ${\parallel ·\parallel }_{D^s}$; we pass to the limit and obtain Equation (27). □

Proposition 1. 

Assume $N>2s$ and $V\in C^1\left({\mathbb{R}}^N\right)$. If $v\in H^s\left({\mathbb{R}}^N\right)$ solves Equation (25), then v satisfies the Pohozaev identity Equation (22).

Proof. 

Assume $N>2s$ and $V\in C^1\left({\mathbb{R}}^N\right)$. Let $W\left(x\right):={\displaystyle \frac{1}{2}}x·\nabla V\left(x\right)$. Assume that Equations (18) and (20) hold. If $v\in H^s\left({\mathbb{R}}^N\right)$ solves Equation (25), then v satisfies the Pohozaev identity Equation (22).

Here, $B_r^{+}:=\{(x,t)\in {\mathbb{R}}_{+}^{N+1}:\left|(x,t)\right|<r\}$, $S_r^{+}:=\mathit{\partial }{B}_r^{+}$, and $B_r^{\prime }:=\{x\in {\mathbb{R}}^N:\left|x\right|<r\}$.

We follow the Caffarelli–Silvestre extension approach as in [26]. Let $w=w(x,t)$ be the extension of v, solving

$$\left\{\begin{array}{cc}div\left(t^{1-2s}\nabla w\right)=0,\hfill & (x,t)\in {\mathbb{R}}_{+}^{N+1},\hfill \\ {\displaystyle -\underset{t\to 0^{+}}{lim}{t}^{1-2s}{\mathit{\partial }}_{t}w(x,t)={\kappa }_s\left((\lambda -V(x\left)\right)v\left(x\right)+f\left(v\right(x\left)\right)\right),}\hfill & x\in {\mathbb{R}}^N,\hfill \end{array}\right.$$

(29)

where $v\left(x\right)=w(x,0)$ and $f\left(v\right):={\mu \left|v\right|}^{p-2}v+{\left|v\right|}^{2_s^{*}-2}v$. Then,

$${(-\Delta )}^{s}v\left(x\right)=-{\kappa }_s\underset{t\to 0^{+}}{lim}{t}^{1-2s}{\mathit{\partial }}_{t}w(x,t).$$

Let $\xi \left(z\right)=z·\nabla w\left(z\right)$ with $z=(x,t)$. Testing $div(t^{1-2s}\nabla w)=0$ against $\xi$ on $B_r^{+}$ and integrating by parts (as in [26]) yields an identity of the form

$$\begin{array}{cc}\hfill & -{\displaystyle \frac{N-2s}{2}}{\int }_{B_r^{+}}{t}^{1-2s}{|\nabla w|}^2\mathrm{d}z+{\displaystyle \frac{r}{2}}{\int }_{S_r^{+}}{t}^{1-2s}{|\nabla w|}^2\mathrm{d}S\hfill \end{array}$$

(30)

$$\begin{array}{cc}\hfill =& r{\int }_{S_r^{+}}{t}^{1-2s}{\left({\mathit{\partial }}_{\nu }w\right)}^2\mathrm{d}S-{\int }_{B_r^{\prime }}{\kappa }_s\left((\lambda -V)v+f\left(v\right)\right)(x·\nabla v)\mathrm{d}x\hfill \end{array}$$

(31)

$$\begin{array}{cc}\hfill -& {\displaystyle \frac{r}{2}}{\int }_{\mathit{\partial }{B}_r^{\prime }}{\kappa }_s\left((\lambda -V)v^2+2F\left(v\right)\right)\mathrm{d}S.\hfill \end{array}$$

(32)

where $F\left(v\right)={\displaystyle \frac{\mu }{p}}{\left|v\right|}^p+{\displaystyle \frac{1}{2_s^{*}}}{\left|v\right|}^{2_s^{*}}$.

Using the integrability of $t^{1-2s}{|\nabla w|}^2$ in ${\mathbb{R}}_{+}^{N+1}$ and of $F\left(v\right)$ in ${\mathbb{R}}^N$, one can choose a sequence $r_n\to \infty$ such that the boundary terms on $S_{r_n}^{+}$ and $\mathit{\partial }{B}_{r_n}^{\prime }$ vanish as $n\to \infty$. Passing to the limit $r=r_n\to \infty$ in Equation (30), we obtain the Pohozaev identity

$$\begin{array}{cc}\hfill & {\displaystyle \frac{N-2s}{2}}{\parallel v\parallel }_{D^s}^2+{\displaystyle \frac{1}{2}}{\int }_{{\mathbb{R}}^N}(x·\nabla V\left(x\right))v^2\mathrm{d}x+{\displaystyle \frac{N}{2}}{\int }_{{\mathbb{R}}^N}V\left(x\right)v^2\mathrm{d}x\hfill \\ \hfill & ={\displaystyle \frac{N\lambda }{2}}{\parallel v\parallel }_2^2+{\displaystyle \frac{N\mu }{p}}{\parallel v\parallel }_p^p+{\displaystyle \frac{N}{2_s^{*}}}{\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}.\hfill \end{array}$$

(33)

Finally, combining Equation (33) with Equation (25) tested against v and with Lemma 1, we obtain Equation (22). □

Remark 3. 

Two points in the above derivation deserve justification:

(i)

Local vs. nonlocal. The Caffarelli–Silvestre extension provides a local realization in ${\mathbb{R}}_{+}^{N+1}$ of the nonlocal operator ${(-\Delta )}^s$ acting on the trace $v=w(·,0)$. When $s={\displaystyle \frac{1}{2}}$, the weight $t^{1-2s}$ becomes constant and Equation (29) reduces to the harmonic extension $\Delta w=0$ in ${\mathbb{R}}_{+}^{N+1}$; moreover, the Dirichlet-to-Neumann constant satisfies ${\kappa }_{1/2}=2^{1-2(1/2)}\Gamma (1-1/2)/\Gamma (1/2)=1$. This simplification affects only weights/constants and does not change the argument, which works for all $s\in (0,1)$.

(ii)

Vanishing of boundary terms. Set

$$A\left(r\right):={\int }_{S_r^{+}}{t}^{1-2s}{|\nabla w|}^2\mathrm{d}S,B\left(r\right):={\int }_{\mathit{\partial }{B}_r^{\prime }}\left(\left|V\right|v^2+\left|F\left(v\right)\right|\right)\mathrm{d}S.$$

Since $t^{1-2s}{|\nabla w|}^2\in L^1\left({\mathbb{R}}_{+}^{N+1}\right)$, the co-area formula yields

$${\int }_0^{\infty }A\left(r\right)\mathrm{d}r={\int }_{{\mathbb{R}}_{+}^{N+1}}{t}^{1-2s}{|\nabla w|}^2\mathrm{d}z<\infty .$$

Likewise, $F\left(v\right)\in L^1\left({\mathbb{R}}^N\right)$ implies

$${\int }_0^{\infty }{\int }_{\mathit{\partial }{B}_r^{\prime }}\left|F\left(v\right)\right|\mathrm{d}S\mathrm{d}r={\int }_{{\mathbb{R}}^N}\left|F\left(v\left(x\right)\right)\right|\mathrm{d}x<\infty ,$$

and the same holds for ${\int }_{\mathit{\partial }{B}_r^{\prime }}\left|V\right|v^2\mathrm{d}x$ under the assumptions of the proposition. Therefore, there exists a sequence $r_n\to \infty$ such that $A\left(r_n\right)+B\left(r_n\right)\to 0$, which justifies passing to the limit $r=r_n\to \infty$ in Equation (30) (cf. [26]).

The following result is a direct consequence of ([21], Theorems 1.2 and 1.3 and Lemma 9.2); it collects monotonicity and variational characterizations of $m_b$.

Lemma 2. 

Assume that $N>2s$ and $\overline{p}\le p<2_s^{*}$. Then, there exists a constant ${\alpha }_{N,p,s}>0$ such that $m_b$ is strictly decreasing for $0<\mu <b^{p{\gamma }_{p,s}-p}{\alpha }_{N,p,s}$ and is nonincreasing for $\mu \ge b^{p{\gamma }_{p,s}-p}{\alpha }_{N,p,s}$. Moreover,

$$0<m_b<{\displaystyle \frac{s}{N}}{S}_s^{{\displaystyle \frac{N}{2s}}}\mathit{whenever}\overline{p}<p<2_s^{*},\mathit{and}{m}_b=0\mathit{for}\mu \ge b^{p{\gamma }_{p,s}-p}{\alpha }_{N,p,s}\mathit{if}p=\overline{p}.$$

In particular, when $p=\overline{p}$, one can take

$${\alpha }_{N,\overline{p},s}={\displaystyle \frac{\overline{p}}{2{\left(C_{N,\overline{p},s}\right)}^{\overline{p}}}}.$$

Finally, if either $\overline{p}<p<2_s^{*}$ or $p=\overline{p}$ and $0<\mu b^{{\displaystyle \frac{4s}{N}}}<{\displaystyle \frac{\overline{p}}{2{\left(C_{N,\overline{p},s}\right)}^{\overline{p}}}}$, then $E_{\mu }{|}_{S_b}$ has a Mountain-Pass geometry and, for any $v\in S_b$, the fiber map $h\mapsto E_{\mu }\left(v_h\right)$ admits a unique maximizer on ${\mathbb{R}}_{+}$; consequently,

$$m_b=\underset{v\in S_b}{inf}\underset{h\in {\mathbb{R}}^{+}}{max}{E}_{\mu }\left(v_h\right).$$

(34)

Lemma 3. 

Assume that $N>2s$ and $\overline{p}\le p<2_s^{*}$. Under the assumptions of Lemma 2, the map $b\mapsto m_b$ is nonincreasing on $(0,\infty )$.

Proof. 

This is proven in ([21], Lemma 9.2); we omit the details. □

Next, we state the following lemma concerning Equation (24).

Lemma 4. 

Suppose that $N>2s$ and $\overline{p}\le p<2_s^{*}$, and let $\left\{v_n\right\}\subset S_b$ be a bounded sequence in $H^s\left({\mathbb{R}}^N\right)$ such that $P_{\mu }\left(v_n\right)\to 0$. Assume that there exists $c>0$ such that $\parallel v_n{\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2\ge c$ for all n. Then,

$$m_b\le \underset{n\to \infty }{lim\; inf}{E}_{\mu }\left(v_n\right).$$

(35)

Proof. 

For clarity, we denote the Pohozaev manifold on the sphere by

$${\mathcal{P}}_{\mu }:=\{v\in S_b:P_{\mu }\left(v\right)=0\},$$

which coincides with the constraint set used in Equation (16). Since $\overline{p}\le p<2_s^{*}$, by Lemma 2 (fiber uniqueness), for each n, there exists a unique $h_n>0$ such that ${\left(v_n\right)}_{h_n}\in {\mathcal{P}}_{\mu }$, that is,

$$P_{\mu }\left({\left(v_n\right)}_{h_n}\right)=0.$$

(36)

On the other hand, $P_{\mu }\left(v_n\right)=o_n\left(1\right)$ reads

$$s\parallel v_n{\parallel }_{D^s}^2-\mu {\gamma }_{p,s}s\parallel v_n{\parallel }_p^p-s{\parallel v_n\parallel }_{2_s^{*}}^{2_s^{*}}=o_n\left(1\right).$$

(37)

Subtracting Equation (36) from Equation (37) and using the scaling laws in Equation (10), we obtain

$$\mu {\gamma }_{p,s}\left(h_n^{ps{\gamma }_{p,s}}-1\right)\parallel v_n{\parallel }_p^p+\left(h_n^{s{2}_s^{*}}-1\right)\parallel v_n{\parallel }_{2_s^{*}}^{2_s^{*}}=\left(h_n^{2s}-1\right){\parallel v_n\parallel }_{D^s}^2+o_n\left(1\right).$$

Since $\parallel v_n{\parallel }_{D^s}^2\ge c>0$ and $\left\{v_n\right\}$ is bounded in $H^s$, the above identity forces $h_n\to 1$ (otherwise the left-hand side would stay separated from 0 while the right-hand side cannot, due to the uniform bounds and $P_{\mu }\left(v_n\right)\to 0$). Consequently, by continuity of $E_{\mu }\left(v_h\right)$ with respect to h on bounded sets,

$$E_{\mu }\left(v_n\right)=E_{\mu }\left({\left(v_n\right)}_{h_n}\right)+o_n\left(1\right).$$

Finally, since ${\left(v_n\right)}_{h_n}\in {\mathcal{P}}_{\mu }$, by the definition of $m_b$, we have

$$E_{\mu }\left({\left(v_n\right)}_{h_n}\right)\ge m_b,$$

hence, $E_{\mu }\left(v_n\right)\ge m_b+o_n\left(1\right)$, and Equation (35) follows. □

Lemma 5. 

Suppose that $N>2s$ and $\overline{p}\le p<2_s^{*}$, and $V\in C^1\left({\mathbb{R}}^N\right)$ satisfies Equation (18), Equation (20) and (V3). If $v\in H^s\left({\mathbb{R}}^N\right)\setminus \left\{0\right\}$ solves Equation (25), then the associated Lagrange multiplier satisfies $\lambda <0$.

Proof. 

Assume that v is a nontrivial solution to Equation (25). Multiplying Equation (25) by v and integrating over ${\mathbb{R}}^N$, and then multiplying the resulting identity by s, we obtain

$$\begin{array}{c}\hfill {s\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2+s{\int }_{{\mathbb{R}}^N}V\left(x\right)v^2\mathrm{d}x={s\lambda \parallel v\parallel }_2^2+{s\mu \parallel v\parallel }_p^p+s{\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}.\end{array}$$

(38)

By Proposition 1, the Pohozaev identity Equation (22) holds. Combining Equation (38) with Equation (22), we have

$${\int }_{{\mathbb{R}}^N}{(sV\left(x\right)+W\left(x\right))\left|v\right|}^2\mathrm{d}x=s\mu (1-{\gamma }_{p,s}){\parallel v\parallel }_p^p+s\lambda {\parallel v\parallel }_2^2.$$

Since $p\ge \overline{p}$ implies $1-{\gamma }_{p,s}\ge 0$, the first term on the right-hand side is nonnegative (and it is strictly positive when $p>\overline{p}$). On the other hand, (V3) gives $sV\left(x\right)+W\left(x\right)<V_{\infty }$ for all x, and after the reduction $V_{\infty }=0$ we have $sV+W<0$. Therefore, the left-hand side is strictly negative, which forces ${s\lambda \parallel v\parallel }_2^2<0$ and hence $\lambda <0$. □

We prove that, under appropriate conditions, the energy functional $E_{\mu ,V}$ is non-negative for any solution to Equation (25).

Lemma 6. 

Suppose that $N>2s$, $\overline{p}\le p<2_s^{*}$, $s\in (0,1)$, and $V\in C^1\left({\mathbb{R}}^N\right)$ satisfies (V0)–(V1). Assume one of the following:

(i)

$\overline{p}<p<2_s^{*}$ and

$${\sigma }_2\le {\displaystyle \frac{1}{2}}-{\displaystyle \frac{1}{p{\gamma }_{p,s}}};$$

(39)

(ii)

$p=\overline{p}$ and

$${\sigma }_2\le {\displaystyle \frac{s}{N}}\left(1-{\displaystyle \frac{2\mu }{\overline{p}}}{C}_{N,\overline{p},s}^{\overline{p}}{b}^{{\displaystyle \frac{4s}{N}}}\right).$$

(40)

If v is a solution of Equation (25), then $E_{\mu ,V}\left(v\right)\ge 0$.

Proof. 

Let v solve Equation (25). By Proposition 1, v satisfies the Pohozaev identity Equation (22).

Case (i): $\overline{p}<p<2_s^{*}$. Using Equation (22) to eliminate the $L^p$–term in $E_{\mu ,V}\left(v\right)$, we obtain

$$\begin{array}{cc}\hfill E_{\mu ,V}\left(v\right)& ={\displaystyle \frac{1}{2}}{\parallel v\parallel }_{D^s}^2+{\displaystyle \frac{1}{2}}{\int }_{{\mathbb{R}}^N}V{v}^2\mathrm{d}x-{\displaystyle \frac{\mu }{p}}{\parallel v\parallel }_p^p-{\displaystyle \frac{1}{2_s^{*}}}{\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}\hfill \\ & ={\displaystyle \frac{1}{2}}{\parallel v\parallel }_{D^s}^2+{\displaystyle \frac{1}{2}}{\int }_{{\mathbb{R}}^N}V{v}^2\mathrm{d}x-{\displaystyle \frac{1}{p{\gamma }_{p,s}s}}\left({s\parallel v\parallel }_{D^s}^2-{\int }_{{\mathbb{R}}^N}W{v}^2\mathrm{d}x-s{\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}\right)-{\displaystyle \frac{1}{2_s^{*}}}{\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}\hfill \\ & =\left({\displaystyle \frac{1}{2}}-{\displaystyle \frac{1}{p{\gamma }_{p,s}}}\right){\parallel v\parallel }_{D^s}^2+{\displaystyle \frac{1}{2}}{\int }_{{\mathbb{R}}^N}V{v}^2\mathrm{d}x+{\displaystyle \frac{1}{p{\gamma }_{p,s}s}}{\int }_{{\mathbb{R}}^N}W{v}^2\mathrm{d}x+\left({\displaystyle \frac{1}{p{\gamma }_{p,s}}}-{\displaystyle \frac{1}{2_s^{*}}}\right){\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}.\hfill \end{array}$$

Since $\overline{p}<p<2_s^{*}$, we have ${\displaystyle \frac{1}{p{\gamma }_{p,s}}}>{\displaystyle \frac{1}{2_s^{*}}}$, hence the last term is nonnegative and can be dropped in a lower bound. By (V1) (after the reduction $V_{\infty }=0$),

$${\displaystyle \frac{1}{2}}{\int }_{{\mathbb{R}}^N}V{v}^2\mathrm{d}x+{\displaystyle \frac{1}{p{\gamma }_{p,s}s}}{\int }_{{\mathbb{R}}^N}W{v}^2\mathrm{d}x\ge -{\sigma }_2{\parallel v\parallel }_{D^s}^2,$$

therefore, using Equation (39), we have

$$E_{\mu ,V}\left(v\right)\ge \left({\displaystyle \frac{1}{2}}-{\displaystyle \frac{1}{p{\gamma }_{p,s}}}-{\sigma }_2\right){\parallel v\parallel }_{D^s}^2\ge 0.$$

Case (ii): $p=\overline{p}$. Starting from the identity

$$E_{\mu ,V}\left(v\right)=\left({\displaystyle \frac{1}{2}}-{\displaystyle \frac{1}{2_s^{*}}}\right){\parallel v\parallel }_{D^s}^2+{\displaystyle \frac{1}{2}}{\int }_{{\mathbb{R}}^N}V{v}^2\mathrm{d}x+{\displaystyle \frac{1}{2_s^{*}s}}{\int }_{{\mathbb{R}}^N}W{v}^2\mathrm{d}x-\mu \left({\displaystyle \frac{1}{p}}-{\displaystyle \frac{{\gamma }_{p,s}}{2_s^{*}}}\right){\parallel v\parallel }_p^p,$$

we use that $p=\overline{p}$ implies $p{\gamma }_{p,s}=2$ and hence ${\parallel v\parallel }_p^p\le C_{N,\overline{p},s}^{\overline{p}}{\parallel v\parallel }_{D^s}^2{b}^{{\displaystyle \frac{4s}{N}}}$ by Equation (11). Moreover, ${\displaystyle \frac{1}{2}}-{\displaystyle \frac{1}{2_s^{*}}}={\displaystyle \frac{s}{N}}$ and, by (V1), we also have

$${\displaystyle \frac{1}{2}}{\int }_{{\mathbb{R}}^N}V{v}^2\mathrm{d}x+{\displaystyle \frac{1}{2_s^{*}s}}{\int }_{{\mathbb{R}}^N}W{v}^2\mathrm{d}x\ge -{\sigma }_2{\parallel v\parallel }_{D^s}^2.$$

Combining these inequalities and Equation (40) yields $E_{\mu ,V}\left(v\right)\ge 0$. □

To construct Palais–Smale sequences at a minimax level, we use the following deformation lemma (see ([27], Theorem 4.5)).

Proposition 2. 

Let X denote a Hilbert manifold and $E\in C^1(X,\mathbb{R})$. Suppose that $K\subset X$ is compact, and let

$$\mathcal{F}\subset \{D\subset X:D\mathit{is}\mathit{compact},K\subset D\},$$

be a family invariant under deformations, leaving K fixed. Assume that

$$\underset{v\in K}{max}E\left(v\right)<c:=\underset{D\in \mathcal{F}}{inf}\underset{v\in D}{max}E\left(v\right)\in \mathbb{R}.$$

Let ${\sigma }_n\in \mathbb{R}$ with ${\sigma }_n\to 0$ and $D_n\in \mathcal{F}$ be a sequence such that

$$c\le \underset{v\in D_n}{max}E\left(v\right)<c+{\sigma }_n.$$

Then, there exists a sequence $\left\{v_n\right\}\subset X$ and a constant $M^{\prime }>0$ such that the following hold:

(i)

$c\le E\left(v_n\right)<c+{\sigma }_n;$

(ii)

$\parallel {\nabla }_{X}E\left(v_n\right)\parallel <M^{\prime }\sqrt{{\sigma }_n};$

(iii)

$\mathrm{dist}(v_n,D_n)<M^{\prime }\sqrt{{\sigma }_n}.$

3. Mountain-Pass Geometry

This section focuses on the construction of the Mountain-Pass geometry associated with $E_{\mu ,V}$ over $S_b$.

Lemma 7. 

Suppose that $N>2s$, $\overline{p}\le p<2_s^{*}$, and (V0) holds. Then, for all v belonging to $S_b$,

$$\underset{h\to 0^{+}}{lim}{E}_{\mu ,V}\left(v_h\right)=0\mathit{and}\underset{h\to \infty }{lim}{E}_{\mu ,V}\left(v_h\right)=-\infty .$$

Proof. 

Let $v\in S_b$; we have

$$E_{\mu ,V}\left(v_h\right)\le {\displaystyle \frac{h^{2s}}{2}}{\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2-{\displaystyle \frac{\mu }{p}}{h}^{sp{\gamma }_{p,s}}{\parallel v\parallel }_p^p-{\displaystyle \frac{1}{2_s^{*}}}{h}^{s{2}_s^{*}}{\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}.$$

For $\overline{p}\le p<2_s^{*}$, we can obtain that

$$\underset{h\to \infty }{lim}{E}_{\mu ,V}\left(v_h\right)=-\infty .$$

On the other hand, writing $V=V_{\infty }+(V-V_{\infty })$ and applying (V0) to $v_h$, we have

$$\left|{\int }_{{\mathbb{R}}^N}(V\left(x\right)-V_{\infty })v_h^2\mathrm{d}x\right|\le {\sigma }_1\parallel v_h{\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2={\sigma }_1{h}^{2s}{\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2.$$

Therefore,

$${\int }_{{\mathbb{R}}^N}V\left(x\right)v_h^2\mathrm{d}x=V_{\infty }{\parallel v_h\parallel }_2^2+O\left(h^{2s}\right)=V_{\infty }{b}^2+O\left(h^{2s}\right),$$

and hence

$$\left|E_{\mu ,V}\left(v_h\right)\right|\le {\displaystyle \frac{h^{2s}}{2}}(1+{\sigma }_1){\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2+{\displaystyle \frac{V_{\infty }}{2}}{b}^2+\mu h^{p{\gamma }_{p,s}s}{\displaystyle \frac{{\parallel v\parallel }_p^p}{p}}+h^{s{2}_s^{*}}{\displaystyle \frac{{\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}}{2_s^{*}}}.$$

In particular, after the harmless shift discussed in the Introduction (so that $V_{\infty }=0$), we conclude that

$$\underset{h\to 0^{+}}{lim}{E}_{\mu ,V}\left(v_h\right)=0.$$

□

Now, we consider, for $k>0$,

$$B_k:=\{v\in S_b{:\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}<k\},\mathit{\partial }{B}_k:=\{v\in S_b{:\parallel v\parallel }_{D^s\left({\mathbb{R}}^N\right)}=k\}.$$

A key observation is that, under (V0), $E_{\mu ,V}$ is bounded below by a positive number on $\mathit{\partial }{B}_k$ for sufficiently small $k>0$.

Lemma 8. 

Suppose that $N>2s$, $\overline{p}\le p<2_s^{*}$, and (V0) holds with

$${\sigma }_1<1\mathit{if}\overline{p}<p<2_s^{*},\mathit{or}{\sigma }_1<1-{\displaystyle \frac{2\mu }{\overline{p}}}{\left(C_{N,\overline{p},s}\right)}^{\overline{p}}{b}^{{\displaystyle \frac{4s}{N}}}\mathit{if}p=\overline{p}.$$

(41)

Then, there exist constants $k_0>0$ and $\beta >0$ such that

$$E_{\mu ,V}\left(v\right)\ge \beta \mathit{for}\mathit{all}v\in \mathit{\partial }{B}_{k_0}.$$

Proof. 

After the reduction $V_{\infty }=0$ (hence ${sup}_{{\mathbb{R}}^N}V=0$), by Equation (18), we have $V\le 0$ and

$${\int }_{{\mathbb{R}}^N}V\left(x\right)v^2\mathrm{d}x\ge -\left|{\int }_{{\mathbb{R}}^N}V\left(x\right)v^2\mathrm{d}x\right|\ge -{\sigma }_1{\parallel v\parallel }_{D^s}^2.$$

Moreover, by the fractional Gagliardo–Nirenberg inequality in Equation (11) and the Sobolev inequality in Equation (12), for any $v\in S_b$, we have

$${\parallel v\parallel }_p^p\le {\left(C_{N,p,s}\right)}^p{b}^{p(1-{\gamma }_{p,s})}{\parallel v\parallel }_{D^s}^{p{\gamma }_{p,s}}{,\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}\le S_s^{-\frac{2_s^{*}}{2}}{\parallel v\parallel }_{D^s}^{2_s^{*}}.$$

Therefore, setting $t:={\parallel v\parallel }_{D^s}$, we obtain

$$E_{\mu ,V}\left(v\right)\ge {\displaystyle \frac{1-{\sigma }_1}{2}}{t}^2-{\displaystyle \frac{\mu }{p}}{\left(C_{N,p,s}\right)}^p{b}^{p(1-{\gamma }_{p,s})}{t}^{p{\gamma }_{p,s}}-{\displaystyle \frac{1}{2_s^{*}}}{S}_s^{-\frac{2_s^{*}}{2}}{t}^{2_s^{*}}.$$

If $\overline{p}<p<2_s^{*}$, then $p{\gamma }_{p,s}>2$ and $2_s^{*}>2$. Hence, the right-hand side is positive for $t>0$ small enough. Choose $k_0>0$ so that

$${\displaystyle \frac{\mu }{p}}{\left(C_{N,p,s}\right)}^p{b}^{p(1-{\gamma }_{p,s})}{k}_0^{p{\gamma }_{p,s}-2}+{\displaystyle \frac{1}{2_s^{*}}}{S}_s^{-{\displaystyle \frac{2_s^{*}}{2}}}{k}_0^{2_s^{*}-2}\le {\displaystyle \frac{1-{\sigma }_1}{4}},$$

and set $\beta :={\displaystyle \frac{1-{\sigma }_1}{4}}{k}_0^2>0$. Then, $E_{\mu ,V}\left(v\right)\ge \beta$ on $\mathit{\partial }{B}_{k_0}$.

If $p=\overline{p}$, then $p{\gamma }_{p,s}=2$ and the $L^p$-term is also of order $t^2$. Using ${\parallel v\parallel }_{\overline{p}}^{\overline{p}}\le {\left(C_{N,\overline{p},s}\right)}^{\overline{p}}{b}^{{\displaystyle \frac{4s}{N}}}{t}^2$, we get

$$E_{\mu ,V}\left(v\right)\ge \left({\displaystyle \frac{1-{\sigma }_1}{2}}-{\displaystyle \frac{\mu }{\overline{p}}}{\left(C_{N,\overline{p},s}\right)}^{\overline{p}}{b}^{{\displaystyle \frac{4s}{N}}}\right)t^2-{\displaystyle \frac{1}{2_s^{*}}}{S}_s^{-{\displaystyle \frac{2_s^{*}}{2}}}{t}^{2_s^{*}}.$$

The assumption in Equation (41) ensures that the coefficient of $t^2$ is positive; choosing $k_0>0$ small yields again $E_{\mu ,V}\ge \beta >0$ on $\mathit{\partial }{B}_{k_0}$. □

It follows from Lemmas 7 and 8 that Equation (41) guarantees the Mountain-Pass geometry of $E_{\mu ,V}$ on $S_b$. Let $v^b\in S_b$ be a positive ground state of the zero-potential problem in Equation (15), so that

$$E_{\mu }\left(v^b\right)=m_b.$$

(42)

By Lemma 7, we have

$$\underset{h\to 0^{+}}{lim}{E}_{\mu ,V}\left(v_h^b\right)=0\mathrm{and}\underset{h\to \infty }{lim}{E}_{\mu ,V}\left(v_h^b\right)=-\infty .$$

Hence, there exist $h_1>h_0>0$ such that

$$e_0:=v_{h_0}^b\in B_{k_0},e_1:=v_{h_1}^b\in S_b\setminus B_{k_0},E_{\mu ,V}\left(e_0\right)<\beta ,E_{\mu ,V}\left(e_1\right)<0,$$

where $k_0$ and $\beta$ are as in Lemma 8. Define the class of Mountain-Pass paths

$$\Gamma :=\left\{\xi \in C([0,1],S_b)|\xi \left(0\right)=e_0,\xi \left(1\right)=e_1\right\},$$

and the Mountain-Pass level

$$m_{V,b}:=\underset{\xi \in \Gamma }{inf}\underset{t\in [0,1]}{max}{E}_{\mu ,V}\left(\xi \left(t\right)\right).$$

It is straightforward that

$$m_{V,b}\ge \beta >0.$$

(43)

Lemma 9. 

Suppose that $N>2s$, $\overline{p}\le p<2_s^{*}$, and the assumption (V0) is satisfied by Equation (41). If $V\not\equiv 0$, then $m_b>m_{V,b}.$

Proof. 

By Equation (42) and the fiber map Equation (34), we have

$$m_b=\underset{h>0}{max}{E}_{\mu }\left({\left(v^b\right)}_h\right).$$

Moreover, after the reduction $V_{\infty }=0$, we have $V\le 0$ and $V\not\equiv 0$; hence, $V<0$ on a set of positive measure. Since $v^b>0$ in ${\mathbb{R}}^N$, it follows that, for every $h>0$,

$${\int }_{{\mathbb{R}}^N}V\left(h^{-1}x\right){\left(v^b\right)}^2\left(x\right)\mathrm{d}x<0,$$

and therefore

$$E_{\mu ,V}\left({\left(v^b\right)}_h\right)=E_{\mu }\left({\left(v^b\right)}_h\right)+{\displaystyle \frac{1}{2}}{\int }_{{\mathbb{R}}^N}V\left(h^{-1}x\right){\left(v^b\right)}^2\left(x\right)\mathrm{d}x<E_{\mu }\left({\left(v^b\right)}_h\right).$$

Taking the maximum over $h>0$ and using the definition of $m_{V,b}$, we obtain

$$m_{V,b}\le \underset{h>0}{max}{E}_{\mu ,V}\left({\left(v^b\right)}_h\right)<\underset{h>0}{max}{E}_{\mu }\left({\left(v^b\right)}_h\right)=m_b.$$

□

To derive a bounded Palais–Smale sequence for $E_{\mu ,V}$ at the Mountain-Pass level $m_{V,b}$, we adopt the methodological framework from [24] to construct an augmented functional. This functional is defined as follows:

$$\begin{array}{c}\hfill {\tilde{E}}_{\mu ,V}(v,h):=E_{\mu ,V}\left(v_h\right),(v,h)\in H^s\left({\mathbb{R}}^N\right)\times {\mathbb{R}}^{+},\end{array}$$

(44)

where $v_h$ is the function specified in Equation (10). In fact, this augmented functional ${\tilde{E}}_{\mu ,V}$ also exhibits a Mountain-Pass structure on the product space $S_b\times {\mathbb{R}}^{+}$. For the space $S_b\times {\mathbb{R}}^{+}$, we define the set of new Mountain-Pass paths as

$$\tilde{\Gamma }:=\left\{\xi \in C([0,1],S_b\times {\mathbb{R}}^{+})|\xi \left(0\right)=(e_0,1),\xi \left(1\right)=(e_1,1)\right\}.$$

Any path $\tilde{\xi }\in \tilde{\Gamma }$ can be expressed in the form:

$$\tilde{\xi }\left(t\right)=(\xi \left(t\right),l\left(t\right)),$$

where $\xi \in \Gamma$ (consistent with the earlier definition of $\Gamma$), $l\in C([0,1],{\mathbb{R}}^{+})$, and the boundary condition $l\left(0\right)=l\left(1\right)=1$ is satisfied. Notably, every such path $\xi$ must intersect the set

$$\mathit{\partial }{\tilde{B}}_{k_0}:=\{(v,h)\in S_b\times {\mathbb{R}}^{+}\mid v_h\in \mathit{\partial }{B}_{k_0}\}.$$

Furthermore, it holds that $E_{\mu ,V}\left(v\right)\ge \beta$ for all $v\in \mathit{\partial }{B}_{k_0}$. Corresponding to the new path set $\tilde{\Gamma }$, the updated Mountain-Pass level is

$${\tilde{m}}_{V,b}:=\underset{\xi \in \tilde{\Gamma }}{inf}\underset{t\in [0,1]}{max}{\tilde{E}}_{\mu ,V}\left(\xi \left(t\right)\right).$$

Lemma 10. 

Suppose that $N>2s$, $\overline{p}\le p<2_s^{*}$, and (V0) holds in conjunction with Equation (41); then, $m_{V,b}={\tilde{m}}_{V,b}$.

Proof. 

For any $\xi \in \Gamma$, by the definition of $\tilde{\Gamma }$, we have $(\xi ,1)\in \tilde{\Gamma }$ and, for each $t\in (0,1)$,

$${\tilde{m}}_{V,b}\le \underset{\xi \in \Gamma }{inf}\underset{t}{max}{\tilde{E}}_{\mu ,V}(\xi \left(t\right),1)=\underset{\xi \in \Gamma }{inf}\underset{t}{max}{E}_{\mu ,V}\left(\xi \left(t\right)\right)=m_{V,b}.$$

Conversely, take any $\tilde{\xi }=(\xi ,l)\in \tilde{\Gamma }$, where $\xi \in \Gamma$, $l\in C([0,1],{\mathbb{R}}^{+})$, and $l\left(0\right)=l\left(1\right)=1$. Let ${\xi }_l\left(t\right):=\xi {\left(t\right)}_{l\left(t\right)}$ for $t\in [0,1]$. Then, ${\xi }_l\in \Gamma$, and we obtain

$$m_{V,b}\le \underset{t}{max}{E}_{\mu ,V}\left({\xi }_l\left(t\right)\right)=\underset{t}{max}{\tilde{E}}_{\mu ,V}\left(\tilde{\xi }\left(t\right)\right).$$

Since $\tilde{\xi }$ is arbitrary in $\tilde{\Gamma }$, taking the infimum over all $\tilde{\xi }$ yields

$$m_{V,b}\le \underset{\tilde{\xi }\in \tilde{\Gamma }}{inf}\underset{t}{max}{\tilde{E}}_{\mu ,V}\left(\tilde{\xi }\left(t\right)\right)={\tilde{m}}_{V,b}.$$

From ${\tilde{m}}_{V,b}\le m_{V,b}$ and $m_{V,b}\le {\tilde{m}}_{V,b}$, we have

$$m_{V,b}={\tilde{m}}_{V,b}.$$

□

4. Palais–Smale Sequence

In this section, we construct a bounded Palais–Smale sequence $\left\{v_n\right\}\subset S_b$ at the Mountain-Pass level $m_{V,b}$, which asymptotically satisfies the Pohozaev identity $P_{\mu ,V}\left(v_n\right)=o_n\left(1\right)$. Recall that $\left\{v_n\right\}\subset S_b$ is a Palais–Smale sequence for $E_{\mu ,V}{|}_{S_b}$ at level c if

$$E_{\mu ,V}\left(v_n\right)=c+o_n\left(1\right)\mathrm{and}{\parallel {\left(E_{\mu ,V}{|}_{S_b}\right)}^{\prime }\left(v_n\right)\parallel }_{{\left(T_{v_n}{S}_b\right)}^{*}}=o_n\left(1\right),$$

where

$$T_{v_n}{S}_b:=\left\{w\in H^s\left({\mathbb{R}}^N\right):{\int }_{{\mathbb{R}}^N}{v}_{n}w\mathrm{d}x=0\right\}.$$

With the help of Proposition 2, we obtain the following lemmas.

Lemma 11. 

Suppose $N>2s$, $\overline{p}\le p<2_s^{*}$, and $V\in C^1\left({\mathbb{R}}^N\right)$ satisfies (V0), (V1), and (V2). Then, there exists a Palais–Smale sequence $\left\{v_n\right\}\subset S_b$ for $E_{\mu ,V}{|}_{S_b}$ at the level $m_{V,b}$ such that

$$P_{\mu ,V}\left(v_n\right)\to 0\mathit{and}{\parallel v_n^{-}\parallel }_2\to 0\mathit{as}n\to \infty .$$

(45)

Proof. 

By the definition of $m_{V,b}$ and Lemma 10, there exists a minimizing sequence $\left\{{\xi }_n\right\}\subset \Gamma$ such that

$$m_{V,b}\le \underset{t\in [0,1]}{max}{E}_{\mu ,V}\left({\xi }_n\left(t\right)\right)<m_{V,b}+{\displaystyle \frac{1}{n}}.$$

Since $E_{\mu ,V}\left(\right|v\left|\right)\le E_{\mu ,V}\left(v\right)$ for all $v\in S_b$, we may replace ${\xi }_n$ by $|{\xi }_n|$ and assume ${\xi }_n\left(t\right)\ge 0$ for all $t\in [0,1]$.

Consider the augmented functional ${\tilde{E}}_{\mu ,V}:S_b\times {\mathbb{R}}^{+}\to \mathbb{R}$ defined by

$${\tilde{E}}_{\mu ,V}(v,h):=E_{\mu ,V}\left(v_h\right),$$

and apply Proposition 2 with

$$X=S_b\times {\mathbb{R}}^{+},K=\{(e_0,1),(e_1,1)\},\mathcal{F}=\{\mathrm{Im}\left(\tilde{\xi }\right):\tilde{\xi }\in \tilde{\Gamma }\},$$

$$D_n=\{({\xi }_n\left(t\right),1):t\in [0,1]\},{\sigma }_n={\displaystyle \frac{1}{n}}.$$

Then, there exist $\left\{(u_n,h_n)\right\}\subset S_b\times {\mathbb{R}}^{+}$ and a constant $c>0$ such that

$$\left\{\begin{array}{c}{m}_{V,b}\le {\tilde{E}}_{\mu ,V}(u_n,h_n)<m_{V,b}+\frac{1}{n},\hfill \\ \parallel d\left({\tilde{E}}_{\mu ,V}{|}_{S_b\times {\mathbb{R}}^{+}}\right)(u_n,h_n){\parallel }_{{\left(T_{(u_n,h_n)}(S_b\times {\mathbb{R}}^{+})\right)}^{*}}<c{n}^{-1/2},\hfill \\ {\mathrm{dist}}_{H^s\times \mathbb{R}}\left((u_n,h_n),D_n\right)<c{n}^{-1/2}.\hfill \end{array}\right.$$

(46)

In particular, from the last line, we have $h_n\to 1$ and ${\mathrm{dist}}_{H^s}(u_n,{\xi }_n\left([0,1]\right))\to 0$; hence, $\parallel u_n^{-}{\parallel }_2\to 0$ since ${\xi }_n\left(t\right)\ge 0$.

Next, by Lemma 1 and the definition of $P_{\mu ,V}$ in Equation (22), the scaling derivative satisfies

$${\displaystyle \frac{\mathit{\partial }}{\mathit{\partial }h}}{\tilde{E}}_{\mu ,V}(u,h)={\displaystyle \frac{1}{h}}{P}_{\mu ,V}\left(u_h\right),(u,h)\in S_b\times {\mathbb{R}}^{+}.$$

Therefore, the second line of Equation (46) yields

$$\left|{\displaystyle \frac{\mathit{\partial }{\tilde{E}}_{\mu ,V}}{\mathit{\partial }h}}(u_n,h_n)\right|={\displaystyle \frac{1}{h_n}}\left|P_{\mu ,V}\left({\left(u_n\right)}_{h_n}\right)\right|\underset{n\to \infty }{\to }0.$$

(47)

Finally, set

$$v_n:={\left(u_n\right)}_{h_n}\in S_b.$$

Then $E_{\mu ,V}\left(v_n\right)={\tilde{E}}_{\mu ,V}(u_n,h_n)=m_{V,b}+o_n\left(1\right)$ by Equation (46), and $P_{\mu ,V}\left(v_n\right)\to 0$ by Equation (47) and $h_n\to 1$. Moreover, since $u_n\to v_n$ in $H^s$ (because $h_n\to 1$ and the scaling map is continuous on $H^s$), the smallness of the constrained differential in Equation (46) implies

$$\parallel {\left(E_{\mu ,V}{|}_{S_b}\right)}^{\prime }\left(v_n\right){\parallel }_{{\left(T_{v_n}{S}_b\right)}^{*}}=o_n\left(1\right),$$

so $\left\{v_n\right\}$ is a Palais–Smale sequence for $E_{\mu ,V}{|}_{S_b}$ at level $m_{V,b}$. Finally, $\parallel v_n^{-}{\parallel }_2\to 0$ follows from $\parallel u_n^{-}{\parallel }_2\to 0$ and the fact that the scaling $u\mapsto u_h$ preserves the sign decomposition. □

By (V0)–(V1), we now prove that the above Palais–Smale sequence is bounded in $H^s\left({\mathbb{R}}^N\right)$.

Lemma 12. 

Let $N>2s$ and $\overline{p}\le p<2_s^{*}$. Suppose that $V\in C^1\left({\mathbb{R}}^N\right)$ and that (V0)–(V1) hold with ${\sigma }_1$ satisfying Equation (41), and with ${\sigma }_2$ satisfying the strict version of Equation (39) (if $\overline{p}<p<2_s^{*}$) or of Equation (40) (if $p=\overline{p}$). In addition, if $p=\overline{p}$, we assume that

$$\left|{\int }_{{\mathbb{R}}^N}\left(\frac{1}{2}(V\left(x\right)-V_{\infty })+\frac{1}{2_s^{*}s}W\left(x\right)\right)v^2\mathrm{d}x\right|\le {\sigma }_2{\parallel v\parallel }_{D^s}^2,\forall v\in H^s\left({\mathbb{R}}^N\right).$$

Let $\left\{v_n\right\}\subset S_b$ be a Palais–Smale sequence for $E_{\mu ,V}$ at the level $m_{V,b}$ such that $P_{\mu ,V}\left(v_n\right)\to 0$. Then, $\left\{v_n\right\}$ is bounded in $H^s\left({\mathbb{R}}^N\right)$.

Proof. 

Since $\parallel v_n{\parallel }_2=b$ for all n, it suffices to prove that $\parallel v_n{\parallel }_{D^s}$ is bounded. For convenience, set

$$a_n:=\parallel v_n{\parallel }_{D^s\left({\mathbb{R}}^N\right)}^2,b_n:={\int }_{{\mathbb{R}}^N}V\left(x\right)v_n^2\mathrm{d}x,c_n:={\parallel v_n\parallel }_p^p,$$

$$d_n:={\parallel v_n\parallel }_{2_s^{*}}^{2_s^{*}},e_n:={\int }_{{\mathbb{R}}^N}W\left(x\right)v_n^2\mathrm{d}x.$$

From $E_{\mu ,V}\left(v_n\right)=m_{V,b}+o_n\left(1\right)$, we have

$$\begin{array}{c}\hfill a_n+b_n-{\displaystyle \frac{2\mu }{p}}{c}_n-{\displaystyle \frac{2}{2_s^{*}}}{d}_n=2m_{V,b}+o_n\left(1\right),\end{array}$$

(48)

and, from $P_{\mu ,V}\left(v_n\right)=o_n\left(1\right)$—namely, Equation (22)—we obtain

$$\begin{array}{c}\hfill s{a}_n-e_n-s\mu {\gamma }_{p,s}{c}_n-s{d}_n=o_n\left(1\right).\end{array}$$

(49)

Case 1: $\overline{p}<p<2_s^{*}$. Since $p\le 2_s^{*}$ implies $p{\gamma }_{p,s}\le 2_s^{*}$, we have ${\displaystyle \frac{1}{2_s^{*}}}\le {\displaystyle \frac{1}{p{\gamma }_{p,s}}}$; hence,

$$\begin{array}{c}\hfill {\displaystyle \frac{2\mu }{p}}{c}_n+{\displaystyle \frac{2}{2_s^{*}}}{d}_n\le {\displaystyle \frac{2}{p{\gamma }_{p,s}s}}(s\mu {\gamma }_{p,s}{c}_n+s{d}_n)={\displaystyle \frac{2}{p{\gamma }_{p,s}s}}(s{a}_n-e_n)+o_n\left(1\right),\end{array}$$

(50)

where we use Equation (49) in the last equality. Combining Equation (48) with Equation (50) gives

$$2m_{V,b}+o_n\left(1\right)\ge \left(1-{\displaystyle \frac{2}{p{\gamma }_{p,s}}}\right)a_n+b_n+{\displaystyle \frac{2}{sp{\gamma }_{p,s}}}{e}_n.$$

By (V0) with $V_{\infty }=0$, we have $|b_n|\le {\sigma }_1{a}_n$, and, by (V1) (equivalently Equation (19) with $V_{\infty }=0$), we have

$$\left|b_n+{\displaystyle \frac{2}{sp{\gamma }_{p,s}}}{e}_n\right|\le 2{\sigma }_2{a}_n.$$

Therefore,

$$2m_{V,b}+o_n\left(1\right)\ge \left(1-{\displaystyle \frac{2}{p{\gamma }_{p,s}}}-2{\sigma }_2\right)a_n.$$

Under the strict assumption ${\sigma }_2<{\displaystyle \frac{1}{2}}-{\displaystyle \frac{1}{p{\gamma }_{p,s}}}$, the coefficient is positive; hence, $\left\{a_n\right\}$ is bounded.

Case 2: $p=\overline{p}$. From Equation (49), we have

$$\begin{array}{c}\hfill s{d}_n=s{a}_n-e_n-s\mu {\gamma }_{\overline{p},s}{c}_n+o_n\left(1\right).\end{array}$$

(51)

Substituting Equation (51) into $s\times$ Equation (48) yields

$$2s{m}_{V,b}+o_n\left(1\right)=\left(1-{\displaystyle \frac{2}{2_s^{*}}}\right)\left(s{a}_n-s\mu {\gamma }_{\overline{p},s}{c}_n\right)+s{b}_n+{\displaystyle \frac{2}{2_s^{*}}}{e}_n+o_n\left(1\right).$$

Using the fractional Gagliardo–Nirenberg inequality in Equation (11) with $p=\overline{p}$ and $\parallel v_n{\parallel }_2=b$, we obtain

$$c_n={\parallel v_n\parallel }_{\overline{p}}^{\overline{p}}\le C_{N,\overline{p},s}^{\overline{p}}{b}^{{\displaystyle \frac{4s}{N}}}{a}_n,\mathrm{and}{\gamma }_{\overline{p},s}={\displaystyle \frac{2}{\overline{p}}}.$$

Hence,

$$s{a}_n-s\mu {\gamma }_{\overline{p},s}{c}_n\ge s\left(1-{\displaystyle \frac{2\mu }{\overline{p}}}{C}_{N,\overline{p},s}^{\overline{p}}{b}^{{\displaystyle \frac{4s}{N}}}\right)a_n.$$

Moreover, by the additional assumption in the critical case (with $V_{\infty }=0$),

$$\left|{\displaystyle \frac{s}{2}}{b}_n+{\displaystyle \frac{1}{2_s^{*}}}{e}_n\right|\le s{\sigma }_2{a}_n,\mathrm{hence}\left|s{b}_n+{\displaystyle \frac{2}{2_s^{*}}}{e}_n\right|\le 2s{\sigma }_2{a}_n.$$

Therefore,

$$2s{m}_{V,b}+o_n\left(1\right)\ge \left[\left(1-{\displaystyle \frac{2}{2_s^{*}}}\right)s\left(1-{\displaystyle \frac{2\mu }{\overline{p}}}{C}_{N,\overline{p},s}^{\overline{p}}{b}^{{\displaystyle \frac{4s}{N}}}\right)-2s{\sigma }_2\right]a_n.$$

Under the strict assumption in Equation (40), the bracket is positive; hence, $\left\{a_n\right\}$ is also bounded in this case.

In both cases, $\left\{a_n\right\}$ is bounded, and, since $\parallel v_n{\parallel }_2=b$, we conclude that $\left\{v_n\right\}$ is bounded in $H^s\left({\mathbb{R}}^N\right)$. □

5. Proof of Theorems 3 and 4

In the previous sections, we have obtained a bounded Palais–Smale sequence $\left\{v_n\right\}\subset S_b$ for $E_{\mu ,V}{|}_{S_b}$ at the Mountain-Pass level $m_{V,b}$ such that

$$E_{\mu ,V}\left(v_n\right)=m_{V,b}+o_n\left(1\right),{\parallel {\left(E_{\mu ,V}{|}_{S_b}\right)}^{\prime }\left(v_n\right)\parallel }_{{\left(T_{v_n}{S}_b\right)}^{*}}=o_n\left(1\right),P_{\mu ,V}\left(v_n\right)=o_n\left(1\right).$$

We denote the associated Pohozaev manifold by

$${\mathcal{P}}_{\mu ,V}:=\{v\in S_b:P_{\mu ,V}\left(v\right)=0\}.$$

To conclude the proofs of Theorems 3 and 4, it remains to show that $\left\{v_n\right\}$ admits a strongly convergent subsequence in $H^s\left({\mathbb{R}}^N\right)$. Since V is not assumed to be radial, compactness cannot be recovered by restricting to $H_{\mathrm{rad}}^s\left({\mathbb{R}}^N\right)$; moreover, the presence of the critical exponent $2_s^{*}={\displaystyle \frac{2N}{N-2s}}$ yields a loss of compactness in $H^s\left({\mathbb{R}}^N\right)\hookrightarrow L^{2_s^{*}}\left({\mathbb{R}}^N\right)$. We use Lions’ concentration–compactness principle and a profile decomposition. A key input is the sharp Sobolev inequality Equation (12) with best constant $S_s>0$, together with the energy bound

$$m_{V,b}<m_b<{\displaystyle \frac{s}{N}}{S}_s^{{\displaystyle \frac{N}{2s}}},$$

which follows from Lemmas 2 and 9.

Lemma 13. 

Let $N>2s$ and $\overline{p}\le p<2_s^{*}$. Assume that $V\in C^1\left({\mathbb{R}}^N\right)$ and (V0), (V1), (V2), (V3) hold, with ${\sigma }_1$ satisfying Equation (41), and with ${\sigma }_2$ satisfying Equation (39) when $\overline{p}<p<2_s^{*}$ or Equation (40) when $p=\overline{p}$. Let $\left\{v_n\right\}\subset S_b$ be a Palais–Smale sequence for $E_{\mu ,V}{|}_{S_b}$ at level $m_{V,b}$ such that $P_{\mu ,V}\left(v_n\right)\to 0$. Then, up to a subsequence, there exist $v\in H^s\left({\mathbb{R}}^N\right)$ and $\lambda \in \mathbb{R}$ such that

$$v_n\rightharpoonup v\mathit{weakly}\mathit{in}{H}^s\left({\mathbb{R}}^N\right),{\lambda }_n\to \lambda ,$$

where $\left\{{\lambda }_n\right\}$ is the Lagrange multiplier sequence associated with $\left\{v_n\right\}$. If $v_n\nrightarrow v$ strongly in $H^s\left({\mathbb{R}}^N\right)$, then there exist an integer $k\in {\mathbb{N}}^{+}$, nontrivial functions $w^1,\dots ,w^k\in H^s\left({\mathbb{R}}^N\right)\setminus \left\{0\right\}$ solving Equation (23) with the same μ and with $\lambda <0$, and sequences $\left\{y_n^j\right\}\subset {\mathbb{R}}^N$ ($1\le j\le k$) such that $|y_n^j|\to \infty$ and $|y_n^j-y_n^i|\to \infty$ for $i\ne j$, and

$$\begin{array}{c}\hfill v_n=v+\sum _{j=1}^k{w}^j(·+y_n^j)+o_n\left(1\right)\mathit{in}{H}^s\left({\mathbb{R}}^N\right).\end{array}$$

(52)

Moreover,

$$\parallel v_n{\parallel }_2^2={\parallel v\parallel }_2^2+\sum _{j=1}^k{\parallel w^j\parallel }_2^2,E_{\mu ,V}\left(v_n\right)=E_{\mu ,V}\left(v\right)+\sum _{j=1}^k{E}_{\mu }\left(w^j\right)+o_n\left(1\right).$$

(53)

Proof. 

Up to a subsequence, we may assume that $v_n\rightharpoonup v$ in $H^s\left({\mathbb{R}}^N\right)$ and $v_n\to v$ a.e. in ${\mathbb{R}}^N$. Since $\left\{v_n\right\}$ is a Palais–Smale sequence for the constrained functional $E_{\mu ,V}{|}_{S_b}$, there exists a sequence $\left\{{\lambda }_n\right\}\subset \mathbb{R}$ such that

$$\begin{array}{c}\hfill {(-\Delta )}^s{v}_n+V\left(x\right)v_n-\mu |v_n{|}^{p-2}{v}_n-{\left|v_n\right|}^{2_s^{*}-2}{v}_n-{\lambda }_n{v}_n\to 0\mathrm{in}{H}^{-s}\left({\mathbb{R}}^N\right).\end{array}$$

(54)

Testing Equation (54) by $v_n$ and using $\parallel v_n{\parallel }_2^2=b^2$, we obtain

$$\begin{array}{c}\hfill \parallel v_n{\parallel }_{D^s}^2+{\int }_{{\mathbb{R}}^N}V\left(x\right)v_n^2\mathrm{d}x-\mu \parallel v_n{\parallel }_p^p-{\parallel v_n\parallel }_{2_s^{*}}^{2_s^{*}}-{\lambda }_n{b}^2=o_n\left(1\right).\end{array}$$

(55)

By Lemma 12, $\left\{v_n\right\}$ is bounded in $H^s\left({\mathbb{R}}^N\right)$; hence, up to a subsequence, ${\lambda }_n\to \lambda \in \mathbb{R}$.

Passing to the limit in Equation (54), we infer that v is a weak solution of Equation (25) with the parameter $\lambda$. In particular, by the sign information obtained in Lemma 5 (see also its proof), any nontrivial solution corresponds to $\lambda <0$; hence, either $v=0$ or $\lambda <0$.

Step 1: Excluding the case $v=0$. Assume $v=0$. Since $\left\{v_n^2\right\}$ is bounded in $L^{{\displaystyle \frac{N}{N-2s}}}\left({\mathbb{R}}^N\right)$ and $v_n\to 0$ almost everywhere, we have $v_n^2\rightharpoonup 0$ weakly in $L^{{\displaystyle \frac{N}{N-2s}}}\left({\mathbb{R}}^N\right)$. Fix $\epsilon >0$. After the harmless shift, $V_{\infty }=0$. Using (V2) (in particular, the $L^{{\displaystyle \frac{N}{2s}}}$-smallness at infinity), choose $R>0$ such that

$${\parallel V\parallel }_{L^{\frac{N}{2s}}({\mathbb{R}}^N\setminus B_R)}+{\parallel W\parallel }_{L^{\frac{N}{2s}}({\mathbb{R}}^N\setminus B_R)}\le \epsilon .$$

Then,

$$\begin{array}{c}\hfill {\int }_{{\mathbb{R}}^N}V\left(x\right)v_n^2\mathrm{d}x={\int }_{B_R}V\left(x\right)v_n^2\mathrm{d}x+{\int }_{{\mathbb{R}}^N\setminus B_R}V\left(x\right)v_n^2\mathrm{d}x.\end{array}$$

(56)

Since $v_n\rightharpoonup 0$ in $H^s\left({\mathbb{R}}^N\right)$ and the embedding $H^s\left(B_R\right)\hookrightarrow L^2\left(B_R\right)$ is compact, we have $v_n\to 0$ strongly in $L^2\left(B_R\right)$; hence,

$$\begin{array}{c}\hfill {\int }_{B_R}V\left(x\right)v_n^2\mathrm{d}x=o_n\left(1\right).\end{array}$$

(57)

Moreover,

$$\left|{\int }_{{\mathbb{R}}^N\setminus B_R}V\left(x\right)v_n^2\mathrm{d}x\right|\le {\parallel V\parallel }_{L^{\frac{N}{2s}}({\mathbb{R}}^N\setminus B_R)}{\parallel v_n^2\parallel }_{L^{\frac{N}{N-2s}}\left({\mathbb{R}}^N\right)}\le C\epsilon ,$$

Since $\epsilon$ is arbitrary, Equations (56) and (57) yield ${\int }_{{\mathbb{R}}^N}V\left(x\right)v_n^2\mathrm{d}x=o_n\left(1\right)$.

Similarly,

$$\begin{array}{c}\hfill {\int }_{{\mathbb{R}}^N}W\left(x\right)v_n^2\mathrm{d}x=o_n\left(1\right).\end{array}$$

(58)

Therefore,

$$E_{\mu ,V}\left(v_n\right)=E_{\mu }\left(v_n\right)+o_n\left(1\right),P_{\mu ,V}\left(v_n\right)=P_{\mu }\left(v_n\right)+o_n\left(1\right).$$

Since $P_{\mu ,V}\left(v_n\right)\to 0$, we obtain $P_{\mu }\left(v_n\right)\to 0$. Moreover, $m_{V,b}=E_{\mu ,V}\left(v_n\right)+o_n\left(1\right)=E_{\mu }\left(v_n\right)+o_n\left(1\right)$. If $\parallel v_n{\parallel }_{D^s}^2\to 0$, then, by Equation (55) (and $\parallel v_n{\parallel }_2=b$), we deduce $\parallel v_n{\parallel }_p^p\to 0$ and $\parallel v_n{\parallel }_{2_s^{*}}^{2_s^{*}}\to 0$; hence, $m_{V,b}=0$, contradicting Equation (43). Thus, up to a subsequence, there exists $c_0>0$ such that $\parallel v_n{\parallel }_{D^s}^2\ge c_0$. Applying Lemma 4 to $\left\{v_n\right\}\subset S_b$, we infer

$$m_b\le \underset{n\to \infty }{lim\; inf}{E}_{\mu }\left(v_n\right)=m_{V,b},$$

which contradicts Lemma 9. Hence, $v\ne 0$ and therefore $\lambda <0$.

Step 2: Profile decomposition when the convergence is not strong. Set $w_n^1:=v_n-v$. Then, $w_n^1\rightharpoonup 0$ in $H^s\left({\mathbb{R}}^N\right)$ and $w_n^1\to 0$ in $L_{\mathrm{loc}}^r\left({\mathbb{R}}^N\right)$ for every $2\le r<2_s^{*}$. Define

$$L:=\underset{n\to \infty }{lim\; inf}\underset{y\in {\mathbb{R}}^N}{sup}{\int }_{B_1\left(y\right)}{\left|w_n^1\right|}^2\mathrm{d}x.$$

If $L=0$, then the fractional Lions’ lemma (see ([28], Lemma 3.1)) yields $\parallel w_n^1{\parallel }_r\to 0$ for all $2<r<2_s^{*}$ (in particular, $\parallel w_n^1{\parallel }_p\to 0$). Using Brezis–Lieb-type splittings (see ([29], Lemma 1.32)), we have

$$\parallel v_n{\parallel }_{2_s^{*}}^{2_s^{*}}={\parallel v\parallel }_{2_s^{*}}^{2_s^{*}}+\parallel w_n^1{\parallel }_{2_s^{*}}^{2_s^{*}}+o_n\left(1\right),\parallel v_n{\parallel }_p^p={\parallel v\parallel }_p^p+{\parallel w_n^1\parallel }_p^p+o_n\left(1\right).$$

Moreover, if $L=0$, then, for every fixed $R>0$, one has $\parallel w_n^1{\parallel }_{L^2\left(B_R\right)}\to 0$. Indeed, $B_R$ can be covered by finitely many unit balls and the definition of L implies ${\int }_{B_1\left(y\right)}{\left|w_n^1\right|}^2\to 0$ uniformly in y; hence, ${\int }_{B_R}{\left|w_n^1\right|}^2\to 0$. Arguing as in Step 1 and using $V\left(x\right)\to 0$, $W\left(x\right)\to 0$ as $\left|x\right|\to \infty$, we obtain

$${\int }_{{\mathbb{R}}^N}V\left(x\right){\left(w_n^1\right)}^2\mathrm{d}x=o_n\left(1\right),{\int }_{{\mathbb{R}}^N}W\left(x\right){\left(w_n^1\right)}^2\mathrm{d}x=o_n\left(1\right),$$

and similarly the mixed terms satisfy

$${\int }_{{\mathbb{R}}^N}V\left(x\right)v{w}_n^1\mathrm{d}x=o_n\left(1\right),{\int }_{{\mathbb{R}}^N}W\left(x\right)v{w}_n^1\mathrm{d}x=o_n\left(1\right).$$

Since v is a weak solution of Equation (25), by Proposition 1, we have $P_{\mu ,V}\left(v\right)=0$. Together with $P_{\mu ,V}\left(v_n\right)\to 0$, the above splitting yields

$$P_{\mu }\left(w_n^1\right)=o_n\left(1\right),\mathrm{that}\mathrm{is}s\parallel w_n^1{\parallel }_{D^s}^2-s{\parallel w_n^1\parallel }_{2_s^{*}}^{2_s^{*}}=o_n\left(1\right),$$

because $\parallel w_n^1{\parallel }_p\to 0$ when $L=0$.

Set $a_n:={\parallel w_n^1\parallel }_{D^s}^2$. By the sharp Sobolev inequality Equation (12),

$$\parallel w_n^1{\parallel }_{2_s^{*}}^{2_s^{*}}\le S_s^{-\frac{2_s^{*}}{2}}{a}_n^{\frac{2_s^{*}}{2}}.$$

Hence,

$$a_n\le S_s^{-\frac{2_s^{*}}{2}}{a}_n^{\frac{2_s^{*}}{2}}+o_n\left(1\right),$$

so either $a_n\to 0$ or ${lim\; inf}_{n\to \infty }{a}_n\ge S_s^{\frac{N}{2s}}$. If $lim\; inf{a}_n\ge S_s^{\frac{N}{2s}}$, then, using $\parallel w_n^1{\parallel }_p\to 0$, we have

$$E_{\mu }\left(w_n^1\right)=\frac{1}{2}{a}_n-\frac{1}{2_s^{*}}{\parallel w_n^1\parallel }_{2_s^{*}}^{2_s^{*}}+o_n\left(1\right)=\frac{s}{N}{a}_n+o_n\left(1\right)\ge \frac{s}{N}{S}_s^{\frac{N}{2s}}+o_n\left(1\right),$$

and, since $E_{\mu ,V}\left(v\right)\ge 0$ by Lemma 6, we obtain

$$m_{V,b}=\underset{n\to \infty }{lim}{E}_{\mu ,V}\left(v_n\right)\ge \frac{s}{N}{S}_s^{\frac{N}{2s}},$$

contradicting $m_{V,b}<{\displaystyle \frac{s}{N}}{S}_s^{\frac{N}{2s}}$.

Now, subtract Equation (25) (solved by v) from Equation (54) and test the difference by $w_n^1$. Using ${\lambda }_n\to \lambda <0$, $\parallel w_n^1{\parallel }_{D^s}\to 0$, and the standard continuity of the nonlinear terms, we obtain

$$-\lambda \parallel w_n^1{\parallel }_2^2\le o_n\left(1\right),$$

hence, $\parallel w_n^1{\parallel }_2\to 0$. Therefore, $w_n^1\to 0$ strongly in $H^s\left({\mathbb{R}}^N\right)$, contradicting the assumption that $v_n$ does not converge strongly. Consequently, $L>0$.

Since $L>0$, we can choose $\left\{y_n^1\right\}\subset {\mathbb{R}}^N$ such that $|y_n^1|\to \infty$ and

$${\int }_{B_1\left(y_n^1\right)}{\left|w_n^1\right|}^2\mathrm{d}x\ge {\displaystyle \frac{L}{2}}.$$

Define the translated sequence ${\tilde{w}}_n^1\left(x\right):=w_n^1(x+y_n^1)$. Then, $\left\{{\tilde{w}}_n^1\right\}$ is bounded in $H^s\left({\mathbb{R}}^N\right)$ and, up to a subsequence,

$${\tilde{w}}_n^1\rightharpoonup w^1\mathrm{in}{H}^s\left({\mathbb{R}}^N\right),w^1\not\equiv 0.$$

Translating Equation (54) and using $V(·+y_n^1)\to 0$ in the sense required by (V0)–(V1), we pass to the limit and obtain that $w^1$ solves Equation (23) with the same $\mu$ and with $\lambda <0$.

Setting $w_n^2:=w_n^1-w^1(·+y_n^1)$ and iterating the above procedure yields finitely many profiles $w^1,\dots ,w^k$ and translations $y_n^j$ with mutual divergence, such that Equation (52) holds. The $L^2$-splitting in Equation (53) follows from the Brezis–Lieb lemma and the orthogonality of translations. Finally, Equation (53) for the energy follows from the same splitting together with Equations (57) and (58) and the fact that $V(·+y_n^j)\to 0$. □

Proof of Theorems 3 and 4. 

Assume the hypotheses of Theorems 3 and 4 hold. By Lemma 11, there exists a Palais–Smale sequence $\left\{v_n\right\}\subset S_b$ for $E_{\mu ,V}{|}_{S_b}$ at level $m_{V,b}$ satisfying Equation (45); by Lemma 12, it is bounded in $H^s\left({\mathbb{R}}^N\right)$. Up to a subsequence, $v_n\rightharpoonup v$ in $H^s\left({\mathbb{R}}^N\right)$. If the convergence were not strong, then, by Lemma 13, we would have $k\ge 1$ and

$$m_{V,b}=E_{\mu ,V}\left(v\right)+\sum _{j=1}^k{E}_{\mu }\left(w^j\right)+o_n\left(1\right).$$

Since v is a solution of Equation (25), Lemma 6 yields $E_{\mu ,V}\left(v\right)\ge 0$. Moreover, each $w^j\not\equiv 0$ solves Equation (23); hence, $P_{\mu }\left(w^j\right)=0$ and $w^j\in S_{\parallel w^j{\parallel }_2}$. Therefore,

$$E_{\mu }\left(w^j\right)\ge m_{\parallel w^j{\parallel }_2}.$$

Since $\parallel w^j{\parallel }_2\le b$ and $b\mapsto m_b$ is nonincreasing by Lemma 3, we have $m_{\parallel w^j{\parallel }_2}\ge m_b$; hence,

$$m_{V,b}\ge \sum _{j=1}^k{E}_{\mu }\left(w^j\right)\ge k{m}_b\ge m_b,$$

which contradicts Lemma 9. Hence, $v_n\to v$ strongly in $H^s\left({\mathbb{R}}^N\right)$.

Finally, since $\parallel v_n^{-}{\parallel }_2\to 0$ in Equation (45), we deduce $v\ge 0$ a.e. in ${\mathbb{R}}^N$. By standard regularity and the strong maximum principle for fractional Schrödinger-type equations (see ([30], B.2 Theorem and B.3 Lemma)), v is a classical solution and satisfies $v>0$ in ${\mathbb{R}}^N$. □

6. Discussion and Outlook

The present work addresses the existence of stationary normalized (mass-constrained) solutions to the fractional Schrödinger Equation (1) in ${\mathbb{R}}^N$, in the presence of a nonconstant potential and Sobolev-critical growth. Under assumptions (V0)–(V3), we set up a Pohozaev-manifold scheme compatible with the mass constraint ${\parallel v\parallel }_2=b$, which allows one to construct constrained Palais–Smale sequences at the Mountain-Pass level. A crucial feature is that, in the regimes covered by our hypotheses, the resulting minimax level can be kept below the fractional critical threshold $\frac{s}{N}{S}_s^{\frac{N}{2s}}$; this rules out Sobolev-critical bubbling in the subsequent concentration–compactness argument and yields positive normalized solutions.

In the $L^2$-critical case $p=\overline{p}$, the above mechanism is implemented by imposing a small-mass condition $b\in (0,b_0)$. In the $L^2$-supercritical range $\overline{p}<p<2_s^{*}$, compactness follows once the Mountain-Pass level lies below the same critical threshold, as ensured by our construction under the stated assumptions (including the smallness conditions on the potential terms appearing in (V0)–(V1)).

6.1. Limitations

Our compactness analysis hinges on the strict inequality $m_{V,b}<\frac{s}{N}{S}_s^{\frac{N}{2s}}$, which excludes Sobolev–critical bubbling. In the $L^2$–critical case, this is achieved through the small–mass restriction $b\in (0,b_0)$; it remains an open problem to remove such a constraint under the general assumptions (V0)–(V3). Moreover, we do not address uniqueness, multiplicity, or finer qualitative properties (such as symmetry breaking, orbital stability for the time–dependent dynamics, or sharp decay profiles), which would require tools beyond the variational compactness framework developed here.

6.2. Perspectives

Several directions appear natural. First, it would be of interest to weaken (V0)–(V3) by identifying verifiable classes of potentials (for instance, radial, periodic, or possibly singular Coulomb-type potentials) for which a Pohozaev-manifold approach still yields compactness. Second, one may study multiplicity and concentration phenomena by combining the present constrained setting with topological methods, such as Lusternik–Schnirelmann theory (see [31]) under suitable symmetry or localization assumptions on V. Third, extensions to bounded domains (with Dirichlet exterior conditions) or to models with magnetic fields would require a different treatment of boundary contributions and lie beyond the scope of this paper. Finally, while our arguments apply to arbitrary $s\in (0,1)$ and do not exploit any special feature of the case $s=\frac{1}{2}$, it would be interesting to connect the stationary theory developed here with dispersive properties of the associated time-dependent fractional Schrödinger equation, including stabilization mechanisms and energy decay estimates.