1 Introduction

The experimental evidence of the neutrino oscillation [1] indicate that neutrinos have tiny but non-zero masses and flavor mixings. Since the neutrinos are massless in the Standard Model (SM), we need to extend the SM to incorporate the non-zero neutrino masses and flavor mixings. From the low energy effective theory viewpoint, we may introduce a dimension-5 operator [2] involving the Higgs and lepton doublets, which violates the lepton number by two units. After the electroweak symmetry breaking, neutrinos acquire tiny Majorana masses suppressed by the scale of the dimension-5 operator. For example, in a type-I seesaw [3,4,5,6,7], heavy Majorana right-handed neutrinos (RHNs), which are singlet under the SM gauge group, are introduced, and the dimension-5 operator is generated by integrating them out.

If the RHNs have masses around 1 TeV or smaller, they can be produced at the Large Hadron Collider (LHC). The same-sign dilepton in the final state, which indicates a violation of the lepton number, is a smoking-gun signature of RHN production. Since RHNs are singlet under the SM gauge group, they can be produced only through their mixings with the SM neutrinos. To reproduce the observed light neutrino mass scale, \(m_\nu = \mathcal {O}(0.1)\) eV, through the type-I seesaw mechanism with heavy neutrino masses at 1 TeV, a natural value of the light-heavy neutrino mixing parameter is estimated to be \(\mathcal {O} (10^{-6})\). With a general parametrization for the neutrino Dirac mass matrix [8], this mixing parameter can be much larger. However, it turns out to be still small \(\lesssim 0.01\) [9] in order to simultaneously satisfy a variety of experimental constraints, such as the neutrino oscillation data, the electroweak precision measurements and the lepton-flavor violating processes. Hence, the production rate of RHNs at the LHC is very suppressed.

In the simplest type-I seesaw scenario, the SM singlet RHNs are introduced only for the neutrino mass generation. The gauged \(B-L\) extended SM [10,11,12,13,14,15] may be a more compelling scenario, which incorporates the type-I seesaw mechanism. In this model, the global \(\hbox {U}(1)_{B-L}\) (baryon number minus lepton number) symmetry in the SM is gauged and the RHNs play the essential role to cancel the gauge and mixed-gravitational anomalies. After the spontaneous breaking of the \(B-L\) symmetry, the RHNs acquire their Majorana masses, and the type-I seesaw mechanism is automatically implemented after the electroweak symmetry breaking. This model provides a new mechanism for the production of RHNs at the LHC. Since the \(B-L\) gauge boson (\(Z^\prime \)) couples with both the SM fermions and the RHNs, once the \(Z^\prime \) boson is resonantly produced at the LHC, its subsequent decay produces a pair of RHNs. Then, the RHNs decay into the SM particles through the light-heavy neutrino mixings: \(N \rightarrow W^{\pm } \ell ^{\mp } \), \(Z \nu _{\ell }\), \(Z {\overline{\nu }_\ell }\), \(h \nu _{\ell } \), and \(h {\overline{\nu }_\ell } \).

Recently, in the context of the gauged \(B-L\) models [16,17,18], the prospect of discovering the RHNs in the future LHC has been explored by simulation studies of a resonant \(Z^\prime \) boson production and its decay into a pair of RHNs. In Refs. [16, 18], the authors have considered the trilepton final states, \(Z^\prime \rightarrow NN \rightarrow \ell ^{\pm } \ell ^{\mp }\ell ^{\mp }\) \(\nu _{\ell }\) jj. For example, in Ref. [18] the signal-to-background ratio of \(S/{\sqrt{B}} \simeq 10\) has been obtained at the LHC with a 300 \(\hbox {fb}^{-1}\) luminosity, for the production cross section, \(\sigma (pp \rightarrow Z^\prime \rightarrow NN \rightarrow \ell ^{\pm } \ell ^{\mp }\ell ^{\mp } \nu _{\ell } jj) = 0.37\) fb (\(\ell = e\) or \(\mu \)), with the \(Z^\prime \) and the RHN masses fixed as \(m_{Z^\prime } = 4\) TeV and \(m_N = 400\) GeV, respectively. In Ref. [17], the authors have considered the final state with a same-sign dimuon and a boosted diboson, \(Z^\prime \rightarrow NN \rightarrow \ell ^{\pm } \ell ^{\pm }\) \(W^{\mp }W^{\mp }\).Footnote 1 For fixed masses, \(m_{Z^\prime } = 3\) TeV and \(m_N = m_{Z^\prime }/4\), they have obtained a cross section \(\sigma (pp \rightarrow Z^\prime \rightarrow NN \rightarrow \mu ^{\pm } \mu ^{\pm } W^{\mp }W^{\mp }) \simeq 0.1\) fb for a 5\(\sigma \) discovery at the LHC with a 300 \(\hbox {fb}^{-1}\) luminosity.

Since the RHNs are produced from the \(Z^\prime \) boson decay, in exploring the future prospect of discovering the RHNs we need to consider the current LHC bound on the \(Z^\prime \) boson production, which is already very severe.Footnote 2 The primary mode for the \(Z^\prime \) boson search at the LHC is via the dilepton final states, \( pp \rightarrow Z^\prime \rightarrow \ell ^+ \ell ^-\) (\(\ell =e\) or \(\mu \)). The current upper bound on the \(Z^\prime \) boson production cross section times its branching ratio into a lepton pair (\(e^+e^-\) and \(\mu ^+ \mu ^-\) combined) is given by \(\sigma (pp \rightarrow Z^\prime \rightarrow \ell ^+ \ell ^-) \lesssim 0.2\) fb, for \(m_{Z^{\prime }}\gtrsim 3\) TeV at the LHC Run-2 with 36.1 \(\hbox {fb}^{-1}\) luminosity [21]. Since the number of SM background events is very small for such a high \(Z^\prime \) boson mass region, we naively scale the current bound (at \(95 \%\) confidence level) to a future bound as

$$\begin{aligned} \sigma (pp \rightarrow Z^\prime \rightarrow \ell ^+ \ell ^-) \lesssim 0.2 \ \mathrm{fb}\times {\frac{36.1}{{\mathcal {L}}}}, \end{aligned}$$
(1)

where \(\mathcal{L}\) (in units of \(\hbox {fb}^{-1}\)) is a luminosity at the future LHC. Here, we have assumed the worst case scenario, namely, there is still no indication of the \(Z^\prime \) boson production in the future LHC data. For example, at the High-Luminosity LHC with \(\mathcal{L} =300\) \(\hbox {fb}^{-1}\), the bound becomes \(\sigma (pp \rightarrow Z^\prime \rightarrow \ell ^+ \ell ^-) \lesssim 2.4\times 10^{-2}\) fb. Note that this value is much smaller than the RHN production cross section of \(\mathcal{O}(0.1)\) fb obtained in the simulation studies. Taking into account the branching ratios \(NN \rightarrow \ell ^{\pm } \ell ^{\mp }\ell ^{\mp } \nu _{\ell } jj\) and \(NN \rightarrow \ell ^{\pm } \ell ^{\pm } W^{\mp }W^{\mp }\), the original production cross section \(\sigma (pp \rightarrow Z^\prime \rightarrow NN)\) must be rather large. Therefore, an enhancement of the branching ratio \(\mathrm{BR}(Z^\prime \rightarrow NN)\) over \(\mathrm{BR}(Z^\prime \rightarrow \ell ^+ \ell ^-)\) is crucial for the discovery of the RHNs in the future.

In the worst case scenario with the 300 \(\hbox {fb}^{-1}\) luminosity, we estimate an enhancement factor necessary to obtain \(\sigma (pp \rightarrow Z^\prime \rightarrow NN \rightarrow \ell ^{\pm } \ell ^{\mp }\ell ^{\mp } \nu _{\ell } jj)\) and \(\sigma (pp \rightarrow Z^\prime \rightarrow NN \rightarrow \mu ^{\pm } \mu ^{\pm }\) \(W^{\mp }W^{\mp })= \mathcal{O}(0.1)\) fb, while \(\sigma (pp \rightarrow Z^\prime \rightarrow \ell ^+ \ell ^-) \lesssim 2.4\times 10^{-2}\) fb. For \(m_N \gg m_W = 80.4 \) GeV, \(m_Z= 91.2\) GeV, and \(m_h = 125.09\) GeV, we estimate the branching ratios as \(\text {BR}(N\rightarrow W \ell ) \simeq 0.5\) and \(\text {BR}(N\rightarrow Z \nu ) \simeq \text {BR}(N\rightarrow h \nu ) \simeq 0.25\), where we have considered one generation only. With \(\text {BR}(W\rightarrow \ell \nu ) \simeq 0.1\), \(\text {BR}(W\rightarrow jj) \simeq 0.7\), \(\text {BR}(Z \rightarrow \ell ^+ \ell ^-) \simeq 0.034\), \(\text {BR}(Z \rightarrow \nu \nu ) \simeq 0.2\), and \(\text {BR}(Z \rightarrow jj) \simeq 0.7\), we estimate \(\mathrm{BR}( N N \rightarrow \ell ^+ \ell ^-\ell ^- \nu jj)=\mathrm{BR}( N N \rightarrow \ell ^- \ell ^+\ell ^+ \nu jj)\simeq 0.04\) and \(\mathrm{BR}(N N \rightarrow \ell ^\pm \ell ^\pm W^\mp W^\mp ) \simeq 0.125\). Hence, in order to obtain \(\sigma (pp \rightarrow Z^\prime \rightarrow N N \rightarrow \ell ^{\pm } \ell ^{\mp }\ell ^{\mp } \nu _{\ell } jj) \gtrsim 0.37\) fb [18] and \(\sigma (pp \rightarrow Z^\prime \rightarrow NN \rightarrow \ell ^{\pm } \ell ^{\pm }W^{\mp }W^{\mp } \gtrsim 0.1\) fb [17], we find \(\sigma (pp \rightarrow Z^\prime \rightarrow N N) \gtrsim 4.62\) fb and 0.8 fb, respectively. Hence, the enhancement factors we need are

$$\begin{aligned} \frac{\text {BR}(Z^\prime \rightarrow N N)}{\text {BR}(Z^\prime \rightarrow \ell ^+ \ell ^-)} \gtrsim 192\; \mathrm {and}\; 33.3, \end{aligned}$$
(2)

respectively. Even for the same sign dilepton final states, we have found that a huge enhancement factor is required. Note that we only have \(\frac{\text {BR}(Z^\prime \rightarrow NN)}{\text {BR}(Z^\prime \rightarrow \ell ^+ \ell ^-)} \simeq 0.5\) in the minimal \(B-L\) model.

In this paper we consider a simple extension of the SM which can realize the branching ratio \(\text {BR}(Z^\prime \rightarrow NN) \gg \text {BR}(Z^\prime \rightarrow \ell ^+ \ell ^-)\). The model is based on the gauge group, \(\hbox {SU}(3)_c \times \hbox {SU}(2)_L \times \hbox {U}(1)_Y\times \hbox {U}(1)_X\), where \(\hbox {U}(1)_X\) is a generalization of \(\hbox {U}(1)_{B-L}\) such that the \(\hbox {U}(1)_{X}\) charges of particles are realized as a linear combination of the SM \(\hbox {U}(1)_Y\) and \(\hbox {U}(1)_{B-L}\) charges (the so-called non-exotic \(\hbox {U}(1)_X \) model [22]). Three generations of the RHNs are added to cancel the gauge and the gravitational anomalies. We consider two cases for the \(B-L\) charge assignment for the RHNs: the conventional and the alternative cases. In the conventional case, a \(B-L\) charge \(-1\) is assigned to all three RHNs, while in the alternative case, a \(B-L\) charge \(-4\) is assigned to two of the RHNs and \(+5\) for the third one.

In our recent paper [23], we considered the minimal \(\hbox {U}(1)_X\) model with the conventional charge assignment and pointed out that the model can yield a significant enhancement of the branching ratio of \(Z^\prime \) boson to a pair of RHNs. We focused on the same-sign dimuon final state which is a smoking gun signature of Majorana RHNs production at the LHC. With such an enhancement and a realistic model-parameter choice to reproduce the neutrino oscillation data, we concluded that the possibility of discovering the RHNs in the future implies that the LHC experiments will discover the \(Z^\prime \) boson well before the RHNs. In this paper, we extend the analysis in our previous paper and perform a general parameter scan to evaluate the maximum production rate of the same-sign dilepton final state at the LHC, while reproducing the neutrino oscillation data. We also consider the alternative charge assignment and find a huge enhancement of the branching ratio of \(Z^\prime \) boson to a pair of RHNs compared to the conventional case. Performing a general parameter scan for this case, we find a possibility of discovering the RHNs even before the \(Z^\prime \) boson at the future LHC experiments.

The paper is organized as follows. In the next section, we present the minimal \(\hbox {U}(1)_X\) model with a conventional charge assignment. After considering the production of the RHNs, we discuss the prospect of discovering the RHNs through their pair production from the decay of \(\hbox {U}(1)_X\) gauge boson (\(Z^\prime \)) at the future LHC experiments. In Sect. 3, we present the minimal \(\hbox {U}(1)_X\) model with an alternative charge assignment, and discuss the prospect of discovering the RHNs in this case. In Sect. 4, we consider the RHN decay process in details and employ a general parametrization for the neutrino Dirac mass matrix to reproduce the neutrino oscillation data. Performing general parameter scans, we evaluate the maximum branching ratio into the signal process, \(NN \rightarrow \ell ^\pm \ell ^\pm W^\mp W^\mp \), and discuss the prospect of discovering the RHN at the future LHC in the minimal \(\hbox {U}(1)_X\) model with both the conventional and the alternative charge assignments. Section 5 is devoted to conclusions.

2 Minimal \(\hbox {U}(1)_X\) model

We first consider the minimal \(\hbox {U}(1)_X\) extension of SM.Footnote 3 The model is based on the gauge group, \(\hbox {SU}(3)_c \times \hbox {SU}(2)_L\times \hbox {U}(1)_Y\times \hbox {U}(1)_X\), where \(\hbox {U}(1)_X\) is a generalization of \(\hbox {U}(1)_{B-L}\) such that the \(\hbox {U}(1)_X\) is a generalization of \(\hbox {U}(1)_{B-L}\) such that the \(\hbox {U}(1)_{X}\) charges of particles are realized as a linear combination of the SM \(\hbox {U}(1)_Y\) and \(\hbox {U}(1)_{B-L}\) charges (the so-called non-exotic \(\hbox {U}(1)_X\) model [22]). The structure of the theory is the same as the \(B-L\) model except for a \(\hbox {U}(1)_X\) charge assignment. The particle content is listed in Table 1. In addition to the SM particle content, this model includes three generations of RHNs (\(N^i_R\)) required for gauge anomaly cancellations, a new Higgs field (\(\Phi \)) which breaks the \(\hbox {U}(1)_X\) gauge symmetry, and a \(\hbox {U}(1)_X\) gauge boson (\(Z^\prime \)). The \(\hbox {U}(1)_X\) charges are defined in terms of two real parameters \(x_{H}\) and \(x_{\Phi }\), which are the \(\hbox {U}(1)_X\) charges associated with H and \(\Phi \), respectively. In this model, \(x_{\Phi }\) always appears as a product with the \(\hbox {U}(1)_{X}\) gauge coupling and is not an independent free parameter, which we fix to be \(x_{\Phi }=1\) throughout this paper. Hence, \(\hbox {U}(1)_X\) charges of the particles are defined by a single free parameter \(x_H\). Note that this model is identical to the minimal \(B-L\) model in the limit of \(x_{H}=0\).

Table 1 Particle content of the \(\hbox {U}(1)_X\) model, where \(i=1, 2, 3\) are generation indices. Without loss of generality, we fix \(x_{\Phi }=1\) throughout this paper

In the minimal \(\hbox {U}(1)_X\) model, the Yukawa sector of the SM is extended to include

$$\begin{aligned} {\mathcal {L}} _{Y}\supset -\sum _{i=1}^{3} \sum _{j=1}^{3} Y_{D}^{ij} \overline{\ell _{L}^{i}} H N_{R}^{j}-\frac{1}{2} \sum _{i=1}^{3} Y_{N}^{k} \Phi \overline{N_{R}^{k \ c}} N_{R}^{k}+ \hbox {h.c.},\nonumber \\ \end{aligned}$$
(3)

where the first and second terms are the Dirac and Majorana Yukawa couplings. Here we use a diagonal basis for the Majorana Yukawa coupling without loss of generality. We assume a suitable Higgs potential for \(\phi \) and H to develop their vacuum expectation values, \({v_\Phi }\) and \( {v_h} =246\) GeV, respectively. After the \(\hbox {U}(1)_X\) and the electroweak symmetry breakings, \(\hbox {U}(1)_X\) gauge boson mass, the Majorana masses for the RHNs, and neutrino Dirac masses are generated:

$$\begin{aligned} m_{Z^\prime }= & {} g_X \sqrt{4 v_\Phi ^2+ \frac{1}{4}x_H^2 v_h^2} \simeq 2 g_X v_\Phi ,\quad m_{N^i}=\frac{Y_N^i}{\sqrt{2}} v_\Phi , \nonumber \\ m_{D}^{ij}= & {} \frac{Y_{D}^{ij}}{\sqrt{2}} v_h, \end{aligned}$$
(4)

where \(g_X\) is the \(\hbox {U}(1)_X\) gauge coupling, and we have used the LEP constraint, \({v_\Phi }^2 \gg {v_h}^2\) [35,36,37].

Fig. 1
figure 1

For the minimal \(\hbox {U}(1)_X\) model, the left panel shows the branching ratios of \(Z^{\prime }\) as a function of \(x_H\) with a fixed \(m_{ Z^{\prime }} = 3\) TeV. The solid lines correspond to \(m_{N^1} = m_{ Z^{\prime }}/4\) and \(m_{N^{2,3}} > m_{ Z^{\prime }}/2\); the dashed (dotted) lines correspond to \(m_{N^{1,2}} = m_{ Z^{\prime }}/4\) and \(m_{N^{3}} > m_{ Z^{\prime }}/2\) (\(m_{N^{1,2,3}} = m_{ Z^{\prime }}/4\) ). From top to bottom, the solid (red, black and blue) lines at \(x_H = -1\) are the branching ratios to the first generations of jets (up and down quarks), RHNs, and charged leptons, respectively. The lines for the RHN final states correspond to the sum of the branching ratio to all possible RHNs. In the right panel, we show the ratio of the partial decay widths of \(Z^\prime \) boson into RHNs and dilepton final states. The line codings are the same as in the left panel

Let us now consider the RHN production via \(Z^{\prime }\) boson decay. The \(Z^{\prime }\) boson decay width into a pair of SM chiral fermions (\(f_L\)) is given by

$$\begin{aligned} \Gamma ({Z^{\prime }\rightarrow {\overline{f_L}} f_L})= & {} \frac{N_c g_X^2 }{24 \pi } Q_{f_L}^2 m_{Z^{\prime }} \left( 1-\frac{4m^2_f}{{m^2_{Z^\prime }}}\right) ^{1/2}\nonumber \\&\times \left( 1-2\frac{m^2_f}{{m^2_{Z^\prime }}}\right) \simeq \frac{N_c g_X^2 }{24 \pi } Q_{f_L}^2 m_{Z^{\prime }}, \end{aligned}$$
(5)

where \(N_c = 1 (3)\) is the color factor for lepton (quark), \(m_f\) (\( Q_{f_L}\)) is the mass (charge) of the SM fermions, and we have used \(m_{f_L}^2 \ll m^2_{Z^\prime }\) in the final expression. Similarly, the partial \(Z^{\prime }\) boson decay width into a pair of single generation of Majorana RHNs is given by

$$\begin{aligned} \Gamma (Z^{\prime }\rightarrow N N) = \frac{g_X^2 }{24\pi } Q^2_{N_R} m_{Z^{\prime }} \left( 1-\frac{4 m^2_N}{{m^2_{Z^\prime }}}\right) ^{3/2}, \end{aligned}$$
(6)

where, \(m_N\) and \(Q_{N_R}\) are the mass and the \(\hbox {U}(1)_X\) charge of the RHN, respectively.

In the left panel of Fig. 1, we show the \(Z^{\prime }\) branching ratios for the minimal \(\hbox {U}(1)_X\) model with a fixed \(m_{Z^\prime } = 3\) TeV. The solid lines correspond to \(m_{N^1} =m_{ Z^{\prime }}/4 \) and \(m_{N^{2,3}} > m_{ Z^{\prime }}/2\); the dashed (dotted) line corresponds to \(m_{N^{1,2}} = m_{ Z^{\prime }}/4\) and \(m_{N^{3}} > m_{ Z^{\prime }}/2\) (\(m_{N^{1,2,3}} = m_{ Z^{\prime }}/4\)). For the SM final states, we show branching ratios to only the first generation dilepton and jets (sum of the jets from up and down quarks). The lines for the RHN final states correspond to the sum of the branching ratio to all possible RHNs. The plot shows the enhancement of the branching ratios into RHNs around \(x_H = -0.8\), with the maximum values of the branching ratios, 0.09, 0.16, and 0.23, for the cases with one, two, and three generations of RHNs, respectively. For the minimal \(B-L\) model (\(x_H = 0\)), the branching ratios are only 0.05, 0.09, and 0.13, respectively.

As discussed in Sect. 1, the discovery of RHNs at the collider via the \(Z^\prime \) decay requires some enhancement of the RHN production cross section, because the LHC Run-2 results already set the very severe upper bound on the \(Z^\prime \) production cross section with the dilepton final states. To see how much enhancement can be achieved in the minimal \(\hbox {U}(1)_X\) model, let us now consider a ratio of the partial decay widths into a pair of NN and dilepton final states, which is nothing but the ratio of the NN and dilepton production cross section. Using Eqs. (5) and (6), this ratio is given by

$$\begin{aligned} \frac{\Gamma (Z^{\prime }\rightarrow N N)}{\Gamma ({Z^{\prime }\rightarrow {\bar{\ell }} \ell })} = \frac{4 Q^2_{N_R}}{8 + 12 x_H + 5 x_H^2} \left( 1-\frac{4 m^2_N}{{m^2_{Z^\prime }}}\right) ^{3/2}, \end{aligned}$$
(7)

for only one generation of RHNs and charged leptons in the final states.

In the right panel of Fig. 1, we show the ratio as a function of \(x_H\). We find the peaks at \(x_H= -1.2\) with the maximum values of 3.25, 6.50, and 9.75, respectively.Footnote 4 Although we have obtained remarkable enhancement factors, these are not large enough, compared to the values required in the worst case scenario (see Eq. (2)). Since the enhancement required for the trilepton final states is extremely large, we focus on the same sign dilepton and diboson final states in the rest of this section.

Fig. 2
figure 2

The plot shows the luminosity required to obtain 25 signal events of the \(Z^\prime \) boson as a function of \(x_H\), for fixed values of \(m_{ Z^{\prime }} = 3\) TeV and \(\text {BR}(N\rightarrow W \mu ) \simeq 0.5\). The solid lines correspond to \(m_{N^1} = m_{ Z^{\prime }}/4\) and \(m_{N^{2,3}} > m_{ Z^{\prime }}/2\); the dashed (dotted) lines correspond to \(m_{N^{1,2}} = m_{ Z^{\prime }}/4\) and \(m_{N^{3}} > m_{ Z^{\prime }}/2\) (\(m_{N^{1,2,3}} = m_{ Z^{\prime }}/4\))

Let us now consider an optimistic case and assume that the \(Z^\prime \) boson has been discovered at the LHC. In this case, we remove the constraint \(\sigma (pp \rightarrow Z^\prime \rightarrow \ell ^+ \ell ^-) \lesssim 2.4\times 10^{-2}\) fb. According to [17], the cross section required for the \(5\sigma \) discovery of the RHNs at the LHC with a 300 \(\hbox {fb}^{-1}\) luminosity is \(\sigma (pp \rightarrow Z^\prime \rightarrow NN \rightarrow \mu ^{\pm } \mu ^{\pm } W^{\mp }W^{\mp }) \simeq 0.1\) fb. Although it is difficult for us to evaluate systematic errors, we here very naively require ad-hoc benchmark number of signal events to be 25 for the discovery of the \(Z^\prime \) boson production, since the number of SM background events for a high \(Z^\prime \) boson mass region (\(m_{Z^\prime }\gtrsim 3\) TeV) is very small. Hence, we estimate the luminosity (\({\mathcal L}\)) for 25 signal events of the \(Z^\prime \) boson production as follows:

$$\begin{aligned} \frac{\sigma (pp \rightarrow Z^\prime \rightarrow NN \rightarrow \mu ^{\pm } \mu ^{\pm }W^{\mp }W^{\mp })}{\sigma (pp \rightarrow Z^\prime \rightarrow \ell ^+ \ell ^-)} \simeq \frac{0.1}{\frac{25}{{\mathcal L}}}. \end{aligned}$$
(8)

For a degenerate mass spectrum for the RHNs, \(\sigma (pp \rightarrow Z^\prime \rightarrow NN \rightarrow \mu ^{\pm } \mu ^{\pm }W^{\mp }W^{\mp }) = \sigma (pp \rightarrow Z^\prime \rightarrow N_{m}^i N_m^i ) \times \sum _{i}\mathrm{BR}(N_{m}^i N_m^i \rightarrow \mu ^\pm \mu ^\pm W^\mp W^\mp )\), and we obtain

$$\begin{aligned} {\mathcal L} (\mathrm{fb}^{-1})\simeq & {} 250 \times \sum _{i=1}\mathrm{BR}(N_{m}^i N_m^i \rightarrow \mu ^\pm \mu ^\pm W^\mp W^\mp ) \nonumber \\&\times \, \frac{\Gamma ( Z^\prime \rightarrow N_{m}^i N_m^i )}{\Gamma (Z^\prime \rightarrow \ell ^+ \ell ^-)}, \end{aligned}$$
(9)

where \(\frac{\Gamma ( Z^\prime \rightarrow N_{m}^i N_m^i )}{\Gamma (Z^\prime \rightarrow \ell ^+ \ell ^-)}\) is shown in the right panel of Fig. 1.

For the fixed values of \(m_{ Z^{\prime }} = 3\) TeV and \(\text {BR}(N\rightarrow W \mu ) \simeq 0.5\), we employ Eq. (9) and show the luminosity (\({\mathcal L}\)) as a function of \(x_H\) in Fig. 2. The solid lines correspond to \(m_{N^1} = m_{ Z^{\prime }}/4\) and \(m_{N^{2,3}} > m_{ Z^{\prime }}/2\), while the dashed (dotted) lines correspond to \(m_{N^{1,2}} = m_{ Z^{\prime }}/4\) and \(m_{N^{3}} > m_{ Z^{\prime }}/2\) (\(m_{N^{1,2,3}} = m_{ Z^{\prime }}/4\) ). Hence, \(x_H\) is constrained to be in the range of \(-2\lesssim x_H \lesssim 0\). For example, let us consider the case of \(x_H = -1.2\) for which the ratio \(\Gamma (Z^{\prime }\rightarrow N N)/\Gamma ({Z^{\prime }\rightarrow {\bar{\ell }} \ell })\) reaches the maximum values of 3.25, 6.50, and 9.75 for one, two, and three degenerate RHNs, respectively. Hence, we obtain the luminosities \({{\mathcal L}}(\mathrm{fb}^{-1}) \simeq 102\), 203 and 305 for one, two and three generations of degenerate RHNs, respectively. These luminosities will be reached in the near future.

3 Alternative \(\hbox {U}(1)_X\) model

There is another way to assign the \(B-L\) charges for the three RHNs to achieve gauge anomaly cancellations. The \(B-L\) charge \(-4\) is assigned to the first two generation of RHNs (\(N^{1,2}\)), while \(-5\) for \(N^3\) [38]. In addition to the SM particle content, the new particle content of this “alternative \(\hbox {U}(1)_X\) model” is listed in Table 2. The \(\hbox {U}(1)_X\) charge assignment for the SM particles is exactly the same as in the minimal \(\hbox {U}(1)_X\) model. Here, we have introduced additional scalar fields, \(H_E\) and \(\Phi _{A,B}\).Footnote 5 The new Higgs doublet \(H_E\) generates the Dirac masses for the neutrinos, while the singlet scalars \(\Phi _A\) and \(\Phi _B\) generate Majorana masses for \(N_R^{1,2}\) and \(N^3_R\), respectively.

Table 2 New particle content of the alternative \(\hbox {U}(1)_X\) model
Fig. 3
figure 3

For the alternative \(\hbox {U}(1)_X\) model, the left panel shows the branching ratios of \(Z^{\prime }\) as a function of \(x_H\) with a fixed \(m_{ Z^{\prime }} = 3\) TeV. The solid lines correspond to \(m_{N^1} = m_{ Z^{\prime }}/4\) and \(m_{N^{2}} > m_{ Z^{\prime }}/2\), and the dashed lines correspond to \(m_{N^{1,2}} = m_{ Z^{\prime }}/4\). From top to bottom, the solid (red, black and blue) lines at \(x_H = -1\) are the branching ratios to the first generations of jets (up and down quarks), RHNs, and charged leptons, respectively. The lines for the RHN final states correspond to the sum of the branching ratio to all possible RHNs. In the right panel, we show the ratio of the partial decay widths of \(Z^\prime \) boson into RHNs and dilepton final states. The line codings are the same as in the left panel

The Yukawa sector of the SM is extended to include

$$\begin{aligned}&{\mathcal {L}} _{Y} \supset -\sum _{i=1}^{3} \sum _{j=1}^{2} Y_{D}^{ij} \overline{\ell _{L}^{i}} H_E N_{R}^{j}-\frac{1}{2} \sum _{k=1}^{2} Y_{N}^{k} \Phi _A \overline{N_{R}^{k^{c}}} N_{R}^{k}+ \hbox {h.c.} \nonumber \\&\quad -\,\frac{1}{2} Y_{N}^{3} \Phi _B \overline{N_{R}^{3^{c}}} N_{R}^{3}+ \hbox {h.c.} \end{aligned}$$
(10)

We assume a suitable scalar potential for H, \(H_E\), \(\Phi _{A}\), and \(\Phi _B\), in which these scalars develop their vacuum expectation values as follows:

$$\begin{aligned} \langle H \rangle= & {} \left( \begin{array}{c} \frac{1}{\sqrt{2}}v_h \\ 0 \end{array} \right) ,\quad \langle H_E \rangle = \left( \begin{array}{c} \frac{1}{\sqrt{2}} \tilde{v}_{h}\\ 0 \end{array} \right) , \nonumber \\ \langle \Phi _A \rangle= & {} \frac{v_{A}}{\sqrt{2}},\quad \langle \Phi _B \rangle = \frac{v_{B}}{\sqrt{2}}, \end{aligned}$$
(11)

where we require that \(v_h^2 + \tilde{v}^2_h = (246 \; \mathrm{GeV})^2\). Associated with the \(\hbox {U}(1)_X\) symmetry breaking, the RHNs and the \(\hbox {U}(1)_X\) gauge boson (\(Z^\prime \)) acquire their masses as

$$\begin{aligned} m_N^{1,2}= & {} \frac{Y_N^{1,2}}{\sqrt{2}} v_A,\quad m_N^{3}=\frac{Y_N^{3}}{\sqrt{2}} v_B, \nonumber \\ m_{Z^\prime }= & {} g_X \sqrt{64 v_{A}^2+ 100 v_{B}^2+ \frac{1}{4} x_H^2 v_h^2 + \left( -\frac{1}{2} x_H +3\right) ^2 {\tilde{v}}_h^2} \nonumber \\\simeq & {} g_X \sqrt{64 v_{A}^2+ 100 v_{B}^2}. \end{aligned}$$
(12)

After the electroweak symmetry breaking, the neutrino Dirac masses,

$$\begin{aligned} m_{D}^{ij}=\frac{Y_{D}^{ij}}{\sqrt{2}} \tilde{v}_h, \end{aligned}$$
(13)

are generated, and hence the seesaw mechanism is automatically implemented.

Let us now consider the branching ratios for \(Z^\prime \) decay. Note that in the alternative \(\hbox {U}(1)_X\) model, the charge assignment ensures the stability of \(N_R^3\) and it is naturally a dark matter (DM) candidate [41]. We may consider the scenario where the DM particle \(N^3\) mainly communicates with the SM sector via \(Z^\prime \) boson exchange (\(Z^\prime \) portal DM). In this case, we expect that the relic abundance constraint leads to \(m_N^3 \simeq m_{Z^\prime }/2\). In the following, we consider this case and the partial decay width of the \(Z^\prime \) into \(N^3\) is neglected. The \(Z^{\prime }\) boson decay width formulas are given by Eqs. (5) and (6). In the alternative \(\hbox {U}(1)_X\) model, \(Q_{N_R} = - 4\) for \(N_R^{1,2}\) in Eq. (6).

For the alternative \(\hbox {U}(1)_X\) model with a fixed \(m_{ Z^{\prime }} = 3\) TeV, we show the \(Z^{\prime }\) branching ratios In the left panel of Fig. 3. The solid lines correspond to \(m_{N^1} = m_{ Z^{\prime }}/4\) and \(m_{N^{2,}} > m_{ Z^{\prime }}/2\). The dashed lines correspond to \(m_{N^{1,2}} = m_{ Z^{\prime }}/4\). For the SM final states, we show branching ratios to only the first generation dilepton and jets (sum of the jets from up and down quarks). The lines for the RHN final states correspond to the sum of the branching ratio to all possible RHNs. The plot shows the enhancement of RHNs branching ratios around \(x_H = -0.8\), with the maximum values of the branching ratios, 0.612 and 0.760, for the cases with one and two generations of RHNs, respectively. Note that even for the \(B-L\) limit (\(x_H = 0\)), the branching ratios are remarkably enhanced, 0.444 and 0.615, compared to those obtained for the conventional charge assignment, 0.05 and 0.09, respectively.

In the right panel, we show the ratio of the partial decay widths into a pair of NN and dilepton final states (see Eq. (7)). For \(\hbox {U}(1)_X\) model with alternative charge assignment, we find the peaks in the ratio at \(x_H= -1.2\), with the maximum values of 52.0 and 104, respectively. Note that even for the \(B-L\) limit (\(x_H = 0\)), we have significant enhancements for the ratios of the partial decay widths with the maximum values of 5.20 and 10.4, respectively, compared to 0.5 for the conventional charge assignment. The maximum values of the enhancement factor for \(x_H=-1.2\) are sufficiently large for the RHN discovery with a same-sign dimuon and a boosted diboson final state (see Eq. (2)).

Fig. 4
figure 4

The plot shows the luminosity required to obtain 25 signal events of the \(Z^\prime \) boson as a function of \(x_H\), for fixed values of the \(m_{ Z^{\prime }} = 3\) TeV and \(\text {BR}(N\rightarrow W \mu ) \simeq 0.5\). The solid line corresponds to \(m_{N^1} = m_{ Z^{\prime }}/4\) and \(m_{N^{2}} > m_{ Z^{\prime }}/2\), while the dashed line corresponds to \(m_{N^{1,2}} = m_{ Z^{\prime }}/4\). The vertical solid line marks the \(B-L\) limit (\(x_H = 0\)). The solid horizontal line corresponds to a luminosity value of 300 \(\mathrm{fb}^{-1}\) required for the discovery of RHNs at the future LHC with a dimuon and a diboson final states

Let us now consider the luminosity required for 25 signal events of the \(Z^\prime \) boson production. For fixed values of the \(m_{ Z^{\prime }} = 3\) TeV and \(\text {BR}(N\rightarrow W \mu ) \simeq 0.5\), we employ Eq. (9) and show the luminosity (\({\mathcal L}\)) as a function of \(x_H\) in Fig. 4. The solid line corresponds to \(m_{N^1} = m_{ Z^{\prime }}/4\) and \(m_{N^{2}} > m_{ Z^{\prime }}/2\), while the dashed line corresponds to \(m_{N^{1,2}} = m_{ Z^{\prime }}/4\). The vertical solid line marks the \(B-L\) limit (\(x_H = 0\)). Hence, \(x_H\) is constrained to be in the range of \(-4\lesssim x_H \lesssim 2\). For example, for \(x_H = -1.2\), the luminosities for 25 signal events of the \(Z^\prime \) boson production are found to be \({{\mathcal L}}(\mathrm{fb}^{-1}) \simeq 1624\) and 3248, for the case with one and two generation of degenerate RHNs, respectively. For the \(B-L\) limit (\(x_H = 0\)) case, the corresponding luminosities are \({{\mathcal L}}(\mathrm{fb}^{-1}) \simeq 162\) and 325, for the case with one and two generation of degenerate RHNs, respectively. Interestingly, these values are comparable to the luminosities in the conventional case with the maximal enhancement (\(x_H = -1.2\)) for two and three generations of degenerate RHNs, respectively. The solid horizontal line denotes luminosity value of 300 \(\mathrm{fb}^{-1}\) required for the discovery of RHNs at the future LHC with a dimuon and a diboson final states. Hence for example, for the case with two degenerate RHNs, Fig. 4 indicates that the RHNs will be discovered before the \(Z^\prime \) boson for \(-2.4 \lesssim x_H\lesssim 0\).

4 Realistic heavy neutrino branching ratios

In the above analysis and the simulation studies, \(\text {BR}(N\rightarrow W \mu ) \simeq 0.5\) is assumed. However, note that in a realistic scenario to reproduce the neutrino oscillation data, this branching ratio is smaller, which implies that more enhancement is required to obtain a sufficient number of signal events. In this section we consider the RHN decay processes in more details.

In the following analysis, we consider the case with degenerate RHNs, for simplicity. Using the Dirac and Majorana mass terms in Eqs. (3) or (10), the neutrino mass matrix is expressed as

$$\begin{aligned} \mathcal{M}_{\nu }=\begin{pmatrix} 0&{}&{}m_{D}\\ (m_{D})^{T}&{}&{}M_{N} \end{pmatrix}, \end{aligned}$$
(14)

where \(m_D\) and \(M_N\) are the Dirac and the Majorana mass matrices. Assuming the hierarchy of \(|m_D^{ij} / m_N^j| \ll 1\), we have the seesaw formula for the light Majorana neutrinos as

$$\begin{aligned} m_{\nu } \simeq - m_{D}(M_{N})^{-1}m_{D}^{T}. \end{aligned}$$
(15)

We express the light neutrino flavor eigenstate \((\nu )\) in terms of the mass eigenstates of the light \((\nu _m)\) and heavy \((N_m)\) Majorana neutrinos such as \(\nu \simeq \mathcal {N} \nu _m+\mathcal {R} N_m\), where \(\mathcal {R} =m_D (M_N)^{-1}\), \(\mathcal {N}=\Big (1-\frac{1}{2}\mathcal {R}^*\mathcal {R}^T\Big )U_{\mathrm{MNS}}\simeq U_{\mathrm{MNS}}\), and \(U_{\mathrm{MNS}}\) is the neutrino mixing matrix by which \(m_\nu \) is diagonalized as

$$\begin{aligned} U_\mathrm{MNS}^T m_\nu U_\mathrm{MNS} = D_\nu = \mathrm{diag}(m_1, m_2, m_3). \end{aligned}$$
(16)

In terms of the neutrino mass eigenstates, the charged current interaction is given by

$$\begin{aligned} {\mathcal {L}}_{CC}= -\frac{g}{\sqrt{2}} W_{\mu } \overline{\ell _\alpha } \gamma ^{\mu } P_L \left( \mathcal{N}_{\alpha i} \nu _{m}^i+ \mathcal{R}_{\alpha i} N_{m}^i \right) + \hbox {h.c.}, \end{aligned}$$
(17)

where \(\ell _\alpha \) are the three generations of the charged SM leptons, and \(P_L = (1- \gamma _5)/2\). Similarly, the neutral current interaction is given by

$$\begin{aligned} {\mathcal {L}}_{NC}= & {} -\frac{g}{2 \cos \theta _\mathrm{W}} Z_{\mu } \Big [ \overline{\nu _{m}^i} \gamma ^{\mu } P_L (\mathcal{N}^\dagger \mathcal{N})_{ij} \nu _{m}^j\nonumber \\&+\, \overline{N_{m}^i} \gamma ^{\mu } P_L (\mathcal{R}^\dagger \mathcal{R})_{ij} N_{m}^j \nonumber \\&+\, \Big \{ \overline{\nu _{m}^i} \gamma ^{\mu } P_L (\mathcal{N}^\dagger \mathcal{R})_{ij} N_{m}^j + \hbox {h.c.} \Big \} \Big ], \end{aligned}$$
(18)

where \(\theta _\mathrm{W}\) is the weak mixing angle.

The elements of the matrix \(\mathcal{R}\) are arranged to reproduce the neutrino oscillation data, for which we adopt \(\sin ^{2}2{\theta _{13}}=0.092\) [37] along with \(\sin ^2 2\theta _{12}=0.87\), \(\sin ^2 2\theta _{23}=1.0\), \(\Delta m_{12}^2 = m_2^2-m_1^2 = 7.6 \times 10^{-5}\,\hbox {eV}^2\), and \(\Delta m_{23}^2= |m_3^2-m_2^2|=2.4 \times 10^{-3}\,\hbox {eV}^2\) [1]. The neutrino mixing matrix is given by

$$\begin{aligned} U_{\mathrm{MNS}}= & {} \left( \begin{array}{c@{\quad }c@{\quad }c} c_{12}c_{13}&{}c_{12}c_{13}&{}s_{13}e^{-i\delta }\\ -s_{12}c_{23}-c_{12}s_{23}s_{13}e^{i\delta }&{}c_{12}c_{23}-s_{12}s_{23}s_{13}e^{i\delta }&{}s_{23} c_{13}\\ s_{12}c_{23}-c_{12}c_{23}s_{13}e^{i\delta }&{}-c_{12}s_{23}-s_{12}c_{23}s_{13}e^{i\delta }&{}c_{23}c_{13} \end{array}\right) \nonumber \\&\times \,\left( \begin{array}{c@{\quad }c@{\quad }c} 1&{}0&{}0\\ 0&{}e^{-i \rho _1}&{}0\\ 0&{}0&{}e^{-i \rho _2} \end{array}\right) , \end{aligned}$$
(19)

where \(c_{ij}=\cos \theta _{ij}\), \(s_{ij}=\sin \theta _{ij}\), and \(\rho _1\) and \(\rho _2\) are the Majorana phases,Footnote 6 which are taken to be free parameters. Motivated by the recent measurement of the Dirac CP-phase, we set \(\delta =\frac{3\pi }{2}\) [42].

Fig. 5
figure 5

In the left (right) panel, we show the parameter scan results for the maximum allowed branching ratios, \(\sum _{i=1}^3\mathrm{BR}(N_{m}^i N_m^i \rightarrow \mu ^\pm \mu ^\pm W^\mp W^\mp )\), as a function of a Majorana phase \(\rho _1\) (\(\rho _2\)) for the NH (IH) case. The solid curve denotes the maximum value of the branching ratio obtained after performing a parameter scan for rest of the free parameters, \(\theta _{1,2,3}, Y\), and \(\rho _2 (\rho _1)\). From the figure we read the maximum value to be 0.337 (0.157) for the NH (IH) case

From Eqs. (15) and (16), we parameterize the Dirac mass matrix as [8]

$$\begin{aligned} m_D = U_{\mathrm{MNS}}^* \sqrt{D_{\nu }} \; O \sqrt{M_N}, \end{aligned}$$
(20)

where \(M_N\) is a diagonal matrix for the mass eigenvalues of the RHNs and \(\sqrt{M_N}\) is defined as a matrix with each element of \(M_N\) square rooted, O is a general orthogonal matrix, and the matrix \(\sqrt{D_\nu }\) will be defined later. For the light neutrino mass spectrum, we consider both the normal hierarchy (NH), \(m_1< m_2< m_3\), and the inverted hierarchy (IH), \(m_3< m_1< m_2\).

Through its mixing with the SM leptons, a heavy neutrino mass eigenstate \(N_m^i\) (\(i=1,2,3\)) decays into \(\ell W\), \(\nu _{\ell } Z\), and \(\nu _{\ell } h\) with the corresponding partial decay widths:

$$\begin{aligned} \Gamma (N_m^i \rightarrow \ell _{\alpha } W)= & {} \frac{1}{16 \pi } \frac{ (M_{N}^2 - m_W^2)^2 (M_{N}^2+2 m_W^2)}{M_{N}^3 v_h^2} \times |R_{\alpha i}|^{2}, \nonumber \\ \Gamma (N_m^i \rightarrow \nu _{\ell _{\alpha }} Z)= & {} \frac{1}{32 \pi } \frac{ (M_{N}^2 - m_Z^2)^2 (M_{N}^2+2 m_Z^2)}{M_{N}^3 v_h^2} \times |R_{\alpha i}|^{2}, \nonumber \\ \Gamma (N_m^i \rightarrow \nu _{\ell _{\alpha }} h)= & {} \frac{1}{32 \pi }\frac{(M_{N}^2-m_h^2)^2}{M_{N} v_h^2}\times |R_{\alpha i}|^{2}, \end{aligned}$$
(21)

where

$$\begin{aligned} R_{\alpha i} = (m_D)_{\alpha i} (M_N)^{-1}= U_{\mathrm{MNS}}^* \sqrt{D_{\nu }} \; O \sqrt{M_N} (M_N)^{-1}. \nonumber \\ \end{aligned}$$
(22)

4.1 Minimal \(\hbox {U}(1)_X\) model

We first consider the minimal \(\hbox {U}(1)_X\) model with three RHNs. In order to make our discussion simple, we assume the degeneracy of the heavy neutrinos in mass such as \(m_N= m_N^1=m_N^2 = m_N^3\). Here, for simplicity, we fix the lightest neutrino mass eigenvalue as \(m_\mathrm{lightest} = 0.1 \times \sqrt{\Delta m_{12}^2}\), by which the elements of the matrix \(\sqrt{D_\nu } \equiv \mathrm{diag}(\sqrt{m_1},\sqrt{m_2},\sqrt{m_3})\) are uniquely fixed for both NH and IH cases. We parameterize the general orthogonal matrix O as

$$\begin{aligned} O= & {} \left( \begin{array}{c@{\quad }c@{\quad }c} 1&{}0&{}0\\ 0&{}\cos \theta _1&{} \sin \theta _1 \\ 0&{}-\sin \theta _1&{} \cos \theta _1 \\ \end{array}\right) \left( \begin{array}{c@{\quad }c@{\quad }c} \cos \theta _2&{} 0 &{}\sin \theta _2 \\ 0&{}1&{}0 \\ -\sin \theta _2&{}0&{}\cos \theta _2 \\ \end{array}\right) \nonumber \\&\times \left( \begin{array}{c@{\quad }c@{\quad }c} \cos \theta _3&{} \sin \theta _3 &{}0 \\ -\sin \theta _3&{} \cos \theta _3&{}0 \\ 0&{}0&{}1 \end{array}\right) , \end{aligned}$$
(23)

where \(\theta _1, \theta _2\), and \(\theta _3\) are complex numbers. With the inputs of the neutrino oscillation data and \(M_N=m_{Z^\prime }/4\) with \(m_{Z^\prime }=3\) TeV, we have performed a scan for the free parameters (\(\theta _1, \theta _2, \theta _3, \rho _1\), and \(\rho _2\)), and found the maximum values of the branching ratio as \(\sum _{i=1}^3\mathrm{BR}(N_{m}^i N_m^i \rightarrow \mu ^\pm \mu ^\pm W^\mp W^\mp ) \simeq 0.337\) and 0.157, for the NH and IH cases, respectively (see Fig. 5). In the analysis of Ref. [23], the orthogonal matrix in Eq. (22) is taken to be a unit matrix, and the branching ratios have been found to be \(\sum _{i=1}^3\mathrm{BR}(N_{m}^i N_m^i \rightarrow \mu ^\pm \mu ^\pm W^\mp W^\mp ) \simeq 0.210\) and 0.154, for the NH and IH cases, respectively. Thus, a general parameter scan yields a larger branching ratios. The branching ratio for the NH case is almost twice as large, while the IH case is almost the same as before.

Fig. 6
figure 6

The luminosity required to obtain 25 signal events of the \(Z^\prime \) boson as a function of \(x_H\) for fixed values of \(m_{ Z^{\prime }} = 3\) TeV and \(m_{N^{1,2,3}} = m_{ Z^{\prime }}/4\). The dotted (dot-dashed) lines correspond to the NH (IH) case with \(\sum _{i=1}^3\mathrm{BR}(N_{m}^i N_m^i \rightarrow \mu ^\pm \mu ^\pm W^\mp W^\mp ) =0.337\) (0.157)

Fig. 7
figure 7

In the left (right) panel, we show the parameter scan results for the maximum allowed branching ratios, \(\sum _{i=1}^2\mathrm{BR}(N_{m}^i N_m^i \rightarrow \mu ^\pm \mu ^\pm W^\mp W^\mp )\), as a function of a Majorana phase \(\rho _1\) for the NH (IH) case. The solid curve denotes the maximum value of the branching ratio obtained after performing a parameter scan for rest of the free parameters, X and Y. From the figure we read the maximum value to be 0.148 (0.0634) for the NH (IH) case

Using these realistic values for branching ratios to reproduce the neutrino oscillation data, we now re-evaluate the luminosity required for 25 signal events of the \(Z^\prime \) boson production. For fixed values of \(m_{ Z^{\prime }} = 3\) TeV and \(m_{N^{1,2,3}} = m_{ Z^{\prime }}/4\), we show the required luminosity as a function of \(x_H\) in Fig. 6. The dotted (dot-dashed) lines correspond to the NH (IH) case. For three degenerate RHNs and for fixed values of \(x_H = -1.2\) and \(\text {BR}(N\rightarrow W \mu ) \simeq 0.5\), we previously obtained the required luminosity to be \( {{\mathcal L}}(\mathrm{fb}^{-1}) \simeq 305\). Using the realistic branching ratios for the RHNs, \(\sum _{i=1}^3\mathrm{BR}(N_{m}^i N_m^i \rightarrow \mu ^\pm \mu ^\pm W^\mp W^\mp ) =0.337\) and 0.157, the required luminosities are corrected to be \({{\mathcal L}}(\mathrm{fb}^{-1}) \simeq 274\) and 128 for the NH and the IH cases, respectively. Hence, for the realistic case, the required luminosity are reduced compared to the case of \(\text {BR}(N\rightarrow W \mu ) \simeq 0.5\). Accordingly, the allowed range of \(x_H\) values for the NH (IH) case is reduced to be \(-2.3 \le x_H \le -0.16\) (\(-1.9 \le x_H \le -0.54\)).

If there is no indication of the \(Z^\prime \) boson production at the future LHC with a dilepton final state, we obtain an upper bound on the \(U(1)_X\) gauge coupling for a fixed \(x_H\) value and the \(Z^\prime \) boson mass. Using a narrow decay width approximation, the total production cross section of the \(Z^\prime \) boson is proportional to \(\alpha _X = g_X^2/(4\pi )\). We refer the results in Refs. [43, 44] for the upper bound \(\alpha _X \lesssim 0.01\)Footnote 7 for \(x_H=-1.2\) and \(m_{Z^\prime }= 3\) TeV from the ATLAS results with \(\mathcal{L} = 36.1\) \(\hbox {fb}^{-1}\). The upper bound on \(\alpha _X\) scales as

$$\begin{aligned} \alpha _X \lesssim 0.01\times {\frac{36.1}{{\mathcal {L}}}}, \end{aligned}$$
(24)

where \(\mathcal{L}\) in units of \(\hbox {fb}^{-1}\) is a luminosity at the future LHC.

4.2 Alternative \(\hbox {U}(1)_X\) model

Let us now consider the alternative \(\hbox {U}(1)_X\) model. Note that in this model only the first two generation RHNs are involved in the seesaw mechanism (the minimal seesaw [46, 47]). In order to make our discussion simple, we assume the degeneracy of the heavy neutrinos in mass such as \(m_N= m_N^{1}=m_N^{2}\), and \(m_{N}^{3} \simeq m_{Z^{\prime }}/2\). The minimal seesaw scenario predicts one massless light neutrino eigenstate. In the NH case, the diagonal mass matrix is given by

$$\begin{aligned} D_{\mathrm{NH}} =\mathrm{diag} \left( 0, \sqrt{\Delta m_{12}^2}, \sqrt{\Delta m_{12}^2 + \Delta m_{23}^2} \right) , \end{aligned}$$
(25)

while in the IH case

$$\begin{aligned} D_{\mathrm{IH}} =\mathrm{diag} \left( \sqrt{\Delta m_{23}^2 - \Delta m_{12}^2}, \sqrt{\Delta m_{23}^2}, 0 \right) . \end{aligned}$$
(26)

The matrices \(\sqrt{D_\nu }\) for the NH and the IH are defined as

$$\begin{aligned} \sqrt{D_{\mathrm{NH}}}= & {} \left( \begin{array}{c@{\quad }c} 0&{}0\\ (\Delta m_{12}^2)^{\frac{1}{4}} &{} 0 \\ 0 &{} (\Delta m_{23}^2+\Delta m_{12}^2)^{\frac{1}{4}} \\ \end{array}\right) ,\nonumber \\ \sqrt{D_{\mathrm{IH}}}= & {} \left( \begin{array}{c@{\quad }c} (\Delta m_{23}^2 - \Delta m_{12}^2)^{\frac{1}{4}} &{} 0 \\ 0 &{} (\Delta m_{23}^2)^{\frac{1}{4}} \\ 0&{}0 \end{array}\right) , \end{aligned}$$
(27)

respectively, and O is a general \(2\times 2\) orthogonal matrix given by

$$\begin{aligned} O= & {} \left( \begin{array}{c@{\quad }c} \cos (X+i Y)&{}\sin (X+i Y)\\ -\sin (X+i Y)&{}\cos (X+i Y) \end{array}\right) \nonumber \\= & {} \left( \begin{array}{c@{\quad }c} \cosh Y &{}i \sinh Y\\ -i\sinh Y &{} \cosh Y \end{array}\right) \left( \begin{array}{c@{\quad }c} \cos X &{} \sin X\\ -\sin X &{} \cos X \end{array}\right) \end{aligned}$$
(28)

where X and Y are real parameters. With the inputs of the neutrino oscillation data and \(M_N=m_{Z^\prime }/4\) with \(m_{Z^\prime }=3\) TeV, we have performed a scan for the free parameters (XY, and \(\rho _1\)), and found the maximum values of the branching ratio as \(\sum _{i=1}^2\mathrm{BR}(N_{m}^i N_m^i \rightarrow \mu ^\pm \mu ^\pm W^\mp W^\mp ) \simeq 0.148\) and 0.0634, for the NH and IH cases, respectively (see Fig. 7). For both the NH and the IH, the maximum values for the branching ratios are obtained for \(\rho _1 \simeq \pi /2\) and \(|Y|\gtrsim 2\). The result becomes independent of Y for \(|Y|\gtrsim 2\).

Fig. 8
figure 8

The luminosity required to obtain 25 signal events of the \(Z^\prime \) boson as a function of \(x_H\) for fixed values of \(m_{ Z^{\prime }} = 3\) TeV and \(m_{N^{1,2,3}} = m_{ Z^{\prime }}/4\). The dashed (dot-dashed) lines correspond to NH (IH) cases with \(\sum _{i=1}^2\mathrm{BR}(N_{m}^i N_m^i \rightarrow \mu ^\pm \mu ^\pm W^\mp W^\mp ) =0.148\) (0.0634). The vertical solid line marks the \(B-L\) limit (\(x_H = 0\)). The solid horizontal line corresponds to a luminosity value of 300 \(\mathrm{fb}^{-1}\) required for the discovery of RHNs at the future LHC with a dimuon and a diboson final states

Using these realistic values for branching ratios to reproduce the neutrino oscillation data, we now re-evaluate the luminosity required for 25 signal events of the \(Z^\prime \) boson production. For fixed values of \(m_{ Z^{\prime }} = 3\) TeV and \(m_{N^{1,2}} = m_{ Z^{\prime }}/4\), we show the luminosity as a function of \(x_H\) in Fig. 8. The dashed (dot-dashed) line corresponds to the NH (IH) case. Note that with a very large enhancement factor, the alternative \(\hbox {U}(1)_X\) model allows us to discover the RHNs at the LHC well before the discovery of the \(Z^\prime \) boson. For example, for \(x_H = -1.2\), using the realistic branching ratios for the RHNs, \(\sum _{i=1}^2\mathrm{BR}(N_{m}^i N_m^i \rightarrow \mu ^\pm \mu ^\pm W^\mp W^\mp ) =0.148\) and 0.0634, the required luminosity is found to be \({{\mathcal L}}(\mathrm{fb}^{-1}) \simeq 1923\) and 824 for the NH and the IH cases, respectively. For the \(B-L\) limit (\(x_H = 0\)) case, we previously obtained \({{\mathcal L}}(\mathrm{fb}^{-1}) \simeq 325\), for \(\text {BR}(N\rightarrow W \mu ) \simeq 0.5\). Using the realistic branching ratios for the RHNs, the corresponding luminosities are reduced to \({{\mathcal L}}(\mathrm{fb}^{-1}) \simeq 192\) and 82 for the NH and the IH cases, respectively. Accordingly, the allowed range of \(x_H\) values for the NH (IH) case is reduced to be \(-4.1 \le x_H \le 1.7\) (\(-3.1 \le x_H \le 0.7\)). The solid horizontal line corresponds to a luminosity value of 300 \(\mathrm{fb}^{-1}\) required for the discovery of RHNs at the future LHC with a dimuon and a diboson final states. Hence for the NH (IH), Fig. 8 indicates that the RHNs will be discovered before the \(Z^\prime \) boson for \(-2.1 \lesssim x_H\lesssim 0\) (\(-1.7 \lesssim x_H\lesssim -0.7\)).

5 Conclusions

We have investigated a prospect of discovering the RHNs in type-I seesaw at the LHC, which are pair produced from the decay of a resonantly produced \(Z^\prime \) boson. Recent simulation studies show that the discovery of the RHNs via \(Z^{\prime }\rightarrow NN\) is promising at the future LHC with, for example, a 300 \(\hbox {fb}^{-1}\) luminosity. However, the production cross section of \(Z^{\prime }\) boson into dilepton final states (\(pp \rightarrow Z^{\prime }\rightarrow \ell ^{+}\ell ^{-} \), where \(\ell ^\pm =e^\pm \) or \(\mu ^\pm \)) is very severely constrained by the current LHC results. Imposing this constraint, we have found that a significant enhancement of the branching ratio \(\mathrm{BR}(Z^{\prime }\rightarrow NN\)) over \(\mathrm{BR}(Z^{\prime }\rightarrow \ell ^{+}\ell ^{-}\)) is crucial for the future discovery of RHNs. For the minimal gauged \(\hbox {U}(1)_X\) extension of the SM with the conventional and the alternative charge assignments, we have found that a significant enhancement, \(\mathrm{BR}(Z^{\prime }\rightarrow NN)/\mathrm{BR}(Z^{\prime }\rightarrow \ell ^{+}\ell ^{-}) \simeq 3.25 \) and 52 (per generation), respectively, can be achieved for \(x_H = -1.2\), with \(m_{Z^\prime } = 3\) TeV, and \(m_N = m_{Z^\prime }/ 4\). This is in sharp contrast with the ratio, \(\mathrm{BR}(Z^{\prime }\rightarrow NN)/\mathrm{BR}(Z^{\prime }\rightarrow \ell ^{+}\ell ^{-}) \simeq 0.5\), in the minimal \(B-L\) model which is commonly used in the simulation studies. The branching ratio of \(\text {BR}(N\rightarrow W \mu ) = 0.5\) is commonly assumed in the simulation studies. However, this branching ratio is not consistent with the neutrino oscillation data. Employing the general parameterization of the neutrino Dirac mass matrix to reproduce the neutrino oscillation data, we have performed a parameter scan to evaluate the maximal value for \(\text {BR}(N\rightarrow W \mu )\). With the maximum enhancement factors and the maximum branching ratio, we have concluded for the minimal \(\hbox {U}(1)_X\) model that a 5\(\sigma \) discovery of RHNs in the future according to the simulation studies implies that the \(Z^\prime \) boson must be discovered before the RHNs. In the alternative \(\hbox {U}(1)_X\) model, we have obtained further enhancement of the signal cross section than the conventional case, and found a possibility of discovering the RHNs even before the \(Z^\prime \) boson at the future LHC experiment.