Review Reports - Comparison of Match Load and Wellness between Friendly and World Cup Matches in Elite Female Soccer Players

Round 1

Reviewer 1 Report

I vote for the article's replacement due to the relevance and originality of the material. The tool used for monitoring and internal load based on subjective perceptions was not developed for the merits and context of team sports, especially games. The chosen scale presents an exponential perception curve in response to incremental stimuli.

Author Response

Reviewer_1

Response: The RPE scale is a tool that has been validated in many sports and especially in team sports, as can be verified in the published scientific literature.

Pedersen, A.; Randers, M.B.; Luteberget, L.S.; Møller, M. Validity of Session Rating of Perceived Exertion for Measuring Training Load in Youth Team Handball Players. J. Strength Cond. Res. 2023, 37, 174–180, doi:10.1519/JSC.0000000000004202.
Lea, J.W.D.; O’Driscoll, J.M.; Hulbert, S.; Scales, J.; Wiles, J.D. Convergent Validity of Ratings of Perceived Exertion During Resistance Exercise in Healthy Participants: A Systematic Review and Meta-Analysis. Sport. Med. - Open 2022, 8, doi:10.1186/s40798-021-00386-8.
Costa, J.A.; Brito, J.; Nakamura, F.Y.; Figueiredo, P.; Rebelo, A. Using the Rating of Perceived Exertion and Heart Rate to Quantify Training Intensity in Female Soccer Players: Validity and Utility. J. Strength Cond. Res. 2022, 36, 201–206, doi:10.1519/JSC.0000000000003407.
Serpiello, F.R.; Hopkins, W.G. Convergent validity of cr100-based session ratings of perceived exertion in elite youth football players of different ages. Int. J. Sports Physiol. Perform. 2021, 16, 443–447, doi:10.1123/IJSPP.2020-0047.
Lovell, R.; Halley, S.; Siegler, J.; Wignell, T.; Coutts, A.J.; Massard, T. Use of numerically blinded ratings of perceived exertion in soccer: Assessing concurrent and construct validity. Int. J. Sports Physiol. Perform. 2020, 15, 1430–1436, doi:10.1123/ijspp.2019-0740.
Fox, J.L.; O’Grady, C.J.; Scanlan, A.T. The concurrent validity of session-rating of perceived exertion workload obtained face-to-face versus via an online application: A team case study. Int. J. Sports Physiol. Perform. 2020, 15, 1476–1479, doi:10.1123/ijspp.2019-0908.
Lupo, C.; Ungureanu, A.N.; Frati, R.; Panichi, M.; Grillo, S.; Brustio, P.R. Player session rating of perceived exertion: A more valid tool than coaches’ ratings to monitor internal training load in elite youth female basketball. Int. J. Sports Physiol. Perform. 2020, 15, 548–553, doi:10.1123/ijspp.2019-0248.
Naidu, S.A.; Fanchini, M.; Cox, A.; Smeaton, J.; Hopkins, W.G.; Serpiello, F.R. Validity of session rating of perceived exertion assessed via the CR100 scale to track internal load in elite youth football players. Int. J. Sports Physiol. Perform. 2019, 14, 403–406, doi:10.1123/ijspp.2018-0432.
Haddad, M.; Stylianides, G.; Djaoui, L.; Dellal, A.; Chamari, K. Session-RPE method for training load monitoring: Validity, ecological usefulness, and influencing factors. Front. Neurosci. 2017, 11, doi:10.3389/fnins.2017.00612.
Cabral, L.L.; Lopes, P.B.; Wolf, R.; Stefanello, J.M.F.; Pereira, G. A systematic review of cross-cultural adaptation and validation of Borg’s Rating Of Perceived Exertion Scale. J. Phys. Educ. 2017, 28, doi:10.4025/jphyseduc.v28i1.2853.
Aniceto, R.R.; Ritti-Dias, R.M.; Dos Prazeres, T.M.P.; Farah, B.Q.; De Lima, F.F.M.; Do Prado, W.L. Rating of Perceived Exertion during Circuit Weight Training: A Concurrent Validation Study. J. Strength Cond. Res. 2015, 29, 3336–3342, doi:10.1519/JSC.0000000000000998.
Rodríguez-Marroyo, J.A.; Antoñan, C. Validity of the session rating of perceived exertion for monitoring exercise demands in youth soccer players. Int. J. Sports Physiol. Perform. 2015, 10, 404–407, doi:10.1123/ijspp.2014-0058.
Lupo, C.; Capranica, L.; Tessitore, A. The validity of the session-RPE method for quantifying training load in water polo. Int. J. Sports Physiol. Perform. 2014, 9, 656–660, doi:10.1123/IJSPP.2013-0297.
Scott, T.J.; Black, C.R.; Quinn, J.; Coutts, A.J. Validity and reliability of the session-rpe method forquantifying training in australian football: A comparison of the cr10 and cr100 scales. J. Strength Cond. Res. 2013, 27, 270–276, doi:10.1519/JSC.0b013e3182541d2e.

Likewise, the RPE scale has been applied to evaluate both the training load and the match load in a multitude of studies in team sports and specifically in football players. As can be seen in the scientific literature.

Lovell, R.; Halley, S.; Siegler, J.; Wignell, T.; Coutts, A.J.; Massard, T. Use of numerically blinded ratings of perceived exertion in soccer: Assessing concurrent and construct validity. Int. J. Sports Physiol. Perform. 2020, 15, 1430–1436, doi:10.1123/ijspp.2019-0740.
Costa, J.A.; Brito, J.; Nakamura, F.Y.; Figueiredo, P.; Rebelo, A. Using the Rating of Perceived Exertion and Heart Rate to Quantify Training Intensity in Female Soccer Players: Validity and Utility. J. Strength Cond. Res. 2022, 36, 201–206, doi:10.1519/JSC.0000000000003407.
Gomez-Piriz, P.T.; JiméNez-Reyes, P.; Ruiz-Ruiz, C. Relation between total body load and session rating of perceived exertion in professional soccer players. J. Strength Cond. Res. 2011, 25, 2100–2103, doi:10.1519/JSC.0b013e3181fb4587.
Fanchini, M.; Ghielmetti, R.; Coutts, A.J.; Schena, F.; Impellizzeri, F.M. Effect of training-session intensity distribution on session rating of perceived exertion in soccer players. Int. J. Sports Physiol. Perform. 2015, 10, 426–430, doi:10.1123/ijspp.2014-0244.
Owen, A.L.; Dunlop, G.; Rouissi, M.; Haddad, M.; Mendes, B.; Chamari, K. Analysis of positional training loads (ratings of perceived exertion) during various-sided games in European professional soccer players. Int. J. Sport. Sci. Coach. 2016, 11, 374–381, doi:10.1177/1747954116644064.
Sanchez-Sanchez, J.; Hernández, D.; Casamichana, D.; Martínez-Salazar, C.; Ramirez-Campillo, R.; Sampaio, J. Heart rate, technical performance, and session-RPE in elite youth soccer small-sided games played with wildcard players. J. Strength Cond. Res. 2017, 31, 2678–2685, doi:10.1519/JSC.0000000000001736.
Rago, V.; Brito, J.; Figueiredo, P.; Costa, J.; Krustrup, P.; Rebelo, A. I nternal training load monitoring in professional football: A systematic review of methods using rating of perceived exertion. J. Sports Med. Phys. Fitness 2020, 60, 160–171, doi:10.23736/S0022-4707.19.10000-X.
Marynowicz, J.; Kikut, K.; Lango, M.; Horna, D.; Andrzejewski, M. Relationship between the session-RPE and external measures of training load in youth soccer training. J. Strength Cond. Res. 2020, 34, 2800–2804, doi:10.1519/JSC.0000000000003785.
Sams, M.L.; Wagle, J.P.; Sato, K.; Deweese, B.H.; Sayers, A.L.; Stone, M.H. Using the Session Rating of Perceived Exertion to Quantify Training Load in a Men’s College Soccer Team. J. Strength Cond. Res. 2020, 34, 2793–2799, doi:10.1519/JSC.0000000000003793.
de Dios-Álvarez, V.; Suárez-Iglesias, D.; Bouzas-Rico, S.; Alkain, P.; González-Conde, A.; Ayán-Pérez, C. Relationships between RPE-derived internal training load parameters and GPS-based external training load variables in elite young soccer players. Res. Sport. Med. 2021, doi:10.1080/15438627.2021.1937165.
Askow, A.T.; Lobato, A.L.; Arndts, D.J.; Jennings, W.; Kreutzer, A.; Erickson, J.L.; Esposito, P.E.; Oliver, J.M.; Foster, C.; Jagim, A.R. Session rating of perceived exertion (Srpe) load and training impulse are strongly correlated to gps-derived measures of external load in ncaa division i women’s soccer athletes. J. Funct. Morphol. Kinesiol. 2021, 6, doi:10.3390/jfmk6040090.
Marynowicz, J.; Lango, M.; Horna, D.; Kikut, K.; Andrzejewski, M. Predicting ratings of perceived exertion in youth soccer using decision tree models. Biol. Sport 2022, 39, 245–252, doi:10.5114/BIOLSPORT.2022.103723.
Gantois, P.; Piqueras-Sanchiz, F.; Cid, M.J.F.A.; Pino-Ortega, J.; Castillo, D.; Nakamura, F.Y. The effects of different small-sided games configurations on heart rate, rating of perceived exertion, and running demands in professional soccer players. Eur. J. Sport Sci. 2022, doi:10.1080/17461391.2022.2092427.
Fonseca, R.T.; Lopes, G.C.; De Castro, J.B.P.; Dos Santos, L.A. V; Lima, B.L.P.; De Oliveira Filho, G.R.; De Alkmim Moreira Nunes, R.; De Souza Vale, R.G. Analysis of vertical jump, rating of perceived exertion, delayed-onset muscle soreness, and muscular peak power in young male Brazilian football players submitted to plyometric and semi-squat training with weights. Retos 2022, 613–621.
Marinho, A.H.; Sousa, F.A.B.; Vilela, R.A.M.P.; Balikian, P.; de Souza Bento, E.; de Mendonça Aquino, T.; Crispim, A.; Ataide-Silva, T.; de Araujo, G.G. The rating of perceived exertion is able to differentiate the post-matches metabolomic profile of elite U-20 soccer players. Eur. J. Appl. Physiol. 2022, 122, 371–382, doi:10.1007/s00421-021-04838-7.
Houtmeyers, K.C.; Robberechts, P.; Jaspers, A.; McLaren, S.J.; Brink, M.S.; Vanrenterghem, J.; Davis, J.J.; Helsen, W.F. Differential Ratings of Perceived Exertion: Relationships with External Intensity and Load in Elite Men s Football. Int. J. Sports Physiol. Perform. 2022, 17, 1415–1424, doi:10.1123/ijspp.2021-0550.
Campos-Vazquez, M. A., Mendez-Villanueva, A., Gonzalez-Jurado, J. A., León-Prados, J. A., Santalla, A., & Suarez-Arrones, L. (2015). Relationships between rating-of-perceived-exertion- and heart-rate-derived internal training load in professional soccer players: a comparison of on-field integrated training sessions. Int J Sports Physiol Perform, 10(5), 587-592. doi:10.1123/ijspp.2014-0294

Finally, the RPE scale is not the only tool applied in this study to assess match load. Variables obtained from GPS (distance traveled, distance traveled at high intensity, player load, etc.) and well-being questionnaires were also recorded.

Author Response File: Author Response.docx

Reviewer 2 Report

First of all, I would like to thank the Editor-in-Chief and Associate/Guest Editors from Applied Sciences for giving me the opportunity to have reviewed the Manuscript ID: applsci-2060329 titled “Comparison of Match Load and Wellness Between Friendly and World Cup Matches in Elite Female Soccer Players”. The purpose of the present work under consideration for publication was to compare external load, internal load and wellness measures between friendly matches and official matches (France 2019 women world cup). Working hypothesis were that external/internal load and wellness will be higher in official match-play. A total of 10 soccer players (no goalkeepers) from the Chilean women’s national soccer team participated. The last three friendly matches before the tournament were recorded, and compared with the three matches of the France 2019 World Cup (group stage). The present study was conducted in applied setting and including elite athletes; this should be highlighted because it is not trivial. In addition, it seems to have a good degree of originality. Main evidence indicated that players performed greater loads (both internal and external) in the World Cup as compared to friendly events while the self-reported wellness was lower in the former. Conversely, some aspects need improvements. To exemplify, the introduction and practical applications are too speculative in some instances. In order to try increase the impact of the present research, new analysis could be also performed (e.g. correlations between friendly and official matches data). The rationale for this study should be also strengthened. To summarize, I have major revisions that need to be addressed by the authors before I can make a final decision. Please see my specific comments:

P2L12. “This WS was adapted and modified later by McLean et al. [12], and this last version was applied in the present study.” - This is method aspect and should be rearranged accordingly.

P2L59-83. This whole paragraph is exceptionally long and confused; please cut into two in order to help improve the readability.

P2L72. “Thus, if the workload is higher during official matches (i.e., FIFA World Cup) in comparison to friendly matches (FM), this will probably affect the recovery processes and the time needed to perform at the highest level.” - It is important to avoid make vague statements. Please attempt to re-format introduction and provide a strength rationale for the present study, avoiding speculative statements.

P2L84. “Nonetheless, to date information about ELO and ILO is lacking in elite female soccer players” - This sentence should be reformulated because the literature about female soccer is not probably scarce nowadays. Maybe the existing studies on elite players; but to confirm statements like this, the authors need to demonstrated evidence (e.g. an updated literature review confirming the absence of studies on internal, external load and wellness in the population).

P2L87. “Finally, it was hypothesized that ILO, ELO and WS will be higher in WWC due to the importance of the tournament [28].” - Why it is expected that WS will be also higher during official match-play?

P2L92. “This longitudinal, observational, intragroup, descriptive and comparative study was based on a quantitative approach”. - I’m not sure if this study qualify for “longitudinal”, take care

P3L100 “For research purposes, only players with more than 80 minutes, and who had played at least 1 FM and 1 WWC, were considered for the study”. - Why such criteria was used? In addition, it is necessary to justify the sample size in order to show that a sufficient number of participants were used to draw firm conclusions (i.e. statistical power)

P2L63. “The last three FM before the WWC, between April and May 2019 were compared with the three matches of the France 2019 WWC groups phase played in June (Figure 1).” - Please insert more information about the matches to assist readers in understanding a bit more the context (e.g. quality of opposition, match status, team formation, if there was any player dismissal, …)

P2L87. “The players wore 10-Hz GPS devices (Optimeye S5, Catapult Sports® , Melbourne, Australia) between the scapulae in a neoprene underwear to prevent device displacement (Freire et al., 2020)” - the validity of the specific devices used should be reported

P4L147. I strongly recommend to the authors to insert also correlation analysis (ideally dividing by playing position). This may help increase the impact of the current study. It is of interest to know if friendly match could be used to predict to some extent the performance level of the players as observed in official matches. In other words, it could be tested the “construct validity” of the friendly matches as potential tool to preview official match-play loads.

Table 1 contains various information but it is lacking the “mean differences”.

P4L165. Please insert also the HSR and NS variables normalized per minute played.

Avoid duplicated information on Tables and Figures (e.g. what is the difference among Table 1/Figure 1 and Table 2/Figure 2.

P7L187 “The aim of this study was to compare the ELO, ILO and WS of the Chile women's national soccer team during friendly and WWC matches. The main findings of the study were that players performed greater ELO and ILO in the WWC compared to FM. Specifically the World Cup competition showed higher TD, HSR, TDr and RPE, whilst, conversely showing poorer post-match WS, specifically in ST24, MS48 and FT48”.- There are too many acronyms in one single paragraph; if the journal guidelines do not have a word count limit, please limit then to a minimal in order to attempt improve the readability of the current manuscript.

P7L192. “The present results can be explained by contextual factors of the matches for example, the ranking of the rival, local or away, the type and phase of the tournament, etc. [16,38,39].” - The sentence is vague because the contextual factors were not reported in methods, please rephrase.

P7L211. In general, the whole discussion section does not flow well; consider using the following structure to re-write various paragraphs: 1) mention of a main finding; 2) compare present results with pertinent literature, 3) explain and make a single concluding/recommendation sentence.

P8L261 - “However, it would be necessary to complement this with good rest, food, and emotional and psychological support, allowing the players to face the competitions in the best possible way. It is also necessary to consider tactical aspects and relate them to physical load factors, in order to adjust the competition load of those players with higher levels of fatigue in a timely manner and without altering the functioning of the team.” - In the practical applications section, limit the recommendations only to those directly supported by the data of the present study.

Author Response

Reviewer_2

P2L12. “This WS was adapted and modified later by McLean et al. [12], and this last version was applied in the present study.” - This is method aspect and should be rearranged accordingly.

Response: Thanks for your comment, this was already modified in the introduction and later treated in methods on line 142-148.

P2L59-83. This whole paragraph is exceptionally long and confused; please cut into two in order to help improve the readability.

Response: Thank you for your comment, this has already been improved in the document.

Response: Thank you for your comment, this was improved in the document specifically in line 80-82.

Response: Thanks for your comment, I think there was a writing error in this line, therefore "It was hypothesized that ILO and ELO values will be higher and WS values lower in WWC compared to FM due to the importance of the tournament", this was corrected in line 84-86.

Response: Thank you for your comment, the study is longitudinal based on the research methodology book by Roberto Hernández Sampieri "Longitudinal Designs Studies that collect data at different points of time, to make inferences about the evolution of the research problem or phenomenon its causes and its effects (page 159)”. In our case, the same sample (players) were evaluated at different points of time to observe their performance in FM (April and May 2019) vs. WWC (June 2019). Hernández Sampieri, R. Metodología de la investigación; 2018; Vol. 4; ISBN 9781456223960.

Response: Thank you for your comment, the reason for this criterion was because the study considered a non-random convenience sample made up of ten soccer players (excluding goalkeepers). This was already corrected in the document. In addition, for study purposes, only players with more than 80 minutes, because a comparison of wellness will be made as a measure of fatigue, understanding that the most intense demands are usually found during the final phases of the match and could affect these results and that they had played at least 1 FM and 1 WWC, they were considered for the study. Oliva-Lozano, J.M.; Martinez-Puertas, H.; Fortes, V.; Muyor, J.M. When do soccer players experience the most demanding passages of match play? A longitudinal study in a professional team. Res. Sport. Med. 2021, 00, 1–11, doi:10.1080/15438627.2021.1943390.

Response: Thank you for your comment, we have included a figure (figure 1) with more background on the matches, such as date, city, country, opponent, ranking and result. We also include the phrase "it is worth mentioning that no player was sent off in these matches" in line 132

Response: Thank you for your comment, we will include the validity in the line 250 of the devices in the article proposed by Minett, M.M.; Binkley, T.B.; Weidauer, L.A.; Specker, B. L. Changes in body composition and bone of female collegiate soccer players through the competitive season and off-season. J. Musculoskeletal. Neural Interact. 2017, 17, 386–398. The objectives of this study were to assess the concurrent validity of global positioning systems (GPS). We also include the article proposed by Villaseca-Vicuña, R.; Otero-Saborido, F.M.; Perez-Contreras, J.; Gonzalez-Jurado, J.A. Relationship between Physical Fitness and Match Performance Parameters of Chile Women's National Football Team. Int. J. Environ. Res. Public Health 2021, 18, 8412, doi:10.3390/ijerph18168412. Where we have used the same GPS devices in another study with the same sample.

Response: Thank you very much for your comment, the objective of this particular study is to compare the internal load (ILO), the external load (ELO) and the well-being (WS) between the friendly matches of official preparation (FM) and the matches of the Women's World Cup in France 2019 (WWC) in soccer players. Therefore, we consider that the expansion of this study should be included in this analysis. However, we will take your comment into account in our future line of research to correlate performance in friendly matches and official championships (World Cup and Olympic Games) in a future report that we are already working on.

Table 1 contains various information but it is lacking the “mean differences”.

Response: Thank you for your comment, but the statistical analysis considered in the study analyzes the within-subject difference between periods that was analyzed through Student's t-test for paired samples (p-value) and the effect sizes were expressed through the standardized difference as Cohen’s d (ES).

P4L165. Please insert also the HSR and NS variables normalized per minute played.

Avoid duplicated information on Tables and Figures (e.g. what is the difference among Table 1/Figure 1 and Table 2/Figure 2.

Response: Thank you for your comment, we have added the HSR and NS normalized per minute variables to table 1 and added to line 152-153. Regarding the difference between table 1/figure 1 and table 2/figure 2, we consider that on the one hand incorporating a table with all the results and then the figure with only the differences found is pedagogical for the reader and in this way to improve the identification of the findings found, also in the figures the intra-subject values appear in "the points".

Response: Thank you for your comment, we improved this paragraph only by including some acronyms and the rest as complete words to improve reading, you can find this on line 217-223

Response: Thank you for your comment, in this paragraph we explain that the results could be due to some extent to contextual factors, in fact this factor was considered for the statistical analysis when comparing friendly matches vs. World Cup matches, this is expressed in the METHODOLOGY - Procedures line 129.

Response: Thank you for your comment. The suggestion has been attended.

Response: Thank you very much for your comment, this paragraph was deleted to avoid recommendations without support in the results, you can check this in line 341.

Author Response File: Author Response.docx

Reviewer 3 Report

Title

Comparison of external and internal load from matches and Wellness Between Friendly and World Cup Matches in Elite Female Soccer Players

Abstract

The authors should include the study’s background in the abstract

Introduction

Comments: In line 52 we talk about contextual factors, do you consider that the type of championship and rival are context variables? Why?

Comment: From line 84 I think I understand the approach to the problem. However this is not clear to me, what is the problem?. The scarce information regarding the performance in players?. If it is possible to define it in a better way so that it is clear to the reader.

Methodology

Design

No comment, I think the design fits the studio

Sample

Without comments, the sample is well defined, adding its inclusion criteria

Ethical considerations

Without comment, the study has an authorization from the ethics committee

Procedures

Comment: In line 113 they explain that the players were evaluated in April and May 2019 and then the world championship was in June 2019, in those months as we know that the players did not improve their fitness level? And consequently, improve kinematic performance in subsequent analyses? Did you measure it somehow? Or did the players when selected continue with their clubs or selection?

Statistical analysis

Comment: On line 150 they talk about applying a statistical test of related samples? Could I justify this analysis? If you compared 3 friendly matches vs 3 World Cup matches, did the same players always play? Otherwise, if it is not the same sample, you should apply a test of independent samples.

Results

Comment: In Figure 2, the letter D) is not defined in variables

Comment: In Figure 3, the MV variable is not defined in variables

Discussion

Comments: What do you mean on line 199 with strong? Did they have more RFD? Or does it mean ranking?

Conclusions

No comment

Practical applications

No comment

Author Response

Abstract

The authors should include the study’s background in the abstract

Introduction

Comments: In line 52 we talk about contextual factors, do you consider that the type of championship and rival are context variables? Why?

Response: Thank you for your comment, we consider contextual factors under the proposal of Augusto, D.; Brito, J.; Aquino, R.; Figueiredo, P.; Eras, F.; Tannure, M.; Veiga, B.; Vasconcellos, F. Contextual Variables Affect Running Performance in Professional Soccer Players: A Brief Report. Front. Sport. Act. Living 2021, 3, doi:10.3389/fspor.2021.778813 and Freire, L. de A.; Brito, M.A.; Muñoz, P.M.; Pérez, D.I.V.; Kohler, H.C.; Aedo-Muñoz, E.A.; Slimani, M.; Brito, C.J.; Bragazzi, N.L.; Znazen, H.; et al. Match Running Performance of Brazilian Professional Soccer Players according to Tournament Types. Montenegrin J. Sport. Sci. Med. 2022, 11, 53–58, doi:10.26773/mjssm.220306.Where the opponent type and the championship system is considered as such, you can find these references in line 63.

Response: Thank you very much for your comment, there are several problems, in the first instance the scarcity of information on women soccer players in competition and finally there is no information on elite women soccer players in world cup championships, you can find this with their references on the line 80-86.

Methodology

Design

No comment, I think the design fits the studio

Sample

Without comments, the sample is well defined, adding its inclusion criteria

Ethical considerations

Without comment, the study has an authorization from the ethics committee

Procedures

Response: Thank you very much for your comment, in both FM (April and May) and WWC (June) evaluation periods the same players were evaluated, that is, for this reason a student's t-test of related samples was applied in the statistical analysis, which which this avoids the bias that it was a different sample, therefore this evaluation allows in a short period of time (3 months) to observe if the players can perform differently in both competitions without modifying their physical condition. In this period it is worth mentioning that the players were in the selection period all the time.

Statistical analysis

Response: Thank you for your comment, the analysis is justified with a student's t test of related samples, since the same group of players participated in FM and WWC, you can find this described in methodology - procedures line 129.

Results

Comment: In Figure 2, the letter D) is not defined in variables

Response: Thanks for your comment, this has already been improved in the document.

Comment: In Figure 3, the MV variable is not defined in variables

Response: Thanks for your comment, this has already been improved in the document.

Discussion

Comments: What do you mean on line 199 with strong? Did they have more RFD? Or does it mean ranking?

Response: Thanks for your comment, we changed "strong" to "better ranked" for your better understanding, you can find this in line 237.