4.1. Methodology
4.1.1. Overview
The reason for using the Delphi technique in this research is as follows. First, we chose a qualitative method to understand the effectiveness of the control measures for each construction work in real construction sites rather than controlled conditions from field experts. Second, we chose the Delphi technique, which was applied to the statistical method to overcome the shortcomings of the qualitative methods, which are difficult to quantify in results and maintain neutrality in interpretation. Third, we determined that the use of the Delphi technique is appropriate for this research. The Delphi technique is especially useful when there is a lack of prior research, and expert opinion is the most important. Practically, previous studies on fugitive dust at construction sites was lacking and field experts’ opinions were important to understanding the effectiveness of control measures for each construction work in a real construction site setting.
The Delphi technique, which was developed by the Rand Corporation in the United States, is a method of generating accurate predictions by obtaining responses from experts on a specific issue, summarizing the responses, and giving the experts feedback on the responses [
22]. The Delphi technique is used to draw consensus among geographically separated experts and was developed to derive expert opinions to predict specific problems and solve problems that require collective judgment [
23]. This technique was developed based on the quantitative objective method that “judgment made by two people is more accurate than those made by one person” and the principle of democratic decision-making, which is that “majority opinions are more accurate than minority opinions”. This method was found to obtain accurate estimations if the group’s estimation is derived by a series of expert groups and is therefore likely to include a range of correct answers. It has three basic features: “iteration of rounds and controlled feedback,” “panel anonymity”, and “statistical group response” [
24].
The Delphi execution procedure is conducted through multiple rounds of surveys to reach consensus in experts’ opinions: collecting experts’ suggestions regarding opposable events, summarizing the suggestions, giving the experts feedback, and facilitating them during the second round of deliberation. For the Delphi technique, the optimal number of rounds is between two and five. In the first round, an open-type survey is conducted, and in the second round, a re-survey is conducted after extracting structured questionnaires based on the first round’s open-type survey. In the third round, the consensus trend and variability of the responses from the panelists collected in the second round are identified, and a re-survey is conducted with the notation of respondent’s own response in the second round along with the consensus trend and variability of the questionnaire.
In the first round, researchers have generally gathered various expert opinions using FGI. In this research, however, we conducted a preliminary analysis to develop a questionnaire for a Delphi study, instead of an open interview, to ensure effective and efficient of the study.
4.1.2. Data Collection
Dalkey [
25] found that at least 10 expert panelists were needed to minimize the error of the average group in the correlation between panel size and maximization of the reliability of the group. Anderson [
26] found that useful results can be obtained with only 10–15 experts in a small group.
To minimize errors and maximize reliability, selection criteria for the panel included representativeness, appropriateness, and expert knowledge in field management. To ensure the panel was capable of evaluating the effectiveness of the fugitive dust control measures specified in the regulations, panel members were selected under the assumption that they have a variety of construction-site experience and either engage in planning for the application of fugitive dust control measures or perform quality-control work.
The panel consists of 12 experts—five with experience in quality control and seven with construction-management experience. The panelists’ average career length is 25.5 years, with a minimum career length of 10 years. The recruitment was conducted over the phone. Once panel members were selected, researchers requested that they participate in two rounds of a survey process. The survey was conducted with the 12 people who were willing to participate following the phone screening.
A Delphi study was conducted in the present study to evaluate the effectiveness of the control measures against fugitive dust according to construction work type between August and December of 2017. Round 2 of the Delphi study was conducted to collect final opinions based on the Round 1 of the Delphi study to collect experts’ opinions about the effectiveness of control measures according to construction work type and the Round 1’s Delphi study results. Round 1 and Round 2 questionnaires were sent to field experts via email, and responses were taken through email replies.
4.1.3. Questionnaire Development
Delphi Round 1. The questionnaire for the Delphi study was constructed using the analysis results in
Section 3. In Round 1, the effectiveness of the 12 control measures in 10 main construction processes was evaluated by 12 experts who had worked in the industry for an average of 26 years. The effectiveness of control measure was measured on a 7-point Likert scale ranging from “strongly disagree” to “strongly agree”.
Delphi Round 2. The survey questionnaire was re-structured based on the information collected in round 1. First, the calculated average of the experts’ first responses was displayed as an “Md”. Second, a response range within the median 50% that reflected the response trend of the other respondents was marked by an empty bracket ([]). Finally, the scores that were selected by each respondent in Round 1 were marked by asterisk (*). After checking the results of Round 1, we asked the respondents to evaluate the questionnaire again. If the score selected by the respondent was out of the answer range of the median 50%, then we asked the respondents to write the reason.
4.1.4. Consensus Criteria
Because the criteria that determine whether the results of the experts’ responses are effective control measures were reached in consensus, this study utilized stability, convergence (width of the response range), and the content validity ratio (CVR; the position of the response range). The concepts of the evaluation elements are as follows:
• Stability
When the response is highly consistent as a result of few differences between the survey responses of the panelists in the repeated survey process, it is said that stability is ensured, which is measured by the contingent valuation (CV):
where CV is the coefficient of variation,
SD is the standard deviation, and
M is the mean
If the CV is less than 0.5, no additional survey is needed. If the CV is 0.5–0.8, it indicates relative stability. However, if the CV is more than 0.8, an additional survey is needed [
27,
28,
29].
• Convergence
Convergence is used to evaluate a convergence of opinions on a single point. It utilizes the quartile deviation (see Equation (2)). The quartile deviation is defined as being half the interquartile range (IQR). The IQR is an index that represents a response trend, which refers to a range that corresponds to the median 50% of all response values. If the IQR value is less than one, then it means that more than 50% of the responses are distributed within one point [
30]. In general, if the IQR value is less than two, then it is interpreted as a consensus [
30,
31,
32,
33]. In this study, when the convergence value of the expert panel is less than one, then it is regarded as consensus of opinion.
where CONV. is the quartile deviation; the closer the value is to zero, the more valid the item.
Q1 is the first quartile, or the lower 25%, and
Q3 is the third quartile, or the upper 25%.
• Content Validity Ratio (CVR)
The CVR is a means to quantify a level of opinion consensus by panelists who are equipped with expertise in a certain field. It is a concept proposed by Lawshe [
34]. The response panel evaluates whether each of the items is “essential” or not, and if the majority of the respondents said that the item was essential, the content is considered valid. In other words, the greater the number of panelists that consider an item to be essential (more than 50%), the larger the content validity is. the functions of CVR based on this assumptions is shown Equation (3).
where CVR is the content validity ratio (−1~+1),
N is the total number of panelists, and
Ne is the number of panelists indicating ‘essential’ (In the case of the 7-point Likert scale, the number of panelists that responded with 5 points or more).
If less than 50% of panelists consider an item to be essential, then the CVR is negative, and if half of them answer that it is essential, then the CVR is zero. If more than 50% of panelists answer that an item is essential, then the CVR is positive. The CVR presents the minimum value according to the number of panelists [
31]. When the CVR is more than the minimum value, the item is considered to have content validity. In this study, the number of respondents was 12. Thus, the minimum value of the CVR was 0.56.
4.2. Results
The evaluation results for the effectiveness of the 12 control measures by 10 construction work types were as follows (see
Appendix A).
The standard deviation and convergence in Round 2 tended to decrease compared to those in Round 1, and the items whose convergence satisfied the consensus level increased from 27 items in Round 1 to 37 items in Round 2. This result meant that field experts agreed with their opinions. In addition, the stability of all items in Round 2 was less than 0.8, which verified that no additional survey was needed.
The effectiveness level for the control measures in each of the construction work types showed that temporary work (5.14), earthwork (5.38), foundation work (5.17), and demolition work (5.98) were relatively high, whereas exterior wall work (3.93), plaster work (3.66), and paint work (3.69) were relatively low. Cleaning, wheel-washing facilities, spray water facilities, and spray water were the control measures for which there was the most consensus that they were effective, whereas the effectiveness of anti-dust facilities and indoor work as control measures reached less of a consensus.
Temporary work. The control measures that reached consensus were spraying water, water spray facilities, the suspension of work when wind speed was high, and wheel-washing facilities. The selected control measures were work types that required high amounts of material transportation, such as loading and unloading, where high amounts of fugitive dust were generated. Note that “suspension of work when wind speed is high” was agreed upon as an effective control measure, but some experts said that the suspension of work due to wind speed was difficult. Other control measures were high priority but did not reach consensus. Road pavement was effective in the prevention of fugitive dust, but it may not be possible to apply it depending on the site conditions, and anti-dust facilities may not solve the fugitive dust problem in many cases due to the typically wide area of construction work.
Earth work. The effectiveness of these control measures was high overall. The measures that reached consensus as being effective were wheel-washing facilities, spray water, water spray facilities, road pavement, control of load capacity, horizontal loading, and low-speed driving. Earth work is a construction work type with high generation and impact of fugitive dust, because fugitive dust is generated significantly in soil and aggregate stocking, loading and unloading, and transportation. Vehicles and construction machinery that transport soils and aggregates must be managed. The control measures that had a high mean value of effectiveness but did not reach consensus were the installation of anti-dust facilities, which is effective but requires difficult installation, and cleaning, which may increase the generation of dust with respect to earth work.
Foundation work. The effective control measures that reached consensus were wheel-washing facilities, spray water facilities, road pavement, and low-speed driving. Of these, spray water facility was regarded as highly effective in the prevention of fugitive dust, but some experts said that it was difficult to employ due to the movement of machinery and equipment.
Concrete work. The effective control measures that reached consensus were wheel-washing facilities and cleaning. In this type of construction work, most fugitive dust is generated during concrete pouring. Thus, the spread of fugitive dust generated during this work to surrounding areas occurs due to the movements of nearby construction equipment. Control measures such as the installation of an anti-dust facility or the suspension of work during high wind speeds were effective, but they did not reach consensus because an anti-dust facility is difficult to install due to cost issues and suspending work due to wind speeds is not possible in many cases.
Stonemasonry work. The effective control measures that reached consensus were dust-collecting facilities and cleaning. Although stonemasonry materials are ordered according to required dimensions, they are often cut on-site, generating dust. The experts answered that dust-collecting facilities were necessary not only for the prevention of dust from spreading to the outside but also for discharging purified air after filtering out the dust to control fugitive dust generated during this work.
Exterior wall work and plaster work. No control measures reached consensus. Both of these construction work types were evaluated as having low generation and impact of fugitive dust, because most exterior wall work involves the installation of pre-fabricated and transported materials, and plaster work involves a high proportion of indoor work. Furthermore, the evaluation results on the effectiveness of the 12 control measures were low overall. This implies that the control measures proposed in the regulations were not appropriate for exterior wall work and plaster work. Note that the control measures did not reach consensus, but high priority was placed on cleaning for exterior wall work and cleaning and indoor work for plaster work.
Painting work. This work may impact not only construction workers but also the surrounding regions because it may generate ultra-fine dust, including volatile organic compounds (VOCs) that affect the human body adversely if the spray method is used. The effective control measure that reached consensus was the suspension of work during fast wind speeds, but the evaluation results of the effectiveness of the 12 control measures were low overall. Furthermore, the above measure was deemed difficult to apply to actual work because painting cannot be done during strong winds or excessive ventilation conditions due to its innate characteristics.
Landscaping work. Fugitive dust is generated mainly during loading and unloading, as well as during the transportation of soils and trees. The effective control measures that reached consensus were spraying water, cleaning, control of load capacity, horizontal loading, and road pavement.
Demolition work. This was one of the main control sectors because it had the highest generation and impact of fugitive dust, but is also the most effectively controlled through appropriate measures. Because demolition work is separately designated for business places and subject to reporting according to the regulations, including the control measures utilized in this study, all control measures except for indoor work were agreed to be effective.
4.3. Discussions
The comprehensive analysis and causes of Delphi results are as follows.
First, convergence was decreased and the number of effective control measures that reached consensus was increased, which may be interpreted as the results of Delphi Round 2 reaching consensus. However, our consensus level was low compared to that of other studies that utilized a Delphi technique because effective control measures differ depending on site circumstances due to the characteristics of the construction industry.
Second, the “other processes” in the “Standards of Control Facility and Measure to Prevent Fugitive Dust” recommend that painting work require the “installation of a dustproof net” and “indoor work,” whereas only the measure “suspension of work during high wind speeds” reached consensus in the present study. In the evaluation results, regarding the effectiveness of control measures, the “installation of a dustproof facility” and “indoor work” measures were highly effective, but their content validity was low, which was why they were not selected. In this regard, some experts expressed that a large area of work was difficult to control using anti-dust facilities, and the installation of anti-dust facilities may be difficult depending on site conditions.
Third, comparing the results of averaged and agreed-upon effective control measures by construction work type showed that temporary work, earth work, foundation work, and demolition work were high, whereas those of exterior wall work, plaster work, and painting work were lower. The reason for these results was because most control measures of fugitive dust proposed in the “Standards of Control Facility and Measure to Prevent Fugitive Dust” targeted external works.
Fourth, cleaning, wheel-washing facilities, spray water facilities, water spraying, and road pavement were selected as the most effective control measures of the 12 control measures. However, these control measures are general measures to prevent fugitive dust generated by movements of vehicles and construction machinery and equipment and cannot be viewed as control measures that reflect the characteristics of a particular construction work type. Despite being effective control measures, they may also be prohibitive due to the cost burden and more easily applicable control measures that exist.