Next Article in Journal
A Production Inventory Model for Deteriorating Items with Collaborative Preservation Technology Investment Under Carbon Tax
Previous Article in Journal
Designing a New Shuttle Service to Meet Large-Scale Instantaneous Peak Demands for Passenger Transportation in a Metropolitan Context: A Green, Low-Cost Mass Transport Option
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Cleaner Production and LCA as Complementary Tools in Environmental Assessment: Discussing Tradeoffs Assessment in a Case of Study within the Wood Sector in Brazil

by
Ronald Panameño
1,2,*,
Carlos Mario Gutiérrez-Aguilar
1,3,
Beatriz Elena Angel
4,
Sandro Fábio-César
1 and
Asher Kiperstok
1
1
Postgraduate Program in Industrial Engineering (PEI), Federal University of Bahia (UFBA), Salvador 40210-630, Brazil
2
Engineering & Architecture Faculty, Operations & Systems Department, Central American University José Simeón Cañas (UCA), San Salvador CP1101, El Salvador
3
Arts and Humanities Faculty, Design Department, Metropolitan Technological Institute (ITM), 050036 Medellin, Colombia
4
Industrial Engineering department, Pontifical Bolivarian University (UPB), Medellin 050036, Colombia
*
Author to whom correspondence should be addressed.
Sustainability 2019, 11(18), 5026; https://doi.org/10.3390/su11185026
Submission received: 26 June 2019 / Revised: 9 September 2019 / Accepted: 10 September 2019 / Published: 14 September 2019

Abstract

:
Cleaner production has been used for several years in Latin America to minimize waste generation while reducing material and energy consumption. Despite those environmental benefits, its implementation may sometimes lead to changes in products or processes whose environmental performance can yield either positive or negative outputs when examined within a broader context, meaning it is necessary to complement cleaner production with other environmental tools that can provide environmental assessments. This paper presents a combination of cleaner production with life cycle assessment (LCA) applied within the wood industry in a case study in Salvador, a state of Bahia (Brazil), regarding the production of two models of wooden chairs. The study selected life cycle assessment as a scientific tool to quantify the environmental impacts of the models having ILCD 2011 midpoint and cumulative energy demand methods. The results confirmed the presence of environmental tradeoffs among the models that were not considered during the cleaner production program implemented. This paper also includes a proposal of a flowchart to guide the implementation of cleaner production when deciding to implement changes in material, energy source, processes, final destination, or lifespan of the product evaluated, identifying the stages where environmental assessment like life cycle assessment may be required to address tradeoffs.

1. Introduction

Cleaner production (CP) is one of the environmental tools used to address sustainability challenges. It may be defined as the continuous application of an integrated preventive strategy to processes, products, and services in order to increase efficiency in the use of materials and energy while reducing environmental pollution [1,2]. Since its introduction, CP has brought environmental gains and cost reductions to large intensive industries [3], achieving recognition from supranational entities such as United Nations Environmental Program (UNEP), who considers CP as one of their supportive activities and programs [4]. CP can be used as a way to implement the industrial-ecology approach on a smaller scale: CP is more focused on reducing risk and material and energy consumption, as well as preventing pollution in a specific production system [5].
CP has the additional advantage of highlighting areas of improvement in material and energy consumption that can be used in combination with other tools aimed at improving environmental gains, such as Ecodesign, which is used to obtain higher quality products by choosing alternative materials with less environmental impacts, re-designed processes, and adequate final disposal of products’ components [6]. Another characteristic of CP is its suitability for small- and medium-sized enterprises, owing to the relatively low cost of implementation [7]. As a result, CP has been used to improve environmental performance in production systems, with generally good results in a range of successful case studies [1], demonstrating not only the energy and material savings accrued from the use of CP, but also the financial savings in the development of more sustainable products.
Environmental performance can influence the competitiveness of a product. Therefore, a variety of companies are now looking to re-evaluate the environmental performance of their products [8] by implementing environmental approaches and programs. However, environmental performance can yield either positive or negative outputs when examined within a broader context. Sometimes, enterprises pursuing technological innovation can obtain contradictory results in environmental performance. Some authors affirmed that even the pursuit of environmental innovation could lead to undesirable results on environmental performance [9] because of the complexity of factors involved during the life cycle of the product. Therefore, it is necessary to analyze the relationship between environmental tools—such as CP—and broader environmental approaches, methods, and tools—such as life cycle assessment (LCA)—in order to make them more effective [10]. The notion of tradeoff becomes relevant here because it is often challenging to obtain positive environmental performance in all aspects when redesigning a product, process, or service.
Tradeoff relates to situations when compromise is required, such as when sacrificing one element or area to obtain benefits in another area [11]. Such situations are sometimes unavoidable, but as their presence might be foreseeable, they may also be handled with various methods and tools to enhance or reassess the results obtained while using environmental programs like CP. Several researchers have encountered this situation in their analysis, which is a sign that despite that several Ecodesign tools provide some support in tradeoff situations, not all of them support a robust qualitative and quantitative approach. Researchers usually consider several strategies ranging from the use of Ecodesign checklists to more sophisticated tools such as Ecodesign scenarios [12], impact and probability Matrix [13], or tradeoff significance methods based on probability distribution [14], among others. Although Ecodesign tools are designed to be useful and straightforward to support decision making, they are more effective when taking a full life-cycle perspective [11].
One of the most used tools to assess environmental impacts from a systematic point of view, including the cradle to grave approach, is LCA. It is a structured and comprehensive method [15], based on an international standardized framework [13,14,15,16], with a holistic approach used to assess environmental impacts [17,18,19,20]. It is precisely because of its systemic and rigorous technical application that it is one of the preferred assessment methods [21], used by an increasing number of scientists, academics, and practitioners.
However, LCA and CP are usually seen as environmental tools that usually give contradicting results. Figure 1 lists some characteristics of both tools, which can be perceived as advantages or disadvantages depending on the point of view of a practitioner or scientist, and the capacity of a company producing resources. If an assessment is sought in a company with limited resources, and there is no staff with experience in LCA, CP may be considered a better option. On the other hand, if the practitioner has enough experience in LCA and the company has enough resources, CP may be considered unnecessary owing to its apparent lack of technical or scientific rigor, in addition to its limited scope.
This study intends to address the following questions: Do CP and LCA represent opposite points of view when attempting to assess the sustainability of a product system? What criteria should small or medium enterprises use to implement LCA to enhance or complement a CP program? How can small and medium enterprises with limited financial resources approach the results of CP programs after implementing any impact assessments such as LCA? These questions gain significant relevance when enterprises, despite their size and financial constraint, commit to improving the environmental performance of their products.

2. Materials and Methods

2.1. Previous CP Results and Main Achievements

This study represents the second phase of an academic project carried out at a small wood industry located in Brazil, in the metropolitan region of Salvador Bahia. The main source of material for that company was located in the city of Eunápolis, 651 km away from Salvador de Bahia. The main product being produced at that time was a model of a wooden chair, mostly made of bonded boards of Eucalyptus urophylla. The first phase of the project, carried out in 2017, consisted of the implementation of a CP program aimed to increase the sustainability of that particular production. The CP program did not include any environmental impact assessment nor LCA, because of limitations of time and resources, but, as stated by Gutierrez et al. [7], LCA was among the recommendations. As a result, an LCA study was implemented to assess the environmental impacts of the re-designed model—already being produced by that time—with the basic model.
The CP program followed the Cleaner Production Program developed by the United Nations Industrial Development Organization (UNIDO) / United Nations Environment Programme (UNEP) and adapted by the National Center for Clean Technologies (CNTL) in Brazil. A schematic diagram of such implementation is presented in Figure 2.
The planning and organization of the CP program included administrative steps to organize the cleaner production team and to set responsibilities to be distributed among the administrative and operative workforce. The pre-evaluation stage consisted of the selection of the product or process to be analyzed. The eucalyptus chair was then selected as the target-product, mainly owing to its high production volume. That eucalyptus chair was also the preferred chair used in different shopping centers in the metropolitan area of Salvador Bahia.
The evaluation process represented the measure of mass and energy balances related to the production process. That included the direct measure, quantification, and validation through material flow analysis of the energy, water, and materials being used to produce the model. After that evaluation, a feasibility study was carried out, applying eco-design principles to reduce waste and materials at the source of every process needed to complete the product. Once a new design was proposed and approved to production, a report expressing these improvements was issued.
The changes in the new design included the elimination of parts that provided redundant support, redesigning the manufacturing process of the biggest parts to reduce material consumption, and finally changing the material of the seat from bonded eucalyptus to a plywood seat with a more efficient production process. The differences between the basic model and the redesigned one are presented in Figure 3.
The increase in the efficiency of resources included reductions in both material and energy, as indicated in Table 1 and Table 2.
These results represented the entry point of discussion between the use of CP and the use of LCA. Up to that moment, all results of the CP program were considered as environmental gains that were aligned with the objectives of the program. They represented savings in raw materials, waste production, and energy consumption (direct electricity consumed by the equipment for the re-designed model production). The change of the material of the seat (i.e., the use of plywood planks instead of bonded eucalyptus boards) was one of the changes that accounted for the higher gains in material reduction and waste generation. The CP team, considering the results, were willing to extend the CP principles to other products, but were also willing to assess the environmental gains with a scientific tool such as LCA, following the recommendation given and published by the authors of [7].

2.2. Goal and Scope

The objective of the study was to perform a comparative LCA between the previous model of the eucalyptus chair and the new design that was developed following the recommendations of the CP program. As the availability of data and financial reports was limited, this study is considered a basic study without full ISO compliance.
Regarding the accuracy and completeness of the data, the study included measured data from the productive process of the models previously collected on the CP program (weight of the parts and residues, energy consumption per machinery, and waste produced at every manufacturing stage). Data inconsistencies were complemented by mass and energy balances [7]. Regarding the rest of the stages needed for the Life Cycle Inventory (LCI), it was necessary to adapt data from specialized literature and complete the gaps with database values or estimated values based on formulas or distances. As a result, the LCI included the previous inventory data from the CP program, as well as new data estimated or calculated. This was the case for the seedling production processes, forest maintenance, harvesting process, lumber mill process, drying process, transports, product use, and final disposition scenario.
Some LCA results were also compared with reported values from the literature as reference. A material cutoff criterion was taken in order to dismiss those materials accounting for less than 1% of the materials required to produce the wooden chair. As for the assessment comparison methods, the ILCD 2011 midpoint (ILCD stands for International Reference Life Cycle Data System, developed by the Joint Research Center (JRN) of the Institute for Environment and Sustainability of the European Commission.) method and cumulative energy demand method were selected because of their diverse characterization and relevance.
Although the Ecoinvent 3.4 database included information about eucalyptus products, it was considered that specific data would be needed in order to properly assess the impacts in this case. The reasoning behind that was that inventory values from eucalyptus wood in the database could be significantly different from the ones of the Brazilian wood industry, mostly because of high differences in edaphoclimatic conditions, wood productivity, harvesting technology, national electrical grid, and average distances between the planted forest, sawmills, production facilities, and municipal landfills. As a result, it was decided that the best approach would be having a cradle to grave system considering specific Brazilian conditions when possible. Figure 4 presents the product system boundaries and the reference flux to produce the basic model. The same procedure was carried out to represent the product system for the redesigned model, whose differences were basically at the amount of wood and energy required at the manufacturing process, incorporating the new material (plywood).
The scope included modeling the forest maintenance process (considering 20 years of land occupation from former pasturelands transformed to eucalyptus planted forest) and incorporating specific conditions for the Brazilian harvesting, lumber mill, drying, manufacturing, product use, and final disposal at the municipal landfill.
The functional unit was chosen from a utility point of view rather than a material point of view (units produced or material amount), as it is not recommended to make a direct comparison between mere products [22], but rather to compare the similar service they are intended to fulfill as functional units. As the specific wooden chair was designed to serve for 12 h per day, during a minimum average of three years before planned obsolescence (i.e., prearranged reform of the food court, taking place every three years), an equivalent service span life was calculated. The functional unit was defined as 12,600 h in continuous service, considering 350 service days for the shopping center, and that both chairs can serve those years before being discharged. As a result, the values presented in Figure 4 are expressed in equivalences to produce one unit of the basic model.

2.3. Life Cycle Inventory

Life cycle inventory included first-hand data collected at the host enterprise during the CP program implemented; secondary data adapted from previous studies related to eucalyptus plantations in Salvador Bahia, Brazil [23]; and complementary data adapted from other specialized literature.
This study declares that allocation had to be included at some steps of the life cycle modeling because other wooden co-products such as shavings, sawdust, and firework are also generated at large scale at the lumber mill and manufacturing facilities, but their final destination is not part of the scope of this study. Therefore, their material flows and environmental contributions were considered using mass allocation distribution. In order to assess the better results, an iterative process took place during the LCA, in order to identify gaps and assure the accuracy of results. SimaPro® by PRé Consultants was the specialized software used to list the inventory for the different stages of the production system for the basic model and the redesigned model. The inventory list of the different materials at the different stages of the production system is included in the supplementary material from Table S1 to Table S9.

2.4. Life Cycle Impact Assessment

In order to have a comprehensive set of impact, ILCD 2011 midpoint was selected as the evaluation impact method, to assess global warming potential, human toxicity, eutrophication, land use, and water depletion, among others. In addition, cumulative energy demand was selected as the assessment method to report the total energy impact of each product. SimaPro® was again used to run the impact assessments. The selection of those methods was to allow a broader discussion and better visualization of the tradeoffs among the products evaluated. This study declares that normalization (normalization, as defined by ISO 14044 standard, is a process to calculate the magnitude of the results of impact category indicator relative to an external value in order to bring all the results on the same scale) was used during the impact analysis. The limitations of this procedure are recognized, and as some authors have stated in different publications, external normalized results may lead to biases where freshwater ecotoxicity, human toxicity, and marine ecotoxicity are commonly among the highest impact categories [24]. As stated in the goal and scope, this study is not full ISO-compliant. ISO 14040 and 14044 standards support normalization, considering it an optional step that allows expressing results using a common reference [17], but the interpretation should take into account the possible bias that this procedure includes. Nevertheless, their use is not restricted [16,24], and normalization can still provide valuable insight [15], as the objective of the study is not to establish conclusive final values on every impact category, but rather to present decision support, especially in the combined use of CP and LCA. The comparative Life Cycle Impact Assessment (LCIA) is a stage that would be addressed according to the availability of resources that may go from limited software capabilities—such as this study—and full capabilities of numerical analysis tools that include uncertainty analysis or Monte Carlo simulation for scenario analysis.

2.5. Interpretation

The interpretation of the results had to go beyond a descriptive-comparative LCA, intended to select the best option between a set of dissimilar alternatives [14]. Owing to a limitation on software capabilities, the interpretation proposed an alternative path to deal with the tradeoffs proposing a flowchart to evaluate the situation in order to take the corresponding action that may include the use of more specific tradeoff analysis tools.
Initially, individual results for LCIA were calculated in order to assess their environmental impacts while contrasting some results with the literature. After that, a normalization procedure was carried out to identify the higher normalized impact category among the results of each product. This procedure provided valuable insight regarding the magnitude of the results relative to an external value in the same scale.
As a second step, a comparison was made between the normalized results of both products. By comparing them, it was possible to identify those characterization factors (already normalized and sorted) that presented an increase in their values relative to the re-designed model. Those impact characterization factors would eventually become the objectives of the final tradeoff analysis.
Owing to software limitations, it was not possible to perform a typical uncertainty analysis among the results of the normalized characterization factors (usually present in LCA studies). Instead, a second cut-off criterion was defined to aid in the analysis of the possible differences; those normalized values whose relative difference between the same characterization factors was less than 5% would not be considered in the final stage of the analysis, as their results would be extremely close. This simplified approximation was considered as sufficient to avoid focusing on characterization factors whose result might be hard to distinguish with confidence
The final interpretation among the tradeoffs included only those characterization factors that met the cut-off criteria and that at the same time represented an increase in their impact value with respect to the original model. The final tradeoff analysis includes identifying the source of the increase in the impact presented per characterized factor that would allow further discussion on how to reduce or overcome such results.
Regarding the results of the cumulative energy demand methodology, they were treated separately, as they came from a single-issue method, and no normalization was needed to bring the results into the same unit. Despite that, they were included and considered as relevant for the host enterprise, but had to go through the second criterion in order to be included in the final analysis of tradeoffs.

3. Results

The results of this research were divided into two sections: LCA using ILCD 2011 Midpoint, and LCA to assess cumulative energy demand, between functional units.

3.1. Life Cycle Comparison Based on ILCD Midpoint

Despite that the results of the CP program declared reductions in the consumption of material around 30%, as well as waste reductions up to 49%, once LCAs were carried out for both products (considering the cradle-to-grave scope of each model), it was possible to have a better understanding of the overall impacts. The LCA included two rounds of iteration in order to consider better data in the study. The impact categories included are presented in Table 3, and the results of the LCIA using the ILCD midpoint for both products are presented in Table 4.
Regarding the productive process, on average, the from seedling to manufacturing process accounted for up to 42% of the impacts, followed by the final disposition and transport processes. The comparison among models expressed as the relative percentage of impact between the basic model and the re-designed model is presented in Figure 5.

3.2. Life Cycle Comparison to Assess Cumulative Energy Consumption

After carrying out another LCA using cumulative energy demand, it was possible to have a comprehensive understanding of the total life cycle cumulative energy for each product, while making it possible to identify the stages where the most energy is required. Table 5 presents the results for each model indicating the distribution of renewable and non-renewable cumulative energy per stage.

4. Discussion

The results obtained from the LCIA contradicted some of the conclusions obtained from the results reported in the previous CP program. The LCA identified areas where the re-designed model had higher environmental impacts than the basic model; apparently, the re-designed model implied more energy consumption and had a bigger carbon emission than the original model, among others.

4.1. Results Interpretation

Even though most of the impact category presented reductions when comparing the basic model with the re-designed one, some of those results needed to be analyzed carefully to avoid misinterpretation. For instance, the increase presented in the impact category of global warming potential (+230%) was explained, taking into account that the life cycle model implemented considered the temporary removal of carbon dioxide from the atmosphere or carbon uptake [15]. In that regard, the general ILCD recommendation (as per prevision 7.4.3.7.3 from the ILCD Handbook: General guide for LCA, (pp. 226–227, [15])) is to consider the carbon dioxide intake as an input of resources from air, and to consider the very same amount in the outputs as emissions to air (something that apparently neutralizes the intake value of biogenic carbon), but at the same time, that recommendation indicates to consider another output flux known as correction flow for delayed emission of biogenic carbon dioxide within first 100 years. That consideration provides −0.01 kg of CO2-equivalents per 1 kg per year [15].
As presented in Figure 6 and Figure 7, such flow represents carbon capture, expressed as a negative value (or avoided impact) in the climate change impact factor, affecting the final value. As for the land-use factor, the reasoning was that in Brazil, the analyzed eucalyptus forest considered the transformation from pasture to intensive forest cultivation, which creates the resulting credit (also expressed as avoided impact) for the land-use impact category. Once it is noticed that the original chair required more material than the re-designed chair (10.3 kg vs. 7.2 kg of wood, respectively, as presented in Table 1), the resulting impact values make sense. The final figures for climate change potential and the rest of the impacts include all the contributions made during the life cycle.
Once taking those corrections flows into account, the final value of the global-warming impact factor was considered within reported values. As an example, a previous assessment of a similar product in Europe (a wooden chair of 4.05 kg mass) reported a total of 0.93 kg CO2 Equation [25] using the CML 2001–2010 assessment method, developed by the institute of environmental sciences at Leiden University.
Regarding the cumulative energy demand, the LCIA results were significantly higher than the results reported in the original CP program. These values can be understood considering that LCIA considers all the contributions that are included from a life cycle approach, which includes not only the direct electricity used in the manufacture of the products, but the total energy contained in materials, transports, and transformations up to the final destination. The final value for the redesigned chair is 5% higher than the value of the basic model, mostly for the cumulative energy contained in the plywood seat that substituted the eucalyptus seat on the basic model. That amount of energy was not part of the CP program; therefore, it was not considered when the savings in energy were estimated. Table 6 presents the final values after implementing the LCIA with the cumulative energy demand method.

4.2. Dealing with Tradeoffs

Tradeoffs are sometimes unavoidable when attempting Ecodesign for sustainability. The productive process, from seedling to manufacturing, accounted for almost half of the environmental impacts, followed by final disposition and transport. Among those productive processes, it was necessary to determine which characterization factors should be analyzed more deeply.
The normalization of characterized values was useful to identify impact categories in reference to an external value that could be used as a guide to set the priorities. Figure 8 presents the sorted results after the LCIA normalization.
In order to define which characterized factors were relevant to be analyzed, a percentage of change among the same normalized characterization factors was calculated. Even though the percentage of the change is equal to the ones visualized after the LCIA, in this case, all of the values were sorted following the normalization rule, as well as being expressed in the same unit of measure. The results indicated that, in decrescent order, human toxicity (non-cancer effects), particulate matter, and climate change potential had to be analyzed in detail, as they presented increases in their normalized results relative to the values of the basic model, as shown in Figure 9. These impact categories also fulfilled the cutoff criterion of having a higher than 5% change.
Regarding the cumulative energy demand, despite that it was not included in the normalization procedure, they were included intentionally in this section because the energy demand was considered one of the main achievements during the CP program implemented. Despite that the LCA results using the cumulative energy demand method were significantly higher than the values reported during the CP program, the difference among such a value in the comparison was just about 5%. As a result, it did not pass the second cutoff criterion. Table 7 presents the selection of the final characterization factors that fulfilled the cutoff criterion.
Although the re-designed chair partially fulfilled the objectives stated in the CP program, a more in-depth analysis of the sources for human toxicity indicated that the presence of substances such as zinc, mercury, lead, and arsenic, among others, generated during the transport of materials and products required for the manufacture of the re-designed model, followed by the final disposal and landfill processes. In this case, the re-designed chair presented higher values, mostly owing to the change in the material of the seat (plywood) at those stages of the life cycle. Other literature findings regarding wood base products and processed wood products, such as plywood, had also indicated that most of the environmental impacts occur outside the plant in the modern furniture industry in Brazil [26], so this finding was considered aligned with those observations. A detail of the main substances reported in this characterization factor is presented in Table 8.
Regarding the increase of particulate matter in the re-designed model, the primary substances identified were particulates <2.5 um, sulfur dioxide, nitrogen oxides, and ammonia. Once again, the source of such increase was identified to be the manufacture of the material of the seat (plywood). Table 9 present the values of those substances in the particulate matter impact category.
Finally, following the order established for the normalization, the last characterization factor to be analyzed in the tradeoff discussion was the increase in the global warming potential factor. In this case, the main explanation was a bit different from the others; despite that the incorporation of the plywood seat did increase the value of the global warming potential, the main reason here was the reduction of the material used to manufacture the re-designed model. This reduction implied less capture of biogenic carbon in the form of raw material, as explained herein—Section 4.1, interpretation of results.

4.3. Proposed Flowchart for Small and Medium Enterprises Attempting CP Programs

The previous CP program carried out in 2017 concluded that by substituting part of the raw material and by changing some stages of the production process, it was possible to reduce waste generation, as well as material and energy consumption. Even though those environmental goals were achieved at that time, the following LCA study demonstrated that a broader scope is relevant in order to avoid transference of impacts among products or materials.
The LCA demonstrated the presence of environmental tradeoffs among the impact characterization factors of the re-designed model, mostly owing to the changes made in the material of the seat and the manufacturing process. Even though it was not possible to carry out the LCA during the implementation of the CP program in 2017 (something that might have prevented the decision to change the material of the seat from bonded eucalyptus pieces to plywood), this study helps to highlight the relevance of the timing when complementing a CP program with an LCA. As a result of this, a flowchart that could aid to identify this kind of situation, as well as other possible situations when implementing a CP program, was proposed. The flowchart can help to identify a situation in which it is necessary to complement the CP program with an LCA.
The proposed flowchart can also help to avoid unnecessary costs and time associated with the implementation of a full LCA in cases that might be unnecessary. Carrying out an LCA from the beginning might be out of reach for micro and small enterprises owing to the need for financial resources and properly trained personnel. That situation could discourage the implementation of an initiative to make environmental improvements in a productive process.
The proposed flowchart is presented in Figure 10. The procedure can follow the steps included in areas A, B, and C. Steps 1.0 to 4.0 represent a common path. The decisions 4.1, 4.2, 4.3, and 4.4 represent necessary questioning that can be evaluated while implementing a CP program. In the case any of such decisions having an affirmative answer, a complementary assessment tool is required in order to analyze unidentified tradeoffs. The path contained within area C is suggested when material or energy substitutions are made, focusing on environmental assessment methods and tradeoff analysis aimed to quantify the relative differences among the most relevant impact (like the approach carried out in this case study), but can also include sensitivity analysis or Monte Carlo simulations. The selection of the tool to address the tradeoffs will depend on the availability of resources and the assessment method selected. Area B path is similar to area C and is suggested when the production process or lifespan is affected in the CP program. It is focused on—but not limited to—changes that require forecasting scenarios.
Finally, it is essential to highlight that areas A, B, or C are not intended to represent any hierarchy among environmental strategies or among the environmental performance of tools. It is possible to have better environmental performance in any of them. What the area A path does highlight is that if there are no changes among energy sources, material, processes, or lifespan, then it is not necessary to carry out another environmental assessment because there will not be environmental tradeoffs, and as a result, the environmental gains from the CP program can be reported with confidence.

5. Conclusions

At the beginning of this paper, some questions regarding CP and LCA were established. After the implementation of this study, it was possible to answer them.
First, it was questioned if CP and LCA represent opposite points of view when attempting to assess the sustainability of a product system. It was concluded that the answer is no. They do not represent opposite points of view, and this conclusion considers the real results obtained in the case of study, which signalized the presence of increments and decrements among the values of the characterized impact factors of the products evaluated. It is possible that similar situations of contradictory results in other case studies reinforced the idea that the tools are not compatible, but this study identified at least one of the main reasons of this misconception of the tools: the timing of the LCA is relevant. The late implementation of the assessment prevented evaluating the new material proposed for the seat in the CP program (plywood). By the time the LCA was carried out, and the increase in some characterization factors was identified, the production process and new design of the product were already in place.
It is recognized that CP programs provide a valuable framework that an LCA might not provide because it is out of its scope; first, the CP has the form of a continuous program, requesting the creation of a working team within the enterprise in charge of looking for new ways to reduce waste generation and material consumption in all the processes of the enterprise. It also requires measuring, estimating, and computing mass and energy balances, and owing to its flexibility and adaptability for any size of enterprise, it is recommended for national and international institutions as a way to attempt sustainability at an enterprise scale. Their limitations regarding the scope and the lack of scientific rigor also recognized, something that LCA does provide, along with the benefit of having a life cycle scope, something that helps to recognize and prevent shifting environmental burdens among processes or products. Indeed, they are not equivalent tools; carrying out just a CP program or an LCA are not considered equivalent as the information needed, time, resources, results, and the possible further actions might be different. The synergy is enhanced when used in combination.
Regarding the question of the criterion that a small or medium enterprise should use to implement LCA as the complement of a CP program, it is concluded that this criterion depends on the findings and recommendations of the CP team. Here, the proposed flowchart is found to be useful to help any CP team to identify the tradeoffs zones where LCA could be needed. As an example, if the flowchart would have been used in this case study, despite that the CP program did not propose changing the energy source or modifying so much the product composition (affecting its lifespan), the CP team suggested changing the material and the production process to reduce waste generation and material and energy consumption. According to the flowchart proposed, these changes would have requested an assessment using a specialized tool such as LCA before taking place.
Carrying out an LCA requires specialized knowledge, and that could be costly depending on the situations of the enterprises and the product or service being evaluated, among other variables. So how can small and medium enterprises with limited financial resources implement a CP program that might request an LCA? In that case, there is not a definitive answer, but this case of study was carried out facing those financial challenges with the aid of an academic institution that provided the staff and operative personnel, as well as other resources such as the software and other expenses. This would be considered an option, keeping in mind that the support might also be limited. It is also signalized that not having the capability to run an LCA should not stop any effort to improve the environmental performance of any product or service through a CP program, as long as some conditions—also identified in the proposed flowchart as no changes in energy source, lifespan, materials, or production processes—are met.
As some authors have stated, support for tradeoffs is commonly found in some Ecodesign tools, and their level of support might include life cycle perspective [11]. Therefore, a direct implementation of an LCA is intended to offer support for the situation of tradeoffs. Usually, specialized software such as SimaPro® includes in its expert-license a set of sensibility tools to interpret the results, as well as several capabilities to set scenarios, including Pedigree Matrix for uncertainty analysis and Monte Carlo simulation for probability distribution scenarios. That was not the case under the faculty license used in this study, but this limitation was not considered a stop. Instead, this situation was used as part of the framework and context that might be relevant to some micro and small enterprises in Latin America.
Regarding the specific product system of this case study, after the implementation of the LCA, it was recommended to the manager to revise the selection of the material of the seat in the redesigned model. More material options can still be considered, including other wood species with less impact and recycled wood from other processes, among others. Following the procedure proposed here, any future change in the material should include a life cycle perspective. Another suggestion made to the manager was to consider closer suppliers of wood. The distance of 621 km from the planted forest to the city of Salvador accounted for most of the impacts regarding CO2 emissions; therefore, sourcing the material from a nearer provided could improve the environmental performance of the products in that characterization factor.
Finally, it is highlighted that the current study does not pretend to discourage the implementation of any CP programs on behalf of performing the LCA. On the contrary, this study does highlight and encourage the continuous implementation of CP programs, especially in Latin America, where a large part of their economy depends on small- and medium-sized enterprises. In that sense, CP seems to be the logical first step in the pursuit of sustainability, owing to its lower need for financial resources.

Supplementary Materials

The following are available online at https://www.mdpi.com/2071-1050/11/18/5026/s1, Table S1: Seedling process inventory; Table S2: Forest maintenance process inventory; Table S3: Harvesting process inventory, Table S4: Lumber mill process inventory; Table S5: Drying process inventory; Table S6: Manufacturing process inventory for the basic model; Table S7: Manufacturing process inventory for the re-designed model; Table S8: Product use inventory (same for basic and re-designed model); Table S9: Final disposition; Table S10: Average distances considered in the study; Figure S1: Location of the state of Bahia in Brazil (a) and the main cities (b) considered in the LCA study. Map adapted from Bing, Microsoft Corporation ®.

Author Contributions

This article was made with the efforts of all the authors, but the following specific contributions are recognized: A.K. and S.F.-C. conceived the follow up of the previous CP program, as well as the LCA design. R.P. performed the LCA case study. R.P., C.M.G.-A., and B.E.A. Álvarez contributed to the literature review, analysis, and discussion of results. R.P. prepared the conclusions. A.K. and S.F.-C. revised the methods, discussion of results, and conclusions. R.P. and C.M.G.-A. wrote the manuscript.

Funding

This research received no external funding.

Acknowledgments

This research study was possible thanks to the financial support of the Coordination for the Improvement of Higher Education Personnel (CAPES) in the form of scholarships. The authors also acknowledge the collaboration of the Industrial Engineering Program of the Federal University of Bahia (PEI-UFBA) for the use of the wood laboratory, and the Central American University José Simeón Cañas (UCA) for the use of the productivity laboratory. They also acknowledge the support of SimaPro® by PRé Consultants for granting the Faculty License used in this study. Finally, the collaboration of the host enterprise is recognized, for allowing the implementation of the Cleaner Production program and for the continued support in the following Life Cycle Assessment.

Conflicts of Interest

The authors declare no conflict of interest. Sponsors had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. UNDP-UNEP. How to Establish and Operate Cleaner Production Centres about the Guidance Manual; UNDP: New York, NY, USA; UNEP: Nairobi, Kenya, 2008. [Google Scholar]
  2. Liang, W.; Luo, S.; Zhao, G. Evaluation of cleaner production for gold mines employing a hybrid multi-criteria decision-making approach. Sustainability 2018, 11, 146. [Google Scholar] [CrossRef]
  3. Visvanathan, C.; Kumar, S. Issues for better implementation of cleaner production in Asian small and medium industries. J. Clean. Prod. 1999, 7, 127–134. [Google Scholar] [CrossRef]
  4. Clark, G. Evolution of the global sustainable consumption and production policy and the United Nations Environment Programme’s (UNEP) supporting activities. J. Clean. Prod. 2007, 15, 492–498. [Google Scholar] [CrossRef]
  5. Ayres, R.U.; Ayres, L.W. A Handbook of Industrial Ecology; Edward Elgar Publishing Limited: Cheltenham, UK, 2002. [Google Scholar]
  6. Naveiro, R.M.; Pacheco, E.B.A.V.; Medina, H.D. Ecodesign : O desenvolvimento de projeto de produto orientado para reciclagem. In Proceedings of the Congresso Brasileiro de Gestão de Desenvolvimento de Produto, Curitiva-PR, Brazil, 9–12 August 2005. [Google Scholar]
  7. Aguilar, C.M.G.; Panameño, R.; Velazquez, A.P.; Álvarez, B.E.A.; Kiperstok, A.; César, S.F. Cleaner production applied in a small furniture industry in Brazil: Addressing focused changes in design to reduce waste. Sustainability 2017, 9, 1867. [Google Scholar] [CrossRef]
  8. ESevero, A.; de Guimarães, J.C.F.; Dorion, E.C.H.; Nodari, C.H. Cleaner production, environmental sustainability and organizational performance: an empirical study in the Brazilian Metal-Mechanic industry. J. Clean. Prod. 2015, 96, 118–125. [Google Scholar] [CrossRef]
  9. Lee, J.; Kim, S.J. Curvilinear relationship between corporate innovation and environmental sustainability. Sustainability 2017, 9, 1267. [Google Scholar] [CrossRef]
  10. Tingström, J.; Karlsson, R. The relationship between environmental analyses and the dialogue process in product development. J. Clean. Prod. 2006, 14, 1409–1419. [Google Scholar] [CrossRef]
  11. Byggeth, S.; Hochschorner, E. Handling trade-offs in Ecodesign tools for sustainable product development and procurement. J. Clean. Prod. 2006, 14, 1420–1430. [Google Scholar] [CrossRef]
  12. Albertí, J.; Raigosa, J.; Raugei, M.; Assiego, R.; Ribas-Tur, J.; Garrido-Soriano, N.; Zhang, L.; Song, G.; Hernández, P.; Fullana-i-Palmer, P. Life Cycle Assessment of a solar thermal system in Spain, eco-design alternatives and derived climate change scenarios at Spanish and Chinese National levels. Sustain. Cities Soc. 2019, 47, 101467. [Google Scholar] [CrossRef]
  13. De Magalhães, R.F.; Danilevicz, Â.D.F.; Palazzo, J. Managing trade-offs in complex scenarios: A decision-making tool for sustainability projects. J. Clean. Prod. 2019, 212, 447–460. [Google Scholar] [CrossRef]
  14. Chester, M.; Arslan, E.; Wender, B.A.; Seager, T.P.; Prado-Lopez, V.; Laurin, L. Tradeoff Evaluation Improves Comparative Life Cycle Assessment: A Photovoltaic Case Study. J. Ind. Ecol. 2015, 20, 710–718. [Google Scholar]
  15. European Commission-Joint Research Centre-Institute for Environment and Sustainability. General Guide for Life Cycle Assessment—Detailed Guidance; European Commission: Brussel, Belgium, 2010. [Google Scholar]
  16. European Commission-Joint Research Centre-Institute for Environment and Sustainability. Framework and Requirements for Life Cycle Impact Assessment Models and Indicators; European Commission: Brussel, Belgium, 2010. [Google Scholar]
  17. International Organization of Standardization. ISO 14040 Environmental Management-Life Cycle Assessment-Principle and Framework; International Organization of Standardization: Geneva, Switzerland, 2009. [Google Scholar]
  18. UNEP/SETAC Life cycle Initiative. Life Cycle Approaches: The Road from Analysis to Practice, Assessment; UNEP/SETAC Life cycle Initiative: Paris, France, 2005; p. 89. [Google Scholar]
  19. Frischknecht, R.; Fantke, P.; Tschümperlin, L.; Niero, M.; Antón, A.; Bare, J.; Boulay, A.M.; Cherubini, F.; Hauschild, M.Z.; Henderson, A.; et al. Global guidance on environmental life cycle impact assessment indicators: progress and case study. Int. J. Life Cycle Assess. 2016, 21, 429–442. [Google Scholar] [CrossRef] [Green Version]
  20. Reed, D. Life-Cycle Assessment in Government Policy in the United States. Ph.D. Thesis, University of Tennessee, Knoxville, TN, USA, 2012. [Google Scholar]
  21. UNEP/SETAC Life cycle Initiative. Towards a Life Cycle Sustainability Assessment. Making Informed Choices on Products; UNEP/SETAC Life cycle Initiative: Paris, France, 2011. [Google Scholar]
  22. Weidema, B.; Wenzel, H.; Petersen, C.; Hansen, K. The product, functional unit, and reference flows in LCA. Environ. News 2004, 70, 1–46. [Google Scholar]
  23. Souza, H.H.D. Avaliação do Ciclo de Vida e Influência do Tempo de Vida útil dos Postes de Madeira e de Concreto do Sistema de Distribuição de Energia Elétrica; Universidad Federal da Bahia: Salvador, Brazil, 2014. [Google Scholar]
  24. Prado, V.; Wender, B.A.; Seager, T.P. Interpretation of comparative LCAs: external normalization and a method of mutual differences. Int. J. Life Cycle Assess. 2017, 22, 2018–2029. [Google Scholar] [CrossRef] [Green Version]
  25. Linkosalmi, L.; Husgafvel, R.; Fomkin, A.; Junnikkala, H.; Witikkala, T.; Kairi, M.; Dahl, O. Main factors influencing greenhouse gas emissions of wood-based furniture industry in Finland. J. Clean. Prod. 2016, 113, 596–605. [Google Scholar] [CrossRef]
  26. Medeiros, D.L.; do Carmo Tavares, A.O.; e Silva, Á.L.; Kiperstok, A. Life cycle assessment in the furniture industry: the case study of an office cabinet. Int. J. Life Cycle Assess. 2017, 22, 1823–1836. [Google Scholar] [CrossRef]
Figure 1. Selection of perceived characteristics of cleaner production (CP) and life cycle assessment (LCA) as options with contradicting results.
Figure 1. Selection of perceived characteristics of cleaner production (CP) and life cycle assessment (LCA) as options with contradicting results.
Sustainability 11 05026 g001
Figure 2. Schematic implementation of CP program as per the case study. Adapted from the work of [7].
Figure 2. Schematic implementation of CP program as per the case study. Adapted from the work of [7].
Sustainability 11 05026 g002
Figure 3. (a) Basic model before CP program; (b) redesigned model after CP program.
Figure 3. (a) Basic model before CP program; (b) redesigned model after CP program.
Sustainability 11 05026 g003
Figure 4. The schematic life cycle of the basic model of the wooden chair, indicating the reference flux, and main imports (I) and exports (E) fluxes.
Figure 4. The schematic life cycle of the basic model of the wooden chair, indicating the reference flux, and main imports (I) and exports (E) fluxes.
Sustainability 11 05026 g004
Figure 5. Characterized results of impact assessment of basic and re-designed model-excluding infrastructure and long-term emissions. GWP, global warming potential; PM, particulate matter; HTNCE, human toxicity, non-cancer effects; POF, photochemical ozone formation; EUTM, marine eutrophication; EUTT, terrestrial eutrophication; FRWTOX, freshwater ecotoxicity; ODP, ionizing radiation e (interim); IRHH, ionizing radiation HH; AC, acidification; HTCE, human toxicity, cancer effects; WD, water resource depletion; EUTF, freshwater eutrophication; MFRRD, mineral, fossil, and ren resource depletion; LU, land use.
Figure 5. Characterized results of impact assessment of basic and re-designed model-excluding infrastructure and long-term emissions. GWP, global warming potential; PM, particulate matter; HTNCE, human toxicity, non-cancer effects; POF, photochemical ozone formation; EUTM, marine eutrophication; EUTT, terrestrial eutrophication; FRWTOX, freshwater ecotoxicity; ODP, ionizing radiation e (interim); IRHH, ionizing radiation HH; AC, acidification; HTCE, human toxicity, cancer effects; WD, water resource depletion; EUTF, freshwater eutrophication; MFRRD, mineral, fossil, and ren resource depletion; LU, land use.
Sustainability 11 05026 g005
Figure 6. Characterized results of impact assessment of basic model-excluding infrastructure and long-term emissions.
Figure 6. Characterized results of impact assessment of basic model-excluding infrastructure and long-term emissions.
Sustainability 11 05026 g006
Figure 7. Characterized results of impact assessment of the re-designed model-excluding infrastructure and long-term emissions.
Figure 7. Characterized results of impact assessment of the re-designed model-excluding infrastructure and long-term emissions.
Sustainability 11 05026 g007
Figure 8. Normalized and sorted results of impact assessment of basic model and redesigned-excluding infrastructure and long-term emissions.
Figure 8. Normalized and sorted results of impact assessment of basic model and redesigned-excluding infrastructure and long-term emissions.
Sustainability 11 05026 g008
Figure 9. Percentage of change between normalized impact categories relative to the basic model.
Figure 9. Percentage of change between normalized impact categories relative to the basic model.
Sustainability 11 05026 g009
Figure 10. Proposed flowchart when considering the implementation of CP programs and LCA.
Figure 10. Proposed flowchart when considering the implementation of CP programs and LCA.
Sustainability 11 05026 g010
Table 1. Savings in materials after the implementation of the cleaner production (CP) program expressed per chair.
Table 1. Savings in materials after the implementation of the cleaner production (CP) program expressed per chair.
Basic Model (g)Re-Designed (g)Change %
Total consumption10,2927209−30.0%
Total used57834888−15.5%
Total waste45092321−48.5%
% of waste generated43.81%32.20%−26.5%
Source: Adapted from the work of [7].
Table 2. Energy consumption after the implementation of the CP program expressed per chair.
Table 2. Energy consumption after the implementation of the CP program expressed per chair.
Manufacturing ProcessBasic ModelRe-Designed ModelChange %
(kWh)(MJ)(kWh)(MJ)
Component’s production4.9217.713.1511.34−36.0%
Final assembly0.080.290.080.290
Total consumption5.0018.003.2311.63−36.0%
Source: Adapted from the work of [7].
Table 3. Impact category and Acronyms used in ILCD midpoint 2011.
Table 3. Impact category and Acronyms used in ILCD midpoint 2011.
Impact CategoryAcronymUnit
Global warming potentialGWPkg CO2 eqkilograms of carbon dioxide equivalent
Particulate matterPMkg PM2.5 eqkilograms of particulate matter suspended of less than 2.5 microns
Human toxicity, non-cancer effectsHTNCECTUhcomparative toxic units for human toxicity
Photochemical ozone formationPOFkg NMVOC eqkilograms of non-methane volatile organic compounds equivalent
Marine eutrophicationEUTMkg N eqkilograms of nitrogen equivalent.
Terrestrial eutrophicationEUTTmolc N eqmoles of nitrogen equivalent
Freshwater ecotoxicityFRWTOXCTUecomparative toxic units for aquatic ecotoxicity
Ozone depletionODPkg CFC-11 eqkilograms of trichlorofluoromethane equivalent
Ionizing radiation E (interim)IRECTUecomparative toxic units for aquatic ecotoxicity
Ionizing radiation HHIRHHkBq U235 eqkilobecquerel of uranium 235 for ionizing radiation
AcidificationACmolc H+ eqmoles of hydrogen ion equivalent
Human toxicity, cancer effectsHTCECTUhcomparative toxic units for human toxicity
Water resource depletionWDm3 water eqcubic meters of water equivalent
Freshwater eutrophicationEUTFkg P eqkilograms of phosphorus equivalent
Mineral, fossil & ren resource depletionMFRRDkg Sb eq kilograms of antimony equivalent
Land useLUkg C deficit kg of carbon deficit
Table 4. LCIA for basic and re-designed models, using ILCD 2011 Midpoint+ V1.10/EC-JRC Global, equal weighting.
Table 4. LCIA for basic and re-designed models, using ILCD 2011 Midpoint+ V1.10/EC-JRC Global, equal weighting.
AcronymUnitBasic ModelRe-DesignedChange %
GWPkg CO2 eq7.02 × 10−12.32 × 10230.85%
PMkg PM2.5 eq6.60 × 10−31.07 × 10−261.68%
HTNCECTUh1.37 × 10−61.49 × 10−69.30%
POFkg NMVOC eq7.01 × 10−26.88 × 10−2−1.83%
EUTMkg N eq3.07 × 10−22.95 × 10−2−4.09%
EUTTmolc N eq2.88 × 10−12.71 × 10−1−5.90%
FRWTOXCTUe2.33 × 1012.15 × 101−7.54%
ODPkg CFC-11 eq1.83 × 10−61.68 × 10−6−8.21%
IRECTUe4.84 × 10−64.39 × 10−6−9.26%
IRHHkBq U235 eq6.81 × 10−16.13 × 10−1−10.03%
ACmolc H+ eq7.85 × 10−27.04 × 10−2−10.24%
HTCECTUh6.52 × 10−85.77 × 10−8−11.45%
WDm3 water eq6.86 × 10−34.61 × 10−3−32.79%
EUTFkg P eq1.28 × 10−36.96 × 10−4−45.45%
MFRRDkg Sb eq2.56 × 10−41.26 × 10−4−50.71%
LUkg C deficit−7.98 × 101−1.43 × 101−82.03%
Table 5. Energy consumption as per the cumulative energy demand V1.10 method.
Table 5. Energy consumption as per the cumulative energy demand V1.10 method.
Impact CategoryTotal (MJ)Product Manufacture (MJ)Final Destination (MJ)Other Stages (MJ)
Basic Model
Non-renewable176.063.468.544.6
Renewable86.786.40.20.1
Total Basic Model262.7149.868.744.7
Re-Designed
Non-renewable162.049.168.544.6
Renewable114.0113.00.20.1
Total Re-designed model276.0162.168.744.7
Table 6. Comparison between basic and redesigned model using cumulative energy demand (CED).
Table 6. Comparison between basic and redesigned model using cumulative energy demand (CED).
Impact CategoryBasic Model (MJ)Re-Designed Model (MJ)Variation %
Non-renewable176.0162.0−8%
Renewable86.7114.031%
Total:263.0276.05%
Table 7. Summary of characterization factors considered in the final tradeoff analysis.
Table 7. Summary of characterization factors considered in the final tradeoff analysis.
Impact CategoryChange %Interpretation
Human toxicity, non-cancer effects9%Increase in Impact
Particulate matter62%Increase in Impact
Global warming potential231%Increase in Impact
Table 8. Specificity per substance/human toxicity, non-cancer effects/0.1% cut off criteria.
Table 8. Specificity per substance/human toxicity, non-cancer effects/0.1% cut off criteria.
SubstanceUnitBasic ModelRe-Designed
ZincCTUh8.47 × 10−71.04 × 10−6
MercuryCTUh1.84 × 10−71.44 × 10−7
LeadCTUh1.12 × 10−71.08 × 10−7
ArsenicCTUh9.73 × 10−87.89 × 10−8
AcroleinCTUh2.80 × 10−82.56 × 10−8
AntimonyCTUh2.58 × 10−82.41 × 10−8
MolybdenumCTUh2.53 × 10−82.36 × 10−8
BariumCTUh2.58 × 10−82.13 × 10−8
CadmiumCTUh1.45 × 10−81.88 × 10−8
Remaining SubstancesCTUh6.15 × 10−96.55 × 10−9
1.37 × 10−61.49 × 10−6
Table 9. Specificity per substance/particulate matter/0.1% cut off criteria.
Table 9. Specificity per substance/particulate matter/0.1% cut off criteria.
SubstanceUnitBasic ModelRe-Designed
Particulates, <2.5 umkg PM2.5 eq4.69 × 10−39.04 × 10−3
Sulfur dioxidekg PM2.5 eq1.34 × 10−31.10 × 10−3
Nitrogen oxideskg PM2.5 eq4.70 × 10−44.44 × 10−4
Ammoniakg PM2.5 eq1.04 × 10−47.31 × 10−5
6.60 × 10−31.07 × 10−2

Share and Cite

MDPI and ACS Style

Panameño, R.; Gutiérrez-Aguilar, C.M.; Angel, B.E.; Fábio-César, S.; Kiperstok, A. Cleaner Production and LCA as Complementary Tools in Environmental Assessment: Discussing Tradeoffs Assessment in a Case of Study within the Wood Sector in Brazil. Sustainability 2019, 11, 5026. https://doi.org/10.3390/su11185026

AMA Style

Panameño R, Gutiérrez-Aguilar CM, Angel BE, Fábio-César S, Kiperstok A. Cleaner Production and LCA as Complementary Tools in Environmental Assessment: Discussing Tradeoffs Assessment in a Case of Study within the Wood Sector in Brazil. Sustainability. 2019; 11(18):5026. https://doi.org/10.3390/su11185026

Chicago/Turabian Style

Panameño, Ronald, Carlos Mario Gutiérrez-Aguilar, Beatriz Elena Angel, Sandro Fábio-César, and Asher Kiperstok. 2019. "Cleaner Production and LCA as Complementary Tools in Environmental Assessment: Discussing Tradeoffs Assessment in a Case of Study within the Wood Sector in Brazil" Sustainability 11, no. 18: 5026. https://doi.org/10.3390/su11185026

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop