Survey Study on Attitudes to Multi-Dimensional Sustainable Development with U . K . MSc Students

As reflected in the sustainable development goals (SDGs), sustainable development is a multi-dimensional concept integrating political, ethical, economic, and other factors. Reports from the United Nations (UN) Decade of Education for Sustainable Development (UNDESD) suggest that universities are more engaged with sustainable development in higher education. Despite promising signals about student awareness of sustainable development, survey studies suggest student engagement and knowledge is limited. Previous studies have tended to focus on undergraduates and examine basic attitudes to triple bottom line issues. This study examined knowledge and attitudes of postgraduate U.K. students enrolled in one-year taught sustainability degrees on the multi-dimensional issues of sustainable development. This study piloted a 39-question 7-point Likert scale survey with a cohort of U.K.-taught postgraduate (MSc, MPhil) students (n = 121, Cronbach’s Alpha 0.796, n = 39 questions). The study found this cohort able to recognize and respond to the multiple challenges of strong and weak sustainable development issues rather than exhibiting knowledge gaps previously reported. Results and qualitative comments from the survey suggest, however, that students resist the idea of strong interventions in social, political, and economic life.


Introduction
The UN Decade of Education for Sustainable Development (2004Development ( -2015) ) aimed to promote greater impact of principles and practices in education globally.In higher education specifically, results indicate mixed outcomes in terms of the depth of engagement of universities, students, and faculty (Wals 2012, p. 86).Ashford (2004) has suggested that important concepts and values of Education for Sustainable Development (ESD), including ideological challenges to mainstream approaches, can be swallowed up by the restrictions of institutional curriculum constraints, which are "arguably undergoing a process of neo-liberalisation" (Sylvestre et al. 2013(Sylvestre et al. , p. 1358)).
Thus, the acceptability of value-laden commitments to sustainability is a fraught issue in university contexts of academic neutrality, neoliberalisation and industry relationships (Mulder 2010).These pressures have contributed to the mainstreaming of conventional ecological modernisation arguments in ESD (e.g., Coffey and Marston 2013), Amador et al. (Amador et al. 2015) conclude that the slow institutionalization of ESD is due to the resistance of universities to addressing the ideological and political challenges that strong sustainable development commitments suggest.This and other obstacles suggest that we are still some distance from developing transformative ESD courses that challenge the mainstream (for example see Sipos et al. 2008).
Postgraduate taught courses integrating education in the challenges of sustainable development offer a distinct environment to enrol committed and engaged student cohorts to explore ecocentric and anthropocentric issues.In addition to any specific disciplinary focus, e.g., engineering, management, Soc.Sci.2019, 8, 75 2 of 12 natural sciences, such courses often integrate units addressing the broader social, environmental, and economic questions of sustainable development.Such a foundational unit into which students were enrolled was a selection criterion for the institutions and programmes selected in this study.Compared to undergraduates, this is a cohort with (albeit varying) knowledge of and attitudes to sustainability.Students bring beliefs and attitudes to such courses, which are subsequently enhanced and challenged (Grierson and Hyland 2011;Naeem and Peach 2011;Stubbs and Cocklin 2008).

Student Attitudes to Sustainability and Development
Previous studies have focused primarily on undergraduate university cohorts.Most identify weaknesses in student understanding of social versus environmental and economic issues.They also identify weak commitments of students and limited development in understanding across year levels.Poor connections with campus greening initiatives was also a weakness.Few studies have surveyed postgraduates and none have explicitly asked students to evaluate their principled commitments to strong and weak sustainable development ideas.
In the first global survey study (45 questions) of engineering students (n = 3134) across multiple institutions, Azapagic et al. (Azapagic et al. 2005) found that knowledge and recognition of environmental principles was at a level of "heard about but could not explain".The authors noted poor knowledge of environmental legislation, policy, and standards, and no difference in knowledge between year levels.They also found that "significant knowledge gaps exist with respect to the other two (social and economic) components of sustainable development" (Azapagic et al. 2005, p. 16).Kagawa (2007) surveyed Plymouth University students (n = 1889) finding limited in depth knowledge and strong association of the idea with environmental rather than economic or social concepts.The study also found a "light green" approach among students to sustainable changes, e.g., beliefs in recycling.Tuncer (2008) found all students, irrespective of whether they were in a sustainability-oriented course or not, were interested in committing to sustainable lifestyles, although no specifics were given on how they would do this.They also note that campus initiatives, e.g., recycling, have had limited uptake.Barth and Timm (2011) found a 'sophisticated' understanding among undergraduate students at Leuphana University where education is strongly learner-centred and experiential.In their Malaysia-based study (n = 379) Nejati and Nejati (2013) found that students associate a sustainable university with activities that are rarely practiced on campus.In an annual repeated study across first-and second-year U.K. students (n = 3845) a UK Higher Education Academy (HEA) report (Drayson et al. 2014) identified interest in students in learning about sustainable development, limited desire to participate directly in environmental actions or initiatives and some preparedness to sacrifice earning potential to work for an ethical company.These studies while useful focus on undergraduate student cohorts.
Few studies have focused specifically on postgraduate taught students.The small case-control study by Brody and Ryu (Brody and Ryu 2006) from the United States did find that following a postgraduate course in sustainable development that students reported reducing their ecological footprint significantly.Corney's study (Corney 2006) of postgraduate teacher education students (n = 19) indicated inter alia serious doubts about introducing more radical strong notions of sustainable development into school contexts.Zeegers and Clark (2014) employed student reflective journals (n = 34) from Master's students in Australia, finding that despite being exposed to the multi-dimensional challenges of sustainable development, most students remain with an envirocentric view.They also note that the complexity of the subject matter including with regard to the political, economic and ideological issues, makes it a challenge to teach.In sum, these studies suggest a general "dissonance" in student attitudes to sustainability and sustainable development with limited acknowledgement of the multidimensional nature of the processes; general student knowledge and attitudes seem favourable but uninformed about the specifics of sustainable development.
This study aimed to further evaluate this weak knowledge claim against a more detailed articulation of sustainable development issues by asking a multi-institutional U.K. postgraduate cohort of students undertaking sustainability studies to evaluate their position with regard to multiple key aspects of sustainable development.These aspects included: historical responsibilities, principles of equity; beliefs about market-oriented versus other growth discourses; technological optimism; local versus global economics; and other questions (see Table 1

ladder of sustainable development below).
No studies to date have based surveys on an articulated view of the multidimensional nature of strong, weak and mainstream approaches to sustainable development.

Strong and Weak Sustainable Development Paradigms
Mainstream sustainable development as typified by the Bruntland Report Our Common Future mixes strong, weak and populist discourses to strike a compromise (Adams 2009).Weaker approaches tend to adhere to versions of market environmentalism and "green wash", which see the invisible hand of market transactions as the way to secure progress (see Eckersley 1993).Thus, strong sustainability focuses on critical natural capital and (non)substitutability, where this "is responsible for important environmental functions and which cannot be substituted in the provision of these functions by manufactured capital" (Ekins et al. 2003, p. 169).Despite criticism of the ambiguities in the terms "sustainability" and "sustainable development" (e.g., Lele 1991), beyond environmental thresholds (mentioned), envisioning alternative futures issues in the latter brings many more factors into play, e.g., approaches to technology, politics and government, etc.These are captured in more recent articulations of sustainable development

Ladder of Sustainable Development
The political, economic, ethical and other concepts have been plotted as a continuum or "ladder" of sustainable development as developed by Baker (2013), across an anthropocentric and eco-centric continuum (see table ).These are distinguished by their appeal to different normative principles, attitudes to nature, spatial focus (e.g., local vs.global), type of development (e.g., attitudes to consumption), approaches to governance, belief in technology, policy integration and tools, and civil society state relationships, i.e., far more than attitudes to critical natural capital.Survey instruments that build on the multi-dimensional consequences of strong (eco-centric) and weak (anthropocentric) positions are being explored by researchers (Kopnina 2014).This study employed Baker's (2013) ladder to systematically reflect these multiple dimensions and evaluate postgraduate student knowledge and attitudes to these.
Baker divides the continuum into four broad 'models' from a deep green ideal model to a pollution control market environmentalism.Initial development of the questionnaire included at least one survey question per cell plus three, which provided alternative perspectives on the topics.Subgroups of questions (Table 1 below) addressed eight areas of relevance.The content of specific survey questions asked individuals to choose a position across the continuum relative to specific topics, e.g., globalization, and thus content coverage was duplicated in areas that affected the Cronbach's Alpha for reliability and factor analysis.Future survey development would offer a reduced number of questions.

Material and Methods
This study focused specifically on postgraduate (MSc/MPhil) students in Environment and Sustainability taught programs where a sustainable development unit was taught explicitly along with other disciplinary foci.

Survey Design and Development
The ladder of sustainable development was used to develop a draft set of questions, which aimed to reflect all aspects of the framework (content validity) and based on pilot and participant responses appeared to have face validity (see Appendix A below).The questions were modified following feedback from two anonymous reviewers and the survey then submitted in pilot form to students at Swinburne University for further evaluation and comment.This feedback provided further inputs, which were incorporated into the final version of the survey.The questions address several dimensions of sustainable development and were polarized to provoke positioning on a seven point Likert scale.Some questions overlap in content focus and this is indicated below for composite scoring and statistics.According to the ladder description above, most but not all survey questions were either strongly polarized towards eco-centric or anthropocentric positions.In conducting reliability analysis, creating composite scores, and Exploratory Factor Analysis (EFA), some questions were transformed.

Institutions and Programs
Ten institutions responded to the invitation to participate (see Table 2 below), which included an onsite visit to a lecture where students and lecturers were present.Many respondents did not indicate which program or institution they came from.Students recruited to the survey were undertaking a unit (either compulsory or elective) addressing the human and material aspects of sustainable development.

Results and Analysis
Through recruitment at 10 U.K. institutions (Table 3) the study obtained a sample (n = 121) to conduct an exploratory translation of the multiple dimensions of the ladder.With an integrated consent form, the survey was advertised on various channels including face to face on campus.This recruitment strategy elicited a varied response rate, which suffered a loss in sections of the survey.

Missing Values, Factor and Reliability Analysis
Following Little's Missing Completely at Random (MCAR) test to test for random missing values the study used Expected Maximization (EM) to replace these.Without reverse transformation of variable outcomes reliability analysis achieved an Alpha score of 0.796 (n = 39).Subsequent removal of nine questions, which overlapped questions in content and focused on government and politics (Q21, 22, 25, 31, 32, 34, 36, 37, 39) significantly raised Cronbach's Alpha to 0.819 (n = 30).The reason for this requires future investigation.Exploratory Factor Analysis (EFA) was conducted on this subset of survey variables (n = 30), which produced the best Cronbach's Alpha reliability (Figure 1 Scree Plot below).This produced nine factors explaining 65% of variance, with the first two factors dividing between strong and weak positions, and collecting questions oriented to these two positions.
conduct an exploratory translation of the multiple dimensions of the ladder.With an integrated consent form, the survey was advertised on various channels including face to face on campus.This recruitment strategy elicited a varied response rate, which suffered a loss in sections of the survey.

Missing Values, Factor and Reliability Analysis
Following Little's Missing Completely at Random (MCAR) test to test for random missing values the study used Expected Maximization (EM) to replace these.Without reverse transformation of variable outcomes reliability analysis achieved an Alpha score of 0.796 (n = 39).Subsequent removal of nine questions, which overlapped questions in content and focused on government and politics (Q21, 22, 25, 31, 32, 34, 36, 37, 39) significantly raised Cronbach's Alpha to 0.819 (n = 30).The reason for this requires future investigation.Exploratory Factor Analysis (EFA) was conducted on this subset of survey variables (n = 30), which produced the best Cronbach's Alpha reliability (Figure 1 Scree Plot below).This produced nine factors explaining 65% of variance, with the first two factors dividing between strong and weak positions, and collecting questions oriented to these two positions.
Thus, the factor analysis seemed to corroborate the claim that sustainable development was multi-dimensional in the sense described above.

Consensus and Dissensus on Specific Issues
To illustrate the measure of variation and consensus on specific issues, range, mean and standard deviation of individual items (n = 39) was calculated (as shown in Table 3 below).There was a high degree of consensus (interpreted as means near or over 6) about principles, general strategies, e.g., legislation, and practices.In addition, the need to legislate, regulate, and employ relevant tools, Thus, the factor analysis seemed to corroborate the claim that sustainable development was multi-dimensional in the sense described above.

Consensus and Dissensus on Specific Issues
To illustrate the measure of variation and consensus on specific issues, range, mean and standard deviation of individual items (n = 39) was calculated (as shown in Table 3 below).There was a high degree of consensus (interpreted as means near or over 6) about principles, general strategies, e.g., legislation, and practices.In addition, the need to legislate, regulate, and employ relevant tools, e.g., Environmental Impact Assessment (EIA), was also relatively undisputed.Concepts which suggested a starker dichotomy, e.g., practical versus principles, importance of market-led growth and locally appropriate farming, generated more disagreement and varied responses as indicated by range, mean, and standard deviation.They are marked in the Table 3 below with an asterisk (*).Means between 3 and 4 typically with high standard deviation (SD) tended to show rejection of the proposition (whether positive or negative polarised) and generated discussion about nuances.

Qualitative Comments
A qualitative component was added to the survey offering participants the opportunity to comment on their choices.Only one-third to one-quarter of respondents added qualitative caveats and a fuller analysis in future of these will be conducted.As noted above suggestions about radical political, e.g., bottom-up governance, economic, e.g., privileging local farming and economies, or environmental change interventions in the survey provoked disagreement.Contentious issues pitting different strong and weak concepts, e.g., market-led growth, practice versus principle, citizens and representation, global competitiveness, converting environment for development (capital substitution), encouraging GM farming, and voluntary industry control, etc., produced disagreement.There was scepticism about voluntary commitments in general, including global agreements (non-enforceable).
In what follows, I briefly illustrate some of the comments attached to specific questions to illustrate how such comments elaborated on, challenged or exemplified issues raised in questions.The recent government's decision to relax planning laws is uniformed and a fundamental mistake.Brownfield development needs to be moved up the government's agenda (again).

Discussion and Conclusions
Sustainable development is a multi-dimensional concept with broad ideological, ethical, political and economic consequences (Adams 2009).Explicitly addressing this complexity should form part of sustainable development in higher education (HESD) pedagogy.Frameworks such as Baker's (2013) make this explicit and this framework was employed to motivate questions in the study.This study could be compared to other recent examples of such tests (Zeegers and Clark 2014).This study trialled a survey with a cohort of U.K. postgraduate taught students (n = 121), including a significant international student enrolment, to demonstrate the feasibility of such evaluation and initial results from its deployment, including EFA evaluation of multi-dimensionality.While the survey had limitations in development and deployment it indicated the feasibility of such evaluation and trends from this cohort.Results also suggest that fewer questions could provide adequate content coverage and improve response rates and completion.
Prior survey studies of students have indicated limited knowledge of the broad multi-dimensional challenges of sustainable development (e.g., Drayson et al. 2014).This study addressing a postgraduate cohort found students willing and able to take a position on a wide range of dimensions.Student respondents from a wide range of countries and backgrounds took an overall pragmatic attitude to moral versus practical issues and showed a general resistance to strong interventions.There was broad consensus on the importance of principles, while anthropocentric development demands often won out over the environment.
In sum there seemed to be limited support for strong positions on sustainable development.Given the small cohort (n = 121) and the limited discipline and institution representation (n = 10) it is not possible to generalize to the broader sector.However, based on the existing results and analysis there are indications that students respond positively to ecological and mainstream arguments about government intervention, civil participation, equity, and so forth while questioning either market environmentalism, strong state interventions, and deep green ideologies.A repeat survey in other countries with a shortened version of test questions (n = 30) would be potentially enlightening.Correlation of the survey with curriculum content and lecturer views would also be an interesting development.

Table 3 .
Survey questions range, average, and standard deviation.
Q4: Practical development issues, e.g., job creation, should take precedence over principles and practices, e.g., gender equality or affirmative action, especially for poor economies or sectors of society.Practical issues should be addressed with principles of fairness and justice in mind to avoid perpetuating an unequal world.There is no conflict.With greater gender equality and affirmative action it allows increased participation and innovation within economies that will create jobs [...] there is an untapped reserve.I could imagine situations where it is reasonable, but generally it is a very bad idea, because it does not promote sustainability.Education is probably the single most important stimulus for development across all sectors, and is a fundamental root of both economic growth and (arguably) gender equality.However, segregated attitudes to education will inhibit economic growth, so... Q10: The key to sustainable development globally is market-led growth, e.g., supply meeting demand in a free market.Market-led gives rise to too many negative externalities and fails to address inequalities.It needs to be restrained by redistributive policies.The key to sustainable development is to reach social agreements made on the basis of rationality (science-based evidence), but been aware that our decisions are taken only on the base of what we know, and there are many uncertainties.Therefore, flexibility to changing policy and management paths is [ . . .] In part bridging the technology gap for low carbon and other renewables, and the growth can only be sustainable when growth is decoupled from carbon pathways or carbon intensity growth paradigms.Q15: The conversion of the environment, e.g., land or forests converted to farming or housing, is an acceptable trade-off or substitution for development.It can be, but it depends on how much land/forest is substituted, where (what kind of land/forest is lost), what is the quality/purpose of the development and who is it for.This needs to be regulated and strictly controlled.