Document Actions

Section II. Aware Respondents

by CAEE last modified 12-26-2007 17:08

Section II.  Aware Respondents

 

One survey question forced a distinction between respondents who were aware of CAEE and those who were not.  For those who were already aware of the work of CAEE, a series of questions probed their perceptions about the organization, about benefits of CAEE membership, and about CAEE services and programs.  The tables in this section (and in Appendix B) summarize these data.

 

The “aware” respondents were asked to describe, in their own words, the Colorado Alliance for Environmental Education.  Again, to retain the integrity and context of respondent comments, Appendix B presents 261 verbatim responses to this question. 

 

The next question probed CAEE-aware respondents, whether or not they were CAEE members, to describe the value(s) and/or benefit(s) of a CAEE membership.  Open-ended responses were content analyzed and are summarized below. 

 

Table W1.  Perceived Value/Benefit of CAEE Membership (n=274)

Benefit/Value

Number of Mentions*

Networking – contact with other professionals, connectivity of people and groups, networking for potential partners; connection to the industry; building community, making connections with other organizations and agencies, share concerns, collaboration, power thru partnerships, great way to stay abreast of new developments; chance to stay connected.

 

103

General Information Sharing – information about professional development, jobs, events, grants, resources, opportunities to share information; awareness of programs; clearinghouse service; streamlining EE for Colo, emails are great; great way to publicize available materials, information about field trips, helps get our message out, communication; jobs/job postings; place to get answers; updates on EE programs.

 

83

Training – classes, workshops, professional development, conferences, no cost/low cost professional development, informative annual conference, OTB Conference; informative presentations; continuing education classes; conferences; regional workshops.

 

70

Advocacy/Information Sharing about EE - about environmental issues, environmental education; EE advocacy; promoting the cause; keeping us up to date on current issues; political work about issues, helps clarify importance and values behind environmental protection, leading force for EE in the state, increased awareness of issues, increased clout, lobbying for EE; trends; collective voice; communication with other education groups in state; one voice.

 

34

Peers/People/Passion – peer support, recognition by peers, people working cooperatively with like minded people, people with life concerns and passion, opportunities for me and my fellow teachers to grapple with sustainability, learning from others, sharing with like minded people; moral support, having someone to call on to answer questions; like-minded individuals; support from others; new friendships; great place to meet people; source of inspiration.

 

31

Specific Information Sources/Services - great website, super newsletter, database, online directory, access to directory; list serve is invaluable, email, job line; awards program.

 

24

Don’t Know/Not Sure – which is why I’m not a member; can get info from list serve without being a member; don’t know; not sure about what members get that non-members don’t get; CAEE isn’t something I find valuable at this time – I attended one professional development seminar (on marketing) and did not fid it at all useful; unknown to state agency; not sure but glad it exists.

 

22

Training Costs - Reduced rates for workshops, discounts at events, free training; no cost/low costs professional development.

 

18

Curriculum - Relevant reference for standardizing curriculum; how to improve skills in class/field, resource for curriculum ideas, how to integrate EE into my class; free curriculum res. Review training; information for classroom teachers; great resources for classroom, helps me focus on what I can teach my students; teacher resources.

13

No Benefits/Hard Benefits – hard to get benefits in high country; hard on west slope; hard in winter; science is only one topic I teach; retired; few benefits right now; no value at this point in my career; not relevant anymore; value hi, benefit low – in southwest Colorado

 

9

Quality of Life – CAEE helps the environment and thus my frame of mind, CAEE enhances the opportunities that my life’s work can be effective; part of movement that helps present and future generations interact positively with our earth; part of larger whole

 

7

Staff – great job, supportive staff; professional, outstanding people in administration of the organization.

 

5

Everything- irreplaceable, priceless, valuable resource

 

4

Accountability - settings standards for the profession, accountability through Resource Review

 

2

* Total mentions do not equal total respondents as most respondents provided more than one remark.

 

Discussion Points:

·        Many aware respondents perceive the highest value of CAEE membership to be in networking, general information sharing, and training.  Respondents perceive additional but somewhat lesser value in advocacy and peer connection and support.  It bears mentioning however, that although there were only 31 specific mentions of peers and/or people, one can assume that peer connection and support is intrinsic in mentions of networking, general information sharing, and training.

·        Several respondents (n=22) mentioned that they don’t know about the benefits or values of CAEE membership.  An additional 9 mentions were made to suggest that benefits are difficult to realize in some areas of the state beyond the Front Range. 

 

Following the perceived value/benefit question, a set of questions asked respondents about their awareness and use of specific CAEE programs and services, the following few tables present the findings from these questions.  Table W2 below reports responses to the question, “In your own words, describe what you know about each of the following CAEE products or services” which was subsequently content analyzed.

 

Table W2.  Awareness and Knowledge about Select CAEE Services.

Service

Don’t know

Aware

Have heard of it

Can define

Very Familiar

Other*

Guidelines

(n=265)

44% (n=117)

13% (n=35)

28% (n=75)

15% (n=38)

Resource Review (n=257)

61% (n=156)

9% (n=24)

20% (n=51)

10% (n=26)

Online Directory (n=259)

44% (n=113)

8% (n=20)

34% (n=89)

14% (n=37)

Master Plan

(n=257)

62% (n=159)

10% (n=25)

20% (n=51)

8% (n=22)

Teacher Liaison Network  (n=261)

66% (n=172)

5% (n=14)

19% (n=50)

10% (n=25)

EE Listserve (n=261)

48% (n=124)

5% (n=15)

33% (n=85)

14% (n=37)

* “Other” comments were those that did not fall into any of the three categories.  They included judgments about the usefulness or excellence of the service and comments about participation or use of the program. 

 

Discussion Points:

·        The question asking respondents to describe, in their own words, each of several CAEE services, solicited over 250 responses for each program/service.  Nearly two-thirds of these respondents did not know about the Resource Review, the Master Plan, and the Teacher Liaison Network.  Just under half did not know about the Guidelines, the Online Directory, and the EE Listserve.

·        By contrast, about one-third of the respondents could provide an accurate description of both the Online Directory and the EE Listserve.  Approximately one in five could provide an accurate description of each of the other services.

 

Table W3 below summarizes the finding from the question, “Indicate your level of (awareness and[1]) use for the following CAEE services, programs, and events.”

 

Table W3.  Use of CAEE Programs/Services

Program

(n=respondents who answered this question)

# who indicated they have used  this program

% who have used this program

Teaching Outside the Box Conference  (n=257)

128

50%

Professional Development Series (n=209)

92

44%

Online EE Teacher’s Institute  (n=113)

19

17%

CAEE Auction  (n=191)

68

36%

Awards and Recognition (n=225)

90

40%

Guidelines for Env. Educators in CO  (n=181)

63

35%

Resource Review System (n=137)

42

31%

Online EE Directory (n=178)

75

42%

Teacher Liaison Network (n=121)

45

37%

Regional Networks (n=121)

51

42%

CAEE Website (n=241)

141

59%

Volunteer Opportunities  (n=179)

65

36%

Diversity Roundtables  (n=144)

31

22%

CAEE Newsletter  (n=226)

141

62%

EE List Serve  (n=162)

80

49%

Colorado EE Master Plan (n=143)

40

28%

Funder Symposium (n=91)

25

27%

 

 

Discussion Points:

·       Highest percentage of program use (50% or higher) includes Teaching Outside the Box, the CAEE Website, and the CAEE Newsletter. 

·       Lowest percentage of program use (25% and lower) includes the Online EE Teacher Institute and the Diversity Roundtables.

 

A separate series of questions then solicited respondent remarks about level of usefulness and asked for explanations about “why or why not” for each of nine key CAEE programs/services.  Tables W4 and W5 below summarizes these data.

 

Table W4.  Usefulness of Select CAEE Programs and Services

Program

(n = total responses to this question)

Not

Useful

Useful

Extremely Useful

Useful Total %

Professional Development Series (n=231)

29% (68)

53% (122)

18% (41)

71%

Guidelines for Env. Educators in CO  (n=222)

27% (60)

61% (135)

12% (27)

73%

Resource Review System (n=192)

52% (100)

42% (80)

6% (12)

48%

Online EE Directory (n=218)

25% (55)

64% (140)

11% (23)

75%

Teacher Liaison Network (n=190)

55% (105)

32% (60)

13% (25)

45%

Regional Networks (n=182)

41% (75)

45% (82)

14% (25)

59%

CAEE Website (n=335)

9% (22)

72% (169)

19% (44)

91%

CAEE Newsletter  (n=233)

6% (14)

67% (157)

27% (62)

94%

EE List Serve  (n=208)

33% (68)

47% (98)

20% (42)

67%

 

Discussion Points:

·       These data suggest the most useful services to these respondents are the CAEE Newsletter (94% total useful percent) and the CAEE Website (91% total useful percent). 

·       The least useful programs appear to be the Teacher Liaison Network (55% not useful) and the Resource Review System (52% not useful).  Caution should be used here however since these programs are targeted as specific audiences (i.e., K-12 teachers).  The effectiveness percentages summarized here may be more a reflection of a limited audience than an overall utility of those specific programs.

 

 

Table W5.  Respondent Comments about Select CAEE Programs

Program

 

Useful Comments

Other Comments

Comment

mentions

Comment

mentions

Professional Development Series (n=135)

 

 

Helpful information (general)

31

Not relevant

14

Networking

9

Not convenient (location)

14

Professional Development

10

Not convenient (schedule)

13

Jobs

0

Have no time/I’m too busy

7

Events, Programs, Materials, Resources

0

Don’t know about it

5

Easy, Accessible

2

Haven’t use it

9

Depends on topic/presenter

10

Poor Quality – presenter not knowledgeable; topics redundant

2

Free; affordable

6

Other

14

Other

7

TOTAL ‘Useful’ comments

82

TOTAL ‘Other’ comments

71

Guidelines

(n=112)

 

 

Helpful information (general)

30

Not relevant

15

Networking

0

Not convenient (location)

0

Professional Development

1

Not convenient (schedule)

1

Jobs

2

Have no time/I’m too busy

2

Events, Programs, Materials, Resources

3

Don’t know about it

10

Grants

2

Haven’t use it

15

Other

17

Poor Quality – not useful, reviews not always accurate

2

We have our own system

6

Other

8

TOTAL ‘Useful’ comments

55

TOTAL ‘Other’ comments

49

 

 

 

Program

 

Useful Comments

Other Comments

Comment

mentions

Comment

mentions

Resource Review System (n=101)

 

 

Helpful information (general)

8

Not relevant

14

Networking

0

Not convenient (location)

0

Professional Development

1

Not convenient (schedule)

0

Jobs

0

Have no time/I’m too busy

0

Events, Programs, Materials, Resources

0

Don’t know about it

22

Program Quality – helps with program quality and grants

3

Haven’t use it

30

Poor Quality; not always accurate

2

Other

7

Other

10

TOTAL ‘Useful’ comments

16

TOTAL ‘Other’ comments

78

EE Online Directory (n=97)

 

 

Helpful information (general)

22

Not relevant

8

Networking

10

Not convenient (location)

2

Professional Development

0

Not convenient (schedule)

0

Jobs

0

Have no time/I’m too busy

1

Events, Programs, Materials, Resources

6

Don’t know about it

9

Easy; accessible

1

Haven’t use it

25

Other

6

Poor Quality - cumbersome

3

Other

6

TOTAL ‘Useful’ comments

45

TOTAL ‘Other’ comments

54

Teacher Liaison Network (n=100)

 

 

Helpful information (general)

4

Not relevant

27

Networking

12

Have no time/I’m too busy

2

Professional Development

0

Don’t know about it

24

Jobs

0

Haven’t use it

20

Events, Programs, Materials, Resources

2

We have our own network; useful to CAEE but not to me

7

Other

2

Other

5

TOTAL ‘Useful’ comments

20

TOTAL ‘Other’ comments

85

Regional Networks (n=82)

 

 

Helpful information (general)

9

Not relevant

7

Networking

18

Not convenient (location)

4

Professional Development

0

Not convenient (schedule)

0

Jobs

0

Have no time/I’m too busy

0

Events, Programs, Materials, Resources

1

Don’t know about it

22

Other

4

Haven’t use it

15

Other

5

TOTAL ‘Useful’ comments

32

TOTAL ‘Other’ comments

53

CAEE Newsletter (n=101)

 

 

Helpful information (general)

76

Not relevant

5

Networking

4

Not convenient (location)

0

Professional Development

12

Not convenient (schedule)

0

Jobs

4

Have no time/I’m too busy

4

Events, Programs, Materials, Resources

12

Don’t know about it

2

Grants

4

Haven’t use it

3

Other

1

Other

1

TOTAL ‘Useful’ comments

113

TOTAL ‘Other’ comments

15

 

 

 

 

 

 

Program

 

Useful Comments

Other Comments

Comment

mentions

Comment

mentions

EE ListServe (n=99)

 

 

Helpful information (general)

30

Not relevant

8

Networking

3

Have no time/I’m too busy

2

Professional Development

1

Don’t know about it

11

Jobs

3

Haven’t use it

30

Events, Programs, Materials, Resources

3

Too much to read; don’t like listserves

9

Other

5

Other

2

TOTAL ‘Useful’ comments

45

TOTAL ‘Other’ comments

62

CAEE Website (n=97)

 

 

Helpful information (general)

42

Not relevant

5

Networking

4

Not convenient (location)

0

Professional Development

2

Not convenient (schedule)

0

Jobs

1

Have no time/I’m too busy

3

Events, Programs, Materials, Resources

12

Don’t know about it

3

Quality – well done

5

Haven’t use it

16

Other

9

Other

0

TOTAL ‘Useful’ comments

75

TOTAL ‘Other’ comments

27

Total number of mentions for each program or service may not equal total number of content analyzed responses (n) for that section as some responses contained more than one idea.

 

Discussion Points:

·         Approximately 100 respondents offered comments for each of several CAEE programs and services.  These comments are helpful in distinguishing how specific programs meet the needs of these individuals.  The programs that are most helpful in terms of information provided, include the Professional Development Series (31 mentions), the EE Online Director (22 mentions), the CAEE Newsletter (76 mentions), the EE ListServe (30 mentions), and the CAEE Website (42 mentions).   

·         Perhaps the most telling finding here is the number of people who either don’t know about the program or simply haven’t used it – the don’t know comments were particularly high for the Resource Review System (22), the Teacher Liaison Network (24), and the Regional Networks (22).

·         In several cases, these programs were not relevant to certain respondents (e.g., the Teacher Liaison Network).  It is assumed that the higher non-relevancy numbers indicate programs that are more targeted to specific audiences. 

·         Convenience of location and/or schedule did not seem to be a problem except for the Professional Development Series which may be an indication of non-Front Range respondents.

·         Very few comments indicated poor program quality.  In only a very few instances did respondents comment about the questionable accuracy or the cumbersome nature of a program. 

 

Finally a cross-tab analysis was conducted of respondents who indicated their awareness and use of select programs and service against the usefulness of these programs and services.  Table W6 on the next page summarizes these data.

 

 

 

 

Table W6.  Use of Select CAEE Programs/Services by Aware, Use, and Usefulness

 

Not Useful

(n)

Useful

(n)

Extremely Useful

(n)

Professional Development Series

Aware

39

76

16

Used

8

55

25

Guidelines for EE in Colorado

Aware

35

76

12

Used

4

39

15

Resource Review System

Aware

41

42

5

Used

8

23

6

Online EE Directory

Aware

21

87

12

Used

11

46

10

Teacher Liaison Network

Aware

35

26

10

Used

6

21

13

Regional Networks

Aware

18

37

9

Used

8

21

17

CAEE Newsletter

Aware

9

94

22

Used

0

78

46

EE Listserve

Aware

23

48

18

Used

6

43

27

CAEE Website

Aware

10

95

22

Used

1

99

31

 

Discussion Points

·         Findings in this table indicate that most respondents who have actually used these programs find them either useful or extremely useful.  This might suggest that respondents who indicted they were aware of the program and also indicated it was not useful had in fact, never used the program; or said another way, if they had not used the program; it was therefore not useful to them. 

·         For the respondents who actually used these programs, the CAEE website and the CAEE newsletter seem to be the most useful (combined useful/extremely useful responses of 130 and 124 respectively).  The Professional Development Series and the EE List serve were also useful to many (combined useful/extremely useful responses of 80 and 70 respectively).  The lowest combined useful responses were for the Resource Review System (n=29).  The highest number of not useful response for those who actually used a program were for the EE Online Directory (n=11).

 

A follow-up question at this point asked, “what other services, programs, or events would you like to see CAEE provide”.  Responses to this question are provided in Appendix C. 

 

When asked to indicate the level of importance and performance (on a 5-point scale) for several major CAEE focus areas, respondents indicated the following (Table W7).

 

Table W7.  Importance and Performance for Major CAEE Focus Areas.

CAEE Program, Service, Event

Importance

(mean score)

Performance

(mean score)

Networking – providing opportunities for people to meet each other

3.6

3.3

Coordination  - bringing people together to form partnerships and collaboration; building capacity in communities for EE

3.6

3.1

Professional Development – training to improve knowledge and skills of environmental educators

3.7

3.2

Advocacy – building support for and capacity in EE.

3.7

3.0

Quality Assurance – proving and improving the quality of EE.

3.6

3.1

Importance was measured on a 4-point scale where:  1= not important at all; 2 = not very important, 3 = somewhat important, and 4 = very important.

Performance was measured on a 4-point scale where: 1= Poor, 2 = Fair, 3 = Good, 4 = Excellent

 

Discussion Points:

·         Respondents indicated that most all the focus areas were fairly important (means = 3.6 – 3.7). 

·         Respondents indicated that performance in all areas was at least fair.  Networking and professional development were rated slightly higher at a mean score of 3.2 or greater. 

 

A series of questions were asked about desired professional development and communication.  Specifically, respondents were asked two professional development questions:  (a) “To what other professional organizations (besides CAEE) do you belong?”, and (b) “Where do you seek professional development opportunities?”  Table W8 below summarizes the responses to these two questions.


 

Table W8.  Professional Development Organization and Opportunities

Membership in other professional organizations

(n=216)

Desired professional development 

opportunities

(n=248)

Organization

# of mentions

Opportunity

Number of mentions

National Association for Interpretation

56

NGO workshops or training sessions

209

National Science Teachers Association

49

Local or regional conferences

193

Colorado Association of Science Teachers

45

National conferences

146

North American Association for EE

34

Continuing education

135

Chamber of Commerce

 

19

University classes

106

Other (135 people mentioned a total of 162 additional organizations - see table in Appendix D)

 

 

n=139

Certification programs

 

95

Online or distance learning opportunities

91

Public or for-profit seminars

 

57

Other* *

 

41

* Responses do not equal total respondents (n) because respondents could select more than one response.

 

** Other responses included:  reading/self-study/ publications (n=11); other orgs. (n=9); my own org. (n=8); higher ed/college progs. (n=4); radio, conferences, TV/video (n=4); speakers, other professionals (n=3); not a priority; not envir. educator (n=2)

 

Discussion Points:

·        Although several respondents were members of the National Association for Interpretation (56), the National Science Teacher’s Association (49), and Colorado Association of Science Teachers (45) most respondents represented membership in a variety of other organizations (Appendix D).

·        The most frequent responses for desired professional development (>130) were for  workshops, in local, regional and national conferences, and continuing education opportunities.

 

In response to a request about preferred communication, “Check your top 2-3 preferences for ach of the following CAEE communication services”, respondents indicated the following.

 


Table W9.  Preferences for Communication Services

CAEE Service (n=total # of responses/category)

Mode of Communication

Phone

# of mentions

Letter/Mail

# of mentions

Email

# of mentions

Face to Face

# of mentions

Website

# of mentions

Membership Renewal  (n=236)

15

69

217

10

37

Conference Info & Regis. (n=238)

3

77

219

8

79

Board Nominations & Elections (n=218)

8

50

169

21

75

Board / Advisory Council Minutes & Announcements (n=222)

4

23

159

15

103

New Programs and Initiatives (n=237)

6

58

219

19

88

Regional Programs & Initiatives (n=225)

3

52

200

22

82

Newsletters (n=238)

1

67

208

2

75

Volunteer Opportunities (n=225)

14

32

194

17

93

Professional Dvlmt. Opps. (n=238)

3

59

218

25

93

Other (n=69)

 

3

10

62

4

17

Note:  Total number of mentions may not equal total responses/category as respondents could select more than one choice.

 

Discussion Points:

·        Most respondents prefer email communication for all services, although there is significant interest in website communication for most all services except membership renewal.  There remains minor interest in regular mail for some services. 

 

In order to segregate teacher respondents for answering some teacher-specific questions, respondents were asked to designate their work as primarily formal (PreK-12) or informal (or non-formal).  Table W10 below summarizes these responses.  Respondents who indicated Formal Education (i.e., school teachers) were then routed to a separate set of questions designed specifically for teachers.  The next section of this report summarizes those findings (Tables T1- T3). 

 

Table W10.  Respondent’s Work by Sector

Sector

% (n = 349)

Informal or Non-Formal EE

45% (n=156)

Formal PreK-12 or Higher Education

34% (n=120)

Both Formal and Informal

3% (n=10)

Other

18% (n=63)

 

Discussion Points:

·        Not quite half of respondents work in the informal or non-formal sector; one third works in the formal sector. 

·        Respondents who indicted “other” work in the private sector or in fields not related to environmental education including health care, government, environmental management, accounting, and retired.



[1] This question asked respondents about both awareness and use, but with only 2 slight exceptions, aware response were exactly equal to the total number of responses in each case, so those results are not reported separately here.