Meghan K. McCoy*; Elizabeth Kandel Englander*; Katalin Parti† * Bridgewater State University, Bridgewater, MA, United States
† National Institute of Criminology, Budapest, Hungary
The Massachusetts Aggression Reduction Center is an academic center located on a public university campus and staffed by faculty and students. The Center provides high-quality, evidence-based programming for students, educators, and other community members involved in K-12 education. The focus is on understanding and preventing social problems among children, with a particular emphasis on bullying, cyberbullying, and digital communications. The Center and available programming are described. Qualitative and quantitative data gathered through informal and formal research methodologies are presented and suggestions made for future evaluation efforts are discussed. cyberbullying, bullying, evidence-based, prevention, primary school (or elementary and middle school), secondary school (or high school), professional development, service learning, University model, high-status peers.
Cyberbullying; Bullying; Evidence-based; Prevention; Primary school (or elementary and middle school); Secondary school (or high school); Professional development; Service learning; University model; High-status peers
In the United States and elsewhere, there are limited educational resources for programming and curricula that focus on the social and emotional needs of children and adolescents. In the face of this challenge, it seems wise to explore interventions that make use of existing and low-cost resources. These realities prompted Dr. Elizabeth Englander, a Professor of Psychology at Bridgewater State University, to develop the Massachusetts Aggression Reduction Center (MARC) in 2004. MARC is an academic center staffed by faculty and students, including graduate and undergraduate students in several fields. MARC faculty and staff bring education, training, research, curricula, and other resources to the primary and secondary education community and other stakeholders (e.g., pediatric physicians, social workers, attorneys, etc.), while providing graduate and undergraduate students with the opportunity to engage in supervised field work.
It is the Center’s mission to provide high-quality, evidence-based programming for students, faculty, administrators, and parents in K-12 education at little to no cost. The focus is on understanding and preventing social problems among children, with a particular emphasis on bullying, cyberbullying, and the central and complicated role that digital communications play in the social lives of children and teens today (Englander, 2013).
All of MARC’s programs are based on the principles promoted by researcher Dan Olweus and his concept of the “whole-school” approach to bullying prevention (Olweus, 1993). When MARC works with a school, we train faculty, students, and administrators and provide education for parents and community members. The goal is to alter the school climate, i.e., behaviors, beliefs, and attitudes, from one that promotes bullying into a climate that discourages it—the only effective method uncovered by decades of research (Lumsden, 2002). MARC’s whole-school program is also based on the body of research showing that bullying is a systemic problem (Atlas & Pepler, 1998), so the most successful programs involve all school personnel and the entire student body as one community (Cromwell, 1999; Hazler, 1998; Pepler, Craig, & Connolly, 1997).
First, all programming and curricula are grounded in ongoing, up-to-date research conducted with students from elementary, secondary, and postsecondary schools and developed with careful attention paid to the developmental needs and realities of children and teens.
Second, MARC focuses on educating and training all stakeholders. As others have emphasized for decades, MARC understands that in order to create lasting change, prevention efforts must be focused on the community as a whole (Bradshaw, 2015; Cromwell, 1999; Hazler, 1998; Olweus, 2005; Pepler et al., 1997; Swearer, Espelage, & Napolitano, 2009; Ttofi & Farrington, 2011; Letendre, Ostrander, & Mickens, 2016).
Third, programming for adults emphasizes the importance of building emotional connections with students. Adults are encouraged to talk to children on a regular basis, to offer advice and guidance based on their own experiences, to coach and support them when they are dealing with bullying situations, and to check back in with students after reports of bullying.
Fourth, MARC trains graduate and undergraduate students to work with Kindergarten through 12th grade students. University students, who receive course credits for their work in MARC, are powerful role models to younger students in a way that many older authority figures (such as parents and teachers) cannot be. Utilizing slightly older peers to work with younger students is called the high-status peer model and was chosen for a number of reasons. In addition to the benefits for younger students (Andreou, Vlachou, & Didaskalou, 2005; Cowie & Olafsson, 2000; Salmivalli, 2001), it allows MARC to train and educate future professionals. Many of the students who are involved with the center plan to work with children and teens, and this work provides them a unique internship-like opportunity while receiving course credit or tuition assistance for their graduate programs.
The program also offers peer mentor trainings for middle and high school students. Peer mentors are recruited and selected by the school staff, to be trained on the core problem of bullying and cyberbullying, how to early recognize and handle difficult situations among peers, and how to stand up for those who in need. Peer mentors are trained at the University campus. This training model is an effective way to teach students skills and strategies to resolve situations on their own (Cowie & Hutson, 2005; Wentzel & Caldwell, 1997).
Professional development opportunities for teachers are intended to increase awareness and knowledge about bullying and cyberbullying; provide adults with effective and practical intervention strategies; and introduce adults to cutting edge research about bullying and cyberbullying.
Content can always be tailored to a school’s specific needs. For example, if a school is struggling with a recent type of problem (such as problems on social media), we address those issues in more detail.
MARC has also developed a Train the Trainer Faculty Training program that prepares professionals to train their colleagues about bullying and cyberbullying prevention. This training is designed to deliver an even more in-depth understanding of bullying and cyberbullying than traditional faculty trainings.
As part of the center’s efforts to improve school culture, presentations for parents and other community groups have been developed. The emphasis of these presentations is on practical, concrete knowledge. Tips for parents are offered to assist them in having discussions with their children, approaching schools for help, and assisting school administrators to successfully resolve bullying situations. Programs can also be tailored to respond to specific concerns the parents or schools may have.
Student programming in MARC is distinctive in that it is delivered by older students and not by professionals, who can be viewed as authority figures. College students, in contrast, are more likely to be viewed as high-status peers (Hoff, Reese-Weber, Schneider, & Stagg, 2009; Levi, Kaplan, & Peter, 2004; Sasso & Rude, 1987; Shi & Xie, 2011).
In addition, these student programs cover negative behaviors but emphasize positive behaviors (i.e., they do not simply tell children not to bully others, but cover a variety of ways students can help themselves and others, and feature stories of similar age students who are actively engaging in positive bullying prevention activities). Although active participation and empowerment of students is always emphasized, all student programs are accompanied by follow-up guides for teachers and parents. These guides review the main points and provide discussion questions for teachers to use in the classroom as a follow-up.
Student programs are offered in the following formats: large group presentations (assemblies); interactive group presentations (assemblies); small group leadership training; student contests; and K-5, 6-12 Advisory, and High School Cyber Skills Curricula. Advisory periods seen in many US schools and are short periods of time designated for lessons and activities related to academic scaffolding and social and emotional learning. Because these periods are common in many schools, but are often no more than 20 or 30 min, MARC created a curriculum specifically designed to be implemented during Advisory periods.
Large group student presentations are offered for students K-12. All presentations are developmentally appropriate, grade-specific, and discuss bullying and cyberbullying in practical ways. The focus is on helping students understand the issues, develop the skills necessary to combat bullying and cyberbullying, and how to treat their peers, even those who are not their friends, with respect and civility.
Presentations for kindergartners and first graders are about 20–25 min long and introduce students to the concept of bullying, better understood at this age as being mean to someone on purpose. The focus is also on how bullying can make people feel and exploring the difference between physical and verbal bullying. The idea of being mean online is briefly introduced. The presentation ends with a practical, concrete discussion of how to be a good friend to everyone, how to help victims of bullying, and how to get help from adults when necessary.
For older elementary aged students in grades 2–4, the presentation is about 30–35 min. This presentation builds on the ideas introduced to younger students with a more in-depth focus on cyberbullying and other digital behaviors. Students are provided with detailed information about how to tell the difference between bullying/cyberbullying and other common social problems like conflict, drama, and teasing. The different roles students play in bullying (i.e., bully, victim, bystander, and egger, a word used by MARC to describe students who may inadvertently support bullying by laughing along, spreading rumors, etc.) are identified and discussed. Tips for helping classmates and oneself are offered with a focus on the low risk strategies students can use to combat bullying.
Presentations for students in the 5th and 6th grades are about 45 min long and continue to build on concepts presented to younger students. Specifically, the presentation goes into great detail about digital aggression and cyberbullying in addition to general information about bullying and peer aggression. Students are introduced to the concept of relational aggression, peer behaviors designed to show contempt for others and create social problems and emotional distress for its victims. The negative consequences of these behaviors are discussed and emphasis is placed on understanding that these behaviors, while not considered bullying/cyberbullying, can have devastating impacts for students. The role of social media in students’ lives and the importance of protecting privacy online are discussed. Students are provided concrete ways that they can use different avenues, e.g., the arts, athletics, and peer support, to combat bullying and offered tools and tips for helping themselves and others to deal with challenging peer behaviors online and in person.
Programs for older middle school and secondary students typically run about 55 min. Building on concepts introduced in earlier grades, these presentations go into great detail about cyberbullying and other digital problems. Common pitfalls of communicating online are discussed. Students are asked to think critically about the unique characteristics of digital communications and why they can lead to problems with peers. Misinterpretations, the use of anonymous apps, and the tricks our minds play to make us think online communication is private are presented with the use of real life examples. Students are asked to think deeply about how online behaviors can impact themselves and their classmates. Students in high school are pushed to think of the long-term impacts of online behaviors on their future opportunities. Sexting, the electronic distribution of nude or seminude images, is discussed. The rules and laws regarding these behaviors are introduced. Students are pushed to think about other negative consequences of these behaviors (i.e., negative emotional responses) and the reasons students report engaging in such behaviors (i.e., pressure from romantic partners). Rules and laws regarding bullying and cyberbullying in Massachusetts are presented. The presentation concludes with concrete, positive strategies for dealing with bullies at school and online.
For students in grades 5–12, MARC offers the option to have small student groups trained by experienced graduate and undergraduate students. These trainings are designed to help students identify and label what they view as the most important social issues going on in their schools, and to work with them to develop, and eventually implement, student-led programming in their own community. These sessions start by educating the student trainees and then these students, working in small groups facilitated by MARC students, are led through a process of identifying issues of concern, and then grouping and organizing their concerns into categories (e.g., people talking about each other, rumors being spread online, and people telling others’ secrets could be reduced to “problems with rumors and gossip”). After the categories of problems are established, the groups then brainstorm about solutions and programs to address them. These solutions and programs are developed, chosen, and implemented by students, which is the source of their power. Ultimately, student groups leave with action plans that discuss what program they want to implement, the resources and possible obstacles to implementation, and the roles of the students and their faculty advisors. Some examples of programs include students creating presentations and plays to be delivered to younger peers; implementing “pay it forward” and “small acts of kindness” campaigns at their schools; and forming action-oriented student groups dedicated to combating bullying.
In an effort to encourage the recognition and promotion of positive peer behaviors, the Center also runs annual contests for primary and secondary grade students. Contests for 3rd–5th grade students ask age-appropriate questions, and students respond by making posters or writing poems. Examples of questions asked are:
● Third Grade: Has a friend ever helped you when someone else was being mean, or just when you felt badly? How did they help you?
● Fourth Grade: How do teachers help kids who are being bullied? Does it help to talk to a teacher?
● Fifth Grade: How would you teach younger kids about the best and most positive ways to use social media? What mistakes would you advise them to avoid?
Secondary grades write, direct, film, and edit Public Service Announcements on a chosen topic. All entries are judged by MARC staff and students, and winners are invited to visit campus for Award Ceremonies (for younger students) and the Youth Summit (for older students). The Youth Summit also serves to recognize and celebrate the accomplishments of students all over Massachusetts in bullying and cyberbullying prevention.
Finally, MARC has created curricula that are available to schools and educators for free upon request. Curricula are intended for use in the classroom for younger students (K-5) and in the classroom or during advisory periods for older students (6–12). All outcomes research establishing the efficacy of these curricula is posted on MARC’s website (www.marccenter.org). Generally, these curricula address issues such as the lack of knowledge about bullying and cyberbullying behaviors; secrecy and shame surrounding all types of peer abuse; inadvertent and overt peer support for these behaviors; lack of understanding about the protective role of friendships; overuse of the terms bullying and cyberbullying; and commonly accepted myths, especially about online interactions (e.g., “it’s no big deal if it’s just online”). Topics for secondary students also include tagging and facial recognition, self-focus online, strong feelings and social media, fighting online, and anonymous apps. These curricula are simply requested through the website’s request function, and then pdf versions of the curriculum are sent to the requester through secure download links. Trainings are held at the University for school staff and MARC staff are always available to answer questions or concerns that arise.
Among all the student programs and services offered by MARC, these curricula are the most often used beyond Massachusetts. They are requested by schools located in approximately half of the states in the United States and in several other countries.
MARC is committed to ensuring the highest quality programming possible and we engage in ongoing outcomes research in order to achieve this goal. Qualitative and quantitative data are collected to assess how well programming is meeting needs, resulting in increased knowledge for participants. Research conducted at the center is primarily self-assessment and is helpful in ongoing efforts to improve program delivery. Research is conducted in the form of online surveys as well as anecdotally in the field, as described earlier. In addition, The Fulbright Foundation and the Hungarian Eötvös Scholarship funded a researcher to study MARC’s programs during the 2013–14 school year. By the methods of pre- and post-tests, students and teachers’ knowledge and improvement was assessed, testing the effectiveness of the student Assemblies and the Train the Trainer programs. Additional one-on-one semistructured qualitative interviews were conducted with teachers and school counselors who participated in In-service Faculty Trainings. This section will present both the qualitative and quantitative results from that year-long study as well as other data that has been collected.
Eighty-four educators attended two separate “Train the Trainer” workshops in November and December 2013. The gender ratio of the participants at the training was 24%–76%, with female participants in the majority. Most participants were between 31 and 40 years old (n = 34; 42%); followed by the age group 41–50 years (n = 17; 21%), and then that of 51–65 years (n = 15; 18.5%).
Participants completed a questionnaire before and after the training (a within-subjects’ pre- and post-test design), which enabled a comparison of expectations for the training to the achievement of those expectations. The posttest included semistructured questions that allowed for the gathering of qualitative data about participants’ experiences.
Table 8.1 shows the results of the comparison between expectations and outcomes. Overall, the training modestly exceeded expectations, with subjects reporting they had gained knowledge beyond their initial expectations. The largest positive differences were for subjects who wanted to learn more about cyberbullying, to learn to differentiate between bullying and other behaviors, to learn information related to specific problems occurring in their schools, to learn how to recognize early signs of cyberbullying problems, and to learn how to help resolve problems. To varying degrees, the content did not meet expectations regarding information on helping parents deal with bullying, providing information on helping students resolve incidents of cyberbullying, understanding how cyberbullying impacts school climate, and learning how to help students make more mature decisions (see Table 8.1).
Table 8.1
Participant gains during training (expected vs. achieved)
Statement | Expected (n) | Gained (n) | How much the gains exceeded the expectations? (pre- and post-test of participants) |
I am not particularly interested | 1 | 1 | 0 |
I am generally interested | 4 | 7 | + 3 |
…to learn information related to specific problems occurred in my school | 32 | 44 | + 12 |
…to learn how (cyber) bullying influence school climate | 65 | 64 | − 1 |
…to learn the side effects of (cyber) bullying and how pupils experience them | 55 | 57 | + 2 |
…to learn how to avoid premature decisions | 57 | 53 | − 4 |
…to be better able to help parents in understanding and solving | 66 | 59 | − 7 |
…to learn how to help pupils solve (cyber) bullying more effectively | 67 | 55 | − 12 |
…to learn what educators can do when confronting such problems | 65 | 68 | + 3 |
…to learn to differentiate between bullying and other types of conflicts | 61 | 77 | + 16 |
…to learn how to early recognize potential (cyber) bullying problems | 67 | 74 | + 7 |
…to learn how to help resolve problems | 65 | 72 | + 7 |
…to develop a better understanding of (cyber) bullying | 65 | 80 | + 25 |
Mean (How much the gains exceeded the expectations?) | + 3.6 |
For 64% of respondents (53 out of 83), this was not their first experience with a bullying prevention program. Generally, MARC’s training received excellent marks. Participants were generally much more satisfied with the training than they had been with past programs. The trainer’s preparedness, organization of material, and quality of information provided received the highest ratings (see Table 8.2).
Table 8.2
Participant satisfaction with training
How satisfied the participant was with the train-the-trainer workshop? | ||||||
1 (Not satisfied at all) | 2 (Somewhat satisfied) | 3 (Satisfied enough) | 4 (Very much satisfied) | No answer | Total | |
Was the program well organized? | 0 (0.0%) | 1 (1.2%) | 10 (11.9%) | 73 (86.9%) | 0 (0.0%) | 84 (100.0%) |
Were the topics relevant? | 0 (0.0%) | 5 (6.%) | 11 (13.1%) | 68 (81.0%) | 0 (0.0%) | 84 (100.0%) |
Was at least 25% of the material new or new perspective? | 1 (1.2%) | 9 (10.7%) | 30 (35.7%) | 44 (52.4%) | 0 (0.0%) | 84 (100.0%) |
Were the trainers informative? | 0 (0.0%) | 1 (1.2%) | 3 (3.6%) | 80 (95.2%) | 0 (0.0%) | 84 (100.0%) |
Were the trainers prepared? | 0 (0.0%) | 0 (0.0%) | 2 (2.4%) | 82 (97.6%) | 0 (0.0%) | 84 (100.0%) |
Was the material presented in an understandable way? | 0 (0.0%) | 2 (2.4%) | 8 (9.5%) | 74 (88.1%) | 0 (0.0%) | 84 (100.0%) |
Were the questions handled satisfactorily? | 1 (1.2%) | 3 (3.6%) | 22 (26.2%) | 58 (69.0%) | 0 (0.0%) | 84 (100.0%) |
Was the room adequate? | 1 (1.2%) | 13 (15.5%) | 36 (42.9%) | 34 (40.5%) | 0 (0.0%) | 84 (100.0%) |
Was the food adequate? | 1 (1.2%) | 3 (3.6%) | 16 (19.0%) | 64 (76.2%) | 0 (0.0%) | 84 (100.0%) |
Were the starting and ending times convenient? | 1 (1.2%) | 0 (0.0%) | 13 (15.5%) | 70 (83.3%) | 0 (0.0%) | 84 (100.0%) |
Was your registration handled smoothly? | 1 (1.2%) | 2 (2.4%) | 5 (6.0%) | 75 (89.3%) | 1 (1.2%) | 84 (100.0%) |
Interestingly, only 55% of the respondents believed that they were in general more prepared on the topic by the end of the workshop. This might be explained by the qualitative data gathered, including open-ended questions in the self-report questionnaire; notably, 22% of the participants felt they needed more time to digest the high volume of information they received at the training; 33% of the participants also reported a desire for even more practical content.
MARC does its best to take advantage of the limited time available for teacher training, and many schools where we train teachers also engage MARC for periodic telephone consultation and support. Fortunately, even while teachers acknowledge their need for more ongoing training, they also report that the in-service trainings were relevant and useful. Qualitative information gathered has included the following comments:
The material is research-based with proven results and the program adapts to the needs of the target audience. I appreciate that the presentations incorporate the latest findings and are never perceived as canned.
It is notable that answers to open-ended questions tend to focus on the two distinctive characteristics of the MARC faculty training: the emphasis on data and research (versus unsubstantiated beliefs or abstract theory) and the practical strategies for dealing with antisocial behaviors. It seems that even though these are one-time trainings, they do appear to meet many (if not all) of the teachers’ needs.
As part of other ongoing outcomes research, pre- and post-test data were collected from a group of 22 middle and high school teachers, nurses, and guidance counselors from a small secondary school in Massachusetts. They were trained during a professional development in-service in 2012. Questions for the pre- and post-test were created, based on the factual concepts in the training curriculum. Items were multiple choice and designed to detect increase in knowledge. Overall, data showed that knowledge about bullying and cyberbullying increased significantly after the faculty training, from a mean score of 7.09 on the pretest to a mean of 11.05 on the posttest. A paired t-test showed that the difference between conditions was significant (t = 10.89, df = 21, and p < 0.0001). The difference showed that participants improved their scores by an average of four correct answers following the faculty training.
In addition to the evaluation of faculty programs, we conducted an evaluation of several assemblies held for 6th & 7th graders at a middle school in Massachusetts. The school volunteered to participate in the evaluation, and the analysis involved anonymous, self-report, pre- and post-test questionnaires on the prevalence and patterns of students’ online activities posing risk (e.g., having own cell phone, playing games online, using SNS sites, chat with people who they know and don’t), whether they feel their school is responsive in helping to stop bullying and cyberbullying, if they ever experienced online embarrassing activities, who they spoke to about a bullying or cyberbullying incident, their perception of frequency of bullying and cyberbullying among their peers, whether they discussed online safety issues (such as being private online, predators online etc.) with adults, their practical knowledge on what students can do for each other in a bullying situation, their legal knowledge on activities widespread among the youth (e.g., video sharing and downloading), their perception of being safe in cyberspace (i.e., less likely be punished due to violation of law), and what they personally liked to see in an antibullying school program (Table 8.3).
Table 8.3
Changes in attitudes among students
Statement | Do you agree with the statement? Pre-test (n, %) | Do you agree with the statement? Post-test (n, %) | Rate of development (pre- and post-test) |
Bystanders CAN change bullying/cyberbullying incidents at all | 220 (57.9%) | 256 (69.6%) | + 11.7% |
Bullying is when a person/group uses power to hurt another person repeatedly | 343 (90.3%) | 328 (89.1%) | − 1.2% |
Texting a lot when we are mad can make us feel worse | 149 (39.2%) | 91 (24.8%) | − 14.5% |
Bullying is sometimes criminal harassment or a civil rights violation | 229 (60.3%) | 308 (83.7%) | + 23.4% |
Once we post something online it could be there online forever, even if we “deleted” it | 272 (71.6%) | 305 (82.9%) | + 11.3% |
Passwords should be kept private (not to be shared and should be changed periodically) | 179 (47.1%) | 307 (83.4%) | + 36.3% |
We are less likely to be punished due to violation of law in cyberspace | 28 (7.4%) | 8 (2.1%) | + 5.3% |
Mean (How much is the development between pre- and post-test?) | + 10.3% |
Attrition was low between the pretest and posttest (only 12 out of 380 pretest subjects failed to complete the posttest). The posttest was conducted within 2–3 weeks after the assembly was held.
One interesting finding concerned students’ preferences for reporting a bullying or cyberbullying incident. In a multiresponse question we asked “Have you ever spoken to someone about an incident of bullying and cyberbullying? If yes, indicate who you decided to speak with.” The pretest revealed their marked preference for discussing bullying and cyberbullying incidents with their parents and peers, regardless of whether they were the target or a bystander. Students’ roles were identified by asking whether they witnessed something written online or in a text message that may have been embarrassing to them or someone else. Almost two-thirds of targets and almost half of bystanders preferred discussions with parents, and more than half of targets and one-third of bystanders preferred discussions with peers.
Participants were somewhat less interested in reporting bullying and cyberbullying to other trusted adults (e.g., counselor, relative). In general, students indicated a stronger preference for talking to school adults when they were the target. The content of MARC student programming consistently emphasizes the positive actions that bystanders, witnesses, friends, and peers can take in reporting bullying and helping targets; possibly because of this, the posttest results detected change in reporting preferences. A few weeks after the assembly, the respondents indicated an increased willingness to discuss bullying and cyberbullying with all possible parties, especially when they were bystanders of cyberbullying incidents. The proportion of students agreeing that they would talk to parents, peers, and adults at school if they witnessed someone being mean online or through text messaging to someone else all increased between the pre- and post-test (Fig. 8.1).
Why did willingness to report increase, particularly to school personnel? MARC’s trainers stress the importance of school climate and how significantly a bullying/cyberbullying incident can impact the entire community. In other words, they emphasize that the actual impact of such an incident or engaging in other negative peer behaviors can be very broad, despite the fact that it may only affect a few persons directly. It is possible that, after the presentation, students better understood the significance of involving other community members (such as teachers or other school staff) in the management of bullying and conflicts. Another possibility is that when students witness their teachers learning alongside with them during the programming, that colearning experience may increase their comfort in reporting to them (Table 8.4).
Table 8.4
Numbers of students participating in pre- and post-test evaluations
Students participating in both test phases | |||||
Grade | Gender | ||||
6th Grade | 7th Grade | Boys | Girls | N.A. | |
Pre-test phase | 188 (49.5%) | 192 (50.5%) | 199 (52.4%) | 178 (46.8%) | 3 (0.8%) |
Post-test phase | 181 (33.3%) | 187 (34.4%) | 186 (50.5%) | 182 (49.5%) | 0 (0.0%) |
Factors that showed little or no change included participants’ understanding of the conceptual elements of bullying; however, there were high levels of understanding already present in the pretest (“bullying is when a person/group uses power to hurt another person repeatedly”: + 1.2%).
Qualitative data suggested that the program was met with a predominantly positive response. Not only did the students absorb new knowledge, but they were also successfully mobilized; MARC student presenters increased their interest in the topic and gave inspiring advice. The students seemed most appreciative of the detailed understanding they gained about digital behaviors and cyberbullying. They highlighted the easy-to-follow, practical advice as one of the most helpful parts of the presentation.
Some negatives were mentioned, notably, the methodological shortcomings of the student assembly, such as insufficient interactivity or group work, and that they wanted to hear more about how to stop bullying.
Students frequently referenced their gains in knowledge about how to best handle bullying and cyberbullying situations as they encounter them. Humorously, one student wrote, “I find this a refreshment from all those dumb strategies that only work in musicals.” Another student said, “Finally, not some dumb, ‘go be friends with the bully’ presentation” [sic].
This curriculum is designed to be used in short periods of time, e.g., 20-min segments–herefore, it can be used during Advisory Periods (which vary in length but can be quite short). It is a discussion-based curriculum, where videos of older students bringing up social issues are then discussed among the class, with the use of a Teacher’s Guide that underscores main points and poses helpful discussion questions. A pilot study of the curriculum was conducted between April and June 2013. Forty-eight schools in Massachusetts agreed to complete the Lesson Plans and record all required data. By the end of the pilot, 48 faculty and staff had taught 123 lessons. Almost two-thirds (64%) identified themselves as classroom teachers, and 18% were counseling staff. Other categories included administrators, librarians, resource officers, secretaries, and substitute teachers.
To measure efficacy, both students and teachers were asked if the students had learned something new during the lesson. In addition, teachers were asked how engaged the students were, and if the lesson plan had stimulated a vigorous discussion between students. Both students and teachers used a five-point rating system (from 1 “completely unengaged” to 5 “completely engaged”). Across all lessons, the curriculum scored highest for stimulating engagement and discussion (mean score was 3.65 out of 5 or 73%). The average scores for increased understanding and learning were somewhat lower (60.4% by the students, and 45% by the teachers). It is interesting that students regarded their own learning as greater relative to teachers’ ratings. This gap underscores the difficulty in estimating learning when it comes to social and emotional concepts. More than one teacher in this study expressed surprise at how much the students felt they had learned through the class discussion.
The premise of this Curriculum is that helping students understand how digital technology can filter or skew information can help them avoid inadvertent social conflict. Lesson plans also address related issues such as the impact of cyberbullying and what effective policies and interventions might look like. During the fall of 2010, a pilot program was launched to systematically evaluate the potential impact of the High School Cyberskills’ Curriculum. This evaluation study used a within-subjects’ pre- and post-test design. Students were tested on their knowledge prior to engaging with the Curriculum, and then retested afterward. The study sample consisted of 1444 children in grades 9–12 from five different schools who were given the lessons in one of their classes. This study directly measured any change in students’ knowledge about digital information skills following the implementation of the curriculum.
Across grades 9–12, six general topics were examined: General knowledge about social networking; knowledge about privacy limitations within social networking; general knowledge about cyberbullying and cyberbehaviors; Internet-based scams, theft, and phishing; cookies, behavioral tracking, and targeted advertising; laws about making and using video/audio recordings. Every topic and grade level studied resulted in statistically significant differences between Time 1 (the pretest) and Time 2 (postcurriculum) levels. A few individual lessons showed no significant difference between the two times. Students significantly increased their general knowledge about social media, the limitations about privacy within social networking, the difference between cyberconflict versus cyberbullying, and ways to combat cyberbullying.
This chapter discussed both quantitative and qualitative evaluations examining the efficacy of MARC programming and curricula for students and faculty. Overall, feedback highlighted the success of some of the centers’ distinctive characteristics, notably the reliance on research findings, the focus on digital issues, the use of high-status peers, and the provision of practical strategies. Both quantitative and qualitative data suggest that these programs were largely successful, but some weaknesses were also identified. Both adults and students cite the need for ongoing, interactive programs, and while they endorsed practical strategies, always wanted more.
Findings presented suggest that programming at the center is received positively across stakeholders. Increased knowledge was seen among faculty and students. Willingness to talk about and intervene in bullying was seen in students. Attendees at the train the trainer indicate that trainings are informative and with subjects reporting they had gained knowledge beyond their initial expectations. Outcome research has been positive overall, but this pool of data has limitations.
Other outcomes studies are not reported in this chapter, although they are freely available on the MARC website. Overall, the outcomes research relied on within-subjects’ research, qualitative comments and feedback, and quasiexperimental design. A more solid review would require random assignment to different conditions, including a control group, and a prospective longitudinal follow-up of subjects to ascertain behavioral and emotional changes. Still, there are advantages in the type of efficacy research undertaken. Pre- and post-test designs can certainly document change although such studies cannot pinpoint the cause of any change noted. Also, while qualitative data can provide only limited answers, it is extremely helpful given the fast-paced nature of changes in the digital realm. This means that by the time questions about particular behaviors or platforms make their way into research studies, trends may have changed. Open-ended surveys of students may be particularly useful in identifying areas that may be inadvertently neglected, e.g., new social media platforms and apps, common online behaviors that may not have entered the adult world like sexting, the use of terminology, etc. Often it is not a disregard for these issues that result in them being ignored, but more likely a result of adults’ limited knowledge base (even those adults engaged in current research efforts).
Finally, while evidence-based programming is without a doubt the gold standard in the field, many programs offer evidence of efficacy that does not rise to the level of randomized controlled research. For example, the programs evaluated here did not include a comprehensive fidelity check. The programs offered by MARC should be considered within that context.
3.239.76.211