On 11/9/17 at 11:00am, I presented at the Wake Technical Community College Fall Professional Development Conference at the Session Gamification In The Classroom in the Engineering Technology Building in Raleigh, NC. This was co-presented by Tyler Dockery and Nicolas D’Agata of Wake Technical Community College
Gamification In The Classroom
In this presentation, we will cover 4 basic topics:
This presentation is part of a grant we ran in 2014, discussing the reason behind what we did, the lessons we learned, and how you might be able to integrate these ideas in your classroom. This grant was proposed and monies set aside to train and develop gamified systems in low-performing courses in the WEB curriculum model. In this first part, we will discuss some of these results.
When Things Go Poorly
LATE NIGHT ACCESS TO THE INSTRUCTOR
Story Form Engagement
By taking the students through the materials one item at a time, student were exposed to a story in serialized form. Each decision allowed student to take quizzes and open things like a choose-your-own-adventure book. A strict list of deliverables were noting requirements each week, and each was made available one item at a time with encouraging messages and explanations. Great artwork moved them through the story with chunked information.
Chocolate Covered Broccoli
Students mentioned in exit interviews that the course was exciting for the first 8 weeks or less only. After 8 weeks, the gamification storyline began to become less exciting and more filler content which stopped them from getting to the real meat of the course. Students who missed assignments or failed to turn them in missed content, stating that they could not follow the story any more. Students who did not read the course material failed to understand that there were minimum quiz grades and found they were flunking early in the semester, and many chose to drop.
After the midterm, many students said that they were facing fatigue. Too many classes, too many projects, and they admitted that by week 9 they were simply skipping over the content to get to the work. One student mentioned very specifically: “I didn’t read the story after the midterm. I just wanted to get my work done and find out what the next item on the list was and get my grade.”
Seems like building out all the dependencies and choose-your-own-adventure story lines were really some wasted time and effort. Scores did increase, but the story was not engaging. After
Second Time Is The Charm
In WEB141 Mobile Interface Design, students found that they were highly disengaged with the class, noting that book materials were very paint-by-number, and had little to do with real life problems. Students found it difficult to tell where they in the class, with scores for midterms, finals, and assignments clearly defined, but still hard to calculate where students should put their efforts. Student who fell behind in online courses felt that they could not gain any headway, and messing up on a project or two when coupled with the midterm left them flat with no way to raise their grade.
To combat the issue, Nic D’Agata looked at the data and changed his tactics to better meet student needs.
GAMIFICATION AT THEIR WILL
Since students in the first class found that the gamification content was a distraction, Nic built his material as an overlay. Content for the course changed little, with the gamification built over the top. Students had the option to ignore the gamification elements without detriment to the course content.
QUICK GAUGE OF PROGRESS
Many students found they could not tell which items were best for their grades, and the best uses of their time. Nic installed a system of “Money” earned through the course of the semester. Each week offered one or more project. Each project was a contract with a client, offering money for project which met the minimum requirements, and greater funds for projects which excel. Students were given the goal to reach $1 million by the end of the semester.
Nic also included a leaderboard where students could see their progress compared to other students. No names were given, so no privileged information is released, but it could encourage students to work harder if they’re in the wrong spot.
INCREASE RANK AT THE STUDENTS’ CHOICE
Students often found that getting behind was like getting in a hole too deep to get out of. At strategic points in the semester, students were treated to “Freelance” options, where they could troubleshoot existing code and earn money to increase their monetary income. This was essentially enrichment activities where students could increase their understanding or take on additional work to increase their grades.
RECOGNITION FOR A JOB WELL DONE
Using blackboard achievements and badges, students would be automatically notified of “industry recognition”. Students could see the badges and gain an instant warm fuzzy for having some minor graphics provided to them.
On the right track
Overall, students reported that they felt more engaged in a course with open-ended projects and gamified elements.
Best of both worlds
Students enjoyed some open-ended projects and did not miss the “paint-by-numbers” approach. Some people really liked the 8-bit gaming platform of the course, and most people enjoyed the scoreboard/leaderboard process. This, along with the monetary system, was super-effective at motivating students
Nothing is ever perfect
The assistant is a moving digital display which lays out the information needed in each lesson. In some lessons this outlines projects, in others, it outlines specifics about the learning methods. While only a small number found it detrimental, it was almost a 50/50 split on Liking/Not Caring for the assistant.
The leaderboard answered questions that many students had about their grades, their places in the class, and provided some good motivation. The material was helpful to most students, with many students noting it as a prime motivator. Some students (about 1-2 per semester) found the leaderboard to be a source of anxiety causing them to worry about their location in the class.
The Leaderboard was a simple tool plugin, and could quite easily be coded into your classes.
Hands-On Leaderboard Addition Demonstration
At this point in the presentation, Nicolas answered questions about adding in the leaderboard. Using HTML code directly in his blackboard course, Nic added the leaderboard in to an older course as a demonstration. It was complicated, but well-received.
SHOW AND TELL IS OVER
At this point, we’ve talked about our personal experiences, so lets begin some insight into how you can add this to your classes.
Blackboard Badging and Certificates
The blackboard badging and certificate systems are available to all current blackboard shells. They can both be accessed through the TOOLS menu options on the lefthand side. You can work with existing items, create your own, make your own certifications, etc. They are easily created, and can easily integrate with your course shells at any time.
At this time, we created a shown, in-person demonstration on the overhead.
The services we showed at the end of the material allowed us to include Quizlet materials for easy self-study materials, online games like Play Brighter or Virtonomics, advanced tools like Duolingo, or creating your own badges and materials with OpenBadges. The material was well received, and we did a few extra demonstrations on how to include teaching materials from duplingo, integrating quizlet, and Q&A was fairly sedate.
Completed UDEMY Certification Course for “How To Design Professional Infographics : Beginners Course”
I have received numerous requests from UDEMY to come to their website and purchase some of their training. While this hadn’t always appealed to me (seemed like perhaps they might be trying a bit too hard), I decided I’d give it a try. While the training course I felt might be most worth my while was still selling for roughly $45, I was able to purchase this second piece of training a few weeks ago at the same time I purchased: Logo Design Fundamentals by Andrew Boehm of Growing Business Online.
This course was much more extensive than the first, with 89 lectures encompassing software, research, slides, and an additional 4.5 hours of video content. Materials came with downloadable materials which were required for the final assessment. The downloading of materials for the final assessment seemed to be met with displeasure, although moderators noted that might change to an elected component. I was pleased with the course and could see how beginners might really sink their teeth into this.
You can check out my fancy certificate here
On April 2nd, 2015 at Wake Tech’s North Campus, Ed Neal addressed the Wake Tech Faculty Professional Development Conference at 9:00am
Evaluating Student Learning: Faculty Professional Development Conference 2015
The hope of this lecture was to create usable training. When looking into your approaches to your classes, and how you evaluate your student learning, begin by evaluating your SLO’s.
- Which ones can be multiple choice questions?
- Which ones can be fill-in-the-blank questions?
- Which ones can require a rubric for open-ended work?
It is important to note that there is a distinct difference between assessment and evaluation.
Evaluation— placing a value
Assessment— Sitting beside the learner and making a determination
More assessments means less stress and better evaluations. Use follow-up questions to accurately assess student learning after lecture and readings. Discussions are great ways to provide students with asynchronus communication when assessing their learning.
If you are giving a grade for everything, students will become grade-oriented. That is, if the task is deemed to be worth doing, and the reward is deemed high enough.
Your students will want to know “How am I graded?”, “What kind of assessments will I receive?”. Be crystal clear. Evaluation is measurement. It should be valid (that is to say, it should test what you want it to test), and it should also be reliable (that is to say, it should be usable again and again without fail).
What are the Threats to Validity?
Threats to validity are often no mentioned. Specifically, cheating. What is it that you are measuring… if the students cheat. Its really a good question. Testing improves learning. Studies and testing clearly supports this.
We took a short test, a tauroscatalogical test.
Incorrect answers will stay with students if not corrected. They can stay with people for a lifetime if uncorrected. The best answer or solution to this is to discuss incorrect answers with students and why the proper answers are correct. Students in high school typically complete 200+ multiple choice test by the time they graduate. Typically, this encompasses 1 right answer, 1 wrong answer in an opposite fashion, and 2 items which are deemed “distractors”. Your students are GOOD at taking these test. You are very poor at writing them.
Case problems are typically the worst questions of all times. Teachers like them because they are ways of dealing with real-world problems. Students hate these, because they are difficult, and moreso than any other type of question they encounter. Dial back the number of these questions that you demand students answer. These are the “Money questions”.
Time to go
At this point, the discussions began to diverge from my needs. As a graphic and web design teacher, our examinations are based on real-world scenarios, multiple choice questions, and the best I can come up with in a constantly changing landscape of culture and technology. Frankly, if I can come up with 50-60 questions, I feel totally on top of my game.
The discussion broke down into item analysis, how to properly calculate the discrimination index with your questions using results from a scan-tron machine, and the mathematical calculations required to do this. I don’t use scan-tron forms, and I haven’t used one since I started working in education in 2005. All of my testing is blackboard-based and I couldn’t help with this or even pretend to understand how these mathematics could be carried out. The populations they discussed in the classes were in the 200+ range per section, and my largest class is 24 students per section, or up to 96 students per semester in all my courses.
We then broke down into small groups and discussed our individual SLOs and which could be broken down into what kinds of questions. Since in my courses we are generally discussing 4 SLOs, my portion was over quickly enough to focus on others for the remainder of the class. I felt this class was enjoyable, and I learned a great deal, however I could not participate as fully as others.
Ed Neal is a consultant with 34 years of experience in faculty development.
Project Management (2013) Certification Achieved!
Since the end of the semester is here, but the summer semester hasn’t begun, I’ve decided that the time is right for me to cover some certification bases. Project Management is a skill that one can never seem to get enough training in. My PMP (Project Management Professional)training was some time ago, and the last project management update I received was related to the changes made in 2008 related to the PMP testing changes.
With this empty time, I’m currently working on a grant with one of my co-workers (gamification of collegiate courses by Tyler Dockery, MAEd and Nicolas D’Agata, MSEd). Before the time for the summer semester is heavy upon me, I took today to get some of those updates to the PMP knowledge base under my skin so that I can be better prepared for the future.
Glad to know that all of my studying paid off, perhaps I wont need another upgrade for a few years now.
Project Management (2008) Certification Achieved!
Winter is here and I’ve decided that the time is right for me to cover some Project Management content. My PMP (Project Management Professional) training was some time ago, and It’s time to update the information I received related to the changes made in 2008 to the PMP testing changes.
Glad to know that all of my studying paid off, perhaps I wont need another upgrade for a few years now.