Course Syllabus
The Editor Only Instructions are NOT visible to your students. To remove, mark as complete in the Key Action Items menu in the lower right-hand corner. Right-click to open links in a new tab or open in Key Action Items.
- Use the heading hierarchy in the Rich Content Editor to add blocks of text and visual interest to the page.
Edit Syllabus Information:
- Consider using CELT'S mindful and student-centered syllabus Toolkit (pdf).
- Enter relevant content on your syllabus page. Important: There are some examples that require being edited or deleted as needed.
- ISU Required Syllabus Statements must remain and are not editable. Your course-specific syllabus statements are editable.
- To print, save this page as a PDF file as described in the Tip below. Leave the Disclaimer and Tip for your students.
Syllabus: EDUC/HCI 504
Evaluating Digital Learning Environments
Tip: The Syllabus Navigation menu is located on the top right corner of the screen to help you quickly locate syllabus content.
Print/Save this page by pressing Control+P (PC) or Command+P (Mac) and select a printer or Save as PDF.
Course Description
This course covers the principles and procedures to plan, design, and conduct effective evaluation studies (formative, summative, usability) in different settings. Opportunities to engage in real or simulated evaluation projects of substantial scope are provided. Course activities include creating evaluation instruments, developing methods with which to evaluate a product or program, conducting try-outs or usability sessions, analyzing the data, reporting the findings, and recommendations.
- Course Name: Evaluating Digital Learning Environments
- Current semester and year: Fall 2023
- Course format: Online
Instructor Information
- Instructor: Evrim Baran, Ph.D.
- Email: ebaran@iastate.edu
- Twitter: @evrimb
- Office Hours: Please email the course instructor to schedule an online meeting.
Course Goals and Learning Objectives
The major goal of this course developing knowledge and skills on the evaluation of digital learning environments. By the end of the course, the students will be able to:
- Distinguish evaluation from research.
- Define basic concepts and terminology associated with evaluation/usability testing.
- Analyze and critique evaluative instruments.
- Compare and contrast different types of evaluation.
- Explain the basic purposes and uses of evaluation depending on its purposes.
- Formulate evaluative questions.
- Describe the basic steps on doing evaluation.
- Create (design and develop) evaluative instruments.
- Use qualitative and quantitative data gathering techniques in an evaluation project.
- Describe reliability, validity, and trustworthiness processes in collecting and analyzing evaluation data.
- Discuss politics, ethics, and standards of evaluation.
- Gather, analyze, and interpret evaluation data and information.
- Report the results of the evaluation activities.
Course Format
This course will use online modules to accomplish outcomes and allow students to access and complete course material at a time convenient to them. Throughout the semester, students will engage with the course content via different modes, such as discussions, applied projects, and teamwork. We will hold four live sessions in Zoom:
- Wednesday, Aug 30, 6:00-8:00pm (CST)
- Wednesday, Oct 4, 6:00-8:00pm (CST)
- Wednesday, Nov 1, 6:00-8:00pm (CST)
- Wednesday, Dec 6, 6:00-8:00pm (CST)
All live sessions will be recorded and students who are not able to attend the meetings will have the option to access them. Project teams will also schedule consultation meetings with the instructor on Zoom during the semester.
Each week, on Tuesday, the instructor will post the module overview and activities covering the topics and announcements. Please review the modules and follow the due dates and deliverables for the projects and online discussions. Your primary responsibilities include:
- Review the Module Overviews released on Tuesdays
- Complete assigned readings/videos/reviews
- Engage in online activities throughout the week.
- Complete project activities with your team members.
Course Materials
List any required and optional materials, such as books, instructional guides, websites, simulations, interactive games, mass media publications, peer reviewed journals.
Follow a specific reference style guide, such as APA, MLA or Chicago. At minimum, reference the author or owner name, date of publication, title, and the URL or source, such as publisher.
Textbooks:
- Rubin, J. & Chisnell, D. (2008). Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests (2nd ed.). Indianapolis, IN: Wiley. [Available for Online Access through Iowa State Library]
- Fitzpatrick, J., Sanders, J. & Worthen, B. (2011). Program Evaluation: Alternative Approaches and Practical Guidelines (4th ed.). New York: Pearson. [Available in the Bookstore]
Recommended:
- Westat, J.F. (Ed.) (2002). User-Friendly Handbook for Project Evaluation. Division of Research, Evaluation and Communication https://www.nsf.gov/pubs/2002/nsf02057/start.htm, National Science Foundation. Arlington, VA: National Science Foundation. FREE from NSF website:
Assessments
Project 1: Evaluative Instrument Critique (individual)
This project consists on critiquing an evaluative instrument (paper or electronic-based). The instrument must serve an evaluative purpose and should measure aspects of a learning technologies related training program or event. The critique is based on a series of evaluation criteria (e.g., appropriateness of the instrument to the purpose of the evaluation stated, strengths and weaknesses of the instrument in terms of a data collection method, quality, etc.).
Project 2: Evaluation/Usability Applied Project (team)
Together with 2-3 other students, you will select a product (or prototype) - in print or electronic format- that is suited for formal or informal learning in academic, K-12 schools, corporate, or non-profit settings. You will conduct an evaluation study or a usability testing project based on the selected product (or prototype).
Online Discussions & Activities
Students will participate in online discussions and activities. Discussions will be based on questions from the instructor relevant to the learning objectives, lectures, and videos. Students will answer instructor questions and then discuss the questions with classmates. These online discussions are your opportunity to reflect on the topics, share your viewpoints, and engage in an active group conversation. When participating in the discussions, it is important that we maintain a sense of freedom to express our thoughts while at the same time providing a safe atmosphere for diverse opinions and expressions. Please keep this in mind that as you are communicating with others.
The online activities are your opportunity to engage in evaluation exercises. In this course, you are strongly encouraged to express yourself using NOT only text-based formats but also contribute using audio, video, and images. A successful class will depend on every member of the group actively collaborating as both learners and teachers. Each of us has valuable perspectives and experiences that will inform our collective, developing knowledge about the integration of design thinking in various contexts in the classrooms. Please be consistent with your participation and inform the instructor at ebaran@iastate.edu of any circumstances that will prevent you to contribute to the course activities and online discussions.
Explain how the learning activities provide opportunities for practice, interaction and achievement of the listed learning objectives.
Grading Distribution & Schema
List all course assessments. Provide specific and descriptive criteria to be used for evaluating student work and explain their connection to the course grading policy.Explain what kind of feedback students can expect after each assessment.
Grade Distribution
To add more columns or rows, hover the cursor over the table to see table properties. See Canvas Guide for more guidance.
You can accumulate points by participating in the following way:
| Deliverable | Grade Points |
|---|---|
| Project 1: Evaluative Instrument Critique | 30 |
|
Project 2: Evaluation /Usability Applied Project
|
120 |
| Online Discussion/Activities | 50 |
| Total Points Possible | 200 |
Grading Scheme
Grading scheme: The table below shows the Canvas default grading scheme. This is a Canvas sample grading schema, and not an institutional grading schema. Make sure the grading schema you describe in your syllabus matches your grading schema in the course-specific settings.
The following grading standards will be used in this class:
| Grade | Range |
|---|---|
| A | 93% to 100% |
| A- | 90% to < 93% |
| B+ | 87% to < 90% |
| B | 83% to < 87% |
| B- | 80% to < 83% |
| C+ | 77% to < 80% |
| C | 73% to < 77% |
| C- | 70% to < 73% |
| D+ | 67% to < 70% |
| D | 63% to < 67% |
| D- | 60% to < 63% |
| F | 0% to < 60% |
Course Policies
Below are sample policies. They may not fitting your course, so please change accordingly.
Feedback
All graded assessments will be returned with feedback within 7 days of the due date. Personalized feedback will be provided for each assignment and reflection. In addition, responses to common questions and unclear content will be posted at the conclusion of each module. Weekly summaries will be posted at the conclusion of each module.
Missed and late coursework
- All online weekly activities must be completed within the given period.
- Please contact the instructor for possible missed and late coursework ahead of time.
Attendance
This course will use an asynchronous format for modular activities. We will hold four live sessions to share project progress and updates. All live meetings will be recorded for those who cannot attend these meetings.
All students should attend the final live meeting for project presentations. Please inform the instructor ahead of time in case one of the team members cannot attend this meeting.
Notice
The information in this syllabus is subject to change in extenuating circumstances. Changes to the course syllabus will be provided in writing and announced via course-wide announcements.
Use of AI Tools
Students are encouraged to use AI tools in this course. When submitting work, students must clearly identify any writing, text, or media generated by AI. Students are responsible for the accuracy of the generated content. Failure to properly acknowledge the AI-generated contributions will be treated as academic misconduct.
Required ISU Syllabus Statement
Free Expression
Iowa State University supports and upholds the First Amendment protection of freedom of speech and the principle of academic freedom in order to foster a learning environment where open inquiry and the vigorous debate of a diversity of ideas are encouraged. Students will not be penalized for the content or viewpoints of their speech as long as student expression in a class context is germane to the subject matter of the class and conveyed in an appropriate manner.
Recommended ISU Syllabus Statements
Academic Dishonesty
The class will follow Iowa State University’s policy on academic misconduct (5.1 in the Student Code of Conduct). Students are responsible for adhering to university policy and the expectations in the course syllabus and on coursework and exams, and for following directions given by faculty, instructors, and Testing Center regulations related to coursework, assessments, and exams. Anyone suspected of academic misconduct will be reported to the Office of Student Conduct in the Dean of Students Office. Information about academic integrity and the value of completing academic work honestly can be found in the Iowa State University Academic Integrity Tutorial.
Accessibility Statement
Iowa State University is committed to advancing equity, access, and inclusion for students with disabilities. Promoting these values entails providing reasonable accommodations where barriers exist to students’ full participation in higher education. Students in need of accommodations or who experience accessibility-related barriers to learning should work with Student Accessibility Services (SAS) to identify resources and support available to them. Staff at SAS collaborate with students and campus partners to coordinate accommodations and to further the academic excellence of students with disabilities. Information about SAS is available online at www.sas.dso.iastate.edu, by email at accessibility@iastate.edu, or by phone at 515-294-7220.
Discrimination and Harassment
Iowa State University does not discriminate on the basis of race, color, age, ethnicity, religion, national origin, pregnancy, sexual orientation, gender identity, genetic information, sex, marital status, disability, or status as a U.S. Veteran. Inquiries regarding non-discrimination policies may be directed to Office of Equal Opportunity, 3410 Beardshear Hall, 515 Morrill Road, Ames, Iowa 50011, Tel. 515-294-7612, Hotline 515-294-1222, email eooffice@iastate.edu
Prep Week
This class follows the Iowa State University Prep Week policy as noted in section 10.6.4 of the Faculty Handbook.
Religious Accommodation
Iowa State University welcomes diversity of religious beliefs and practices, recognizing the contributions differing experiences and viewpoints can bring to the community. There may be times when an academic requirement conflicts with religious observances and practices. If that happens, students may request the reasonable accommodation for religious practices. In all cases, you must put your request in writing. The instructor will review the situation in an effort to provide a reasonable accommodation when possible to do so without fundamentally altering a course. For students, you should first discuss the conflict and your requested accommodation with your professor at the earliest possible time. You or your instructor may also seek assistance from the Dean of Students Office at 515-294-1020 or the Office of Equal Opportunity at 515-294-7612.
Contact Information For Academic Issues
If you are experiencing, or have experienced, a problem with any of the above statements, email academicissues@iastate.edu
(Important note to faculty: The email address for contact information is monitored and answered through the Office of the Senior Vice President and Provost)
Disclaimer: The information in this syllabus is subject to change in extenuating circumstances. Changes to the course syllabus will be provided in writing and announced via course-wide announcements.
The syllabus page shows a table-oriented view of the course schedule, and the basics of course grading. You can add any other comments, notes, or thoughts you have about the course structure, course policies or anything else.
To add some comments, click the "Edit" link at the top.