Remote Proctoring: How Examinees Cheat and How To Catch Them

The webinar on remote proctoring explored the challenges of examinee cheating and solutions to detect it. It featured two industry leaders: Monitor EDU, specializing in live human proctoring for high-stakes exams, and Samadhi, offering AI-based proctoring services. They discussed various methods, including live proctoring, multi-factor authentication, biometric verification, and the use of secure browsers to ensure exam integrity. The conversation highlighted the importance of balancing security measures with privacy concerns and the need for robust customer support to ensure a smooth exam experience.

Takeaways

• 🎓 **Live Human Proctoring**: Monitor EDU focuses on high-stakes exams with live human proctoring, requiring examinees to verify their identity through video and photo ID checks.
• 📱 **Multi-Camera Setup**: Examinees may be asked to use both a webcam and a secondary device like a phone to provide a full view of the testing environment, including the candidate's face and room.
• 🔒 **AI-Based Proctoring**: Soma.ai provides scalable, secure remote proctoring services using AI to detect biometrics and suspicious behaviors during exams.
• 🖥️ **Secure Browser**: Soma.ai uses a secure browser application that restricts access to the exam until all unauthorized applications are closed and prevents new applications from being opened during the exam.
• 👁️ **Facial Recognition**: AI-based proctoring systems continuously take photographs of the examinee to ensure the person taking the exam is the registered candidate.
• 🚫 **Object Detection**: AI can detect unauthorized objects or a second person in the background, flagging any suspicious activity for further review.
• 🔗 **Integration with Platforms**: AI proctoring services integrate with Learning Management Systems (LMS) and other platforms to streamline the exam process.
• 🌐 **Global Reach**: Soma.ai serves customers across various geographies, including Latin America, Europe, the Middle East, and South Africa.
• ⏱️ **Real-Time Monitoring**: Proctoring platforms feed information to the cloud, allowing supervisors to monitor examinee behavior in real time during exams.
• 📈 **Scalability**: AI proctoring solutions can handle a high volume of exams, with Soma.ai supervising over 40,000 exams in a single day.
• 🔏 **Balancing Security and Privacy**: Both live and AI proctoring solutions emphasize the importance of respecting candidate privacy while ensuring exam security, adhering to data protection policies like GDPR.

Q & A

What is the main topic of the webinar?

The main topic of the webinar is remote proctoring, specifically discussing how examinees cheat in online exams and the methods used to catch them.

What are the two perspectives on remote proctoring discussed in the webinar?

The two perspectives discussed are live human proctoring, represented by Monitor EDU, and AI-based proctoring, represented by Somani.

What is unique about Monitor EDU's approach to proctoring?

Monitor EDU focuses on live human proctoring for high-stakes exams, requiring examinees to interact with a live proctor, show their ID, and use multiple cameras to monitor the exam environment.

How does Somani's AI-based proctoring service work?

Somani uses a secure browser application that employs artificial intelligence for detecting biometrics and suspicious behavior. It includes multi-factor authentication methods like facial recognition, typing pattern recognition, and voice recognition.

What is the significance of using a two-camera solution in remote proctoring?

A two-camera solution allows for a more comprehensive view of the testing environment, ensuring that there are no unauthorized materials or persons present and that the examinee is the person taking the exam.

What challenges do remote proctoring services face in terms of cheating prevention?

Remote proctoring services face challenges such as students finding creative ways to cheat, like using VPNs, virtual machines, or hidden materials, and the need to constantly update their systems to detect and prevent these new methods.

How does the lockdown browser feature contribute to the security of online exams?

The lockdown browser feature blocks other applications and peripherals during the exam, ensuring that examinees cannot access unauthorized materials or switch to other programs while taking the test.

What is the role of a live proctor in identifying cheating behaviors?

A live proctor observes the examinee's behavior and actions during the exam. They can intervene in real-time if suspicious activities are detected, ensuring the integrity of the examination process.

How do remote proctoring services ensure privacy and data protection for examinees?

Services like Somani are working towards GDPR compliance and implementing robust security measures to protect data. They also align with customer data retention policies and work with external ethical hackers to maintain system security.

What are some concerns that institutions have regarding remote proctoring?

Institutions are concerned about ensuring the proper use of proctoring tools by students, maintaining the security of exams, and providing a positive exam experience that does not cause undue stress or anxiety for students.

How can the use of mobile devices as secondary cameras be both beneficial and challenging in remote proctoring?

Mobile devices can provide an additional layer of monitoring, but they can also present challenges such as connectivity issues and the need for examinees to manage their device's battery life during the exam.

Outlines

00:00

😀 Introduction to Remote Proctoring Webinar

The video script introduces a webinar on remote proctoring, focusing on how to prevent and detect cheating during online exams. It features two industry leaders, Monitor EDU and Samadhi, who provide live human proctoring and AI-based proctoring services, respectively. The discussion aims to explore different perspectives on maintaining exam integrity and the technologies used to catch cheating. The speakers introduce themselves and their companies, sharing their backgrounds and experiences in the remote proctoring industry.

05:01

👀 AI-Based Proctoring with Biometric Authentication

This paragraph delves into the AI-based proctoring solution offered by Samadhi. Rivera from Samadhi explains how their tool uses artificial intelligence and biometrics, such as facial recognition, typing pattern recognition, and voice recognition, for authenticating student identities. The tool operates as a secure browser that integrates with learning management systems and testing platforms. It also features constant facial recognition during exams to ensure the student's identity and monitors the environment for any suspicious activities or objects. The system flags any attempts to open unauthorized applications and can scale to supervise a large number of exams simultaneously.

10:03

🛡️ Live Human Proctoring with Two-Camera Solution

In contrast to AI-based proctoring, Patrick from Monitor EDU describes their live human proctoring approach, which involves a two-camera system to monitor the testing environment comprehensively. Live proctors observe candidates in real-time, ensuring the environment is secure and candidates are following rules. They use a lockdown browser for secure testing and can intervene immediately if any suspicious behavior is detected. The live proctoring method is particularly focused on higher stakes assessments and provides a human element to guide candidates and ensure the integrity of the examination process.

15:05

🕵️‍♂️ Catching Cheating Tactics and Stories

The discussion shifts to specific instances of cheating and how they were caught. Don from Monitor EDU shares anecdotes of candidates using VPNs and others attempting to hide materials within their examination space. Proctors' keen observation skills and technology were crucial in identifying and addressing these cheating attempts. The stories highlight the importance of both technology and human oversight in preventing cheating during remote exams.

20:06

🤖 Creative Cheating Methods and AI Detection

Raul from Samadhi shares instances where students have been creative in their attempts to cheat, such as using answer sheets on the ceiling or plugging in a second monitor to access unauthorized materials. He explains how AI can detect unusual behaviors and monitor the use of peripherals and network traffic. The conversation underscores the continuous evolution of both cheating tactics and anti-cheating measures, with a focus on adapting to the technical savviness of students.

25:07

🔒 Addressing VPN Use and Privacy Concerns

The script addresses the use of VPNs in proctoring solutions and the challenges it poses. It is acknowledged that while VPNs can be necessary for candidates in certain regions, they can also be exploited to cheat. The panelists discuss the importance of identifying VPN use and monitoring traffic to maintain exam security. Additionally, they emphasize the need to balance security measures with privacy considerations, ensuring compliance with international data protection policies like GDPR.

30:09

📚 Balancing Exam Security and Student Anxiety

The conversation highlights the concerns of educational institutions and students regarding remote proctoring. While institutions worry about the security of exams and the integrity of the testing process, they also want to ensure that students can use the proctoring tools without issues. Addressing student anxiety and providing in-exam support are crucial to ensure a positive assessment experience and to avoid negatively impacting academic outcomes.

35:10

📱 Challenges of Using Mobile Phones for Proctoring

The panelists discuss the use of mobile phones as secondary cameras in proctoring and the challenges associated with it, such as inconsistent internet connectivity and device performance. They explain how their solutions adapt to these issues and the importance of having backup procedures in place. The discussion also touches on the limitations of conducting exams on mobile devices due to technological restrictions and the need for a better user experience.

40:11

📊 Future of Mobile Proctoring and Confirmation Testing

The script concludes with a discussion on the future of mobile proctoring and the potential for mobile devices to be used in the testing process. The panelists acknowledge that while current technology does not support taking exams on mobile devices with the same level of security as on laptops or desktops, advancements may change this in the future. They also mention the use of mobile devices for initial, low-stakes exams as part of a confirmation testing approach, which could save costs and resources.

45:11

🤝 Closing Remarks and Contact Information

In the final part of the script, the panelists share their closing thoughts, emphasizing the importance of collaboration and sharing information within the proctoring industry. They each provide their contact information and company websites, inviting attendees to reach out for more information or to collaborate. The webinar organizer thanks the panelists and attendees for their participation, wrapping up the discussion on a positive note.

Keywords

Remote Proctoring

Remote proctoring refers to the supervision of exams or tests taken by students outside of a traditional testing center, using digital tools and technologies. It is pivotal in ensuring the integrity of online assessments. In the video, various remote proctoring methods are discussed, such as live human proctoring and AI-based proctoring, to prevent and detect cheating in high-stakes exams like medical certifications.

Live Human Proctoring

Live human proctoring is a method where a real person monitors the examinee during an exam through webcams and other technologies. It adds a personal touch and can provide immediate intervention if any suspicious activity is detected. The script mentions Monitor EDU, an organization that works with high-stakes exams and utilizes live human proctoring, requiring examinees to interact with a live proctor and show their ID before starting the exam.

AI-Based Proctoring

AI-based proctoring employs artificial intelligence to monitor examinees during exams. It uses technologies like biometrics, object detection, and behavior analysis to deter and detect cheating. Rivera from Zumani explains how Samadhi, an AI-based proctoring service, uses facial recognition, typing pattern recognition, and other AI tools to ensure the examinee's identity and prevent cheating during the exam.

Biometrics

Biometrics in the context of remote proctoring involves the use of unique personal characteristics, such as facial recognition, to verify the identity of the examinee. It is a key component in preventing impersonation during online exams. The script discusses how Samadhi uses AI-based biometric identification to ensure that the person taking the exam is the same person who is supposed to take it.

Multi-Factor Authentication

Multi-factor authentication is a security process that requires more than one method of verification from independent categories of credentials to verify the user's identity for a login or transaction. In the script, it is mentioned that Samadhi uses multi-factor authentication methods, including facial recognition and typing pattern recognition, to authenticate students before they begin their exams.

Cheating Deterrence

Cheating deterrence refers to the measures and strategies put in place to discourage or prevent examinees from cheating during exams. The video discusses various techniques used by proctoring services to deter cheating, such as constant facial recognition checks, environment validation, and monitoring for suspicious behavior.

Lockdown Browser

A lockdown browser is a customized browser used for online testing that restricts the functionality of the device to prevent cheating. It blocks other applications and internet access during an exam. The script mentions that both live human proctoring and AI-based proctoring services use lockdown browsers to ensure that examinees cannot access unauthorized materials during the exam.

Two-Camera Solution

The two-camera solution is a method where examinees use two devices with cameras to provide a comprehensive view of the testing environment. One camera focuses on the examinee's face, while the second camera provides a wider view of the room. This method is used by live human proctoring services like Monitor EDU to ensure a fair and secure testing environment.

Object Detection

Object detection is a technology that allows AI systems to identify and classify objects within an image or video. In the context of remote proctoring, object detection is used to scan the examinee's environment for unauthorized materials or additional people. The script describes how Samadhi's AI system uses object detection to validate the exam environment and flag any suspicious objects.

Scalability

Scalability refers to the ability of a system, network, or process to handle a growing amount of work, or its potential to be enlarged to accommodate that growth. In the video, Samadhi's executive director mentions the service's scalability, highlighting its capacity to supervise a large number of exams simultaneously, leveraging cloud infrastructure for efficient exam monitoring.

Data Retention Policy

A data retention policy is a strategy for managing the lifecycle of data in an organization from its creation, use, and eventual deletion. In the script, there is a discussion on the importance of balancing security needs with privacy considerations, mentioning that proctoring services must adhere to data retention policies and comply with international data protection regulations like GDPR.

Highlights

Webinar discusses remote proctoring methods to prevent and detect cheating in online exams.

Monitor EDU specializes in live human proctoring for high-stakes exams like medical certifications.

Live proctoring involves identity verification through ID cards and room inspections.

Dual camera systems provide comprehensive monitoring of the examinee and their environment.

Samadhi offers AI-based proctoring services with a focus on scalability and security.

AI proctoring uses biometrics like facial recognition to authenticate student identity.

Multi-factor authentication methods are employed, including typing and voice recognition.

AI can detect suspicious behavior and cheating tactics by monitoring student actions and environment.

Lockdown browsers prevent students from accessing unauthorized applications during exams.

Exam proctoring software can supervise thousands of exams simultaneously, leveraging cloud infrastructure.

Live proctors can intervene in real-time to address cheating or rule violations.

High-stakes exams often require a human element for assurance and intervention.

Examples of creative cheating methods discussed, including using a VPN and hidden answer sheets.

AI proctoring can detect unusual behaviors, such as a student looking up at an answer sheet on the roof.

Students have attempted to use second monitors and virtual machines to cheat in exams.

Proctoring solutions must balance security needs with privacy concerns and compliance with data protection laws.

Different retention policies for exam data are implemented based on client requirements and compliance standards.

Clients are concerned about test security, exam rule adherence, and ensuring the right person takes the exam.

Support for students during exams is crucial to ensure they can use proctoring tools effectively and address any issues.

Mobile phones are currently used as secondary devices for proctoring but not for taking exams due to limitations.

The future of proctoring may include mobile devices as technology evolves and allows for multitasking on phones.