Webpage Overview
Problem
Currently, frontliners need to physically take the PVT test in the HTX Cognitive Lab under the supervision of a cognitive scientist regardless of their duty. This means that there is no way for the PVT test to be done on-site, at the location of their duty. Additionally, the cognitive scientist has to manually observe and note down any user distractions as there is no way of tracking user distractions. Below are the current user journeys of both the frontliner and the cognitive scientist.
After the PVT test, cognitive scientists have to manually filter and clean each test’s data before moving on to analysing it. This whole journey is inconvenient, labour intensive, and inefficient. Furthermore, cognitive states of frontliners on duty will not be able to be assessed.
With these limitations in mind, we discovered the main pain points of our users:
- Cognitive scientist needed to monitor officer’s behaviour and surroundings
- Difficulty in cleaning data and promptly interpreting results
With these pain points in mind, we then went on to create our problem statement.
Our Problem Statement
"How might we develop a portable PVT solution to accurately assess the cognitive state of Home Team officers in real-world environments?"
Our Solution
Guided by our problem statement, Cog Lab PVT was created.
A portable lab-grade PVT test with enhanced features such as gaze and audio decibel level detection to ensure greater result accuracy!
Take a look at how our app looks like below:
With the Cog Lab PVT app, frontliners can now do the PVT test anywhere, anytime on the go! Furthermore, cognitive scientists no longer have to manually track user distractions and are now able to analyse and form insights from test data quickly thanks to the additional features on the app and Tableau!
New Features
While the user is taking the test, our software will be keeping track of where their eyes are looking to determine if he/she is distracted
This features allow HTX to track the audio decibel level throughout to determine if a slow reaction time or false start was caused by any sudden loud noise.
Tableau Dashboard
To summarise, with the help of Cog Lab PVT, frontliners can now take the PVT test at any time before, during or after their shift, better reflecting the impact that their rest cycle has on their cognitive states during duty. Additionally, the gaze and audio decibel level detection features will aid the post-test data analysis by pick up any distractions and flagging out data points where the reaction time is not within the threshold. All these will be reflected in the final dashboard for the cognitive scientist.
The main dashboard would show the minute by minute average reaction times of each participant throughout the test, alongside the average audio decibel level below it. Other relevant information such as subject information, indicators for false starts and trial lapses, as well as gaze detection data (to tell if participant is looking at the phone when the stimulus appears)can be found on the right hand side of the dashboard. This will make it easier for the cognitive scientist to compare and see if any lapses or the lack of concentration may be due to any audio distractions.
By hovering the pointer over each data point, the individual reaction time for each trial used in the minute average calculation will be displayed, giving the cognitive scientist a better understanding of the performance of the participant. This function can be seen below.
The secondary dashboard shows the individual stimulus response time of the selected participant. This will allow HTX to conduct a more in-depth analysis of the participant’s performance as they can see information on each individual stimulus reaction. The dashboard flags out any trial lapses and highlights them on the graph, as well as display information regarding the number and percentage of lapses.
When we hover the pointer over each datapoint, the dashboard will display additional important information such as the audio decibel level during that specific stimulus. This function can be seen in the video below.
At the end of the day, Cog Lab PVT makes it convenient for both frontliners and cognitive scientists to do the PVT test and analyse data respectively. Their new user journeys can be seen below.
Overall Systems Architecture
The system integrates multiple subsystems into a seamless, end-to-end solution. The client app follows a Model-View-Controller (MVC) architecture, ensuring efficient data flow and user interaction. The backend operates on a secure, serverless Google Cloud infrastructure, incorporating authentication, API management, and automated malware scanning for uploaded video files. Processed data is securely stored and analysed using Tableau Data Analytics, providing valuable insights. This architecture ensures a scalable, resilient, and secure cloud-based solution.Â
Data Analysis Pipeline
Overview
Audio Decibel Cleaning
Gaze Detection Cleaning
Data Output Merging
Acknowledgement
We would like to thank Jennifer, Juliana, Xue Yi and HTX for their patience and guidance through our capstone journey and for being such excellent industry mentors to us! A special thank you to SUTD as well for helping us throughout the project!
