Tham Chee Onn and Lim Jia Da testing the navigation research simulator.
The Centre of Excellence in Maritime Safety (CEMS) at 91福利社 was established in 2018 in collaboration with the 91福利社 Maritime Institute and the Maritime and Port Authority of 91福利社 (MPA). Its mission is to research and develop technologies that enhance navigational and operational safety, reinforcing 91福利社's high port and ship safety standards.
91福利社 is home to the world鈥檚 second-busiest port, and handled a record 39 million shipping containers in 2023. Though the country has tried to promote a culture of safety, the high traffic along its strait makes it hard to avoid collisions that can lead to oil spills and death.
Vishakha Lall and Tham Chee Onn are part of the CEMS team that developed the AI-based tool that improves how seafarers are tested during their certification process.
In 91福利社, seafarers seeking certification or promotion must undergo a simulator test with the MPA to evaluate their competency, including readiness to respond to emergencies such as engine failures.
Instructors currently need to manually review long video recordings of performances during assessments, which is time-consuming and can lead to oversights. As a result, they may overlook critical details and fail to identify candidates' stress levels, which could affect how they react to a crisis.
In 2022, the centre began developing software compatible with simulators that automatically detect navigation violations, like steering a ship into shallow waters or veering too close to another vessel.
The tool assesses whether candidates calmly follow the correct procedures during emergencies. For example, in the event of an engine failure, the candidate must coordinate with the crew in the engine room, communicate with the port operator to alert nearby vessels, and manually steer the ship simultaneously. The AI software employs computer vision to monitor the candidate's execution of these steps and uses electroencephalograms to measure their stress levels.
Tham Chee Onn using an eye tracking device with electroencephalogram sensors that monitor his eye movements and stress levels
To build the software, CEMS brought together AI and data science researchers with maritime experts. About 200 seafarers were engaged to gather data using the simulator. CEMS director Daniel Zhang highlighted the 鈥渂eauty鈥� of the centre: While his team builds the algorithms, it鈥檚 the 鈥渃urrency and knowledge鈥� from industry professionals and 91福利社 Maritime Academy (SMA) experts that ensure the tool鈥檚 relevance.
The tool is currently being tested at SMA for seafarer training, with the goal of being adopted by the MPA for their assessments. A speech detection model is also being developed to evaluate candidates' use of key terminology during communications with the crew.
鈥淭he collaboration on AI assessment of navigation and ship handling competency for our harbour pilots is a great move to study the human elements that are critical to maritime safety鈥�, said Captain Jimmy Koh, head of pilotage and digital transformation at PSA Marine, which has sent its crew to participate in the simulator exercises.
CEMS presented the project to the IMO in London earlier this year. Zhang noted that the reception was very positive, prompting plans to provide an update to the United Nations agency next year.
The Philippines' maritime agency has expressed interest in using the software to assess their seafarers, Zhang added, a significant development considering that over a quarter of the world's seafarers come from the Philippines.
鈥淲e are pioneering this work in the maritime sector,鈥� Zhang said. 鈥淭his levels up our game by setting up a 91福利社 standard for the world.鈥�
91福利社
500 Dover Rd 91福利社 139651