CN113034852A - Image processing technology-based crew physiological recorder interactive working system - Google Patents
Image processing technology-based crew physiological recorder interactive working system Download PDFInfo
- Publication number
- CN113034852A CN113034852A CN202110302639.5A CN202110302639A CN113034852A CN 113034852 A CN113034852 A CN 113034852A CN 202110302639 A CN202110302639 A CN 202110302639A CN 113034852 A CN113034852 A CN 113034852A
- Authority
- CN
- China
- Prior art keywords
- crew
- physiological
- duty
- module
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention provides an interactive working system of a physiological recorder for a crew based on an image processing technology. The system can select the optimal working time point of the physiological recorder according to personal database information and duty task state of a crew, then transmits crew data to the data processing end in real time, analyzes and timely feeds back physiological information at the data processing end, and improves effectiveness of data recorded by the crew physiological recorder and safety of ship navigation.
Description
Technical Field
The invention relates to the field of safe navigation of ships, in particular to the field of human-induced interactive safe navigation of ships.
Technical Field
Shipping is now an important mode of transportation and travel. The ship navigation safety system is a complex system consisting of four factors of people, ships, environment and management, and people are the core factor in the safety system. Most of recorders for monitoring physiological changes of crews can only realize the function of recording data, cannot realize the functions of monitoring physiological state changes of crews in real time and feeding back real-time monitoring results, and the existing physiological recorders have repeated and redundant recorded data and cannot realize targeted data recording and analysis aiming at specific states of crews.
The invention provides an interactive working system of a crew physiological recorder based on an image processing technology, which can judge whether the current state of a crew affects the normal duty according to the body posture position and time when the crew executes the duty operation instruction on the basis that a ship driving platform is provided with a monitoring video system, further adopt signals such as a warning signal and the like, stop the state and the behavior affecting the normal duty of the crew, reduce the man-made error of the crew, reduce the accident loss and improve the shipping safety level.
Disclosure of Invention
The invention provides an interactive working system of a crew physiological recorder based on an image processing technology, which has the following specific scheme:
the interactive working system of the physiological recorder for the crew based on the image processing technology comprises an image processing module, a physiological recorder working module and a data processing end, and is characterized in that the image processing module analyzes pictures acquired by a monitoring system on a ship driving platform, triggers the physiological recorder working module to send a working signal for starting the physiological recorder and simultaneously transmits data to the data processing end in real time, and the physiological recorder working module receives the processed information and makes a warning signal for the crew on duty.
Further, the image processing module comprises crew operation instruction completing position information and a crew body state posture analysis model, and the crew operation instruction completing position information is obtained by analyzing whether the crew reaches an operation instruction completing designated position in a monitoring video picture; the analysis model for the physical state and posture of the crew judges whether the crew can normally perform duty or not by analyzing the physical posture of the crew in the video picture.
Further, the operation instruction position information stores position information of a crew who finishes an operation instruction on duty, and when the crew in the monitoring picture does not reach a specified position and finishes the operation instruction on duty, the physiological recorder working module is triggered to send out a warning.
Further, an autonomous learning model is stored in the position information of the crew completing operation instruction, and the autonomous learning model can automatically update and complete whether a crew arrives at the current operation instruction position and completes the instruction.
Furthermore, the image processing module is provided with a physical state and posture analysis model of the crew. According to the area of the crew duty position, determining the time t when the video monitoring detects that the crew duty is at the duty node1The time for keeping the same body posture state by the crew on duty is t2And determining that the time interval of the crew on duty leaving the duty position is delta t, and judging and triggering a working instruction in a working module of the physiological recorder.
Furthermore, the working module of the physiological recorder comprises a working module of the triggering physiological recorder, a real-time recording transmission module, a data processing result receiving module and an alarm module, wherein the working module of the triggering physiological recorder is used for starting a working instruction of the physiological recorder, the real-time recording transmission module is used for recording physiological data of a crew and transmitting the physiological data to the data processing end in real time, the data processing receiving module is used for receiving a feedback result of the data processing end, and the alarm module is used for giving a warning signal to the crew on duty according to the feedback result of the data processing end.
Furthermore, the data processing end comprises a physiological data storage end and a physiological data processing feedback end, and data transmitted in real time based on the working module of the physiological recorder for physiological recording is stored in the physiological data storage section. The physiological data feedback end judges the state of the current on-duty driver based on real-time data of the crew, the on-duty time of the crew, normal physiological data of the crew, physiological data of the crew in fatigue and sleeping physiological data of the crew.
Furthermore, each module in the working system is provided with an automatic updating model, and the working system determines whether to give a warning signal to the crew on duty according to the result of the data processing end.
Furthermore, an alarm is arranged on the working module of the physiological recorder, and can give a warning signal to a crew on duty.
Furthermore, the number of the monitoring cameras in the monitoring system in the ship bridge is determined according to the number of the crew on duty.
By using the interactive working system, the problem of timeliness of detecting the on-duty state and behavior of the crew during the on-duty process of the ship bridge is solved, and meanwhile, the alarm of the overall decision-making module of the physiological recorder can give the crew the suspension of unsafe behavior and state.
Drawings
FIG. 1 is a schematic view of the interactive working system of the physiological recorder for the crewman based on image processing technology
FIG. 2 is a data flow diagram of the interactive working system of the physiological recorder for the crewman based on image processing technology
Detailed Description
As shown in fig. 1, in an embodiment of the present invention, the interactive work system of the crew physiological recorder is configured with a video monitoring system in the ship's bridge.
A shipman wears a physiological recorder and enters a ship driving platform, and the monitoring camera collects real-time pictures and works according to the functions of the monitoring system. And when the monitoring video acquires the action posture and the position information of the crew, the action posture and the position information are sent to the image processing module.
The crew is on the ship bridge and needs to complete some instructions in the process of sailing on duty, and the instructions need the crew on duty to move to the designated position for completion. And the image processing module is provided with position information of the crew completing operation instructions. And when the on-duty crew needs to finish the instruction transmitted in the ship driving platform, judging whether the on-duty crew reaches the designated position or not, and finishing the operation instruction. When an operation instruction is issued, the recorder interactive working system selects a video picture segment with the duration of 1 minute, extracts a position image of a designated area in the video picture, and a crew finishes whether the crew on duty reaches the designated position through analysis in the operation instruction position information, and if the crew on duty does not detect the occurrence of the crew on duty in the designated area within 1 minute, the physiological recorder working signal module is triggered to send an alarm signal working instruction.
The position information of the crew completing operation instruction is stored with an autonomous learning model, the autonomous learning model can automatically update and complete whether the crew arrives at the current operation instruction position and complete the instruction, and if the image processing module detects that the crew arrives at the designated position, the image processing module does not trigger the physiological recorder working signal module to send out an alarm signal working instruction.
The crew on duty has a long time on duty, and the duty environment is single and boring. The image processing module is provided with a physical state and posture analysis model of the crew. According to the area of the crew duty position, determining the time t when the video monitoring detects that the crew duty is at the duty node1The time for keeping the same body posture state by the crew on duty is t2And determining the time interval of the crew on duty leaving the duty position as delta t.
The working logic thought of triggering the working signal module of the physiological recorder is that when t is1<0, judging that the crew on duty is not on duty, triggering an alarm signal in a working signal module of the physiological recorder, and reporting to a captain duty room; when t is2>t1And t is2>Triggering a physiological recorder recording module to be started in a physiological recorder working signal module when the time is 5 minutes; when Δ t is reached>And when 10 minutes, recording that the crew on duty leaves the duty for a long time, triggering an alarm signal in a working signal module of the physiological recorder, and reporting to a captain duty room.
The physiological data volume of the crew on duty is huge, and the storage space of the physiological recorder is limited. Only when the physiological recorder working module receives a signal sent by the crew body state posture model in the image processing module, the physiological recorder is triggered to start the work of recording the physiological data of the crew, so that the physiological recorder can record the current physiological state data of the crew in a targeted manner.
The physiological recorder that the crewman wore all is furnished with the serial number, and the physiological recorder adopts the bluetooth to be connected with data processing end. And triggering the working module of the physiological recorder, starting a data recording working instruction, sending a Bluetooth signal to the data processing end, and connecting the data processing end with the Bluetooth signal.
And when the data processing end is successfully connected with the physiological recorder of the crew, the physiological recorder starts to transmit data to the data processing end in real time. Meanwhile, when the Bluetooth signal is numbered according to the received physiological recorder, the crew database can be accessed, and the personal information of the crew wearing the physiological recorder with the current number, including the age, the age of the crew, the real-time duty time, the duty condition, the normal physiological data, the fatigue physiological data and the sleep physiological data of the crew, can be acquired.
After the data are received, the data processing end carries out data processing on the acquired physiological data, the real-time processed physiological data result is compared with the accessed information in the database of the sailor, and the physiological data processing feedback module of the data processing end feeds the real-time data processing result back to the physiological recorder overall decision making end. And if the real-time data processing result is matched with the physiological fatigue data of the crew in the database, giving a warning signal to the crew and reporting to the captain's duty room.
The interactive work system of the image processing technology-based physiological recorder for the crew provided by the invention is described in detail, the principle and the implementation mode of the invention are explained by applying specific examples, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, there are modifications in the specific embodiments according to the idea of the present invention, and the content of the present specification should not be construed as a limitation to the technical solution of the present invention.
Claims (10)
1. The interactive working system of the physiological recorder for the crew based on the image processing technology comprises an image processing module, a physiological recorder working module and a data processing end, and is characterized in that the image processing module analyzes pictures acquired by a monitoring system on a ship driving platform, the physiological recorder working module sends a working signal for starting the physiological recorder and simultaneously transmits data to the data processing end in real time, and the physiological recorder working module receives the processed information and makes a warning signal for the crew on duty.
2. The image processing technology-based interactive work system of the physiological recorder of the crew, according to claim 1, is characterized in that the image processing module comprises crew completion operation instruction position information and a crew body state and posture analysis model, wherein the crew completion operation instruction position information is used for analyzing and monitoring whether the crew reaches a specified position of the completion operation instruction in a video picture; the analysis model for the body state and posture of the crew judges whether the crew can normally carry out duty or not by analyzing the body posture of the crew on the duty position in the video picture.
3. The image processing technology-based crew physiological recorder interactive working system according to claim 1, wherein the physiological recorder working module comprises a triggering physiological recorder working signal module and a real-time recording transmission module, the triggering physiological recorder working signal module is used for starting a physiological recorder working instruction, including starting to record data and sending an alarm signal, and the real-time recording transmission module is used for recording crew physiological data and transmitting the crew physiological data to the data processing end in real time.
4. The interactive work system of the physiological recorder based on image processing technology as claimed in claim 2, wherein the position information of the crew's operation instruction completion stores the area position information of the crew who finishes the operation instruction on duty, and when the crew in the monitoring screen does not reach the designated area position and finishes the operation instruction on duty, the position information of the crew's operation instruction completion triggers the physiological recorder work module to send out an alarm signal.
5. The image processing technology-based crew physiological recorder interactive working system according to claim 4, wherein the crew completing operation instruction position information is stored with an autonomous learning model, and the autonomous learning model can automatically update whether a crew arrives and completes the instruction at the current operation instruction position.
6. The image processing technology-based interactive work system for a physiological recorder of a crew as claimed in claim 2, wherein the analysis model of the physical state and posture of the crew stores the position information of the crew duty area and the data set of the human body movement, when the crew duty area in the monitoring video identifies the crew, the video monitoring detects that the crew duty is at the crew node time t1The time for keeping the same body posture state by the crew on duty is t2And triggering the working module of the physiological recorder when the time interval of the crew on duty leaving the duty position is delta t.
7. The interactive work system for the physiological recorder based on image processing technology as claimed in claim 1, wherein the data processing end comprises a physiological data storage module and a physiological data processing feedback module, and data transmitted in real time based on the physiological recorder work module is stored in the physiological data storage section. The physiological data feedback end judges the state of the current on-duty driver based on real-time data of the crew, the on-duty time of the crew, normal physiological data of the crew, physiological data of the crew in fatigue and sleeping physiological data of the crew.
8. The interactive work system for physiological recorders of crew based on image processing technology as claimed in any one of claims 7 or 8, wherein each module in the work system has an autonomous updating model, and the work system determines whether to give warning signal to crew on duty according to the result of the data processing end.
9. The image processing technology-based crew physiological recorder interactive working system according to claim 1, wherein an alarm is arranged on the physiological recorder working module, and can give warning signals to crew on duty.
10. The interactive work system for physiological recorders based on image processing technology as claimed in claim 1, wherein the number of monitoring cameras in the cabin duty cab monitoring system is determined according to the number of duty crews, and the alarm signals of the physiological recorders are all sent to the captain duty cab.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110302639.5A CN113034852A (en) | 2021-03-22 | 2021-03-22 | Image processing technology-based crew physiological recorder interactive working system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110302639.5A CN113034852A (en) | 2021-03-22 | 2021-03-22 | Image processing technology-based crew physiological recorder interactive working system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113034852A true CN113034852A (en) | 2021-06-25 |
Family
ID=76472290
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110302639.5A Pending CN113034852A (en) | 2021-03-22 | 2021-03-22 | Image processing technology-based crew physiological recorder interactive working system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113034852A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116597427A (en) * | 2023-07-18 | 2023-08-15 | 山东科技大学 | Ship driver's cab identity recognition method based on deep learning |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104021653A (en) * | 2014-06-12 | 2014-09-03 | 孔秀梅 | Crossing on-duty status video analysis and warning system and method |
| CN104887207A (en) * | 2015-06-05 | 2015-09-09 | 武汉理工大学 | Ship conduction system on basis of internet of things |
| CN110522426A (en) * | 2019-09-05 | 2019-12-03 | 大连海事大学 | A kind of ship personnel behavior intelligent monitor system based on multisensor |
| CN210093375U (en) * | 2019-04-18 | 2020-02-18 | 兰州交通大学 | Monitoring and alarming system for driver on-duty state of ship bridge |
| US20210059543A1 (en) * | 2019-08-28 | 2021-03-04 | Giga-Byte Technology Co., Ltd. | Human condition detecting device |
-
2021
- 2021-03-22 CN CN202110302639.5A patent/CN113034852A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104021653A (en) * | 2014-06-12 | 2014-09-03 | 孔秀梅 | Crossing on-duty status video analysis and warning system and method |
| CN104887207A (en) * | 2015-06-05 | 2015-09-09 | 武汉理工大学 | Ship conduction system on basis of internet of things |
| CN210093375U (en) * | 2019-04-18 | 2020-02-18 | 兰州交通大学 | Monitoring and alarming system for driver on-duty state of ship bridge |
| US20210059543A1 (en) * | 2019-08-28 | 2021-03-04 | Giga-Byte Technology Co., Ltd. | Human condition detecting device |
| CN110522426A (en) * | 2019-09-05 | 2019-12-03 | 大连海事大学 | A kind of ship personnel behavior intelligent monitor system based on multisensor |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116597427A (en) * | 2023-07-18 | 2023-08-15 | 山东科技大学 | Ship driver's cab identity recognition method based on deep learning |
| CN116597427B (en) * | 2023-07-18 | 2023-10-20 | 山东科技大学 | Ship driver's cab identity recognition method based on deep learning |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106335432B (en) | Intelligent back vision mirror, control system and processing method with driving auxiliary system | |
| US10370012B2 (en) | Adaptive vehicle control system | |
| US8164464B2 (en) | Method and system of aircraft pilot assessment | |
| JP7273031B2 (en) | Information processing device, mobile device, information processing system and method, and program | |
| CN109528219A (en) | System for monitoring operation person | |
| CN106218405A (en) | Fatigue driving monitoring method and cloud server | |
| CN103978977A (en) | System and method for monitoring automobile based on body communication | |
| US20200242343A1 (en) | Method of assessing a pilot emotional state | |
| CN103839379A (en) | Automobile and driver fatigue early warning detecting method and system for automobile | |
| CN112734985B (en) | Vehicle door control method, device, equipment, terminal and readable storage medium | |
| CN110281944A (en) | Driver status based on multi-information fusion monitors system | |
| CN110525456A (en) | A kind of train safe driving monitoring system and method | |
| WO2009066109A1 (en) | Fatigue monitoring and intruder alert system | |
| CN111645694B (en) | Driver driving state monitoring system and method based on attitude estimation | |
| CN111311051A (en) | Aircraft and method for regulating the workload of a pilot | |
| CN113034852A (en) | Image processing technology-based crew physiological recorder interactive working system | |
| CN205722310U (en) | A kind of train driver Activity recognition system based on video sequence | |
| CA3132496A1 (en) | Mitigating operational risk in aircraft | |
| CN117542027A (en) | Unit disabling state monitoring method based on non-contact sensor | |
| CN109305039A (en) | A kind of safe driving monitoring system and method | |
| CN109308802A (en) | Abnormal vehicles management method and device | |
| CN107610495A (en) | Drive responsibility and determine method, data backup device, judgement system and carrier | |
| US11738763B2 (en) | Fatigue monitoring system for drivers tasked with monitoring a vehicle operating in an autonomous driving mode | |
| CN115793682A (en) | Bridge intelligent inspection method and inspection system based on unmanned aerial vehicle | |
| KR102528032B1 (en) | Method and system for checking fatigue of pilot before flying |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210625 |