CN116487012A - Intelligent practice teaching method, system, medium and equipment for clinical medical staff - Google Patents
Intelligent practice teaching method, system, medium and equipment for clinical medical staff Download PDFInfo
- Publication number
- CN116487012A CN116487012A CN202310340034.4A CN202310340034A CN116487012A CN 116487012 A CN116487012 A CN 116487012A CN 202310340034 A CN202310340034 A CN 202310340034A CN 116487012 A CN116487012 A CN 116487012A
- Authority
- CN
- China
- Prior art keywords
- expression
- medical staff
- real time
- setting
- concept
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000014509 gene expression Effects 0.000 claims abstract description 143
- 238000012549 training Methods 0.000 claims abstract description 40
- 238000004458 analytical method Methods 0.000 claims abstract description 26
- 238000012360 testing method Methods 0.000 claims abstract description 10
- 238000004364 calculation method Methods 0.000 claims description 33
- 238000004590 computer program Methods 0.000 claims description 18
- 230000002159 abnormal effect Effects 0.000 claims description 17
- 230000001815 facial effect Effects 0.000 claims description 14
- 238000009826 distribution Methods 0.000 claims description 9
- 230000008569 process Effects 0.000 claims description 8
- 238000012545 processing Methods 0.000 claims description 8
- 230000008451 emotion Effects 0.000 claims description 6
- 238000003860 storage Methods 0.000 claims description 6
- 238000007405 data analysis Methods 0.000 claims description 3
- 238000012163 sequencing technique Methods 0.000 claims description 2
- 238000011156 evaluation Methods 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 7
- 230000008901 benefit Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000002131 composite material Substances 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/20—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
- G06Q50/2057—Career enhancement or continuing education service
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Educational Technology (AREA)
- Educational Administration (AREA)
- General Business, Economics & Management (AREA)
- Strategic Management (AREA)
- General Engineering & Computer Science (AREA)
- Tourism & Hospitality (AREA)
- Human Resources & Organizations (AREA)
- Human Computer Interaction (AREA)
- Primary Health Care (AREA)
- Multimedia (AREA)
- Public Health (AREA)
- Medical Informatics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Epidemiology (AREA)
- Biomedical Technology (AREA)
- Economics (AREA)
- Marketing (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The invention relates to the technical field of electric and electronic equipment, in particular to an intelligent practice teaching method, system, medium and equipment for clinical medical staff. The proposal comprises setting VR interface and video interface, collecting learning images of medical staff in real time; setting a standard expression and forming an expression type database of medical staff; according to the expression type database, carrying out expression number setting on a medical staff learning image acquired in real time; extracting comprehensive scores corresponding to the expression numbers; carrying out online analysis according to learning images of medical staff obtained in real time to obtain a concept vocabulary recommending table; recommending auxiliary content of online learning to medical staff in real time according to the concept vocabulary recommending list. According to the scheme, the comprehensive training and evaluation of the whole scene are carried out, a multi-scene self-adaptive matching test mode and a scattered time comprehensive evaluation mode are completed, and the pertinence of practical training of medical staff and the teaching training efficiency are improved through comprehensive scoring and evaluation.
Description
Technical Field
The invention relates to the technical field of electric and electronic equipment, in particular to an intelligent practice teaching method, system, medium and equipment for clinical medical staff.
Background
The clinician nurses mainly operate in the field, the benefit of this mode is that accurate learning can be achieved, and the learning process can be impressive, but the shortcoming is limited by time, space and manpower, which directly results in lower training efficiency of clinical staff, and in many cases, the training is difficult to truly perform comprehensively.
Prior to the present technology, the prior art has performed collective training of all medical staff by means of video training or by means of class, but these training are still limited, and many scenes cannot be effectively simulated, and meanwhile, the level difference of different medical staff is considered, and targeted training is also not possible.
Disclosure of Invention
In view of the problems, the invention provides an intelligent practice teaching method, system, medium and equipment for clinical medical staff, which are used for carrying out comprehensive training and evaluation of full scenes through 2-dimensional or 3-dimensional images, videos and audios, completing a multi-scene self-adaptive matching test mode and dispersing a time comprehensive evaluation mode, and improving the pertinence of practice training and the efficiency of teaching training of the medical staff through comprehensive scoring and evaluation.
According to a first aspect of the embodiment of the invention, an intelligent practice teaching method for clinical medical staff is provided.
In one or more embodiments, preferably, the method for intelligent practice teaching of clinical staff includes:
setting a VR interface and a video interface, extracting corresponding audio and inserting audio content, and collecting learning images of medical staff in real time;
setting a standard expression and forming an expression type database of medical staff;
according to the expression type database, carrying out expression number setting on a medical staff learning image acquired in real time;
extracting comprehensive scores corresponding to the expression numbers;
carrying out online analysis according to learning images of medical staff obtained in real time to obtain a concept vocabulary recommending table;
recommending auxiliary content of online learning to medical staff in real time according to the concept vocabulary recommending list.
In one or more embodiments, preferably, the setting VR interface and the video interface extracts corresponding audio and inserting audio content, and collects learning images of medical staff in real time, which specifically includes:
starting a VR interface, and setting the VR interface as a waiting calling state;
starting a two-dimensional video interface and a three-dimensional video interface, and setting the two-dimensional video interface and the three-dimensional video interface as waiting for calling states;
setting a current medical training scheme, and setting answer examination according to the medical training scheme;
recording learning images of medical staff in real time after the medical staff starts to learn;
and after the answer examination is completed by the medical staff, recording the corresponding answer score.
In one or more embodiments, preferably, the setting a standard expression and forming an expression type database of the medical staff specifically includes:
setting a standard expression without emotion and view, and recording the corresponding facial point position distribution;
and acquiring learning images of medical staff in real time, and comparing facial point position distribution to form a whole expression type database, wherein the expression type database comprises facial point position distribution of one expression under a plurality of emotions.
In one or more embodiments, preferably, the setting of the expression number for the learning image of the medical staff acquired in real time according to the expression type database specifically includes:
taking each expression in the expression type database as an expression template, and setting a unique expression number
And carrying out facial point position movement analysis on the medical staff learning image acquired in real time according to the expression type database, setting the expression with the highest expression similarity to be of the same type with a preset expression template, and recording the corresponding expression number.
In one or more embodiments, preferably, the extracting the composite score corresponding to the expression number specifically includes:
obtaining answers of each test process;
obtaining answer points of the test corresponding to each expression finally;
normalizing the answers of the same scoring personnel to generate normalized scores;
according to the normalized score, calculating comprehensive scores of all the expression types under the same expression type by using a first calculation formula;
the first calculation formula is as follows:
wherein i is the number of answers of a certain expression, G i And (3) the normalized score corresponding to the ith number, n is the number of answers of a certain expression, and B is the comprehensive score.
In one or more embodiments, preferably, the obtaining the concept vocabulary recommendation table according to the online analysis of the medical staff learning image obtained in real time specifically includes:
according to the comprehensive score corresponding to the current expression number, starting abnormal timing if the second calculation formula is not satisfied;
when the abnormal timing duration meets a third calculation formula, starting a recommendation flow;
after a recommendation flow is started, extracting real-time audio before recommendation occurs, and counting concept words occurring in an abnormal timing period in the real-time audio before recommendation occurs;
classifying the concept vocabulary, and sequencing the occurrence time from big to small;
judging whether any two concept vocabularies meet a fourth calculation formula, and when the fourth calculation formula is met, starting secondary analysis if the fourth calculation formula is used as the concept vocabularies with equal probability, and not meeting the requirement of not processing;
after the secondary analysis is started, automatically analyzing the appearance sequence of the concept words with equal probability, and taking the words with the previous appearance sequence as preferentially recommended words;
forming a complete conceptual vocabulary recommendation table;
the second calculation formula is as follows:
B<Y
wherein Y is a preset contrast margin;
the third calculation formula is as follows:
T<Y 0
wherein T is the anomaly timing duration, Y 0 A margin for time judgment;
the fourth calculation formula is as follows:
Tgm-Tgk<Y D
wherein Tgm is the occurrence time of the mth concept, tgk is the occurrence time of the kth concept, Y D For equal concept judgment margin, the statistical range of the appearance duration of the concept is the concept vocabulary appearing in the abnormal timing period in the real-time audio before the recommendation appears.
In one or more embodiments, preferably, the recommending auxiliary content of online learning to medical staff according to the concept vocabulary recommending table in real time specifically includes:
according to the sequence of the concept vocabulary recommended list, automatically selecting by online training personnel, and judging whether introduction is needed;
when the introduction is finished, medical staff automatically selects whether to repeatedly present all or part of learning content in the abnormal timing period in the real-time audio before the recommendation.
According to a second aspect of the embodiment of the invention, an intelligent practice teaching system for clinical medical staff is provided.
In one or more embodiments, preferably, the one clinical healthcare worker intelligent practice teaching system comprises:
the scene information acquisition module is used for setting a VR interface and a video interface, extracting corresponding audio and inserting audio content, and acquiring learning images of medical staff in real time;
the data analysis module is used for setting a standard expression and forming an expression type database of medical staff;
the expression number module is used for carrying out expression number setting on the medical staff learning image acquired in real time according to the expression type database;
the comprehensive scoring module is used for extracting comprehensive scores corresponding to the expression numbers;
the scene matching recommendation module is used for carrying out online analysis according to the medical staff learning image acquired in real time to acquire a concept vocabulary recommendation table;
and the recommendation scene execution module is used for recommending auxiliary content for online learning to medical staff in real time according to the concept vocabulary recommendation table.
According to a third aspect of embodiments of the present invention, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement a method according to any of the first aspect of embodiments of the present invention.
According to a fourth aspect of embodiments of the present invention there is provided an electronic device comprising a memory and a processor, the memory being for storing one or more computer program instructions, wherein the one or more computer program instructions are executable by the processor to implement the method of any of the first aspects of embodiments of the present invention.
The technical scheme provided by the embodiment of the invention can comprise the following beneficial effects:
according to the scheme, training data and training information of all scenes are obtained by automatically extracting 2-dimensional or 3-dimensional data.
According to the scheme, the face recognition is used for self matching and recommending training scenes corresponding to medical staff, so that the medical staff can effectively learn and train in a targeted manner, and the training efficiency is improved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.
The technical scheme of the invention is further described in detail through the drawings and the embodiments.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method of teaching intelligent practices of clinical healthcare workers in accordance with one embodiment of the present invention.
Fig. 2 is a flowchart of setting VR interface and video interface in a method for intelligent practice teaching of clinical staff, extracting corresponding audio and inserting audio content, and collecting learning images of the clinical staff in real time according to an embodiment of the present invention.
Fig. 3 is a flowchart of setting a standard expression in a method for teaching intelligent practices of clinical staff and forming an expression type database of the clinical staff according to an embodiment of the present invention.
Fig. 4 is a flowchart of performing expression number setting on a medical staff learning image acquired in real time according to the expression type database in a clinical staff intelligent practice teaching method according to an embodiment of the present invention.
Fig. 5 is a flowchart of a comprehensive score corresponding to an extracted expression number in a method for teaching intelligent practices of clinical staff according to an embodiment of the present invention.
FIG. 6 is a flow chart of obtaining a conceptual vocabulary recommendation table based on online analysis of medical staff learning images acquired in real time in a method of teaching clinical staff intelligent practices according to one embodiment of the present invention.
FIG. 7 is a flow chart of a method of intelligent practice teaching of clinical staff for recommending online learning assistance content to the staff in real time based on the concept vocabulary recommendations, according to one embodiment of the present invention.
Fig. 8 is a block diagram of a clinical healthcare worker intelligent practice teaching system according to one embodiment of the present invention.
Fig. 9 is a block diagram of an electronic device in one embodiment of the invention.
Detailed Description
In some of the flows described in the specification and claims of the present invention and in the foregoing figures, a plurality of operations occurring in a particular order are included, but it should be understood that the operations may be performed out of order or performed in parallel, with the order of operations such as 101, 102, etc., being merely used to distinguish between the various operations, the order of the operations themselves not representing any order of execution. In addition, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first" and "second" herein are used to distinguish different messages, devices, modules, etc., and do not represent a sequence, and are not limited to the "first" and the "second" being different types.
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to fall within the scope of the invention.
The clinician nurses mainly operate in the field, the benefit of this mode is that accurate learning can be achieved, and the learning process can be impressive, but the shortcoming is limited by time, space and manpower, which directly results in lower training efficiency of clinical staff, and in many cases, the training is difficult to truly perform comprehensively.
Prior to the present technology, the prior art has performed collective training of all medical staff by means of video training or by means of class, but these training are still limited, and many scenes cannot be effectively simulated, and meanwhile, the level difference of different medical staff is considered, and targeted training is also not possible.
The embodiment of the invention provides a method, a system, a medium and equipment for intelligent practice teaching of clinical medical staff. According to the scheme, comprehensive training and evaluation of the whole scene are carried out through 2-dimensional or 3-dimensional images, videos and audios, a multi-scene self-adaptive matching test mode is completed, a time comprehensive evaluation mode is scattered, and pertinence of practical training of medical staff and efficiency of teaching training are improved through comprehensive scoring and evaluation.
According to a first aspect of the embodiment of the invention, an intelligent practice teaching method for clinical medical staff is provided.
FIG. 1 is a flow chart of a method of teaching intelligent practices of clinical healthcare workers in accordance with one embodiment of the present invention.
In one or more embodiments, preferably, the method for intelligent practice teaching of clinical staff includes:
s101, setting a VR interface and a video interface, extracting corresponding audio and inserting audio content, and collecting learning images of medical staff in real time;
s102, setting a standard expression and forming an expression type database of medical staff;
s103, performing expression number setting on a medical staff learning image acquired in real time according to the expression type database;
s104, extracting comprehensive scores corresponding to the expression numbers;
s105, carrying out online analysis according to the medical staff learning image acquired in real time to acquire a concept vocabulary recommending table;
s106, recommending auxiliary content of online learning to medical staff in real time according to the concept vocabulary recommending list.
According to the embodiment of the invention, the corresponding expression type is selected from the expression classification library according to the highest similarity in a period of time, the relation between the answer accuracy and the expressions is further associated, each expression is subjected to refinement marking according to the answer accuracy, finally, specific recommendation rule setting is completed under a certain rule, and when the recommendation rule is started, the corresponding concept vocabulary is automatically recommended to medical staff for online learning to insert learning or insert audio introduction.
Fig. 2 is a flowchart of setting VR interface and video interface in a method for intelligent practice teaching of clinical staff, extracting corresponding audio and inserting audio content, and collecting learning images of the clinical staff in real time according to an embodiment of the present invention.
As shown in fig. 2, in one or more embodiments, preferably, the setting VR interface and the video interface, extracting corresponding audio and inserting audio content, and collecting learning images of medical staff in real time specifically includes:
s201, starting a VR interface, and setting the VR interface to be in a waiting call state;
s202, starting a two-dimensional video interface and a three-dimensional video interface, and setting the two-dimensional video interface and the three-dimensional video interface as waiting for a calling state;
s203, setting a current medical training scheme, and setting answer examination according to the medical training scheme;
s204, after the medical staff starts to learn, recording learning images of the medical staff in real time;
s205, recording corresponding answer scores after the answer examination is completed by the medical staff.
Canvas 1.
Fig. 3 is a flowchart of setting a standard expression in a method for teaching intelligent practices of clinical staff and forming an expression type database of the clinical staff according to an embodiment of the present invention.
As shown in fig. 3, in one or more embodiments, preferably, the setting a standard expression and forming an expression type database of the medical staff specifically includes:
s301, setting a standard expression without emotion and view, and recording the corresponding facial point position distribution;
s302, acquiring learning images of medical staff in real time, and comparing facial point position distribution to form a whole expression type database, wherein the expression type database comprises facial point position distribution of one expression under a plurality of emotions.
In the embodiment of the invention, in order to further clearly define how to set the expression type database, recording is performed according to the preset expression template and the facial point position movement after the expression occurs; and setting an expression type database for online comparison analysis.
Fig. 4 is a flowchart of performing expression number setting on a medical staff learning image acquired in real time according to the expression type database in a clinical staff intelligent practice teaching method according to an embodiment of the present invention.
As shown in fig. 4, in one or more embodiments, preferably, the performing, according to the expression type database, expression number setting on a learning image of a medical staff acquired in real time specifically includes:
s401, taking each expression in the expression type database as an expression template, and setting a unique expression number
S402, according to the expression type database, facial point position movement analysis is carried out on medical staff learning images acquired in real time, the expression with the highest expression similarity and a preset expression template are set to be of the same type, and corresponding expression numbers are recorded.
In the embodiment of the invention, for further accurate correspondence and analysis, it is necessary to clearly set the expression numbers, so that recording is performed according to the preset expression template and the facial point position movement after the expression occurs; judging that the expression with the highest expression similarity and a preset expression template are set to be of the same type; and setting an expression type database for online comparison analysis.
Fig. 5 is a flowchart of a comprehensive score corresponding to an extracted expression number in a method for teaching intelligent practices of clinical staff according to an embodiment of the present invention.
As shown in fig. 5, in one or more embodiments, preferably, the extracting the composite score corresponding to the expression number specifically includes:
s501, obtaining answering points of each test process;
s502, obtaining answer points of the test corresponding to each expression finally;
s503, carrying out normalization processing on the answers of the same scoring personnel to generate normalized scores;
s504, calculating comprehensive scores under all the same expression types by using a first calculation formula according to the normalized scores;
the first calculation formula is as follows:
wherein i is the number of answers of a certain expression, G i And (3) the normalized score corresponding to the ith number, n is the number of answers of a certain expression, and B is the comprehensive score.
In the embodiment of the invention, the answer score of the test corresponding to each expression finally is further determined, and the corresponding relation between the expression number and the comprehensive score of the expression type database is formed.
FIG. 6 is a flow chart of obtaining a conceptual vocabulary recommendation table based on online analysis of medical staff learning images acquired in real time in a method of teaching clinical staff intelligent practices according to one embodiment of the present invention.
In one or more embodiments, as shown in fig. 6, preferably, the on-line analysis performed according to the learning image of the medical staff acquired in real time to obtain the concept vocabulary recommendation table specifically includes:
s601, starting abnormal timing when judging that a second calculation formula is not satisfied according to the comprehensive score corresponding to the current expression number;
s602, when the abnormal timing duration meets a third calculation formula, starting a recommendation flow;
s603, after a recommendation flow is started, extracting real-time audio before recommendation occurs, and counting concept words occurring in an abnormal timing period in the real-time audio before recommendation occurs;
s604, classifying the concept vocabulary, and sorting the appearance time from big to small;
s605, judging whether any two concept vocabularies meet a fourth calculation formula, and when the fourth calculation formula is met, starting secondary analysis if the fourth calculation formula is used as the concept vocabularies with equal probability, and not meeting the requirement of not processing;
s606, after the secondary analysis is started, automatically analyzing the appearance sequence of the concept words with equal probability, and taking the words with the previous appearance sequence as preferentially recommended words;
s607, forming a whole concept vocabulary recommendation table;
the second calculation formula is as follows:
B<Y
wherein Y is a preset contrast margin;
the third calculation formula is as follows:
T<Y 0
wherein T is the anomaly timing duration, Y 0 A margin for time judgment;
the fourth calculation formula is as follows:
Tgm-Tgk<Y D
wherein Tgm is the occurrence time of the mth concept, tgk is the occurrence time of the kth concept, Y D For equal concept judgment margin, the statistical range of the appearance duration of the concept is the concept vocabulary appearing in the abnormal timing period in the real-time audio before the recommendation appears.
In the embodiment of the invention, the problem of when and what to recommend is mainly solved, the comprehensive score is obtained according to the current expression number correspondence, and abnormal timing is started if the second calculation formula is judged not to be satisfied; and when the abnormal timing duration meets the third calculation formula, starting a recommendation flow, and finally providing a list of recommended contents by combining a fourth calculation formula.
FIG. 7 is a flow chart of a method of intelligent practice teaching of clinical staff for recommending online learning assistance content to the staff in real time based on the concept vocabulary recommendations, according to one embodiment of the present invention.
As shown in fig. 7, in one or more embodiments, preferably, the recommending auxiliary content of online learning to a medical staff according to the concept vocabulary recommending table in real time specifically includes:
s701, automatically selecting whether to introduce or not by online training personnel according to the sequence of the concept vocabulary recommendation list;
s702, when the introduction is completed, medical staff automatically selects whether to repeatedly present all or part of learning content in the abnormal timing period in the real-time audio before the recommendation.
In the embodiment of the invention, the method specifically defines how to effectively and specifically send out targeted contents in real time, and specifically and automatically displays whether the content needs to be introduced or not according to the sequence of the concept vocabulary recommendation list and automatically selected by online training staff; if the introduction is complete, the training personnel select whether the specific needs to be repeated.
According to a second aspect of the embodiment of the invention, an intelligent practice teaching system for clinical medical staff is provided.
Fig. 8 is a block diagram of a clinical healthcare worker intelligent practice teaching system according to one embodiment of the present invention.
In one or more embodiments, preferably, the one clinical healthcare worker intelligent practice teaching system comprises:
the scene information acquisition module 801 is used for setting a VR interface and a video interface, extracting corresponding audio and inserting audio content, and acquiring learning images of medical staff in real time;
the data analysis module 802 is configured to set a standard expression and form an expression type database of the medical staff;
the expression numbering module 803 is configured to set an expression number for a learning image of a medical staff acquired in real time according to the expression type database;
the comprehensive scoring module 804 is configured to extract a comprehensive score corresponding to the expression number;
the scene matching recommendation module 805 is configured to perform online analysis according to the medical staff learning image acquired in real time to obtain a concept vocabulary recommendation table;
and a recommendation scene execution module 806, configured to recommend auxiliary content of online learning to a healthcare worker in real time according to the concept vocabulary recommendation table.
In the embodiment of the invention, a system suitable for different structures is realized through a series of modularized designs, and the system can realize closed-loop, reliable and efficient execution through acquisition, analysis and control.
According to a third aspect of embodiments of the present invention, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement a method according to any of the first aspect of embodiments of the present invention.
According to a fourth aspect of an embodiment of the present invention, there is provided an electronic device. Fig. 9 is a block diagram of an electronic device in one embodiment of the invention. The electronic equipment shown in fig. 9 is a general clinical medical staff intelligent practice teaching device. Referring to fig. 9, the electronic device may be a smart phone, a tablet computer, or the like. The electronic device 900 comprises a processor 901 and a memory 902. The processor 901 is electrically connected to the memory 902.
The processor 901 is a control center of the electronic device 900, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or calling computer programs stored in the memory 902 and calling data stored in the memory 902, thereby performing overall monitoring of the electronic device.
In this embodiment, the processor 901 in the electronic device 900 loads instructions corresponding to the processes of one or more computer programs into the memory 902 according to the following steps, and the processor 901 executes the computer programs stored in the memory 902, so as to implement various functions, for example: setting a VR interface and a video interface, extracting corresponding audio and inserting audio content, and collecting learning images of medical staff in real time; setting a standard expression and forming an expression type database of medical staff; according to the expression type database, carrying out expression number setting on a medical staff learning image acquired in real time; extracting comprehensive scores corresponding to the expression numbers; carrying out online analysis according to learning images of medical staff obtained in real time to obtain a concept vocabulary recommending table; recommending auxiliary content of online learning to medical staff in real time according to the concept vocabulary recommending list.
In some implementations, the electronic device 900 may further include: a display 903, radio frequency circuitry 904, audio circuitry 905, a wireless fidelity module 906, and a power supply 907. The display 903, the radio frequency circuit 904, the audio circuit 905, the wireless fidelity module 906 and the power supply 907 are electrically connected to the processor 901.
The display 903 may be used to display information entered by a user or provided to a user as well as various graphical user interfaces, which may be composed of graphics, text, icons, video, and any combination thereof. The display 903 may include a display panel, which in some embodiments may be configured in the form of a liquid crystal display (LCD, liquid Crystal Display), or an Organic Light-Emitting Diode (OLED), or the like.
The radio frequency circuit 904 may be configured to receive and transmit radio frequency signals to and from a network device or other electronic device via wireless communication.
The audio circuit 905 may be used to provide an audio interface between a user and an electronic device through a speaker, microphone.
The wireless fidelity module 906 may be used for short-range wireless transmission, may help users to send and receive e-mail, browse websites, access streaming media, etc., and provides wireless broadband internet access to the user.
The power supply 907 may be used to power various components of the electronic device 900. In some embodiments, the power supply 907 may be logically connected to the processor 901 through a power management system, so as to perform functions of managing charging, discharging, and power consumption management through the power management system.
Although not shown in fig. 9, the electronic device 900 may further include a camera, a bluetooth module, etc., which will not be described herein.
The technical scheme provided by the embodiment of the invention can comprise the following beneficial effects:
according to the scheme, training data and training information of all scenes are obtained by automatically extracting 2-dimensional or 3-dimensional data.
According to the scheme, the face recognition is used for self matching and recommending training scenes corresponding to medical staff, so that the medical staff can effectively learn and train in a targeted manner, and the training efficiency is improved.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (10)
1. An intelligent practice teaching method for clinical medical staff is characterized by comprising the following steps:
setting a VR interface and a video interface, extracting corresponding audio and inserting audio content, and collecting learning images of medical staff in real time;
setting a standard expression and forming an expression type database of medical staff;
according to the expression type database, carrying out expression number setting on a medical staff learning image acquired in real time;
extracting comprehensive scores corresponding to the expression numbers;
carrying out online analysis according to learning images of medical staff obtained in real time to obtain a concept vocabulary recommending table;
recommending auxiliary content of online learning to medical staff in real time according to the concept vocabulary recommending list.
2. The intelligent practice teaching method for clinical staff according to claim 1, wherein the setting of VR interface and video interface, extracting corresponding audio and inserting audio content, and collecting learning images of the clinical staff in real time comprises the following steps:
starting a VR interface, and setting the VR interface as a waiting calling state;
starting a two-dimensional video interface and a three-dimensional video interface, and setting the two-dimensional video interface and the three-dimensional video interface as waiting for calling states;
setting a current medical training scheme, and setting answer examination according to the medical training scheme;
recording learning images of medical staff in real time after the medical staff starts to learn;
and after the answer examination is completed by the medical staff, recording the corresponding answer score.
3. The intelligent practice teaching method for clinical staff according to claim 1, wherein the setting a standard expression and forming an expression type database for the clinical staff comprises the following steps:
setting a standard expression without emotion and view, and recording the corresponding facial point position distribution;
and acquiring learning images of medical staff in real time, and comparing facial point position distribution to form a whole expression type database, wherein the expression type database comprises facial point position distribution of one expression under a plurality of emotions.
4. The intelligent practice teaching method for clinical staff according to claim 1, wherein the setting of expression numbers for learning images of the clinical staff acquired in real time according to the expression type database specifically comprises:
taking each expression in the expression type database as an expression template, and setting a unique expression number
And carrying out facial point position movement analysis on the medical staff learning image acquired in real time according to the expression type database, setting the expression with the highest expression similarity to be of the same type with a preset expression template, and recording the corresponding expression number.
5. The intelligent practice teaching method for clinical staff as claimed in claim 1, wherein the extracting the comprehensive score corresponding to the expression number specifically comprises:
obtaining answers of each test process;
obtaining answer points of the test corresponding to each expression finally;
normalizing the answers of the same scoring personnel to generate normalized scores;
according to the normalized score, calculating comprehensive scores of all the expression types under the same expression type by using a first calculation formula;
the first calculation formula is as follows:
wherein i is the number of answers of a certain expression, G i And (3) the normalized score corresponding to the ith number, n is the number of answers of a certain expression, and B is the comprehensive score.
6. The intelligent practice teaching method for clinical staff according to claim 1, wherein the on-line analysis is performed according to the learning image of the clinical staff obtained in real time to obtain a concept vocabulary recommendation list, specifically comprising:
according to the comprehensive score corresponding to the current expression number, starting abnormal timing if the second calculation formula is not satisfied;
when the abnormal timing duration meets a third calculation formula, starting a recommendation flow;
after a recommendation flow is started, extracting real-time audio before recommendation occurs, and counting concept words occurring in an abnormal timing period in the real-time audio before recommendation occurs;
classifying the concept vocabulary, and sequencing the occurrence time from big to small;
judging whether any two concept vocabularies meet a fourth calculation formula, and when the fourth calculation formula is met, starting secondary analysis if the fourth calculation formula is used as the concept vocabularies with equal probability, and not meeting the requirement of not processing;
after the secondary analysis is started, automatically analyzing the appearance sequence of the concept words with equal probability, and taking the words with the previous appearance sequence as preferentially recommended words;
forming a complete conceptual vocabulary recommendation table;
the second calculation formula is as follows:
B<Y
wherein Y is a preset contrast margin;
the third calculation formula is as follows:
T<Y 0
wherein T is the anomaly timing duration, Y 0 A margin for time judgment;
the fourth calculation formula is as follows:
Tgm-Tgk<Y D
wherein Tgm is the occurrence time of the mth concept, tgk is the occurrence time of the kth concept, Y D For equal concept judgment margin, the statistical range of the appearance duration of the concept is the concept vocabulary appearing in the abnormal timing period in the real-time audio before the recommendation appears.
7. The intelligent practice teaching method for clinical staff according to claim 1, wherein the recommending auxiliary content for online learning to the clinical staff according to the concept vocabulary recommending table comprises the following steps:
according to the sequence of the concept vocabulary recommended list, automatically selecting by online training personnel, and judging whether introduction is needed;
when the introduction is finished, medical staff automatically selects whether to repeatedly present all or part of learning content in the abnormal timing period in the real-time audio before the recommendation.
8. A clinical healthcare worker intelligent practice teaching system for implementing the method of any one of claims 1-7, the system comprising:
the scene information acquisition module is used for setting a VR interface and a video interface, extracting corresponding audio and inserting audio content, and acquiring learning images of medical staff in real time;
the data analysis module is used for setting a standard expression and forming an expression type database of medical staff;
the expression number module is used for carrying out expression number setting on the medical staff learning image acquired in real time according to the expression type database;
the comprehensive scoring module is used for extracting comprehensive scores corresponding to the expression numbers;
the scene matching recommendation module is used for carrying out online analysis according to the medical staff learning image acquired in real time to acquire a concept vocabulary recommendation table;
and the recommendation scene execution module is used for recommending auxiliary content for online learning to medical staff in real time according to the concept vocabulary recommendation table.
9. A computer readable storage medium, on which computer program instructions are stored, which computer program instructions, when executed by a processor, implement the method of any of claims 1-7.
10. An electronic device comprising a memory and a processor, wherein the memory is configured to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310340034.4A CN116487012A (en) | 2023-03-31 | 2023-03-31 | Intelligent practice teaching method, system, medium and equipment for clinical medical staff |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310340034.4A CN116487012A (en) | 2023-03-31 | 2023-03-31 | Intelligent practice teaching method, system, medium and equipment for clinical medical staff |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116487012A true CN116487012A (en) | 2023-07-25 |
Family
ID=87220458
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310340034.4A Pending CN116487012A (en) | 2023-03-31 | 2023-03-31 | Intelligent practice teaching method, system, medium and equipment for clinical medical staff |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116487012A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117495197A (en) * | 2023-11-28 | 2024-02-02 | 北京大学人民医院 | Clinical medicine study teaching process management method and system |
-
2023
- 2023-03-31 CN CN202310340034.4A patent/CN116487012A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117495197A (en) * | 2023-11-28 | 2024-02-02 | 北京大学人民医院 | Clinical medicine study teaching process management method and system |
| CN117495197B (en) * | 2023-11-28 | 2024-06-11 | 北京大学人民医院 | Clinical medicine study teaching process management method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110399541B (en) | Topic recommendation method and device based on deep learning and storage medium | |
| CN110991381B (en) | Real-time classroom student status analysis and indication reminding system and method based on behavior and voice intelligent recognition | |
| CN109635098B (en) | Intelligent question and answer method, device, equipment and medium | |
| CN111144191B (en) | Font identification method, font identification device, electronic equipment and storage medium | |
| CN112184500A (en) | Extraclass learning tutoring system based on deep learning and knowledge graph and implementation method | |
| US20210294806A1 (en) | Method for monitoring user behavior when interacting with content and a system for its implementation | |
| CN115082269B (en) | Big data based teaching planning method and system | |
| CN111651497B (en) | User tag mining method and device, storage medium and electronic equipment | |
| CN111538852B (en) | Multimedia resource processing method, device, storage medium and equipment | |
| CN109165316A (en) | A kind of method for processing video frequency, video index method, device and terminal device | |
| CN110580516B (en) | Interaction method and device based on intelligent robot | |
| CN115544241B (en) | Intelligent pushing method and device for online operation | |
| CN111368808A (en) | Method, device and system for acquiring answer data and teaching equipment | |
| CN112990794A (en) | Video conference quality detection method, system, storage medium and electronic equipment | |
| CN116259004B (en) | Student learning state detection method and system applied to online education | |
| CN112015574A (en) | Remote medical education training method, device, equipment and storage medium | |
| CN116487012A (en) | Intelligent practice teaching method, system, medium and equipment for clinical medical staff | |
| CN111696648A (en) | Psychological consultation platform based on Internet | |
| CN116796802A (en) | Learning recommendation method, device, equipment and storage medium based on error question analysis | |
| CN113822907B (en) | Image processing method and device | |
| CN113505604B (en) | Online auxiliary experiment method, device and equipment for psychological education | |
| CN111353439A (en) | Method, device, system and equipment for analyzing teaching behaviors | |
| CN110111011A (en) | A kind of quality of instruction monitoring and managing method, device and electronic equipment | |
| CN114639152A (en) | Multi-modal voice interaction method, device, equipment and medium based on face recognition | |
| CN109800880B (en) | Self-adaptive learning feature extraction system based on dynamic learning style information and application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |