CN114267213A - Real-time demonstration method, device, equipment and storage medium for practical training - Google Patents
Real-time demonstration method, device, equipment and storage medium for practical training Download PDFInfo
- Publication number
- CN114267213A CN114267213A CN202111544564.8A CN202111544564A CN114267213A CN 114267213 A CN114267213 A CN 114267213A CN 202111544564 A CN202111544564 A CN 202111544564A CN 114267213 A CN114267213 A CN 114267213A
- Authority
- CN
- China
- Prior art keywords
- real
- demonstration
- video stream
- time
- knowledge point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 93
- 238000012549 training Methods 0.000 title claims abstract description 61
- 230000009471 action Effects 0.000 claims abstract description 87
- 238000012545 processing Methods 0.000 claims abstract description 28
- 238000013507 mapping Methods 0.000 claims abstract description 17
- 238000004590 computer program Methods 0.000 claims description 11
- 238000004891 communication Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 abstract description 18
- 230000000694 effects Effects 0.000 abstract description 8
- 238000004088 simulation Methods 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000003137 locomotive effect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 238000007499 fusion processing Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012552 review Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Abstract
The application provides a real-time demonstration method, a real-time demonstration device, a real-time demonstration equipment and a real-time demonstration storage medium for practical training, and belongs to the technical field of simulation demonstration. The method comprises the following steps: acquiring a real-time demonstration video stream sent by image acquisition equipment, wherein the real-time demonstration video stream is used for recording demonstration actions executed by a demonstration staff; identifying and processing the real-time demonstration video stream, and determining the current demonstration action; determining a target knowledge point corresponding to the current demonstration action based on a mapping relation between the preset demonstration action and the knowledge point; and respectively sending the target knowledge point and the real-time demonstration video stream to the intelligent student terminal so that the intelligent student terminal fuses the target knowledge point into the real-time demonstration video stream for playing. The teaching demonstration device can demonstrate knowledge points related in the teaching process while demonstrating real-time demonstration for students, and therefore teaching efficiency and effect are improved.
Description
Technical Field
The application relates to the technical field of simulation teaching, in particular to a real-time demonstration method, device, equipment and storage medium for practical training.
Background
In order to train the operation, maintenance and other work of station workers, the teaching video demonstration of the station workers is usually required.
In the prior art, a demonstrator usually performs practical training demonstration in a device room, and a student learns in the field or other specific areas.
However, due to the limited space in the field and the fixed viewing angle, the student usually cannot fully learn the actual operation of the demonstrator, which results in the low teaching efficiency and poor teaching effect for the worker in the prior art.
Disclosure of Invention
The application aims to provide a real-time demonstration method, a real-time demonstration device, a real-time demonstration equipment and a real-time demonstration storage medium for practical training, which can show knowledge points related in the teaching process while showing real-time demonstration for students, so that the teaching efficiency and effect are improved.
The embodiment of the application is realized as follows:
in one aspect of the embodiments of the present application, a real-time demonstration method for practical training is provided, where the method is applied to a server, and the server is in communication connection with an image acquisition device and various intelligent terminals, respectively, and the method includes:
acquiring a real-time demonstration video stream sent by image acquisition equipment, wherein the real-time demonstration video stream is used for recording demonstration actions executed by a demonstration staff;
identifying and processing the real-time demonstration video stream, and determining the current demonstration action;
determining a target knowledge point corresponding to the current demonstration action based on a mapping relation between the preset demonstration action and the knowledge point;
and respectively sending the target knowledge point and the real-time demonstration video stream to the intelligent student terminal so that the intelligent student terminal fuses the target knowledge point into the real-time demonstration video stream for playing.
Optionally, determining a target knowledge point corresponding to the current demonstration action based on a mapping relationship between the preset demonstration action and the knowledge point, including:
determining a target task flow corresponding to the current demonstration action based on the current demonstration action and the identification of the current practical training course;
acquiring a knowledge point list corresponding to a target task flow, wherein the knowledge point list comprises knowledge points corresponding to demonstration actions;
and determining a target knowledge point corresponding to the current demonstration action based on the knowledge point list.
Optionally, the image acquisition device comprises: the system comprises an electronic screen acquisition device and a real-time scene acquisition device;
the method for acquiring the real-time demonstration video stream sent by the image acquisition equipment comprises the following steps:
respectively receiving a first video stream sent by an electronic screen acquisition device and a second video stream sent by a real-time scene acquisition device;
a real-time presentation video stream is derived based on the first video stream and the second video stream.
Optionally, the method of sending the target knowledge point and the real-time demonstration video stream to the intelligent terminal for video playing respectively includes:
and respectively sending the target knowledge point and the real-time demonstration video stream to the intelligent terminal so that the intelligent terminal determines the display position of the target knowledge point in the real-time demonstration video and displays the target knowledge point at the display position.
Optionally, after receiving the real-time demonstration video stream sent by the image capturing device, the method further includes:
storing the real-time demonstration video stream;
and sending the real-time demonstration video stream to the intelligent terminal of the demonstrator.
Optionally, after sending the real-time demonstration video stream to the intelligent terminal of the demonstrator, the method further includes:
receiving annotation information sent by the intelligent terminal of the demonstrator, wherein the annotation information comprises: the real-time demonstration video stream comprises annotation content, a time mark and a position mark, wherein the time mark is used for representing the time of the annotation content in the real-time demonstration video stream, and the position mark is used for marking the position of the annotation content in the real-time demonstration video stream;
performing correlation processing on the annotation information and the real-time demonstration video stream to obtain a target playing video;
and sending the target playing video to the intelligent student terminal for video playing.
Optionally, the format of the target knowledge point includes at least one of: text, image, video, voice.
On the other hand of this application embodiment provides a real-time presentation device of instructing, and the device is applied to the server, and the server respectively with image acquisition equipment, multiple intelligent terminal communication connection, the device includes: the device comprises an acquisition module, an identification module, a determination module and a sending module;
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a real-time demonstration video stream sent by image acquisition equipment, and the real-time demonstration video stream is used for recording demonstration actions executed by a demonstrator;
the identification module is used for identifying the real-time demonstration video stream and determining the current demonstration action;
the determining module is used for determining a target knowledge point corresponding to the current demonstration action based on a mapping relation between the preset demonstration action and the knowledge point;
and the sending module is used for respectively sending the target knowledge point and the real-time demonstration video stream to the intelligent student terminal so that the intelligent student terminal fuses the target knowledge point into the real-time demonstration video stream for playing.
Optionally, the determining module is specifically configured to determine, based on the current demonstration action and the identifier of the current practical training course, a target task flow corresponding to the current demonstration action; acquiring a knowledge point list corresponding to a target task flow, wherein the knowledge point list comprises knowledge points corresponding to demonstration actions; and determining a target knowledge point corresponding to the current demonstration action based on the knowledge point list.
Optionally, the image acquisition device comprises: the system comprises an electronic screen acquisition device and a real-time scene acquisition device; the acquisition module is used for respectively receiving a first video stream sent by the electronic screen acquisition equipment and a second video stream sent by the real-time scene acquisition equipment; a real-time presentation video stream is derived based on the first video stream and the second video stream.
Optionally, the sending module is specifically configured to send the target knowledge point and the real-time demonstration video stream to the intelligent terminal, so that the intelligent terminal determines a display position of the target knowledge point in the real-time demonstration video and displays the target knowledge point at the display position.
Optionally, the obtaining module is further configured to store the real-time demonstration video stream; and the sending module is also used for sending the real-time demonstration video stream to the intelligent terminal of the demonstrator.
Optionally, the obtaining module is further configured to receive annotation information sent by the presenter intelligent terminal, where the annotation information includes: the real-time demonstration video stream comprises annotation content, a time mark and a position mark, wherein the time mark is used for representing the time of the annotation content in the real-time demonstration video stream, and the position mark is used for marking the position of the annotation content in the real-time demonstration video stream; performing correlation processing on the annotation information and the real-time demonstration video stream to obtain a target playing video; and the sending module is also used for sending the target playing video to the intelligent student terminal for video playing.
In another aspect of the embodiments of the present application, there is provided a computer device, including: the real-time demonstration method comprises a memory and a processor, wherein a computer program capable of running on the processor is stored in the memory, and when the processor executes the computer program, the steps of the real-time demonstration method for the practical training are realized.
In another aspect of the embodiments of the present application, a computer-readable storage medium is provided, where a computer program is stored on the storage medium, and when the computer program is executed by a processor, the steps of the real-time demonstration method for training are implemented.
The beneficial effects of the embodiment of the application include:
in the method, the device, the equipment and the storage medium for real-time demonstration of the practical training provided by the embodiment of the application, a real-time demonstration video stream sent by image acquisition equipment can be acquired, and the real-time demonstration video stream is used for recording demonstration actions executed by demonstration personnel; identifying and processing the real-time demonstration video stream, and determining the current demonstration action; determining a target knowledge point corresponding to the current demonstration action based on a mapping relation between the preset demonstration action and the knowledge point; and respectively sending the target knowledge point and the real-time demonstration video stream to the intelligent student terminal so that the intelligent student terminal fuses the target knowledge point into the real-time demonstration video stream for playing. The real-time demonstration video stream is sent to the intelligent student terminal, real-time learning of the student can be achieved, the target knowledge points corresponding to the demonstration actions can be sent to enable the student to learn the corresponding related theoretical indication in the actual demonstration operation process of learning, and teaching efficiency and effect are improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
Fig. 1 is a schematic view of an application scenario of a real-time demonstration method of practical training provided in an embodiment of the present application;
fig. 2 is a first schematic flow chart of a real-time demonstration method of practical training provided in the embodiment of the present application;
fig. 3 is a schematic flow chart diagram of a real-time demonstration method of practical training provided in the embodiment of the present application;
fig. 4 is a third schematic flowchart of a real-time demonstration method of practical training provided in the embodiment of the present application;
fig. 5 is a schematic overall flow chart of a real-time demonstration method of practical training provided in the embodiment of the present application;
fig. 6 is a fourth schematic flowchart of a real-time demonstration method of practical training provided in the embodiment of the present application;
fig. 7 is a fifth flowchart illustrating a real-time demonstration method of practical training provided in the embodiment of the present application;
fig. 8 is a schematic overall flow chart diagram of a real-time demonstration method of practical training provided in the embodiment of the present application;
fig. 9 is a schematic structural diagram of a real-time demonstration apparatus for practical training provided in an embodiment of the present application;
fig. 10 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
In the description of the present application, it is noted that the terms "first", "second", "third", and the like are used merely for distinguishing between descriptions and are not intended to indicate or imply relative importance.
It should be noted that, in professional education, for example, technical training for station workers, training practice is a necessary supplement for theoretical knowledge learning, and the simulation training teaching system provides an efficient, safe and precise training mode based on real equipment and adopting technical means such as three-dimensional simulation, and can be combined with a training system to perform teaching quality inspection. When a demonstrator performs an equipment training demonstration operation, a student needs to look around the equipment, or can only observe limited contents in a specific area such as a central control room through a fixed camera, and cannot review after class.
Specifically, the following drawbacks exist in the prior art: formula of enclosing and watching teaching, the demo can only enclose in limited space when the demonstration personnel, leads to the back row student to see not clearly to hear unclear. The demonstration information is incomplete, the simulation training area is large, and the display phenomenon of equipment and the operation of a demonstrator are difficult to observe at the same time no matter where the student stands; in the teaching process, the operation and the theoretical knowledge cannot be automatically corresponded; repeated teaching, which cannot record and playback the demonstration process, is difficult for students to review and needs repeated demonstration by the demonstrator; a camera is fixed in a common operation room, acquisition points are limited, and recording of demonstration details cannot be met; the conventional video recording content is monotonous, teaching auxiliary information cannot be added, and students do not have key points in learning.
In order to solve the above problems, the present application provides a real-time demonstration method of practical training, and a specific implementation scenario of the real-time demonstration method of practical training provided in the embodiment of the present application is specifically explained below.
Fig. 1 is a schematic view of an application scenario of a real-time demonstration method for practical training provided in an embodiment of the present application, please refer to fig. 1, where the scenario may include: the system comprises a server 110, an image acquisition device 120 and various intelligent terminals 130, wherein the server 110 is respectively connected with the image acquisition device 120 and the various intelligent terminals 130 in a communication mode.
The server 110 may be one, and is configured to perform processing and forwarding; alternatively, the streaming media server and the processing server may be included to implement forwarding and processing functions, respectively, and are not limited in particular herein.
The image acquisition devices 120 may be multiple ones, may respectively acquire different images, may be wired image acquisition devices, such as a simulation system computer, may acquire device desktop images and fixed cameras in an operation room, and may acquire video images in the operation room; or may be a wireless image capturing device, such as a teaching vehicle capable of moving, a law enforcement recorder carried about, and the like, which is not limited herein.
The intelligent terminal 130 may be various, for example: student intelligent terminal, demo personnel intelligent terminal etc. and the concrete effect can be the broadcast of carrying out the video stream, based on using the difference of object, can be equipped with different functions, for example: the intelligent terminal for the trainees can be used for video playing, testing and the like; the intelligent terminal for the demonstration staff can be used for playing videos, adding annotations and the like, is not particularly limited, and can be correspondingly set according to actual requirements.
The specific representation form of the smart terminal 130 may be a projector for displaying in a projection form, or an application program in a smart tablet, a smart phone, and the like, and is not limited in particular.
Optionally, in this scenario, the presenter may perform real-time presentation of specific training between operations, such as: the specific steps needed to be executed when a certain part of the train is repaired or a worker executes a certain task, and the like. The image acquiring device 120 may acquire a video stream when the presenter executes the video stream, and transmit the video stream to the server 110, and the server 110 may perform corresponding processing and then transmit the video stream and related data to the intelligent terminal 130.
Based on the application scenario, a specific implementation process of the real-time demonstration method for the practical training provided in the embodiment of the present application is specifically explained below.
Fig. 2 is a first schematic flow chart of a real-time demonstration method of practical training provided in an embodiment of the present application, please refer to fig. 2, where the method includes:
s210: and acquiring the real-time demonstration video stream sent by the image acquisition equipment.
Wherein the real-time demonstration video stream is used for recording demonstration actions performed by a demonstrator.
Optionally, an execution main body of the method may be the server, the real-time demonstration video stream may be a plurality of frames of continuous images that are shot, may be content that is shot in a live broadcast manner in real time, and specifically may be obtained by processing, by the server, a plurality of image acquisition devices that respectively acquire and send video streams to the server.
The presentation action displayed by the real-time presentation video stream may be a specific action in performing a certain operation, such as: the actions of repairing the components of the locomotive, opening the doors of the locomotive, etc., are not limited herein.
S220: and identifying the real-time demonstration video stream, and determining the current demonstration action.
Optionally, after acquiring the real-time demonstration video stream, the server may perform recognition processing on an image in the video stream, for example: image recognition techniques may be employed to determine the corresponding demo actions made by a demo in images captured in a video stream.
For example: when a demonstrator needs to turn on a certain switch of the operating device when performing a certain operation, the specific action of turning on the switch is the demonstration action.
S230: and determining a target knowledge point corresponding to the current demonstration action based on the mapping relation between the preset demonstration action and the knowledge point.
Alternatively, the knowledge point may be a knowledge point corresponding to the demonstration action, for example: the notice, the operation point, the easily overlooked details and the like of the demonstration action during execution can be included, and can be embodied in various forms. For example: text, images, video, voice, etc., without limitation.
Alternatively, the server may be configured with a mapping relationship between the knowledge points and the demonstration actions in advance, for example, the mapping relationship may be stored in the form of a mapping table, and after the demonstration actions are determined, the knowledge points corresponding to the demonstration actions may be determined based on the mapping table.
After the knowledge points are determined, the corresponding knowledge points can be used as the target knowledge points.
S240: and respectively sending the target knowledge point and the real-time demonstration video stream to the intelligent student terminal so that the intelligent student terminal fuses the target knowledge point into the real-time demonstration video stream for playing.
Optionally, after the target knowledge point is determined, the target knowledge point and the real-time demonstration video stream may be respectively sent to the trainee intelligent terminal, wherein if one server is used, the target knowledge point and the real-time demonstration video stream may be simultaneously sent to the trainee intelligent terminal; if the server is a streaming media server and a processing server, the streaming media server can directly transmit the real-time demonstration video stream to the student intelligent terminal, and the processing server can transmit the target knowledge point to the student intelligent terminal after obtaining the target knowledge point based on the processing.
Optionally, after receiving the target knowledge point, the trainee intelligent terminal may perform fusion processing on the target knowledge point and the real-time demonstration video stream, so as to play video content after the fusion processing.
In the real-time demonstration method for the practical training provided by the embodiment of the application, a real-time demonstration video stream sent by image acquisition equipment can be acquired, and the real-time demonstration video stream is used for recording demonstration actions executed by a demonstrator; identifying and processing the real-time demonstration video stream, and determining the current demonstration action; determining a target knowledge point corresponding to the current demonstration action based on a mapping relation between the preset demonstration action and the knowledge point; and respectively sending the target knowledge point and the real-time demonstration video stream to the intelligent student terminal so that the intelligent student terminal fuses the target knowledge point into the real-time demonstration video stream for playing. The real-time demonstration video stream is sent to the intelligent student terminal, real-time learning of the student can be achieved, the target knowledge points corresponding to the demonstration actions can be sent to enable the student to learn the corresponding related theoretical indication in the actual demonstration operation process of learning, and teaching efficiency and effect are improved.
Another specific implementation process of the real-time demonstration method for practical training provided in the embodiment of the present application is specifically explained below.
Fig. 3 is a second flowchart of a real-time demonstration method for practical training provided in an embodiment of the present application, and please refer to fig. 3, where determining a target knowledge point corresponding to a current demonstration action based on a mapping relationship between the preset demonstration action and the knowledge point includes:
s310: and determining a target task flow corresponding to the current demonstration action based on the current demonstration action and the identification of the current practical training course.
Optionally, the identifier of the current practical training course may be a preset identifier, which is used to indicate the content of the current practical training course, the practical training course may include multiple task flows, in the practical training course, a target task flow corresponding to the current demonstration action may be determined based on the current demonstration action, and the target task flow is a flow that includes the current demonstration action and conforms to the current practical training course among the multiple task flows.
For example: if a task flow included in a certain training course includes opening and closing the vehicle door, the task flow corresponding to the action of opening the door by the demonstrator is also the task flow for opening and closing the vehicle door.
S320: and acquiring a knowledge point list corresponding to the target task flow.
And the knowledge point list comprises knowledge points corresponding to the demonstration actions.
Optionally, a knowledge point list corresponding to each target task flow may be stored in the server, and each target task flow corresponds to a plurality of demonstration actions, and each demonstration action may correspond to one or more knowledge points in the knowledge point list.
S330: and determining a target knowledge point corresponding to the current demonstration action based on the knowledge point list.
Optionally, after the target process is determined, the knowledge point corresponding to the demonstration action may be determined from the knowledge point list corresponding to the target process.
For example: in the process of locomotive maintenance, a plurality of task flows all involve opening a certain switch, while knowledge points involved in different tasks are different, and after the target flow is determined based on the method, the knowledge points in the knowledge point list corresponding to the target flow can be called, namely the knowledge points corresponding to the demonstration action can be determined when the task flow is executed.
After the knowledge points are obtained, the knowledge points can be used as the target knowledge points.
A further specific implementation process of the real-time demonstration method for practical training provided in the embodiment of the present application is specifically explained below.
Fig. 4 is a third schematic flowchart of a real-time demonstration method of practical training provided in an embodiment of the present application, and referring to fig. 4, an image acquisition device includes: the system comprises an electronic screen acquisition device and a real-time scene acquisition device; the method for acquiring the real-time demonstration video stream sent by the image acquisition equipment comprises the following steps:
s410: and respectively receiving a first video stream sent by the electronic screen acquisition equipment and a second video stream sent by the real-time scene acquisition equipment.
Optionally, the electronic screen acquiring device may be the simulation system computer in the foregoing explanation, and the real-time scene acquiring device may be the fixed camera, the mobile teaching vehicle, the law enforcement recorder carried around, and the like in the foregoing explanation.
Wherein the first video stream may be a video stream displayed in an electronic screen, such as: when the demonstrator operates the interactive equipment, the demonstrator interacts the video stream displayed in the screen; the second video stream may be a video stream of the actual scene in the operation room, for example: the presenter performs a video stream of actions while performing the operation of a certain device.
S420: a real-time presentation video stream is derived based on the first video stream and the second video stream.
Optionally, after the first video stream and the second video stream are obtained respectively, the first video stream and the second video stream may be processed to obtain a real-time demonstration video stream.
Specifically, for example, when the second video stream relates to a picture displayed by the playing device of the first video stream, the first video stream is adopted for overlay highlighting; alternatively, the first video stream and the second video stream may be played synchronously, and is not limited in particular.
Optionally, the method of sending the target knowledge point and the real-time demonstration video stream to the intelligent terminal for video playing respectively includes:
and respectively sending the target knowledge point and the real-time demonstration video stream to the intelligent terminal so that the intelligent terminal determines the display position of the target knowledge point in the real-time demonstration video stream and displays the target knowledge point at the display position.
After the target knowledge point and the real-time demonstration video stream are sent to the intelligent terminal, the intelligent terminal may determine a display position, a display mode, and the like of the target knowledge point in the real-time demonstration video stream according to pre-configured program software, a plug-in, and the like, for example: different types of knowledge points are displayed in different colors and sizes so as to be convenient for the students to understand.
Optionally, after the display mode is determined, the knowledge point may be displayed in a corresponding display mode at a corresponding position in the real-time demonstration video stream.
The following is a specific implementation process of the overall execution of the real-time demonstration method for practical training in the embodiment of the present application when the two servers are respectively a streaming server and a processing server.
Fig. 5 is a schematic overall flow chart of a real-time demonstration method for practical training provided in an embodiment of the present application, please refer to fig. 5, and the overall flow of the method is specifically as follows:
s510: the processing server and the streaming media server respectively acquire real-time demonstration video streams sent by the image acquisition equipment.
S520: and the streaming media server sends the real-time demonstration video stream to the intelligent student terminal.
S530: and the processing server identifies the real-time demonstration video stream and determines the current demonstration action.
S540: and the processing server determines a target knowledge point corresponding to the current demonstration action based on the mapping relation between the preset demonstration action and the knowledge point.
S550: and the processing server is used for enabling the target knowledge point trainee to be intelligent.
S560: and the intelligent student terminal determines the display position of the target knowledge point in the real-time demonstration video stream and displays the target knowledge point at the display position.
The specific steps performed in S510-S560 are explained above, and are not described herein again.
Next, a further specific implementation process of the real-time demonstration method for practical training provided in the embodiment of the present application is specifically explained.
Fig. 6 is a fourth schematic flowchart of a real-time demonstration method for practical training provided in the embodiment of the present application, please refer to fig. 6, where after receiving a real-time demonstration video stream sent by an image acquisition device, the method further includes:
s610: the real-time presentation video stream is stored.
Optionally, after receiving the real-time demonstration video stream, the server may store the video stream, for example, in a storage space corresponding to the server, or may also store in another storage connected to the server, which is not limited herein.
S620: and sending the real-time demonstration video stream to the intelligent terminal of the demonstrator.
Optionally, the stored real-time demonstration video stream may be sent to the demonstrator intelligent terminal, specifically, the real-time demonstration video stream may be directly sent after the storage is completed, or sent in response to a request sent by the demonstrator intelligent terminal, or sent at a preset time, which is not limited herein.
The following is a specific explanation of a further specific implementation process of the real-time demonstration method of the practical training provided in the embodiment of the present application.
Fig. 7 is a fifth flowchart of a real-time demonstration method for practical training provided in an embodiment of the present application, please refer to fig. 7, where after a real-time demonstration video stream is sent to a demo intelligent terminal, the method further includes:
s710: and receiving the comment information sent by the intelligent terminal of the demonstrator.
Wherein the annotation information comprises: the real-time demonstration video stream comprises annotation content, a time mark and a position mark, wherein the time mark is used for representing the time of the annotation content in the real-time demonstration video stream, and the position mark is used for marking the position of the annotation content in the real-time demonstration video stream.
Optionally, after the real-time demonstration video stream is sent to the demonstrator intelligent terminal, annotation information sent by the demonstrator intelligent terminal may be received, where the annotation information may be an annotation generated by the demonstrator based on the demonstrator intelligent terminal.
The annotation content may be an annotation character, an annotation link, and the like, the time identifier is used to indicate a specific time point of the annotation content in the real-time demonstration video stream, and the position identifier is used to identify a specific display position of the annotation content in the real-time demonstration video stream.
S720: and performing correlation processing on the annotation information and the real-time demonstration video stream to obtain a target playing video.
Optionally, the real-time demonstration video stream may be associated based on the annotation information, specifically, corresponding annotation contents may be added at corresponding time and corresponding position of the video stream, and after the addition of all the annotation contents is completed, the association is completed, so as to obtain the target playing video.
S730: and sending the target playing video to the intelligent student terminal for video playing.
Optionally, after the target playing video is obtained, the server may send the target playing video to the trainee intelligent terminal for video playing.
The following explains a specific implementation process of playing based on a video playback mode in the real-time demonstration method of the practical training provided in the embodiment of the present application.
Fig. 8 is a schematic overall flow chart of a real-time demonstration method for practical training provided in the embodiment of the present application, please refer to fig. 8, and the overall flow of the method is specifically as follows:
s810: the server stores the live presentation video stream.
S820: and the server respectively sends the real-time demonstration video stream to the demonstrator intelligent terminal and the student intelligent terminal.
S830: and the server receives the comment information sent by the intelligent terminal of the demonstrator.
S840: and the server performs correlation processing on the annotation information and the real-time demonstration video stream to obtain a target playing video.
S850: and the intelligent student terminal plays the real-time demonstration video stream or the target playing video.
It should be noted that, in the execution process of the method, the trainee intelligent terminal may directly acquire the real-time demonstration video stream for playing, or play the target playing video after acquiring the target playing video, which is not limited herein.
The following describes a device, equipment, a storage medium, and the like corresponding to the real-time demonstration method for performing the practical training provided by the present application, and specific implementation processes and technical effects thereof are referred to above and will not be described in detail below.
Fig. 9 is a schematic structural diagram of a real-time demonstration apparatus for practical training provided in an embodiment of the present application, please refer to fig. 9, where the apparatus is applied to a server, the server is respectively in communication connection with an image acquisition device and a plurality of intelligent terminals, and the apparatus includes: an acquisition module 710, an identification module 720, a determination module 730 and a sending module 740;
the acquisition module 710 is configured to acquire a real-time demonstration video stream sent by the image acquisition device, where the real-time demonstration video stream is used to record a demonstration action performed by a demonstrator;
the identification module 720 is configured to identify a real-time demonstration video stream and determine a current demonstration action;
the determining module 730 is configured to determine a target knowledge point corresponding to a current demonstration action based on a mapping relationship between the preset demonstration action and the knowledge point;
and the sending module 740 is configured to send the target knowledge point and the real-time demonstration video stream to the trainee intelligent terminal, so that the trainee intelligent terminal fuses the target knowledge point into the real-time demonstration video stream for playing.
Optionally, the determining module 730 is specifically configured to determine, based on the current demonstration action and the identifier of the current practical training course, a target task flow corresponding to the current demonstration action; acquiring a knowledge point list corresponding to a target task flow, wherein the knowledge point list comprises knowledge points corresponding to demonstration actions; and determining a target knowledge point corresponding to the current demonstration action based on the knowledge point list.
Optionally, the image acquisition device comprises: the system comprises an electronic screen acquisition device and a real-time scene acquisition device; an obtaining module 710, configured to receive a first video stream sent by an electronic screen obtaining device and a second video stream sent by a real-time scene obtaining device, respectively; a real-time presentation video stream is derived based on the first video stream and the second video stream.
Optionally, the sending module 740 is specifically configured to send the target knowledge point and the real-time demonstration video stream to the intelligent terminal, so that the intelligent terminal determines a display position of the target knowledge point in the real-time demonstration video and displays the target knowledge point at the display position.
Optionally, the obtaining module 710 is further configured to store the real-time demonstration video stream; and the sending module 740 is further configured to send the real-time demonstration video stream to the intelligent terminal of the demonstrator.
Optionally, the obtaining module 710 is further configured to receive annotation information sent by the presenter intelligent terminal, where the annotation information includes: the real-time demonstration video stream comprises annotation content, a time mark and a position mark, wherein the time mark is used for representing the time of the annotation content in the real-time demonstration video stream, and the position mark is used for marking the position of the annotation content in the real-time demonstration video stream; performing correlation processing on the annotation information and the real-time demonstration video stream to obtain a target playing video; the sending module 740 is further configured to send the target playing video to the trainee intelligent terminal for video playing.
The above-mentioned apparatus is used for executing the method provided by the foregoing embodiment, and the implementation principle and technical effect are similar, which are not described herein again.
These above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), or one or more microprocessors, or one or more Field Programmable Gate Arrays (FPGAs), etc. For another example, when one of the above modules is implemented in the form of a Processing element scheduler code, the Processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of calling program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
Fig. 10 is a schematic structural diagram of a computer device according to an embodiment of the present application, and referring to fig. 10, the computer device includes: the real-time demonstration method comprises a memory 810 and a processor 820, wherein a computer program capable of running on the processor 820 is stored in the memory 810, and when the computer program is executed by the processor 820, the steps of the real-time demonstration method for the practical training are realized.
Optionally, the computer device may specifically be the aforementioned server.
On the other hand, the embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the storage medium, and when the computer program is executed by a processor, the steps of the real-time demonstration method for the practical training are implemented.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a unit is merely a logical division, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute some steps of the methods according to the embodiments of the present invention. And the aforementioned storage medium includes: a U disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. A real-time demonstration method of practical training is characterized in that the method is applied to a server, the server is respectively in communication connection with an image acquisition device and a plurality of intelligent terminals, and the method comprises the following steps:
acquiring a real-time demonstration video stream sent by the image acquisition equipment, wherein the real-time demonstration video stream is used for recording demonstration actions executed by a demonstration staff;
identifying the real-time demonstration video stream, and determining a current demonstration action;
determining a target knowledge point corresponding to the current demonstration action based on a mapping relation between the preset demonstration action and the knowledge point;
and respectively sending the target knowledge point and the real-time demonstration video stream to a student intelligent terminal so that the student intelligent terminal fuses the target knowledge point into the real-time demonstration video stream for playing.
2. The method of claim 1, wherein determining the target knowledge point corresponding to the current demonstration action based on a pre-configured mapping relationship between the demonstration action and the knowledge point comprises:
determining a target task flow corresponding to the current demonstration action based on the current demonstration action and the identification of the current practical training course;
acquiring a knowledge point list corresponding to the target task flow, wherein the knowledge point list comprises knowledge points corresponding to all demonstration actions;
and determining a target knowledge point corresponding to the current demonstration action based on the knowledge point list.
3. The method of claim 1, wherein the image acquisition device comprises: the system comprises an electronic screen acquisition device and a real-time scene acquisition device;
the acquiring of the real-time demonstration video stream sent by the image acquisition device includes:
respectively receiving a first video stream sent by the electronic screen acquisition equipment and a second video stream sent by the real-time scene acquisition equipment;
and obtaining the real-time demonstration video stream based on the first video stream and the second video stream.
4. The method of claim 1, wherein the separately sending the target knowledge point and the live presentation video stream to the intelligent terminal for video playing comprises:
and respectively sending the target knowledge point and the real-time demonstration video stream to the intelligent terminal so that the intelligent terminal determines the display position of the target knowledge point in the real-time demonstration video stream and displays the target knowledge point at the display position.
5. The method of claim 1, wherein after the acquiring the live presentation video stream transmitted by the image acquisition device, the method further comprises:
storing the real-time demonstration video stream;
and sending the real-time demonstration video stream to a demonstration staff intelligent terminal.
6. The method of claim 5, wherein after sending the live presentation video stream to a presenter smart terminal, the method further comprises:
receiving annotation information sent by the intelligent demonstration personnel terminal, wherein the annotation information comprises: the real-time demonstration video stream comprises annotation content, a time identifier and a position identifier, wherein the time identifier is used for representing the time of the annotation content in the real-time demonstration video stream, and the position identifier is used for identifying the position of the annotation content in the real-time demonstration video stream;
performing correlation processing on the annotation information and the real-time demonstration video stream to obtain a target playing video;
and sending the target playing video to the intelligent student terminal for video playing.
7. The method of any one of claims 1-6, wherein the format of the target knowledge point comprises at least one of: text, image, video, voice.
8. The utility model provides a real-time presentation device of real standard which characterized in that, the device is applied to the server, the server respectively with image acquisition equipment, multiple intelligent terminal communication connection, the device includes: the device comprises an acquisition module, an identification module, a determination module and a sending module;
the acquisition module is used for acquiring a real-time demonstration video stream sent by the image acquisition equipment, and the real-time demonstration video stream is used for recording demonstration actions executed by a demonstration worker;
the identification module is used for identifying the real-time demonstration video stream and determining the current demonstration action;
the determining module is used for determining a target knowledge point corresponding to the current demonstration action based on a mapping relation between the preset demonstration action and the knowledge point;
the sending module is used for respectively sending the target knowledge point and the real-time demonstration video stream to a student intelligent terminal so that the student intelligent terminal fuses the target knowledge point into the real-time demonstration video stream for playing.
9. A computer device, comprising: memory in which a computer program is stored which is executable on the processor, and a processor which, when executing the computer program, carries out the steps of the method according to any one of the preceding claims 1 to 7.
10. A computer-readable storage medium, characterized in that the storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111544564.8A CN114267213A (en) | 2021-12-16 | 2021-12-16 | Real-time demonstration method, device, equipment and storage medium for practical training |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111544564.8A CN114267213A (en) | 2021-12-16 | 2021-12-16 | Real-time demonstration method, device, equipment and storage medium for practical training |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114267213A true CN114267213A (en) | 2022-04-01 |
Family
ID=80827540
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111544564.8A Pending CN114267213A (en) | 2021-12-16 | 2021-12-16 | Real-time demonstration method, device, equipment and storage medium for practical training |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114267213A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114743440A (en) * | 2022-04-29 | 2022-07-12 | 长沙酷得网络科技有限公司 | Intelligent programming training environment construction method and device based on application disassembly |
| CN116456062A (en) * | 2023-06-16 | 2023-07-18 | 北京紫云智能科技有限公司 | Teaching implementation method and system for resuscitation flow in wound resuscitation unit |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106409035A (en) * | 2016-12-01 | 2017-02-15 | 陈冲 | Teaching demonstration method, device and system |
| CN108376166A (en) * | 2018-02-24 | 2018-08-07 | 宁夏玲杰科技有限公司 | Intelligence learning method, apparatus and electronic equipment |
| CN108924608A (en) * | 2018-08-21 | 2018-11-30 | 广东小天才科技有限公司 | A kind of householder method and smart machine of video teaching |
| CN110033659A (en) * | 2019-04-26 | 2019-07-19 | 北京大米科技有限公司 | A kind of remote teaching interactive approach, server, terminal and system |
| CN110225394A (en) * | 2019-04-30 | 2019-09-10 | 北京嗨学网教育科技股份有限公司 | The processing method and processing device of recorded broadcast video knowledge point |
| KR102194240B1 (en) * | 2020-02-10 | 2020-12-23 | (주)혜윰아이씨티 | Knowledge trading platform system through real-time interactive video remote technology |
| CN112309215A (en) * | 2020-11-11 | 2021-02-02 | 黑龙江中医药大学 | Demonstration system for clinical medicine internal medicine teaching and control method thereof |
| CN112330997A (en) * | 2020-11-13 | 2021-02-05 | 北京安博盛赢教育科技有限责任公司 | Method, device, medium and electronic equipment for controlling demonstration video |
-
2021
- 2021-12-16 CN CN202111544564.8A patent/CN114267213A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106409035A (en) * | 2016-12-01 | 2017-02-15 | 陈冲 | Teaching demonstration method, device and system |
| CN108376166A (en) * | 2018-02-24 | 2018-08-07 | 宁夏玲杰科技有限公司 | Intelligence learning method, apparatus and electronic equipment |
| CN108924608A (en) * | 2018-08-21 | 2018-11-30 | 广东小天才科技有限公司 | A kind of householder method and smart machine of video teaching |
| CN110033659A (en) * | 2019-04-26 | 2019-07-19 | 北京大米科技有限公司 | A kind of remote teaching interactive approach, server, terminal and system |
| WO2020215966A1 (en) * | 2019-04-26 | 2020-10-29 | 北京大米科技有限公司 | Remote teaching interaction method, server, terminal and system |
| CN110225394A (en) * | 2019-04-30 | 2019-09-10 | 北京嗨学网教育科技股份有限公司 | The processing method and processing device of recorded broadcast video knowledge point |
| KR102194240B1 (en) * | 2020-02-10 | 2020-12-23 | (주)혜윰아이씨티 | Knowledge trading platform system through real-time interactive video remote technology |
| CN112309215A (en) * | 2020-11-11 | 2021-02-02 | 黑龙江中医药大学 | Demonstration system for clinical medicine internal medicine teaching and control method thereof |
| CN112330997A (en) * | 2020-11-13 | 2021-02-05 | 北京安博盛赢教育科技有限责任公司 | Method, device, medium and electronic equipment for controlling demonstration video |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114743440A (en) * | 2022-04-29 | 2022-07-12 | 长沙酷得网络科技有限公司 | Intelligent programming training environment construction method and device based on application disassembly |
| CN116456062A (en) * | 2023-06-16 | 2023-07-18 | 北京紫云智能科技有限公司 | Teaching implementation method and system for resuscitation flow in wound resuscitation unit |
| CN116456062B (en) * | 2023-06-16 | 2023-08-25 | 北京紫云智能科技有限公司 | Teaching implementation method and system for resuscitation flow in wound resuscitation unit |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110570698B (en) | Online teaching control method and device, storage medium and terminal | |
| CN107316520B (en) | Video teaching interaction method, device, equipment and storage medium | |
| CN111242962A (en) | Method, device and equipment for generating remote training video and storage medium | |
| CN114267213A (en) | Real-time demonstration method, device, equipment and storage medium for practical training | |
| US20210150924A1 (en) | Interactive situational teaching system for use in K12 stage | |
| CN110738895A (en) | Criminal scene investigation real-scene VR comprehensive training system | |
| CN113225575B (en) | Intelligent classroom question answering interaction system and method | |
| CN210091423U (en) | Remote teaching interactive system based on holographic projection | |
| CN105320282A (en) | Image recognition solution based on augmented reality | |
| CN112286354A (en) | Education and teaching method and system based on virtual reality | |
| CN111402662A (en) | Virtual international logistics teaching system of VR | |
| CN111242704B (en) | Method and electronic equipment for superposing live character images in real scene | |
| CN112509401A (en) | Remote real-practice teaching method and system based on augmented reality projection interaction | |
| CN111325853B (en) | Remote coaching system and method based on augmented reality glasses | |
| KR20110058270A (en) | On-line education management system | |
| CN106530160A (en) | Education platform operation method based on monitoring positioning | |
| CN112331001A (en) | Teaching system based on virtual reality technology | |
| CN111353439A (en) | Method, device, system and equipment for analyzing teaching behaviors | |
| CN111985035B (en) | BIM-based achievement display method and device for campus reduction system and storage medium | |
| CN113395534A (en) | Live playback video processing method, device, equipment and storage medium | |
| CN111757140B (en) | Teaching method and device based on live classroom | |
| CN110378261B (en) | Student identification method and device | |
| CN114170859B (en) | Online teaching system and method based on virtual reality | |
| CN112270264A (en) | Multi-party interactive teaching system | |
| CN111031369B (en) | Information screen projection method in control system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |