CN113571099A - Operation recording and broadcasting method and device, electronic equipment and storage medium - Google Patents
Operation recording and broadcasting method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113571099A CN113571099A CN202110713681.6A CN202110713681A CN113571099A CN 113571099 A CN113571099 A CN 113571099A CN 202110713681 A CN202110713681 A CN 202110713681A CN 113571099 A CN113571099 A CN 113571099A
- Authority
- CN
- China
- Prior art keywords
- marking
- video
- instruction
- audio
- recording
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
Abstract
The embodiment of the invention provides a method and a device for recording and broadcasting a surgery, electronic equipment and a storage medium. The operation recording and broadcasting method comprises the following steps: recording audio and video in the operation process; in the recording process, in response to a marking instruction sent by a trigger device in the operation process, marking operation indicated by the marking instruction is executed on the audio/video, and marking information corresponding to the audio/video is obtained and stored. In the embodiment of the invention, the key and difficult points in the marked audio and video can be actively triggered by medical staff who performs the operation in the operation process, and the recorded and broadcast server does not only store the audio and video, but also synchronously stores the marking information aiming at the audio and video in the operation process, so that in the subsequent audio and video editing process, the editing personnel can definitely know which part in the audio and video is the key, the difficult point and the like based on the marking information, thereby needing no doctor who performs the operation to participate in professional guidance, saving the precious time of the doctor and simplifying the processing process.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a method and a device for recording and broadcasting operation, electronic equipment and a storage medium.
Background
In clinical teaching in hospitals, in the traditional operation teaching process, students need to enter an operating room to carry out on-site observation and communication. This approach presents several problems as follows: 1. increases the difficulty for the management of the operating room of the hospital; 2. the probability of surgical cross-infection increases; 3. the space of the operating room is limited, so that the number of observers is limited; 4. the high-value surgical case resources cannot be recycled.
In order to solve various obstacles encountered in the traditional operation teaching, improve the operation teaching efficiency and simplify the operation room management, the high-definition operation teaching recording and broadcasting system is provided by combining the audio and video processing technology and the network technology. The operation teaching recording and broadcasting system can record the audio and video in the operation process so as to be used for teaching of lower-level hospital doctors or demonstrate operation data in an academic conference.
Because the operation process is long and partial process with less teaching significance exists, the recorded audio and video needs to be edited in the later period after the whole recording is finished. However, in the editing process, since the medical operation has high requirements on professional skills and the editing personnel may not have high knowledge of the medical operation, the main doctor is required to guide the editing personnel to complete the editing, and the processing process is complicated.
Disclosure of Invention
In view of the above problems, embodiments of the present invention are proposed to provide a surgical recording and broadcasting method, apparatus, electronic device and storage medium that overcome or at least partially solve the above problems.
In a first aspect, an embodiment of the present invention discloses a surgical recording and broadcasting method, including:
recording audio and video in the operation process;
in the recording process, in response to a marking instruction sent by a trigger device in the operation process, the marking operation indicated by the marking instruction is executed on the audio and video to obtain and store marking information corresponding to the audio and video.
Optionally, the marking instructions include a start marking instruction and an end marking instruction; the start marker instruction includes at least one of: an operation key starting marking instruction, an operation difficulty starting marking instruction and an operation stage starting marking instruction; the end-marker instruction includes at least one of: an operation key ending marking instruction, an operation difficulty ending marking instruction and an operation stage ending marking instruction.
Optionally, the recording audio and video in the surgical procedure includes: responding to a recording starting instruction sent by the trigger equipment in the operation process, and starting to record the audio and video; and/or stopping recording the audio and video in response to a recording ending instruction sent by the trigger equipment in the operation process.
Optionally, the method further comprises: and responding to a playing request sent by playing equipment, and sending the audio and video to the playing equipment after adding a mark point corresponding to the mark information on the playing progress bar of the audio and video based on the mark information.
Optionally, the marking instructions include a start marking instruction and an end marking instruction; the method further comprises the following steps: responding to the starting marking instruction, starting to identify voice data in the audio and video, and obtaining and storing text information corresponding to the voice data; and responding to the end marking instruction, and stopping recognizing the voice data in the audio and video.
Optionally, after the marking operation indicated by the marking instruction is executed on the operation video, the method further includes: and sending the marking instruction to a reminding device, wherein the reminding device and the trigger device are positioned in the same operating room, and the marking instruction is used for indicating the reminding device to send reminding information corresponding to the marking instruction to medical staff who performs the operation.
In a second aspect, an embodiment of the present invention discloses a surgical recording and broadcasting device, including:
the recording module is used for recording the audio and video in the operation process;
and the marking module is used for responding to a marking instruction sent by the trigger equipment in the operation process in the recording process, executing the marking operation indicated by the marking instruction on the audio and video, and obtaining and storing the marking information corresponding to the audio and video.
Optionally, the marking instructions include a start marking instruction and an end marking instruction; the start marker instruction includes at least one of: an operation key starting marking instruction, an operation difficulty starting marking instruction and an operation stage starting marking instruction; the end-marker instruction includes at least one of: an operation key ending marking instruction, an operation difficulty ending marking instruction and an operation stage ending marking instruction.
Optionally, the recording module is specifically configured to start recording the audio and video in response to a recording start instruction sent by the trigger device in the surgical procedure; and/or stopping recording the audio and video in response to a recording ending instruction sent by the trigger equipment in the operation process.
Optionally, the apparatus further comprises: and the adding module is used for responding to a playing request sent by playing equipment, adding a mark point corresponding to the mark information on the playing progress bar of the audio and video based on the mark information, and then sending the audio and video to the playing equipment.
Optionally, the marking instructions include a start marking instruction and an end marking instruction; the device further comprises: the recognition module is used for responding to the starting marking instruction, starting to recognize the voice data in the audio and video, and obtaining and storing text information corresponding to the voice data; and responding to the end marking instruction, and stopping recognizing the voice data in the audio and video.
Optionally, the apparatus further comprises: and the sending module is used for sending the marking instruction to a reminding device, the reminding device and the trigger device are positioned in the same operating room, and the marking instruction is used for indicating the reminding device to send reminding information corresponding to the marking instruction to medical personnel who perform the operation.
In a third aspect, an embodiment of the present invention discloses an electronic device, including: one or more processors; and one or more machine-readable media having instructions stored thereon; the instructions, when executed by the one or more processors, cause the processors to perform a surgical recording method as any one of above.
In a fourth aspect, an embodiment of the present invention discloses a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements a surgical recording and broadcasting method as described in any one of the above.
In the embodiment of the invention, the recording and broadcasting server records the audio and video in the operation process, medical personnel can send a marking instruction to the recording and broadcasting server through the trigger equipment in the operation process, and the recording and broadcasting server responds to the marking instruction in the recording process and executes the marking operation indicated by the marking instruction on the recorded audio and video to obtain and store the marking information corresponding to the audio and video. Therefore, in the embodiment of the invention, the process of marking key points, difficulties and the like in the audio and video can be actively triggered by medical staff who performs the operation in the operation process, and the recording and broadcasting server does not only store the audio and video, but also synchronously stores the marking information aiming at the audio and video in the operation process, so that in the subsequent audio and video editing process, the editing personnel can clearly know which part in the audio and video is the key point, the difficulty and the like based on the marking information, thereby needing no doctor who performs the operation to participate in professional guidance, saving precious time of the doctor and having simpler and more convenient processing process.
Drawings
Fig. 1 is a schematic structural diagram of a recording and broadcasting system according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating the steps of a surgical recording and broadcasting method according to an embodiment of the present invention;
FIG. 3 is a flow chart illustrating steps of another surgical recording and broadcasting method according to an embodiment of the present invention;
fig. 4 is a block diagram of a surgical recording and broadcasting apparatus according to an embodiment of the present invention;
fig. 5 is a block diagram of another surgical recording and broadcasting apparatus according to an embodiment of the present invention.
Detailed Description
Technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are some, but not all, of the embodiments of the present disclosure. All other embodiments, which can be obtained by a person skilled in the art without making creative efforts based on the embodiments of the present disclosure, belong to the protection scope of the embodiments of the present disclosure.
The embodiment of the invention can be applied to a recording and broadcasting system. Next, the architecture of the recording and playing system will be described.
Referring to fig. 1, a schematic architecture diagram of a recording and playing system according to an embodiment of the present invention is shown.
As shown in fig. 1, the recording and broadcasting system may include a recording and broadcasting server 101, an image pickup apparatus 102, a trigger apparatus 103, a reminder apparatus 104, and a playing apparatus 105. The image pickup device 102, the trigger device 103, the reminder device 104, and the playback device 105 can perform bidirectional communication with the recording and playing server 101. The image pickup apparatus 102, the trigger apparatus 103, the reminder apparatus 104, and the playback apparatus 105 can also each perform bidirectional communication therebetween (not shown in fig. 1). It should be noted that the recording and playing system may also include other devices or modules besides the device shown in fig. 1, and the embodiments of the present invention are not discussed in detail herein.
The recording and broadcasting server 101 can realize the functions of audio and video recording, audio and video storage, audio and video marking, voice recognition, instruction receiving and sending and the like.
The camera device 102 can realize audio and video acquisition and send the acquired audio and video to the recording and playing server 101. The image capturing apparatus may include, but is not limited to, at least one of: various cameras, mobile terminals with camera functions, and the like.
The trigger device 103 may be operated by a medical staff performing an operation to enable the trigger device 103 to generate a relevant instruction, and send the instruction to the recording and broadcasting server 101. The triggering device may include, but is not limited to, at least one of: foot pedals, remote controls, voice recognition devices, gesture recognition devices, and the like.
The reminding device 104 can receive the relevant instruction sent by the recording and broadcasting server 101, and send out reminding information. The reminder device may include, but is not limited to, at least one of: cameras, light emitting elements, etc.
The playing device 105 can realize the functions of downloading the audio and video from the recording and playing server 101, playing the downloaded audio and video, and the like. The playing device may include various players.
Typically, the imaging device 102, the triggering device 103 and the reminder device 104 are provided in the same operating room. In the process of performing an operation in the operating room, the video and audio in the operation process are collected by the camera device 102 and uploaded to the recording and playing server 101. The medical staff performing the operation performs the relevant operation so as to trigger the trigger device 103 to generate the marking instruction and send the marking instruction to the recording server 101. After the recording and broadcasting server 101 executes the marking operation, the corresponding marking instruction is sent to the reminding device 104, so that the reminding device 104 reminds the medical staff performing the operation of the marking result.
Referring to fig. 2, a flowchart illustrating steps of a surgical recording and broadcasting method according to an embodiment of the present invention is shown. The surgical recording and broadcasting method shown in fig. 2 can be executed in a recording and broadcasting server.
As shown in fig. 2, the surgical recording and broadcasting method may include the following steps:
In the operation process, the video and the audio in the operation process are collected by the camera device in real time, and the collected video and the audio are sent to the recording and broadcasting server. And the recording and broadcasting server records the audio and video in the operation process and stores the recorded audio and video.
In the operation process, if the medical staff performing the operation wants to mark the audio and video, for example, mark operation key points, operation difficulty points, operation stages and the like, the medical staff can execute corresponding operations to enable the trigger device to generate a mark instruction, and the trigger device sends the mark instruction to the recording and broadcasting server.
And after receiving the marking instruction, the recording and broadcasting server responds to the marking instruction, executes the marking operation indicated by the marking instruction on the recorded audio and video to obtain the marking information corresponding to the audio and video, and stores the marking information corresponding to the audio and video.
In the embodiment of the invention, the recording and broadcasting server records the audio and video in the operation process, medical personnel can send a marking instruction to the recording and broadcasting server through the trigger equipment in the operation process, and the recording and broadcasting server responds to the marking instruction in the recording process and executes the marking operation indicated by the marking instruction on the recorded audio and video to obtain and store the marking information corresponding to the audio and video. Therefore, compared with the prior art, when editing recorded audio/video, due to limited professional skills of editing personnel, which part in the operation process is the key point, the difficulty point and the like cannot be accurately determined, so that a doctor who performs the operation also needs to participate in the editing process so as to perform professional guidance. In the embodiment of the invention, the key and difficult points in the marked audio and video can be actively triggered by medical staff who performs the operation in the operation process, and the recorded and broadcast server does not only store the audio and video, but also synchronously stores the marking information aiming at the audio and video in the operation process, so that in the subsequent audio and video editing process, the editing personnel can clearly know which part in the audio and video is the key, the difficult point and the like based on the marking information, thereby avoiding the participation of doctors who perform the operation in professional guidance, saving the precious time of the doctors and ensuring that the processing process is simpler and more convenient.
Referring to fig. 3, a flowchart illustrating steps of a surgical recording and broadcasting method according to an embodiment of the present invention is shown. The surgical recording and broadcasting method shown in fig. 3 can be executed in the recording and broadcasting server.
As shown in fig. 3, the surgical recording and broadcasting method may include the following steps:
In practical application, for different types of trigger devices, the medical staff performing the operation can perform different operations, so that the trigger devices generate corresponding instructions, and the same trigger device can be triggered to generate a plurality of different instructions. The following examples are given.
Under the condition that the triggering device is a pedal, the corresponding relation between the pedal action and the instruction can be preset, and medical personnel performing the operation can trigger the pedal to generate different instructions by executing different pedal actions. For example, different continuous pedaling times correspond to different instructions, and the continuous pedaling may mean that a time interval between two pedaling is smaller than a certain threshold; different pedaling rhythms correspond to different instructions, for example, pedaling once, pedaling twice continuously within a certain time interval to form one pedaling rhythm, pedaling twice continuously first, and pedaling once again within a certain time interval to form another pedaling rhythm, and the like. The related setting may be specifically performed according to an actual situation, and the embodiment of the present invention is not limited to this.
Under the condition that the triggering device is a remote controller, the corresponding relation between the keys of the remote controller and the instructions can be preset, and medical personnel performing the operation can trigger the remote controller to generate different instructions by pressing different keys.
Under the condition that the trigger equipment is voice recognition equipment, the corresponding relation between the text and the instruction can be preset, medical personnel who perform operations can send out voice, and the voice recognition equipment recognizes the voice of the medical personnel to obtain the corresponding text, so that the instruction corresponding to the text is generated.
The system mainly comprises four parts, namely feature extraction, an acoustic model, a language model, a dictionary and decoding, wherein in order to effectively extract features, preprocessing operations such as filtering, framing and the like are also needed to be carried out on collected sound signals, and signals to be analyzed are extracted from original signals; then, the feature extraction work converts the sound signal from a time domain to a frequency domain, and provides a proper feature vector for the acoustic model; calculating the score of each feature vector on the acoustic features according to the acoustic characteristics in the acoustic model; the language model calculates the probability of the sound signal corresponding to the possible phrase sequence according to the theory related to linguistics; and finally, decoding the phrase sequence according to the existing dictionary to obtain the final possible text representation.
In practical applications, the acoustic Model may adopt HMM (Hidden Markov Model) architecture, GMM (Gaussian Mixture Model) -HMM architecture, DNN (Deep Neural Networks) -HMM architecture, and the like. The Language Model may employ an N-gram LM (N-gram Language Model) architecture, an NNLM (Neural Network Language Model) architecture, or the like.
Under the condition that the trigger device is the gesture recognition device, the corresponding relation between the gesture and the instruction can be preset, medical personnel who perform operations can make the gesture, and the voice recognition device recognizes the gesture of the medical personnel and further generates the instruction corresponding to the gesture.
In practical application, gesture recognition can be performed based on an algorithm, or gesture recognition can be performed based on a neural network, or gesture recognition can be performed based on a gesture sample library. The basic flow based on the algorithm is to define the processing rules and conditions, which are required to meet the requirements of the processing results. In gesture recognition, the result of this algorithm requires a binary object, which is either a gesture that is consistent with a predetermined gesture or not. The neural network is organized and judged based on statistics and probabilities, and contains many neurons, each of which is a good algorithm that can be used to judge the motion of a subtle part of a gesture. In a neural network, many gestures may share neurons, and the neurons have efficient data structures to process information. A sample-base or template-based gesture recognition system can match a person's gesture to known gestures for gesture recognition.
It is contemplated that some of the more basic surgical procedures may be less pedagogically meaningful and take longer during the surgical procedure. Such as surgical preparation procedures, less technically difficult surgical dissection procedures, suturing procedures, and the like. In practice, recording may not be necessary for these basic surgical procedures. Therefore, in the embodiment of the invention, in the operation process, the medical staff can execute corresponding operation to enable the trigger equipment to generate the recording instruction, and the trigger equipment sends the recording instruction to the recording and broadcasting server. And after receiving the recording instruction, the recording and broadcasting server responds to the recording instruction and records the audio and video in the operation process.
The recording instruction may include a start recording instruction and/or an end recording instruction. Thus, in response to the recording instruction, the process of recording audio and video during the surgical procedure may include: responding to a recording starting instruction sent by the trigger equipment in the operation process, and starting to record the audio and video; and/or stopping recording the audio and video in response to a recording ending instruction sent by the trigger equipment in the operation process.
Under the condition that the recording instruction comprises a recording starting instruction and does not comprise a recording ending instruction, the recording and broadcasting server can stop recording the audio and video when the camera equipment stops sending the audio and video in the operation process, namely the recording and broadcasting server does not receive the audio and video sent by the camera equipment any more.
Under the condition that the recording instruction includes a recording start instruction and does not include a recording end instruction, the recording and broadcasting server can stop recording the audio and video when the camera equipment stops sending the audio and video in the operation process (for example, when the operation is ended, the camera equipment stops sending the audio and video in the operation process), that is, the recording and broadcasting server does not receive the audio and video sent by the camera equipment any more.
When the recording instruction includes a recording ending instruction and does not include a recording starting instruction, the recording and broadcasting server may start recording the audio and video when the camera device starts to transmit the audio and video in the operation process (for example, when the operation starts, the camera device starts to transmit the audio and video in the operation process), that is, when the recording and broadcasting server starts to receive the audio and video transmitted by the camera device.
And 302, in the recording process, responding to a marking instruction sent by a trigger device in the operation process, executing the marking operation indicated by the marking instruction on the audio/video, and obtaining and storing marking information corresponding to the audio/video.
In the operation process, medical personnel who carry out the operation can carry out corresponding operation so that trigger equipment generates the mark instruction, and trigger equipment sends the mark instruction to recorded broadcast server. And in the process of recording the audio and video, the recording and broadcasting server responds to the marking instruction after receiving the marking instruction, executes the marking operation indicated by the marking instruction on the audio and video to obtain the marking information corresponding to the audio and video, and stores the marking information corresponding to the audio and video. Therefore, the surgery recording file can include audio and video in the surgery process, marking information corresponding to the audio and video, and the like.
Optionally, the marking instructions comprise a start marking instruction and an end marking instruction. The start marker instruction includes at least one of: an operation key point starting marking instruction, an operation difficulty starting marking instruction and an operation stage starting marking instruction. The end-marker instruction includes at least one of: an operation key ending marking instruction, an operation difficulty ending marking instruction and an operation stage ending marking instruction. The surgical stage may include any stage of the actual surgical procedure, such as an incision stage, a hemostasis stage, a suture stage, a bypass stage, and so forth.
Correspondingly, the marking operation indicated by the operation focus starting marking instruction is to mark the start of the operation focus, the marking operation indicated by the operation focus ending marking instruction is to mark the end of the operation focus, the marking operation indicated by the operation difficulty starting marking instruction is to mark the start of the operation difficulty, the marking operation indicated by the operation focus ending marking instruction is to mark the end of the operation focus, the marking operation indicated by the operation stage starting marking instruction is to mark the start of the operation stage, and the marking operation indicated by the operation stage ending marking instruction is to mark the end of the operation stage.
Optionally, the marking information may include, but is not limited to, at least one of: the type of marking operation, the point in time of the marking operation (which may refer to a corresponding point in time in the audio-video), etc.
For a surgical focus start marker instruction, the marker information may include the start of the surgical focus at xxx time points, and for a surgical focus end marker instruction, the marker information may include the end of the surgical focus at xxx time points. For the operation difficulty start marking instruction, the marking information can comprise the start of the operation difficulty at the xxx time point, and for the operation difficulty end marking instruction, the marking information can comprise the end of the operation difficulty at the xxx time point. For a surgical phase start marker instruction, marker information may include the start of the surgical phase at xxx time points, and for a surgical phase end marker instruction, marker information may include the end of the surgical phase at xxx time points.
In the embodiment of the invention, the corresponding relation between the marking instruction and the reminding information can be preset. The recording and broadcasting server can also send the marking instruction to the reminding equipment after the marking operation indicated by the marking instruction is executed on the audio and video to obtain and store the marking information corresponding to the audio and video. After the reminding device receives the marking instruction, the corresponding relation between the marking instruction and the reminding information is inquired, and the reminding information corresponding to the marking instruction is sent to the medical staff who performs the operation. Of course, in practical application, it may also be set to specifically remind which marking instruction or instructions.
In practical application, the reminding device and the triggering device are located in the same operating room. The trigger device is triggered by medical personnel who perform operations through executing corresponding operations, so that the trigger device generates a marking instruction, and the marking instruction is sent to the recording and broadcasting server, so that the recording and broadcasting server marks recorded audio and video according to the marking instruction. And after the recording and broadcasting server marks, the marking instruction is sent to the reminding device, so that the reminding device sends reminding information corresponding to the marking instruction to the medical personnel who perform the operation, and the medical personnel who perform the operation can timely know the current marking result.
Optionally, the reminder information may include, but is not limited to, at least one of: color, sound, numbers, letters, etc. For example, different surgical procedures may correspond to different colors, etc.
Taking the reminding information as a color as an example, for the operation key point start marking instruction, the reminding information can be a first color for starting to send out, and for the operation key point end marking instruction, the reminding information can be a first color for stopping sending out. For the operation difficulty start marking instruction, the reminding information can be a second color for starting to send out, and for the operation difficulty end marking instruction, the reminding information can be a second color for stopping sending out. For the surgical phase start marking instruction, the reminding information can be used for starting to emit the third color, and for the surgical phase end marking instruction, the reminding information can be used for stopping emitting the third color. For example, the preoperative preparation phase for recording is green; the key/difficult stage of the operation is red; difficulty of surgery ends with yellow color, etc.
And 304, responding to a marking instruction sent by the trigger device in the operation process, identifying the voice data in the audio and video, and obtaining and storing text information corresponding to the voice data.
In consideration of the fact that certain parts in the operation process are important, the embodiment of the invention provides that on the basis of marking the audio and video, the marked parts are further subjected to voice recognition to obtain text information corresponding to the marked parts, so that the marked parts are described more intuitively and in more detail. Therefore, the recording and broadcasting server responds to the marking instruction sent by the trigger equipment, identifies the voice data in the audio and video, and obtains and stores the text information corresponding to the voice data. Of course, in practical applications, it may also be set to which marking instruction or instructions are specifically targeted for voice recognition.
In the implementation, the recording and broadcasting server responds to a marking starting instruction, starts to identify voice data in the audio and video, and obtains and stores text information corresponding to the voice data; and responding to the end marking instruction, and stopping recognizing the voice data in the audio and video. For the specific process of speech recognition, reference may be made to the above description of speech recognition, and any suitable speech recognition mode may be adopted in implementation, and the embodiments of the present invention are not discussed in detail herein.
When the audio and video recorded by the recording and playing server needs to be played on the playing device, for example, teaching needs to be performed by using the recorded audio and video, an academic conference needs to be performed, and the like, the user can execute corresponding operations on the playing device so as to trigger the playing device to generate a playing request, and the playing request is sent to the recording and playing server. The recording and playing server can send the recorded audio and video to the playing equipment for playing.
In the process of watching the operation audio and video, the viewer usually locates the interested content through the progress bar, and the locating is blind. Therefore, in the embodiment of the present invention, the recording and playing server responds to the playing request sent by the playing device, adds the mark point corresponding to the mark information on the playing progress bar of the audio and video based on the mark information, and then sends the audio and video to the playing device, so that the viewer can more intuitively and more accurately position the content of interest through the mark point.
Optionally, after receiving a play request sent by the play device, the recording and playing server responds to the play request, generates a prompt control corresponding to the mark information based on the mark information, embeds the prompt control into the audio and video, and then sends the audio and video to the play device.
The prompt control can be a prompt bar, and different prompts can be performed on different marking information in the prompt bar. For example, when the audio and video is played to a key part, a difficult part, different operation stages and the like, different colors can be displayed for prompting, and the like.
Corresponding to the step 304, the text information corresponding to the voice data is obtained and stored by recognizing the voice data in the audio and video, and the recording and playing server can also send the text information to the playing device together, so that the playing device can play the text information at the same time, and a viewer can know more detailed contents.
Referring to fig. 4, a block diagram of a surgical recording and broadcasting apparatus according to an embodiment of the present invention is shown.
As shown in fig. 4, the surgical recording and broadcasting apparatus may include the following modules:
the recording module 401 is used for recording the audio and video in the operation process;
and the marking module 402 is configured to, in the recording process, respond to a marking instruction sent by the trigger device in the surgical process, execute a marking operation indicated by the marking instruction on the audio/video, and obtain and store marking information corresponding to the audio/video.
Referring to fig. 5, a block diagram of a surgical recording and broadcasting apparatus according to an embodiment of the present invention is shown.
As shown in fig. 5, the surgical recording and broadcasting device may include the following modules:
the recording module 501 is used for recording the audio and video in the operation process;
and the marking module 502 is used for responding to a marking instruction sent by the trigger device in the operation process in the recording process, executing the marking operation indicated by the marking instruction on the audio/video, and obtaining and storing marking information corresponding to the audio/video.
Optionally, the marking instructions include a start marking instruction and an end marking instruction; the start marker instruction includes at least one of: an operation key starting marking instruction, an operation difficulty starting marking instruction and an operation stage starting marking instruction; the end-marker instruction includes at least one of: an operation key ending marking instruction, an operation difficulty ending marking instruction and an operation stage ending marking instruction.
Optionally, the recording module 502 is specifically configured to start recording the audio and video in response to a recording start instruction sent by the trigger device in the surgical procedure; and/or stopping recording the audio and video in response to a recording ending instruction sent by the trigger equipment in the operation process.
Optionally, the apparatus further comprises: the adding module 503 is configured to respond to a play request sent by a playing device, add a mark point corresponding to the mark information to the playing progress bar of the audio and video based on the mark information, and then send the audio and video to the playing device.
Optionally, the marking instructions include a start marking instruction and an end marking instruction; the device further comprises: the recognition module 504 is configured to start recognizing voice data in the audio and video in response to the start marking instruction, and obtain and store text information corresponding to the voice data; and responding to the end marking instruction, and stopping recognizing the voice data in the audio and video.
Optionally, the apparatus further comprises: a sending module 505, configured to send the marking instruction to a reminding device, where the reminding device and the triggering device are located in the same operating room, and the marking instruction is used to instruct the reminding device to send reminding information corresponding to the marking instruction to a medical worker who performs an operation.
In the embodiment of the invention, the key and difficult points in the marked audio and video can be actively triggered by medical staff who performs the operation in the operation process, and the recorded and broadcast server does not only store the audio and video, but also synchronously stores the marking information aiming at the audio and video in the operation process, so that in the subsequent audio and video editing process, the editing personnel can definitely know which part in the audio and video is the key, the difficult point and the like based on the marking information, thereby needing no doctor who performs the operation to participate in professional guidance, saving the precious time of the doctor and simplifying the processing process.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
In an embodiment of the invention, an electronic device is also provided. The electronic device may include one or more processors and one or more machine-readable media having instructions, such as an application program, stored thereon. The instructions, when executed by the one or more processors, cause the processors to perform the surgical recording method described above.
In an embodiment of the present invention, there is also provided a non-transitory computer-readable storage medium having a computer program stored thereon, the program being executable by a processor of an electronic device to perform the above-mentioned surgical recording and broadcasting method. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The operation recording and broadcasting method, the operation recording and broadcasting device, the electronic device and the storage medium provided by the invention are introduced in detail, specific examples are applied in the description to explain the principle and the implementation mode of the invention, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A method for recording and broadcasting a surgical operation, the method comprising:
recording audio and video in the operation process;
in the recording process, in response to a marking instruction sent by a trigger device in the operation process, the marking operation indicated by the marking instruction is executed on the audio and video to obtain and store marking information corresponding to the audio and video.
2. The method of claim 1,
the marking instructions comprise a start marking instruction and an end marking instruction;
the start marker instruction includes at least one of: an operation key starting marking instruction, an operation difficulty starting marking instruction and an operation stage starting marking instruction;
the end-marker instruction includes at least one of: an operation key ending marking instruction, an operation difficulty ending marking instruction and an operation stage ending marking instruction.
3. The method of claim 1, wherein the recording of audio and video during a surgical procedure comprises:
responding to a recording starting instruction sent by the trigger equipment in the operation process, and starting to record the audio and video;
and/or the presence of a gas in the gas,
and responding to a recording ending instruction sent by the trigger equipment in the operation process, and stopping recording the audio and video.
4. The method of claim 1, further comprising:
and responding to a playing request sent by playing equipment, and sending the audio and video to the playing equipment after adding a mark point corresponding to the mark information on the playing progress bar of the audio and video based on the mark information.
5. The method of claim 1, wherein the marker instructions comprise a start marker instruction and an end marker instruction; the method further comprises the following steps:
responding to the starting marking instruction, starting to identify voice data in the audio and video, and obtaining and storing text information corresponding to the voice data;
and responding to the end marking instruction, and stopping recognizing the voice data in the audio and video.
6. The method of claim 1, further comprising, after performing the marking operation indicated by the marking instruction on the surgical video:
and sending the marking instruction to a reminding device, wherein the reminding device and the trigger device are positioned in the same operating room, and the marking instruction is used for indicating the reminding device to send reminding information corresponding to the marking instruction to medical staff who performs the operation.
7. A surgical recording and broadcasting device, the device comprising:
the recording module is used for recording the audio and video in the operation process;
and the marking module is used for responding to a marking instruction sent by the trigger equipment in the operation process in the recording process, executing the marking operation indicated by the marking instruction on the audio and video, and obtaining and storing the marking information corresponding to the audio and video.
8. The apparatus of claim 7,
the marking instructions comprise a start marking instruction and an end marking instruction;
the start marker instruction includes at least one of: an operation key starting marking instruction, an operation difficulty starting marking instruction and an operation stage starting marking instruction;
the end-marker instruction includes at least one of: an operation key ending marking instruction, an operation difficulty ending marking instruction and an operation stage ending marking instruction.
9. An electronic device, comprising:
one or more processors; and
one or more machine-readable media having instructions stored thereon;
the instructions, when executed by the one or more processors, cause the processors to perform the surgical recording method of any of claims 1-6.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out a surgical recording method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110713681.6A CN113571099A (en) | 2021-06-25 | 2021-06-25 | Operation recording and broadcasting method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110713681.6A CN113571099A (en) | 2021-06-25 | 2021-06-25 | Operation recording and broadcasting method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113571099A true CN113571099A (en) | 2021-10-29 |
Family
ID=78162764
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110713681.6A Pending CN113571099A (en) | 2021-06-25 | 2021-06-25 | Operation recording and broadcasting method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113571099A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116506674A (en) * | 2023-07-01 | 2023-07-28 | 世优（北京）科技有限公司 | Target event triggering method and device based on virtual object |
-
2021
- 2021-06-25 CN CN202110713681.6A patent/CN113571099A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116506674A (en) * | 2023-07-01 | 2023-07-28 | 世优（北京）科技有限公司 | Target event triggering method and device based on virtual object |
| CN116506674B (en) * | 2023-07-01 | 2023-09-05 | 世优（北京）科技有限公司 | Target event triggering method and device based on virtual object |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110971964B (en) | Intelligent comment generation and playing method, device, equipment and storage medium | |
| CN106548773B (en) | Child user searching method and device based on artificial intelligence | |
| US20200286396A1 (en) | Following teaching system having voice evaluation function | |
| CN108159702B (en) | Multi-player voice game processing method and device | |
| CN109036372B (en) | Voice broadcasting method, device and system | |
| CN110032355B (en) | Voice playing method and device, terminal equipment and computer storage medium | |
| WO2016136104A1 (en) | Information processing device, information processing method, and program | |
| CN109240786A (en) | A kind of subject replacement method and electronic equipment | |
| CN112992124A (en) | Feedback type language intervention method, system, electronic equipment and storage medium | |
| CN113571099A (en) | Operation recording and broadcasting method and device, electronic equipment and storage medium | |
| CN109376145B (en) | Method and device for establishing movie and television dialogue database and storage medium | |
| CN106571087A (en) | Teaching system with memory function, and teaching method | |
| CN110164020A (en) | Ballot creation method, device, computer equipment and computer readable storage medium | |
| CN110808075B (en) | Intelligent recording and broadcasting method | |
| US10872091B2 (en) | Apparatus, method, and system of cognitive data blocks and links for personalization, comprehension, retention, and recall of cognitive contents of a user | |
| CN109033448A (en) | A kind of study bootstrap technique and private tutor's equipment | |
| JP4651981B2 (en) | Education information management server | |
| CN114971975B (en) | Learning abnormity prompting method and system for online education platform | |
| CN107452408B (en) | Audio playing method and device | |
| CN116403583A (en) | Voice data processing method and device, nonvolatile storage medium and vehicle | |
| JP4085015B2 (en) | STREAM DATA GENERATION DEVICE, STREAM DATA GENERATION SYSTEM, STREAM DATA GENERATION METHOD, AND PROGRAM | |
| CN112820265A (en) | Speech synthesis model training method and related device | |
| CN110111640A (en) | It practises handwriting learning method, calligraphy practising pen and terminal device | |
| CN110148414A (en) | A kind of voice saying bootstrap technique and device | |
| CN112752142B (en) | Dubbing data processing method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |