WO2021253730A1 - Assessment video generation method and apparatus, and computer device and storage medium - Google Patents
Assessment video generation method and apparatus, and computer device and storage medium Download PDFInfo
- Publication number
- WO2021253730A1 WO2021253730A1 PCT/CN2020/132975 CN2020132975W WO2021253730A1 WO 2021253730 A1 WO2021253730 A1 WO 2021253730A1 CN 2020132975 W CN2020132975 W CN 2020132975W WO 2021253730 A1 WO2021253730 A1 WO 2021253730A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- temporary file
- video
- file
- assessment
- display interface
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 107
- 230000004044 response Effects 0.000 claims abstract description 54
- 239000000523 sample Substances 0.000 claims abstract description 28
- 238000002604 ultrasonography Methods 0.000 claims description 113
- 238000011156 evaluation Methods 0.000 claims description 68
- 238000004590 computer program Methods 0.000 claims description 31
- 238000011017 operating method Methods 0.000 claims description 13
- 230000008569 process Effects 0.000 abstract description 12
- 238000005516 engineering process Methods 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 3
- 238000003745 diagnosis Methods 0.000 description 2
- 238000002059 diagnostic imaging Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 210000004185 liver Anatomy 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 210000000496 pancreas Anatomy 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 238000012285 ultrasound imaging Methods 0.000 description 1
- 210000004291 uterus Anatomy 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/441—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
- H04N21/4438—Window management, e.g. event handling following interaction with the user interface
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
Definitions
- This application relates to the field of medical imaging technology, and in particular to a method, device, computer equipment, and storage medium for generating a scanning skill assessment video in an ultrasonic detection process.
- Ultrasound examination is a method of medical imaging examination, which assists clinicians in the diagnosis of diseases, and can also be used to evaluate the efficacy and guide the next treatment. Under normal circumstances, it is necessary to train and guide junior physicians in ultrasound scanning skills to improve the technical level of junior physicians.
- a method for generating an assessment video comprising:
- the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skills.
- the response to the video recording instruction to start acquiring the display interface image of the ultrasound display terminal includes:
- a new window is created in the display interface of the ultrasound display terminal, and all areas of the display interface corresponding to the window except the ultrasound image area are blocked;
- the generating the first temporary file according to the acquired image sequence of the display interface and generating the second temporary file according to the acquired image sequence of the operation technique includes:
- the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
- the merging the first temporary file and the second temporary file to generate an assessment video file corresponding to the ultrasound scanning skill includes:
- the second temporary file is appended to the end position of the first temporary file to generate an assessment video file corresponding to the ultrasound scanning skill.
- the number of the assessment video files is multiple; the method further includes:
- the cloud server In response to the upload instruction, upload the evaluation video file to be uploaded to a cloud server; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
- the method before the responding to the video recording instruction, the method further includes:
- the login instruction In response to a login instruction, log in to the ultrasound display terminal; the login instruction includes a user identification of the examined physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
- the merging the first temporary file with the second temporary file when the video recording ends includes:
- the video recording is ended, and the first temporary file and the second temporary file are merged;
- the video recording is ended, and the first temporary file and the second temporary file are merged.
- a processing device for assessment data comprising:
- the image acquisition module is used to start acquiring the display interface image of the ultrasonic display terminal in response to the video recording instruction, and at the same time turn on the image acquisition device to perform image acquisition on the operating method of the ultrasonic probe;
- the temporary file generating module is configured to generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of manipulation techniques;
- the video file generating module is configured to merge the first temporary file with the second temporary file when the video recording ends to generate an assessment video file corresponding to the ultrasound scanning skill.
- a computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when the computer program is executed:
- the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skills.
- the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skills.
- the method, device, computer equipment and storage medium for generating the above assessment video start to acquire the display interface image of the ultrasonic display terminal by responding to the video recording instruction, and at the same time turn on the image acquisition device to perform image acquisition on the operating technique of the ultrasonic probe;
- the acquired display interface image sequence generates a first temporary file, and a second temporary file is generated according to the acquired operation technique image sequence; when the video recording is over, the first temporary file and the second temporary file are merged to generate an ultrasound scan
- the assessment video files can be used to assess the ultrasound scanning skills of junior physicians, which changes the assessment method of ultrasound scanning skills in traditional technology, avoids expert physicians from viewing the scanning process of junior physicians on site, and improves the assessment efficiency of ultrasound scanning skills .
- FIG. 1 is an application environment diagram of a method for generating an assessment video in an embodiment
- FIG. 2 is a schematic flowchart of a method for generating an assessment video in an embodiment
- FIG. 3 is a schematic flowchart of step S202 in an embodiment
- FIG. 4 is a schematic flowchart of step S204 in an embodiment
- Figure 5a is a schematic flowchart of a method for generating an assessment video in an embodiment
- Figure 5b is a schematic diagram of an interface for uploading an assessment video in an embodiment
- Figure 6 is a schematic diagram of a login interface of an ultrasound display terminal in an embodiment
- FIG. 7 is a schematic flowchart of a method for generating an assessment video in an embodiment
- Figure 8a is a schematic diagram of an evaluation query interface of a first terminal in an embodiment
- Figure 8b is a schematic diagram of an evaluation query interface of the first terminal in an embodiment
- Figure 9 is a structural block diagram of a device for generating assessment videos in an embodiment
- Fig. 10 is an internal structure diagram of a computer device in an embodiment.
- the method for generating assessment videos provided in this application can be applied to the application environment as shown in FIG. 1.
- the ultrasound display terminal 102 communicates with the cloud server 104 through the network.
- the first terminal 106 used by the physician to be assessed (usually a junior physician) and the second terminal 108 used by the expert physician also communicate with the cloud server 104 via the network.
- the ultrasonic display terminal 102 responds to the video recording instruction to start acquiring the display interface image of the ultrasonic display terminal, and at the same time, the image acquisition device is turned on to perform image acquisition of the operating method of the ultrasonic probe; thus, the first temporary file is generated according to the acquired display interface image sequence , Generate a second temporary file according to the collected operation technique image sequence; when the video recording ends, merge the first temporary file with the second temporary file to generate an assessment video file corresponding to the ultrasound scanning skills.
- the ultrasound imaging equipment includes an ultrasound probe and an ultrasound display terminal 102.
- the ultrasound display terminal 102 includes a processor, a display, and a memory.
- the processor processes the ultrasonic echo signal/data to obtain the ultrasonic image of the target part or the ultrasonic image of the interventional object.
- the ultrasound images obtained by the processor can be stored in the memory, and these ultrasound images can be displayed on the display or sent to the ultrasound workstation.
- the first terminal 106 and the second terminal 108 can be, but are not limited to, various personal computers, laptops, smart phones, tablets, and portable wearable devices.
- the cloud server 104 can be an independent server or a server cluster composed of multiple servers. to realise.
- a method for generating an assessment video is provided. Taking the method applied to the ultrasound display terminal 102 in FIG. 1 as an example for description, the method includes the following steps:
- the primary physician when performing medical ultrasound testing, operates the ultrasound probe to scan the target site to be tested.
- the ultrasonic display terminal applies an electrical signal to the ultrasonic probe through the ultrasonic cable so that the ultrasonic probe emits ultrasonic waves to the target site to be detected.
- the ultrasonic probe receives the echo signal reflected by the target part and feeds the echo signal back to the ultrasonic display terminal through the ultrasonic cable.
- the ultrasonic display terminal can generate an ultrasonic image of the target part according to the echo signal for diagnosis by the physician.
- the target part is a part of interest of the physician, such as liver, pancreas, uterus, etc.
- a corresponding display interface can be provided for primary physicians to operate.
- the above display interface can include controls such as a logo marquee or a menu bar.
- the junior doctor can input the operation instructions for the ultrasound image through the display interface according to the actual use situation, so as to perform operations such as measurement of the ultrasound image through the ultrasound display terminal.
- the operating methods of the ultrasound probe may include forward, backward, rotating, tilting to the left, tilting to the right, increasing or decreasing the force, acceleration and deceleration, etc. of the ultrasound probe.
- the image acquisition device can collect the image of the doctor's operation method of the ultrasound probe, thereby saving his operation method of the ultrasound probe, and lay the foundation for generating the assessment video file.
- a video recording button is set in the display interface of the ultrasound display terminal, and the video recording button is triggered when the junior physician performs scanning exercises or scanning examinations on the ultrasound display terminal.
- the ultrasound display terminal responds to the video recording instruction issued by the primary physician, and not only starts to record the screen of the display interface of the ultrasound display terminal, but also turns on the image acquisition device to perform image acquisition on the operating method of the ultrasound probe.
- the ultrasound scanning process of the primary physician can be completely preserved, so that the expert physician can subsequently evaluate the skill level of the primary physician.
- the shooting range of the image acquisition device may include the operation technique of the ultrasound probe, and may also include the face of the primary physician, so as to avoid the occurrence of cheating.
- S204 Generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of the manipulation technique.
- a series of display interface images obtained by recording the display interface of the ultrasound display device constitute a display interface image sequence.
- a series of manipulation images collected by the image capture device constitutes a sequence of manipulation images.
- this application creatively uses the display interface image sequence and the operation technique image sequence to create the evaluation video file, and when playing the evaluation video file, it is necessary to ensure that the time correspondence between the display interface image and the operation technique image is followed Relationship, the two will be played synchronously. Therefore, in order to ensure the accuracy of the data and the subsequent generation of an orderly assessment video file, the display interface image and the operation technique image are respectively temporarily saved.
- the acquired image sequence of the display interface is saved in the first temporary file, and the acquired operation technique image sequence is saved in the second temporary file.
- the first temporary file and the second temporary file are merged to generate a video file, which reduces the time and effort spent on the evaluation of expert physicians.
- the assessment video file is provided with a file header, and the file header information includes the data length information of the assessment video file.
- the assessment video file corresponding to the scanning skill ensures that the two parts of the image have the same end time; the synchronization of the display interface image screen and the operation method image screen in the assessment video file is realized, so that the assessment video file can be used for the ultrasound of the junior physician
- the assessment of scanning skills has changed the assessment method of ultrasonic scanning skills in traditional technology, avoiding expert physicians from viewing the scanning process of junior physicians on site, and improving the assessment efficiency of ultrasonic scanning skills.
- starting to acquire a display interface image of the ultrasound display terminal includes the following steps:
- the display interface image of the ultrasound display terminal includes not only the ultrasound image area, but also other areas that display patient information, doctor information, and hospital information. Specifically, in order to ensure the fairness of the assessment, it is necessary for expert physicians to hide this information in other areas. Therefore, before starting the video recording, that is, after responding to the video recording instruction, a new window can be created in the display interface of the ultrasound display terminal.
- the window can be invisible to the assessed physician, that is, the information seen by the assessed physician still includes the information of the ultrasound image area and other areas, while the expert physician only needs to see the ultrasound In the image area, all areas of the display interface corresponding to the newly created window except the ultrasound image area are blocked, so that the corresponding display interface image is obtained based on the newly created window.
- a new window is created, and all areas except the ultrasound image area in the display interface corresponding to the window are blocked, which ensures the fairness of the assessment.
- generating the first temporary file according to the acquired display interface image sequence, and generating the second temporary file according to the acquired operation technique image sequence includes the following steps:
- S402 Acquire a display interface image at a preset frame rate, and write them in the first temporary file sequentially in chronological order;
- S404 Collect the operation technique images at the same preset frame rate, and write them into the second temporary file in sequence according to the time sequence.
- the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
- the display interface image screen and the operation technique image screen are played synchronously, the time to start acquiring the display interface image and the time to start collecting the operation technique image must be consistent, and the acquisition of the display interface image must be stopped.
- the time of, and the time of stopping the acquisition of the image of the operation technique must be the same, and the two need to write their corresponding images to the first temporary file and the second temporary file in chronological order at the same frame rate (for example, 15 frames per second) .
- the second temporary file is appended to the end position of the first temporary file to generate an assessment video file corresponding to the ultrasonic scanning skills.
- the acquired display interface image and operation technique image are temporarily saved in chronological order at the same frame rate, the acquired display interface image sequence is written into the first temporary file, and the acquired operation technique image sequence Writing into the second temporary file can ensure the accuracy of the data and the subsequent generation of an orderly assessment video file.
- the number of assessment video files is multiple.
- the method also includes the following steps:
- S502 In response to the selection instruction of at least one evaluation video file, determine the evaluation video file corresponding to the selection instruction as the evaluation video file to be uploaded;
- the junior physician can perform multiple operations on the ultrasound display terminal for practice requirements or examination requirements to obtain multiple assessment video files, and can browse multiple assessment video files from multiple assessment video files. Determine the more satisfactory video file. Specifically, a selection operation is performed on multiple evaluation video files, and in response to a selection instruction of at least one evaluation video file, the selected at least one evaluation video file is determined to be an evaluation video file with upload. Then, the upload button in the display interface is triggered, and in response to the upload instruction, the assessment video file to be uploaded starts to upload.
- the cloud server can store the evaluation data, and the cloud server stores the evaluation data generated by evaluating the uploaded evaluation video file.
- the method before responding to the video recording instruction, the method further includes: responding to the login instruction, logging in to the ultrasound display terminal.
- the login instruction includes the user identification of the assessed physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
- the ultrasound display terminal displays a login interface, and the assessed physician is provided with a user ID, and the user ID and password of the assessed physician (usually a junior physician) are used to log in.
- the login instruction log in to the ultrasound display terminal.
- the login instruction includes the user identification of the assessed physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
- the assessed physician can obtain practice requirements or examination requirements before uploading the assessment video file to the cloud server.
- merging the first temporary file with the second temporary file includes: when the duration of the video recording reaches the preset duration, ending the video recording, and combining the first temporary file with the second temporary file File merging; or in response to the video stop recording instruction, end video recording, and merge the first temporary file with the second temporary file.
- the present application provides a method for generating an assessment video.
- the method includes the following steps:
- the login instruction includes the user identification of the assessed physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
- S706 Acquire a display interface image corresponding to the window, and at the same time turn on the image acquisition device to perform image acquisition on the operating method of the ultrasonic probe.
- S708 Acquire the display interface image at a preset frame rate, and write the first temporary file sequentially in chronological order.
- the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
- the number of assessment video files is multiple.
- the duration of the video recording reaches the preset duration
- the video recording is ended, and the second temporary file is appended to the end of the first temporary file; or in response to the video stop recording instruction, the video recording is ended, and the second temporary file is appended to the first temporary file.
- the end position of a temporary file is the end position of a temporary file.
- the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
- the present application provides a method for generating assessment videos.
- the method includes the following steps:
- S816 Generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of the manipulation technique.
- the display interface images are acquired at a preset frame rate and written into the first temporary file in chronological order;
- the operation technique images are acquired at the same preset frame rate and written into the second temporary file in chronological order; wherein, The number of frames of the first temporary file is the same as the number of frames of the second temporary file. It can be ensured that the image of the display interface and the image of the operation technique can be played synchronously.
- S820 In response to the selection instruction of at least one evaluation video file, determine the evaluation video file corresponding to the selection instruction as the evaluation video file to be uploaded.
- the expert physician views the assessment video file on the second terminal, and simultaneously plays the ultrasound image and the operation technique image.
- the expert physician evaluates the awareness to be evaluated through the display interface of the second terminal, and generates evaluation data.
- the second terminal may send the evaluation data to the cloud server, and the cloud server receives the evaluation data generated by evaluating the uploaded evaluation video file.
- the query instruction includes the user identification of the assessed physician, and the user identification is used to instruct the cloud server to search for corresponding evaluation data according to the user identification.
- the assessed physician inquires the assessment result of the exercise or examination through the first terminal.
- a device 900 for generating an assessment video which includes: an image acquisition module 910, a temporary file generation module 920, and a video file generation module 930, wherein:
- the image acquisition module 910 is configured to start acquiring the display interface image of the ultrasound display terminal in response to the video recording instruction, and at the same time turn on the image acquisition device to perform image acquisition on the operating method of the ultrasound probe;
- the temporary file generating module 920 is configured to generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of manipulation techniques;
- the video file generating module 930 is configured to merge the first temporary file with the second temporary file when the video recording ends to generate an assessment video file corresponding to the ultrasound scanning skill.
- the image acquisition module 910 is further configured to create a new window in the display interface of the ultrasound display terminal in response to a video recording instruction, and the display interface corresponding to the window except the ultrasound image area The areas are all blocked; the display interface image corresponding to the window is acquired.
- the temporary file generating module 920 is further configured to obtain the display interface image at a preset frame rate, and write the first temporary file sequentially in chronological order; to capture the operation at the same preset frame rate The manual image is written into the second temporary file sequentially in chronological order; wherein the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
- the video file generating module 930 is further configured to append the second temporary file to the end position of the first temporary file to generate an assessment video file corresponding to the ultrasound scanning skill.
- the number of the assessment video files is multiple; the generating device further includes a video file selection module and a video file upload module, wherein:
- the video file selection module is configured to respond to at least one selection instruction of the evaluation video file, and determine the evaluation video file corresponding to the selection instruction as the evaluation video file to be uploaded;
- the video file upload module is configured to upload the evaluation video file to be uploaded to a cloud server in response to an upload instruction; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
- the generating device further includes a login module for logging in to the ultrasound display terminal in response to a login instruction; the login instruction includes the user identification of the examined physician, and the user identification is used to indicate the The cloud server establishes a network connection with the ultrasound display terminal.
- the video file generation module 930 is further configured to end video recording when the duration of the video recording reaches a preset duration, and merge the first temporary file with the second temporary file; or respond to the video Stop the recording instruction, end the video recording, and merge the first temporary file with the second temporary file.
- Each module in the device for generating an assessment video described above can be implemented in whole or in part by software, hardware, and a combination thereof.
- the foregoing modules may be embedded in the form of hardware or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the foregoing modules.
- a computer device is provided.
- the computer device may be a terminal, and its internal structure diagram may be as shown in FIG. 10.
- the computer equipment includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus.
- the processor of the computer device is used to provide calculation and control capabilities.
- the memory of the computer device includes a non-volatile storage medium and an internal memory.
- the non-volatile storage medium stores an operating system and a computer program.
- the internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium.
- the communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, an operator's network, NFC (near field communication) or other technologies.
- WIFI wireless fidelity
- NFC near field communication
- the computer program is executed by the processor, a method for generating an assessment video is realized.
- the display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen
- the input device of the computer equipment can be a touch layer covered on the display screen, or it can be a button, trackball or touchpad set on the housing of the computer equipment , It can also be an external keyboard, touchpad, or mouse.
- FIG. 10 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied.
- the specific computer device may Including more or less parts than shown in the figure, or combining some parts, or having a different arrangement of parts.
- a computer device including a memory and a processor, and a computer program is stored in the memory, and the processor implements the following steps when the processor executes the computer program:
- the processor further implements the following steps when executing the computer program: in response to the video recording instruction, a new window is created in the display interface of the ultrasound display terminal, and the display interface corresponding to the window except for the ultrasound image area All other areas outside are blocked; the display interface image corresponding to the window is acquired.
- the processor further implements the following steps when executing the computer program: acquiring the display interface images at a preset frame rate, and writing them to the first temporary file in chronological order; acquiring all images at the same preset frame rate The operation technique images are sequentially written into the second temporary file in chronological order; wherein the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
- the processor executes the computer program, the following steps are further implemented: append a second temporary file to the end position of the first temporary file, and generate an assessment video file corresponding to the ultrasound scanning skill.
- the number of the evaluation video files is multiple; the processor further implements the following step when executing the computer program: in response to at least one selection instruction of the evaluation video file, the evaluation video file corresponding to the selection instruction The file is determined to be an evaluation video file to be uploaded; in response to an upload instruction, the evaluation video file to be uploaded is uploaded to a cloud server; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
- the processor further implements the following steps when executing the computer program: in response to a login instruction, log in to the ultrasound display terminal; the login instruction includes the user identification of the examined physician, and the user identification is used to indicate The cloud server establishes a network connection with the ultrasound display terminal.
- the processor further implements the following steps when executing the computer program: when the duration of the video recording reaches a preset duration, ending the video recording, and merging the first temporary file with the second temporary file; or responding In the video stop recording instruction, the video recording is ended, and the first temporary file and the second temporary file are merged.
- a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
- the following steps are also implemented: in response to a video recording instruction, a new window is created in the display interface of the ultrasound display terminal, and the ultrasound image area is excluded from the display interface corresponding to the window. Areas other than those are blocked; the display interface image corresponding to the window is acquired.
- the following steps are also implemented: acquiring the display interface image at a preset frame rate, and sequentially writing to the first temporary file in chronological order; acquiring at the same preset frame rate The operation technique images are sequentially written into the second temporary file in chronological order; wherein the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
- the following steps are further implemented: append a second temporary file to the end position of the first temporary file, and generate an assessment video file corresponding to the ultrasound scanning skill.
- the number of the assessment video files is multiple; when the computer program is executed by the processor, the following steps are further implemented: in response to at least one selection instruction of the assessment video file, the assessment corresponding to the selection instruction
- the video file is determined to be the evaluation video file to be uploaded; in response to the upload instruction, the evaluation video file to be uploaded is uploaded to the cloud server; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file .
- the following steps are further implemented: in response to a login instruction, log in to the ultrasound display terminal; the login instruction includes the user identification of the examined physician, and the user identification is used to indicate The cloud server establishes a network connection with the ultrasound display terminal.
- the following steps are further implemented: when the duration of the video recording reaches a preset duration, the video recording is ended, and the first temporary file and the second temporary file are merged; or In response to the video stop recording instruction, the video recording is ended, and the first temporary file and the second temporary file are merged.
- Non-volatile memory may include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, or optical storage.
- Volatile memory may include random access memory (RAM) or external cache memory.
- RAM may be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Physics & Mathematics (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Biophysics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- General Health & Medical Sciences (AREA)
- Radiology & Medical Imaging (AREA)
- Software Systems (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Human Computer Interaction (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
Description
Claims (10)
- 一种考核视频的生成方法,其特征在于,所述方法包括:A method for generating assessment videos, characterized in that the method includes:响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集;In response to the video recording instruction, start to acquire the display interface image of the ultrasonic display terminal, and at the same time turn on the image acquisition device to acquire the image of the operating method of the ultrasonic probe;根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;Generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of the manipulation technique;当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,生成超声扫查技能对应的考核视频文件。When the video recording ends, the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skills.
- 根据权利要求1所述的方法,其特征在于,所述响应于视频录制指令,开始获取超声显示终端的显示界面图像,包括:The method according to claim 1, wherein, in response to a video recording instruction, starting to acquire a display interface image of the ultrasound display terminal comprises:响应于视频录制指令,在所述超声显示终端的显示界面中新建窗口,且所述窗口对应的显示界面中除超声图像区域之外的其他区域均被遮挡;In response to the video recording instruction, a new window is created in the display interface of the ultrasound display terminal, and all areas of the display interface corresponding to the window except the ultrasound image area are blocked;获取所述窗口对应的显示界面图像。Obtain the display interface image corresponding to the window.
- 根据权利要求1所述的方法,其特征在于,所述根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件,包括:The method according to claim 1, wherein the generating a first temporary file according to the acquired display interface image sequence, and generating a second temporary file according to the acquired operation technique image sequence, comprises:以预设帧率获取所述显示界面图像,并按照时间顺序依次写入第一临时文件;Acquire the display interface images at a preset frame rate, and write them into the first temporary file in chronological order;以相同的预设帧率采集所述操作手法图像,并按照时间顺序依次写入第二临时文件;Collecting the operation technique images at the same preset frame rate, and sequentially writing them into the second temporary file in chronological order;其中,所述第一临时文件的帧数与所述第二临时文件的帧数相同。Wherein, the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
- 根据权利要求1所述的方法,其特征在于,所述将所述第一临时文件与所述第二临时文件合并,生成所述超声扫查技能对应的考核视频文件,包括:The method according to claim 1, wherein the combining the first temporary file with the second temporary file to generate an assessment video file corresponding to the ultrasonic scanning skill comprises:将第二临时文件追加至第一临时文件的末尾位置,生成所述超声扫查技能对应的考核视频文件。The second temporary file is appended to the end position of the first temporary file to generate an assessment video file corresponding to the ultrasound scanning skill.
- 根据权利要求1至4任一项所述的方法,其特征在于,所述考核视频文件的数量为多个;所述方法还包括:The method according to any one of claims 1 to 4, wherein the number of the assessment video files is multiple; the method further comprises:响应于至少一个所述考核视频文件的选择指令,将所述选择指令对应的考核视频文件确定为待上传的考核视频文件;In response to the selection instruction of at least one of the evaluation video files, determining the evaluation video file corresponding to the selection instruction as the evaluation video file to be uploaded;响应于上传指令,将所述待上传的考核视频文件上传至云端服务器;所述云端服务器存储有对已上传的考核视频文件进行评价所产生的评价数据。In response to the upload instruction, upload the evaluation video file to be uploaded to a cloud server; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
- 根据权利要求5所述的方法,其特征在于,在所述响应于视频录制指令之前,所述方法还包括:The method according to claim 5, characterized in that, before the responding to the video recording instruction, the method further comprises:响应于登录指令,登录至所述超声显示终端;所述登录指令包括被考核医师的用户标识,所述用户标识用于指示所述云端服务器与所述超声显示终端建立网络连接。In response to a login instruction, log in to the ultrasound display terminal; the login instruction includes a user identification of the examined physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
- 根据权利要求5所述的方法,其特征在于,所述当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,包括:The method according to claim 5, wherein the merging the first temporary file with the second temporary file when the video recording ends comprises:当视频录制的时长达到预设时长时,结束视频录制,将所述第一临时文件与所述第二临时文件合并;或When the duration of the video recording reaches the preset duration, the video recording is ended, and the first temporary file and the second temporary file are merged; or响应于视频停止录制指令,结束视频录制,将所述第一临时文件与所述第二临时文件合并。In response to the video stop recording instruction, the video recording is ended, and the first temporary file and the second temporary file are merged.
- 一种考核视频的生成装置,其特征在于,所述装置包括:A device for generating assessment videos, characterized in that the device comprises:图像获取模块,用于响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集;The image acquisition module is used to start acquiring the display interface image of the ultrasonic display terminal in response to the video recording instruction, and at the same time turn on the image acquisition device to perform image acquisition on the operating method of the ultrasonic probe;临时文件生成模块,用于根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;The temporary file generating module is configured to generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of manipulation techniques;视频文件生成模块,用于当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,生成所述超声扫查技能对应的考核视频文件。The video file generating module is configured to merge the first temporary file with the second temporary file when the video recording ends to generate an assessment video file corresponding to the ultrasound scanning skill.
- 一种计算机设备,包括存储器和处理器,所述存储器存储有计算机程序,其特征在于,所述处理器执行所述计算机程序时实现权利要求1至7中任一项所述的方法的步骤。A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method according to any one of claims 1 to 7 when the computer program is executed by the processor.
- 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1至7中任一项所述的方法的步骤。A computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the method according to any one of claims 1 to 7 when the computer program is executed by a processor.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010541882.8A CN113810758A (en) | 2020-06-15 | 2020-06-15 | Assessment video generation method and device, computer equipment and storage medium |
CN202010541882.8 | 2020-06-15 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021253730A1 true WO2021253730A1 (en) | 2021-12-23 |
Family
ID=78892426
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/132975 WO2021253730A1 (en) | 2020-06-15 | 2020-11-30 | Assessment video generation method and apparatus, and computer device and storage medium |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN113810758A (en) |
WO (1) | WO2021253730A1 (en) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104219454A (en) * | 2014-09-30 | 2014-12-17 | 联想(北京)有限公司 | Method and device for acquiring images |
US20150035959A1 (en) * | 2013-03-15 | 2015-02-05 | eagleyemed, Inc. | Multi-site data sharing platform |
WO2017015902A1 (en) * | 2015-07-29 | 2017-02-02 | 深圳迈瑞生物医疗电子股份有限公司 | Ultrasonic imaging system and method |
CN106851162A (en) * | 2017-02-17 | 2017-06-13 | 成都依能科技股份有限公司 | video recording method and device |
CN109348155A (en) * | 2018-11-08 | 2019-02-15 | 北京微播视界科技有限公司 | Video recording method, device, computer equipment and storage medium |
WO2019047080A1 (en) * | 2017-09-06 | 2019-03-14 | 深圳迈瑞生物医疗电子股份有限公司 | Ultrasonic diagnostic apparatus and method for acquiring remote auxiliary data using ultrasonic diagnostic apparatus |
CN109872807A (en) * | 2019-02-15 | 2019-06-11 | 深圳华声医疗技术股份有限公司 | The ultrasonic long-range method, apparatus of the consultation of doctors in real time, equipment and readable storage medium storing program for executing |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110536088A (en) * | 2019-09-24 | 2019-12-03 | 深圳华声医疗技术股份有限公司 | Ultrasonic image-forming system device, ultrasonic imaging method |
-
2020
- 2020-06-15 CN CN202010541882.8A patent/CN113810758A/en active Pending
- 2020-11-30 WO PCT/CN2020/132975 patent/WO2021253730A1/en active Application Filing
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150035959A1 (en) * | 2013-03-15 | 2015-02-05 | eagleyemed, Inc. | Multi-site data sharing platform |
CN104219454A (en) * | 2014-09-30 | 2014-12-17 | 联想(北京)有限公司 | Method and device for acquiring images |
WO2017015902A1 (en) * | 2015-07-29 | 2017-02-02 | 深圳迈瑞生物医疗电子股份有限公司 | Ultrasonic imaging system and method |
CN106851162A (en) * | 2017-02-17 | 2017-06-13 | 成都依能科技股份有限公司 | video recording method and device |
WO2019047080A1 (en) * | 2017-09-06 | 2019-03-14 | 深圳迈瑞生物医疗电子股份有限公司 | Ultrasonic diagnostic apparatus and method for acquiring remote auxiliary data using ultrasonic diagnostic apparatus |
CN109348155A (en) * | 2018-11-08 | 2019-02-15 | 北京微播视界科技有限公司 | Video recording method, device, computer equipment and storage medium |
CN109872807A (en) * | 2019-02-15 | 2019-06-11 | 深圳华声医疗技术股份有限公司 | The ultrasonic long-range method, apparatus of the consultation of doctors in real time, equipment and readable storage medium storing program for executing |
Also Published As
Publication number | Publication date |
---|---|
CN113810758A (en) | 2021-12-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20110245632A1 (en) | Medical Diagnosis Using Biometric Sensor Protocols Based on Medical Examination Attributes and Monitored Data | |
US20220142609A1 (en) | Apparatus and method for fetal intelligent navigation echocardiography | |
US10282517B2 (en) | Apparatus, method, and non-transitory computer-readable medium for supporting viewing examination images | |
JP6638729B2 (en) | Console and dynamic imaging diagnostic system | |
JP2021516090A (en) | Methods and equipment for annotating ultrasonography | |
US9411932B2 (en) | Image management apparatus | |
US20150002538A1 (en) | Ultrasound image display method and apparatus | |
US20200234444A1 (en) | Systems and methods for the analysis of skin conditions | |
CN102265308A (en) | System for monitoring medical abnormalities and method of operation thereof | |
JP2018518226A (en) | System and method for motion compensation in medical procedures | |
US9881125B2 (en) | Ultrasound measurement of biometrics of fetus | |
KR102207255B1 (en) | Method and system for sharing information | |
CA3110581C (en) | System and method for evaluating the performance of a user in capturing an image of an anatomical region | |
JP2001198123A (en) | Method and device for data management | |
KR101518804B1 (en) | Method and apparatus for managing medical data | |
CN110246135A (en) | Monitor Follicles method, apparatus, system and storage medium | |
US20210065882A1 (en) | Method and system for prompting data donation for artificial intelligence tool development | |
Deng et al. | Assessment of atrial septal defect using 2D or real-time 3D transesophageal echocardiography and outcomes following transcatheter closure | |
WO2021253730A1 (en) | Assessment video generation method and apparatus, and computer device and storage medium | |
CN112741620A (en) | Cervical spondylosis evaluation device based on limb movement | |
US20220148172A1 (en) | System and method for detecting medical conditions | |
CN108845565B (en) | Vehicle diagnosis method and vehicle diagnosis instrument | |
CN114694442B (en) | Ultrasonic training method and device based on virtual reality, storage medium and ultrasonic equipment | |
KR102388735B1 (en) | Method of detecting cheating for exams in meatverse environment based on image data processing | |
US20230181163A1 (en) | System and Method for Automatic Association and Display of Video Loop Subject Matter for Enhanced Identification |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20941092 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20941092 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20941092 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATE 26.06.2023) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20941092 Country of ref document: EP Kind code of ref document: A1 |