WO2021253730A1 - Assessment video generation method and apparatus, and computer device and storage medium - Google Patents

Assessment video generation method and apparatus, and computer device and storage medium Download PDF

Info

Publication number
WO2021253730A1
WO2021253730A1 PCT/CN2020/132975 CN2020132975W WO2021253730A1 WO 2021253730 A1 WO2021253730 A1 WO 2021253730A1 CN 2020132975 W CN2020132975 W CN 2020132975W WO 2021253730 A1 WO2021253730 A1 WO 2021253730A1
Authority
WO
WIPO (PCT)
Prior art keywords
temporary file
video
file
assessment
display interface
Prior art date
Application number
PCT/CN2020/132975
Other languages
French (fr)
Chinese (zh)
Inventor
归晓斌
Original Assignee
飞依诺科技(苏州)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 飞依诺科技(苏州)有限公司 filed Critical 飞依诺科技(苏州)有限公司
Publication of WO2021253730A1 publication Critical patent/WO2021253730A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334Recording operations
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4438Window management, e.g. event handling following interaction with the user interface
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working

Definitions

  • This application relates to the field of medical imaging technology, and in particular to a method, device, computer equipment, and storage medium for generating a scanning skill assessment video in an ultrasonic detection process.
  • Ultrasound examination is a method of medical imaging examination, which assists clinicians in the diagnosis of diseases, and can also be used to evaluate the efficacy and guide the next treatment. Under normal circumstances, it is necessary to train and guide junior physicians in ultrasound scanning skills to improve the technical level of junior physicians.
  • a method for generating an assessment video comprising:
  • the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skills.
  • the response to the video recording instruction to start acquiring the display interface image of the ultrasound display terminal includes:
  • a new window is created in the display interface of the ultrasound display terminal, and all areas of the display interface corresponding to the window except the ultrasound image area are blocked;
  • the generating the first temporary file according to the acquired image sequence of the display interface and generating the second temporary file according to the acquired image sequence of the operation technique includes:
  • the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
  • the merging the first temporary file and the second temporary file to generate an assessment video file corresponding to the ultrasound scanning skill includes:
  • the second temporary file is appended to the end position of the first temporary file to generate an assessment video file corresponding to the ultrasound scanning skill.
  • the number of the assessment video files is multiple; the method further includes:
  • the cloud server In response to the upload instruction, upload the evaluation video file to be uploaded to a cloud server; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
  • the method before the responding to the video recording instruction, the method further includes:
  • the login instruction In response to a login instruction, log in to the ultrasound display terminal; the login instruction includes a user identification of the examined physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
  • the merging the first temporary file with the second temporary file when the video recording ends includes:
  • the video recording is ended, and the first temporary file and the second temporary file are merged;
  • the video recording is ended, and the first temporary file and the second temporary file are merged.
  • a processing device for assessment data comprising:
  • the image acquisition module is used to start acquiring the display interface image of the ultrasonic display terminal in response to the video recording instruction, and at the same time turn on the image acquisition device to perform image acquisition on the operating method of the ultrasonic probe;
  • the temporary file generating module is configured to generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of manipulation techniques;
  • the video file generating module is configured to merge the first temporary file with the second temporary file when the video recording ends to generate an assessment video file corresponding to the ultrasound scanning skill.
  • a computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when the computer program is executed:
  • the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skills.
  • the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skills.
  • the method, device, computer equipment and storage medium for generating the above assessment video start to acquire the display interface image of the ultrasonic display terminal by responding to the video recording instruction, and at the same time turn on the image acquisition device to perform image acquisition on the operating technique of the ultrasonic probe;
  • the acquired display interface image sequence generates a first temporary file, and a second temporary file is generated according to the acquired operation technique image sequence; when the video recording is over, the first temporary file and the second temporary file are merged to generate an ultrasound scan
  • the assessment video files can be used to assess the ultrasound scanning skills of junior physicians, which changes the assessment method of ultrasound scanning skills in traditional technology, avoids expert physicians from viewing the scanning process of junior physicians on site, and improves the assessment efficiency of ultrasound scanning skills .
  • FIG. 1 is an application environment diagram of a method for generating an assessment video in an embodiment
  • FIG. 2 is a schematic flowchart of a method for generating an assessment video in an embodiment
  • FIG. 3 is a schematic flowchart of step S202 in an embodiment
  • FIG. 4 is a schematic flowchart of step S204 in an embodiment
  • Figure 5a is a schematic flowchart of a method for generating an assessment video in an embodiment
  • Figure 5b is a schematic diagram of an interface for uploading an assessment video in an embodiment
  • Figure 6 is a schematic diagram of a login interface of an ultrasound display terminal in an embodiment
  • FIG. 7 is a schematic flowchart of a method for generating an assessment video in an embodiment
  • Figure 8a is a schematic diagram of an evaluation query interface of a first terminal in an embodiment
  • Figure 8b is a schematic diagram of an evaluation query interface of the first terminal in an embodiment
  • Figure 9 is a structural block diagram of a device for generating assessment videos in an embodiment
  • Fig. 10 is an internal structure diagram of a computer device in an embodiment.
  • the method for generating assessment videos provided in this application can be applied to the application environment as shown in FIG. 1.
  • the ultrasound display terminal 102 communicates with the cloud server 104 through the network.
  • the first terminal 106 used by the physician to be assessed (usually a junior physician) and the second terminal 108 used by the expert physician also communicate with the cloud server 104 via the network.
  • the ultrasonic display terminal 102 responds to the video recording instruction to start acquiring the display interface image of the ultrasonic display terminal, and at the same time, the image acquisition device is turned on to perform image acquisition of the operating method of the ultrasonic probe; thus, the first temporary file is generated according to the acquired display interface image sequence , Generate a second temporary file according to the collected operation technique image sequence; when the video recording ends, merge the first temporary file with the second temporary file to generate an assessment video file corresponding to the ultrasound scanning skills.
  • the ultrasound imaging equipment includes an ultrasound probe and an ultrasound display terminal 102.
  • the ultrasound display terminal 102 includes a processor, a display, and a memory.
  • the processor processes the ultrasonic echo signal/data to obtain the ultrasonic image of the target part or the ultrasonic image of the interventional object.
  • the ultrasound images obtained by the processor can be stored in the memory, and these ultrasound images can be displayed on the display or sent to the ultrasound workstation.
  • the first terminal 106 and the second terminal 108 can be, but are not limited to, various personal computers, laptops, smart phones, tablets, and portable wearable devices.
  • the cloud server 104 can be an independent server or a server cluster composed of multiple servers. to realise.
  • a method for generating an assessment video is provided. Taking the method applied to the ultrasound display terminal 102 in FIG. 1 as an example for description, the method includes the following steps:
  • the primary physician when performing medical ultrasound testing, operates the ultrasound probe to scan the target site to be tested.
  • the ultrasonic display terminal applies an electrical signal to the ultrasonic probe through the ultrasonic cable so that the ultrasonic probe emits ultrasonic waves to the target site to be detected.
  • the ultrasonic probe receives the echo signal reflected by the target part and feeds the echo signal back to the ultrasonic display terminal through the ultrasonic cable.
  • the ultrasonic display terminal can generate an ultrasonic image of the target part according to the echo signal for diagnosis by the physician.
  • the target part is a part of interest of the physician, such as liver, pancreas, uterus, etc.
  • a corresponding display interface can be provided for primary physicians to operate.
  • the above display interface can include controls such as a logo marquee or a menu bar.
  • the junior doctor can input the operation instructions for the ultrasound image through the display interface according to the actual use situation, so as to perform operations such as measurement of the ultrasound image through the ultrasound display terminal.
  • the operating methods of the ultrasound probe may include forward, backward, rotating, tilting to the left, tilting to the right, increasing or decreasing the force, acceleration and deceleration, etc. of the ultrasound probe.
  • the image acquisition device can collect the image of the doctor's operation method of the ultrasound probe, thereby saving his operation method of the ultrasound probe, and lay the foundation for generating the assessment video file.
  • a video recording button is set in the display interface of the ultrasound display terminal, and the video recording button is triggered when the junior physician performs scanning exercises or scanning examinations on the ultrasound display terminal.
  • the ultrasound display terminal responds to the video recording instruction issued by the primary physician, and not only starts to record the screen of the display interface of the ultrasound display terminal, but also turns on the image acquisition device to perform image acquisition on the operating method of the ultrasound probe.
  • the ultrasound scanning process of the primary physician can be completely preserved, so that the expert physician can subsequently evaluate the skill level of the primary physician.
  • the shooting range of the image acquisition device may include the operation technique of the ultrasound probe, and may also include the face of the primary physician, so as to avoid the occurrence of cheating.
  • S204 Generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of the manipulation technique.
  • a series of display interface images obtained by recording the display interface of the ultrasound display device constitute a display interface image sequence.
  • a series of manipulation images collected by the image capture device constitutes a sequence of manipulation images.
  • this application creatively uses the display interface image sequence and the operation technique image sequence to create the evaluation video file, and when playing the evaluation video file, it is necessary to ensure that the time correspondence between the display interface image and the operation technique image is followed Relationship, the two will be played synchronously. Therefore, in order to ensure the accuracy of the data and the subsequent generation of an orderly assessment video file, the display interface image and the operation technique image are respectively temporarily saved.
  • the acquired image sequence of the display interface is saved in the first temporary file, and the acquired operation technique image sequence is saved in the second temporary file.
  • the first temporary file and the second temporary file are merged to generate a video file, which reduces the time and effort spent on the evaluation of expert physicians.
  • the assessment video file is provided with a file header, and the file header information includes the data length information of the assessment video file.
  • the assessment video file corresponding to the scanning skill ensures that the two parts of the image have the same end time; the synchronization of the display interface image screen and the operation method image screen in the assessment video file is realized, so that the assessment video file can be used for the ultrasound of the junior physician
  • the assessment of scanning skills has changed the assessment method of ultrasonic scanning skills in traditional technology, avoiding expert physicians from viewing the scanning process of junior physicians on site, and improving the assessment efficiency of ultrasonic scanning skills.
  • starting to acquire a display interface image of the ultrasound display terminal includes the following steps:
  • the display interface image of the ultrasound display terminal includes not only the ultrasound image area, but also other areas that display patient information, doctor information, and hospital information. Specifically, in order to ensure the fairness of the assessment, it is necessary for expert physicians to hide this information in other areas. Therefore, before starting the video recording, that is, after responding to the video recording instruction, a new window can be created in the display interface of the ultrasound display terminal.
  • the window can be invisible to the assessed physician, that is, the information seen by the assessed physician still includes the information of the ultrasound image area and other areas, while the expert physician only needs to see the ultrasound In the image area, all areas of the display interface corresponding to the newly created window except the ultrasound image area are blocked, so that the corresponding display interface image is obtained based on the newly created window.
  • a new window is created, and all areas except the ultrasound image area in the display interface corresponding to the window are blocked, which ensures the fairness of the assessment.
  • generating the first temporary file according to the acquired display interface image sequence, and generating the second temporary file according to the acquired operation technique image sequence includes the following steps:
  • S402 Acquire a display interface image at a preset frame rate, and write them in the first temporary file sequentially in chronological order;
  • S404 Collect the operation technique images at the same preset frame rate, and write them into the second temporary file in sequence according to the time sequence.
  • the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
  • the display interface image screen and the operation technique image screen are played synchronously, the time to start acquiring the display interface image and the time to start collecting the operation technique image must be consistent, and the acquisition of the display interface image must be stopped.
  • the time of, and the time of stopping the acquisition of the image of the operation technique must be the same, and the two need to write their corresponding images to the first temporary file and the second temporary file in chronological order at the same frame rate (for example, 15 frames per second) .
  • the second temporary file is appended to the end position of the first temporary file to generate an assessment video file corresponding to the ultrasonic scanning skills.
  • the acquired display interface image and operation technique image are temporarily saved in chronological order at the same frame rate, the acquired display interface image sequence is written into the first temporary file, and the acquired operation technique image sequence Writing into the second temporary file can ensure the accuracy of the data and the subsequent generation of an orderly assessment video file.
  • the number of assessment video files is multiple.
  • the method also includes the following steps:
  • S502 In response to the selection instruction of at least one evaluation video file, determine the evaluation video file corresponding to the selection instruction as the evaluation video file to be uploaded;
  • the junior physician can perform multiple operations on the ultrasound display terminal for practice requirements or examination requirements to obtain multiple assessment video files, and can browse multiple assessment video files from multiple assessment video files. Determine the more satisfactory video file. Specifically, a selection operation is performed on multiple evaluation video files, and in response to a selection instruction of at least one evaluation video file, the selected at least one evaluation video file is determined to be an evaluation video file with upload. Then, the upload button in the display interface is triggered, and in response to the upload instruction, the assessment video file to be uploaded starts to upload.
  • the cloud server can store the evaluation data, and the cloud server stores the evaluation data generated by evaluating the uploaded evaluation video file.
  • the method before responding to the video recording instruction, the method further includes: responding to the login instruction, logging in to the ultrasound display terminal.
  • the login instruction includes the user identification of the assessed physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
  • the ultrasound display terminal displays a login interface, and the assessed physician is provided with a user ID, and the user ID and password of the assessed physician (usually a junior physician) are used to log in.
  • the login instruction log in to the ultrasound display terminal.
  • the login instruction includes the user identification of the assessed physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
  • the assessed physician can obtain practice requirements or examination requirements before uploading the assessment video file to the cloud server.
  • merging the first temporary file with the second temporary file includes: when the duration of the video recording reaches the preset duration, ending the video recording, and combining the first temporary file with the second temporary file File merging; or in response to the video stop recording instruction, end video recording, and merge the first temporary file with the second temporary file.
  • the present application provides a method for generating an assessment video.
  • the method includes the following steps:
  • the login instruction includes the user identification of the assessed physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
  • S706 Acquire a display interface image corresponding to the window, and at the same time turn on the image acquisition device to perform image acquisition on the operating method of the ultrasonic probe.
  • S708 Acquire the display interface image at a preset frame rate, and write the first temporary file sequentially in chronological order.
  • the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
  • the number of assessment video files is multiple.
  • the duration of the video recording reaches the preset duration
  • the video recording is ended, and the second temporary file is appended to the end of the first temporary file; or in response to the video stop recording instruction, the video recording is ended, and the second temporary file is appended to the first temporary file.
  • the end position of a temporary file is the end position of a temporary file.
  • the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
  • the present application provides a method for generating assessment videos.
  • the method includes the following steps:
  • S816 Generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of the manipulation technique.
  • the display interface images are acquired at a preset frame rate and written into the first temporary file in chronological order;
  • the operation technique images are acquired at the same preset frame rate and written into the second temporary file in chronological order; wherein, The number of frames of the first temporary file is the same as the number of frames of the second temporary file. It can be ensured that the image of the display interface and the image of the operation technique can be played synchronously.
  • S820 In response to the selection instruction of at least one evaluation video file, determine the evaluation video file corresponding to the selection instruction as the evaluation video file to be uploaded.
  • the expert physician views the assessment video file on the second terminal, and simultaneously plays the ultrasound image and the operation technique image.
  • the expert physician evaluates the awareness to be evaluated through the display interface of the second terminal, and generates evaluation data.
  • the second terminal may send the evaluation data to the cloud server, and the cloud server receives the evaluation data generated by evaluating the uploaded evaluation video file.
  • the query instruction includes the user identification of the assessed physician, and the user identification is used to instruct the cloud server to search for corresponding evaluation data according to the user identification.
  • the assessed physician inquires the assessment result of the exercise or examination through the first terminal.
  • a device 900 for generating an assessment video which includes: an image acquisition module 910, a temporary file generation module 920, and a video file generation module 930, wherein:
  • the image acquisition module 910 is configured to start acquiring the display interface image of the ultrasound display terminal in response to the video recording instruction, and at the same time turn on the image acquisition device to perform image acquisition on the operating method of the ultrasound probe;
  • the temporary file generating module 920 is configured to generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of manipulation techniques;
  • the video file generating module 930 is configured to merge the first temporary file with the second temporary file when the video recording ends to generate an assessment video file corresponding to the ultrasound scanning skill.
  • the image acquisition module 910 is further configured to create a new window in the display interface of the ultrasound display terminal in response to a video recording instruction, and the display interface corresponding to the window except the ultrasound image area The areas are all blocked; the display interface image corresponding to the window is acquired.
  • the temporary file generating module 920 is further configured to obtain the display interface image at a preset frame rate, and write the first temporary file sequentially in chronological order; to capture the operation at the same preset frame rate The manual image is written into the second temporary file sequentially in chronological order; wherein the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
  • the video file generating module 930 is further configured to append the second temporary file to the end position of the first temporary file to generate an assessment video file corresponding to the ultrasound scanning skill.
  • the number of the assessment video files is multiple; the generating device further includes a video file selection module and a video file upload module, wherein:
  • the video file selection module is configured to respond to at least one selection instruction of the evaluation video file, and determine the evaluation video file corresponding to the selection instruction as the evaluation video file to be uploaded;
  • the video file upload module is configured to upload the evaluation video file to be uploaded to a cloud server in response to an upload instruction; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
  • the generating device further includes a login module for logging in to the ultrasound display terminal in response to a login instruction; the login instruction includes the user identification of the examined physician, and the user identification is used to indicate the The cloud server establishes a network connection with the ultrasound display terminal.
  • the video file generation module 930 is further configured to end video recording when the duration of the video recording reaches a preset duration, and merge the first temporary file with the second temporary file; or respond to the video Stop the recording instruction, end the video recording, and merge the first temporary file with the second temporary file.
  • Each module in the device for generating an assessment video described above can be implemented in whole or in part by software, hardware, and a combination thereof.
  • the foregoing modules may be embedded in the form of hardware or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the foregoing modules.
  • a computer device is provided.
  • the computer device may be a terminal, and its internal structure diagram may be as shown in FIG. 10.
  • the computer equipment includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus.
  • the processor of the computer device is used to provide calculation and control capabilities.
  • the memory of the computer device includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system and a computer program.
  • the internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium.
  • the communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, an operator's network, NFC (near field communication) or other technologies.
  • WIFI wireless fidelity
  • NFC near field communication
  • the computer program is executed by the processor, a method for generating an assessment video is realized.
  • the display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen
  • the input device of the computer equipment can be a touch layer covered on the display screen, or it can be a button, trackball or touchpad set on the housing of the computer equipment , It can also be an external keyboard, touchpad, or mouse.
  • FIG. 10 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied.
  • the specific computer device may Including more or less parts than shown in the figure, or combining some parts, or having a different arrangement of parts.
  • a computer device including a memory and a processor, and a computer program is stored in the memory, and the processor implements the following steps when the processor executes the computer program:
  • the processor further implements the following steps when executing the computer program: in response to the video recording instruction, a new window is created in the display interface of the ultrasound display terminal, and the display interface corresponding to the window except for the ultrasound image area All other areas outside are blocked; the display interface image corresponding to the window is acquired.
  • the processor further implements the following steps when executing the computer program: acquiring the display interface images at a preset frame rate, and writing them to the first temporary file in chronological order; acquiring all images at the same preset frame rate The operation technique images are sequentially written into the second temporary file in chronological order; wherein the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
  • the processor executes the computer program, the following steps are further implemented: append a second temporary file to the end position of the first temporary file, and generate an assessment video file corresponding to the ultrasound scanning skill.
  • the number of the evaluation video files is multiple; the processor further implements the following step when executing the computer program: in response to at least one selection instruction of the evaluation video file, the evaluation video file corresponding to the selection instruction The file is determined to be an evaluation video file to be uploaded; in response to an upload instruction, the evaluation video file to be uploaded is uploaded to a cloud server; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
  • the processor further implements the following steps when executing the computer program: in response to a login instruction, log in to the ultrasound display terminal; the login instruction includes the user identification of the examined physician, and the user identification is used to indicate The cloud server establishes a network connection with the ultrasound display terminal.
  • the processor further implements the following steps when executing the computer program: when the duration of the video recording reaches a preset duration, ending the video recording, and merging the first temporary file with the second temporary file; or responding In the video stop recording instruction, the video recording is ended, and the first temporary file and the second temporary file are merged.
  • a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
  • the following steps are also implemented: in response to a video recording instruction, a new window is created in the display interface of the ultrasound display terminal, and the ultrasound image area is excluded from the display interface corresponding to the window. Areas other than those are blocked; the display interface image corresponding to the window is acquired.
  • the following steps are also implemented: acquiring the display interface image at a preset frame rate, and sequentially writing to the first temporary file in chronological order; acquiring at the same preset frame rate The operation technique images are sequentially written into the second temporary file in chronological order; wherein the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
  • the following steps are further implemented: append a second temporary file to the end position of the first temporary file, and generate an assessment video file corresponding to the ultrasound scanning skill.
  • the number of the assessment video files is multiple; when the computer program is executed by the processor, the following steps are further implemented: in response to at least one selection instruction of the assessment video file, the assessment corresponding to the selection instruction
  • the video file is determined to be the evaluation video file to be uploaded; in response to the upload instruction, the evaluation video file to be uploaded is uploaded to the cloud server; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file .
  • the following steps are further implemented: in response to a login instruction, log in to the ultrasound display terminal; the login instruction includes the user identification of the examined physician, and the user identification is used to indicate The cloud server establishes a network connection with the ultrasound display terminal.
  • the following steps are further implemented: when the duration of the video recording reaches a preset duration, the video recording is ended, and the first temporary file and the second temporary file are merged; or In response to the video stop recording instruction, the video recording is ended, and the first temporary file and the second temporary file are merged.
  • Non-volatile memory may include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, or optical storage.
  • Volatile memory may include random access memory (RAM) or external cache memory.
  • RAM may be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Physics & Mathematics (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Biophysics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • General Health & Medical Sciences (AREA)
  • Radiology & Medical Imaging (AREA)
  • Software Systems (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Human Computer Interaction (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

The present application relates to an assessment video generation method and apparatus, and a computer device and a storage medium. The method comprises: in response to a video recording instruction, starting to acquire a display interface image of an ultrasonic display terminal, and simultaneously starting an image collection device to perform image collection on an operation technique of an ultrasonic probe; generating a first temporary file according to a sequence of acquired display interface images, and generating a second temporary file according to a sequence of collected operation technique images; and when video recording is finished, merging the first temporary file with the second temporary file to generate an assessment video file corresponding to an ultrasonic scanning skill. Therefore, the ultrasonic scanning skill of a primary physician can be assessed using an assessment video file. The assessment method for an ultrasonic scanning skill in the traditional technology is changed, wherein an expert physician does not need to check the scanning process of the primary physician on site, and the efficiency of assessment of the ultrasonic scanning skill is improved.

Description

考核视频的生成方法、装置、计算机设备和存储介质Method, device, computer equipment and storage medium for generating assessment video 技术领域Technical field
本申请涉及医学成像技术领域,特别是涉及一种超声检测过程中扫查技能考核视频的生成方法、装置、计算机设备和存储介质。This application relates to the field of medical imaging technology, and in particular to a method, device, computer equipment, and storage medium for generating a scanning skill assessment video in an ultrasonic detection process.
背景技术Background technique
超声检查是医学影像检查的一种手段,辅助临床医师对疾病进行诊断,也可以用于评估疗效,指导下一步的治疗。一般情况下,需要对初级医师的超声扫查技能进行培训和指导,以提升初级医师的技术水平。Ultrasound examination is a method of medical imaging examination, which assists clinicians in the diagnosis of diseases, and can also be used to evaluate the efficacy and guide the next treatment. Under normal circumstances, it is necessary to train and guide junior physicians in ultrasound scanning skills to improve the technical level of junior physicians.
传统技术中,通过专家医师对初级医师的超声扫查过程进行现场查看,并对初级医师进行现场指导和评价,从而完成超声扫查技能的培训和考核。In traditional technology, expert physicians conduct on-site inspection of the ultrasound scanning process of primary physicians, and provide on-site guidance and evaluation to primary physicians to complete the training and assessment of ultrasound scanning skills.
然而,专家医师时间宝贵且人数不多,初级医师人数往往较多,专家医师无法一一现场查看初级医师的扫查过程。因此,传统技术中超声扫查技能的考核方式存在效率低的技术问题。However, the time of expert physicians is precious and the number of physicians is small, and the number of junior physicians is often large. Expert physicians cannot view the scanning process of junior physicians one by one on the spot. Therefore, the evaluation method of ultrasonic scanning skills in the traditional technology has a technical problem of low efficiency.
发明内容Summary of the invention
基于此,有必要针对上述技术问题,提供一种能够提升超声扫查技能考核效率的考核视频的生成方法、装置、计算机设备和存储介质。Based on this, it is necessary to address the above technical problems and provide a method, device, computer equipment, and storage medium for generating an assessment video that can improve the efficiency of ultrasonic scanning skills assessment.
一种考核视频的生成方法,所述方法包括:A method for generating an assessment video, the method comprising:
响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集;In response to the video recording instruction, start to acquire the display interface image of the ultrasonic display terminal, and at the same time turn on the image acquisition device to acquire the image of the operating method of the ultrasonic probe;
根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;Generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of the manipulation technique;
当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,生成超声扫查技能对应的考核视频文件。When the video recording ends, the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skills.
在其中一个实施例中,所述响应于视频录制指令,开始获取超声显示终端的显示界面图像,包括:In one of the embodiments, the response to the video recording instruction to start acquiring the display interface image of the ultrasound display terminal includes:
响应于视频录制指令,在所述超声显示终端的显示界面中新建窗口,且所述窗口对应的显示界面中除超声图像区域之外的其他区域均被遮挡;In response to the video recording instruction, a new window is created in the display interface of the ultrasound display terminal, and all areas of the display interface corresponding to the window except the ultrasound image area are blocked;
获取所述窗口对应的显示界面图像。Obtain the display interface image corresponding to the window.
在其中一个实施例中,所述根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件,包括:In one of the embodiments, the generating the first temporary file according to the acquired image sequence of the display interface and generating the second temporary file according to the acquired image sequence of the operation technique includes:
以预设帧率获取所述显示界面图像,并按照时间顺序依次写入第一临时文件;Acquire the display interface images at a preset frame rate, and write them into the first temporary file in chronological order;
以相同的预设帧率采集所述操作手法图像,并按照时间顺序依次写入第二临时文件;Collecting the operation technique images at the same preset frame rate, and sequentially writing them into the second temporary file in chronological order;
其中,所述第一临时文件的帧数与所述第二临时文件的帧数相同。Wherein, the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
在其中一个实施例中,所述将所述第一临时文件与所述第二临时文件合并,生成所述超声扫查技能对应的考核视频文件,包括:In one of the embodiments, the merging the first temporary file and the second temporary file to generate an assessment video file corresponding to the ultrasound scanning skill includes:
将第二临时文件追加至第一临时文件的末尾位置,生成所述超声扫查技能对应的考核视频文件。The second temporary file is appended to the end position of the first temporary file to generate an assessment video file corresponding to the ultrasound scanning skill.
在其中一个实施例中,所述考核视频文件的数量为多个;所述方法还包括:In one of the embodiments, the number of the assessment video files is multiple; the method further includes:
响应于至少一个所述考核视频文件的选择指令,将所述选择指令对应的考核视频文件确定为待上传的考核视频文件;In response to the selection instruction of at least one of the evaluation video files, determining the evaluation video file corresponding to the selection instruction as the evaluation video file to be uploaded;
响应于上传指令,将所述待上传的考核视频文件上传至云端服务器;所述云端服务器存储有对已上传的考核视频文件进行评价所产生的评价数据。In response to the upload instruction, upload the evaluation video file to be uploaded to a cloud server; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
在其中一个实施例中,在所述响应于视频录制指令之前,所述方法还包括:In one of the embodiments, before the responding to the video recording instruction, the method further includes:
响应于登录指令,登录至所述超声显示终端;所述登录指令包括被考核医师的用户标识,所述用户标识用于指示所述云端服务器与所述超声显示终端建立网络连接。In response to a login instruction, log in to the ultrasound display terminal; the login instruction includes a user identification of the examined physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
在其中一个实施例中,所述当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,包括:In one of the embodiments, the merging the first temporary file with the second temporary file when the video recording ends includes:
当视频录制的时长达到预设时长时,结束视频录制,将所述第一临时文件与所述第二临时文件合并;或When the duration of the video recording reaches the preset duration, the video recording is ended, and the first temporary file and the second temporary file are merged; or
响应于视频停止录制指令,结束视频录制,将所述第一临时文件与所述第 二临时文件合并。In response to the video stop recording instruction, the video recording is ended, and the first temporary file and the second temporary file are merged.
一种考核数据的处理装置,所述装置包括:A processing device for assessment data, the device comprising:
图像获取模块,用于响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集;The image acquisition module is used to start acquiring the display interface image of the ultrasonic display terminal in response to the video recording instruction, and at the same time turn on the image acquisition device to perform image acquisition on the operating method of the ultrasonic probe;
临时文件生成模块,用于根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;The temporary file generating module is configured to generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of manipulation techniques;
视频文件生成模块,用于当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,生成所述超声扫查技能对应的考核视频文件。The video file generating module is configured to merge the first temporary file with the second temporary file when the video recording ends to generate an assessment video file corresponding to the ultrasound scanning skill.
一种计算机设备,包括存储器和处理器,所述存储器存储有计算机程序,所述处理器执行所述计算机程序时实现以下步骤:A computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when the computer program is executed:
响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集;In response to the video recording instruction, start to acquire the display interface image of the ultrasonic display terminal, and at the same time turn on the image acquisition device to acquire the image of the operating method of the ultrasonic probe;
根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;Generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of the manipulation technique;
当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,生成超声扫查技能对应的考核视频文件。When the video recording ends, the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skills.
一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现以下步骤:A computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集;In response to the video recording instruction, start to acquire the display interface image of the ultrasonic display terminal, and at the same time turn on the image acquisition device to acquire the image of the operating method of the ultrasonic probe;
根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;Generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of the manipulation technique;
当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,生成超声扫查技能对应的考核视频文件。When the video recording ends, the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skills.
上述考核视频的生成方法、装置、计算机设备和存储介质,通过响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集;并根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;当视频录制 结束时,将所述第一临时文件与所述第二临时文件合并,生成超声扫查技能对应的考核视频文件。从而可以利用考核视频文件对初级医师的超声扫查技能进行考核,改变了传统技术中超声扫查技能的考核方式,避免专家医师现场查看初级医师的扫查过程,提升超声扫查技能的考核效率。The method, device, computer equipment and storage medium for generating the above assessment video start to acquire the display interface image of the ultrasonic display terminal by responding to the video recording instruction, and at the same time turn on the image acquisition device to perform image acquisition on the operating technique of the ultrasonic probe; The acquired display interface image sequence generates a first temporary file, and a second temporary file is generated according to the acquired operation technique image sequence; when the video recording is over, the first temporary file and the second temporary file are merged to generate an ultrasound scan Check the assessment video file corresponding to the skill. Therefore, the assessment video files can be used to assess the ultrasound scanning skills of junior physicians, which changes the assessment method of ultrasound scanning skills in traditional technology, avoids expert physicians from viewing the scanning process of junior physicians on site, and improves the assessment efficiency of ultrasound scanning skills .
附图说明Description of the drawings
图1为一个实施例中考核视频的生成方法的应用环境图;FIG. 1 is an application environment diagram of a method for generating an assessment video in an embodiment;
图2为一个实施例中考核视频的生成方法的流程示意图;FIG. 2 is a schematic flowchart of a method for generating an assessment video in an embodiment;
图3为一个实施例中步骤S202的流程示意图;FIG. 3 is a schematic flowchart of step S202 in an embodiment;
图4为一个实施例中步骤S204的流程示意图;FIG. 4 is a schematic flowchart of step S204 in an embodiment;
图5a为一个实施例中考核视频的生成方法的流程示意图;Figure 5a is a schematic flowchart of a method for generating an assessment video in an embodiment;
图5b为一个实施例中上传考核视频的界面示意图;Figure 5b is a schematic diagram of an interface for uploading an assessment video in an embodiment;
图6为一个实施例中超声显示终端的登录界面示意图;Figure 6 is a schematic diagram of a login interface of an ultrasound display terminal in an embodiment;
图7为一个实施例中考核视频的生成方法的流程示意图;FIG. 7 is a schematic flowchart of a method for generating an assessment video in an embodiment;
图8a为一个实施例中第一终端的评价查询界面示意图;Figure 8a is a schematic diagram of an evaluation query interface of a first terminal in an embodiment;
图8b为一个实施例中第一终端的评价查询界面示意图;Figure 8b is a schematic diagram of an evaluation query interface of the first terminal in an embodiment;
图9为一个实施例中考核视频的生成装置的结构框图;Figure 9 is a structural block diagram of a device for generating assessment videos in an embodiment;
图10为一个实施例中计算机设备的内部结构图。Fig. 10 is an internal structure diagram of a computer device in an embodiment.
具体实施方式detailed description
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。In order to make the purpose, technical solutions, and advantages of this application clearer, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not used to limit the present application.
本申请提供的考核视频的生成方法,可以应用于如图1所示的应用环境中。其中,超声显示终端102通过网络与云端服务器104进行通信。待考核医师(通常为初级医师)所使用的第一终端106、专家医师所使用的第二终端108也通过网络与云端服务器104进行通信。通过超声显示终端102响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头 的操作手法进行图像采集;从而根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;当视频录制结束时,将第一临时文件与第二临时文件合并,生成超声扫查技能对应的考核视频文件。The method for generating assessment videos provided in this application can be applied to the application environment as shown in FIG. 1. Wherein, the ultrasound display terminal 102 communicates with the cloud server 104 through the network. The first terminal 106 used by the physician to be assessed (usually a junior physician) and the second terminal 108 used by the expert physician also communicate with the cloud server 104 via the network. The ultrasonic display terminal 102 responds to the video recording instruction to start acquiring the display interface image of the ultrasonic display terminal, and at the same time, the image acquisition device is turned on to perform image acquisition of the operating method of the ultrasonic probe; thus, the first temporary file is generated according to the acquired display interface image sequence , Generate a second temporary file according to the collected operation technique image sequence; when the video recording ends, merge the first temporary file with the second temporary file to generate an assessment video file corresponding to the ultrasound scanning skills.
其中,超声成像设备包括超声探头和超声显示终端102。超声显示终端102包括处理器、显示器和存储器。处理器对超声回波信号/数据进行处理,以获得目标部位的超声图像或者介入性物体的超声图像。处理器获得的超声图像可以存储于存储器中,这些超声图像可以在显示器上显示,还可以发送给超声工作站。第一终端106、第二终端108可以但不限于是各种个人计算机、笔记本电脑、智能手机、平板电脑和便携式可穿戴设备,云端服务器104可以用独立的服务器或者是多个服务器组成的服务器集群来实现。Among them, the ultrasound imaging equipment includes an ultrasound probe and an ultrasound display terminal 102. The ultrasound display terminal 102 includes a processor, a display, and a memory. The processor processes the ultrasonic echo signal/data to obtain the ultrasonic image of the target part or the ultrasonic image of the interventional object. The ultrasound images obtained by the processor can be stored in the memory, and these ultrasound images can be displayed on the display or sent to the ultrasound workstation. The first terminal 106 and the second terminal 108 can be, but are not limited to, various personal computers, laptops, smart phones, tablets, and portable wearable devices. The cloud server 104 can be an independent server or a server cluster composed of multiple servers. to realise.
在一个实施例中,如图2所示,提供了一种考核视频的生成方法,以该方法应用于图1中的超声显示终端102为例进行说明,包括以下步骤:In one embodiment, as shown in FIG. 2, a method for generating an assessment video is provided. Taking the method applied to the ultrasound display terminal 102 in FIG. 1 as an example for description, the method includes the following steps:
S202、响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集。S202. In response to the video recording instruction, start to acquire the display interface image of the ultrasonic display terminal, and at the same time, turn on the image acquisition device to perform image acquisition on the operating method of the ultrasonic probe.
其中,在进行医学超声检测时,初级医师操作超声探头在待检测的目标部位进行扫查。超声显示终端通过超声线缆在超声探头上施加电信号使得超声探头向待检测的目标部位发出超声波。超声探头接收目标部位反射的回波信号并将该回波信号通过超声线缆反馈给超声显示终端,超声显示终端根据回波信号可以生成目标部位的超声图像,以供医师诊断。目标部位为医师的感兴趣部位,例如肝脏、胰腺、子宫等。超声显示终端运行时,可以提供相应的显示界面供初级医师操作,在上述显示界面中,可以包括标识选框或者菜单栏等控件。初级医师可以根据实际使用情况通过显示界面输入对超声图像的操作指令,以通过超声显示终端对超声成像进行测量等操作。超声探头的操作手法可以包括将超声探头前进、后退、旋转、向左倾斜、向右倾斜、加减力度、加减速等。图像采集设备可以将医师对超声探头的操作手法进行图像采集,从而保存其对超声探头的操作手法,为生成考核视频文件打下基础。Among them, when performing medical ultrasound testing, the primary physician operates the ultrasound probe to scan the target site to be tested. The ultrasonic display terminal applies an electrical signal to the ultrasonic probe through the ultrasonic cable so that the ultrasonic probe emits ultrasonic waves to the target site to be detected. The ultrasonic probe receives the echo signal reflected by the target part and feeds the echo signal back to the ultrasonic display terminal through the ultrasonic cable. The ultrasonic display terminal can generate an ultrasonic image of the target part according to the echo signal for diagnosis by the physician. The target part is a part of interest of the physician, such as liver, pancreas, uterus, etc. When the ultrasound display terminal is running, a corresponding display interface can be provided for primary physicians to operate. The above display interface can include controls such as a logo marquee or a menu bar. The junior doctor can input the operation instructions for the ultrasound image through the display interface according to the actual use situation, so as to perform operations such as measurement of the ultrasound image through the ultrasound display terminal. The operating methods of the ultrasound probe may include forward, backward, rotating, tilting to the left, tilting to the right, increasing or decreasing the force, acceleration and deceleration, etc. of the ultrasound probe. The image acquisition device can collect the image of the doctor's operation method of the ultrasound probe, thereby saving his operation method of the ultrasound probe, and lay the foundation for generating the assessment video file.
具体地,在超声显示终端的显示界面内设置视频录制按钮,当初级医师在超声显示终端进行扫查练习或者扫查考试时,触发该视频录制按钮。若要对初 级医师的技能水平做出正确且全满的评估,不仅需要将超声扫查过程中超声显示终端显示界面的实况进行录屏,还需要记录初级医师对超声探头的操作手法。因此,超声显示终端对初级医师发出的视频录制指令做出响应,不仅开始对超声显示终端的显示界面进行录屏,而且同时开启图像采集设备对超声探头的操作手法进行图像采集。从而可以将初级医师的超声扫查过程完整地保存下来,以便专家医师后续对初级医师的技能水平进行评估。需要说明的是,图像采集设备的拍摄范围可以包括超声探头的操作手法,也可以包括初级医师的脸部,以避免作弊行为的发生。Specifically, a video recording button is set in the display interface of the ultrasound display terminal, and the video recording button is triggered when the junior physician performs scanning exercises or scanning examinations on the ultrasound display terminal. To make a correct and full assessment of the skill level of junior physicians, it is not only necessary to record the live status of the ultrasound display terminal display interface during the ultrasound scanning process, but also to record the operation techniques of the junior physician on the ultrasound probe. Therefore, the ultrasound display terminal responds to the video recording instruction issued by the primary physician, and not only starts to record the screen of the display interface of the ultrasound display terminal, but also turns on the image acquisition device to perform image acquisition on the operating method of the ultrasound probe. In this way, the ultrasound scanning process of the primary physician can be completely preserved, so that the expert physician can subsequently evaluate the skill level of the primary physician. It should be noted that the shooting range of the image acquisition device may include the operation technique of the ultrasound probe, and may also include the face of the primary physician, so as to avoid the occurrence of cheating.
S204、根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件。S204: Generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of the manipulation technique.
具体地,在超声扫查技能的考核过程中,对超声显示设备的显示界面进行录屏而获取的一系列显示界面图像构成显示界面图像序列。通过图像采集设备采集的一系列操作手法图像构成操作手法图像序列。为了简化考核方式提升考核效率,本申请创造性地利用显示界面图像序列与操作手法图像序列创建考核视频文件,且在播放考核视频文件时,需要确保按照显示界面图像与操作手法图像之间的时间对应关系,将两者同步播放。因此,为了保证数据的准确性以及后续可以生成有序的考核视频文件,将显示界面图像以及操作手法图像分别进行临时性保存。将获取的显示界面图像序列保存在第一临时文件内,将采集的操作手法图像序列保存在第二临时文件内。Specifically, during the assessment process of the ultrasound scanning skills, a series of display interface images obtained by recording the display interface of the ultrasound display device constitute a display interface image sequence. A series of manipulation images collected by the image capture device constitutes a sequence of manipulation images. In order to simplify the evaluation method and improve the evaluation efficiency, this application creatively uses the display interface image sequence and the operation technique image sequence to create the evaluation video file, and when playing the evaluation video file, it is necessary to ensure that the time correspondence between the display interface image and the operation technique image is followed Relationship, the two will be played synchronously. Therefore, in order to ensure the accuracy of the data and the subsequent generation of an orderly assessment video file, the display interface image and the operation technique image are respectively temporarily saved. The acquired image sequence of the display interface is saved in the first temporary file, and the acquired operation technique image sequence is saved in the second temporary file.
S206,当视频录制结束时,将第一临时文件与第二临时文件合并,生成超声扫查技能对应的考核视频文件。S206: When the video recording ends, the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skill.
具体地,一方面,为了提升考核效率,将第一临时文件与第二临时文件合并生成一个视频文件,减少专家医师考核工作所花费的时间和精力。另一方面,需要确保考核视频文件的准确性,显示界面图像画面与操作手法图像画面的同步性播放,从而停止获取显示界面图像的时间与停止采集操作手法图像的时间需保持一致。因此,在视频录制结束的时刻,将第一临时文件与第二临时文件合并,生成超声扫查技能对应的考核视频文件,并删除第一临时文件与第二临时文件。其中,考核视频文件设有文件头,文件头信息包括考核视频文件的数 据长度信息。Specifically, on the one hand, in order to improve the evaluation efficiency, the first temporary file and the second temporary file are merged to generate a video file, which reduces the time and effort spent on the evaluation of expert physicians. On the other hand, it is necessary to ensure the accuracy of the assessment video file and the synchronized playback of the display interface image screen and the operation technique image screen, so that the time to stop acquiring the display interface image and the time to stop collecting the operation technique image must be consistent. Therefore, at the end of the video recording, the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasonic scanning skills, and the first temporary file and the second temporary file are deleted. Among them, the assessment video file is provided with a file header, and the file header information includes the data length information of the assessment video file.
上述考核视频的生成方法中,通过响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集,保证了两部分图像具有相同的起始时刻;并根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;当视频录制结束时,将第一临时文件与第二临时文件合并,生成超声扫查技能对应的考核视频文件,保证了两部分图像具有相同的结束时刻;实现了考核视频文件中显示界面图像画面与操作手法图像画面的同步播放,从而可以利用考核视频文件对初级医师的超声扫查技能进行考核,改变了传统技术中超声扫查技能的考核方式,避免专家医师现场查看初级医师的扫查过程,提升超声扫查技能的考核效率。In the above-mentioned method for generating the assessment video, by responding to the video recording instruction, starting to acquire the display interface image of the ultrasonic display terminal, and simultaneously turning on the image acquisition device to collect the image of the operation method of the ultrasonic probe, ensuring that the two parts of the image have the same effect. The first time; and generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired operation technique image sequence; when the video recording ends, the first temporary file and the second temporary file are merged to generate ultrasound The assessment video file corresponding to the scanning skill ensures that the two parts of the image have the same end time; the synchronization of the display interface image screen and the operation method image screen in the assessment video file is realized, so that the assessment video file can be used for the ultrasound of the junior physician The assessment of scanning skills has changed the assessment method of ultrasonic scanning skills in traditional technology, avoiding expert physicians from viewing the scanning process of junior physicians on site, and improving the assessment efficiency of ultrasonic scanning skills.
在一个实施例中,如图3所示,响应于视频录制指令,开始获取超声显示终端的显示界面图像,包括以下步骤:In one embodiment, as shown in FIG. 3, in response to a video recording instruction, starting to acquire a display interface image of the ultrasound display terminal includes the following steps:
S302、响应于视频录制指令,在超声显示终端的显示界面中新建窗口,且窗口对应的显示界面中除超声图像区域之外的其他区域均被遮挡;S302. In response to the video recording instruction, create a new window in the display interface of the ultrasound display terminal, and all areas except the ultrasound image area in the display interface corresponding to the window are blocked;
S304、获取窗口对应的显示界面图像。S304. Acquire a display interface image corresponding to the window.
其中,超声显示终端的显示界面图像不仅包括超声图像区域,还包括显示病人信息、医生信息、医院信息等的其他区域。具体地,为了保证考核的公平,对于专家医师来说,需要将其他区域的这些信息隐藏。因此,在开始视频录制之前,即响应于视频录制指令后,可以在超声显示终端的显示界面中新建窗口。为了不影响被考核医师的正常发挥,该窗口可以对于被考核医师是不可见的,即被考核医师所看到的信息依旧包括超声图像区域和其他区域的信息,而专家医师仅仅需要看到超声图像区域,则新建的窗口所对应的显示界面中除超声图像区域之外的其他区域均被遮挡,从而基于新建的窗口获取对应的显示界面图像。Among them, the display interface image of the ultrasound display terminal includes not only the ultrasound image area, but also other areas that display patient information, doctor information, and hospital information. Specifically, in order to ensure the fairness of the assessment, it is necessary for expert physicians to hide this information in other areas. Therefore, before starting the video recording, that is, after responding to the video recording instruction, a new window can be created in the display interface of the ultrasound display terminal. In order not to affect the normal performance of the assessed physician, the window can be invisible to the assessed physician, that is, the information seen by the assessed physician still includes the information of the ultrasound image area and other areas, while the expert physician only needs to see the ultrasound In the image area, all areas of the display interface corresponding to the newly created window except the ultrasound image area are blocked, so that the corresponding display interface image is obtained based on the newly created window.
本实施例中,通过新建窗口,且该窗口对应的显示界面中除超声图像区域之外的其他区域均被遮挡,保证了考核的公平性。In this embodiment, a new window is created, and all areas except the ultrasound image area in the display interface corresponding to the window are blocked, which ensures the fairness of the assessment.
在一个实施例中,如图4所示,根据获取的显示界面图像序列生成第一临 时文件,根据采集的操作手法图像序列生成第二临时文件,包括以下步骤:In one embodiment, as shown in Fig. 4, generating the first temporary file according to the acquired display interface image sequence, and generating the second temporary file according to the acquired operation technique image sequence, includes the following steps:
S402、以预设帧率获取显示界面图像,并按照时间顺序依次写入第一临时文件;S402: Acquire a display interface image at a preset frame rate, and write them in the first temporary file sequentially in chronological order;
S404、以相同的预设帧率采集操作手法图像,并按照时间顺序依次写入第二临时文件。S404: Collect the operation technique images at the same preset frame rate, and write them into the second temporary file in sequence according to the time sequence.
其中,第一临时文件的帧数与第二临时文件的帧数相同。具体地,为确保考核视频文件的准确性,显示界面图像画面与操作手法图像画面的同步性播放,开始获取显示界面图像的时间与开始采集操作手法图像的时间需保持一致,停止获取显示界面图像的时间与停止采集操作手法图像的时间需保持一致,且两者需要以相同的帧率(比如每秒15帧)将各自对应的图像分别按照时间顺序写入第一临时文件以及第二临时文件。Wherein, the number of frames of the first temporary file is the same as the number of frames of the second temporary file. Specifically, in order to ensure the accuracy of the assessment video file, the display interface image screen and the operation technique image screen are played synchronously, the time to start acquiring the display interface image and the time to start collecting the operation technique image must be consistent, and the acquisition of the display interface image must be stopped. The time of, and the time of stopping the acquisition of the image of the operation technique must be the same, and the two need to write their corresponding images to the first temporary file and the second temporary file in chronological order at the same frame rate (for example, 15 frames per second) .
进一步地,将第二临时文件追加至第一临时文件的末尾位置,生成超声扫查技能对应的考核视频文件。Further, the second temporary file is appended to the end position of the first temporary file to generate an assessment video file corresponding to the ultrasonic scanning skills.
本实施例中,将获取的显示界面图像以及操作手法图像以相同的帧率按照时间顺序临时性地保存,将获取的显示界面图像序列写入第一临时文件内,将采集的操作手法图像序列写入第二临时文件内,可以保证数据的准确性以及后续可以生成有序的考核视频文件。In this embodiment, the acquired display interface image and operation technique image are temporarily saved in chronological order at the same frame rate, the acquired display interface image sequence is written into the first temporary file, and the acquired operation technique image sequence Writing into the second temporary file can ensure the accuracy of the data and the subsequent generation of an orderly assessment video file.
在一个实施例中,如图5a所示,考核视频文件的数量为多个。该方法还包括以下步骤:In one embodiment, as shown in FIG. 5a, the number of assessment video files is multiple. The method also includes the following steps:
S502、响应于至少一个考核视频文件的选择指令,将选择指令对应的考核视频文件确定为待上传的考核视频文件;S502: In response to the selection instruction of at least one evaluation video file, determine the evaluation video file corresponding to the selection instruction as the evaluation video file to be uploaded;
S504、响应于上传指令,将待上传的考核视频文件上传至云端服务器。S504. In response to the upload instruction, upload the assessment video file to be uploaded to the cloud server.
其中,如图5b所示,初级医师可以在超声显示终端针对练习要求或者考试要求进行多次操作,得到多个考核视频文件,可以对多个考核视频文件进行浏览,从多个考核视频文件中确定较为满意的视频文件。具体地,对多个考核视频文件进行选择操作,响应于至少一个考核视频文件的选择指令,被选中的至少一个考核视频文件确定为带上传的考核视频文件。接着,触发显示界面中的上传按钮,响应于上传指令,对待上传的考核视频文件开始上传,通过上传考 核视频文件至云端服务器,专家医师可以随时随地查看,方便专家医师对初级医师的技能进行考核和评分。当专家医师对已上传的考核视频文件作出评价,生成评价数据,云端服务器可以将评价数据进行存储,则云端服务器存储有对已上传的考核视频文件进行评价所产生的评价数据。Among them, as shown in Figure 5b, the junior physician can perform multiple operations on the ultrasound display terminal for practice requirements or examination requirements to obtain multiple assessment video files, and can browse multiple assessment video files from multiple assessment video files. Determine the more satisfactory video file. Specifically, a selection operation is performed on multiple evaluation video files, and in response to a selection instruction of at least one evaluation video file, the selected at least one evaluation video file is determined to be an evaluation video file with upload. Then, the upload button in the display interface is triggered, and in response to the upload instruction, the assessment video file to be uploaded starts to upload. By uploading the assessment video file to the cloud server, expert physicians can view it anytime and anywhere, which is convenient for expert physicians to assess the skills of junior physicians And score. When an expert physician evaluates the uploaded evaluation video file and generates evaluation data, the cloud server can store the evaluation data, and the cloud server stores the evaluation data generated by evaluating the uploaded evaluation video file.
本实施例中,通过将考核视频文件上传至服务器,方便专家医师对初级医师的技能水平进行评价,避免专家医师现场查看初级医师的扫查过程,节约专家医师的时间,提升超声扫查技能的考核效率。In this embodiment, by uploading the assessment video file to the server, it is convenient for expert physicians to evaluate the skill level of junior physicians, avoiding expert physicians to check the scanning process of junior physicians on site, saving expert physicians’ time, and improving ultrasound scanning skills. Assess efficiency.
在一个实施例中,在响应于视频录制指令之前,该方法还包括:响应于登录指令,登录至超声显示终端。其中,登录指令包括被考核医师的用户标识,用户标识用于指示云端服务器与超声显示终端建立网络连接。In one embodiment, before responding to the video recording instruction, the method further includes: responding to the login instruction, logging in to the ultrasound display terminal. Wherein, the login instruction includes the user identification of the assessed physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
具体地,如图6所示,超声显示终端显示登陆界面,被考核医师设有用户标识,利用被考核医师(通常为初级医师)的用户标识及密码进行登陆。响应于登录指令,登录至超声显示终端。其中,登录指令包括被考核医师的用户标识,用户标识用于指示云端服务器与超声显示终端建立网络连接。基于云端服务器与超声显示终端之间的网络连接,被考核医师可以获取练习要求或者考试要求,才可以将考核视频文件上传至云端服务器。Specifically, as shown in FIG. 6, the ultrasound display terminal displays a login interface, and the assessed physician is provided with a user ID, and the user ID and password of the assessed physician (usually a junior physician) are used to log in. In response to the login instruction, log in to the ultrasound display terminal. Wherein, the login instruction includes the user identification of the assessed physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal. Based on the network connection between the cloud server and the ultrasound display terminal, the assessed physician can obtain practice requirements or examination requirements before uploading the assessment video file to the cloud server.
在一个实施例中,当视频录制结束时,将第一临时文件与第二临时文件合并,包括:当视频录制的时长达到预设时长时,结束视频录制,将第一临时文件与第二临时文件合并;或响应于视频停止录制指令,结束视频录制,将第一临时文件与第二临时文件合并。In one embodiment, when the video recording ends, merging the first temporary file with the second temporary file includes: when the duration of the video recording reaches the preset duration, ending the video recording, and combining the first temporary file with the second temporary file File merging; or in response to the video stop recording instruction, end video recording, and merge the first temporary file with the second temporary file.
在一个实施例中,如图7所示,本申请提供一种考核视频的生成方法,该方法包括以下步骤:In one embodiment, as shown in FIG. 7, the present application provides a method for generating an assessment video. The method includes the following steps:
S702、响应于登录指令,登录至超声显示终端。S702. Log in to the ultrasound display terminal in response to the login instruction.
其中,登录指令包括被考核医师的用户标识,用户标识用于指示云端服务器与超声显示终端建立网络连接。Wherein, the login instruction includes the user identification of the assessed physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
S704、响应于视频录制指令,在超声显示终端的显示界面中新建窗口,且窗口对应的显示界面中除超声图像区域之外的其他区域均被遮挡。S704. In response to the video recording instruction, create a new window in the display interface of the ultrasound display terminal, and all areas of the display interface corresponding to the window except the ultrasound image area are blocked.
S706、获取窗口对应的显示界面图像,并同时开启图像采集设备对超声探 头的操作手法进行图像采集。S706: Acquire a display interface image corresponding to the window, and at the same time turn on the image acquisition device to perform image acquisition on the operating method of the ultrasonic probe.
S708、以预设帧率获取显示界面图像,并按照时间顺序依次写入第一临时文件。S708: Acquire the display interface image at a preset frame rate, and write the first temporary file sequentially in chronological order.
S710、以相同的预设帧率采集操作手法图像,并按照时间顺序依次写入第二临时文件。S710. Collect the operation technique images at the same preset frame rate, and write them into the second temporary file in sequence according to the time sequence.
其中,第一临时文件的帧数与第二临时文件的帧数相同。Wherein, the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
S712、当视频录制结束时,将第二临时文件追加至第一临时文件的末尾位置,生成超声扫查技能对应的考核视频文件。S712: When the video recording ends, the second temporary file is appended to the end position of the first temporary file, and an assessment video file corresponding to the ultrasound scanning skill is generated.
其中,考核视频文件的数量为多个。当视频录制的时长达到预设时长时,结束视频录制,将第二临时文件追加至第一临时文件的末尾位置;或响应于视频停止录制指令,结束视频录制,将第二临时文件追加至第一临时文件的末尾位置。Among them, the number of assessment video files is multiple. When the duration of the video recording reaches the preset duration, the video recording is ended, and the second temporary file is appended to the end of the first temporary file; or in response to the video stop recording instruction, the video recording is ended, and the second temporary file is appended to the first temporary file. The end position of a temporary file.
S714、响应于至少一个考核视频文件的选择指令,将选择指令对应的考核视频文件确定为待上传的考核视频文件。S714. In response to the selection instruction of at least one evaluation video file, determine the evaluation video file corresponding to the selection instruction as the evaluation video file to be uploaded.
S716、响应于上传指令,将待上传的考核视频文件上传至云端服务器。S716: In response to the upload instruction, upload the assessment video file to be uploaded to the cloud server.
其中,云端服务器存储有对已上传的考核视频文件进行评价所产生的评价数据。Among them, the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
在一个实施例中,本申请提供一种考核视频的生成方法,该方法包括以下步骤:In one embodiment, the present application provides a method for generating assessment videos. The method includes the following steps:
S802、通过第二终端创建班级标识。S802. Create a class identifier through the second terminal.
S804、通过第二终端,建立被考核医师的用户标识与班级标识之间的对应关系。S804. Through the second terminal, establish a correspondence between the user ID of the assessed physician and the class ID.
S806、通过第二终端,创建练习或考试要求所对应的数据,并建立与班级标识的对应关系。S806. Through the second terminal, create data corresponding to the practice or test requirements, and establish a corresponding relationship with the class identifier.
S810、通过超声显示终端,响应于登录指令,登录至超声显示终端;登录指令包括被考核医师的用户标识,用户标识用于指示云端服务器与超声显示终端建立网络连接。S810. Log in to the ultrasound display terminal in response to the login instruction through the ultrasound display terminal; the login instruction includes the user identification of the examined physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
S812、通过云端服务器与超声显示终端之间网络连接,根据被考核医师的 用户标识获取练习或考试要求所对应的数据。S812. Obtain the data corresponding to the practice or examination requirements through the network connection between the cloud server and the ultrasound display terminal according to the user ID of the examined physician.
S814、响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集。S814. In response to the video recording instruction, start to acquire the display interface image of the ultrasound display terminal, and at the same time turn on the image acquisition device to perform image acquisition on the operating method of the ultrasound probe.
S816、根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件。S816: Generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of the manipulation technique.
其中,以预设帧率获取显示界面图像,并按照时间顺序依次写入第一临时文件;以相同的预设帧率采集操作手法图像,并按照时间顺序依次写入第二临时文件;其中,第一临时文件的帧数与第二临时文件的帧数相同。则可以保证显示界面图像与操作手法图像可以同步播放。Among them, the display interface images are acquired at a preset frame rate and written into the first temporary file in chronological order; the operation technique images are acquired at the same preset frame rate and written into the second temporary file in chronological order; wherein, The number of frames of the first temporary file is the same as the number of frames of the second temporary file. It can be ensured that the image of the display interface and the image of the operation technique can be played synchronously.
S818、响应于视频录制指令,将第二临时文件追加至第一临时文件的末尾位置,生成超声扫查技能对应的考核视频文件S818. In response to the video recording instruction, append the second temporary file to the end position of the first temporary file, and generate an assessment video file corresponding to the ultrasound scanning skill
S820、响应于至少一个考核视频文件的选择指令,将选择指令对应的考核视频文件确定为待上传的考核视频文件。S820: In response to the selection instruction of at least one evaluation video file, determine the evaluation video file corresponding to the selection instruction as the evaluation video file to be uploaded.
S822、响应于上传指令,将待上传的考核视频文件上传至云端服务器;S822: In response to the upload instruction, upload the assessment video file to be uploaded to the cloud server;
S822、通过第二终端,接收对已上传的考核视频文件进行评价所产生的评价数据。S822. Receive, through the second terminal, evaluation data generated by evaluating the uploaded evaluation video file.
具体地,专家医师在第二终端查看考核视频文件,同步播放超声图像以及操作手法图像。通过第二终端的显示界面专家医师对待考核意识进行评价,生成评价数据。第二终端可以将评价数据发送至云端服务器,云端服务器接收对已上传的考核视频文件进行评价所产生的评价数据。Specifically, the expert physician views the assessment video file on the second terminal, and simultaneously plays the ultrasound image and the operation technique image. The expert physician evaluates the awareness to be evaluated through the display interface of the second terminal, and generates evaluation data. The second terminal may send the evaluation data to the cloud server, and the cloud server receives the evaluation data generated by evaluating the uploaded evaluation video file.
S824、通过第一终端,响应于评价查询指令,获取并显示云端服务器返回的评价数据。S824. Obtain and display the evaluation data returned by the cloud server in response to the evaluation query instruction through the first terminal.
其中,查询指令包括被考核医师的用户标识,用户标识用于指示云端服务器根据用户标识查找对应的评价数据。具体地,如图8a和8b所示,被考核医师通过第一终端查询练习或者考试的考核结果。Wherein, the query instruction includes the user identification of the assessed physician, and the user identification is used to instruct the cloud server to search for corresponding evaluation data according to the user identification. Specifically, as shown in FIGS. 8a and 8b, the assessed physician inquires the assessment result of the exercise or examination through the first terminal.
应该理解的是,虽然上述各实施例的流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,这些步骤可以以其 它的顺序执行。而且,上述各实施例中的至少一部分步骤可以包括多个子步骤或者多个阶段,这些子步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,这些子步骤或者阶段的执行顺序也不必然是依次进行,而是可以与其它步骤或者其它步骤的子步骤或者阶段的至少一部分轮流或者交替地执行。It should be understood that, although the steps in the flowcharts of the foregoing embodiments are displayed in sequence as indicated by the arrows, these steps are not necessarily performed in sequence in the order indicated by the arrows. Unless explicitly stated in this article, there is no strict order for the execution of these steps, and these steps can be executed in other orders. Moreover, at least a part of the steps in the foregoing embodiments may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but may be executed at different times. These sub-steps or stages The order of execution of is not necessarily performed sequentially, but may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.
在一个实施例中,如图9所示,提供了一种考核视频的生成装置900,包括:图像获取模块910、临时文件生成模块920和视频文件生成模块930,其中:In one embodiment, as shown in FIG. 9, a device 900 for generating an assessment video is provided, which includes: an image acquisition module 910, a temporary file generation module 920, and a video file generation module 930, wherein:
图像获取模块910,用于响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集;The image acquisition module 910 is configured to start acquiring the display interface image of the ultrasound display terminal in response to the video recording instruction, and at the same time turn on the image acquisition device to perform image acquisition on the operating method of the ultrasound probe;
临时文件生成模块920,用于根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;The temporary file generating module 920 is configured to generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of manipulation techniques;
视频文件生成模块930,用于当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,生成所述超声扫查技能对应的考核视频文件。The video file generating module 930 is configured to merge the first temporary file with the second temporary file when the video recording ends to generate an assessment video file corresponding to the ultrasound scanning skill.
在一个实施例中,图像获取模块910,还用于响应于视频录制指令,在所述超声显示终端的显示界面中新建窗口,且所述窗口对应的显示界面中除超声图像区域之外的其他区域均被遮挡;获取所述窗口对应的显示界面图像。In one embodiment, the image acquisition module 910 is further configured to create a new window in the display interface of the ultrasound display terminal in response to a video recording instruction, and the display interface corresponding to the window except the ultrasound image area The areas are all blocked; the display interface image corresponding to the window is acquired.
在一个实施例中,临时文件生成模块920,还用于以预设帧率获取所述显示界面图像,并按照时间顺序依次写入第一临时文件;以相同的预设帧率采集所述操作手法图像,并按照时间顺序依次写入第二临时文件;其中,所述第一临时文件的帧数与所述第二临时文件的帧数相同。In one embodiment, the temporary file generating module 920 is further configured to obtain the display interface image at a preset frame rate, and write the first temporary file sequentially in chronological order; to capture the operation at the same preset frame rate The manual image is written into the second temporary file sequentially in chronological order; wherein the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
在一个实施例中,视频文件生成模块930,还用于将第二临时文件追加至第一临时文件的末尾位置,生成所述超声扫查技能对应的考核视频文件。In one embodiment, the video file generating module 930 is further configured to append the second temporary file to the end position of the first temporary file to generate an assessment video file corresponding to the ultrasound scanning skill.
在一个实施例中,所述考核视频文件的数量为多个;该生成装置还包括视频文件选择模块和视频文件上传模块,其中:In an embodiment, the number of the assessment video files is multiple; the generating device further includes a video file selection module and a video file upload module, wherein:
视频文件选择模块,用于响应于至少一个所述考核视频文件的选择指令,将所述选择指令对应的考核视频文件确定为待上传的考核视频文件;The video file selection module is configured to respond to at least one selection instruction of the evaluation video file, and determine the evaluation video file corresponding to the selection instruction as the evaluation video file to be uploaded;
视频文件上传模块,用于响应于上传指令,将所述待上传的考核视频文件上传至云端服务器;所述云端服务器存储有对已上传的考核视频文件进行评价 所产生的评价数据。The video file upload module is configured to upload the evaluation video file to be uploaded to a cloud server in response to an upload instruction; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
在一个实施例中,该生成装置还包括登陆模块,用于响应于登录指令,登录至所述超声显示终端;所述登录指令包括被考核医师的用户标识,所述用户标识用于指示所述云端服务器与所述超声显示终端建立网络连接。In one embodiment, the generating device further includes a login module for logging in to the ultrasound display terminal in response to a login instruction; the login instruction includes the user identification of the examined physician, and the user identification is used to indicate the The cloud server establishes a network connection with the ultrasound display terminal.
在一个实施例中,视频文件生成模块930,还用于当视频录制的时长达到预设时长时,结束视频录制,将所述第一临时文件与所述第二临时文件合并;或响应于视频停止录制指令,结束视频录制,将所述第一临时文件与所述第二临时文件合并。In one embodiment, the video file generation module 930 is further configured to end video recording when the duration of the video recording reaches a preset duration, and merge the first temporary file with the second temporary file; or respond to the video Stop the recording instruction, end the video recording, and merge the first temporary file with the second temporary file.
关于考核视频的生成装置的具体限定可以参见上文中对于考核视频的生成方法的限定,在此不再赘述。上述考核视频的生成装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中,也可以以软件形式存储于计算机设备中的存储器中,以便于处理器调用执行以上各个模块对应的操作。Regarding the specific limitation on the generating device of the assessment video, please refer to the above limitation on the generating method of the assessment video, which will not be repeated here. Each module in the device for generating an assessment video described above can be implemented in whole or in part by software, hardware, and a combination thereof. The foregoing modules may be embedded in the form of hardware or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the foregoing modules.
在一个实施例中,提供了一种计算机设备,该计算机设备可以是终端,其内部结构图可以如图10所示。该计算机设备包括通过系统总线连接的处理器、存储器、通信接口、显示屏和输入装置。其中,该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统和计算机程序。该内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境。该计算机设备的通信接口用于与外部的终端进行有线或无线方式的通信,无线方式可通过WIFI、运营商网络、NFC(近场通信)或其他技术实现。该计算机程序被处理器执行时以实现一种考核视频的生成方法。该计算机设备的显示屏可以是液晶显示屏或者电子墨水显示屏,该计算机设备的输入装置可以是显示屏上覆盖的触摸层,也可以是计算机设备外壳上设置的按键、轨迹球或触控板,还可以是外接的键盘、触控板或鼠标等。In one embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. 10. The computer equipment includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, an operator's network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a method for generating an assessment video is realized. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, or it can be a button, trackball or touchpad set on the housing of the computer equipment , It can also be an external keyboard, touchpad, or mouse.
本领域技术人员可以理解,图10中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的计算机设备的限定,具体的计算机设备可以包括比图中所示更多或更少的部件,或者组合某些部件, 或者具有不同的部件布置。Those skilled in the art can understand that the structure shown in FIG. 10 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may Including more or less parts than shown in the figure, or combining some parts, or having a different arrangement of parts.
在一个实施例中,提供了一种计算机设备,包括存储器和处理器,存储器中存储有计算机程序,该处理器执行计算机程序时实现以下步骤:In one embodiment, a computer device is provided, including a memory and a processor, and a computer program is stored in the memory, and the processor implements the following steps when the processor executes the computer program:
响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集;根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,生成超声扫查技能对应的考核视频文件。In response to the video recording instruction, start to acquire the display interface image of the ultrasonic display terminal, and at the same time turn on the image acquisition device to collect the image of the operation method of the ultrasonic probe; generate the first temporary file according to the acquired display interface image sequence, and according to the collected operation method The image sequence generates a second temporary file; when the video recording ends, the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skills.
在一个实施例中,处理器执行计算机程序时还实现以下步骤:响应于视频录制指令,在所述超声显示终端的显示界面中新建窗口,且所述窗口对应的显示界面中除超声图像区域之外的其他区域均被遮挡;获取所述窗口对应的显示界面图像。In one embodiment, the processor further implements the following steps when executing the computer program: in response to the video recording instruction, a new window is created in the display interface of the ultrasound display terminal, and the display interface corresponding to the window except for the ultrasound image area All other areas outside are blocked; the display interface image corresponding to the window is acquired.
在一个实施例中,处理器执行计算机程序时还实现以下步骤:以预设帧率获取所述显示界面图像,并按照时间顺序依次写入第一临时文件;以相同的预设帧率采集所述操作手法图像,并按照时间顺序依次写入第二临时文件;其中,所述第一临时文件的帧数与所述第二临时文件的帧数相同。In one embodiment, the processor further implements the following steps when executing the computer program: acquiring the display interface images at a preset frame rate, and writing them to the first temporary file in chronological order; acquiring all images at the same preset frame rate The operation technique images are sequentially written into the second temporary file in chronological order; wherein the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
在一个实施例中,处理器执行计算机程序时还实现以下步骤:将第二临时文件追加至第一临时文件的末尾位置,生成所述超声扫查技能对应的考核视频文件。In one embodiment, when the processor executes the computer program, the following steps are further implemented: append a second temporary file to the end position of the first temporary file, and generate an assessment video file corresponding to the ultrasound scanning skill.
在一个实施例中,所述考核视频文件的数量为多个;处理器执行计算机程序时还实现以下步骤:响应于至少一个所述考核视频文件的选择指令,将所述选择指令对应的考核视频文件确定为待上传的考核视频文件;响应于上传指令,将所述待上传的考核视频文件上传至云端服务器;所述云端服务器存储有对已上传的考核视频文件进行评价所产生的评价数据。In one embodiment, the number of the evaluation video files is multiple; the processor further implements the following step when executing the computer program: in response to at least one selection instruction of the evaluation video file, the evaluation video file corresponding to the selection instruction The file is determined to be an evaluation video file to be uploaded; in response to an upload instruction, the evaluation video file to be uploaded is uploaded to a cloud server; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
在一个实施例中,处理器执行计算机程序时还实现以下步骤:响应于登录指令,登录至所述超声显示终端;所述登录指令包括被考核医师的用户标识,所述用户标识用于指示所述云端服务器与所述超声显示终端建立网络连接。In one embodiment, the processor further implements the following steps when executing the computer program: in response to a login instruction, log in to the ultrasound display terminal; the login instruction includes the user identification of the examined physician, and the user identification is used to indicate The cloud server establishes a network connection with the ultrasound display terminal.
在一个实施例中,处理器执行计算机程序时还实现以下步骤:当视频录制 的时长达到预设时长时,结束视频录制,将所述第一临时文件与所述第二临时文件合并;或响应于视频停止录制指令,结束视频录制,将所述第一临时文件与所述第二临时文件合并。In one embodiment, the processor further implements the following steps when executing the computer program: when the duration of the video recording reaches a preset duration, ending the video recording, and merging the first temporary file with the second temporary file; or responding In the video stop recording instruction, the video recording is ended, and the first temporary file and the second temporary file are merged.
在一个实施例中,提供了一种计算机可读存储介质,其上存储有计算机程序,计算机程序被处理器执行时实现以下步骤:In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集;根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,生成超声扫查技能对应的考核视频文件。In response to the video recording instruction, start to acquire the display interface image of the ultrasonic display terminal, and at the same time turn on the image acquisition device to collect the image of the operation method of the ultrasonic probe; generate the first temporary file according to the acquired display interface image sequence, and according to the collected operation method The image sequence generates a second temporary file; when the video recording ends, the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skills.
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:响应于视频录制指令,在所述超声显示终端的显示界面中新建窗口,且所述窗口对应的显示界面中除超声图像区域之外的其他区域均被遮挡;获取所述窗口对应的显示界面图像。In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: in response to a video recording instruction, a new window is created in the display interface of the ultrasound display terminal, and the ultrasound image area is excluded from the display interface corresponding to the window. Areas other than those are blocked; the display interface image corresponding to the window is acquired.
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:以预设帧率获取所述显示界面图像,并按照时间顺序依次写入第一临时文件;以相同的预设帧率采集所述操作手法图像,并按照时间顺序依次写入第二临时文件;其中,所述第一临时文件的帧数与所述第二临时文件的帧数相同。In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: acquiring the display interface image at a preset frame rate, and sequentially writing to the first temporary file in chronological order; acquiring at the same preset frame rate The operation technique images are sequentially written into the second temporary file in chronological order; wherein the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:将第二临时文件追加至第一临时文件的末尾位置,生成所述超声扫查技能对应的考核视频文件。In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: append a second temporary file to the end position of the first temporary file, and generate an assessment video file corresponding to the ultrasound scanning skill.
在一个实施例中,所述考核视频文件的数量为多个;计算机程序被处理器执行时还实现以下步骤:响应于至少一个所述考核视频文件的选择指令,将所述选择指令对应的考核视频文件确定为待上传的考核视频文件;响应于上传指令,将所述待上传的考核视频文件上传至云端服务器;所述云端服务器存储有对已上传的考核视频文件进行评价所产生的评价数据。In one embodiment, the number of the assessment video files is multiple; when the computer program is executed by the processor, the following steps are further implemented: in response to at least one selection instruction of the assessment video file, the assessment corresponding to the selection instruction The video file is determined to be the evaluation video file to be uploaded; in response to the upload instruction, the evaluation video file to be uploaded is uploaded to the cloud server; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file .
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:响应于登录指令,登录至所述超声显示终端;所述登录指令包括被考核医师的用户标识, 所述用户标识用于指示所述云端服务器与所述超声显示终端建立网络连接。In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: in response to a login instruction, log in to the ultrasound display terminal; the login instruction includes the user identification of the examined physician, and the user identification is used to indicate The cloud server establishes a network connection with the ultrasound display terminal.
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:当视频录制的时长达到预设时长时,结束视频录制,将所述第一临时文件与所述第二临时文件合并;或响应于视频停止录制指令,结束视频录制,将所述第一临时文件与所述第二临时文件合并。In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: when the duration of the video recording reaches a preset duration, the video recording is ended, and the first temporary file and the second temporary file are merged; or In response to the video stop recording instruction, the video recording is ended, and the first temporary file and the second temporary file are merged.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一非易失性计算机可读取存储介质中,该计算机程序在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用,均可包括非易失性和易失性存储器中的至少一种。非易失性存储器可包括只读存储器(Read-Only Memory,ROM)、磁带、软盘、闪存或光存储器等。易失性存储器可包括随机存取存储器(Random Access Memory,RAM)或外部高速缓冲存储器。作为说明而非局限,RAM可以是多种形式,比如静态随机存取存储器(Static Random Access Memory,SRAM)或动态随机存取存储器(Dynamic Random Access Memory,DRAM)等。Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage. In the medium, when the computer program is executed, it may include the procedures of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database or other media used in the embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, or optical storage. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not a limitation, RAM may be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc.
以上实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be It is considered as the range described in this specification.
以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。The above-mentioned embodiments only express several implementation manners of the present application, and their descriptions are more specific and detailed, but they should not be understood as limiting the scope of invention patents. It should be pointed out that for those of ordinary skill in the art, without departing from the concept of this application, several modifications and improvements can be made, and these all fall within the protection scope of this application. Therefore, the scope of protection of the patent of this application shall be subject to the appended claims.

Claims (10)

  1. 一种考核视频的生成方法,其特征在于,所述方法包括:A method for generating assessment videos, characterized in that the method includes:
    响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集;In response to the video recording instruction, start to acquire the display interface image of the ultrasonic display terminal, and at the same time turn on the image acquisition device to acquire the image of the operating method of the ultrasonic probe;
    根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;Generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of the manipulation technique;
    当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,生成超声扫查技能对应的考核视频文件。When the video recording ends, the first temporary file and the second temporary file are merged to generate an assessment video file corresponding to the ultrasound scanning skills.
  2. 根据权利要求1所述的方法,其特征在于,所述响应于视频录制指令,开始获取超声显示终端的显示界面图像,包括:The method according to claim 1, wherein, in response to a video recording instruction, starting to acquire a display interface image of the ultrasound display terminal comprises:
    响应于视频录制指令,在所述超声显示终端的显示界面中新建窗口,且所述窗口对应的显示界面中除超声图像区域之外的其他区域均被遮挡;In response to the video recording instruction, a new window is created in the display interface of the ultrasound display terminal, and all areas of the display interface corresponding to the window except the ultrasound image area are blocked;
    获取所述窗口对应的显示界面图像。Obtain the display interface image corresponding to the window.
  3. 根据权利要求1所述的方法,其特征在于,所述根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件,包括:The method according to claim 1, wherein the generating a first temporary file according to the acquired display interface image sequence, and generating a second temporary file according to the acquired operation technique image sequence, comprises:
    以预设帧率获取所述显示界面图像,并按照时间顺序依次写入第一临时文件;Acquire the display interface images at a preset frame rate, and write them into the first temporary file in chronological order;
    以相同的预设帧率采集所述操作手法图像,并按照时间顺序依次写入第二临时文件;Collecting the operation technique images at the same preset frame rate, and sequentially writing them into the second temporary file in chronological order;
    其中,所述第一临时文件的帧数与所述第二临时文件的帧数相同。Wherein, the number of frames of the first temporary file is the same as the number of frames of the second temporary file.
  4. 根据权利要求1所述的方法,其特征在于,所述将所述第一临时文件与所述第二临时文件合并,生成所述超声扫查技能对应的考核视频文件,包括:The method according to claim 1, wherein the combining the first temporary file with the second temporary file to generate an assessment video file corresponding to the ultrasonic scanning skill comprises:
    将第二临时文件追加至第一临时文件的末尾位置,生成所述超声扫查技能对应的考核视频文件。The second temporary file is appended to the end position of the first temporary file to generate an assessment video file corresponding to the ultrasound scanning skill.
  5. 根据权利要求1至4任一项所述的方法,其特征在于,所述考核视频文件的数量为多个;所述方法还包括:The method according to any one of claims 1 to 4, wherein the number of the assessment video files is multiple; the method further comprises:
    响应于至少一个所述考核视频文件的选择指令,将所述选择指令对应的考核视频文件确定为待上传的考核视频文件;In response to the selection instruction of at least one of the evaluation video files, determining the evaluation video file corresponding to the selection instruction as the evaluation video file to be uploaded;
    响应于上传指令,将所述待上传的考核视频文件上传至云端服务器;所述云端服务器存储有对已上传的考核视频文件进行评价所产生的评价数据。In response to the upload instruction, upload the evaluation video file to be uploaded to a cloud server; the cloud server stores evaluation data generated by evaluating the uploaded evaluation video file.
  6. 根据权利要求5所述的方法,其特征在于,在所述响应于视频录制指令之前,所述方法还包括:The method according to claim 5, characterized in that, before the responding to the video recording instruction, the method further comprises:
    响应于登录指令,登录至所述超声显示终端;所述登录指令包括被考核医师的用户标识,所述用户标识用于指示所述云端服务器与所述超声显示终端建立网络连接。In response to a login instruction, log in to the ultrasound display terminal; the login instruction includes a user identification of the examined physician, and the user identification is used to instruct the cloud server to establish a network connection with the ultrasound display terminal.
  7. 根据权利要求5所述的方法,其特征在于,所述当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,包括:The method according to claim 5, wherein the merging the first temporary file with the second temporary file when the video recording ends comprises:
    当视频录制的时长达到预设时长时,结束视频录制,将所述第一临时文件与所述第二临时文件合并;或When the duration of the video recording reaches the preset duration, the video recording is ended, and the first temporary file and the second temporary file are merged; or
    响应于视频停止录制指令,结束视频录制,将所述第一临时文件与所述第二临时文件合并。In response to the video stop recording instruction, the video recording is ended, and the first temporary file and the second temporary file are merged.
  8. 一种考核视频的生成装置,其特征在于,所述装置包括:A device for generating assessment videos, characterized in that the device comprises:
    图像获取模块,用于响应于视频录制指令,开始获取超声显示终端的显示界面图像,并同时开启图像采集设备对超声探头的操作手法进行图像采集;The image acquisition module is used to start acquiring the display interface image of the ultrasonic display terminal in response to the video recording instruction, and at the same time turn on the image acquisition device to perform image acquisition on the operating method of the ultrasonic probe;
    临时文件生成模块,用于根据获取的显示界面图像序列生成第一临时文件,根据采集的操作手法图像序列生成第二临时文件;The temporary file generating module is configured to generate a first temporary file according to the acquired image sequence of the display interface, and generate a second temporary file according to the acquired image sequence of manipulation techniques;
    视频文件生成模块,用于当视频录制结束时,将所述第一临时文件与所述第二临时文件合并,生成所述超声扫查技能对应的考核视频文件。The video file generating module is configured to merge the first temporary file with the second temporary file when the video recording ends to generate an assessment video file corresponding to the ultrasound scanning skill.
  9. 一种计算机设备,包括存储器和处理器,所述存储器存储有计算机程序,其特征在于,所述处理器执行所述计算机程序时实现权利要求1至7中任一项所述的方法的步骤。A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method according to any one of claims 1 to 7 when the computer program is executed by the processor.
  10. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1至7中任一项所述的方法的步骤。A computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the method according to any one of claims 1 to 7 when the computer program is executed by a processor.
PCT/CN2020/132975 2020-06-15 2020-11-30 Assessment video generation method and apparatus, and computer device and storage medium WO2021253730A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010541882.8A CN113810758A (en) 2020-06-15 2020-06-15 Assessment video generation method and device, computer equipment and storage medium
CN202010541882.8 2020-06-15

Publications (1)

Publication Number Publication Date
WO2021253730A1 true WO2021253730A1 (en) 2021-12-23

Family

ID=78892426

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/132975 WO2021253730A1 (en) 2020-06-15 2020-11-30 Assessment video generation method and apparatus, and computer device and storage medium

Country Status (2)

Country Link
CN (1) CN113810758A (en)
WO (1) WO2021253730A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104219454A (en) * 2014-09-30 2014-12-17 联想(北京)有限公司 Method and device for acquiring images
US20150035959A1 (en) * 2013-03-15 2015-02-05 eagleyemed, Inc. Multi-site data sharing platform
WO2017015902A1 (en) * 2015-07-29 2017-02-02 深圳迈瑞生物医疗电子股份有限公司 Ultrasonic imaging system and method
CN106851162A (en) * 2017-02-17 2017-06-13 成都依能科技股份有限公司 video recording method and device
CN109348155A (en) * 2018-11-08 2019-02-15 北京微播视界科技有限公司 Video recording method, device, computer equipment and storage medium
WO2019047080A1 (en) * 2017-09-06 2019-03-14 深圳迈瑞生物医疗电子股份有限公司 Ultrasonic diagnostic apparatus and method for acquiring remote auxiliary data using ultrasonic diagnostic apparatus
CN109872807A (en) * 2019-02-15 2019-06-11 深圳华声医疗技术股份有限公司 The ultrasonic long-range method, apparatus of the consultation of doctors in real time, equipment and readable storage medium storing program for executing

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110536088A (en) * 2019-09-24 2019-12-03 深圳华声医疗技术股份有限公司 Ultrasonic image-forming system device, ultrasonic imaging method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150035959A1 (en) * 2013-03-15 2015-02-05 eagleyemed, Inc. Multi-site data sharing platform
CN104219454A (en) * 2014-09-30 2014-12-17 联想(北京)有限公司 Method and device for acquiring images
WO2017015902A1 (en) * 2015-07-29 2017-02-02 深圳迈瑞生物医疗电子股份有限公司 Ultrasonic imaging system and method
CN106851162A (en) * 2017-02-17 2017-06-13 成都依能科技股份有限公司 video recording method and device
WO2019047080A1 (en) * 2017-09-06 2019-03-14 深圳迈瑞生物医疗电子股份有限公司 Ultrasonic diagnostic apparatus and method for acquiring remote auxiliary data using ultrasonic diagnostic apparatus
CN109348155A (en) * 2018-11-08 2019-02-15 北京微播视界科技有限公司 Video recording method, device, computer equipment and storage medium
CN109872807A (en) * 2019-02-15 2019-06-11 深圳华声医疗技术股份有限公司 The ultrasonic long-range method, apparatus of the consultation of doctors in real time, equipment and readable storage medium storing program for executing

Also Published As

Publication number Publication date
CN113810758A (en) 2021-12-17

Similar Documents

Publication Publication Date Title
US20110245632A1 (en) Medical Diagnosis Using Biometric Sensor Protocols Based on Medical Examination Attributes and Monitored Data
US20220142609A1 (en) Apparatus and method for fetal intelligent navigation echocardiography
US10282517B2 (en) Apparatus, method, and non-transitory computer-readable medium for supporting viewing examination images
JP6638729B2 (en) Console and dynamic imaging diagnostic system
JP2021516090A (en) Methods and equipment for annotating ultrasonography
US9411932B2 (en) Image management apparatus
US20150002538A1 (en) Ultrasound image display method and apparatus
US20200234444A1 (en) Systems and methods for the analysis of skin conditions
CN102265308A (en) System for monitoring medical abnormalities and method of operation thereof
JP2018518226A (en) System and method for motion compensation in medical procedures
US9881125B2 (en) Ultrasound measurement of biometrics of fetus
KR102207255B1 (en) Method and system for sharing information
CA3110581C (en) System and method for evaluating the performance of a user in capturing an image of an anatomical region
JP2001198123A (en) Method and device for data management
KR101518804B1 (en) Method and apparatus for managing medical data
CN110246135A (en) Monitor Follicles method, apparatus, system and storage medium
US20210065882A1 (en) Method and system for prompting data donation for artificial intelligence tool development
Deng et al. Assessment of atrial septal defect using 2D or real-time 3D transesophageal echocardiography and outcomes following transcatheter closure
WO2021253730A1 (en) Assessment video generation method and apparatus, and computer device and storage medium
CN112741620A (en) Cervical spondylosis evaluation device based on limb movement
US20220148172A1 (en) System and method for detecting medical conditions
CN108845565B (en) Vehicle diagnosis method and vehicle diagnosis instrument
CN114694442B (en) Ultrasonic training method and device based on virtual reality, storage medium and ultrasonic equipment
KR102388735B1 (en) Method of detecting cheating for exams in meatverse environment based on image data processing
US20230181163A1 (en) System and Method for Automatic Association and Display of Video Loop Subject Matter for Enhanced Identification

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20941092

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20941092

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 20941092

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATE 26.06.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20941092

Country of ref document: EP

Kind code of ref document: A1