CN112434652A - Intelligent visual operation record editing method and system - Google Patents

Intelligent visual operation record editing method and system Download PDF

Info

Publication number
CN112434652A
CN112434652A CN202011430050.5A CN202011430050A CN112434652A CN 112434652 A CN112434652 A CN 112434652A CN 202011430050 A CN202011430050 A CN 202011430050A CN 112434652 A CN112434652 A CN 112434652A
Authority
CN
China
Prior art keywords
image
module
editing
record
image segments
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011430050.5A
Other languages
Chinese (zh)
Inventor
刘晓晟
易晓
袁志军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huaping Xiangsheng Shanghai Medical Technology Co ltd
Original Assignee
Huaping Xiangsheng Shanghai Medical Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huaping Xiangsheng Shanghai Medical Technology Co ltd filed Critical Huaping Xiangsheng Shanghai Medical Technology Co ltd
Priority to CN202011430050.5A priority Critical patent/CN112434652A/en
Publication of CN112434652A publication Critical patent/CN112434652A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/49Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/60ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses an intelligent visual operation record editing method and system, which comprises the steps of obtaining a video image of the whole course of an operation; dividing the video image into a plurality of image segments of key operation steps according to a preset time node; judging whether the key operation steps corresponding to the image segments are complete or not; if not, further adjusting the image segment; if yes, intelligently editing the image segments to generate finished image products, and adding labels to the finished image products respectively; by adopting the intelligent visual operation record editing method and system, the timeliness and uniqueness of the record can be realized by photographing or recording in the operation, and the occurrence of a large number of copying phenomena in the current operation record is avoided; the doctor-patient communication effect and efficiency are improved, the understanding of the patient to the operation process and the confidence of the patient to the operation scheme are increased, and the occurrence of medical disputes is reduced; the hospital can build an operation quality management platform, and has perfect data to evaluate the operation level and ability of the doctor.

Description

Intelligent visual operation record editing method and system
Technical Field
The invention relates to the field of medical treatment, in particular to an intelligent visual operation record editing method and system.
Background
Currently, medical records are explicitly defined in medical records management regulations (2013), basic specifications of electronic medical records (2010, 24) in medical institutions, which refer to the sum of characters, symbols, diagrams, images, slices and other data formed by medical staff during medical activities, and need to be recorded in a standardized way and properly stored. With the overall promotion of medical informatization, reports such as clinical pathology diagnosis, imaging examination, endoscopy treatment, interventional examination treatment and the like already adopt an image-text report form, and play a positive role in the continuous improvement of the clinical diagnosis and treatment behavior specification and quality. Surgical documentation is an objective description of the surgical procedure, and photographic or video material critical to the procedure has been used for academic exchange, but has not been used to assist in documenting the procedure. In the era of high informatization of hospitals and intellectualization of operating rooms, live-action photos and operation key video clips which are key steps in operation are used for assisting in recording the operation process, so that the content of operation record information is increased substantially, and the operation record quality is improved comprehensively. The image-text operation record is a novel medical document which records the operation process by using pictures, videos and text descriptions, so that the operation record can reflect the operation situation more objectively and in detail. The image-text operation record has abundant operation information capacity, can ensure that the operation information is digitalized and smoothly accessed into a Hospital Information System (HIS), and is more visual and comprehensive compared with the traditional operation record, thereby having more objectivity, authenticity and legal efficacy.
Aiming at the problems in the prior art, the method and the system for editing the intelligent visual operation record have important significance.
Disclosure of Invention
In order to solve the problems, the invention provides an intelligent visual operation record editing method and system.
In order to achieve the above object, the method for editing an intelligent visual operation record of the present invention comprises the following steps: acquiring a video image of the whole operation process; dividing the video image into a plurality of image segments of key operation steps according to a preset time node; judging whether the key operation steps corresponding to the image segments are complete or not; if not, further adjusting the image segment; if yes, intelligently editing the image segments to generate finished image products, and adding labels to the finished image products respectively;
further, in the step: acquiring video images of the whole operation process, wherein the video images are specifically endoscope images, operation field images, monitor instrument images and any instrument images related to the operation in the whole operation process;
further, judging whether the key operation steps corresponding to the image segments are complete specifically, performing intelligent recognition on the voice in the operation, and judging whether the key operation steps corresponding to the image segments are complete by utilizing a keyword screening technology;
further, judging whether the key operation steps corresponding to the image segments are complete or not, and judging whether the key operation steps corresponding to the image segments are complete or not by utilizing manual review check;
further, further adjusting the image segment specifically includes further cropping or completing the image segment;
further, if yes, intelligently editing the image segment to generate an image finished product, and after adding a label to the image finished product, respectively, the method further includes: and adding the image finished product into an electronic medical record online editing system.
The invention also provides an intelligent visual operation record editing system, which comprises a camera module, a preset time node module, a control module, a judgment module and an image editing module; the camera module is used for acquiring a video image of the whole operation process; the preset time node module is used for storing preset time nodes; the judging module is used for judging whether the key operation steps corresponding to the image segments are complete or not; the image editing module is used for intelligently editing the image segments to generate finished image products and adding labels to the finished image products respectively; the control module is used for dividing the video image into image segments of a plurality of key operation steps according to the preset time node and further adjusting the image segments according to the judgment result of the judgment module;
the system further comprises a voice recognition module, wherein the voice recognition module is connected with the judgment module and is specifically used for intelligently recognizing voice and content in the operation; the judging module is specifically used for judging whether the key operation steps corresponding to the image segments are complete or not by utilizing a keyword screening technology;
further, the image editing module is specifically configured to perform format conversion, slow down, speed up, compression, and cropping operations on the image segment.
The intelligent visual operation record editing method and the system adopt the intelligent video image surgical operation record and editing method, and have the following advantages: (1) the timeliness and uniqueness of the record are realized by photographing or recording in the operation, the phenomenon of mass duplication in the current operation record is avoided, and the quality of the operation record is improved. (2) Ensures that the follow-up visit and consultation doctors have visual and clear understanding and cognition on the whole operation process and arrange proper follow-up examination and treatment. (3) The effect and the efficiency of doctor-patient communication are improved, the understanding of patients and family members to the operation process and the confidence of the operation scheme are increased, and the occurrence of medical disputes is reduced. (4) Increase the importance of low-grade medical doctors and medical students on operation study and understanding and increase medical records as teaching resources. (5) Each operation record can become a competitive teaching material for surgical medical education; by making each surgery a competitive product, the progress of surgery precision is promoted. (6) The hospital can build an operation quality management platform and has perfect data evaluation operation level and capability.
Drawings
FIG. 1 is a schematic flow chart of a method for editing an intelligent visual surgical record according to the present invention;
fig. 2 is a schematic structural diagram of an intelligent visualized operation record editing system according to the present invention.
Detailed Description
The structure, operation, and the like of the present invention will be further described with reference to the accompanying drawings.
As shown in fig. 1, fig. 1 is a schematic flow chart of an intelligent visual operation record editing method according to the present invention, and the method includes the following steps:
s1, acquiring a video image of the whole operation process; in the preferred embodiment of the present invention, the video images are specifically endoscope images, operation field images, monitor images and any instrument images related to the operation during the whole operation; all material sources are received, selected, relayed, sent and recorded by a central control system of a digital operating room; in a preferred embodiment of the present invention, the arbitrary surgical-related instrument image may be a microscope, DSA, ultrasound, robot, navigator, or the like image;
s2, dividing the video image into a plurality of image segments of key operation steps according to a preset time node; in a preferred embodiment of the present invention, the key operation steps respectively include incision selection, pathology before operation, key operation steps during operation, gross resection specimen, and the like, and different preset time nodes are respectively stored according to real-time medical data of a patient and habits and experiences of a doctor; the time node can be specifically a time node required by academia;
s3, judging whether the key operation steps corresponding to the image segments are complete; if not, further adjusting the image segment; in a preferred embodiment of the present invention, specifically, the voice in the operation is intelligently recognized, and a keyword screening technology is used to determine whether the key operation steps corresponding to the image segment are complete; in another preferred embodiment of the present invention, it is specifically determined and determined whether the key surgical step corresponding to the image segment is complete by using a manual review check. Further adjusting the image segment, specifically, further cropping or completing the image segment;
s4, intelligently editing the image segments to generate finished image products, and adding labels to the finished image products respectively; in a preferred embodiment of the present invention, the intelligent editing specifically includes performing format conversion, slow down, speed up, compression, and clipping operations on the image segment; the label can be intelligently preset or added by a doctor in the later period;
and S5, adding the finished image product into an electronic medical record online editing system. In a preferred embodiment of the present invention, the electronic medical record online editing system specifically includes a central control system of each digital operating room, and the system further includes a central server, where the central server includes an account number and authority management module, a remote device management module, a video resource management module, an electronic medical record online editing module, and a data interface docking module; the account and authority management module is used for calling data in the hospital account management system to acquire hospital organization data and account authority information of hospital user personnel and performing login and authorization management; the remote equipment management module is used for remotely monitoring and controlling each remote equipment including a digital operating room central control system; the video resource management module is used for performing storage management, search management and editing management on the operation image audio information of each digital operating room; the electronic medical record online editing module is used for providing an operation report or an electronic medical record template, allowing a user to insert, store, call, cut, edit and combine image audio information in the template, blending the image audio information into an electronic medical record or an operation record report, and generating an operation electronic medical record database; the data interface docking module is used for completing data calling and updating in docking with each information system of the hospital and performing data docking with each remote device.
As shown in fig. 2, fig. 2 is a schematic structural diagram of an intelligent visualized surgical record editing system according to the present invention; the intelligent visual operation record editing system comprises a camera module, a preset time node module, a control module, a judgment module, an image editing module and a voice recognition module;
the camera module is electrically connected with the control module and is used for acquiring a video image of the whole operation process; the preset time node module is electrically connected with the control module and is used for storing preset time nodes; the judging module is electrically connected with the control module and is used for judging whether the key operation steps corresponding to the image segments are complete or not; the image editing module is electrically connected with the control module and is used for intelligently editing the image sections to generate finished image products and adding labels to the finished image products respectively; in a preferred embodiment of the present invention, the image editing module is specifically configured to perform format conversion, slow down, speed up, compression, and cropping operations on the image segment.
The control module is used for dividing the video image into image segments of a plurality of key operation steps according to the preset time node and further adjusting the image segments according to the judgment result of the judgment module; the voice recognition module is electrically connected with the judgment module and is specifically used for intelligently recognizing the voice in the operation; the judging module is specifically used for judging whether the key operation steps corresponding to the image segments are complete or not by utilizing a keyword screening technology.
In the first embodiment of the invention, the intelligent visual operation record editing system comprises a camera module, a preset time node module, a control module, a judgment module, an image editing module and a voice recognition module;
the camera module is electrically connected with the control module and is used for acquiring a video image of the whole operation process; the preset time node module is electrically connected with the control module and is used for storing preset time nodes and time nodes required by academia; the judging module is electrically connected with the control module and is used for judging whether the key operation steps corresponding to the image segments are complete or not; the image editing module is electrically connected with the control module and is used for intelligently editing the image sections to generate finished image products and adding labels to the finished image products respectively; the image editing module is specifically used for performing format conversion, slowing down, accelerating, compressing and clipping operations on the image segment.
The control module is used for dividing the video image into a plurality of key operation steps according to the preset time node and the academic required time node: the image segment of the nine steps of 'starting operation, cutting skin, preparing channel, implanting endoscope, pathological condition, excision process, repair process, pathological condition after operation and ending operation' and the image segment is further adjusted according to the judgment result of the judgment module; the voice recognition module is electrically connected with the judgment module and is specifically used for intelligently recognizing the voice in the operation; the judging module is specifically used for judging whether the key operation steps corresponding to the image segments are complete or not by utilizing a keyword screening technology.
The intelligent visual operation record editing method comprises the following steps:
s1, acquiring endoscope images, operation field images, monitoring instrument images and any instrument images related to the operation in the whole operation process, including images of a microscope, a DSA, ultrasound, a robot, a navigator and the like;
s2, dividing the video image into image segments of nine key operation steps according to a preset time node; the specific time nodes are in the following table:
Figure BDA0002820310100000081
s3, judging whether the key operation steps corresponding to the image segments are complete; if not, further adjusting the image segment; the judging method specifically comprises the steps of carrying out intelligent recognition on voice in an operation, judging whether a key operation step corresponding to the image segment is complete by utilizing a keyword screening technology and judging whether the key operation step corresponding to the image segment is complete by utilizing manual review inspection;
s4, intelligently editing the image segments to generate finished image products, and adding labels to the finished image products respectively; the intelligent editing specifically comprises the steps of performing format conversion, slowing down, accelerating, compressing and cutting operations on the image segment; the label can be intelligently preset or added by a doctor in the later period;
and S5, adding the finished image product into an electronic medical record online editing system.
The foregoing is merely illustrative of the present invention, and it will be appreciated by those skilled in the art that various modifications may be made without departing from the principles of the invention, and the scope of the invention is to be determined accordingly.

Claims (9)

1. An intelligent visual operation record editing method is characterized by comprising the following steps:
acquiring a video image of the whole operation process;
dividing the video image into a plurality of image segments of key operation steps according to a preset time node;
judging whether the key operation steps corresponding to the image segments are complete or not; if not, further adjusting the image segment;
and if so, intelligently editing the image segments to generate finished image products, and adding labels to the finished image products respectively.
2. The intelligent visual surgical record editing method of claim 1, wherein in the step: the method comprises the steps of obtaining video images of the whole operation process, wherein the video images specifically comprise endoscope images, operation field images, monitor instrument images and any instrument images related to the operation in the whole operation process.
3. The method for editing surgical record according to claim 1, wherein the step of judging whether the key surgical steps corresponding to the image segments are complete is to intelligently recognize the voice and content during surgery and judge whether the key surgical steps corresponding to the image segments are complete by using a keyword screening technique.
4. The method for editing an intelligent visual surgical record according to claim 1, wherein the step of judging whether the key surgical steps corresponding to the image segments are complete is specifically performed, and the step of judging whether the key surgical steps corresponding to the image segments are complete is performed by manual review.
5. The method for editing an intelligent visual surgical record as claimed in claim 1, wherein the further adjustment of the image section is further cropping or completing the image section.
6. The method for editing an intelligent visualized surgical record according to claim 1, wherein if yes, the method for intelligently editing the image segments to generate a finished image, and after adding labels to the finished image, respectively further comprises: and adding the image finished product into an electronic medical record online editing system.
7. An intelligent visual operation record editing system is characterized by comprising a camera module, a preset time node module, a control module, a judgment module and an image editing module;
the camera module is used for acquiring a video image of the whole operation process;
the preset time node module is used for storing preset time nodes;
the judging module is used for judging whether the key operation steps corresponding to the image segments are complete or not;
the image editing module is used for intelligently editing the image segments to generate finished image products and adding labels to the finished image products respectively;
the control module is used for dividing the video image into image segments of a plurality of key operation steps according to the preset time node and further adjusting the image segments according to the judgment result of the judgment module.
8. The intelligent visual surgical record editing system according to claim 7, further comprising a voice recognition module, wherein the voice recognition module is connected to the judgment module, and the voice recognition module is specifically configured to perform intelligent recognition on intraoperative voice; the judging module is specifically used for judging whether the key operation steps corresponding to the image segments are complete or not by utilizing a keyword screening technology.
9. The intelligent visual surgical record editing system of claim 8, wherein the image editing module is specifically configured to perform format conversion, slow down, speed up, compression and cropping operations on the image segment.
CN202011430050.5A 2020-12-07 2020-12-07 Intelligent visual operation record editing method and system Pending CN112434652A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011430050.5A CN112434652A (en) 2020-12-07 2020-12-07 Intelligent visual operation record editing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011430050.5A CN112434652A (en) 2020-12-07 2020-12-07 Intelligent visual operation record editing method and system

Publications (1)

Publication Number Publication Date
CN112434652A true CN112434652A (en) 2021-03-02

Family

ID=74691666

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011430050.5A Pending CN112434652A (en) 2020-12-07 2020-12-07 Intelligent visual operation record editing method and system

Country Status (1)

Country Link
CN (1) CN112434652A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114171145A (en) * 2021-11-22 2022-03-11 华平祥晟(上海)医疗科技有限公司 Rich media operation record list generation system and method
CN114496174A (en) * 2021-12-31 2022-05-13 北京航天长峰股份有限公司 Electronic report generation method, device, equipment and medium based on operation video
CN114512210A (en) * 2021-12-31 2022-05-17 北京航天长峰股份有限公司 Method for generating and editing digital operation report, computer device and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102867527A (en) * 2012-05-07 2013-01-09 苏州麦迪斯顿医疗科技有限公司 Application of multi-picture hypermedia document with same time axis
CN103325400A (en) * 2013-05-17 2013-09-25 北京中科大洋信息技术有限公司 Teaching system and method for recording and broadcasting operation video
CN106855919A (en) * 2016-12-22 2017-06-16 广东清立方科技有限公司 A kind of surgical operation images acquisition management method and a kind of surgical operation images harvester
CN109166606A (en) * 2018-08-31 2019-01-08 上海轩昂医疗科技有限公司 A kind of electronic health record online editing platform and its implementation
CN109949880A (en) * 2019-01-31 2019-06-28 北京汉博信息技术有限公司 A kind of surgical data processing method
CN110931094A (en) * 2018-09-19 2020-03-27 北京航天长峰股份有限公司 Method for generating operation record and assisting management application in operating room through voice recognition

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102867527A (en) * 2012-05-07 2013-01-09 苏州麦迪斯顿医疗科技有限公司 Application of multi-picture hypermedia document with same time axis
CN103325400A (en) * 2013-05-17 2013-09-25 北京中科大洋信息技术有限公司 Teaching system and method for recording and broadcasting operation video
CN106855919A (en) * 2016-12-22 2017-06-16 广东清立方科技有限公司 A kind of surgical operation images acquisition management method and a kind of surgical operation images harvester
CN109166606A (en) * 2018-08-31 2019-01-08 上海轩昂医疗科技有限公司 A kind of electronic health record online editing platform and its implementation
CN110931094A (en) * 2018-09-19 2020-03-27 北京航天长峰股份有限公司 Method for generating operation record and assisting management application in operating room through voice recognition
CN109949880A (en) * 2019-01-31 2019-06-28 北京汉博信息技术有限公司 A kind of surgical data processing method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
薛召等: "胆道镜图文手术记录系统的研制及临床试用", 《中国医疗器械杂志》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114171145A (en) * 2021-11-22 2022-03-11 华平祥晟(上海)医疗科技有限公司 Rich media operation record list generation system and method
CN114496174A (en) * 2021-12-31 2022-05-13 北京航天长峰股份有限公司 Electronic report generation method, device, equipment and medium based on operation video
CN114512210A (en) * 2021-12-31 2022-05-17 北京航天长峰股份有限公司 Method for generating and editing digital operation report, computer device and storage medium

Similar Documents

Publication Publication Date Title
CN112434652A (en) Intelligent visual operation record editing method and system
US20240065768A1 (en) Surgical system with ar/vr training simulator and intra-operative physician image-guided assistance
CN103325400B (en) A kind of surgical operation images recorded broadcast teaching system and method
WO2018163600A1 (en) Medical information management device, medical information management method, and medical information management system
US20160295086A1 (en) System for enabling remote annotation of media data captured using endoscopic instruments and the creation of targeted digital advertising in a documentation environment using diagnosis and procedure code entries
US20230134195A1 (en) Systems and methods for video and audio analysis
US20230363851A1 (en) Methods and systems for video collaboration
CN111667902A (en) Clinical operation management system
CN107657990A (en) A kind of auxiliary of operation record typing supports system and method
Eryigit et al. Association of video completed by audio in laparoscopic cholecystectomy with improvements in operative reporting
CN110931094A (en) Method for generating operation record and assisting management application in operating room through voice recognition
US20190362859A1 (en) System for enabling remote annotation of media data captured using endoscopic instruments and the creation of targeted digital advertising in a documentation environment using diagnosis and procedure code entries
KR101115020B1 (en) A method and system for recording, saving and providing surgery video in real time
CN116910105A (en) Medical information query system and method based on pre-training large model
JP6359264B2 (en) Surgery information management device
CN114093451A (en) Method and system for managing user data by PACS (Picture archiving and communication System)
CN114040138A (en) Visual operation process recording method and recording system
US20230317278A1 (en) System for Aggregating, Analyzing, and Reporting Medical Information
CN114121208A (en) Operation record quality control method based on visual data
Leibetseder et al. Endometriosis annotation in endoscopic videos
WO2006131277A1 (en) System for diagnosing, commenting, and/or documenting moving images in the medical field
CN114300103A (en) Digital operating room information management method and system
JP7164877B2 (en) Information sharing system
JP2005124824A (en) Operation supporting system
WO2002067170A1 (en) Information system for hospital

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210302

RJ01 Rejection of invention patent application after publication