CN109102874A - Medical treatment method, apparatus, equipment and storage medium based on AR technology - Google Patents
Medical treatment method, apparatus, equipment and storage medium based on AR technology Download PDFInfo
- Publication number
- CN109102874A CN109102874A CN201810886304.0A CN201810886304A CN109102874A CN 109102874 A CN109102874 A CN 109102874A CN 201810886304 A CN201810886304 A CN 201810886304A CN 109102874 A CN109102874 A CN 109102874A
- Authority
- CN
- China
- Prior art keywords
- patient
- treatment information
- feature data
- facial feature
- treatment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000005516 engineering process Methods 0.000 title claims abstract description 58
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000001815 facial effect Effects 0.000 claims abstract description 108
- 238000012545 processing Methods 0.000 claims description 30
- 238000004590 computer program Methods 0.000 claims description 26
- 230000000474 nursing effect Effects 0.000 claims description 21
- 230000003190 augmentative effect Effects 0.000 claims description 16
- 238000007689 inspection Methods 0.000 claims description 13
- 206010013700 Drug hypersensitivity Diseases 0.000 claims description 12
- 229940079593 drug Drugs 0.000 claims description 12
- 239000003814 drug Substances 0.000 claims description 12
- 201000005311 drug allergy Diseases 0.000 claims description 12
- 230000005540 biological transmission Effects 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 10
- 238000009434 installation Methods 0.000 description 8
- 239000011521 glass Substances 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 235000006694 eating habits Nutrition 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
- G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Biomedical Technology (AREA)
- Public Health (AREA)
- Epidemiology (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- General Business, Economics & Management (AREA)
- Business, Economics & Management (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Medical Treatment And Welfare Office Work (AREA)
Abstract
The application provides a kind of medical treatment method, apparatus, equipment and storage medium based on AR technology, this method comprises: the facial feature data for obtaining patient obtains the treatment information of the patient according to the facial feature data；The treatment information is used to refer to the physical condition and treatment condition of the patient before this, and treatment information is overlapped display in AR scene.By combining recognition of face and AR technology, in the form of AR equipment, show that the associated treatment information of corresponding patient, assist personnel provide more rapidly convenient good medical services for patient with AR to medical staff.
Description
Technical field
The invention relates to field of artificial intelligence, more particularly to one kind to be based on augmented reality (Augmented
Reality, AR) technology medical treatment method, apparatus, equipment and storage medium.
Background technique
It goes to a doctor as more and more patients pour in hospital, the operating pressure of medical staff is very big, medical staff
During facial diagnosis patient, need to understand the inspection situation of patient, physical condition was done assorted by constantly inquiring patient
The solution preocess for the treatment of etc., patient information needs to waste a large amount of time.The workload of medical staff is bigger, and very much
Patient not quite understands the treatment condition of the state of an illness and history, causes certain communication inaccuracy, leads to whole medical treatment
Nursing process efficiency is lower.Therefore, it is badly in need of a kind of solution that can effectively improve medical treatment and nursing efficiency at present.
Summary of the invention
The embodiment of the present application provides a kind of medical treatment method, apparatus, equipment and storage medium based on AR technology, can have
Effect improves the efficiency of medical care path.
The application first aspect provides a kind of medical treatment method based on AR technology, comprising:
Obtain the facial feature data of patient；
According to the facial feature data, the treatment information of the patient is obtained；The treatment information is used to refer to described
The physical condition and treatment condition of patient before this；
The treatment information is overlapped display in AR scene.
Optionally, described according to the facial feature data, obtain the treatment information of the patient, comprising:
Treatment information acquisition request is sent to server, the treatment information acquisition request includes that the face of the patient is special
Levy data；
Receive the treatment information for the patient that the server returns.
Optionally, described according to the facial feature data, obtain the treatment information of the patient, comprising:
According to the patient identity mark and corresponding facial feature data in database, to the facial characteristics number of the patient
According to being analyzed and processed, the identity of the patient is determined；
Treatment information acquisition request is sent to server, includes the identity of the patient in the treatment information acquisition request
Mark；
Receive the treatment information for the patient that the server returns.
Optionally, described according to the facial feature data, obtain the treatment information of the patient, comprising:
According to the patient identity mark and corresponding facial feature data in database, to the facial characteristics number of the patient
According to being analyzed and processed, the identity of the patient is determined；
The trouble is obtained from the patient being locally stored with corresponding treatment information according to the identity of the patient
The treatment information of person.
Optionally, the facial feature data for obtaining patient, comprising:
The face-image of the patient is obtained by camera shooting；
Identifying processing is carried out using face recognition technology to the face-image, obtains the facial characteristics number of the patient
According to.
Optionally, the treatment information of the patient comprises at least one of the following:
The inspection result of the patient, related case history, medication record and drug allergy history.
Optionally, the method also includes:
According to the treatment information of the patient, the nursing information to the patient is obtained；
The nursing information is pushed to the custodial care facility of the patient.
The application second aspect provides a kind of medical treatment method based on AR technology, comprising:
The treatment information acquisition request that augmented reality AR equipment is sent is received, the treatment information acquisition request includes described
The identity of the facial feature data of patient or the patient；
According to the treatment information acquisition request, the treatment information of the patient stored in database is inquired；
The treatment information is returned into the AR equipment.
Optionally, described according to institute if the treatment information acquisition request includes the facial feature data of the patient
Treatment information acquisition request is stated, the treatment information of the patient stored in database is inquired, comprising:
According to the patient identity mark and corresponding facial feature data in database, to the facial characteristics number of the patient
According to being analyzed and processed, the identity of the patient is determined；
According to the identity of the patient, the treatment information of the patient stored in database is inquired.
Optionally, the treatment information of the patient comprises at least one of the following:
The inspection result of the patient, related case history, medication record and drug allergy history.
The application third aspect provides a kind of medical treatment device based on AR technology, comprising:
Module is obtained, for obtaining the facial feature data of patient；
Processing module, for obtaining the treatment information of the patient according to the facial feature data；The treatment information
It is used to refer to the physical condition and treatment condition of the patient before this；
Display module, for the treatment information to be overlapped display in augmented reality AR scene.
Optionally, described device further include:
Sending module, for sending treatment information acquisition request to server, the treatment information acquisition request includes institute
State the facial feature data of patient；
Receiving module, for receiving the treatment information for the patient that the server returns.
Optionally, the processing module is specifically used for being identified and corresponding facial characteristics according to the patient identity in database
Data are analyzed and processed the facial feature data of the patient, determine the identity of the patient；
Described device further include:
Sending module treats information acquisition request for sending to server, includes in the treatment information acquisition request
The identity of the patient；
Receiving module, for receiving the treatment information for the patient that the server returns.
Optionally, the processing module is specifically used for:
According to the patient identity mark and corresponding facial feature data in database, to the facial characteristics number of the patient
According to being analyzed and processed, the identity of the patient is determined；
The trouble is obtained from the patient being locally stored with corresponding treatment information according to the identity of the patient
The treatment information of person.
Optionally, the acquisition module is specifically used for:
The face-image of the patient is obtained by camera shooting；
Identifying processing is carried out using face recognition technology to the face-image, obtains the facial characteristics number of the patient
According to.
Optionally, the treatment information of the patient comprises at least one of the following:
The inspection result of the patient, related case history, medication record and drug allergy history.
Optionally, the processing module is also used to:
According to the treatment information of the patient, the nursing information to the patient is obtained；
The nursing information is pushed to the custodial care facility of the patient.
The application fourth aspect provides a kind of medical treatment device based on AR technology, comprising:
Receiving module, for receiving the treatment information acquisition request of augmented reality AR equipment transmission, the treatment information is obtained
Taking request includes the facial feature data of the patient or the identity of the patient；
Processing module, for inquiring controlling for the patient stored in database according to the treatment information acquisition request
Treat information；
Sending module, for the treatment information to be returned to the AR equipment.
Optionally, if the treatment information acquisition request includes the facial feature data of the patient, the processing mould
Block is specifically used for:
According to the patient identity mark and corresponding facial feature data in database, to the facial characteristics number of the patient
According to being analyzed and processed, the identity of the patient is determined；
According to the identity of the patient, the treatment information of the patient stored in database is inquired.
Optionally, the treatment information of the patient comprises at least one of the following:
The inspection result of the patient, related case history, medication record and drug allergy history.
The 5th aspect of the application provides a kind of AR equipment, comprising: display, transmitter, receiver, processor, memory
And computer program；In the memory, the processor executes the computer program for the computer program storage
Realize the medical treatment method based on AR technology that any embodiment of first aspect provides.
The 6th aspect of the application provides a kind of server, comprising: receiver, transmitter, processor, memory and calculating
Machine program；In the memory, the processor executes the computer program and realizes second for the computer program storage
The medical treatment method based on AR technology that any embodiment of aspect provides.
The 7th aspect of the application provides a kind of computer readable storage medium, and the computer-readable recording medium storage has
Computer program, the Division of Medical Care based on AR technology that the computer program provides for realizing first aspect any embodiment
Reason method.
The application eighth aspect provides a kind of computer readable storage medium, and the computer-readable recording medium storage has
Computer program, the medical treatment based on AR technology that the computer program provides for realizing any embodiment of second aspect
Processing method.
Medical treatment method, apparatus, equipment and storage medium provided by the embodiments of the present application based on AR technology, passes through knot
Recognition of face and AR technology are closed, the facial feature data of patient is obtained, according to the facial feature data, obtains the patient's
Information is treated, treatment information is overlapped display in AR scene, i.e., in the form of AR equipment, is shown to medical staff with AR
The associated treatment information of corresponding patient, assist personnel provide more rapidly convenient good medical services for patient.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this Shen
Some embodiments please for those of ordinary skill in the art without any creative labor, can be with
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is the flow chart of the medical treatment embodiment of the method one provided by the embodiments of the present application based on AR technology；
Fig. 2 is the flow chart of the medical treatment embodiment of the method two provided by the embodiments of the present application based on AR technology；
Fig. 3 is the structural schematic diagram of the medical treatment Installation practice one provided by the embodiments of the present application based on AR technology；
Fig. 4 is the structural schematic diagram of the medical treatment Installation practice two provided by the embodiments of the present application based on AR technology；
Fig. 5 is the structural schematic diagram of the medical treatment Installation practice three provided by the embodiments of the present application based on AR technology；
Fig. 6 is the structural schematic diagram of AR apparatus embodiments one provided by the embodiments of the present application；
Fig. 7 is the structural schematic diagram of server example one provided by the embodiments of the present application.
Specific embodiment
To keep the purposes, technical schemes and advantages of the embodiment of the present application clearer, below in conjunction with the embodiment of the present application
In attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is
Some embodiments of the present application, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art
All other embodiment obtained without creative efforts, shall fall in the protection scope of this application.
As everybody increasingly payes attention to the health of body, and due to environment, the influence of eating habit causes from children
To old age, need the people in hospital admission more and more, and medical resource is limited, then there is patient's the difficulty of getting medical service, medical cares
Personnel, which work extra shifts or extra hours, can not handle all patients, and the efficiency for resulting in present medical treatment and nursing on the whole lower is asked
Topic.
Based on the above issues, the application, which provides, a kind of exists augmented reality (Augmented Reality, AR) technical application
Scheme in medical care path effectively improves medical care efficiency.The executing subject that the program is related to is AR equipment, such as: AR
Mirror is equipped with AR glasses for medical staff, the treatment information of the patient is showed doctor by AR glasses by the identification to patient
Shield personnel.AR equipment can obtain the data of needs from cloud or server, it is therefore desirable to and cloud or server it
Between carry out data interaction, general common mode is to realize data interaction by wireless network.AR equipment can also pass through itself
The data that needs are obtained in the data of storage, with no restrictions to this this programme.
The program is specifically described below by several specific implementations.
Fig. 1 is the flow chart of the medical treatment embodiment of the method one provided by the embodiments of the present application based on AR technology, such as Fig. 1
Shown, the program is applied in AR equipment, should medical treatment method based on AR technology specifically includes the following steps:
S101: the facial feature data of patient is obtained.
In this step, AR equipment needs to obtain the facial feature data of patient, i.e., in application process, AR equipment first
The photo either video for needing to acquire the face of patient, obtains the face-image of patient, carries out at identification to the face of patient
Reason, obtains out facial feature data, which is primarily used to patient's progress identification, so as to subsequent
Relevant treatment information can be obtained according to the identity of the patient determined.
In the program in the specific implementation, obtaining the specific implementation of the facial feature data of patient including at least following
Two kinds:
The first implementation, the camera that AR equipment is arranged by itself, shooting acquisition one or multiple patients'
The image (can be directly shooting photo, be also possible to shoot video clip, face-image is obtained by video clip) of face,
Then by face recognition technology, the face in image is identified, extracts the facial feature data of wherein personage, as
The facial feature data of above-mentioned patient.
Second of implementation, the camera that AR equipment is arranged by itself, shooting acquisition one or multiple patients'
The image (can be directly shooting photo, be also possible to shoot video clip, face-image is obtained by video clip) of face,
The server that obtained image is sent to recognition of face is subjected to recognition of face, and receives the facial characteristics number of the portrait of return
According to the facial feature data of that is, above-mentioned patient.
The program can also be other implementations, with no restrictions to this this programme.
S102: according to facial feature data, the treatment information of patient is obtained；Treatment information is used to refer to patient before this
Physical condition and treatment condition.
In this step, it after having obtained the facial feature data of patient according to above-mentioned implementation, needs according to the face
Portion's characteristic obtains the treatment information of the patient, the program in the specific implementation, can directly according to facial feature data with
The corresponding relationship between information is treated, the treatment information of the patient is directly acquired, can also be obtained first according to facial feature data
The identity of the patient is taken, the treatment information of the patient is then obtained according to the corresponding relationship of identity and treatment information.
Likewise, being also possible to deposit in advance in AR equipment according to the mode that facial feature data obtains the treatment information of patient
The data for storing up institute's some need are directly inquired according to the facial feature data after having obtained the facial feature data of patient
The corresponding treatment data of the patient is obtained, or confirms the identity of patient according to facial feature data, according to identity
The treatment information of the patient is obtained from the treatment information being locally stored.Alternatively, AR equipment can be by the facial characteristics number of patient
According to server is sent to, the corresponding all treatment information of identity of all patients, Huo Zhecun are store in server
The corresponding all treatment information of facial feature data of patient is stored up, server is in the face for the patient for receiving the transmission of AR equipment
After portion's characteristic, the identity of user is confirmed according to the facial feature data, then according to the identity, inquiry is obtained
The treatment information of the patient is taken to return to AR equipment, with no restrictions to this this programme.
The treatment information of patient be primarily used to instruction patient physical condition and treatment condition, such as may include with
It is at least one of lower: inspection result, the related case history of the patient of the patient body, case history etc., the medication record of the patient and
Drug allergy history.
The step one kind in the specific implementation, according in database patient identity mark and corresponding facial characteristics number
According to being analyzed and processed to the facial feature data of the patient, determine the identity of the patient；According to the patient's
Identity obtains the treatment information of the patient from the patient being locally stored with corresponding treatment information.
S103: treatment information is overlapped display in AR scene.
In this not step, AR equipment needs quickly to provide the treatment information after obtaining the treatment information of patient
To the medical staff of the needs treatment information, such as the treatment information is directly superimposed upon in the scene of augmented reality and is shown
Show, medical staff can directly be seen that the treatment information of the patient.
By taking AR glasses as an example, after medical staff wears the AR glasses, carried out in medical procedures to patient, AR glasses are clapped
The face-image for obtaining patient is taken the photograph, obtains the treatment information of patient according to above-mentioned realization process, and pass through the AR in medical staff
The treatment information of the Overlapping display patient in the scene that glasses are seen, i.e. medical staff is while seeing patient, the week of patient
Enclose distribution show displaying in need treatment information, medical staff is very clear, does not need to exchange with patient and has been acknowledged
Information, save the medical care time.
Medical treatment method provided in this embodiment based on AR technology, by AR equipment combination face recognition technology,
It is needed in interrogation or nursing process in patient, obtains the corresponding treatment of the patient by obtaining the facial feature data of patient
Information shows that the relevant treatment information of the patient, assist personnel are to suffer to medical staff in the form of AR equipment with AR
Person is provided more rapidly than the street E An, and more good medical services, effectively improves medical care efficiency, and improve the medical treatment body of patient
It tests.
Fig. 2 is the flow chart of the medical treatment embodiment of the method two provided by the embodiments of the present application based on AR technology, such as Fig. 2
It is shown, on the basis of the above embodiments, a kind of specific implementation of the medical treatment method provided by the present application based on AR technology
Steps are as follows:
S201: the facial feature data of patient is obtained.
In this step, AR equipment needs to obtain the facial feature data of patient, i.e., in application process, AR equipment first
The photo either video for needing to acquire the face of patient, obtains the face-image of patient, carries out at identification to the face of patient
Reason, obtains out facial feature data, which is primarily used to patient's progress identification, so as to subsequent
Relevant treatment information can be obtained according to the identity of the patient determined, specific acquisition modes are similar with embodiment one.
S202: treatment information acquisition request is sent to server.
In this step, AR equipment sends according to the facial feature data and treats after getting facial feature data
Information acquisition request includes facial feature data in the treatment information acquisition request, or is got according to facial feature data
Patient identity.
In a kind of specific implementation, AR equipment division is identified according to the patient identity in database and corresponding face is special
Data are levied, the facial feature data of the patient is analyzed and processed, determines the identity of the patient, then by the trouble
The identity of person, which is carried, is sent to server in treatment information acquisition request.
S203: according to treatment information acquisition request, the treatment information of the patient stored in database is inquired.
In server side, server receives the treatment information acquisition request of AR equipment transmission, which asks
The treatment information for requesting patient is sought, therefore includes the identity characteristic of patient in the treatment information acquisition request, if it is trouble
The facial feature data of person can then inquire in the database the treatment information for obtaining patient with taproot according to the facial feature data.
The identity that can also determine the patient according to the facial feature data of the patient first, then according to the identity mark of the patient
Know the treatment information that inquiry database obtains the patient.It, can be in addition to storing the treatment information of each patient i.e. in server
Store the identity and corresponding facial feature data of patient.
In one kind in the specific implementation, according to the patient identity mark and corresponding facial feature data in database, to institute
The facial feature data for stating patient is analyzed and processed, and determines the identity of the patient, according to the identity mark of the patient
Know, inquires the treatment information of the patient stored in database.
S204: treatment information is returned into AR equipment.
In this step, obtained treatment information is returned to AR equipment by server.
The treatment information of patient be primarily used to instruction patient physical condition and treatment condition, such as may include with
It is at least one of lower: inspection result, the related case history of the patient of the patient body, case history etc., the medication record of the patient and
Drug allergy history.
S205: information Overlapping display in augmented reality AR scene will be treated.
In this step, which is directly superimposed upon augmented reality after receiving treatment information by AR equipment
Scene in shown, medical staff can directly be seen that the treatment information of the patient.
Medical treatment method provided in this embodiment based on AR technology, by storing all patients' in the server
Information is treated, during patient sees a doctor, treatment information is showed medical care people by the superposition shown by recognition of face and AR
Member, effectively improves medical treatment and nursing efficiency.
Based on any of the above embodiments, being somebody's turn to do the medical treatment method based on AR technology can also include following step
Rapid: AR equipment obtains the nursing information to patient according to the treatment information of patient；The monitoring that nursing information pushes to patient is set
It is standby.
The program is meant that AR equipment can be applied in specific nursing process, according to the treatment of obtained patient
Information obtains the nursing care mode and content of the most suitable patient, i.e. nursing information, which is pushed to patient monitoring and is set
It is standby, such as: the custodial care facility can use the terminal device of nursing staff or monitoring device etc., without limitation.
Fig. 3 is the structural schematic diagram of the medical treatment Installation practice one provided by the embodiments of the present application based on AR technology,
As shown in figure 3, the medical treatment device 10 based on AR technology includes:
Module 11 is obtained, for obtaining the facial feature data of patient；
Processing module 12, for obtaining the treatment information of the patient according to the facial feature data；The treatment letter
Breath is used to refer to the physical condition and treatment condition of the patient before this；
Display module 13, for the treatment information to be overlapped display in augmented reality AR scene.
Medical treatment device provided in this embodiment based on AR technology, for executing AR equipment in preceding method embodiment
Technical solution, it is similar that the realization principle and technical effect are similar, by combine recognition of face and AR technology, in the form of AR, to doctor
Shield personnel show that the associated treatment information of corresponding patient, assist personnel provide more rapidly convenient good doctor for patient with AR
Treat service.
Fig. 4 is the structural schematic diagram of the medical treatment Installation practice two provided by the embodiments of the present application based on AR technology,
As shown in figure 4, on the basis of the above embodiments, being somebody's turn to do the medical treatment device 10 based on AR technology further include:
Sending module 14, for sending treatment information acquisition request to server, the treatment information acquisition request includes
The facial feature data of the patient；
Receiving module 15, for receiving the treatment information for the patient that the server returns.
On the basis of above-mentioned two embodiment, optionally, the processing module 12 is specifically used for according in database
Patient identity mark and corresponding facial feature data, are analyzed and processed the facial feature data of the patient, determine institute
State the identity of patient；
Sending module 14 wraps in the treatment information acquisition request for sending treatment information acquisition request to server
Include the identity of the patient；
Receiving module 15, for receiving the treatment information for the patient that the server returns.
Optionally, the processing module 12 is specifically used for:
According to the patient identity mark and corresponding facial feature data in database, to the facial characteristics number of the patient
According to being analyzed and processed, the identity of the patient is determined；
The trouble is obtained from the patient being locally stored with corresponding treatment information according to the identity of the patient
The treatment information of person.
Optionally, the acquisition module 11 is specifically used for:
The face-image of the patient is obtained by camera shooting；
Identifying processing is carried out using face recognition technology to the face-image, obtains the facial characteristics number of the patient
According to.
Optionally, the treatment information of the patient comprises at least one of the following:
The inspection result of the patient, related case history, medication record and drug allergy history.
Optionally, the processing module 12 is also used to:
According to the treatment information of the patient, the nursing information to the patient is obtained；
The nursing information is pushed to the custodial care facility of the patient.
The medical treatment device based on AR technology that any of the above-described Installation practice provides is implemented for executing preceding method
The technical solution of AR equipment in example, it is similar that the realization principle and technical effect are similar, and details are not described herein.
Fig. 5 is the structural schematic diagram of the medical treatment Installation practice three provided by the embodiments of the present application based on AR technology,
As shown in figure 5, being somebody's turn to do the medical treatment device 20 based on AR technology, comprising:
Receiving module 21, for receiving the treatment information acquisition request of augmented reality AR equipment transmission, the treatment information
Acquisition request includes the facial feature data of the patient or the identity of the patient；
Processing module 22, for inquiring the patient's stored in database according to the treatment information acquisition request
Treat information；
Sending module 23, for the treatment information to be returned to the AR equipment.
Optionally, if the treatment information acquisition request includes the facial feature data of the patient, the processing mould
Block 22 is specifically used for:
According to the patient identity mark and corresponding facial feature data in database, to the facial characteristics number of the patient
According to being analyzed and processed, the identity of the patient is determined；
According to the identity of the patient, the treatment information of the patient stored in database is inquired.
Optionally, the treatment information of the patient comprises at least one of the following:
The inspection result of the patient, related case history, medication record and drug allergy history.
The medical treatment device based on AR technology that any of the above-described Installation practice provides is implemented for executing preceding method
The technical solution of cloud or server in example, it is similar that the realization principle and technical effect are similar, and details are not described herein.
Fig. 6 is the structural schematic diagram of AR apparatus embodiments one provided by the embodiments of the present application, as shown in fig. 6, the AR equipment
It includes at least: display, transmitter, receiver, processor, memory and computer program；The computer program storage
In the memory, the processor execute that the computer program realizes that aforementioned either method embodiment provides based on AR
The technical solution of the medical treatment method of technology.
Fig. 7 is the structural schematic diagram of server example one provided by the embodiments of the present application, as shown in fig. 7, the server,
It include: receiver, transmitter, processor, memory and computer program；The computer program is stored in the memory
In, the processor executes the computer program and realizes the doctor based on AR technology that aforementioned either method embodiment provides
Treat the technical solution of processing method.
The application also provides a kind of computer readable storage medium, and the computer-readable recording medium storage has computer
Program, in the medical treatment method based on AR technology that the computer program provides for realizing aforementioned either method embodiment
The technical solution of AR equipment side.
The application also provides a kind of computer readable storage medium, and the computer-readable recording medium storage has computer
Program, in the medical treatment method based on AR technology that the computer program provides for realizing aforementioned either method embodiment
The technical solution of server side.
In above-mentioned AR equipment and server in the specific implementation, it should be understood that processor can be central processing unit (English
Text: Central Processing Unit, referred to as: CPU), it can also be other general processors, digital signal processor (English
Text: Digital Signal Processor, referred to as: DSP), specific integrated circuit (English: Application Specific
Integrated Circuit, referred to as: ASIC) etc..General processor can be microprocessor or the processor is also possible to
Any conventional processor etc..The step of method in conjunction with disclosed in the embodiment of the present application, can be embodied directly in hardware processor
Execute completion, or in processor hardware and software module combination execute completion.
Those of ordinary skill in the art will appreciate that: realize that all or part of the steps of above-mentioned each method embodiment can lead to
The relevant hardware of program instruction is crossed to complete.Program above-mentioned can be stored in a computer readable storage medium.The journey
When being executed, execution includes the steps that above-mentioned each method embodiment to sequence；And storage medium above-mentioned includes: read-only memory (English
Text: read-only memory, abbreviation: ROM), RAM, flash memory, hard disk, solid state hard disk, tape (English: magnetic
Tape), floppy disk (English: floppy disk), CD (English: optical disc) and any combination thereof.
Finally, it should be noted that the above various embodiments is only to illustrate the technical solution of the application, rather than its limitations；To the greatest extent
Pipe is described in detail the application referring to foregoing embodiments, those skilled in the art should understand that: its according to
So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into
Row equivalent replacement；And these are modified or replaceed, each embodiment technology of the application that it does not separate the essence of the corresponding technical solution
The range of scheme.
Claims (24)
1. a kind of medical treatment method based on AR technology characterized by comprising
Obtain the facial feature data of patient；
According to the facial feature data, the treatment information of the patient is obtained；The treatment information is used to refer to the patient
Physical condition and treatment condition before this；
The treatment information is overlapped display in augmented reality AR scene.
2. obtaining the trouble the method according to claim 1, wherein described according to the facial feature data
The treatment information of person, comprising:
Treatment information acquisition request is sent to server, the treatment information acquisition request includes the facial characteristics number of the patient
According to；
Receive the treatment information for the patient that the server returns.
3. obtaining the trouble the method according to claim 1, wherein described according to the facial feature data
The treatment information of person, comprising:
According to the patient identity mark and corresponding facial feature data in database, to the facial feature data of the patient into
Row analysis processing, determines the identity of the patient；
Treatment information acquisition request is sent to server, includes the identity mark of the patient in the treatment information acquisition request
Know；
Receive the treatment information for the patient that the server returns.
4. obtaining the trouble the method according to claim 1, wherein described according to the facial feature data
The treatment information of person, comprising:
According to the patient identity mark and corresponding facial feature data in database, to the facial feature data of the patient into
Row analysis processing, determines the identity of the patient；
Obtain the patient's from the patient being locally stored with corresponding treatment information according to the identity of the patient
Treat information.
5. method according to any one of claims 1 to 4, which is characterized in that the facial feature data for obtaining patient,
Include:
The face-image of the patient is obtained by camera shooting；
Identifying processing is carried out using face recognition technology to the face-image, obtains the facial feature data of the patient.
6. method according to any one of claims 1 to 4, which is characterized in that the treatment information of the patient includes following
It is at least one:
The inspection result of the patient, related case history, medication record and drug allergy history.
7. method according to any one of claims 1 to 4, which is characterized in that the method also includes:
According to the treatment information of the patient, the nursing information to the patient is obtained；
The nursing information is pushed to the custodial care facility of the patient.
8. a kind of medical treatment method based on AR technology characterized by comprising
The treatment information acquisition request that augmented reality AR equipment is sent is received, the treatment information acquisition request includes the patient
Facial feature data or the patient identity；
According to the treatment information acquisition request, the treatment information of the patient stored in database is inquired；
The treatment information is returned into the AR equipment.
9. according to the method described in claim 8, it is characterized in that, if the treatment information acquisition request includes the patient
Facial feature data, then it is described according to the treatment information acquisition request, inquire the treatment of the patient stored in database
Information, comprising:
According to the patient identity mark and corresponding facial feature data in database, to the facial feature data of the patient into
Row analysis processing, determines the identity of the patient；
According to the identity of the patient, the treatment information of the patient stored in database is inquired.
10. method according to claim 8 or claim 9, which is characterized in that the treatment information of the patient includes following at least one
Kind:
The inspection result of the patient, related case history, medication record and drug allergy history.
11. a kind of medical treatment device based on AR technology characterized by comprising
Module is obtained, for obtaining the facial feature data of patient；
Processing module, for obtaining the treatment information of the patient according to the facial feature data；The treatment information is used to
Indicate the physical condition and treatment condition of the patient before this；
Display module, for the treatment information to be overlapped display in augmented reality AR scene.
12. device according to claim 11, which is characterized in that described device further include:
Sending module, for sending treatment information acquisition request to server, the treatment information acquisition request includes the trouble
The facial feature data of person；
Receiving module, for receiving the treatment information for the patient that the server returns.
13. device according to claim 11, which is characterized in that the processing module is specifically used for according in database
Patient identity mark and corresponding facial feature data, are analyzed and processed the facial feature data of the patient, determine institute
State the identity of patient；
Described device further include:
Sending module includes described in the treatment information acquisition request for sending treatment information acquisition request to server
The identity of patient；
Receiving module, for receiving the treatment information for the patient that the server returns.
14. device according to claim 11, which is characterized in that the processing module is specifically used for:
According to the patient identity mark and corresponding facial feature data in database, to the facial feature data of the patient into
Row analysis processing, determines the identity of the patient；
Obtain the patient's from the patient being locally stored with corresponding treatment information according to the identity of the patient
Treat information.
15. 1 to 14 described in any item devices according to claim 1, which is characterized in that the acquisition module is specifically used for:
The face-image of the patient is obtained by camera shooting；
Identifying processing is carried out using face recognition technology to the face-image, obtains the facial feature data of the patient.
16. 1 to 14 described in any item devices according to claim 1, which is characterized in that the treatment information of the patient include with
Lower at least one:
The inspection result of the patient, related case history, medication record and drug allergy history.
17. 1 to 14 described in any item devices according to claim 1, which is characterized in that the processing module is also used to:
According to the treatment information of the patient, the nursing information to the patient is obtained；
The nursing information is pushed to the custodial care facility of the patient.
18. a kind of medical treatment device based on AR technology characterized by comprising
Receiving module, for receiving the treatment information acquisition request of augmented reality AR equipment transmission, the treatment acquisition of information is asked
Ask the facial feature data including the patient or the identity of the patient；
Processing module, for inquiring the treatment letter of the patient stored in database according to the treatment information acquisition request
Breath；
Sending module, for the treatment information to be returned to the AR equipment.
19. device according to claim 18, which is characterized in that if the treatment information acquisition request includes the patient
Facial feature data, then the processing module is specifically used for:
According to the patient identity mark and corresponding facial feature data in database, to the facial feature data of the patient into
Row analysis processing, determines the identity of the patient；
According to the identity of the patient, the treatment information of the patient stored in database is inquired.
20. device described in 8 or 19 according to claim 1, which is characterized in that the treatment information of the patient include it is following at least
It is a kind of:
The inspection result of the patient, related case history, medication record and drug allergy history.
21. a kind of AR equipment characterized by comprising display, transmitter, receiver, processor, memory and calculating
Machine program；In the memory, the processor executes the computer program and realizes right for the computer program storage
It is required that 1 to 7 described in any item medical treatment methods based on AR technology.
22. a kind of server characterized by comprising receiver, transmitter, processor, memory and computer program；
Computer program storage in the memory, the processor execute the computer program realize claim 8 to
10 described in any item medical treatment methods based on AR technology.
23. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer journey
Sequence, the computer program is for realizing the described in any item medical treatment methods based on AR technology of claim 1 to 7.
24. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer journey
Sequence, the computer program is for realizing the described in any item medical treatment methods based on AR technology of claim 8 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810886304.0A CN109102874A (en) | 2018-08-06 | 2018-08-06 | Medical treatment method, apparatus, equipment and storage medium based on AR technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810886304.0A CN109102874A (en) | 2018-08-06 | 2018-08-06 | Medical treatment method, apparatus, equipment and storage medium based on AR technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109102874A true CN109102874A (en) | 2018-12-28 |
Family
ID=64848881
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810886304.0A Pending CN109102874A (en) | 2018-08-06 | 2018-08-06 | Medical treatment method, apparatus, equipment and storage medium based on AR technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109102874A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101329722A (en) * | 2007-06-21 | 2008-12-24 | 上海北控智能科技有限公司 | Human face recognition method for performing recognition algorithm based on neural network |
| CN102655544A (en) * | 2011-03-01 | 2012-09-05 | 联想(北京)有限公司 | Method for issuing communication, and communication terminal |
| CN103051791A (en) * | 2012-12-17 | 2013-04-17 | 广东欧珀移动通信有限公司 | Method and device for acquiring communication information |
| CN106909771A (en) * | 2015-12-23 | 2017-06-30 | 西门子医疗有限公司 | Method and system for exporting augmented reality information |
| CN107239725A (en) * | 2016-03-29 | 2017-10-10 | 阿里巴巴集团控股有限公司 | A kind of information displaying method, apparatus and system |
| CN107566248A (en) * | 2017-08-22 | 2018-01-09 | 非常云智慧科技（常州）有限公司 | Social contact method and device based on augmented reality |
| CN108135772A (en) * | 2015-09-28 | 2018-06-08 | 皇家飞利浦有限公司 | For the portable medical device and method instructed based on the personalized treatment of the on-line storage data with body measurement |
-
2018
- 2018-08-06 CN CN201810886304.0A patent/CN109102874A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101329722A (en) * | 2007-06-21 | 2008-12-24 | 上海北控智能科技有限公司 | Human face recognition method for performing recognition algorithm based on neural network |
| CN102655544A (en) * | 2011-03-01 | 2012-09-05 | 联想(北京)有限公司 | Method for issuing communication, and communication terminal |
| CN103051791A (en) * | 2012-12-17 | 2013-04-17 | 广东欧珀移动通信有限公司 | Method and device for acquiring communication information |
| CN108135772A (en) * | 2015-09-28 | 2018-06-08 | 皇家飞利浦有限公司 | For the portable medical device and method instructed based on the personalized treatment of the on-line storage data with body measurement |
| CN106909771A (en) * | 2015-12-23 | 2017-06-30 | 西门子医疗有限公司 | Method and system for exporting augmented reality information |
| CN107239725A (en) * | 2016-03-29 | 2017-10-10 | 阿里巴巴集团控股有限公司 | A kind of information displaying method, apparatus and system |
| CN107566248A (en) * | 2017-08-22 | 2018-01-09 | 非常云智慧科技（常州）有限公司 | Social contact method and device based on augmented reality |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180197544A1 (en) | Transcription of communication sessions | |
| US10212389B2 (en) | Device to device communication | |
| EP1239399A3 (en) | System and method for providing a medical information system for clinical care | |
| CN103258137A (en) | Long-distance inquiring method | |
| KR20190126587A (en) | Medical Image De-Identification System, Method and Computer Readable Recording Medium | |
| WO2018128992A1 (en) | Establishment of communication between devices | |
| CN103778311A (en) | Entry terminal and method for first-aid workstation structured electronic medical records | |
| CN108648125B (en) | Management system and method for volunteers in home-based care service | |
| US10779733B2 (en) | Telemedicine application of video analysis and motion augmentation | |
| CN110442783A (en) | Information-pushing method, device based on recognition of face, computer equipment | |
| CN111640477A (en) | Identity information unifying method and device and electronic equipment | |
| KR20200068992A (en) | Method, Apparatus and Recording For Computerizing Of Electro-Magnetic Resonance | |
| KR20150114194A (en) | Method and system for managing tooth information service | |
| CN109102874A (en) | Medical treatment method, apparatus, equipment and storage medium based on AR technology | |
| CN111968730A (en) | Online electronic accompanying certificate application and use method | |
| CN108962360B (en) | Verification method and device, server, application server and real-name verification system | |
| WO2020087792A1 (en) | Artificial-intelligence disease analysis method and apparatus, storage medium, and computer device | |
| US20190013097A1 (en) | Method, system, and non-transitory computer-readable recording medium for providing medical service | |
| US20180247701A1 (en) | System and Method to Combine, View, and Distribute Patient Health Records from Multiple Sources | |
| US11004134B2 (en) | Method and system for providing face-based services and non-transitory computer-readable recording medium | |
| US20220005567A1 (en) | Current Health Status Certification | |
| Paulus et al. | AUDIME: Augmented disaster medicine | |
| CN202535401U (en) | International classification of functioning, disability and health (ICF) network platform system | |
| JP2017016347A (en) | Information processing device, information processing method, and program | |
| TW201145063A (en) | Emergency treatment pre-processing system and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181228 |