CN212853514U - Augmented reality observation device for ultrasound device - Google Patents

Abstract

The utility model relates to the technical field of medical instruments and discloses augmented reality observation equipment for ultrasonic equipment, which comprises a communication module, an AR module, an ultrasonic module and a wearing device; the communication module transmits the detection information of the ultrasonic module to the AR module, and the AR module displays the real-time ultrasonic model after the detection information is combined; by arranging the AR module, the ultrasonic module and the wearing device, wherein the AR module is connected with the wearing device, the ultrasonic module is connected with the communication module, the ultrasonic module combines detection information into a real-time ultrasonic model after ultrasonic detection is carried out on the ultrasonic module, the real-time ultrasonic model is transmitted to the AR module through the communication module, and the ultrasonic module is attached to determine locating point information of organs or fetuses.

Description

Augmented reality observation device for ultrasound device

Technical Field

The patent of the utility model relates to the technical field of medical instrument, particularly, relate to an augmented reality observation device for ultrasonic equipment.

Background

Medical ultrasound (also known as diagnostic ultrasound or ultrasound) is a diagnostic imaging technique based on ultrasound applications; it is used to view internal body structures such as tendons, muscles, joints, blood vessels and internal organs; the aim is often to find the origin of the disease or to exclude any pathology; the practice of examining pregnant women using ultrasonic waves is called obstetrical ultrasound, which is widely used; in the conventional ultrasound field, a common two-dimensional picture or a virtual three-dimensional image is displayed through a planar display, but is essentially a two-dimensional representation.

Augmented reality (AR for short) simply applies virtual information to a real world through a computer graphic image technology and a positioning technology, superimposes a real scene and a virtual scene, and can be seen by human eyes, presenting a brand new man-machine interaction mode.

In the prior art, an augmented reality observation device for an ultrasonic device, which is convenient to use, is lacked.

SUMMERY OF THE UTILITY MODEL

An object of the utility model is to provide an augmented reality observation equipment for supersound equipment aims at providing the augmented reality observation equipment that is used for supersound equipment that facilitates the use.

The utility model discloses a realize like this for the augmented reality observation equipment of ultrasonic equipment, including communication module, AR module for showing, the ultrasonic module that is used for the ultrasonic testing user and connect the device of wearing of AR module, communication module with ultrasonic module electric connection, AR module with communication module signal connection; the combined detection information of the ultrasonic modules is a real-time ultrasonic model, the communication module transmits the real-time ultrasonic model and positioning point information to the AR module, and the AR module displays an image formed by combining the real-time ultrasonic model and a real environment according to the positioning point information.

Furthermore, the wearing device comprises two fixed legs and a fixed frame, wherein the two fixed legs are respectively hinged with two ends of the fixed frame; the two fixing legs deviate from an elastic piece is connected between the rear ends of the fixing frames, and the elastic piece is used for assisting the wearing device to be fixed on the head of the user.

Furthermore, the front ends of the two fixing legs are respectively hinged with the fixing frame, and the rear ends of the two fixing legs are respectively bent towards the other fixing leg.

Further, the AR module comprises a communication block, a controller, a camera and a display lens, wherein the communication block is in close range connection with the communication module; the camera, the display lens the controller with mount fixed connection, the camera the display lens respectively with controller electric connection, the camera is shot and is fixed a position real-time supersound model display position, the display lens shows real-time supersound model.

Further, the AR module comprises an acceleration sensor, an ambient light sensor and a gyroscope sensor, parameters of the acceleration sensor are sent to the controller, and the controller changes from a standby state to a starting state or from the starting state to the standby state; the parameters of the ambient light sensor are sent to the controller, and the controller controls the display brightness of the display lens; and the parameters of the gyroscope sensor are sent to the controller, and the controller controls the display angle of the real-time ultrasonic model.

Further, the ultrasonic module comprises a detection piece and a calculation piece, wherein the detection piece is electrically connected with the calculation piece, the detection piece is in contact detection with the user and transmits a signal to the calculation piece, and the calculation piece transmits the signal to the communication block through the communication module.

Further, the detecting piece comprises an ultrasonic generator, an ultrasonic receiver and a transmission line, the ultrasonic generator and the ultrasonic receiver are fixedly connected, and the ultrasonic receiver is connected to the calculating piece through the transmission line in a wired mode.

Further, the detection piece comprises an ultrasonic generator, an ultrasonic receiver and a transmission block, the ultrasonic generator and the ultrasonic receiver are fixedly connected, and the ultrasonic receiver is connected to the calculation piece through the transmission block in a short range.

Further, the calculating part comprises an ultrasonic image processing module and a real-time ultrasonic model storage module,

the ultrasonic image processing module processes the detection information into a real-time ultrasonic model,

and the real-time ultrasonic model storage module sends the real-time ultrasonic model to the communication module or uploads the real-time ultrasonic model to a server.

Further, the communication module is connected with the communication block through short range communication.

Compared with the prior art, the utility model provides an augmented reality observation device for ultrasonic equipment, through setting up the AR module, the ultrasonic module and wear the device, wherein the AR module with wear the device and be connected, and the ultrasonic module is connected with communication module, the ultrasonic module carries out ultrasonic testing back and will detect the information combination and be real-time ultrasonic model, and real-time ultrasonic model is transmitted for the AR module by passing through communication module, wherein still attach ultrasonic module and confirm organ or foetal setpoint information, thus, the image after real-time ultrasonic model of last AR module demonstration and real environment combination, and according to setpoint information, can let the observer directly see the internal diagnostic status of user, it is very convenient.

Drawings

Fig. 1 is a schematic diagram of a module connection of an augmented reality observation device for an ultrasound device provided by the present invention;

fig. 2 is a schematic perspective view of the wearing device and the AR module provided by the present invention;

fig. 3 is another perspective view of the wearable device and the AR module provided by the present invention;

fig. 4 is another perspective view of the wearing device and the AR module provided by the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The following describes the implementation of the present invention in detail with reference to specific embodiments.

The same or similar reference numerals in the drawings of the present embodiment correspond to the same or similar components; in the description of the present invention, it should be understood that if there are the terms "upper", "lower", "left", "right", etc. indicating the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, it is only for convenience of description and simplification of the description, but it is not intended to indicate or imply that the device or element referred to must have a specific orientation, be constructed in a specific orientation, and be operated, and therefore the terms describing the positional relationship in the drawings are only for illustrative purposes and are not to be construed as limitations of the present patent, and those skilled in the art can understand the specific meanings of the terms according to specific situations.

Referring to fig. 1-3, the preferred embodiment of the present invention is shown.

The augmented reality observation device for the ultrasonic device provided by the embodiment can be used for observing the fetal state in the body of a target person, and meanwhile, all parts and organs in the body of the target person can be observed, so that the traditional ultrasonic display screen is replaced, and the augmented reality observation device becomes a more clear and more convenient display terminal.

The augmented reality observation equipment for the ultrasonic equipment comprises a communication module, an AR module 12, an ultrasonic module and a wearing device 11, wherein the AR module 12 is used for displaying, the ultrasonic module is used for ultrasonic detection of a user, the wearing device 11 is connected with the AR module 12, the communication module is electrically connected with the ultrasonic module, and the AR module 12 is in signal connection with the communication module; the combined detection information of the ultrasonic modules is a real-time ultrasonic model, the communication module transmits the real-time ultrasonic model and the positioning point information to the AR module 12, and the AR module 12 displays an image formed by combining the real-time ultrasonic model and the real environment according to the positioning point information.

By setting the AR module 12, the ultrasonic module and the wearing device 11, wherein the AR module 12 is connected with the wearing device 11, the ultrasonic module is connected with the communication module, the ultrasonic module combines the detection information into a real-time ultrasonic model after ultrasonic detection, the real-time ultrasonic model is transmitted to the AR module 12 through the communication module, and the ultrasonic module is attached to determine the locating point information of organs or fetuses, so that the AR module 12 displays the image formed by combining the real-time ultrasonic model and the real environment, and an observer can directly see the diagnosis condition in the body of the user according to the locating point information, thereby being very convenient

The wearing device 11 comprises two fixed legs 13 and a fixed frame 14, wherein the two fixed legs 13 are respectively hinged with two ends of the fixed frame 14; two fixed legs 13 deviate from being connected with elastic component 17 between the rear end of mount 14, and elastic component 17 is used for the supplementary device 11 of wearing to fix at user's overhead, wears the device 11 and can fix at user's overhead, and like this, AR module 12 can be fixed in user's the eye in front, and through setting up elastic component 17, orders about AR module 12 can not lead to vibrations because of walking about for the people when showing, perhaps other actions.

In addition, the front ends of the two fixed legs 13 are respectively hinged with the fixed frame 14, and the rear ends of the two fixed legs 13 are respectively arranged towards the other fixed leg 13 in a bending way, so that the wearing device 11 can be further fixed on the head of a user, and the stability is enhanced.

There is another embodiment as shown in fig. 3:

the wearing device 11 comprises a fixed leg 13 and a fixed frame 14, the fixed leg 13 being hingedly arranged with the fixed frame 14.

In addition, the front end of the fixed leg 13 is hinged to the fixed frame 14, and the rear end of the fixed leg 13 is bent horizontally downward, so that the wearing device 11 can be further fixed on the ear of the user, and the stability is enhanced.

As shown in fig. 4, the rear end of the fixed leg 13 is connected with a fixed head band 17, which has elasticity and drives the wearing device 11 to be fixed on the head of the user.

In yet another embodiment, a stop block is attached to the rear end of the fixed leg 13, wherein the stop block has friction lines on its lower surface, wherein the friction lines are used to prevent the wearing device 11 from slipping.

The AR module 12 includes a communication block, a controller, a camera 16 and a display lens 15, the communication block is connected to the communication module in a short range; camera 16, display lens 15, controller and mount 14 fixed connection, camera 16, display lens 15 respectively with controller electric connection, camera 16 shoot and fix a position real-time supersound model display position, display lens 15 shows real-time supersound model, wherein display lens 15 includes transparent lens and organic light emitting display circuit, wherein organic light emitting display circuit is transparent, and is arranged in transparent lens.

Specifically, the transparent lens includes a first layer and a second layer, wherein the organic light emitting display circuit is located between the first layer and the second layer, and the first layer and the second layer are connected through an adhesive.

The wearing device 11 further comprises a cover sheet movably connected to the fixing frame 14 such that the fixing cover sheet is used to cover the display lens 15, when the display lens 15 is covered by the cover sheet, the user's visual field is limited, the organic light emitting transparent circuit directly displays an image, and the camera 16 continues to take a picture for recognizing a gesture.

Specifically, one end of the cover plate is connected with the fixing frame through magnetic force, and the cover plate moves to cover the transparent lens.

In addition, another embodiment relates to a cover plate, wherein one end of the cover plate is hinged with the fixed frame, and the cover plate is moved to cover the transparent lens.

Specifically, the camera 16 is fixedly connected with the fixing frame 14, and the display lens 15 is also fixedly connected with the fixing frame 14, so that the display lens 15 is further fixed.

The AR module 12 includes an acceleration sensor, an ambient light sensor, and a gyroscope sensor, and parameters of the acceleration sensor are sent to the controller, and the controller changes from a standby state to a start state or from the start state to the standby state; the parameters of the ambient light sensor are sent to the controller, and the controller controls the display brightness of the display lens 15; parameters of the gyroscope sensor are sent to the controller, and the controller controls the display angle of the real-time ultrasonic model.

In addition, the AR module 12 is further provided with a light sensing circuit, wherein the light sensing circuit is used for sensing the pupil angle so as to position the viewing angle focus, and thus, the light sensing circuit transmits the pupil focus position to the controller, and then the controller controls the organic light emitting display circuit to correspondingly display the blurred or cleaned image.

The ultrasonic module comprises a detection piece and a calculation piece, the detection piece is electrically connected with the calculation piece, the detection piece is in contact detection with a user and transmits a signal to the calculation piece, and the calculation piece transmits the signal to the communication block through the communication module.

And the detection piece comprises an ultrasonic generator, an ultrasonic receiver and a transmission line, the ultrasonic generator and the ultrasonic receiver are fixedly connected, and the ultrasonic receiver is connected to the calculation piece through the transmission line in a wired mode.

In yet another embodiment, the detecting member comprises an ultrasonic generator, an ultrasonic receiver and a transmission block, the ultrasonic generator and the ultrasonic receiver are fixedly connected, and the ultrasonic receiver is connected to the calculating member through the transmission block in a short range, wherein the ultrasonic generator generates ultrasonic waves, the ultrasonic receiver receives the ultrasonic waves and converts the ultrasonic waves into detection information, and the transmission block transmits the detection information to the ultrasonic image processing module.

And the computing part comprises an ultrasonic image processing module and a real-time ultrasonic model storage module, the ultrasonic image processing module processes the detection information into a real-time ultrasonic model, and the real-time ultrasonic model storage module sends the real-time ultrasonic model to the communication module or uploads the real-time ultrasonic model to the server.

Wherein the communication module is connected with the communication block through short-range communication.

Wherein the controller includes user interaction module, and camera 16 shoots user's gesture, and user interaction module turns into the operation of rotation, enlargeing, reducing of model with it, and when the user made the gesture before camera 16, the controller discerned the gesture, wherein has following step:

(1) the optical sensor circuit detects whether the pupil focus of the user is in front of the lens, and when the pupil focus of the user is in front of the lens, the optical sensor circuit drives the camera 16 to start shooting;

(2) the controller judges whether the user faces the detection part of the user according to the shooting result of the camera 16, whether the detection corresponds to the positioning point information one by one, and when the camera 16 is positioned to the positioning point information, the controller drives the display lens 15 to display the real-time ultrasonic model;

(3) the user makes a gesture in the shooting range of the camera 16, and the shielding range of the hand is calculated and transmitted, so that the shielding range corresponding to the hand is hidden by the model display on the display lens 15, and meanwhile, the controller acquires the gesture action;

(4) and the controller judges whether the user performs the gesture of rotation, amplification and reduction according to the duration and the amplitude of the gesture action, and when the gesture of rotation, amplification and reduction is determined, the controller drives the model on the display lens 15 to rotate, amplify and reduce.

The user interaction module is also responsible for calculating and displaying the annotation, so that a user can know the near condition of the organ or the fetus conveniently.

In addition, the AR module 12 is further provided with a memory, wherein the memory is used for temporarily storing the real-time ultrasound model transmitted from the ultrasound module, and then letting the controller select full high-definition display or fuzzy display, and when the controller sets the energy-saving mode, the definition of the display lens 15 displaying the real-time ultrasound model will decrease.

The data processed by the virtual-real mixed processing module is obtained, and the obtained ultrasonic imaging mixed model can be directly output to a display module for display and can also be output to a virtual-real mixed data storage module for storage;

in addition, in order to fuse the real-time ultrasound model with the real scene three-dimensional model, the transformation of a coordinate system is required; converting a real-time ultrasonic model coordinate system into a real scene coordinate system which can be seen by the vision of a user;

assuming that all points of the corresponding three-dimensional real-time ultrasound model in the real-time ultrasound model coordinate system are P1(x, y, z), P2(x, y, z), P3(x, y, z), P4(x, y, z) … … Pn (x, y, z),

corresponding to all points in the real scene coordinate system based on the AR module 12 are P1 ' (x, y, z), P2 ' (x, y, z), P3 ' (x, y, z), P4 ' (x, y, z) … … Pn ' (x, y, z),

a transformation matrix M is required to realize the transformation of the coordinate system, and the relative position of the organ or fetus is obtained through the transformation of the coordinate system.

The positioning point information is obtained by identifying the position of the organ or the fetus on the human body through the ultrasonic module, the position of the three-dimensional model of the organ or the fetus is finally obtained by combining the positioning point information and the coordinate system, and the corresponding real-time ultrasonic model is finally displayed on the display lens 15 through the camera 16.

Specifically, when the person does not look at the user, the display lens 15 does not display the corresponding real-time ultrasound model, but when the camera 16 gradually photographs the user or the user rotates in the user direction, the real-time ultrasound model is gradually displayed on the display lens 15.

Optionally, the ultrasound module may be a palm ultrasound device or a desktop ultrasound device, which is not limited herein.

The ultrasound module may be used to detect, among other things, abdominal organs, blood vessels, skin, neck organs, fetuses, etc.

The above description is only exemplary of the present invention and should not be taken as limiting the scope of the present invention, as any modifications, equivalents, improvements and the like made within the spirit and principles of the present invention are intended to be included within the scope of the present invention.

Claims (10)

1. The augmented reality observation equipment for the ultrasonic equipment is characterized by comprising a communication module, an AR module for displaying, an ultrasonic module for ultrasonically detecting a user and a wearing device connected with the AR module, wherein the communication module is electrically connected with the ultrasonic module, and the AR module is in signal connection with the communication module; the combined detection information of the ultrasonic modules is a real-time ultrasonic model, the communication module transmits the real-time ultrasonic model and positioning point information to the AR module, and the AR module displays an image formed by combining the real-time ultrasonic model and a real environment according to the positioning point information.

2. The augmented reality observation apparatus for an ultrasound apparatus according to claim 1, wherein the wearing means includes two fixed legs and a fixed frame, the two fixed legs are respectively hinged to two ends of the fixed frame; two the fixed leg deviates from be connected with the elastic component between the rear end of mount, the elastic component is used for assisting wear the device and fix on user's head.

3. The augmented reality observation device for an ultrasound device according to claim 2, wherein front ends of the two fixed legs are respectively hinged to the fixed frame, and rear ends of the two fixed legs are respectively arranged to be bent toward the other fixed leg.

4. The augmented reality observation device for an ultrasound device of any one of claims 2-3, wherein the AR module comprises a communication block, a controller, a camera, and a display lens, the communication block in proximity connection with the communication module; the camera, the display lens and the controller are fixedly connected with the fixing frame, the camera and the display lens are respectively and electrically connected with the controller, the camera shoots the positioning point information for the controller to position, and the display lens displays the real-time ultrasonic model.

5. The augmented reality observation device for an ultrasound device of claim 4 wherein the AR module comprises an acceleration sensor, an ambient light sensor and a gyroscope sensor, parameters of the acceleration sensor are sent to the controller, the controller changes from a standby to a startup state or from a startup to a standby state; the parameters of the ambient light sensor are sent to the controller, and the controller controls the display brightness of the display lens; and the parameters of the gyroscope sensor are sent to the controller, and the controller controls the display angle of the real-time ultrasonic model.

6. The augmented reality observation apparatus for an ultrasound apparatus according to claim 5, wherein the ultrasound module comprises a detecting member and a calculating member, the detecting member is electrically connected with the calculating member, the detecting member is in contact with the user to detect and transmit a signal to the calculating member, and the calculating member transmits the signal to the communication block through the communication module.

7. The augmented reality observation apparatus for an ultrasound apparatus according to claim 6, wherein the detecting member includes an ultrasound generator, an ultrasound receiver, and a transmission line, the ultrasound generator and the ultrasound receiver are fixedly connected, and the ultrasound receiver is wired to the calculating member through the transmission line.

8. The augmented reality observation apparatus for an ultrasound apparatus according to claim 7, wherein the detecting member comprises an ultrasound generator, an ultrasound receiver, and a transmission block, the ultrasound generator and the ultrasound receiver are fixedly connected, and the ultrasound receiver is connected to the calculating member by proximity through the transmission block.

9. The augmented reality observation apparatus for an ultrasound apparatus according to claim 8, wherein the calculation means includes an ultrasound image processing module and a real-time ultrasound model storage module,

the ultrasonic image processing module processes the detection information into a real-time ultrasonic model,

and the real-time ultrasonic model storage module sends the real-time ultrasonic model to the communication module or uploads the real-time ultrasonic model to a server.

10. The augmented reality observation device for an ultrasound device of claim 9, wherein the communication module is connected with the communication block by short range communication.

Images