CN114430482B - Holographic diagnosis system, method, computer equipment and storage medium - Google Patents

Holographic diagnosis system, method, computer equipment and storage medium Download PDF

Info

Publication number
CN114430482B
CN114430482B CN202210342565.2A CN202210342565A CN114430482B CN 114430482 B CN114430482 B CN 114430482B CN 202210342565 A CN202210342565 A CN 202210342565A CN 114430482 B CN114430482 B CN 114430482B
Authority
CN
China
Prior art keywords
holographic
image
information
acquisition
collecting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210342565.2A
Other languages
Chinese (zh)
Other versions
CN114430482A (en
Inventor
秦友慈
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Jida Health Medical Technology Co ltd
Original Assignee
Shenzhen Jida Health Medical Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Jida Health Medical Technology Co ltd filed Critical Shenzhen Jida Health Medical Technology Co ltd
Priority to CN202210342565.2A priority Critical patent/CN114430482B/en
Publication of CN114430482A publication Critical patent/CN114430482A/en
Application granted granted Critical
Publication of CN114430482B publication Critical patent/CN114430482B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/296Synchronisation thereof; Control thereof
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/20ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Public Health (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Databases & Information Systems (AREA)
  • Pathology (AREA)
  • Data Mining & Analysis (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Holo Graphy (AREA)

Abstract

The invention relates to the technical field of Internet of things, in particular to a holographic diagnosis system, a holographic diagnosis method, computer equipment and a storage medium, wherein the holographic diagnosis system comprises an acquisition terminal and a display terminal which are communicated with each other, the acquisition terminal is used for acquiring display information of an object and transmitting the display information to the display terminal, and the display terminal is used for displaying the display information; the acquisition terminal specifically comprises a holographic acquisition device and an image acquisition device, the holographic acquisition device acquires three-dimensional information of an object in real time, and the image acquisition device acquires local image information of the object according to user control; the display terminal comprises a holographic projection device and a plane display device which are integrally arranged, the holographic projection device displays a holographic image of an object in real time, and the plane display device displays acquired local image information in an overlapping mode on the holographic image. The invention displays three-dimensional information and plane images by superposition, combines the whole and the local and is convenient for remote diagnosis.

Description

Holographic diagnosis system, method, computer equipment and storage medium
Technical Field
The invention relates to the technical field of Internet of things, in particular to a holographic diagnosis system, a holographic diagnosis method, computer equipment and a storage medium.
Background
The holographic projection technology is a 3D stereo display technology, and records and reproduces real three-dimensional images of objects by utilizing the interference principle. Limited by the current state of the art, the holographic projection we know at ordinary times is not strictly holographic projection, but is a type of holographic projection technology that uses pepper's ghost, edge blanking, etc. to achieve 3D effect.
However, even the holographic projection technology still provides more realistic picture effect than the traditional display technology, so that the observer can feel as if he is in the scene. The existing projection technology is mostly used in scenes such as advertisements, commercial performances and the like, and has limited value.
In recent years, telemedicine has been rapidly developed, and generally, under the condition that a doctor is in a different place from a patient, diagnosis, treatment and the like are remotely realized through a series of display and remote control technologies. The telemedicine provided by the prior art uses video technology or holographic technology separately, and does not consider the problem of how to merge the two to provide more information.
Disclosure of Invention
In view of the above, it is desirable to provide a holographic diagnostic system, a method, a computer device and a storage medium for addressing the above-mentioned problems.
The embodiment of the invention is realized in such a way that the holographic diagnostic system comprises an acquisition terminal and a display terminal which are communicated with each other, wherein the acquisition terminal is used for acquiring display information of an object and transmitting the display information to the display terminal, and the display terminal is used for displaying the display information;
the acquisition terminal specifically comprises a holographic acquisition device and an image acquisition device, the holographic acquisition device acquires three-dimensional information of an object in real time, and the image acquisition device acquires local image information of the object according to user control;
the display terminal comprises a holographic projection device and a plane display device which are integrally arranged, the holographic projection device displays a holographic image of an object in real time according to acquired three-dimensional information, and the plane display device displays acquired local image information on the holographic image in an overlapping mode according to user control.
In one embodiment, the present invention provides a holographic diagnostic method applied to the holographic diagnostic system of the embodiment of the present invention, the holographic diagnostic method includes:
and (3) full mining mode:
the holographic acquisition device is driven to rotationally acquire three-dimensional information of an object within 360 degrees, and the image acquisition device is driven to acquire a local image of the object;
driving a rotary screen of the holographic projection device to rotate, and projecting the three-dimensional information of the object in the corresponding angle range on the rotary screen according to the rotation angle of the rotary screen so as to enable the rotary screen to rotate for a circle, namely completely displaying the three-dimensional information of the object in the 360-degree range once;
superposing the acquired local image on the corresponding part of the three-dimensional information through a plane display device for displaying;
a capture mode:
the method comprises the steps of operating in a full-acquisition mode, determining an observation part of a user, driving a holographic acquisition device to swing left and right in a reciprocating manner by taking the determined observed part of an object as a center according to the observation part of the user so as to acquire local three-dimensional information of the object;
driving an image acquisition device to acquire a local image of an object;
driving a rotary screen of the holographic projection device to rotate, and projecting the acquired local three-dimensional stereo information on the rotary screen when the rotary screen rotates to an angle corresponding to the observed part of the object;
and superposing the acquired local image on the corresponding part of the local three-dimensional information through a plane display device for displaying.
In one embodiment, the invention provides a computer device comprising a memory and a processor, the memory having stored therein a computer program which, when executed by the processor, causes the processor to perform the steps of the above-described holographic diagnostic method.
In one embodiment, the present invention provides a computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which, when executed by a processor, causes the processor to perform the steps of the above-mentioned holographic diagnostic method.
The three-dimensional information of the object can be acquired by arranging the holographic acquisition device, and the local characteristics of the object can be acquired by the image acquisition device; the holographic image can be displayed through the holographic projection device, and the acquired local image information can be displayed on the three-dimensional stereo image in an overlapping mode through the plane display device. According to the invention, through the combination of the three-dimensional image and the local comprehensive image, the doctor can conveniently carry out overall observation, and can diagnose the specific part according to the local image, thereby overcoming the problem that the prior art can not give consideration to the overall and the local parts.
Drawings
FIG. 1 is a block diagram of a holographic diagnostic system provided in one embodiment;
FIG. 2 is a schematic diagram of image stitching for a method of holographic diagnostic system in one embodiment;
FIG. 3 is a block diagram showing an internal configuration of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It will be understood that, as used herein, the terms "first," "second," and the like may be used herein to describe various elements, but these elements are not limited by these terms unless otherwise specified. These terms are only used to distinguish one element from another. For example, a first xx script may be referred to as a second xx script, and similarly, a second xx script may be referred to as a first xx script, without departing from the scope of the present disclosure.
As shown in fig. 1, in an embodiment, the present invention provides a holographic diagnostic system, which includes an acquisition terminal and a display terminal that are in communication with each other, where the acquisition terminal is configured to acquire display information of an object and transmit the display information to the display terminal, and the display terminal is configured to display the display information;
the acquisition terminal specifically comprises a holographic acquisition device and an image acquisition device, the holographic acquisition device acquires three-dimensional information of an object in real time, and the image acquisition device acquires local image information of the object according to user control;
the display terminal comprises a holographic projection device and a plane display device which are integrally arranged, the holographic projection device displays a holographic image of an object in real time according to acquired three-dimensional information, and the plane display device displays acquired local image information on the holographic image in an overlapping mode according to user control.
In the embodiment of the present invention, the holographic acquisition device is configured to acquire three-dimensional stereo information of an object, specifically, the information may be information that reflects a three-dimensional state of the object and is formed by images in multiple directions, and may also be a radar scan image or other types of point cloud images that reflect a distribution of the object in a three-dimensional space. It should be noted that the three-dimensional stereo information herein merely refers to three-dimensional features that are reflected by the information or used for constructing an object, and does not mean that the information itself is three-dimensional.
In the embodiment of the invention, the system further comprises an image acquisition device, the image acquisition device can acquire an image of a specific part of a target, and for a patient, the specific part can be an oral cavity, an eyeball, a face or other parts needing diagnosis; the subject of the present invention is mainly a patient, and the user or user generally refers to a doctor, a nurse, or the like.
In the embodiment of the invention, the display terminal comprises a fully automatic projection device and a plane display device, wherein the holographic projection device is used for projecting to obtain a holographic image, the plane display device is used for displaying a two-dimensional image, and the plane is only relative to the three-dimensional of the hologram, and does not mean that the displayed image is in a plane shape necessarily.
In this embodiment, the acquired partial images are displayed superimposed on the three-dimensional stereoscopic image, and it should be noted that the superimposition does not mean that the three-dimensional stereoscopic image and the planar image are displayed on the same display surface, and the present invention means that the images viewed from the observer are displayed superimposed.
The three-dimensional information of the object can be acquired by arranging the holographic acquisition device, and the local characteristics of the object can be acquired by the image acquisition device; the holographic image can be displayed through the holographic projection device, and the acquired local image information can be displayed on the three-dimensional stereo image in an overlapping mode through the plane display device. According to the invention, through the combination of the three-dimensional image and the local comprehensive image, the doctor can conveniently carry out overall observation, and can diagnose the specific part according to the local image, thereby overcoming the problem that the prior art can not give consideration to the overall and the local parts.
In one embodiment, the holographic acquisition device comprises a plurality of first acquisition heads, wherein the plurality of first acquisition heads are arranged on an annular track and rotate around an object on the annular track under an operating state so as to acquire three-dimensional stereo information of the object;
the second collecting head is arranged at the top of the central shaft of the annular track and collects the three-dimensional information of the object from top to bottom.
In this embodiment, the first collecting head may use a device having an image collecting function, such as a camera, a radar, or a high-speed camera, and the first collecting head is disposed on the circular track, moves around the circular track at a high speed, and can collect image information of an object in a range of 360 °, and a hologram can be constructed by these information systems.
In one embodiment, the first collecting heads are provided with three, and are respectively arranged on annular tracks with different heights;
in the full-collecting mode, three first collecting heads are arranged around the center of the annular track at equal angles on a top view, and simultaneously, three-dimensional information of an object in a 360-degree range is collected in a rotating mode;
in the capturing mode, in a top view, the staggered angle range of the low-position first collecting head and the high-position first collecting head is 60-180 degrees, the middle-position first collecting head is located in the middle position between the low-position first collecting head and the high-position first collecting head, and the three first collecting heads keep relative angle dynamic left and right movement to track the observed part of the object.
In this embodiment, the number of the first collecting heads is 3, and the 3 first collecting heads are arranged from bottom to top, and have different horizontal heights, for example, the central height is sequentially set to 30cm, 100cm, 170cm, and the like, and structures with heights that can be respectively adjusted may also be arranged, and the embodiment of the present invention is not specifically limited to this specific structure for implementing this adjustment manner, and for example, the height adjustment function may be implemented by using a support rail such as a telescopic rod, an air cylinder, and the like; in the embodiment, the circular tracks of the three first collecting heads have the same radius and the centers of the circles are on the same vertical line.
In this embodiment, in full pick mode, the three first pick heads are equiangularly disposed, e.g., initially at 0 °, 120 ° and 240 ° positions, respectively, and are simultaneously activated and rotated at the same speed.
In one embodiment, the image capture device is disposed inside the endless track and comprises at least one second capture head and a motion arm;
the second collecting head is arranged at the executing end of the moving arm, and the moving arm is used for driving the second collecting head to collect local image information of an object.
In this embodiment, the moving arm may adopt a mechanical arm, and may also collect an expansion joint, a universal joint, and the like; the fixed end of the moving arm is arranged on the base, and the base can be moved or fixed on the ground. When it is desired to capture images of the mouth, face, eyes, or other particular area, the patient or medical personnel may operate the second pick head to capture images of the particular area.
In one embodiment, the holographic projection device comprises a base, a projection device, and a rotating screen;
the base is in a disc shape, and the projection device and the base are relatively fixed; the included angle between the rotary screen and the horizontal plane is 30-60 degrees, the back of the rotary screen is fixed in the center of the base through a rotating shaft, and the rotary screen is driven by the rotating shaft to rotate on the base;
the projection device generates a holographic image according to the three-dimensional stereo information and projects the holographic image on the rotary screen.
In this embodiment, optionally, the projection device is disposed directly above the disc-shaped base through an Jiong-shaped bracket, and the projection device is used for projecting images. The rotary screen is arranged right below the projection device through a rotating shaft and is positioned on the disc-shaped base, and the included angle between the normal vector of the front side of the rotary screen and the horizontal plane ranges from 30 degrees to 60 degrees, preferably 45 degrees; the rotating screen can adopt a semi-permeable membrane or a plane mirror, and the display effect of the semi-permeable membrane and the plane mirror is different, but the aim of the invention can be achieved.
In this embodiment, as another optional specific implementation manner, the holographic projection apparatus includes a base and a rotary screen, a normal vector of a front surface of the rotary screen is parallel to a horizontal plane, and the rotary screen can be made of a conventional screen; it will be appreciated that display control means are also included at this point for outputting display data for the screen.
In one embodiment, the flat panel display device comprises a columnar transparent screen, wherein the columnar transparent screen is arranged on the base and surrounds the rotary screen;
the columnar transparent screen is used for displaying a local image, and a user can observe the holographic image superposed on the bottom layer of the local image through the columnar transparent screen;
the flat panel display device further comprises a sight tracking device fixed relative to the base for tracking the sight of the user to determine the position of the sight of the user on the cylindrical transparent screen.
In this embodiment, the cylindrical transparent screen can protect the rotary screen to prevent touch. Further, with the columnar transparent screen, a partial image can be displayed. For example, when the human eye observes the oral cavity part of the object displayed on the rotary screen through the transparent display screen, the partial image acquired by the second acquisition head is presented at the oral cavity position displayed on the transparent display screen, so that a doctor can observe the image inside the oral cavity for diagnosis.
In this embodiment, the display device further comprises a sight tracking device, and the sight tracking device can track the sight of a person in front of the cylindrical transparent screen, so that a local image can be displayed at an accurate position. Gaze tracking is well within the art and the present invention is not directed to improvements in this area.
In one embodiment, the present invention provides a holographic diagnostic method applied to the holographic diagnostic system according to any one of the embodiments of the present invention, the holographic diagnostic method including:
and (3) full mining mode:
the holographic acquisition device is driven to rotationally acquire three-dimensional information of an object within 360 degrees, and the image acquisition device is driven to acquire a local image of the object;
driving a rotary screen of the holographic projection device to rotate, and projecting the three-dimensional information of the object in the corresponding angle range on the rotary screen according to the rotation angle of the rotary screen so as to enable the rotary screen to rotate for a circle, namely completely displaying the three-dimensional information of the object in the 360-degree range once;
superposing the acquired local image on the corresponding part of the three-dimensional information through a plane display device for displaying;
a capture mode:
the method comprises the steps of operating in a full-acquisition mode, determining an observation part of a user, and driving a holographic acquisition device to swing left and right in a reciprocating mode by taking the determined observed part of an object as a center according to the observation part of the user so as to acquire local three-dimensional information of the object;
driving an image acquisition device to acquire a local image of an object;
driving a rotary screen of the holographic projection device to rotate, and projecting the acquired local three-dimensional stereo information on the rotary screen when the rotary screen rotates to an angle corresponding to the observed part of the object;
and superposing the acquired local image on the corresponding part of the local three-dimensional information through a plane display device for displaying.
In this embodiment, it can be understood that, when the capture mode is to be operated, the full capture mode is operated first to obtain the whole stereoscopic image of the object, and only a few observers are allowed to observe within a limited observation angle in the capture mode, which can greatly save unnecessary data acquisition, so that the data acquired by the system is all used for providing pictures for the users, and is not used for displaying back images which are not concerned by the users, thereby causing waste of resources.
In this embodiment, in the full-collecting mode, taking an object as a patient as an example, in a top view, a direction in which the patient faces is a positive X-axis direction, the low-position first collecting head collects images from a 240 ° direction toward the patient, the middle-position first collecting head collects images from a 0 ° direction toward the patient, the low-position first collecting head collects images from a 120 ° direction toward the patient, and the three first collecting heads move on the rail at a high speed to collect images of the patient. At one end of the display terminal, when the rotary screen rotates to a set X-axis positive direction (different from an X-axis of the acquisition terminal), the projection device projects an image acquired at the X-axis positive position to the rotary screen; when the rotary screen rotates to a set 90-degree position, the projection device projects the image collected at the 90-degree position to the rotary screen; and so on. Because the collecting head rotates at a high speed, and the display screen also rotates at a high speed, under a proper rotating speed, the principle that the common persistence of vision of human eyes is utilized to enable an observer to observe corresponding images at any angle of 360 degrees of the display terminal, and therefore three-dimensional display is achieved.
In this embodiment, in the capture mode, taking the subject as an example of a patient, in a top view, a direction in which the patient faces is a positive direction of an X axis, the lower-position first pick head performs image capture from a-45 ° direction toward the patient, the middle-position first pick head performs image capture from a 0 ° direction toward the patient, the lower-position first pick head performs image capture from a 45 ° direction toward the patient, when the head of the patient swings, the direction of the X axis changes accordingly, and positions of the three first pick heads on the track also change accordingly, thereby implementing dynamic tracking. At one end of the display terminal, when the rotary screen rotates to be close to the set positive direction of the X axis (for example, in a range of-90 degrees), the projection device projects the collected image to the rotary screen; when the rotary screen rotates to a set range of 90-270 degrees, the projection device does not project an image.
In one embodiment, the acquiring local three-dimensional stereo information of the object specifically includes:
dividing pictures collected by the three first collecting heads into 3 × 3 grids respectively, and adjusting the relative positions of the three first collecting heads to enable 4 grids below one side of the middle first collecting head to be overlapped with the contents of 4 grids of the lower first collecting head and 4 grids above the other side of the middle first collecting head to be overlapped with the contents of 4 grids of the upper first collecting head;
taking the middle column of the picture collected by the first middle collecting head as the middle column of the final picture;
taking two squares above the middle column of the picture acquired by the low-position first acquisition head as the content of the corresponding position of the final picture;
taking two squares below the middle column of the picture acquired by the high-position first acquisition head as the content of the corresponding position of the final picture;
and determining the contents of the rest two squares corresponding to the middle first collecting head in the final picture according to the picture collected by the middle first collecting head and the sizes of the contents in the middle row of the lower first collecting head and the upper first collecting head.
In this embodiment, as shown in fig. 2, the images captured by the lower-order first pick heads are composed of 41, 21, 22, 42, 31, 32, 43, 44, 45, the images captured by the middle-order first pick heads are composed of 11, 12, 13, 21, 22, 23, 31, 32, 33, and the images captured by the upper-order first pick heads are composed of 51, 52, 53, 12, 13, 54, 22, 23, 55. The positions of the synthesized image 12, 22 and 32 are the contents collected by the first collecting head; 21. the 31-position image takes the content collected by the lower first collecting head; 13. the 23 position takes the contents acquired by the first, higher pick head. While the 11 position takes the content picked up by the middle first pick head and rectifies that area according to the size of the content at the corresponding position (21, 31, 44) of the lower first pick head. The correction method can be as follows: an object extending from the position 21 of the image captured by the lower first pick head to the position 11 of the image captured by the middle first pick head is selected, and the region 11 is extended or compressed, depending on the position of the object in the position 21, to thereby connect particular one or more objects smoothly. Similar operations can be taken with respect to location 33, and are not described in detail herein.
In this embodiment, when images at positions 21 and 31 (and 54 and 55) are spliced with positions 22 and 32, respectively, it is necessary to adjust the vertical dimensions of the positions 21 and 31 (and 54 and 55) by the above-described correction method, but to keep the horizontal dimensions unchanged.
The image splicing method provided by the invention splices the three images by utilizing the characteristic of small image center distortion, and more truly restores a real scene.
FIG. 3 is a diagram illustrating an internal structure of a computer device in one embodiment. The computer device may be used in particular for the control of the system shown in fig. 1. As shown in fig. 3, the computer apparatus includes a processor, a memory, a network interface, an input device, and a display screen connected through a system bus. Wherein the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program, which, when executed by the processor, may cause the processor to implement the holographic diagnostic method provided by the embodiments of the present invention. The internal memory may also store a computer program, and when the computer program is executed by the processor, the computer program may cause the processor to execute the holographic diagnostic method provided by the embodiments of the present invention. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the configuration shown in fig. 3 is a block diagram of only a portion of the configuration associated with aspects of the present invention and is not intended to limit the computing devices to which aspects of the present invention may be applied, and that a particular computing device may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is proposed, the computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
and (3) full mining mode:
the holographic acquisition device is driven to rotationally acquire three-dimensional information of an object within 360 degrees, and the image acquisition device is driven to acquire a local image of the object;
driving a rotary screen of the holographic projection device to rotate, and projecting the three-dimensional information of the object in the corresponding angle range on the rotary screen according to the rotation angle of the rotary screen so as to enable the rotary screen to rotate for a circle, namely completely displaying the three-dimensional information of the object in the 360-degree range once;
superposing the acquired local image on the corresponding part of the three-dimensional information through a plane display device for displaying;
a capture mode:
the method comprises the steps of operating in a full-acquisition mode, determining an observation part of a user, and driving a holographic acquisition device to swing left and right in a reciprocating mode by taking the determined observed part of an object as a center according to the observation part of the user so as to acquire local three-dimensional information of the object;
driving an image acquisition device to acquire a local image of an object;
driving a rotary screen of the holographic projection device to rotate, and projecting the acquired local three-dimensional stereo information on the rotary screen when the rotary screen rotates to an angle corresponding to the observed part of the object;
and superposing the acquired local image on the corresponding part of the local three-dimensional information through a plane display device for displaying.
In one embodiment, a computer readable storage medium is provided, having a computer program stored thereon, which, when executed by a processor, causes the processor to perform the steps of:
and (3) full mining mode:
the holographic acquisition device is driven to rotationally acquire three-dimensional information of an object within 360 degrees, and the image acquisition device is driven to acquire a local image of the object;
driving a rotary screen of the holographic projection device to rotate, and projecting the three-dimensional information of the object in the corresponding angle range on the rotary screen according to the rotation angle of the rotary screen so as to enable the rotary screen to rotate for a circle, namely completely displaying the three-dimensional information of the object in the 360-degree range once;
superposing the acquired local image on the corresponding part of the three-dimensional information through a plane display device for displaying;
a capture mode:
the method comprises the steps of operating in a full-acquisition mode, determining an observation part of a user, and driving a holographic acquisition device to swing left and right in a reciprocating mode by taking the determined observed part of an object as a center according to the observation part of the user so as to acquire local three-dimensional information of the object;
driving an image acquisition device to acquire a local image of an object;
driving a rotary screen of the holographic projection device to rotate, and projecting the acquired local three-dimensional stereo information on the rotary screen when the rotary screen rotates to an angle corresponding to the observed part of the object;
and superposing the acquired local image on the corresponding part of the local three-dimensional information through a plane display device for displaying.
It should be understood that, although the steps in the flowcharts of the embodiments of the present invention are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of steps in various embodiments may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed alternately or alternatingly with other steps or at least a portion of sub-steps or stages of other steps.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. Any reference to memory, storage, databases, or other media used in embodiments provided herein may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (10)

1. The holographic diagnosis system is characterized by comprising an acquisition terminal and a display terminal which are communicated with each other, wherein the acquisition terminal is used for acquiring display information of an object and transmitting the display information to the display terminal, and the display terminal is used for displaying the display information;
the acquisition terminal specifically comprises a holographic acquisition device and an image acquisition device, the holographic acquisition device acquires three-dimensional information of an object in real time, and the image acquisition device acquires local image information of the object according to user control;
the display terminal comprises a holographic projection device and a plane display device which are integrally arranged, the holographic projection device displays a holographic image of an object in real time according to acquired three-dimensional information, and the plane display device displays acquired local image information on the holographic image in an overlapping mode according to user control.
2. The holographic diagnostic system of claim 1, wherein the holographic acquisition device comprises a plurality of first acquisition heads disposed on an endless track on which the holographic acquisition head is operatively rotated around the object to acquire three-dimensional volumetric information of the object;
the second collecting head is arranged at the top of the central shaft of the annular track and collects the three-dimensional information of the object from top to bottom.
3. The holographic diagnostic system of claim 2, wherein the first pick head is provided in three, respectively arranged on circular tracks having different heights;
in the full-collecting mode, three first collecting heads are arranged around the center of the annular track at equal angles on a top view, and simultaneously, three-dimensional information of an object in a 360-degree range is collected in a rotating mode;
in the capturing mode, in a top view, the staggered angle range of the low-position first collecting head and the high-position first collecting head is 60-180 degrees, the middle-position first collecting head is located in the middle position between the low-position first collecting head and the high-position first collecting head, and the three first collecting heads keep relative angle dynamic left and right movement to track the observed part of the object.
4. The holographic diagnostic system of claim 2, wherein the image capture device is disposed inside the endless track, comprising at least one second capture head and a motion arm;
the second collecting head is arranged at the executing end of the moving arm, and the moving arm is used for driving the second collecting head to collect local image information of an object.
5. The holographic diagnostic system of any of claims 1 to 4, wherein the holographic projection device comprises a base, a projection device, and a rotating screen;
the base is in a disc shape, and the projection device and the base are relatively fixed; the included angle between the rotary screen and the horizontal plane is 30-60 degrees, the back surface of the rotary screen is fixed in the center of the base through a rotating shaft, and the rotary screen is driven by the rotating shaft to rotate on the base;
the projection device generates a holographic image according to the three-dimensional stereo information and projects the holographic image on the rotary screen.
6. The holographic diagnostic system of claim 5, wherein the flat display device comprises a cylindrical transparent screen disposed on the base surrounding the rotating screen;
the columnar transparent screen is used for displaying a local image, and a user can observe the holographic image superposed on the bottom layer of the local image through the columnar transparent screen;
the flat panel display device further comprises a sight tracking device fixed relative to the base for tracking the sight of the user to determine the position of the sight of the user on the cylindrical transparent screen.
7. A holographic diagnostic method applied to the holographic diagnostic system according to any one of claims 1 to 6, wherein the holographic diagnostic method comprises:
and (3) full mining mode:
the holographic acquisition device is driven to rotationally acquire three-dimensional information of an object within 360 degrees, and the image acquisition device is driven to acquire a local image of the object;
driving a rotary screen of the holographic projection device to rotate, and projecting the three-dimensional information of the object in the corresponding angle range on the rotary screen according to the rotation angle of the rotary screen so as to enable the rotary screen to rotate for a circle, namely completely displaying the three-dimensional information of the object in the 360-degree range once;
superposing the acquired local image on the corresponding part of the three-dimensional information through a plane display device for displaying;
a capture mode:
the method comprises the steps of operating in a full-acquisition mode, determining an observation part of a user, and driving a holographic acquisition device to swing left and right in a reciprocating mode by taking the determined observed part of an object as a center according to the observation part of the user so as to acquire local three-dimensional information of the object;
driving an image acquisition device to acquire a local image of an object;
driving a rotating screen of the holographic projection device to rotate, and projecting the acquired local three-dimensional stereo information onto the rotating screen when the rotating screen rotates to an angle corresponding to an observed part of an object;
and superposing the acquired local image on the corresponding part of the local three-dimensional information through a plane display device for displaying.
8. The holographic diagnostic method of claim 7, wherein acquiring local three-dimensional volumetric information of the object specifically comprises:
dividing pictures collected by the three first collecting heads into 3 × 3 grids respectively, and adjusting the relative positions of the three first collecting heads to enable 4 grids below one side of the middle first collecting head to be overlapped with the contents of 4 grids of the lower first collecting head and 4 grids above the other side of the middle first collecting head to be overlapped with the contents of 4 grids of the upper first collecting head;
taking the middle column of the picture collected by the first middle collecting head as the middle column of the final picture;
taking two squares above the middle column of the picture acquired by the low-position first acquisition head as the content of the corresponding position of the final picture;
taking two squares below the middle column of the picture acquired by the high-position first acquisition head as the content of the corresponding position of the final picture;
and determining the contents of the rest two squares corresponding to the middle first collecting head in the final picture according to the picture collected by the middle first collecting head and the sizes of the contents in the middle row of the lower first collecting head and the upper first collecting head.
9. A computer arrangement, characterized by a memory and a processor, the memory having stored therein a computer program which, when executed by the processor, causes the processor to carry out the steps of the holographic diagnostic method of any of claims 7 to 8.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, causes the processor to carry out the steps of the holographic diagnostic method of any of the claims 7 to 8.
CN202210342565.2A 2022-04-02 2022-04-02 Holographic diagnosis system, method, computer equipment and storage medium Active CN114430482B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210342565.2A CN114430482B (en) 2022-04-02 2022-04-02 Holographic diagnosis system, method, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210342565.2A CN114430482B (en) 2022-04-02 2022-04-02 Holographic diagnosis system, method, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN114430482A CN114430482A (en) 2022-05-03
CN114430482B true CN114430482B (en) 2022-08-05

Family

ID=81314239

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210342565.2A Active CN114430482B (en) 2022-04-02 2022-04-02 Holographic diagnosis system, method, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114430482B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0754987A2 (en) * 1995-07-18 1997-01-22 Dai Nippon Printing Co., Ltd. Subject plate for recording holograms, hologram-making method, and hologram-recorded article
WO2019156409A1 (en) * 2018-02-12 2019-08-15 유재희 Floating hologram display device using multilayered display faces and multiple image generation method therefor
CN110169821A (en) * 2019-04-29 2019-08-27 博瑞生物医疗科技(深圳)有限公司 A kind of image processing method, apparatus and system
CN110367912A (en) * 2019-07-12 2019-10-25 深圳先进技术研究院 A kind of endoscope and endoscopic system
US10699124B1 (en) * 2019-09-09 2020-06-30 Ar, Llc Augmented reality content selection and display based on printed objects having security features
WO2020136178A2 (en) * 2018-12-28 2020-07-02 Okcu Burhanettin Holographic viewing device
CN113256791A (en) * 2021-05-24 2021-08-13 南开大学 Holographic augmented reality assisted human-computer interaction diagnosis and treatment system in surgical operation

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4548680B2 (en) * 1999-04-12 2010-09-22 大日本印刷株式会社 Color hologram display and method for producing the same
US6844948B2 (en) * 2002-03-27 2005-01-18 Rabbit Tanaka Corporation Limited Integral hologram revolving lamp and method for making same
DE102005005687A1 (en) * 2005-02-08 2006-08-17 Siemens Ag Magnetic resonance equipment for treating intra luminal pathologies of gastro intestinal tract, has image recording unit recording raw data containing perfusion information and/or angiographic information of identified abnormality
CN101529475B (en) * 2006-10-17 2013-12-25 皇家飞利浦电子股份有限公司 Visualization of 3D images in combination with 2D projection images
US20140037049A1 (en) * 2012-07-31 2014-02-06 General Electric Company Systems and methods for interventional imaging
KR101326294B1 (en) * 2012-12-31 2013-11-11 김현정 Three dimensions decoration
GB2517069B (en) * 2014-06-23 2015-09-02 Liang Kong Autostereoscopic virtual reality platform
US10503120B2 (en) * 2016-07-15 2019-12-10 Disney Enterprises, Inc. Three-dimensional display with augmented holograms
US10796430B2 (en) * 2018-04-24 2020-10-06 General Electric Company Multimodality 2D to 3D imaging navigation

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0754987A2 (en) * 1995-07-18 1997-01-22 Dai Nippon Printing Co., Ltd. Subject plate for recording holograms, hologram-making method, and hologram-recorded article
WO2019156409A1 (en) * 2018-02-12 2019-08-15 유재희 Floating hologram display device using multilayered display faces and multiple image generation method therefor
WO2020136178A2 (en) * 2018-12-28 2020-07-02 Okcu Burhanettin Holographic viewing device
CN110169821A (en) * 2019-04-29 2019-08-27 博瑞生物医疗科技(深圳)有限公司 A kind of image processing method, apparatus and system
CN110367912A (en) * 2019-07-12 2019-10-25 深圳先进技术研究院 A kind of endoscope and endoscopic system
US10699124B1 (en) * 2019-09-09 2020-06-30 Ar, Llc Augmented reality content selection and display based on printed objects having security features
CN113256791A (en) * 2021-05-24 2021-08-13 南开大学 Holographic augmented reality assisted human-computer interaction diagnosis and treatment system in surgical operation

Also Published As

Publication number Publication date
CN114430482A (en) 2022-05-03

Similar Documents

Publication Publication Date Title
US11869205B1 (en) Techniques for determining a three-dimensional representation of a surface of an object from a set of images
US10859840B2 (en) Graphics rendering method and apparatus of virtual reality
CN102959616B (en) Interactive reality augmentation for natural interaction
CN104079918A (en) Panoramic three dimensional camera shooting device
JP2018523321A (en) A set of virtual glasses to see the actual scene, correcting the position of the lens different from the eye
JP2004514951A (en) Spherical stereoscopic imaging system and method
CN101581874B (en) Tele-immersion teamwork device based on multi-camera acquisition
US6836286B1 (en) Method and apparatus for producing images in a virtual space, and image pickup system for use therein
CN205195880U (en) Watch equipment and watch system
JP4406824B2 (en) Image display device, pixel data acquisition method, and program for executing the method
CN107368192A (en) The outdoor scene observation procedure and VR glasses of VR glasses
CN111954896B (en) Light field image generation system, image display system, shape information acquisition server, image generation server, display device, light field image generation method, and image display method
CN101021669A (en) Whole-view field imaging and displaying method and system
WO2004068865A1 (en) Steroscopic panoramic image capture device
WO2018027110A1 (en) Virtual window
CN103916653A (en) 3d Image Apparatus And Method For Displaying Images
JP6752425B2 (en) Shooting device
AU2018390994B2 (en) Camera projection technique system and method
WO2012108187A1 (en) Device and method for generation of image for 3d vision, and programme
CN115769592A (en) Image acquisition method, image acquisition device, electronic device, and medium
CN114430482B (en) Holographic diagnosis system, method, computer equipment and storage medium
CN105138130B (en) Strange land is the same as information interchange indicating means and system in scene
US20240297962A1 (en) Display control device, display control method, and recording medium
CN206523738U (en) Optical imaging device bearing support
CN206523698U (en) Panoramic scanning device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant