CN114866761A - Holographic light field projection method, device and equipment - Google Patents

Holographic light field projection method, device and equipment Download PDF

Info

Publication number
CN114866761A
CN114866761A CN202210788236.0A CN202210788236A CN114866761A CN 114866761 A CN114866761 A CN 114866761A CN 202210788236 A CN202210788236 A CN 202210788236A CN 114866761 A CN114866761 A CN 114866761A
Authority
CN
China
Prior art keywords
light field
projected
field image
image information
projection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210788236.0A
Other languages
Chinese (zh)
Inventor
王占奎
孟凡华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Daai Holographic Beijing Technology Co ltd
Original Assignee
Daai Holographic Beijing Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Daai Holographic Beijing Technology Co ltd filed Critical Daai Holographic Beijing Technology Co ltd
Priority to CN202210788236.0A priority Critical patent/CN114866761A/en
Publication of CN114866761A publication Critical patent/CN114866761A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/363Image reproducers using image projection screens
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00Projectors or projection-type viewers; Accessories therefor
    • G03B21/14Details
    • G03B21/142Adjusting of projection optics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/388Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141Constructional details thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179Video signal processing therefor

Abstract

The embodiment of the application relates to the field of image display, and discloses a holographic light field projection method, a holographic light field projection device and equipment. The embodiment of the application relates to a holographic light field projection method, which comprises the following steps: acquiring at least one light field image information of an object to be projected; constructing a volume video corresponding to the object to be projected according to at least one light field image information corresponding to the object to be projected; and projecting the volume video to a preset display area to present an image with a three-dimensional display effect of the object to be projected, wherein the preset display area is an independent and complete display area. Therefore, when the light field image information of the target object changes, the corresponding volume video also changes, and the latest state corresponding to the target object can be timely transmitted to the client. On the other hand, the projection information of the target object is transmitted in a volume video mode and is projected into an independent and complete display area, so that the problem that the integrity of the picture is damaged due to the traditional splicing technology is solved, and the user experience is improved.

Description

Holographic light field projection method, device and equipment
Technical Field
The embodiment of the invention relates to the field of image display, in particular to a holographic light field projection method, a device and equipment.
Background
The holographic light field projection technology is based on the interference and diffraction principle of light, uses corresponding image acquisition equipment to record two-dimensional image information of an object to be projected, combines a mirror moving technology to process a two-dimensional image into a three-dimensional display effect, and finally presents the three-dimensional image to a user through a corresponding receiving screen. In actual life, the holographic light field projection is usually used for exhibiting the articles, so that when a user acquires an image corresponding to an exhibited article, the user can feel more intuitively on the corresponding article, and better visual experience is obtained.
However, in the conventional holographic light field projection scheme, an image or corresponding light wave information needs to be recorded in advance on an article to be projected, and then mirror operation processing and imaging are performed according to the recorded information. Thus, the latest state of the item to be projected cannot be displayed to the client in real time. On the other hand, because the receiving screens required by the current holographic light field projection are all electronic screens, and the size requirement is large, a plurality of electronic screens are required to be obtained by adopting a splicing technology, so that the projection picture can be influenced by a screen splicing gap, the picture integrity is damaged, and the user experience is reduced.
Disclosure of Invention
The embodiment of the application provides a holographic optical field projection method, a holographic optical field projection device and equipment, and aims to solve the problems that real-time projection cannot be carried out in the conventional holographic optical field projection and the integrity of images of splicing gaps of an electronic screen is caused.
In a first aspect, an embodiment of the present application provides a holographic light field projection method, where the method includes:
acquiring at least one light field image information of an object to be projected, wherein the at least one light field image information is respectively obtained by at least one light field image capturing device which is deployed in advance, and the at least one light field image capturing device is respectively arranged at different directions of the object to be projected;
constructing a volume video corresponding to the object to be projected according to at least one light field image information corresponding to the object to be projected;
and projecting the volume video to a preset display area to present an image with a three-dimensional display effect of the object to be projected, wherein the preset display area is an independent and complete display area.
In some possible embodiments, the light field image information comprises at least one of: light intensity, light projection position, and light distribution direction. In this way, color information and depth information of the object to be projected can be obtained, and an image of a three-dimensional display effect for a volumetric video can be constructed therefrom.
In some possible embodiments, after constructing the volumetric video corresponding to the object to be projected, the holographic light field projection method further includes:
and sending the volume video to at least one different-place projection device, so that each of the at least one different-place projection device receives the volume video corresponding to the object to be projected, and the volume video corresponding to the object to be projected is projected to a preset different-place projection area, wherein the preset different-place projection area is an independent and complete display area. Therefore, the synchronous transmission of the objects to be projected on equipment at a plurality of different places can be realized.
In some possible embodiments, the method for constructing the volume video corresponding to the projection object includes:
acquiring light field image information of an object to be projected;
generating a three-dimensional model sequence set according to the light field image information of the object to be projected, wherein each three-dimensional model sequence set comprises at least one three-dimensional model;
and arranging the three-dimensional model sequence set to obtain a volume video corresponding to the object to be projected. Therefore, the real-time light field image of the object to be projected is associated with the projection image output to the display area, and the real-time projection of the object to be projected is realized.
In some possible embodiments, the generating a three-dimensional model sequence set according to the light field image information of the object to be projected is implemented by at least one volume video capture device deployed in advance, and the at least one volume video capture device is respectively disposed at different orientations of the object to be projected. In this way, the corresponding color information and depth information of each object to be projected can be captured, thereby improving the quality of the projected image output to the display area.
In some possible embodiments, the generating a set of three-dimensional model sequences according to the light field image information of the object to be projected is implemented by a feature transformation relationship preset in the at least one volumetric video capture device. In this way, the projection image output to the display area can be adjusted as needed.
In some possible embodiments, the sending the volumetric video to at least one offsite projection device is accomplished through a pre-deployed communication port. Thus, the remote transmission of the holographic light field projection can be realized.
In a second aspect, embodiments of the present application further provide a holographic light field projection apparatus, the apparatus including:
the system comprises an acquisition module, a projection module and a display module, wherein the acquisition module is used for acquiring at least one light field image information of an object to be projected, the at least one light field image information is respectively obtained by at least one light field image capturing device which is deployed in advance, and the at least one light field image capturing device is respectively arranged at different directions of the object to be projected;
the processing module is used for constructing a volume video corresponding to the object to be projected according to at least one light field image information corresponding to the object to be projected;
and the output module is used for projecting the volume video to a preset display area so as to present an image with a three-dimensional display effect of the object to be projected, and the preset display area is an independent and complete display area.
In a third aspect, an embodiment of the present application further provides an electronic device, where the electronic device includes: a memory and a processor, the memory and the processor being communicatively connected to each other, the memory having stored therein computer instructions, the processor performing the method of the first aspect or any of the possible embodiments of the first aspect by executing the computer instructions.
In a fourth aspect, the present application further provides a computer-readable storage medium, where computer instructions are stored, and the computer instructions are configured to cause the computer to execute the method in the first aspect or any possible implementation manner of the first aspect.
The embodiment of the application provides a technical scheme of a holographic light field projection method, and in the scheme, at least one piece of light field image information of an object to be projected is obtained firstly, the at least one piece of light field image information is obtained by at least one piece of light field image capturing equipment which is deployed in advance, and the at least one piece of light field image capturing equipment is arranged in different directions of the object to be projected respectively; then, according to at least one light field image information corresponding to the object to be projected, a volume video corresponding to the object to be projected is constructed; and finally, projecting the volume video to a preset display area to present an image with a three-dimensional display effect of the object to be projected, wherein the preset display area is an independent and complete display area. On one hand, the volume video describes a three-dimensional space scene through three-dimensional image information, so that a three-dimensional space feeling is not required to be given to two-dimensional image information of a target object by combining a mirror moving technology in the technical scheme of the application, and when light field image information of the target object changes, the corresponding volume video also changes, so that the latest state corresponding to the target object can be timely transmitted to a client. On the other hand, the projection information of the target object is transmitted in a volume video mode and is projected into an independent and complete display area, so that the problem that the integrity of the picture is damaged due to the traditional splicing technology is solved, and the user experience is improved.
Drawings
FIG. 1 is a schematic flow chart of a holographic light field projection method provided by an embodiment of the present application;
FIG. 2a is a schematic diagram of an image acquisition mode of a holographic light field projection method provided in an embodiment of the present application;
FIG. 2b is a schematic projection diagram of a holographic light field projection method provided by an embodiment of the present application;
FIG. 3 is a schematic structural diagram of a holographic light field projection apparatus provided in an embodiment of the present application;
FIG. 4 is a schematic diagram of an exemplary structure of a holographic light field projection apparatus provided by an embodiment of the present application.
Detailed Description
The terminology used in the following examples of the present application is for the purpose of describing alternative embodiments and is not intended to be limiting of the present application. As used in the specification of the present application and the appended claims, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well. It should also be understood that although the terms first, second, etc. may be used in the following embodiments to describe a class of objects, the objects are not limited to these terms. These terms are used to distinguish between particular objects of that class of objects. For example, the following embodiments may adopt the terms first, second, etc. to describe other class objects in the same way, and are not described herein again.
The embodiment of the application provides a technical scheme of a holographic light field projection method, and in the scheme, at least one piece of light field image information of an object to be projected is obtained firstly, the at least one piece of light field image information is obtained by at least one piece of light field image capturing equipment which is deployed in advance, and the at least one piece of light field image capturing equipment is arranged in different directions of the object to be projected respectively; then, according to at least one light field image information corresponding to the object to be projected, a volume video corresponding to the object to be projected is constructed; and finally, projecting the volume video to a preset display area to present an image with a three-dimensional display effect of the object to be projected, wherein the preset display area is an independent and complete display area. On one hand, the volume video describes a three-dimensional space scene through three-dimensional image information, so that a three-dimensional space feeling is not required to be given to two-dimensional image information of a target object by combining a mirror moving technology in the technical scheme of the application, and when light field image information of the target object changes, the corresponding volume video also changes, so that the latest state corresponding to the target object can be timely transmitted to a client. On the other hand, the projection information of the target object is transmitted in a volume video mode and is projected into an independent and complete display area, so that the problem that the integrity of the picture is damaged due to the traditional splicing technology is solved, and the user experience is improved.
Any electronic device related to the embodiments of the present application may be an electronic device such as a mobile phone, a tablet computer, a wearable device (e.g., a smart watch, a smart bracelet, etc.), a notebook computer, a desktop computer, and an in-vehicle device. The electronic device is preinstalled with a software deployment application. It is understood that the embodiment of the present application does not set any limit to the specific type of the electronic device.
The holographic light field projection technology is based on the interference and diffraction principle of light, uses corresponding image acquisition equipment to record two-dimensional image information of an object to be projected, combines a mirror moving technology to process a two-dimensional image into a three-dimensional display effect, and finally presents the three-dimensional image to a user through a corresponding receiving screen. In actual life, the holographic light field projection is usually used for exhibiting the articles, so that when a user acquires an image corresponding to an exhibited article, the user can feel more intuitively on the corresponding article, and better visual experience is obtained.
However, in the conventional holographic light field projection scheme, an image or corresponding light wave information needs to be recorded in advance on an article to be projected, and then mirror operation processing and imaging are performed according to the recorded information. Thus, the latest state of the item to be projected cannot be displayed to the client in real time. On the other hand, because the receiving screens required by the current holographic light field projection are all electronic screens, and the size requirement is large, a plurality of electronic screens are required to be obtained by adopting a splicing technology, so that the projection picture can be influenced by a screen splicing gap, the picture integrity is damaged, and the user experience is reduced.
The following is a description of several exemplary embodiments, and the technical solutions of the embodiments of the present application and the technical effects produced by the technical solutions of the present application will be explained.
In a first aspect of the present application, a holographic light field projection method is provided, referring to fig. 1, where fig. 1 is a schematic flow chart of the holographic light field projection method provided in an embodiment of the present application, and includes the following steps:
acquiring at least one light field image information of an object to be projected, wherein the at least one light field image information is respectively obtained by at least one light field image capturing device which is deployed in advance, and the at least one light field image capturing device is respectively arranged at different directions of the object to be projected;
constructing a volume video corresponding to the object to be projected according to at least one light field image information corresponding to the object to be projected;
and projecting the volume video to a preset display area to present an image with a three-dimensional display effect of the object to be projected, wherein the preset display area is an independent and complete display area.
Optionally, the light field image information includes at least one of: light intensity, light projection position, and light distribution direction.
Generally, the holographic light field projection technology includes three parts, namely, image acquisition, image processing and image transmission, wherein the image acquisition is to acquire related image information of the object to be projected through a pre-deployed image acquisition device, and the acquisition content includes the light field image information and/or related color information and depth information corresponding to the object to be projected;
the image processing is to process the acquired image information or light wave information, and because the acquired image has more two-dimensional image information in the image acquisition process, the image processing needs to be performed by combining a corresponding mirror moving technology in order to enable the two-dimensional image information to have the display effect of a three-dimensional image;
and image transmission, namely, transmitting the relevant information after image processing to projection equipment, and outputting and watching.
In a possible implementation manner, the image capturing manner for the object to be projected can be applied to an article display live broadcast scene, specifically as shown in fig. 2a, wherein A, B, C and D are light field image capturing devices distributed around the object to be projected at different angles, and the light field image capturing devices are used to obtain light field image information of the object to be projected. The captured light field image information may specifically include color information (e.g., surface pixel information and reflected light path information of corresponding angles, etc.) and depth information (e.g., spatial location information, etc.) of the object to be projected.
Further, these light field image capture devices may be optionally light field cameras. The light field camera is an application combined with a light field technology, only a composition process is needed during photographing, a focusing process is not needed, and subsequently collected light field image information can be adjusted according to requirements through corresponding focusing software. Specifically, in a conventional camera (e.g., a digital camera product in the market at the present time), a lens of the conventional camera captures light, and the light is focused on a film or a sensor behind the lens, so that the sum of all the light forms a pixel point for enjoying a photo, thereby displaying an image. However, in the light field camera, a microscope array of a plurality of micro lenses is arranged between a main lens and a photoreceptor, each small array receives light from the main lens and then transmits the light to the photoreceptor, focused light is separated out and light information is converted to be recorded as digital information, and tracking and adjusting (namely point-to-point focusing) of the digital information corresponding to each light can be realized through operating software built in the camera.
Optionally, after the light field image information of the object to be projected is obtained, the volume video corresponding to the object to be projected is constructed according to at least one light field image information corresponding to the object to be projected, which specifically includes:
acquiring light field image information of an object to be projected;
generating a three-dimensional model sequence set according to the light field image information of the object to be projected, wherein each three-dimensional model sequence set comprises at least one three-dimensional model;
and arranging the three-dimensional model sequence set to obtain a volume video corresponding to the object to be projected.
Optionally, as shown in fig. 2a, volume video acquisition devices a and b are further disposed around the object to be projected, and are configured to construct a volume video corresponding to the object to be projected according to at least one light field image information corresponding to the object to be projected.
Furthermore, the volume video acquisition equipment can adopt an RGB depth induction camera and a high-precision industrial camera. The volume video is a technology for generating a corresponding three-dimensional model sequence by capturing corresponding information (color information, depth information and the like) of a captured object in a three-dimensional space and combining corresponding feature transformation relations (such as a distortion correction matrix and the like), and the three-dimensional models are arranged to form a video format which can be viewed from any visual angle.
Optionally, the light field image capturing device and the volume video capturing device which are disposed around the object to be projected adjust the placement positions through corresponding fixing structures, such as the first direction fixing component and the second direction fixing component in fig. 2a, where the first direction and the second direction may be adjusted according to actual requirements.
In a possible implementation manner, after the volume video corresponding to the object to be projected is constructed, the method further includes an image transmission process, specifically including: and projecting the volume video to a preset display area to present an image with a three-dimensional display effect of the object to be projected, wherein the preset display area is an independent and complete display area.
Optionally, the volume video corresponding to the object to be projected is obtained through construction, and the essence of the volume video belongs to video information, and the volume video can be transmitted through a corresponding communication port, and a specific transmission mode can be realized through a pre-deployed communication port, for example, a 5G port.
Optionally, as shown in fig. 2b, after the projection device receives the volume video through the pre-deployed communication port, the projecting operation performed on the volume video specifically includes: and outputting the projection light to a preset display area, wherein the preset display area is an independent and complete display area.
Optionally, the specific form of the preset display area includes: projection cloth, projection board and wall.
In a possible implementation manner, after constructing the volumetric video corresponding to the object to be projected, the holographic light field projection method further includes:
and sending the volume video to at least one different-place projection device, so that each of the at least one different-place projection device receives the volume video corresponding to the object to be projected, and the volume video corresponding to the object to be projected is projected to a preset different-place projection area, wherein the preset different-place projection area is an independent and complete display area.
Specifically, firstly, the volume video information is transmitted to a projection device at a different place through a pre-deployed communication port, and then the projection device at the different place is released to a display area preset at the different place according to a corresponding release demand. It is understood that the specific form of the display area preset at the different place may also include: projection cloth, projection board and wall.
Optionally, the application scenario of the above technical solution is not limited to the application scenario of article display, and the above technical solution is also applicable to other application scenarios, for example: and (5) carrying out remote collaborative design.
Illustratively, after the projection of the object to be projected is obtained by using the scheme, the projection information is transmitted to the enterprise research and development test system in different places through 5G data transmission, and in the process, the projection information can be combined with the corresponding virtual reality technology, so that the user in different places can correspondingly process and analyze the received projection information,
the specific scenes comprise: and (4) carrying out cross-region online cooperative operation on the projection object and the like by scientific researchers.
The foregoing embodiments describe various implementation manners of the holographic light field projection method provided in the embodiments of the present application in terms of obtaining light field image information of an object to be projected, constructing a volume video, projecting the volume video, and the like. It should be understood that, in the embodiments of the present application, the above functions may be implemented in hardware or a combination of hardware and computer software in the processing steps of obtaining light field image information of an object to be projected, constructing a volume video, and projecting the volume video. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
For example, if the above implementation steps implement the corresponding functions through software modules. As shown in fig. 3, the holographic light field projection apparatus may include an acquisition module, a processing module, and an output module. The holographic light field projection device can be used for executing part or all of the operations of the holographic light field projection method.
For example:
the system comprises an acquisition module, a projection module and a display module, wherein the acquisition module is used for acquiring at least one light field image information of an object to be projected, the at least one light field image information is respectively obtained by at least one light field image capturing device which is deployed in advance, and the at least one light field image capturing device is respectively arranged at different directions of the object to be projected;
the processing module is used for constructing a volume video corresponding to the object to be projected according to at least one light field image information corresponding to the object to be projected;
and the output module is used for projecting the volume video to a preset display area so as to present an image with a three-dimensional display effect of the object to be projected, and the preset display area is an independent and complete display area.
As can be seen from this, it is,
the embodiment of the application provides a technical scheme of a holographic light field projection method, and in the scheme, at least one piece of light field image information of an object to be projected is obtained firstly, the at least one piece of light field image information is obtained by at least one piece of light field image capturing equipment which is deployed in advance, and the at least one piece of light field image capturing equipment is arranged in different directions of the object to be projected respectively; then, according to at least one light field image information corresponding to the object to be projected, a volume video corresponding to the object to be projected is constructed; and finally, projecting the volume video to a preset display area to present an image with a three-dimensional display effect of the object to be projected, wherein the preset display area is an independent and complete display area. On one hand, the volume video describes a three-dimensional space scene through three-dimensional image information, so that a three-dimensional space feeling is not required to be given to two-dimensional image information of a target object by combining a mirror moving technology in the technical scheme of the application, and when light field image information of the target object changes, the corresponding volume video also changes, so that the latest state corresponding to the target object can be timely transmitted to a client. On the other hand, the projection information of the target object is transmitted in a volume video mode and is projected into an independent and complete display area, so that the problem that the integrity of the picture is damaged due to the traditional splicing technology is solved, and the user experience is improved.
It is understood that the functions of the above modules may be implemented by integrating into a hardware entity, for example, the obtaining module may be implemented by integrating into a transceiver, the processing module and the output module may be implemented by integrating into a processor, and the programs and instructions for implementing the functions of the above modules may be maintained in a memory. As shown in fig. 4, an electronic device is provided, where the electronic device includes a processor, a transceiver and a memory, where the transceiver is configured to execute learning result acquisition corresponding to target reference information and each piece of encoding information in a disease species identification method based on multiple pieces of information, and the memory is configured to store a program/code preinstalled by the aforementioned deployment apparatus, and may also store a code for execution by the processor, etc. When the processor executes the codes stored in the memory, the electronic device is caused to execute part or all of the operations of the software deployment method in the method.
The specific process is described in the above embodiments of the method, and is not described in detail here.
In a specific implementation, corresponding to the foregoing electronic device, an embodiment of the present application further provides a computer storage medium, where the computer storage medium disposed in the electronic device may store a program, and when the program is executed, part or all of the steps in each embodiment of the software deployment method may be implemented. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a Random Access Memory (RAM), or the like.
One or more of the above modules or units may be implemented in software, hardware or a combination of both. When any of the above modules or units are implemented in software, which is present as computer program instructions and stored in a memory, a processor may be used to execute the program instructions and implement the above method flows. The processor may include, but is not limited to, at least one of: various computing devices that run software, such as a Central Processing Unit (CPU), a microprocessor, a Digital Signal Processor (DSP), a Microcontroller (MCU), or an artificial intelligence processor, may each include one or more cores for executing software instructions to perform operations or processing. The processor may be built in an SoC (system on chip) or an Application Specific Integrated Circuit (ASIC), or may be a separate semiconductor chip. The processor may further include a necessary hardware accelerator such as a Field Programmable Gate Array (FPGA), a PLD (programmable logic device), or a logic circuit for implementing a dedicated logic operation, in addition to a core for executing software instructions to perform an operation or a process.
When the above modules or units are implemented in hardware, the hardware may be any one or any combination of a CPU, a microprocessor, a DSP, an MCU, an artificial intelligence processor, an ASIC, an SoC, an FPGA, a PLD, a dedicated digital circuit, a hardware accelerator, or a discrete device that is not integrated, which may run necessary software or is independent of software to perform the above method flows.
Further, a bus interface may also be included in FIG. 4, which may include any number of interconnected buses and bridges, with one or more processors, represented by a processor, and various circuits of memory, represented by memory, linked together. The bus interface may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface. The transceiver provides a means for communicating with various other apparatus over a transmission medium. The processor is responsible for managing the bus architecture and the usual processing, and the memory may store data used by the processor in performing operations.
When the above modules or units are implemented using software, they may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It should be understood that, in the various embodiments of the present application, the size of the serial number of each process does not mean the execution sequence, and the execution sequence of each process should be determined by the function and the inherent logic thereof, and should not constitute any limitation to the implementation process of the embodiments.
All parts of the specification are described in a progressive mode, the same and similar parts of all embodiments can be referred to each other, and each embodiment is mainly introduced to be different from other embodiments. In particular, as to the apparatus and system embodiments, since they are substantially similar to the method embodiments, the description is relatively simple and reference may be made to the description of the method embodiments in relevant places.
While alternative embodiments of the present application have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.
The above-mentioned embodiments, objects, technical solutions and advantages of the present application are further described in detail, it should be understood that the above-mentioned embodiments are only examples of the present application, and are not intended to limit the scope of the present application, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the present application should be included in the scope of the present invention.

Claims (10)

1. A holographic light field projection method, characterized in that the method comprises:
acquiring at least one light field image information of an object to be projected, wherein the at least one light field image information is respectively obtained by at least one light field image capturing device which is deployed in advance, and the at least one light field image capturing device is respectively arranged at different directions of the object to be projected;
constructing a volume video corresponding to the object to be projected according to at least one light field image information corresponding to the object to be projected;
and projecting the volume video to a preset display area to present an image with a three-dimensional display effect of the object to be projected, wherein the preset display area is an independent and complete display area.
2. The holographic light field projection method according to claim 1, characterized in that the light field image information comprises at least one of: light intensity, light projection position, and light distribution direction.
3. The holographic light field projection method according to claim 1, wherein after constructing the volumetric video corresponding to the object to be projected, the holographic light field projection method further comprises:
and sending the volume video to at least one different-place projection device, so that each of the at least one different-place projection device receives the volume video corresponding to the object to be projected, and the volume video corresponding to the object to be projected is projected to a preset different-place projection area, wherein the preset different-place projection area is an independent and complete display area.
4. The holographic light field projection method according to claim 1, wherein said constructing a volumetric video corresponding to said projected object, comprises:
acquiring light field image information of an object to be projected;
generating a three-dimensional model sequence set according to the light field image information of the object to be projected, wherein each three-dimensional model sequence set comprises at least one three-dimensional model;
and arranging the three-dimensional model sequence set to obtain a volume video corresponding to the object to be projected.
5. The holographic light field projection method according to claim 4, wherein the generating a three-dimensional model sequence set according to the light field image information of the object to be projected is implemented by at least one volume video capture device deployed in advance, and the at least one volume video capture device is respectively disposed at different orientations of the object to be projected.
6. The holographic light field projection method according to claim 4 or 5, wherein said generating a set of three-dimensional model sequences based on the light field image information of the object to be projected is implemented by a feature transformation relationship preset in the at least one volumetric video capture device.
7. The holographic light field projection method of claim 3, wherein said sending the volumetric video to at least one displaced projection device is accomplished through a pre-deployed communication port.
8. A holographic light field projection apparatus, characterized in that the apparatus comprises:
the system comprises an acquisition module, a projection module and a display module, wherein the acquisition module is used for acquiring at least one light field image information of an object to be projected, the at least one light field image information is respectively obtained by at least one light field image capturing device which is deployed in advance, and the at least one light field image capturing device is respectively arranged at different directions of the object to be projected;
the processing module is used for constructing a volume video corresponding to the object to be projected according to at least one light field image information corresponding to the object to be projected;
and the output module is used for projecting the volume video to a preset display area so as to present an image with a three-dimensional display effect of the object to be projected, and the preset display area is an independent and complete display area.
9. An electronic device, characterized in that the electronic device comprises: a memory and a processor communicatively coupled to each other, the memory having stored therein computer instructions, the processor performing the method of any of claims 1-7 by executing the computer instructions.
10. A computer-readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-7.
CN202210788236.0A 2022-07-06 2022-07-06 Holographic light field projection method, device and equipment Pending CN114866761A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210788236.0A CN114866761A (en) 2022-07-06 2022-07-06 Holographic light field projection method, device and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210788236.0A CN114866761A (en) 2022-07-06 2022-07-06 Holographic light field projection method, device and equipment

Publications (1)

Publication Number Publication Date
CN114866761A true CN114866761A (en) 2022-08-05

Family

ID=82626329

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210788236.0A Pending CN114866761A (en) 2022-07-06 2022-07-06 Holographic light field projection method, device and equipment

Country Status (1)

Country Link
CN (1) CN114866761A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN205901977U (en) * 2016-08-15 2017-01-18 万象三维视觉科技(北京)有限公司 Interactive display system of bore hole 3D augmented reality
US10275898B1 (en) * 2015-04-15 2019-04-30 Google Llc Wedge-based light-field video capture
CN111083453A (en) * 2018-10-18 2020-04-28 中兴通讯股份有限公司 Projection device, method and computer readable storage medium
CN114004927A (en) * 2021-10-25 2022-02-01 北京字节跳动网络技术有限公司 3D video model reconstruction method and device, electronic equipment and storage medium
CN114399358A (en) * 2021-12-31 2022-04-26 陕西红星闪闪网络科技有限公司 Holographic commodity display method and system and electronic equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10275898B1 (en) * 2015-04-15 2019-04-30 Google Llc Wedge-based light-field video capture
CN205901977U (en) * 2016-08-15 2017-01-18 万象三维视觉科技(北京)有限公司 Interactive display system of bore hole 3D augmented reality
CN111083453A (en) * 2018-10-18 2020-04-28 中兴通讯股份有限公司 Projection device, method and computer readable storage medium
CN114004927A (en) * 2021-10-25 2022-02-01 北京字节跳动网络技术有限公司 3D video model reconstruction method and device, electronic equipment and storage medium
CN114399358A (en) * 2021-12-31 2022-04-26 陕西红星闪闪网络科技有限公司 Holographic commodity display method and system and electronic equipment

Similar Documents

Publication Publication Date Title
US10154246B2 (en) Systems and methods for 3D capturing of objects and motion sequences using multiple range and RGB cameras
Matsuyama et al. 3D video and its applications
JP6627861B2 (en) Image processing system, image processing method, and program
WO2021030002A1 (en) Depth-aware photo editing
CN101150704B (en) Image processing system, image processing method
US20170078637A1 (en) Image processing apparatus and method
US11095871B2 (en) System that generates virtual viewpoint image, method and storage medium
KR20140004592A (en) Image blur based on 3d depth information
CN101577795A (en) Method and device for realizing real-time viewing of panoramic picture
CN102591449A (en) Low-latency fusing of virtual and real content
CN109995997A (en) Polyphaser processor with characteristic matching
CN111107265B (en) Image processing method and device, computer readable medium and electronic equipment
CN107113373A (en) Pass through the exposure calculating photographed based on depth calculation
JP2013025649A (en) Image processing device, image processing method, and program
CN111327823A (en) Video generation method and device and corresponding storage medium
US20220217322A1 (en) Apparatus, articles of manufacture, and methods to facilitate generation of variable viewpoint media
JP2011035638A (en) Virtual reality space video production system
JP2010166218A (en) Camera system and method of controlling the same
See et al. Virtual reality 360 interactive panorama reproduction obstacles and issues
KR102176805B1 (en) System and method for providing virtual reality contents indicated view direction
KR101632514B1 (en) Method and apparatus for upsampling depth image
CN114866761A (en) Holographic light field projection method, device and equipment
US20230131418A1 (en) Two-dimensional (2d) feature database generation
CN112312041B (en) Shooting-based image correction method and device, electronic equipment and storage medium
EP4075789A1 (en) Imaging device, imaging method, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination