WO2021147749A1 - Method and apparatus for realizing 3d display, and 3d display system - Google Patents

Method and apparatus for realizing 3d display, and 3d display system Download PDF

Info

Publication number
WO2021147749A1
WO2021147749A1 PCT/CN2021/071696 CN2021071696W WO2021147749A1 WO 2021147749 A1 WO2021147749 A1 WO 2021147749A1 CN 2021071696 W CN2021071696 W CN 2021071696W WO 2021147749 A1 WO2021147749 A1 WO 2021147749A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
photographing
eye image
camera
display content
Prior art date
Application number
PCT/CN2021/071696
Other languages
French (fr)
Chinese (zh)
Inventor
刁鸿浩
黄玲溪
Original Assignee
北京芯海视界三维科技有限公司
视觉技术创投私人有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京芯海视界三维科技有限公司, 视觉技术创投私人有限公司 filed Critical 北京芯海视界三维科技有限公司
Publication of WO2021147749A1 publication Critical patent/WO2021147749A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/122Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/239Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking
    • H04N13/383Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video

Definitions

  • This application relates to the field of 3D technology, for example, to methods, devices and 3D display systems for realizing 3D display.
  • the embodiments of the present disclosure provide a method, a device, a 3D display system, a computer-readable storage medium, and a computer program product for realizing 3D display, so as to solve the technical problem that the live screen is a plane.
  • the method for implementing 3D display includes:
  • the position confirmation device confirm the position of a 3D photographing device capable of 3D photographing with respect to a 3D display device to obtain the position of the 3D photographing device;
  • the 3D display device generates 3D display content for the 3D camera based on the position of the 3D camera.
  • generating 3D display content may include:
  • the image to be displayed is rendered into a left-eye image and a right-eye image, and the left-eye image and the right-eye image are allocated pixels according to the position of the 3D camera.
  • performing pixel allocation on the left-eye image and the right-eye image according to the position of the 3D camera may include:
  • the left-eye image and the right-eye image are allocated to the pixels of the 3D display screen of the 3D display device corresponding to the position of the 3D photographing device.
  • the method for implementing 3D display may further include: displaying 3D display content for the 3D camera.
  • the method for implementing 3D display may further include: receiving the displayed 3D display content through a 3D camera.
  • receiving 3D display content may include:
  • At least two cameras included in the 3D shooting device are used to receive the displayed 3D display content in a 3D display manner.
  • the method for implementing 3D display may further include: transmitting the received 3D display content to the user terminal.
  • the method for implementing 3D display may further include: 3D photographing the environment where the host is located through a 3D photographing device.
  • the method for implementing 3D display may further include: confirming the position of the anchor through the position confirming device to obtain the position of the anchor.
  • the device for realizing 3D display may include a processor and a memory storing program instructions, and the processor is configured to execute the above-mentioned method for realizing 3D display when the program instructions are executed.
  • the device for implementing 3D display may include:
  • the position confirmation device is configured to confirm the position of a 3D photographing device capable of 3D photographing with respect to the 3D display device to obtain the position of the 3D photographing device;
  • the 3D display device is configured to generate 3D display content for the 3D camera according to the position of the 3D camera.
  • the 3D display device may also be configured to render the image to be displayed into a left-eye image and a right-eye image, and perform pixel allocation on the left-eye image and the right-eye image according to the position of the 3D camera.
  • the 3D display device may be configured to allocate the left-eye image and the right-eye image to pixels corresponding to the position of the 3D photographing device on the 3D display screen of the 3D display device.
  • the 3D display device may also be configured to display 3D display content for the 3D camera.
  • the device for implementing 3D display may further include: a 3D photographing device configured to receive the displayed 3D display content.
  • the 3D photographing device may include at least two cameras, configured to receive the displayed 3D display content in a manner that can realize 3D display.
  • the 3D photographing device may also be configured to transmit the received 3D display content to the user terminal.
  • the 3D photographing device may also be configured to take 3D photographs of the environment where the host is located.
  • the 3D photographing device may also be configured to transmit the 3D photographing signal obtained by 3D photographing the environment where the host is located to the user terminal.
  • the 3D display system may include the device for implementing 3D display as described above.
  • the computer-readable storage medium provided by the embodiment of the present disclosure stores computer-executable instructions, and the computer-executable instructions are set to execute the above-mentioned method for realizing 3D display.
  • the computer program product provided by the embodiments of the present disclosure includes a computer program stored on a computer-readable storage medium.
  • the computer program includes program instructions.
  • the program instructions When the program instructions are executed by a computer, the computer executes the above-mentioned 3D display method.
  • the method, device and 3D display system, computer-readable storage medium, and computer program product for implementing 3D display provided by the embodiments of the present disclosure can achieve the following technical effects:
  • FIG. 1 is a flowchart of a method for realizing 3D display provided by an embodiment of the present disclosure
  • FIG. 2 is a flowchart of another method for realizing 3D display provided by an embodiment of the present disclosure
  • FIG. 3 is a structural diagram of an apparatus for realizing 3D display provided by an embodiment of the present disclosure
  • FIG. 4 is a structural diagram of another device for realizing 3D display provided by an embodiment of the present disclosure.
  • FIG. 5 is a structural diagram of another device for realizing 3D display provided by an embodiment of the present disclosure.
  • FIG. 6 is a structural diagram of another device for realizing 3D display provided by an embodiment of the present disclosure.
  • FIG. 7 is a structural diagram of another device for realizing 3D display provided by an embodiment of the present disclosure.
  • FIG. 8 is a structural diagram of another device for realizing 3D display provided by an embodiment of the present disclosure.
  • FIG. 9 is a structural diagram of a 3D display system provided by an embodiment of the present disclosure.
  • 3D display system 300: device for realizing 3D display; 310: processor; 320: memory; 330: communication interface; 340: bus; 400: position confirmation device; 410: 3D display device; 401: first camera module Group; 402: logic judgment circuit; 411: 3D display screen; 420: 3D camera; 421: second camera module.
  • an embodiment of the present disclosure provides a method for implementing 3D display, including:
  • S100 Through the position confirmation device, confirm the position of the 3D photographing device capable of 3D photographing with respect to the 3D display device to obtain the position of the 3D photographing device;
  • S200 Using the 3D display device, generate 3D display content for the 3D camera according to the position of the 3D camera.
  • the position confirmation device can determine the position.
  • the structure and determination form of the position confirmation device in this application are not limited, as long as the position information of the 3D camera device can be obtained.
  • a 3D camera device that performs 3D shooting for a 3D display device can be understood as a 3D display device that can play 3D display content, a 3D camera device can take a 3D picture, and the 3D picture taken by the 3D camera device is generated by the 3D display device.
  • the position of the 3D shooting device is different, the 3D display content displayed by the 3D display device may be different, and accordingly, the 3D images captured by the 3D shooting device may be different.
  • the image of the 3D photographing device may be photographed by the position confirming device to obtain the position of the 3D photographing device.
  • the position confirmation device may be a camera, and the position information of the target is determined based on the captured image information of the target, and the target is a 3D camera.
  • the 3D camera depth information in obtaining the position of the 3D camera, can be obtained according to the plane position information of the 3D camera in the image of the 3D camera, so as to obtain the 3D camera coordinates of the 3D camera.
  • the position image of the 3D camera captured by the position confirmation device contains the plane position information of the 3D camera, and the depth information of the 3D camera is obtained according to the plane position information, so as to obtain the spatial coordinate information of the 3D camera.
  • S210 rendering the image to be displayed into a left-eye image and a right-eye image
  • S220 according to the 3D camera
  • the position of the left-eye image and the right-eye image are pixel-allocated. Since the left and right eye images are different, different pixel assignments are performed on the left and right eye images based on the position of the 3D camera device to generate 3D display content.
  • the left-eye image and the right-eye image when the left-eye image and the right-eye image are allocated pixels according to the position of the 3D camera, the left-eye image and the right-eye image can be allocated to the position of the 3D display screen of the 3D display device and the position of the 3D camera. On the corresponding pixel. As a result, different left-eye images and right-eye images are displayed on the pixels corresponding to different viewing positions on the 3D display screen, so that different 3D display contents are displayed on the 3D display screen corresponding to different positions.
  • the method for implementing 3D display may further include: displaying 3D display content for the 3D camera.
  • the 3D display device displays corresponding 3D display content corresponding to the location of the 3D camera.
  • the 3D display content displayed by the 3D display device is received by the 3D camera, so that the 3D camera captures a 3D picture corresponding to its location.
  • the 3D display content is received through a 3D camera, and the displayed 3D display content can be received through the second camera module 421 (see FIG. 8) included in the 3D camera in a 3D display manner.
  • the second camera The module 421 can be at least two cameras.
  • the left-eye image and the right-eye image can be collected by using at least two cameras to obtain the left-eye image and the right-eye image. Based on the difference between the left-eye image and the right-eye image, 3D can be realized. Receiving in the displayed way.
  • the method for implementing 3D display may also perform the following operations: transmitting the received 3D display content to the user terminal.
  • the 3D camera device transmits the received 3D display content to the client via the network.
  • the method for implementing 3D display disclosed in some embodiments may further include: 3D photographing the environment where the host is located through a 3D photographing device.
  • the above-mentioned 3D shooting of the environment where the host is located by the 3D shooting device may include: a first camera module (see FIG. 5, which may include at least two cameras) included in the 3D shooting device to achieve 3D display 3D shooting of the environment where the host is located. At least two cameras in the 3D shooting device capture different first images and second images, respectively, and obtain the first and second images correspondingly.
  • the 3D shooting device can realize 3D display based on the first and second images. 3D shooting of the environment where the host is located.
  • the method for implementing 3D display disclosed in some embodiments may further include: transmitting a 3D shooting signal obtained by 3D shooting of the environment where the host is located through a 3D shooting device to the user terminal. Users who watch the live broadcast can receive the 3D display screen brought by the 3D shooting signal.
  • the anchor's eyeball depth information can be obtained according to the anchor's eyeball plane position information contained in the anchor's image, so as to obtain the anchor's eyeball coordinates.
  • the anchor can display the 3D display content corresponding to its location.
  • the method for implementing 3D display disclosed in some embodiments may include: generating 3D display content for the host according to the location of the host.
  • the 3D display device generates 3D display content corresponding to the location information of the host according to the location information of the host.
  • the location of the host is different, and the 3D display content generated by the 3D display device corresponding to its location may be different.
  • the image to be displayed may be rendered into a left-eye image and a right-eye image, and the left-eye image and the right-eye image are allocated pixels according to the location of the host.
  • the left eye image and the right eye image are allocated to the pixels corresponding to the location of the host on the 3D display screen of the 3D display device.
  • the method for implementing 3D display in some embodiments may further include: displaying 3D display content for the host.
  • the host sees the 3D display content for the host displayed by the 3D display device at his location.
  • the method for implementing 3D display may further include: 3D photographing the environment where the host is located through the location confirmation device.
  • performing 3D shooting of the environment where the host is located through the location confirmation device may include: performing 3D shooting of the environment where the host is located through the first camera module included in the location confirmation device, where the first camera module may be at least Two cameras can take 3D shots of the host’s environment in a way that can realize 3D display.
  • the at least two cameras included in the first camera module separately collect different images to perform 3D shooting of the environment where the host is located in a manner that can realize 3D display.
  • the method for implementing 3D display may also perform the following operations: the 3D shooting signal obtained by 3D shooting of the environment where the host is located is transmitted to the user terminal through the location confirmation device. Users who watch the live broadcast can receive 3D shooting signals and obtain 3D images.
  • the embodiment of the present disclosure provides a device for realizing 3D display, including a processor and a memory storing program instructions.
  • the processor is configured to execute the method for realizing 3D display as described above when the program instructions are executed.
  • the structure of the above-mentioned 3D display device is shown in FIG. 3, which may include a processor 310 and a memory 320, and may also include a communication interface 330 and a bus 340.
  • the processor 310, the communication interface 330, and the memory 320 can communicate with each other through the bus 340.
  • the communication interface 330 can be used for information transmission.
  • the processor 310 may call logical instructions in the memory 320 to execute the method for implementing 3D display in the foregoing embodiment.
  • the above-mentioned logical instructions in the memory 320 can be implemented in the form of a software functional unit and when sold or used as an independent product, they can be stored in a computer readable storage medium.
  • the memory 320 can be used to store software programs and computer-executable programs, such as program instructions/modules corresponding to the methods in the embodiments of the present disclosure.
  • the processor 310 executes functional applications and data processing by running program instructions/modules stored in the memory 320, that is, implements the 3D display method in the foregoing method embodiment.
  • the memory 320 may include a program storage area and a data storage area.
  • the program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the terminal device, and the like.
  • the memory 320 may include a high-speed random access memory, and may also include a non-volatile memory.
  • an embodiment of the present disclosure provides a device for realizing 3D display, including: a position confirmation device 400 and a 3D display device 410.
  • the position confirmation device 400 is configured to confirm the position of a 3D photographing device capable of 3D photographing with respect to a 3D display device to obtain the position of the 3D photographing device.
  • the location confirmation device 400 can determine the location of the target to obtain the location information of the target, and the structure and determination form of the location confirmation device 400 are not limited.
  • the 3D display device 410 is configured to generate 3D display content for the 3D camera according to the position of the 3D camera.
  • the 3D display device 410 generates corresponding 3D display content based on the position of the 3D camera.
  • the 3D display device may generate different 3D display content according to the position of the 3D camera.
  • the position confirmation device 400 may be configured to take an image of a 3D camera, and obtain the position of the 3D camera according to the image of the 3D camera.
  • the position confirmation device 400 may be a camera, and the position information of the target is determined based on the captured image information of the target, and the target is a 3D camera.
  • the position confirmation device 400 may include: a first camera module 401 and a logic judgment circuit 402.
  • the first camera module 401 may be at least two cameras 401 configured to capture images of a 3D camera.
  • the at least two cameras 401 can take images of the 3D camera from different angles to obtain the position of the 3D camera.
  • the logical judgment circuit 402 is configured to obtain the position of the 3D camera according to the image of the 3D camera.
  • the logical judgment circuit 402 may be configured to obtain the depth information of the 3D camera according to the plane position information of the 3D camera contained in the image of the 3D camera, so as to obtain the 3D camera coordinates of the 3D camera.
  • the 3D display device 410 may be configured to render the image to be displayed into a left-eye image and a right-eye image, and perform pixel allocation on the left-eye image and the right-eye image according to the position of the 3D camera. Since the left and right eye images are different, different pixel assignments are performed on the left and right eye images based on the position of the 3D camera device to generate 3D display content.
  • the 3D display device 410 may be configured to allocate the left-eye image and the right-eye image to pixels corresponding to the position of the 3D photographing device on the 3D display screen of the 3D display device. As a result, different left-eye images and right-eye images are displayed on the pixels corresponding to different viewing positions on the 3D display screen, and different 3D display contents can be displayed corresponding to different positions on the 3D display screen.
  • the 3D display device 410 may also be configured to display 3D display content for the 3D camera.
  • the 3D display device 410 may include a 3D display screen 411 configured to display 3D display content for the 3D camera.
  • the device for realizing 3D display may further include a 3D photographing device 420.
  • the 3D photographing device may be configured to receive displayed 3D display content.
  • the 3D camera 420 may include a second camera module 421.
  • the second camera module 421 includes at least two cameras, and the at least two cameras are configured to receive displayed 3D display content in a manner that can realize 3D display.
  • the above-mentioned at least two cameras can separately collect left-eye images and right-eye images to obtain left-eye images and right-eye images. Based on the difference between the left-eye images and the right-eye images, they can be received in a manner that can realize 3D display.
  • the 3D camera may also be configured to transmit the received 3D display content to the user terminal.
  • the 3D camera can transmit the received 3D display content to the user terminal via the network.
  • the 3D photographing device may also be configured to take 3D photographs of the environment where the host is located.
  • the 3D camera 420 may include a second camera module 421, and the second camera module 421 may include at least two cameras.
  • the at least two cameras are configured to perform 3D shooting of the environment where the host is located in a manner that can realize 3D display.
  • At least two cameras in the 3D shooting device capture different first images and second images, respectively, and obtain the first and second images correspondingly.
  • the 3D shooting device can realize 3D display based on the above-mentioned first and second images. 3D shooting of the environment where the host is located.
  • the 3D photographing device may also be configured to transmit the 3D photographing signal obtained by 3D photographing the environment where the host is located to the user terminal.
  • the user watching the live broadcast can play the received 3D shooting signal through the 3D display device.
  • the location confirmation device may also be configured to confirm the location of the host to obtain the location of the host. Based on the position of the anchor, the eyeball coordinates of the anchor can be obtained, which is convenient for the anchor to watch the 3D captured image.
  • the location confirmation device may be configured to: take an image of the host and obtain the location of the host according to the image of the host.
  • the location confirmation device may include a first camera module and a logic judgment circuit 402.
  • the first camera module may include at least two cameras, and the above-mentioned at least two cameras may be configured to capture images of the host.
  • the logic judgment circuit 402 is configured to obtain the position of the anchor according to the image of the anchor.
  • the logical judgment circuit may be configured to obtain the anchor's eyeball depth information according to the anchor's eyeball plane position information contained in the anchor's image, so as to obtain the anchor's eyeball coordinates.
  • the 3D display device may also be configured to generate 3D display content for the host according to the location of the host.
  • the anchor watched the 3D display content, and it was easier to experience the feeling of 3D live broadcast.
  • the 3D display device when the 3D display device generates 3D display content for the host, it can be configured to: render the image to be displayed as a left-eye image and a right-eye image, and perform the left-eye image and the right-eye image according to the location of the host. Pixel allocation.
  • the pixel allocation of the 3D display device may be configured to: allocate the left eye image and the right eye image to the pixels corresponding to the position of the host in the 3D display screen of the 3D display device, so that the 3D display screen The 3D display content is displayed on the location of the anchor.
  • the 3D display device may also be configured to display 3D display content for the host.
  • the host can watch the 3D display content for himself, which improves the host’s experience of live broadcast.
  • the 3D display device includes a 3D display screen.
  • the 3D display screen may be configured to display 3D display content for the host.
  • the location confirmation device may also be configured to take a 3D photograph of the environment where the host is located.
  • the position confirmation device may include a first camera module, and the first camera module includes at least two cameras.
  • the at least two cameras are configured to perform 3D shooting of the environment where the host is located in a manner that can realize 3D display.
  • the location confirmation device may also be configured to transmit the 3D shooting signal obtained by 3D shooting of the environment where the host is located to the user terminal.
  • the embodiment of the present disclosure also provides a 3D display system 1 (see FIG. 9), which includes a device for realizing 3D display as described above.
  • the 3D display device includes a position confirmation device 400 and a 3D display device 410, and may also include a 3D photographing device 420.
  • the 3D display system can be set on the host side or on the user side, and can be set according to the needs of different users.
  • the position of the 3D camera capable of 3D shooting of the 3D display device is confirmed by the position confirmation device to obtain the position of the 3D camera.
  • the 3D display device 410 generates 3D display content for the 3D camera based on the position of the 3D camera.
  • the user can obtain the 3D image corresponding to the position of the 3D camera from the 3D shooting signal sent by the 3D camera, and the 3D camera at different positions can obtain different 3D images, which improves the user's viewing experience of watching live broadcasts.
  • the embodiment of the present disclosure provides a computer-readable storage medium that stores computer-executable instructions, and the computer-executable instructions are configured to execute the above-mentioned method for implementing 3D display.
  • the embodiments of the present disclosure provide a computer program product, including a computer program stored on a computer-readable storage medium, the computer program including program instructions, when the program instructions are executed by a computer, the computer executes the above-mentioned 3D display method.
  • the aforementioned computer-readable storage medium may be a transitory computer-readable storage medium or a non-transitory computer-readable storage medium.
  • the computer-readable storage medium and computer program product provided by the embodiments of the present disclosure confirm the position of a 3D photographing device capable of 3D photographing with respect to a 3D display device through the position confirming device to obtain the position of the 3D photographing device.
  • the 3D display device generates 3D display content for the 3D camera based on the position of the 3D camera.
  • the 3D camera captures the 3D image corresponding to its location, and the user can obtain the 3D image corresponding to the position of the 3D camera from the 3D camera, and the 3D camera at different positions obtains different 3D images, which improves the user’s viewing of the live broadcast.
  • the 3D display device generates 3D display content for the 3D camera based on the position of the 3D camera.
  • the technical solutions of the embodiments of the present disclosure can be embodied in the form of a software product.
  • the computer software product is stored in a storage medium and includes one or more instructions to enable a computer device (which can be a personal computer, a server, or a network). Equipment, etc.) execute all or part of the steps of the method of the embodiment of the present disclosure.
  • the aforementioned storage medium may be a non-transitory storage medium, including: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks, etc.
  • the first element can be called the second element, and likewise, the second element can be called the first element, as long as all occurrences of the "first element” are renamed consistently and all occurrences "Second component” can be renamed consistently.
  • the first element and the second element are both elements, but they may not be the same element.
  • the terms used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and claims, unless the context clearly indicates, the singular forms "a” (a), “an” (an) and “the” (the) are intended to also include plural forms .
  • the term “and/or” as used in this application refers to any and all possible combinations that include one or more of the associated lists.
  • the term “comprise” (comprise) and its variants “comprises” and/or including (comprising) and the like refer to the stated features, wholes, steps, operations, elements, and/or The existence of components does not exclude the existence or addition of one or more other features, wholes, steps, operations, elements, components, and/or groups of these. If there are no more restrictions, the element defined by the sentence “including a" does not exclude the existence of other identical elements in the process, method, or device that includes the element.
  • each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other.
  • the relevant parts can be referred to the description of the method part.
  • the disclosed methods and products can be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of units may only be a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment.
  • the functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • each block in the flowchart or block diagram may represent a module, program segment, or part of the code, and the above-mentioned module, program segment, or part of the code contains one or more options for realizing the specified logic function.
  • Execute instructions may also occur in a different order from the order marked in the drawings. For example, two consecutive blocks can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Provided are a method and apparatus for realizing 3D display, and a 3D display system, a computer-readable storage medium, and a computer program product. The method for realizing 3D display comprises: by means of a position confirmation apparatus, performing position confirmation on a 3D photographic apparatus which can perform 3D photography for a 3D display apparatus, so as to obtain the position of the 3D photographic apparatus (S100); and by means of the 3D display apparatus, generating 3D display content for the 3D photographic apparatus according to the position of the 3D photographic apparatus (S200). A live broadcast picture capable of realizing 3D display is provided.

Description

实现3D显示的方法、装置及3D显示系统Method, device and 3D display system for realizing 3D display
本申请要求在2020年01月20日提交中国知识产权局、申请号为202010072953.4、发明名称为“实现3D显示的方法、装置及3D显示系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the China Intellectual Property Office on January 20, 2020, the application number is 202010072953.4, and the invention title is "Method, Apparatus and 3D Display System for Realizing 3D Display", the entire content of which is incorporated by reference Incorporated in this application.
技术领域Technical field
本申请涉及3D技术领域,例如涉及实现3D显示的方法、装置及3D显示系统。This application relates to the field of 3D technology, for example, to methods, devices and 3D display systems for realizing 3D display.
背景技术Background technique
随着网络直播的不断发展,观看直播的需求越来越多。With the continuous development of webcasting, there is an increasing demand for watching live broadcasts.
在实现本公开实施例的过程中,发现相关技术中至少存在如下问题:In the process of implementing the embodiments of the present disclosure, it is found that at least the following problems exist in the related technology:
用户观看直播节目时,观看的画面多为平面,通常通过语音、文字或者手势进行互动,但是互动效果较差,并不能达到身临其境的效果。When users watch live programs, the screens they watch are mostly flat, and they usually interact through voice, text, or gestures, but the interaction effect is poor, and the immersive effect cannot be achieved.
发明内容Summary of the invention
为了对披露的实施例的一些方面有基本的理解,下面给出了简单的概括。该概括不是泛泛评述,也不是要确定关键/重要组成元素或描绘这些实施例的保护范围,而是作为后面的详细说明的序言。In order to have a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not a general comment, nor is it intended to determine key/important components or describe the scope of protection of these embodiments, but serves as a prelude to the detailed description that follows.
本公开实施例提供了一种实现3D显示的方法、装置及3D显示系统、计算机可读存储介质、计算机程序产品,以解决直播画面为平面的技术问题。The embodiments of the present disclosure provide a method, a device, a 3D display system, a computer-readable storage medium, and a computer program product for realizing 3D display, so as to solve the technical problem that the live screen is a plane.
在一些实施例中,实现3D显示的方法包括:In some embodiments, the method for implementing 3D display includes:
通过位置确认装置,对能够针对3D显示装置进行3D拍摄的3D拍摄装置进行位置确认以获得3D拍摄装置的位置;Through the position confirmation device, confirm the position of a 3D photographing device capable of 3D photographing with respect to a 3D display device to obtain the position of the 3D photographing device;
通过3D显示装置,根据3D拍摄装置的位置生成针对3D拍摄装置的3D显示内容。The 3D display device generates 3D display content for the 3D camera based on the position of the 3D camera.
在一些实施例中,生成3D显示内容,可以包括:In some embodiments, generating 3D display content may include:
将待显示图像渲染为左眼图像和右眼图像,根据3D拍摄装置的位置对左眼图像和右眼图像进行像素分配。The image to be displayed is rendered into a left-eye image and a right-eye image, and the left-eye image and the right-eye image are allocated pixels according to the position of the 3D camera.
在一些实施例中,根据3D拍摄装置的位置对左眼图像和右眼图像进行像素分配,可以包括:In some embodiments, performing pixel allocation on the left-eye image and the right-eye image according to the position of the 3D camera may include:
将左眼图像和右眼图像分配到3D显示装置的3D显示屏幕的与3D拍摄装置的位置对 应的像素上。The left-eye image and the right-eye image are allocated to the pixels of the 3D display screen of the 3D display device corresponding to the position of the 3D photographing device.
在一些实施例中,实现3D显示的方法还可以包括:显示针对3D拍摄装置的3D显示内容。In some embodiments, the method for implementing 3D display may further include: displaying 3D display content for the 3D camera.
在一些实施例中,实现3D显示的方法还可以包括:通过3D拍摄装置接收显示的3D显示内容。In some embodiments, the method for implementing 3D display may further include: receiving the displayed 3D display content through a 3D camera.
在一些实施例中,接收3D显示内容,可以包括:In some embodiments, receiving 3D display content may include:
通过3D拍摄装置包括的至少两个摄像头,以可实现3D显示的方式接收显示的3D显示内容。At least two cameras included in the 3D shooting device are used to receive the displayed 3D display content in a 3D display manner.
在一些实施例中,实现3D显示的方法还可以包括:向用户端传输接收的3D显示内容。In some embodiments, the method for implementing 3D display may further include: transmitting the received 3D display content to the user terminal.
在一些实施例中,实现3D显示的方法还可以包括:通过3D拍摄装置对主播所在环境进行3D拍摄。In some embodiments, the method for implementing 3D display may further include: 3D photographing the environment where the host is located through a 3D photographing device.
在一些实施例中,实现3D显示的方法还可以包括:通过位置确认装置对主播进行位置确认以获得主播的位置。In some embodiments, the method for implementing 3D display may further include: confirming the position of the anchor through the position confirming device to obtain the position of the anchor.
在一些实施例中,实现3D显示的装置,可以包括处理器和存储有程序指令的存储器,处理器被配置为在执行程序指令时,执行上述的实现3D显示的方法。In some embodiments, the device for realizing 3D display may include a processor and a memory storing program instructions, and the processor is configured to execute the above-mentioned method for realizing 3D display when the program instructions are executed.
在一些实施例中,实现3D显示的装置,可以包括:In some embodiments, the device for implementing 3D display may include:
位置确认装置,被配置为对能够针对3D显示装置进行3D拍摄的3D拍摄装置进行位置确认以获得3D拍摄装置的位置;The position confirmation device is configured to confirm the position of a 3D photographing device capable of 3D photographing with respect to the 3D display device to obtain the position of the 3D photographing device;
3D显示装置,被配置为根据3D拍摄装置的位置生成针对3D拍摄装置的3D显示内容。The 3D display device is configured to generate 3D display content for the 3D camera according to the position of the 3D camera.
在一些实施例中,3D显示装置还可以被配置为:将待显示图像渲染为左眼图像和右眼图像,根据3D拍摄装置的位置对左眼图像和右眼图像进行像素分配。In some embodiments, the 3D display device may also be configured to render the image to be displayed into a left-eye image and a right-eye image, and perform pixel allocation on the left-eye image and the right-eye image according to the position of the 3D camera.
在一些实施例中,3D显示装置可以被配置为:将左眼图像和右眼图像分配到3D显示装置的3D显示屏幕中与3D拍摄装置的位置对应的像素上。In some embodiments, the 3D display device may be configured to allocate the left-eye image and the right-eye image to pixels corresponding to the position of the 3D photographing device on the 3D display screen of the 3D display device.
在一些实施例中,3D显示装置还可以被配置为:显示针对3D拍摄装置的3D显示内容。In some embodiments, the 3D display device may also be configured to display 3D display content for the 3D camera.
在一些实施例中,实现3D显示的装置还可以包括:3D拍摄装置,被配置为接收显示的3D显示内容。In some embodiments, the device for implementing 3D display may further include: a 3D photographing device configured to receive the displayed 3D display content.
在一些实施例中,3D拍摄装置可以包括至少两个摄像头,被配置为以可实现3D显示的方式接收显示的3D显示内容。In some embodiments, the 3D photographing device may include at least two cameras, configured to receive the displayed 3D display content in a manner that can realize 3D display.
在一些实施例中,3D拍摄装置还可以被配置为:向用户端传输接收的3D显示内容。In some embodiments, the 3D photographing device may also be configured to transmit the received 3D display content to the user terminal.
在一些实施例中,3D拍摄装置还可以被配置为:对主播所在环境进行3D拍摄。In some embodiments, the 3D photographing device may also be configured to take 3D photographs of the environment where the host is located.
在一些实施例中,3D拍摄装置还可以被配置为:将对主播所在环境进行3D拍摄得到的3D拍摄信号向用户端传输。In some embodiments, the 3D photographing device may also be configured to transmit the 3D photographing signal obtained by 3D photographing the environment where the host is located to the user terminal.
在一些实施例中,3D显示系统可以包括如上述的实现3D显示的装置。In some embodiments, the 3D display system may include the device for implementing 3D display as described above.
本公开实施例提供的计算机可读存储介质,存储有计算机可执行指令,计算机可执行指令设置为执行上述的实现3D显示的方法。The computer-readable storage medium provided by the embodiment of the present disclosure stores computer-executable instructions, and the computer-executable instructions are set to execute the above-mentioned method for realizing 3D display.
本公开实施例提供的计算机程序产品,包括存储在计算机可读存储介质上的计算机程序,计算机程序包括程序指令,当该程序指令被计算机执行时,使计算机执行上述的实现3D显示的方法。The computer program product provided by the embodiments of the present disclosure includes a computer program stored on a computer-readable storage medium. The computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the above-mentioned 3D display method.
本公开实施例提供的实现3D显示的方法、装置及3D显示系统、计算机可读存储介质、计算机程序产品,可以实现以下技术效果:The method, device and 3D display system, computer-readable storage medium, and computer program product for implementing 3D display provided by the embodiments of the present disclosure can achieve the following technical effects:
提供可实现3D显示的直播画面。Provide a live screen that can be displayed in 3D.
以上的总体描述和下文中的描述仅是示例性和解释性的,不用于限制本申请。The above general description and the following description are only exemplary and explanatory, and are not used to limit the application.
附图说明Description of the drawings
一个或多个实施例通过与之对应的附图进行示例性说明,这些示例性说明和附图并不构成对实施例的限定,附图中具有相同参考数字标号的元件示为类似的元件,附图不构成比例限制,并且其中:One or more embodiments are exemplified by the accompanying drawings. These exemplified descriptions and drawings do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements. The drawings do not constitute a scale limitation, and among them:
图1是本公开实施例提供的实现3D显示的方法流程图;FIG. 1 is a flowchart of a method for realizing 3D display provided by an embodiment of the present disclosure;
图2是本公开实施例提供的实现3D显示的又一方法流程图;2 is a flowchart of another method for realizing 3D display provided by an embodiment of the present disclosure;
图3是本公开实施例提供的实现3D显示的装置结构图;FIG. 3 is a structural diagram of an apparatus for realizing 3D display provided by an embodiment of the present disclosure;
图4是本公开实施例提供的实现3D显示的又一装置结构图;4 is a structural diagram of another device for realizing 3D display provided by an embodiment of the present disclosure;
图5是本公开实施例提供的实现3D显示的又一装置结构图;FIG. 5 is a structural diagram of another device for realizing 3D display provided by an embodiment of the present disclosure;
图6是本公开实施例提供的实现3D显示的又一装置结构图;FIG. 6 is a structural diagram of another device for realizing 3D display provided by an embodiment of the present disclosure;
图7是本公开实施例提供的实现3D显示的又一装置结构图;FIG. 7 is a structural diagram of another device for realizing 3D display provided by an embodiment of the present disclosure;
图8是本公开实施例提供的实现3D显示的又一装置结构图;FIG. 8 is a structural diagram of another device for realizing 3D display provided by an embodiment of the present disclosure;
图9是本公开实施例提供的3D显示系统的结构图。FIG. 9 is a structural diagram of a 3D display system provided by an embodiment of the present disclosure.
附图标记:Reference signs:
1:3D显示系统;300:实现3D显示的装置;310:处理器;320:存储器;330:通信接口;340:总线;400:位置确认装置;410:3D显示装置;401:第一摄像头模组;402: 逻辑判断电路;411:3D显示屏幕;420:3D拍摄装置;421:第二摄像头模组。1: 3D display system; 300: device for realizing 3D display; 310: processor; 320: memory; 330: communication interface; 340: bus; 400: position confirmation device; 410: 3D display device; 401: first camera module Group; 402: logic judgment circuit; 411: 3D display screen; 420: 3D camera; 421: second camera module.
具体实施方式Detailed ways
为了能够更加详尽地了解本公开实施例的特点与技术内容,下面结合附图对本公开实施例的实现进行详细阐述,所附附图仅供参考说明之用,并非用来限定本公开实施例。在以下的技术描述中,为方便解释起见,通过多个细节以提供对所披露实施例的充分理解。然而,在没有这些细节的情况下,一个或多个实施例仍然可以实施。在其它情况下,为简化附图,熟知的结构和装置可以简化展示。In order to have a more detailed understanding of the features and technical content of the embodiments of the present disclosure, the implementation of the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, a number of details are used to provide a sufficient understanding of the disclosed embodiments. However, without these details, one or more embodiments can still be implemented. In other cases, in order to simplify the drawings, well-known structures and devices may be simplified for display.
如图1所示,本公开实施例提供了一种实现3D显示的方法,包括:As shown in FIG. 1, an embodiment of the present disclosure provides a method for implementing 3D display, including:
S100:通过位置确认装置,对能够针对3D显示装置进行3D拍摄的3D拍摄装置进行位置确认以获得3D拍摄装置的位置;S100: Through the position confirmation device, confirm the position of the 3D photographing device capable of 3D photographing with respect to the 3D display device to obtain the position of the 3D photographing device;
S200:通过3D显示装置,根据3D拍摄装置的位置生成针对3D拍摄装置的3D显示内容。S200: Using the 3D display device, generate 3D display content for the 3D camera according to the position of the 3D camera.
在一些实施例中,位置确认装置可以进行位置的确定,本申请中的位置确认装置的结构和确定形式不做限定,只要能够获得3D摄像装置的位置信息即可。针对3D显示装置进行3D拍摄的3D摄像装置可以理解为3D显示装置可以播放3D显示内容,3D摄像装置可以拍摄到3D画面,并且3D摄像装置拍摄到的3D画面是3D显示装置生成的对应于该位置的3D显示装置的3D显示内容。3D拍摄装置的位置不同,3D显示装置显示的3D显示内容可以不同,相应地,3D拍摄装置拍摄到的3D画面可以不同。In some embodiments, the position confirmation device can determine the position. The structure and determination form of the position confirmation device in this application are not limited, as long as the position information of the 3D camera device can be obtained. A 3D camera device that performs 3D shooting for a 3D display device can be understood as a 3D display device that can play 3D display content, a 3D camera device can take a 3D picture, and the 3D picture taken by the 3D camera device is generated by the 3D display device. The 3D display content of the location of the 3D display device. The position of the 3D shooting device is different, the 3D display content displayed by the 3D display device may be different, and accordingly, the 3D images captured by the 3D shooting device may be different.
在一些实施例中,在执行S100以对3D拍摄装置进行位置确认时,可以通过位置确认装置拍摄3D拍摄装置的图像,进而获得3D拍摄装置的位置。例如位置确认装置可以是摄像仪,基于捕捉到的目标物的图像信息来确定出目标物的位置信息,目标物为3D摄像装置。In some embodiments, when S100 is performed to confirm the position of the 3D photographing device, the image of the 3D photographing device may be photographed by the position confirming device to obtain the position of the 3D photographing device. For example, the position confirmation device may be a camera, and the position information of the target is determined based on the captured image information of the target, and the target is a 3D camera.
在一些实施例中,获得3D拍摄装置的位置中,可以根据3D拍摄装置的图像中包含3D拍摄装置的平面位置信息得到3D拍摄装置深度信息,从而获得3D拍摄装置的3D拍摄装置坐标。位置确认装置拍摄的3D拍摄装置的位置图像中包含3D拍摄装置的平面位置信息,根据该平面位置信息得到3D拍摄装置的深度信息,从而获得3D拍摄装置的空间坐标信息。In some embodiments, in obtaining the position of the 3D camera, the 3D camera depth information can be obtained according to the plane position information of the 3D camera in the image of the 3D camera, so as to obtain the 3D camera coordinates of the 3D camera. The position image of the 3D camera captured by the position confirmation device contains the plane position information of the 3D camera, and the depth information of the 3D camera is obtained according to the plane position information, so as to obtain the spatial coordinate information of the 3D camera.
在一些实施例中,参见图2所示,在执行S200以生成3D显示内容时,可以执行如下操作:S210:将待显示图像渲染为左眼图像和右眼图像;以及S220:根据3D拍摄装置的位置对左眼图像和右眼图像进行像素分配。由于左右眼图像不同,再基于3D摄像装置的 位置对左右眼图像进行不同的像素分配,生成3D显示内容。In some embodiments, referring to FIG. 2, when performing S200 to generate 3D display content, the following operations may be performed: S210: rendering the image to be displayed into a left-eye image and a right-eye image; and S220: according to the 3D camera The position of the left-eye image and the right-eye image are pixel-allocated. Since the left and right eye images are different, different pixel assignments are performed on the left and right eye images based on the position of the 3D camera device to generate 3D display content.
在一些实施例中,根据3D拍摄装置的位置对左眼图像和右眼图像进行像素分配时,可以将左眼图像和右眼图像分配到3D显示装置的3D显示屏幕的与3D拍摄装置的位置对应的像素上。由此3D显示屏上对应不同观看位置的像素上显示不同的左眼图像和右眼图像,从而3D显示屏上对应不同位置显示不同的3D显示内容。In some embodiments, when the left-eye image and the right-eye image are allocated pixels according to the position of the 3D camera, the left-eye image and the right-eye image can be allocated to the position of the 3D display screen of the 3D display device and the position of the 3D camera. On the corresponding pixel. As a result, different left-eye images and right-eye images are displayed on the pixels corresponding to different viewing positions on the 3D display screen, so that different 3D display contents are displayed on the 3D display screen corresponding to different positions.
在一些实施例中,实现3D显示的方法,还可以包括:显示针对3D拍摄装置的3D显示内容。3D显示装置对应3D拍摄装置所处位置显示相应的3D显示内容。In some embodiments, the method for implementing 3D display may further include: displaying 3D display content for the 3D camera. The 3D display device displays corresponding 3D display content corresponding to the location of the 3D camera.
在一些实施例中,通过3D拍摄装置接收3D显示装置显示的3D显示内容,由此3D拍摄装置拍摄到对应其位置的3D画面。In some embodiments, the 3D display content displayed by the 3D display device is received by the 3D camera, so that the 3D camera captures a 3D picture corresponding to its location.
在一些实施例中,通过3D拍摄装置接收3D显示内容,可以通过3D拍摄装置包括的第二摄像头模组421(参见图8)以可实现3D显示的方式接收显示的3D显示内容,第二摄像头模组421可以为至少两个摄像头,采用至少两个摄像头可以分别采集左眼图像和右眼图像对应获得左眼画面和右眼画面,基于左眼画面和右眼画面的不同,以可实现3D显示的方式接收。In some embodiments, the 3D display content is received through a 3D camera, and the displayed 3D display content can be received through the second camera module 421 (see FIG. 8) included in the 3D camera in a 3D display manner. The second camera The module 421 can be at least two cameras. The left-eye image and the right-eye image can be collected by using at least two cameras to obtain the left-eye image and the right-eye image. Based on the difference between the left-eye image and the right-eye image, 3D can be realized. Receiving in the displayed way.
在一些实施例中,实现3D显示的方法还可以执行如下操作:向用户端传输接收的3D显示内容。3D拍摄装置经由网络向用户端传输接收的3D显示内容。In some embodiments, the method for implementing 3D display may also perform the following operations: transmitting the received 3D display content to the user terminal. The 3D camera device transmits the received 3D display content to the client via the network.
在一些实施例中公开的实现3D显示的方法还可以包括:通过3D拍摄装置对主播所在环境进行3D拍摄。可选地,上述通过3D拍摄装置对主播所在环境进行3D拍摄,可以包括:通过3D拍摄装置包括的第一摄像头模组(参见图5,可以包括至少两个摄像头),以可实现3D显示的方式对主播所在环境进行3D拍摄。3D拍摄装置中的至少两个摄像头分别采集不同的第一图像和第二图像,对应地获得第一画面和第二画面,3D拍摄装置基于第一画面和第二画面,以可实现3D显示的方式对主播所在环境进行3D拍摄。The method for implementing 3D display disclosed in some embodiments may further include: 3D photographing the environment where the host is located through a 3D photographing device. Optionally, the above-mentioned 3D shooting of the environment where the host is located by the 3D shooting device may include: a first camera module (see FIG. 5, which may include at least two cameras) included in the 3D shooting device to achieve 3D display 3D shooting of the environment where the host is located. At least two cameras in the 3D shooting device capture different first images and second images, respectively, and obtain the first and second images correspondingly. The 3D shooting device can realize 3D display based on the first and second images. 3D shooting of the environment where the host is located.
在一些实施例公开的实现3D显示的方法还可以包括:通过3D拍摄装置将对主播所在环境进行3D拍摄得到的3D拍摄信号向用户端传输。观看直播的用户可以接收到3D拍摄信号带来的3D显示画面。The method for implementing 3D display disclosed in some embodiments may further include: transmitting a 3D shooting signal obtained by 3D shooting of the environment where the host is located through a 3D shooting device to the user terminal. Users who watch the live broadcast can receive the 3D display screen brought by the 3D shooting signal.
在一些实施例公开的实现3D显示的方法,还可以包括:通过位置确认装置对主播进行位置确认以获得主播的位置。对主播进行位置确认可以包括:通过位置确认装置拍摄主播的图像,根据主播的图像获得主播的位置。获得主播的位置时可以获得主播的眼球坐标。The method for implementing 3D display disclosed in some embodiments may further include: confirming the position of the anchor through the position confirming device to obtain the position of the anchor. Confirming the location of the host may include: taking an image of the host through the location confirmation device, and obtaining the location of the host according to the image of the host. The eye coordinates of the anchor can be obtained when the position of the anchor is obtained.
在一些实施例公开的获得主播的位置中可以根据主播的图像中包含的主播眼球平面位置信息得到主播眼球深度信息,从而获得主播眼球的眼球坐标。根据主播的眼球坐标可以向主播显示对应其位置的3D显示内容。In obtaining the anchor's position disclosed in some embodiments, the anchor's eyeball depth information can be obtained according to the anchor's eyeball plane position information contained in the anchor's image, so as to obtain the anchor's eyeball coordinates. According to the anchor's eye coordinates, the anchor can display the 3D display content corresponding to its location.
在一些实施例公开的实现3D显示的方法,可以包括:根据主播的位置生成针对主播的3D显示内容。3D显示装置根据主播的位置信息生成对应其位置信息的3D显示内容。主播处于的位置不同,3D显示装置对应其位置生成的3D显示内容可能不同。The method for implementing 3D display disclosed in some embodiments may include: generating 3D display content for the host according to the location of the host. The 3D display device generates 3D display content corresponding to the location information of the host according to the location information of the host. The location of the host is different, and the 3D display content generated by the 3D display device corresponding to its location may be different.
在一些实施例公开的生成针对主播的3D显示内容中,可以将待显示图像渲染为左眼图像和右眼图像,根据主播的位置对左眼图像和右眼图像进行像素分配。根据主播的位置对左眼图像和右眼图像进行像素分配中,将左眼图像和右眼图像分配到3D显示装置的3D显示屏幕的与主播的位置对应的像素上。In the generation of 3D display content for the host disclosed in some embodiments, the image to be displayed may be rendered into a left-eye image and a right-eye image, and the left-eye image and the right-eye image are allocated pixels according to the location of the host. In the pixel allocation of the left eye image and the right eye image according to the location of the host, the left eye image and the right eye image are allocated to the pixels corresponding to the location of the host on the 3D display screen of the 3D display device.
一些实施例中地实现3D显示的方法,还可以包括:显示针对主播的3D显示内容。主播在其位置处观看到3D显示装置显示的针对主播的3D显示内容。The method for implementing 3D display in some embodiments may further include: displaying 3D display content for the host. The host sees the 3D display content for the host displayed by the 3D display device at his location.
在一些实施例中,实现3D显示的方法,还可以包括:通过位置确认装置对主播所在环境进行3D拍摄。In some embodiments, the method for implementing 3D display may further include: 3D photographing the environment where the host is located through the location confirmation device.
在一些实施例中,通过位置确认装置对主播所在环境进行3D拍摄,可以包括:通过位置确认装置包括的第一摄像头模组,对主播所在环境进行3D拍摄,其中第一摄像头模组可以为至少两个摄像头,以可实现3D显示的方式对主播所在环境进行3D拍摄。第一摄像头模组包括的至少两个摄像头分别采集不同的图像以可实现3D显示的方式对主播所在环境进行3D拍摄。In some embodiments, performing 3D shooting of the environment where the host is located through the location confirmation device may include: performing 3D shooting of the environment where the host is located through the first camera module included in the location confirmation device, where the first camera module may be at least Two cameras can take 3D shots of the host’s environment in a way that can realize 3D display. The at least two cameras included in the first camera module separately collect different images to perform 3D shooting of the environment where the host is located in a manner that can realize 3D display.
在一些实施例中,实现3D显示的方法,还可以执行如下操作:通过位置确认装置将对主播所在环境进行3D拍摄得到的3D拍摄信号向用户端传输。观看直播的用户可以接收3D拍摄信号并且获得3D画面。In some embodiments, the method for implementing 3D display may also perform the following operations: the 3D shooting signal obtained by 3D shooting of the environment where the host is located is transmitted to the user terminal through the location confirmation device. Users who watch the live broadcast can receive 3D shooting signals and obtain 3D images.
本公开实施例提供了一种实现3D显示的装置,包括处理器和存储有程序指令的存储器,处理器被配置为在执行程序指令时,执行如上文所述实现3D显示的方法。在一些实施例中,上述实现3D显示的装置结构如图3所示,可以包括:处理器(processor)310和存储器(memory)320,还可以包括通信接口(Communication Interface)330和总线340。其中,处理器310、通信接口330、存储器320可以通过总线340完成相互间的通信。通信接口330可以用于信息传输。处理器310可以调用存储器320中的逻辑指令,以执行上述实施例的实现3D显示的方法。The embodiment of the present disclosure provides a device for realizing 3D display, including a processor and a memory storing program instructions. The processor is configured to execute the method for realizing 3D display as described above when the program instructions are executed. In some embodiments, the structure of the above-mentioned 3D display device is shown in FIG. 3, which may include a processor 310 and a memory 320, and may also include a communication interface 330 and a bus 340. Among them, the processor 310, the communication interface 330, and the memory 320 can communicate with each other through the bus 340. The communication interface 330 can be used for information transmission. The processor 310 may call logical instructions in the memory 320 to execute the method for implementing 3D display in the foregoing embodiment.
此外,上述的存储器320中的逻辑指令可以通过软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。存储器320作为一种计算机可读存储介质,可用于存储软件程序、计算机可执行程序,如本公开实施例中的方法对应的程序指令/模块。处理器310通过运行存储在存储器320中的程序指令/模块,从而执行功能应用以及数据处理,即实现上述方法实施例中的实现3D显示的方法。存储器320 可包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序;存储数据区可存储根据终端设备的使用所创建的数据等。In addition, the above-mentioned logical instructions in the memory 320 can be implemented in the form of a software functional unit and when sold or used as an independent product, they can be stored in a computer readable storage medium. As a computer-readable storage medium, the memory 320 can be used to store software programs and computer-executable programs, such as program instructions/modules corresponding to the methods in the embodiments of the present disclosure. The processor 310 executes functional applications and data processing by running program instructions/modules stored in the memory 320, that is, implements the 3D display method in the foregoing method embodiment. The memory 320 may include a program storage area and a data storage area. The program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the terminal device, and the like.
此外,存储器320可以包括高速随机存取存储器,还可以包括非易失性存储器。In addition, the memory 320 may include a high-speed random access memory, and may also include a non-volatile memory.
参见图4,本公开实施例提供了一种实现3D显示的装置,包括:位置确认装置400和3D显示装置410。其中,位置确认装置400,被配置为对能够针对3D显示装置进行3D拍摄的3D拍摄装置进行位置确认以获得3D拍摄装置的位置。位置确认装置400可以确定目标物的位置来获得目标物的位置信息,位置确认装置400的结构和确定形式不做限定。3D显示装置410,被配置为根据3D拍摄装置的位置生成针对3D拍摄装置的3D显示内容。3D显示装置410基于3D拍摄装置的位置生成相应的3D显示内容,3D拍摄装置的位置不同,3D显示装置生成的3D显示内容可以不同。Referring to FIG. 4, an embodiment of the present disclosure provides a device for realizing 3D display, including: a position confirmation device 400 and a 3D display device 410. Wherein, the position confirmation device 400 is configured to confirm the position of a 3D photographing device capable of 3D photographing with respect to a 3D display device to obtain the position of the 3D photographing device. The location confirmation device 400 can determine the location of the target to obtain the location information of the target, and the structure and determination form of the location confirmation device 400 are not limited. The 3D display device 410 is configured to generate 3D display content for the 3D camera according to the position of the 3D camera. The 3D display device 410 generates corresponding 3D display content based on the position of the 3D camera. The 3D display device may generate different 3D display content according to the position of the 3D camera.
在一些实施例中,位置确认装置400,可以被配置为:拍摄3D拍摄装置的图像,并且根据3D拍摄装置的图像获得3D拍摄装置的位置。位置确认装置400可以是摄像仪,基于捕捉到的目标物的图像信息来确定出目标物的位置信息,目标物为3D摄像装置。In some embodiments, the position confirmation device 400 may be configured to take an image of a 3D camera, and obtain the position of the 3D camera according to the image of the 3D camera. The position confirmation device 400 may be a camera, and the position information of the target is determined based on the captured image information of the target, and the target is a 3D camera.
在一些实施例中,参见图5,位置确认装置400可以包括:第一摄像头模组401和逻辑判断电路402。第一摄像头模组401可以为至少两个摄像头401,被配置为拍摄3D拍摄装置的图像,该至少两个摄像头401可以拍摄不同角度的3D拍摄装置的图像,来获得3D拍摄装置的位置。逻辑判断电路402,被配置为根据3D拍摄装置的图像获得3D拍摄装置的位置。In some embodiments, referring to FIG. 5, the position confirmation device 400 may include: a first camera module 401 and a logic judgment circuit 402. The first camera module 401 may be at least two cameras 401 configured to capture images of a 3D camera. The at least two cameras 401 can take images of the 3D camera from different angles to obtain the position of the 3D camera. The logical judgment circuit 402 is configured to obtain the position of the 3D camera according to the image of the 3D camera.
在一些实施例中,逻辑判断电路402可以被配置为:根据3D拍摄装置的图像中包含的3D拍摄装置平面位置信息得到3D拍摄装置深度信息,从而获得3D拍摄装置的3D拍摄装置坐标。In some embodiments, the logical judgment circuit 402 may be configured to obtain the depth information of the 3D camera according to the plane position information of the 3D camera contained in the image of the 3D camera, so as to obtain the 3D camera coordinates of the 3D camera.
在一些实施例中,3D显示装置410,可以被配置为:将待显示图像渲染为左眼图像和右眼图像,根据3D拍摄装置的位置对左眼图像和右眼图像进行像素分配。由于左右眼图像不同,再基于3D摄像装置的位置对左右眼图像进行不同的像素分配,生成3D显示内容。In some embodiments, the 3D display device 410 may be configured to render the image to be displayed into a left-eye image and a right-eye image, and perform pixel allocation on the left-eye image and the right-eye image according to the position of the 3D camera. Since the left and right eye images are different, different pixel assignments are performed on the left and right eye images based on the position of the 3D camera device to generate 3D display content.
在一些实施例中,3D显示装置410,可以被配置为:将左眼图像和右眼图像分配到3D显示装置的3D显示屏幕中与3D拍摄装置的位置对应的像素上。由此3D显示屏上对应不同观看位置的像素上显示不同的左眼图像和右眼图像,3D显示屏上可以对应不同位置显示不同的3D显示内容。In some embodiments, the 3D display device 410 may be configured to allocate the left-eye image and the right-eye image to pixels corresponding to the position of the 3D photographing device on the 3D display screen of the 3D display device. As a result, different left-eye images and right-eye images are displayed on the pixels corresponding to different viewing positions on the 3D display screen, and different 3D display contents can be displayed corresponding to different positions on the 3D display screen.
在一些实施例中,3D显示装置410,还可以被配置为:显示针对3D拍摄装置的3D显示内容。In some embodiments, the 3D display device 410 may also be configured to display 3D display content for the 3D camera.
参见图6,在一些实施例中,3D显示装置410可以包括3D显示屏幕411,被配置为显示针对3D拍摄装置的3D显示内容。Referring to FIG. 6, in some embodiments, the 3D display device 410 may include a 3D display screen 411 configured to display 3D display content for the 3D camera.
在一些实施例中,参见图7,实现3D显示的装置,还可以包括3D拍摄装置420。该3D拍摄装置可以被配置为接收显示的3D显示内容。In some embodiments, referring to FIG. 7, the device for realizing 3D display may further include a 3D photographing device 420. The 3D photographing device may be configured to receive displayed 3D display content.
在一些实施例中,参见图8,3D拍摄装置420可以包括第二摄像头模组421。第二摄像头模组421包括至少两个摄像头,该至少两个摄像头被配置为以可实现3D显示的方式接收显示的3D显示内容。上述至少两个摄像头可以分别采集左眼图像和右眼图像来获得左眼画面和右眼画面,基于左眼画面和右眼画面的不同,以可实现3D显示的方式接收。In some embodiments, referring to FIG. 8, the 3D camera 420 may include a second camera module 421. The second camera module 421 includes at least two cameras, and the at least two cameras are configured to receive displayed 3D display content in a manner that can realize 3D display. The above-mentioned at least two cameras can separately collect left-eye images and right-eye images to obtain left-eye images and right-eye images. Based on the difference between the left-eye images and the right-eye images, they can be received in a manner that can realize 3D display.
在一些实施例中,3D拍摄装置,还可以被配置为:向用户端传输接收的3D显示内容。3D拍摄装置可以经由网络向用户端传输接收的3D显示内容。In some embodiments, the 3D camera may also be configured to transmit the received 3D display content to the user terminal. The 3D camera can transmit the received 3D display content to the user terminal via the network.
在一些实施例中,3D拍摄装置,还可以被配置为:对主播所在环境进行3D拍摄。In some embodiments, the 3D photographing device may also be configured to take 3D photographs of the environment where the host is located.
在一些实施例中,参见图8,3D拍摄装置420,可以包括第二摄像头模组421,第二摄像头模组421可以包括至少两个摄像头。该至少两个摄像头被配置为以可实现3D显示的方式对主播所在环境进行3D拍摄。3D拍摄装置中的至少两个摄像头分别采集不同的第一图像和第二图像,对应地获得第一画面和第二画面,3D拍摄装置基于上述第一画面和第二画面,以可实现3D显示的方式对主播所在环境的3D拍摄。In some embodiments, referring to FIG. 8, the 3D camera 420 may include a second camera module 421, and the second camera module 421 may include at least two cameras. The at least two cameras are configured to perform 3D shooting of the environment where the host is located in a manner that can realize 3D display. At least two cameras in the 3D shooting device capture different first images and second images, respectively, and obtain the first and second images correspondingly. The 3D shooting device can realize 3D display based on the above-mentioned first and second images. 3D shooting of the environment where the host is located.
在一些实施例中,3D拍摄装置还可以被配置为:将对主播所在环境进行3D拍摄得到的3D拍摄信号向用户端传输。观看直播的用户可以通过3D显示装置播放接收到的3D拍摄信号。In some embodiments, the 3D photographing device may also be configured to transmit the 3D photographing signal obtained by 3D photographing the environment where the host is located to the user terminal. The user watching the live broadcast can play the received 3D shooting signal through the 3D display device.
在一些实施例中,位置确认装置还可以被配置为:对主播进行位置确认以获得主播的位置。基于主播的位置可以获得主播眼球的眼球坐标,方便主播观看到3D拍摄图像。位置确认装置,可以被配置为:拍摄主播的图像,根据主播的图像获得主播的位置。In some embodiments, the location confirmation device may also be configured to confirm the location of the host to obtain the location of the host. Based on the position of the anchor, the eyeball coordinates of the anchor can be obtained, which is convenient for the anchor to watch the 3D captured image. The location confirmation device may be configured to: take an image of the host and obtain the location of the host according to the image of the host.
在一些实施例中,位置确认装置可以包括第一摄像头模组和逻辑判断电路402。第一摄像头模组可以包括至少两个摄像头,上述至少两个摄像头可以被配置为拍摄主播的图像。逻辑判断电路402,被配置为根据主播的图像获得主播的位置。In some embodiments, the location confirmation device may include a first camera module and a logic judgment circuit 402. The first camera module may include at least two cameras, and the above-mentioned at least two cameras may be configured to capture images of the host. The logic judgment circuit 402 is configured to obtain the position of the anchor according to the image of the anchor.
在一些实施例中,逻辑判断电路可以被配置为:根据主播的图像中包含的主播眼球平面位置信息得到主播眼球深度信息,从而获得主播眼球的眼球坐标。In some embodiments, the logical judgment circuit may be configured to obtain the anchor's eyeball depth information according to the anchor's eyeball plane position information contained in the anchor's image, so as to obtain the anchor's eyeball coordinates.
在一些实施例中,3D显示装置还可以被配置为:根据主播的位置生成针对主播的3D显示内容。主播观看到3D显示内容,更容易体验到3D直播的感受。In some embodiments, the 3D display device may also be configured to generate 3D display content for the host according to the location of the host. The anchor watched the 3D display content, and it was easier to experience the feeling of 3D live broadcast.
在一些实施例中,3D显示装置生成针对主播的3D显示内容时,可以被配置为:将待显示图像渲染为左眼图像和右眼图像,根据主播的位置对左眼图像和右眼图像进行像素分 配。In some embodiments, when the 3D display device generates 3D display content for the host, it can be configured to: render the image to be displayed as a left-eye image and a right-eye image, and perform the left-eye image and the right-eye image according to the location of the host. Pixel allocation.
在一些实施例中,3D显示装置进行像素分配时可以被配置为:将左眼图像和右眼图像分配到3D显示装置的3D显示屏幕中与主播的位置对应的像素上,以使3D显示屏幕上针对主播的位置显示3D显示内容。In some embodiments, the pixel allocation of the 3D display device may be configured to: allocate the left eye image and the right eye image to the pixels corresponding to the position of the host in the 3D display screen of the 3D display device, so that the 3D display screen The 3D display content is displayed on the location of the anchor.
在一些实施例中,3D显示装置还可以被配置为:显示针对主播的3D显示内容。主播观看到针对自己的3D显示内容,提高了主播进行直播的使用体验。In some embodiments, the 3D display device may also be configured to display 3D display content for the host. The host can watch the 3D display content for himself, which improves the host’s experience of live broadcast.
在一些实施例中,3D显示装置包括3D显示屏幕。该3D显示屏幕可以被配置为显示针对主播的3D显示内容。In some embodiments, the 3D display device includes a 3D display screen. The 3D display screen may be configured to display 3D display content for the host.
在一些实施例中,位置确认装置还可以被配置为:对主播所在环境进行3D拍摄。In some embodiments, the location confirmation device may also be configured to take a 3D photograph of the environment where the host is located.
在一些实施例中,位置确认装置可以包括第一摄像头模组,第一摄像头模组包括至少两个摄像头。该至少两个摄像头被配置为以可实现3D显示的方式对主播所在环境进行3D拍摄。In some embodiments, the position confirmation device may include a first camera module, and the first camera module includes at least two cameras. The at least two cameras are configured to perform 3D shooting of the environment where the host is located in a manner that can realize 3D display.
在一些实施例中,位置确认装置还可以被配置为:将对主播所在环境进行3D拍摄得到的3D拍摄信号向用户端传输。In some embodiments, the location confirmation device may also be configured to transmit the 3D shooting signal obtained by 3D shooting of the environment where the host is located to the user terminal.
本公开实施例还提供了一种3D显示系统1(参见图9),包括如上文所述实现3D显示的装置。该实现3D显示的装置包括位置确认装置400和3D显示装置410,还可以包括3D拍摄装置420。该3D显示系统可以设置在主播端,也可以设置在用户端,可以根据不同用户的需求设置。The embodiment of the present disclosure also provides a 3D display system 1 (see FIG. 9), which includes a device for realizing 3D display as described above. The 3D display device includes a position confirmation device 400 and a 3D display device 410, and may also include a 3D photographing device 420. The 3D display system can be set on the host side or on the user side, and can be set according to the needs of different users.
本公开实施例提供的实现3D显示的方法、装置及3D显示系统,通过位置确认装置对能够针对3D显示装置进行3D拍摄的3D拍摄装置进行位置确认来获得3D拍摄装置的位置。3D显示装置410,根据3D拍摄装置的位置生成针对3D拍摄装置的3D显示内容。用户可以从3D拍摄装置发来的3D拍摄信号获得对应3D拍摄装置位置的3D画面,处于不同位置的3D拍摄装置可以获得不同的3D画面,提高了用户观看直播的观看体验。According to the method, device and 3D display system for realizing 3D display provided by the embodiments of the present disclosure, the position of the 3D camera capable of 3D shooting of the 3D display device is confirmed by the position confirmation device to obtain the position of the 3D camera. The 3D display device 410 generates 3D display content for the 3D camera based on the position of the 3D camera. The user can obtain the 3D image corresponding to the position of the 3D camera from the 3D shooting signal sent by the 3D camera, and the 3D camera at different positions can obtain different 3D images, which improves the user's viewing experience of watching live broadcasts.
本公开实施例提供了一种计算机可读存储介质,存储有计算机可执行指令,该计算机可执行指令设置为执行上述实现3D显示的方法。The embodiment of the present disclosure provides a computer-readable storage medium that stores computer-executable instructions, and the computer-executable instructions are configured to execute the above-mentioned method for implementing 3D display.
本公开实施例提供了一种计算机程序产品,包括存储在计算机可读存储介质上的计算机程序,该计算机程序包括程序指令,当该程序指令被计算机执行时,使上述计算机执行上述实现3D显示的方法。The embodiments of the present disclosure provide a computer program product, including a computer program stored on a computer-readable storage medium, the computer program including program instructions, when the program instructions are executed by a computer, the computer executes the above-mentioned 3D display method.
上述的计算机可读存储介质可以是暂态计算机可读存储介质,也可以是非暂态计算机可读存储介质。The aforementioned computer-readable storage medium may be a transitory computer-readable storage medium or a non-transitory computer-readable storage medium.
本公开实施例提供的计算机可读存储介质和计算机程序产品,通过位置确认装置对能 够针对3D显示装置进行3D拍摄的3D拍摄装置进行位置确认来获得3D拍摄装置的位置。3D显示装置,根据3D拍摄装置的位置生成针对3D拍摄装置的3D显示内容。从而3D拍摄装置拍摄到对应其位置的3D画面,用户可以从3D拍摄装置获得对应3D拍摄装置的位置的3D画面,处于不同位置的3D拍摄装置获得不同的3D画面,提高了用户观看直播的观看体验。The computer-readable storage medium and computer program product provided by the embodiments of the present disclosure confirm the position of a 3D photographing device capable of 3D photographing with respect to a 3D display device through the position confirming device to obtain the position of the 3D photographing device. The 3D display device generates 3D display content for the 3D camera based on the position of the 3D camera. As a result, the 3D camera captures the 3D image corresponding to its location, and the user can obtain the 3D image corresponding to the position of the 3D camera from the 3D camera, and the 3D camera at different positions obtains different 3D images, which improves the user’s viewing of the live broadcast. Experience.
本公开实施例的技术方案可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括一个或多个指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本公开实施例的方法的全部或部分步骤。而前述的存储介质可以是非暂态存储介质,包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等多种可以存储程序代码的介质,也可以是暂态存储介质。The technical solutions of the embodiments of the present disclosure can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes one or more instructions to enable a computer device (which can be a personal computer, a server, or a network). Equipment, etc.) execute all or part of the steps of the method of the embodiment of the present disclosure. The aforementioned storage medium may be a non-transitory storage medium, including: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks, etc. A medium that can store program codes, or it can be a transient storage medium.
以上描述和附图充分地示出了本公开的实施例,以使本领域技术人员能够实践它们。其他实施例可以包括结构的、逻辑的、电气的、过程的以及其他的改变。实施例仅代表可能的变化。除非明确要求,否则单独的部件和功能是可选的,并且操作的顺序可以变化。一些实施例的部分和特征可以被包括在或替换其他实施例的部分和特征。本公开实施例的范围包括权利要求书的整个范围,以及权利要求书的所有可获得的等同物。当用于本申请中时,虽然术语“第一”、“第二”等可能会在本申请中使用以描述各元件,但这些元件不应受到这些术语的限制。这些术语仅用于将一个元件与另一个元件区别开。比如,在不改变描述的含义的情况下,第一元件可以叫做第二元件,并且同样第,第二元件可以叫做第一元件,只要所有出现的“第一元件”一致重命名并且所有出现的“第二元件”一致重命名即可。第一元件和第二元件都是元件,但可以不是相同的元件。而且,本申请中使用的用词仅用于描述实施例并且不用于限制权利要求。如在实施例以及权利要求的描述中使用的,除非上下文清楚地表明,否则单数形式的“一个”(a)、“一个”(an)和“所述”(the)旨在同样包括复数形式。类似地,如在本申请中所使用的术语“和/或”是指包含一个或一个以上相关联的列出的任何以及所有可能的组合。另外,当用于本申请中时,术语“包括”(comprise)及其变型“包括”(comprises)和/或包括(comprising)等指陈述的特征、整体、步骤、操作、元素,和/或组件的存在,但不排除一个或一个以上其它特征、整体、步骤、操作、元素、组件和/或这些的分组的存在或添加。在没有更多限制的情况下,由语句“包括一个…”限定的要素,并不排除在包括该要素的过程、方法或者设备中还存在另外的相同要素。本文中,每个实施例重点说明的可以是与其他实施例的不同之处,各个实施例之间相同相似部分可以互相参见。对于实施例公开的方法、产品等而言,如果其与实施例公开的方法部分相对 应,那么相关之处可以参见方法部分的描述。The above description and drawings sufficiently illustrate the embodiments of the present disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, procedural, and other changes. The examples only represent possible changes. Unless explicitly required, the individual components and functions are optional, and the order of operations can be changed. Parts and features of some embodiments may be included in or substituted for parts and features of other embodiments. The scope of the embodiments of the present disclosure includes the entire scope of the claims and all available equivalents of the claims. When used in this application, although the terms "first", "second", etc. may be used in this application to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, without changing the meaning of the description, the first element can be called the second element, and likewise, the second element can be called the first element, as long as all occurrences of the "first element" are renamed consistently and all occurrences "Second component" can be renamed consistently. The first element and the second element are both elements, but they may not be the same element. Moreover, the terms used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and claims, unless the context clearly indicates, the singular forms "a" (a), "an" (an) and "the" (the) are intended to also include plural forms . Similarly, the term "and/or" as used in this application refers to any and all possible combinations that include one or more of the associated lists. In addition, when used in this application, the term "comprise" (comprise) and its variants "comprises" and/or including (comprising) and the like refer to the stated features, wholes, steps, operations, elements, and/or The existence of components does not exclude the existence or addition of one or more other features, wholes, steps, operations, elements, components, and/or groups of these. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, or device that includes the element. In this article, each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method parts disclosed in the embodiments, then the relevant parts can be referred to the description of the method part.
本领域技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,可以取决于技术方案的特定应用和设计约束条件。本领域技术人员可以对每个特定的应用来使用不同方法以实现所描述的功能,但是这种实现不应认为超出本公开实施例的范围。本领域技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art may realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed by hardware or software may depend on the specific application and design constraint conditions of the technical solution. Those skilled in the art may use different methods for each specific application to realize the described functions, but such realization should not be considered as going beyond the scope of the embodiments of the present disclosure. Those skilled in the art can clearly understand that, for the convenience and conciseness of the description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.
本文所披露的实施例中,所揭露的方法、产品(包括但不限于装置、设备等),可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,单元的划分,可以仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另外,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例。另外,在本公开实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of units may only be a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, the functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
附图中的流程图和框图显示了根据本公开实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或代码的一部分,上述模块、程序段或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个连续的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这可以依所涉及的功能而定。在附图中的流程图和框图所对应的描述中,不同的方框所对应的操作或步骤也可以以不同于描述中所披露的顺序发生,有时不同的操作或步骤之间不存在特定的顺序。例如,两个连续的操作或步骤实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这可以依所涉及的功能而定。框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或动作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flowcharts and block diagrams in the accompanying drawings show the possible implementation architecture, functions, and operations of the system, method, and computer program product according to the embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or part of the code, and the above-mentioned module, program segment, or part of the code contains one or more options for realizing the specified logic function. Execute instructions. In some alternative implementations, the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two consecutive blocks can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the drawings, the operations or steps corresponding to different blocks can also occur in a different order than that disclosed in the description, and sometimes there is no specific operation or step between different operations or steps. order. For example, two consecutive operations or steps can actually be performed substantially in parallel, and they can sometimes be performed in the reverse order, which may depend on the functions involved. Each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or actions, or can be implemented by dedicated hardware Realized in combination with computer instructions.

Claims (22)

  1. 一种实现3D显示的方法,包括:A method for realizing 3D display, including:
    通过位置确认装置,对能够针对3D显示装置进行3D拍摄的3D拍摄装置进行位置确认以获得所述3D拍摄装置的位置;Using the position confirmation device, confirm the position of a 3D photographing device capable of 3D photographing with respect to a 3D display device to obtain the position of the 3D photographing device;
    通过所述3D显示装置,根据所述3D拍摄装置的位置生成针对所述3D拍摄装置的3D显示内容。The 3D display device generates 3D display content for the 3D camera according to the position of the 3D camera.
  2. 根据权利要求1所述的方法,其中,生成所述3D显示内容,包括:The method according to claim 1, wherein generating the 3D display content comprises:
    将待显示图像渲染为左眼图像和右眼图像;Render the image to be displayed into a left-eye image and a right-eye image;
    根据所述3D拍摄装置的位置对所述左眼图像和右眼图像进行像素分配。Pixel allocation is performed on the left-eye image and the right-eye image according to the position of the 3D photographing device.
  3. 根据权利要求2所述的方法,其中,根据所述3D拍摄装置的位置对所述左眼图像和右眼图像进行像素分配,包括:The method according to claim 2, wherein the pixel allocation of the left-eye image and the right-eye image according to the position of the 3D photographing device comprises:
    将所述左眼图像和右眼图像分配到所述3D显示装置的3D显示屏幕中与所述3D拍摄装置的位置对应的像素上。The left-eye image and the right-eye image are allocated to pixels corresponding to the position of the 3D photographing device on the 3D display screen of the 3D display device.
  4. 根据权利要求1至3任一项所述的方法,还包括:显示针对所述3D拍摄装置的所述3D显示内容。The method according to any one of claims 1 to 3, further comprising: displaying the 3D display content for the 3D camera.
  5. 根据权利要求4所述的方法,还包括:通过所述3D拍摄装置接收显示的所述3D显示内容。The method according to claim 4, further comprising: receiving the displayed 3D display content through the 3D photographing device.
  6. 根据权利要求5所述的方法,其中,接收所述3D显示内容,包括:The method according to claim 5, wherein receiving the 3D display content comprises:
    通过所述3D拍摄装置包括的至少两个摄像头,以可实现3D显示的方式接收显示的所述3D显示内容。Through at least two cameras included in the 3D photographing device, the displayed 3D display content is received in a manner that can realize 3D display.
  7. 根据权利要求5所述的方法,还包括:向用户端传输接收的所述3D显示内容。The method according to claim 5, further comprising: transmitting the received 3D display content to the user terminal.
  8. 根据权利要求1所述的方法,还包括:通过所述3D拍摄装置对主播所在环境进行3D拍摄。The method according to claim 1, further comprising: 3D photographing the environment where the host is located through the 3D photographing device.
  9. 根据权利要求1所述的方法,还包括:通过所述位置确认装置对主播进行位置确认以获得所述主播的位置。The method according to claim 1, further comprising: confirming the position of the anchor through the position confirming device to obtain the position of the anchor.
  10. 一种实现3D显示的装置,包括处理器和存储有程序指令的存储器,所述处理器被配置为在执行所述程序指令时,执行如权利要求1至9任一项所述的方法。A device for realizing 3D display, comprising a processor and a memory storing program instructions, the processor is configured to execute the method according to any one of claims 1 to 9 when the program instructions are executed.
  11. 一种实现3D显示的装置,包括:A device for realizing 3D display, including:
    位置确认装置,被配置为对能够针对3D显示装置进行3D拍摄的3D拍摄装置进行位置确认以获得所述3D拍摄装置的位置;A position confirmation device configured to confirm the position of a 3D photographing device capable of 3D photographing with respect to a 3D display device to obtain the position of the 3D photographing device;
    所述3D显示装置,被配置为根据所述3D拍摄装置的位置生成针对所述3D拍摄装置 的3D显示内容。The 3D display device is configured to generate 3D display content for the 3D camera according to the position of the 3D camera.
  12. 根据权利要求11所述的装置,其中,所述3D显示装置,被配置为:The device according to claim 11, wherein the 3D display device is configured to:
    将待显示图像渲染为左眼图像和右眼图像,根据所述3D拍摄装置的位置对所述左眼图像和右眼图像进行像素分配。The image to be displayed is rendered into a left-eye image and a right-eye image, and pixel allocation is performed on the left-eye image and the right-eye image according to the position of the 3D photographing device.
  13. 根据权利要求12所述的装置,其中,所述3D显示装置,被配置为:The device according to claim 12, wherein the 3D display device is configured to:
    将所述左眼图像和右眼图像分配到所述3D显示装置的3D显示屏幕中与所述3D拍摄装置的位置对应的像素上。The left-eye image and the right-eye image are allocated to pixels corresponding to the position of the 3D photographing device on the 3D display screen of the 3D display device.
  14. 根据权利要求11至13任一项所述的装置,其中,所述3D显示装置,还被配置为:显示针对所述3D拍摄装置的所述3D显示内容。The device according to any one of claims 11 to 13, wherein the 3D display device is further configured to display the 3D display content for the 3D photographing device.
  15. 根据权利要求14所述的装置,还包括:3D拍摄装置,被配置为接收显示的所述3D显示内容。The device according to claim 14, further comprising: a 3D photographing device configured to receive the displayed 3D display content.
  16. 根据权利要求15所述的装置,其中,所述3D拍摄装置包括至少两个摄像头,被配置为以可实现3D显示的方式接收显示的所述3D显示内容。The device according to claim 15, wherein the 3D photographing device comprises at least two cameras configured to receive the displayed 3D display content in a manner that can realize 3D display.
  17. 根据权利要求15所述的装置,其中,所述3D拍摄装置,还被配置为:向用户端传输接收的所述3D显示内容。15. The device according to claim 15, wherein the 3D photographing device is further configured to transmit the received 3D display content to the user terminal.
  18. 根据权利要求15所述的装置,其中,所述3D拍摄装置,还被配置为:对主播所在环境进行3D拍摄。The device according to claim 15, wherein the 3D photographing device is further configured to take 3D photographs of the environment where the host is located.
  19. 根据权利要求18所述的装置,其中,所述3D拍摄装置,还被配置为:将对主播所在环境进行3D拍摄得到的3D拍摄信号向用户端传输。18. The device according to claim 18, wherein the 3D photographing device is further configured to transmit a 3D photographing signal obtained by 3D photographing the environment where the host is located to the user terminal.
  20. 一种3D显示系统,包括如权利要求10至19任一项所述的装置。A 3D display system, comprising the device according to any one of claims 10-19.
  21. 一种计算机可读存储介质,存储有计算机可执行指令,所述计算机可执行指令设置为执行如权利要求1至9任一项所述的方法。A computer-readable storage medium storing computer-executable instructions, the computer-executable instructions being configured to execute the method according to any one of claims 1-9.
  22. 一种计算机程序产品,包括存储在计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当该程序指令被计算机执行时,使所述计算机执行如权利要求1至9任一项所述的方法。A computer program product, comprising a computer program stored on a computer-readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer, the computer executes any one of claims 1 to 9 The method described.
PCT/CN2021/071696 2020-01-20 2021-01-14 Method and apparatus for realizing 3d display, and 3d display system WO2021147749A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010072953.4 2020-01-20
CN202010072953.4A CN113141501A (en) 2020-01-20 2020-01-20 Method and device for realizing 3D display and 3D display system

Publications (1)

Publication Number Publication Date
WO2021147749A1 true WO2021147749A1 (en) 2021-07-29

Family

ID=76809284

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/071696 WO2021147749A1 (en) 2020-01-20 2021-01-14 Method and apparatus for realizing 3d display, and 3d display system

Country Status (3)

Country Link
CN (1) CN113141501A (en)
TW (1) TW202129363A (en)
WO (1) WO2021147749A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114422819A (en) * 2022-01-25 2022-04-29 纵深视觉科技(南京)有限责任公司 Video display method, device, equipment, system and medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101435989A (en) * 2007-11-16 2009-05-20 深圳华强数码电影有限公司 Tracking visual field and method for making three-dimensional film by secondary rendering
CN106210856A (en) * 2016-07-26 2016-12-07 武汉斗鱼网络科技有限公司 Internet video live broadcasting platform is watched the method and system of 3D panoramic video
CN106385576A (en) * 2016-09-07 2017-02-08 深圳超多维科技有限公司 Three-dimensional virtual reality live method and device, and electronic device
CN107147896A (en) * 2017-05-26 2017-09-08 沈阳泰科易科技有限公司 Camera device and the live video camera of 3D augmented realities
WO2019019306A1 (en) * 2017-07-27 2019-01-31 深圳依偎控股有限公司 Dual-camera collection-based 3d live broadcasting display method and system
US20190104235A1 (en) * 2017-09-29 2019-04-04 Sony Interactive Entertainment America Llc Spectator view into an interactive gaming world showcased in a live event held in a real-world venue

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2011125368A1 (en) * 2010-04-05 2013-07-08 シャープ株式会社 Stereoscopic image display device, display system, driving method, driving device, display control method, display control device, program, and computer-readable recording medium
CN102868894A (en) * 2011-07-05 2013-01-09 天马微电子股份有限公司 Full-visual angle 3D display image output method, device and display equipment
CN103517061B (en) * 2013-09-03 2015-09-23 展讯通信(上海)有限公司 A kind of display control method of terminal equipment and device
CN103945208B (en) * 2014-04-24 2015-10-28 西安交通大学 A kind of parallel synchronous zooming engine for multiple views bore hole 3D display and method
KR101957243B1 (en) * 2014-07-09 2019-03-12 삼성전자주식회사 Multi view image display apparatus and multi view image display method thereof
CN104536578B (en) * 2015-01-13 2018-02-16 京东方科技集团股份有限公司 Control method and device, the bore hole 3D display device of bore hole 3D display device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101435989A (en) * 2007-11-16 2009-05-20 深圳华强数码电影有限公司 Tracking visual field and method for making three-dimensional film by secondary rendering
CN106210856A (en) * 2016-07-26 2016-12-07 武汉斗鱼网络科技有限公司 Internet video live broadcasting platform is watched the method and system of 3D panoramic video
CN106385576A (en) * 2016-09-07 2017-02-08 深圳超多维科技有限公司 Three-dimensional virtual reality live method and device, and electronic device
CN107147896A (en) * 2017-05-26 2017-09-08 沈阳泰科易科技有限公司 Camera device and the live video camera of 3D augmented realities
WO2019019306A1 (en) * 2017-07-27 2019-01-31 深圳依偎控股有限公司 Dual-camera collection-based 3d live broadcasting display method and system
US20190104235A1 (en) * 2017-09-29 2019-04-04 Sony Interactive Entertainment America Llc Spectator view into an interactive gaming world showcased in a live event held in a real-world venue

Also Published As

Publication number Publication date
CN113141501A (en) 2021-07-20
TW202129363A (en) 2021-08-01

Similar Documents

Publication Publication Date Title
US11089266B2 (en) Communication processing method, terminal, and storage medium
US9948863B2 (en) Self-timer preview image presentation method and apparatus, and terminal
US20150358539A1 (en) Mobile Virtual Reality Camera, Method, And System
US20020030675A1 (en) Image display control apparatus
CN101636747A (en) Two dimensional/three dimensional digital information obtains and display device
WO2010028559A1 (en) Image splicing method and device
JP2014508430A (en) Zero parallax plane for feedback-based 3D video
JP6782812B2 (en) How to control virtual reality devices and virtual reality devices
US9848168B2 (en) Method, synthesizing device, and system for implementing video conference
WO2023169283A1 (en) Method and apparatus for generating binocular stereoscopic panoramic image, device, storage medium, and product
US20120127280A1 (en) Apparatus and method for generating three dimensional image in portable terminal
WO2021147749A1 (en) Method and apparatus for realizing 3d display, and 3d display system
KR102108246B1 (en) Method and apparatus for providing video in potable device
CN107592520B (en) Imaging device and imaging method of AR equipment
WO2021063319A1 (en) Method and device for implementing 3d display, and 3d display terminal
US9177382B2 (en) Image processing apparatus for forming synthetic image and image processing method for forming synthetic image
US10482671B2 (en) System and method of providing a virtual environment
US20240015264A1 (en) System for broadcasting volumetric videoconferences in 3d animated virtual environment with audio information, and procedure for operating said device
US20150264336A1 (en) System And Method For Composite Three Dimensional Photography And Videography
JP7225016B2 (en) AR Spatial Image Projection System, AR Spatial Image Projection Method, and User Terminal
US20210051310A1 (en) The 3d wieving and recording method for smartphones
CN103220458A (en) Stereoscopic camera-shooting device and stereoscopic camera-shooting method
JP2012191575A (en) Imaging device, imaging method, and imaging system
JP2005064681A (en) Image pick-up/display device, image pick-up/display system, video image forming method, program of the method and recording medium having the program recorded thereon
CN115278200A (en) Processing apparatus and display device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21743858

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21743858

Country of ref document: EP

Kind code of ref document: A1