CN117041518A - 3D projection system and 3D video communication system - Google Patents

Abstract

The application relates to the technical field of display, and discloses a 3D projection system and a 3D video communication system, wherein the 3D projection system comprises: the image acquisition device, the 3D projection device and the electronic equipment are respectively connected with the electronic equipment; the image acquisition device is used for acquiring images and sending the acquired images to the electronic equipment; the electronic equipment is used for processing the acquired images to obtain a first viewpoint image and a second viewpoint image, and sending the first viewpoint image and the second viewpoint image to the 3D projection device; and the 3D projection device is used for projecting the received first viewpoint image and the received second viewpoint image. According to the scheme provided by the application, a 3D projection display scheme is realized, the problems of high cost, limited display picture size and the like of using a multi-view 3D display are solved, and the size of a projection picture can be flexibly adjusted by the scheme provided by the application, and the cost is low.

Description

3D projection system and 3D video communication system

Technical Field

The present application relates to the field of display technologies, and in particular, to a 3D projection system and a 3D video communication system.

Background

The 3D video conference is an important application scene of the stereoscopic display technology, and two sides of the video conference can experience face-to-face conversation communication through the 3D video conference. In the current technical solution for implementing 3D video conferences, it is generally required to present the collected images through a 3D display, which results in problems of high cost, difficulty in coping with diversified usage scenarios, greater constraints of users and usage environments, and the like.

Disclosure of Invention

In view of this, the present application provides a 3D projection system and a 3D video communication system, which can adjust the size of a projection screen, and has low cost, so as to solve the problems of high cost, limited display screen size, etc. when using a multi-view 3D display.

Based on the above objects, an aspect of an embodiment of the present application provides a 3D projection system, which specifically includes:

the device comprises an image acquisition device, a 3D projection device and electronic equipment, wherein the image acquisition device and the 3D projection device are respectively connected with the electronic equipment; wherein,

the image acquisition device is used for acquiring an image and sending the acquired image to the electronic equipment;

the electronic equipment is used for processing the acquired images to obtain a first viewpoint image and a second viewpoint image, and sending the first viewpoint image and the second viewpoint image to the 3D projection device;

the 3D projection device is used for projecting the received first viewpoint image and the received second viewpoint image.

In some embodiments, the system further comprises:

and the curtain is used for displaying the first viewpoint image and the second viewpoint image projected by the 3D projection device.

In some embodiments, the curtain includes a display assembly and an adjustment assembly for adjusting a size of the display assembly.

In some embodiments, the image capturing apparatus includes a capturing device and a control portion, where the capturing device is disposed on the control portion, and is configured to capture an image and send the captured image to the electronic device, and the control portion is configured to adjust a position of the capturing device on the control portion and an angle of the capturing device relative to a horizontal plane and a vertical plane in which the capturing device is located.

In some embodiments, the control portion is located a distance from the rear end of the curtain; the distance from the center of the acquisition equipment to the center of the curtain is greater than the distance from any point on the curtain to the center of the curtain, and the plane of the front end of the acquisition equipment is higher than the plane of the front end of the curtain, wherein the front end of the acquisition equipment and the front end of the curtain are both one ends facing the 3D projection device, and one end deviating from the front end of the curtain is the rear end of the curtain.

In some embodiments, the image acquisition apparatus includes at least one acquisition device, and the control section includes: the device comprises at least one control arm and a first sliding frame, wherein the acquisition equipment is arranged in one-to-one correspondence with the control arm, the control arm is arranged on the first sliding frame, and the control arm is used for adjusting the angle of the acquisition equipment relative to the horizontal plane and the vertical plane where the acquisition equipment is located, and adjusting the position of the acquisition equipment on the first sliding frame.

In some embodiments, the first carriage includes a first slide bar and a second slide bar intersecting each other, and the control arm is disposed at a position of the first slide bar or the second slide bar except for the intersection point.

In some embodiments, the first slide bar is provided with a first track on a side facing the control arm;

the second sliding rod is provided with a second track on one side facing the control arm;

the control arm is provided with a first sliding part at one side away from the acquisition equipment; wherein,

the first sliding part is arranged corresponding to the first track or the second track, and the control arm is arranged on the first track or the second track through the first sliding part.

In some embodiments, the control portion includes a first control arm, a second control arm, a third control arm, and a fourth control arm; wherein,

the first control arm is arranged at a first position on the first sliding rod, the second control arm is arranged at a second position on the first sliding rod, the third control arm is arranged at a third position on the second sliding rod, and the fourth control arm is arranged at a fourth position on the second sliding rod; wherein,

the first position and the second position are located on both sides of an intersection of the first slide bar and the second slide bar, and the third position and the fourth position are located on both sides of the intersection.

In some embodiments, the first position is a first end of a first slide bar, the second position is a second end of the first slide bar, the third position is a first end of a second slide bar, and the fourth position is a second end of the second slide bar.

In some embodiments, the first rail is at the first and second positions, and the second rail is at the third and fourth positions, respectively, provided with a first groove;

the first sliding member is provided with a first protrusion on a side facing the first rail or the second rail;

the first groove and the first protrusion are correspondingly arranged, so that the first sliding part is fixed on the first track or the second track.

In some embodiments, the intersection of the first slide bar and the second slide bar is located at the center of the first slide bar and the center of the second slide bar.

In some embodiments, the 3D projection device includes: the three-dimensional (3D) projector comprises a 3D projector, a supporting adjusting frame and a second sliding frame, wherein the 3D projector is arranged on the supporting adjusting frame, the supporting adjusting frame is arranged on the second sliding frame, and the supporting adjusting frame is used for adjusting the position of the 3D projector relative to the second sliding frame and the angle of the horizontal plane and the vertical plane where the 3D projector is located.

In some embodiments, the support adjustment bracket includes a support adjustment bracket body, a sliding portion, and a rotating portion, wherein,

the sliding part is arranged on one side of the supporting and adjusting frame body facing the second sliding frame and is used for being connected with the second sliding frame in a sliding way so as to adjust the position of the sliding part on the second sliding frame;

the rotating part is arranged on one side of the supporting and adjusting frame body facing the 3D projector and is used for being connected with the 3D projector so as to adjust the angle of the 3D projector relative to the horizontal plane and the vertical plane where the 3D projector is positioned;

the support adjusting frame body is a telescopic support adjusting frame body and is used for adjusting the height of the 3D projector relative to the second sliding frame.

In some embodiments, the second sliding frame is provided with a third rail on one side connected with the sliding part, the third rail is arranged corresponding to the sliding part, and the support adjusting frame moves on the second sliding frame through the sliding part.

In some embodiments, the acquisition device comprises a camera or a webcam.

In some embodiments, the electronic device is configured with a three-dimensional reconstruction network model for predicting the acquired images to output the first and second viewpoint images.

In another aspect of the embodiment of the present application, there is also provided a 3D video communication system, including: the system comprises a first 3D projection system and a second 3D projection system, wherein the first 3D projection system and the second 3D projection system are both 3D projection systems.

Drawings

In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings that are necessary for the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the application and that other embodiments may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic structural diagram of a 3D projection system according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of a curtain according to an embodiment of the present application;

fig. 3 is a schematic structural diagram of an image capturing device according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of a first sliding frame according to an embodiment of the present application;

fig. 5 is a schematic structural view of a first sliding frame according to an embodiment of the present application;

fig. 6 is a schematic diagram of a positional relationship between an image acquisition device, a 3D projection device and a curtain according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of a 3D projection apparatus according to an embodiment of the present application;

FIG. 8 is a schematic diagram of pre-training a three-dimensional reconstruction network model according to an embodiment of the present application;

FIG. 9 is a schematic diagram of tuning a three-dimensional reconstruction network model according to an embodiment of the present application;

fig. 10 is a schematic diagram of an embodiment of a 3D conference communication system provided by the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the following embodiments of the present application will be described in further detail with reference to the accompanying drawings.

Embodiments of the present disclosure are described below. However, it is to be understood that the disclosed embodiments are merely examples and that other embodiments may take various alternative forms. The figures are not necessarily to scale; some functions may be exaggerated or minimized to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present application. As will be appreciated by one of ordinary skill in the art, the various features illustrated and described with reference to any one of the figures may be combined with features illustrated in one or more other figures to produce embodiments that are not explicitly illustrated or described. The combination of features shown provides representative embodiments for typical applications. However, various combinations and modifications of the features consistent with the teachings of the present disclosure may be desired for certain specific applications or implementations.

Unless defined otherwise, technical or scientific terms used in this disclosure should be given the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure belongs. The terms "first," "second," and the like, as used in this disclosure, do not denote any order, quantity, or importance, but rather are used to distinguish one element from another. Likewise, the terms "a," "an," or "the" and similar terms do not denote a limitation of quantity, but rather denote the presence of at least one. The word "comprising" or "comprises", and the like, means that elements or items preceding the word are included in the element or item listed after the word and equivalents thereof, but does not exclude other elements or items. The terms "connected" or "connected," and the like, are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "upper", "lower", "left", "right", etc. are used merely to indicate relative positional relationships, which may also be changed when the absolute position of the object to be described is changed. The term "and/or" when used in reference to two or more items means that any one of the listed items may be employed by itself, or any combination of two or more of the listed items may be employed.

In a first aspect of an embodiment of the present application, a 3D projection system is provided. In the embodiment shown in fig. 1, the 3D projection system specifically includes an image capturing device 10, a 3D projection device 20, and an electronic apparatus 30, where the image capturing device 10 and the 3D projection device 20 are connected to the electronic apparatus 30, respectively. The image capturing device 10 is configured to capture an image and send the captured image to the electronic device 30, the electronic device 30 is configured to process the captured image to obtain a first viewpoint image and a second viewpoint image, and send the first viewpoint image and the second viewpoint image to the 3D projection device 20,3D, and the projection device 20 is configured to project the received first viewpoint image and the received second viewpoint image.

The specific process of projection by the 3D projection system is as follows:

acquiring an image by the image acquisition device 10 and transmitting the acquired image to the electronic apparatus 30; processing the acquired images by the electronic device 30 to obtain a first viewpoint image and a second viewpoint image, and transmitting the first viewpoint image and the second viewpoint image to the 3D projection apparatus 20; the received first view image and second view image are projected by the 3D projection device 20.

According to the embodiment of the application, the 3D display cost is reduced by adopting a 3D display mode of combining the 3D projection device, the image acquisition device and the electronic equipment.

In some examples, the electronic device may be, but is not limited to, a desktop, notebook, server, or the like electronic device.

In some examples, the 3D projection device may project the first and second viewpoint images to a plane, e.g., a plane such as a wall, a floor, or a flat panel, but is not limited thereto. The size of the projection image can be adjusted by adjusting the distance between the 3D projection device and the projection plane, so that the 3D projection system can be suitable for projection spaces with different sizes. The user can see the first view image and the second view image projected to the plane by wearing 3D glasses. In the disclosed embodiments, the first and second viewpoint images may be used to represent a left eye image corresponding to a left eye of a user wearing 3D glasses and a right eye image corresponding to a right eye of the user wearing 3D glasses, respectively. By wearing 3D glasses, the left eye of the user can see the left eye image projected by the 3D projection device, the right eye of the user can only see the right eye image projected by the 3D projection device, and the 3D image is synthesized in the brain through the seen left eye image and right eye image.

In some embodiments, as shown in fig. 1, in order to improve the projection effect, the projected first and second viewpoint images may be made clearer, and the first and second viewpoint images may also be projected onto the curtain 40.

In some examples, as shown in fig. 2, the curtain 200 includes a display component 201 and an adjustment component 202, with the adjustment component 202 being able to adjust the size of the display component 201. The adjusting component can be formed by matching the rotating shaft with the driving motor, the display component can comprise a plurality of display screens with different sizes, and a user can select the display screens with different sizes according to the use scene.

According to the embodiment of the disclosure, the first viewpoint image and the second viewpoint image can be projected onto the display screen with corresponding sizes by adjusting the distance between the 3D projection device and the display screen, so that the 3D projection system is not limited by the number of users and the use place, and can be applied to scenes with different sizes of the number of users and the use place.

According to the embodiment of the disclosure, the 3D display mode of the three cooperation of the 3D projection device, the image acquisition device and the electronic equipment is adopted to replace a traditional multi-view 3D display, so that the problems of high cost, limited display picture size and the like of the multi-view 3D display are solved.

In some embodiments, as shown in fig. 3, the image capturing apparatus includes a capturing device 41 and a control section 42, the capturing device 41 is disposed on the control section 42, a plurality of capturing devices correspond to one control section, the capturing device 41 is configured to capture an image and send the captured image to the electronic device, and the control section 42 is configured to adjust a position of the capturing device 41 on the control section 42 and an angle of the capturing device 41 relative to a horizontal plane and a vertical plane in which the capturing device 42 is located.

In some examples, the capture device may be a device such as a camera or webcam that can capture images, which are all information captured within the field of view of the capture device.

In the embodiment of the disclosure, the position and the angle of the acquisition equipment are adjusted by the control part, so that the 3D projection system can be suitable for different scenes.

In some embodiments, referring to fig. 3, the control portion includes a control arm 43 and a first carriage 44, the collection devices 41 are disposed in one-to-one correspondence with the control arm 43, in the embodiment of the present disclosure, the control portion 42 includes 2 control arms 43 and 1 first carriage 44, and the number of collection devices 41 is also 2, and 2 collection devices 41 are disposed on two sides of a midpoint of the first carriage 44 through the 2 control arms, respectively. By controlling the control arm 43 to slide on the first carriage 44, the collecting devices 41 are always moved on the first carriage 44, and each collecting device 41 is correspondingly moved along a straight line of the first carriage 44.

In the embodiment of the disclosure, the positions of the corresponding acquisition devices on the first sliding frame are respectively adjusted by the control arms, so that a user can adjust the acquisition devices to the optimal positions of the control part according to a use scene to acquire images.

In some examples, the 3D projection system of the embodiments of the present disclosure may be applied to a 3D video conference scene, and when two communicating parties perform a 3D video conference, the position of the acquisition device on the control portion may be adjusted according to the number of communicating people. When the number of communication persons is large, the acquisition device is located at a position close to the end part or at the end part of the control part, so that the acquisition device can acquire more image information. When communication personnel are not more, the acquisition equipment can be positioned at the position of the control part, which is away from the end part and is close to the center of the control part, so that the image information acquired by the acquisition equipment is reduced, and the processing speed of the electronic equipment on the acquired images is improved.

In some embodiments, referring to fig. 3, control arm 43 may also be used to adjust the angle at which acquisition device 41 performs image acquisition. Specifically, the control arm 43 can control the collection device 41 to rotate up and down, and left and right, wherein the up and down rotation refers to the rotation of the collection device 41 along the horizontal plane where the collection device is located, and the left and right rotation refers to the rotation of the collection device along the vertical plane where the collection device is located.

According to the embodiment of the disclosure, the optional orientation of the acquisition equipment can be controlled through the control arm, so that the image acquisition angle can be adjusted to the optimal angle when the acquisition equipment acquires images.

In some examples, the 3D projection system of the embodiments of the present disclosure may be applied to a 3D video conference scene, and when two communication parties perform a 3D video conference, the angle of the collected image of the collecting device may be adjusted according to the positions of the two communication parties, and one end of the collected image of the collecting device is aligned to the position of the communication party.

In some examples, after adjusting the position of the control arm 43 on the first carriage 44, the control arm 43 may be secured to the first carriage 44 by fasteners in order to prevent movement of the control arm.

In some examples, the position of the control arm 43 on the first carriage 44 may be manually adjusted, or a motor and a transmission chip may be provided in the control arm 43, the transmission chip may be connected to an electronic device, and a driving instruction may be sent to the transmission chip by the electronic device to drive the motor, thereby adjusting the position of the control arm 43 on the first carriage 44.

In some embodiments, as shown in fig. 4, the first carriage includes a first slide bar 51 and a second slide bar 52 intersecting each other, and the control portion includes a first control arm 61, a second control arm 62, a third control arm 63, and a fourth control arm 64; the first control arm 61 is disposed at a first position on the first slide rod 51, the second control arm 62 is disposed at a second position on the first slide rod 51, the third control arm 63 is disposed at a third position on the second slide rod 52, and the fourth control arm 64 is disposed at a fourth position on the second slide rod 52; the first and second positions are located on both sides of the intersection of the first and second slide bars, and the third and fourth positions are located on both sides of the intersection.

In some examples, the first, second, third, and fourth positions may be ends of the first slide bar 51, and corresponding third and fourth positions may be ends of the second slide bar 52, denoted as A1, A2, A3, A4, respectively, in embodiments of the present disclosure.

In some examples, the first, second, third, and fourth positions may also be positions between the end of the slide bar and the intersection, with continued reference to fig. 4, and the first, second, third, and fourth positions may also be positions represented by B1, B2, B3, B4, or positions represented by C1, C2, C3, C4.

In some embodiments, to minimize user operations and ensure user experience, the acquisition device may be divided into multiple slide levels, with continued reference to fig. 4, the positions denoted A1, A2, A3, A4 are determined to be a first slide level, the positions denoted B1, B2, B3, B4 are determined to be a second slide level, and the positions denoted C1, C2, C3, C4 are determined to be a third slide level. Correspondingly, the curtain can also be adjusted to the size corresponding to each sliding grade, so that the curtain can be corresponding to the acquisition equipment when the acquisition equipment is positioned at different sliding grades.

Therefore, when the 3D projection system of the embodiment of the disclosure is applied to a 3D video conference scene, two communication parties of the 3D video conference can select different sliding grades according to the scale of participants and the size of a conference room.

In some embodiments, as shown in fig. 5, a specific embodiment of yet another first carriage is provided. In the embodiment of the present disclosure, the first sliding frame includes a first sliding rod 51 and a second sliding rod 52 disposed perpendicular to each other, the first sliding rod 51 includes a first rail 53, the second sliding rod 52 includes a second rail 54, a first control arm 61 is disposed at a first end portion on the first sliding rod 51, a second control arm 62 is disposed at a second end portion on the first sliding rod 51, a third control arm 63 is disposed at a first end portion on the second sliding rod 52, and a fourth control arm 64 is disposed at a second end portion on the second sliding rod 52; the first control arm 61, the second control arm 62, the third control arm 63 and the fourth control arm 64 each include a first slide member 65 (not shown in the drawings), the first rail 53 has an end of the first slide lever 51, and the second rail 54 has first grooves (not shown in the drawings) provided at the end of the second slide lever 52, respectively; the first sliding member 65 is provided with a first protrusion (not shown in the drawings) on a side facing the first rail 53 or the second rail 54; the first groove and the first protrusion are provided correspondingly, and the first sliding member 65 is fixed to the first rail or the second rail by the first groove and the first protrusion. Therefore, the control arm can be more stably fixed on the sliding rod, and the stability of the acquisition equipment when acquiring images is improved.

Fig. 6 is a schematic diagram illustrating a positional relationship among the image capturing device, the 3D projection device and the curtain. The image acquisition devices on the left side of fig. 6 are located at the four corners of the curtain, and the image acquisition devices on the right side of fig. 6 are located at the very middle of the four sides of the curtain.

In some embodiments, the positional relationship of the image capturing device, the 3D projection device and the curtain is described with reference to fig. 2, 3 and 6.

In the embodiment of the disclosure, the projection end of the 3D projection device faces the curtain, the end face of the projection end is a certain distance away from the front end face of the curtain, and the area of the 3D image to be projected by the 3D projection device is small and positively correlated with the distance.

In the embodiment of the present disclosure, the image capturing apparatus includes the capturing device 41 and the control section 42, in order to prevent the curtain from blocking the capturing view angle of the capturing device 41, the plane in which the front end of the capturing device is located is set to be higher than the plane in which the front end of the curtain is located. The control part 42 includes a control arm 43 and a first carriage 44, and in order to prevent the control part 42 (not shown in fig. 6) and the collecting device 41 from colliding with the curtain, distances from the collecting device center, the control arm center, and the first carriage center to the curtain center are set to be greater than distances from the curtain edge to the curtain center. The front end of the acquisition device and the front end of the curtain are both the end facing the 3D projection device and closest to the vertical distance of the 3D projection device, and the rear end of the curtain is the end far away from the front end of the curtain and farthest from the vertical distance of the 3D projection device.

According to the embodiment of the disclosure, the 3D projection system can be applicable to different application scenes by the aid of the 3D projection mode of mutually matching of the image acquisition device, the 3D projection device and the electronic equipment. In some embodiments, as shown in fig. 7, the 3D projection device includes: the 3D projector 610, the support adjusting frame 620 and the second sliding frame 630,3D are arranged on the support adjusting frame 620, the support adjusting frame 620 is arranged on the second sliding frame 630, the support adjusting frame 620 is used for adjusting the height of the 3D projector 610 relative to the second sliding frame 630, and the position on the second sliding frame 630, and the support adjusting frame 620 is also used for adjusting the angle of the 3D projector 610 relative to the horizontal plane and the vertical plane where the 3D projector 610 is located. Therefore, the user can adjust the height of the 3D projector 610 relative to the second sliding frame 630 and the position of the 3D projector 610 on the second sliding frame 630, and the angle of the 3D projector 610 relative to the user according to the space required for projection, so that the 3D projection system can be suitable for different application scenes, and the practicability of the 3D projection system is improved.

In some embodiments, as shown in fig. 7, the support adjustment bracket 620 includes a support adjustment bracket body 621, a sliding portion 622, and a rotating portion 623. The sliding part 622 is disposed on a side of the supporting adjustment frame body 621 facing the second sliding frame 630, and is used for sliding connection with the second sliding frame 630, so as to adjust the position of the sliding part 622 on the second sliding frame 630; the rotating part 623 is disposed on the side of the supporting adjustment frame body 621 facing the 3D projector 610, and is used for connecting with the 3D projector 610 to adjust the angle of the 3D projector 610 relative to the horizontal plane and the vertical plane of the 3D projector 610; the support adjustment frame body 621 is a telescopic support adjustment frame body for adjusting the height of the 3D projector 610 with respect to the second sliding frame 630.

In some embodiments, referring to fig. 7, the second sliding frame 630 is provided with a third rail (not shown) at a side to which the sliding part 622 is connected, the third rail being provided corresponding to the sliding part 622, thereby allowing the support adjustment frame 620 to smoothly slide on the second sliding frame 630 through the sliding part 622.

In some embodiments, the electronic device is configured with a three-dimensional reconstruction network model for predicting the acquired images to output left-eye and right-eye images.

The acquired images are all information shot in the field angle of the acquisition equipment, each acquisition equipment corresponds to one shooting area, and when the electronic equipment processes the image information acquired by the acquisition equipment, the electronic equipment processes the content of the public shooting area shot by all the acquisition equipment. The electronic equipment processes image information of people in a public shooting area through a preset three-dimensional reconstruction network model to obtain a left eye image and a right eye image, and projects the obtained left eye image and right eye image.

In the embodiment of the present disclosure, the three-dimensional reconstruction network model is a pre-trained three-dimensional reconstruction network model, as shown in fig. 8 and 9, and is a training process of the three-dimensional reconstruction network model, which specifically includes the following steps:

1) The three-dimensional reconstruction network model is pre-trained using a large-scale virtual data set as input, where the large-scale virtual data performs a variety of different actions for a variety of different wearers. And (3) pre-training the three-dimensional reconstruction network model through the virtual data set to obtain a group of pre-training weight files. The pre-training process can lead the three-dimensional reconstruction network model to learn the main geometric features and color features of the person, thereby realizing a basic generalization capability for generating the portrait.

2) The method comprises the steps of performing tuning on data which are collected in a 3D projection system in a period of time and contain people on the basis of a pre-trained three-dimensional reconstruction network model, inputting parameters obtained in the tuning process into the three-dimensional reconstruction network model as optimal weight parameter files, using the three-dimensional reconstruction network model with the optimal weight parameter files applied as a real-time inference network, and processing the data collected in real time by the 3D projection system to obtain a first viewpoint image and a second viewpoint image.

In the real-time deducing process of the three-dimensional reconstruction network model, inputting the image acquired by the image acquisition device in real time into the three-dimensional reconstruction network model for first viewpoint image prediction and second viewpoint image prediction, transmitting the predicted first viewpoint image and second viewpoint image to a projector through a video transmission interface of electronic equipment, projecting the first viewpoint image and the second viewpoint image onto a curtain by the projector, and enabling a user to see the 3D image projected onto the curtain by wearing 3D glasses.

In some examples, in the process of tuning based on the pre-trained three-dimensional reconstruction network model, the collected images may be further grouped according to the sliding grade by combining with the sliding grade of the collection device to obtain a plurality of groups of data about the person. The number of acquisition devices required is reduced and the sensitivity to changes in acquisition device position is reduced relative to conventional interpolation display algorithms.

Based on the same inventive concept, a second aspect of the embodiments of the present application proposes a 3D video communication system. A 3D video communication system comprising: the system comprises a first 3D projection system and a second 3D projection system, wherein the first 3D projection system and the second 3D projection system are both 3D projection systems.

In some embodiments, as shown in fig. 10, is an end-to-end 3D video communication system, the 3D video communication system comprising: a first 3D projection system 910 and a second 3D projection system 920, the first 3D projection system 910 comprising a first image acquisition device 911, a first 3D projection device 912 and a first electronic device 913, the second 3D projection system 920 comprising a second image acquisition device 921, a second 3D projection device 922 and a second electronic device 923.

The specific process of 3D projection by the 3D video communication system is as follows:

the first image capturing device 911 captures an image and transmits the captured image to the first electronic device 913 for encoding, the first electronic device 913 transmits the encoded image to the second electronic device 923 through a network, the second electronic device 923 decodes the received encoded image, predicts the decoded image according to the three-dimensional reconstruction network model to obtain a left/right eye image, and then transmits the left/right eye image to the second 3D projection device 922 for projection.

In the embodiment of the present disclosure, the left/right eye image is a first viewpoint image and a second viewpoint image.

In the above projection process, taking the first 3D projection system 910 as an image capturing end and the second 3D projection system 920 as a display end for multi-viewpoint image processing and projection, the 3D projection is performed by the 3D video communication system. The process of performing 3D projection by using the second 3D projection system 920 as an image capturing end and using the first 3D projection system as a display end for multi-viewpoint image processing and projection is the same as the above projection process, and will not be described herein.

The embodiment of the disclosure is suitable for a 3D video conference communication scene watched by multiple people, and the viewers see the same visual angle picture which simulates left/right eye images when the viewers are positioned at the right center position of a public shooting area.

In some embodiments, when one end of the 3D video conference is a single person, left/right eye images may be generated according to the eye position of the viewer in conjunction with a eye tracking algorithm.

The above discussion of any embodiment is merely exemplary and is not intended to imply that the scope of the disclosure of embodiments of the application, including the claims, is limited to such examples; combinations of features of the above embodiments or in different embodiments are also possible within the idea of an embodiment of the application, and many other variations of the different aspects of the embodiments of the application as described above exist, which are not provided in detail for the sake of brevity. Therefore, any omission, modification, equivalent replacement, improvement, etc. of the embodiments should be included in the protection scope of the embodiments of the present application.

Claims (18)

1. A 3D projection system, comprising:

the device comprises an image acquisition device, a 3D projection device and electronic equipment, wherein the image acquisition device and the 3D projection device are respectively connected with the electronic equipment; wherein,

the image acquisition device is used for acquiring an image and sending the acquired image to the electronic equipment;

the electronic equipment is used for processing the acquired images to obtain a first viewpoint image and a second viewpoint image, and sending the first viewpoint image and the second viewpoint image to the 3D projection device;

the 3D projection device is used for projecting the received first viewpoint image and the received second viewpoint image.

2. The system of claim 1, further comprising:

and the curtain is used for displaying the first viewpoint image and the second viewpoint image projected by the 3D projection device.

3. The system of claim 2, wherein the curtain comprises a display assembly and an adjustment assembly for adjusting a size of the display assembly.

4. The system of claim 2, wherein the image capturing device includes a capturing device and a control portion, the capturing device being disposed on the control portion for capturing an image and transmitting the captured image to the electronic device, the control portion being configured to adjust a position of the capturing device on the control portion and an angle of the capturing device relative to a horizontal plane and a vertical plane in which the capturing device is located.

5. The system of claim 4, wherein the control portion is located a distance from the rear end of the curtain; the distance from the center of the acquisition equipment to the center of the curtain is greater than the distance from any point on the curtain to the center of the curtain, and the plane of the front end of the acquisition equipment is higher than the plane of the front end of the curtain, wherein the front end of the acquisition equipment and the front end of the curtain are both one ends facing the 3D projection device, and one end deviating from the front end of the curtain is the rear end of the curtain.

6. The system according to claim 4, wherein the image acquisition apparatus includes at least one acquisition device, and the control section includes: the device comprises at least one control arm and a first sliding frame, wherein the acquisition equipment is arranged in one-to-one correspondence with the control arm, the control arm is arranged on the first sliding frame, and the control arm is used for adjusting the angle of the acquisition equipment relative to the horizontal plane and the vertical plane where the acquisition equipment is located, and adjusting the position of the acquisition equipment on the first sliding frame.

7. The system of claim 6, wherein the first carriage comprises first and second sliding bars that intersect each other, the control arm being disposed at a location other than the intersection of the first or second sliding bars.

8. The system according to claim 7, characterized in that the first slide bar is provided with a first track on the side facing the control arm;

the second sliding rod is provided with a second track on one side facing the control arm;

the control arm is provided with a first sliding part at one side away from the acquisition equipment; wherein,

the first sliding part is arranged corresponding to the first track or the second track, and the control arm is arranged on the first track or the second track through the first sliding part.

9. The system of claim 7, wherein the control comprises a first control arm, a second control arm, a third control arm, and a fourth control arm; wherein,

the first control arm is arranged at a first position on the first sliding rod, the second control arm is arranged at a second position on the first sliding rod, the third control arm is arranged at a third position on the second sliding rod, and the fourth control arm is arranged at a fourth position on the second sliding rod; wherein,

the first position and the second position are located on both sides of an intersection of the first slide bar and the second slide bar, and the third position and the fourth position are located on both sides of the intersection.

10. The system of claim 9, wherein the first position is a first end of a first slide bar, the second position is a second end of the first slide bar, the third position is a first end of a second slide bar, and the fourth position is a second end of the second slide bar.

11. The system of claim 8, wherein the first rail is at the first and second positions and the second rail is at the third and fourth positions, respectively, provided with a first groove;

the first sliding member is provided with a first protrusion on a side facing the first rail or the second rail;

the first groove and the first protrusion are correspondingly arranged, so that the first sliding part is fixed on the first track or the second track.

12. The system of claim 7, wherein the intersection of the first slide bar and the second slide bar is located at a center of the first slide bar and a center of the second slide bar.

13. The system of claim 1, wherein the 3D projection device comprises: the three-dimensional (3D) projector comprises a 3D projector, a supporting adjusting frame and a second sliding frame, wherein the 3D projector is arranged on the supporting adjusting frame, the supporting adjusting frame is arranged on the second sliding frame, and the supporting adjusting frame is used for adjusting the position of the 3D projector relative to the second sliding frame and the angle of the horizontal plane and the vertical plane where the 3D projector is located.

14. The system of claim 13, wherein the support adjustment bracket includes a support adjustment bracket body, a slide, and a swivel, wherein,

the sliding part is arranged on one side of the supporting and adjusting frame body facing the second sliding frame and is used for being connected with the second sliding frame in a sliding way so as to adjust the position of the sliding part on the second sliding frame;

the rotating part is arranged on one side of the supporting and adjusting frame body facing the 3D projector and is used for being connected with the 3D projector so as to adjust the angle of the 3D projector relative to the horizontal plane and the vertical plane where the 3D projector is positioned;

the support adjusting frame body is a telescopic support adjusting frame body and is used for adjusting the height of the 3D projector relative to the second sliding frame.

15. The system of claim 14, wherein the second carriage is provided with a third rail on a side to which the sliding part is connected, the third rail being provided in correspondence with the sliding part, and the support adjustment frame is moved on the second carriage by the sliding part.

16. The system of claim 4, wherein the acquisition device comprises a camera or a webcam.

17. The system of any of claims 1-16, wherein a three-dimensional reconstruction network model is configured on the electronic device, the three-dimensional reconstruction network model configured to predict the acquired images to output the first and second viewpoint images.

18. A 3D video communication system, comprising: a first 3D projection system and a second 3D projection system, wherein the first 3D projection system and the second 3D projection system are each the 3D projection system of any of claims 1-17.