CN108574833B - Projection system, method and server - Google Patents
Projection system, method and server Download PDFInfo
- Publication number
- CN108574833B CN108574833B CN201710135001.0A CN201710135001A CN108574833B CN 108574833 B CN108574833 B CN 108574833B CN 201710135001 A CN201710135001 A CN 201710135001A CN 108574833 B CN108574833 B CN 108574833B
- Authority
- CN
- China
- Prior art keywords
- video data
- range
- video
- projection
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/54—Accessories
- G03B21/56—Projection screens
- G03B21/60—Projection screens characterised by the nature of the surface
- G03B21/62—Translucent screens
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
- Projection Apparatus (AREA)
Abstract
The embodiment of the invention discloses a projection system, a method and a server, wherein the projection system comprises a display device, a projection film and a projector, a display device and the projection film are used for simultaneously displaying first video data and second video data respectively, the first video data and the second video data respectively carry the video data of video images in different depth ranges, the time axis adopted by the first video data and the second video data is the same as the video images and are simultaneously displayed, so that a target object appears on the display device when being in the first range in the projection display process, when the target object moves to the second range, the target object jumps to the projection film, and along with the movement of the target object, a user watching the projection display can feel the movement of the target object between the display device and the projection film along with the change of the depth, thereby achieving the three-dimensional display effect, the user can have an immersive visual sense more easily, and the user experience is improved.
Description
Technical Field
The invention relates to the field of data processing, in particular to a projection system, a projection method, a server and a control interface.
Background
With the development of society, the demand of people for video display effects, such as 3D effects, is also increasing.
Projection, as a common video presentation, also needs to meet this requirement as much as possible.
However, the current projection mode is single, and basically, only simple projection of video signals onto the projection screen can be realized, and the display effect is difficult to meet the user requirements.
Disclosure of Invention
In order to solve the technical problems, the invention provides a projection system, a projection method, a server and a control interface, so that a three-dimensional display effect is achieved, a user can have an immersive visual sense more easily, and the user experience is improved.
The embodiment of the invention discloses the following technical scheme:
in a first aspect, an embodiment of the present application provides a projection system, which includes a display device, a projection film, and a projector:
the display device is used for displaying first video data, the display device is arranged behind the projection film in the video image display direction, the first video data carries video data in a first depth range in a video image, the first depth range comprises a first range in a depth range in which a target object moves in the video image, and the time axis of the first video data is the same as the time axis of the video image;
the projector is configured to project second video data onto the projection film while the display device displays the first video data, where the second video data carries video data in a second depth range in the video image, the second depth range includes a second range in a depth range in which the target object moves in the video image, a time axis used by the second video data is the same as a time axis of the video image, and the first range is deeper than the second range.
Optionally, when the projection film displays the second video data, the display device is not shielded in the display direction to display the first video data.
Optionally, the display surface of the display device is planar or curved;
when the display surface of the display device is planar, the display device and the projection film are parallel, and a connecting line between the display center of the display device and the display center of the projection film is perpendicular to the projection film.
Optionally, the size of the projection film is greater than or equal to the size of the display device.
Optionally, the first range and the second range do not intersect, and the first range and the second range constitute a depth range in which the target object moves in the video image.
Optionally, the first range and the second range partially intersect, and the first range and the second range constitute a depth range in which the target object moves in the video image.
Optionally, the display device is a projection screen, a projection film or a display screen.
Optionally, the third video data carries video data of a movable object in the video image, a moving range of the movable object in the video image includes the first depth range and/or the second depth range, a time axis adopted by the third video data is the same as a time axis of the video image, and the system further includes a projection device:
the projection device is used for projecting the third video data to the display device or a projection film according to the depth range of the movable object in the third video data while the display device displays the first video data.
In a second aspect, an embodiment of the present application provides a projection method, where the method includes:
displaying first video data on display equipment, wherein the display equipment is arranged behind a projection film in the video image display direction, the first video data carries video data in a first depth range in a video image, the first depth range comprises a first range in a depth range in which a target object moves in the video image, and the time axis of the first video data is the same as the time axis of the video image;
and simultaneously projecting second video data on the projection film, wherein the second video data carries video data in a second depth range in the video image, the second depth range comprises a second range in the depth range of the target object moving in the video image, the time axis of the second video data is the same as the time axis of the video image, and the first depth range is deeper than the second depth range.
Optionally, when the projection film displays the second video data, the display device is not shielded in the display direction to display the first video data.
Optionally, the display surface of the display device is planar or curved; when the display surface of the display device is planar, the display device and the projection film are parallel, and a connecting line between the display center of the display device and the display center of the projection film is perpendicular to the projection film.
Optionally, the size of the projection film is greater than or equal to the size of the display device.
Optionally, the first range and the second range do not intersect, and the first range and the second range constitute a depth range in which the target object moves in the video image.
Optionally, the first range and the second range partially intersect, and the first range and the second range constitute a depth range in which the target object moves in the video image.
Optionally, the display device is a projection screen, a projection film, or a display screen, and displaying the first video data on the display device includes:
projecting first video data on a projection screen when the display device is the projection screen or the projection film;
and when the display equipment is a display screen, displaying the first video data on the display screen.
Optionally, the third video data carries video data of a movable object in the video image, a moving range of the movable object in the video image includes the first depth range and/or the second depth range, and a time axis adopted by the third video data is the same as a time axis of the video image, and the method further includes:
projecting the third video data to the presentation device or a projection film according to a depth range in the third video data where the movable object is located while the presentation device is presenting the first video data.
In a third aspect, an embodiment of the present application provides a projection server, where the server includes a generation module and a control module:
the generating module is configured to generate first video data and second video data according to a video image, where the first video data carries video data in a video image within a first depth range, the first depth range includes a first range of depth ranges in which a target object moves in the video image, the second video data carries video data in a second depth range in the video image, the second depth range includes a second range of depth ranges in which the target object moves in the video image, a time axis used by the first video data and the second video data is the same as a time axis of the video image, and the first range is deeper than the second range;
the control module is used for controlling the projector to project the second video data on the projection film and displaying the first video data on a display device while projecting the second video data.
Optionally, the server further includes a modeling module:
and the modeling module is used for modeling according to the display requirement and acquiring the video image meeting the display requirement according to the modeling.
Optionally, the generating module is further configured to generate third video data according to a video image, where the third video data carries video data of a movable object in the video image, a moving range of the movable object in the video image includes the first depth range and/or the second depth range, and a time axis used by the third video data is the same as a time axis of the video image;
the control module is further configured to project the third video data to the presentation device or a projection film according to a depth range of the movable object in the third video data while the presentation device presents the first video data.
In a fourth aspect, an embodiment of the present application provides a projection control interface, where the interface includes an input sub-interface and an output sub-interface:
the input sub-interface comprises an input interface, and is used for receiving first video data and second video data, wherein the first video data carries video data in a video image within a first depth range, the first depth range comprises a first range in a depth range in which a target object moves in the video image, the second video data carries video data in a second depth range in the video image, the second depth range comprises a second range in the depth range in which the target object moves in the video image, a time axis adopted by the first video data and the second video data is the same as that of the video image, and the first range is deeper than the second range;
the output sub-interface comprises an output interface which is used for outputting the first video data and the second video data simultaneously when an output instruction is triggered.
Optionally, the interface further includes an adjustment sub-interface:
the adjusting sub-interface is used for receiving an adjusting instruction, the adjusting instruction comprises an instruction for adjusting the output position of the first video data and/or the second video data, and the adjusting instruction further comprises an instruction for adjusting the output format of the first video data and/or the second video data.
Optionally, the interface further includes a simulation sub-interface:
the simulation sub-interface is used for simulating the display effect of the first video data and/or the second video data.
Optionally, the input sub-interface is further configured to receive third video data, where the third video data carries video data of a movable object in the video image, a moving range of the movable object in the video image includes the first depth range and/or the second depth range, and a time axis used by the third video data is the same as a time axis of the video image;
the output sub-interface is further used for simultaneously outputting the first video data, the second video data and the third video data when the output instruction is triggered.
According to the technical scheme, the projection system comprises the display device, the projection film and the projector, the display device and the projection film are used for simultaneously displaying the first video data and the second video data respectively, the first video data and the second video data carry the video data of the video images in different depth ranges respectively, so that the content of the video images in the first depth range can be displayed through the first video data during displaying, the content of the video images in the second depth range can be displayed through the second video data, the time axes adopted by the first video data and the second video data are the same as the video images and are displayed simultaneously, the video images are displayed together through the projection film and the display device, and the images on the projection film and the display device are linked. Moreover, since the first depth range and the second depth range respectively comprise a part of the depth range in the video image in which the target object moves, during the projection display, the target object may appear on the display device when in the first range, jump from onto the projection film when the target object moves to the second range, since the display device is disposed behind the projection film, the display device displays the first video data carrying the deeper portion of the video data, and the projection film displays the second video data carrying the shallower portion of the video data, the user viewing the projection display can be made to feel the movement of the target object between the display device and the projection film with the depth change as the target object moves, therefore, the three-dimensional display effect is achieved, the user can have an immersive visual sense more easily, and the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic system diagram of a projection system according to an embodiment of the present invention;
fig. 2a is a schematic diagram of a video image according to an embodiment of the present invention;
fig. 2b is a schematic diagram of a video image carried by video data according to an embodiment of the present invention;
FIG. 3 is a flowchart of a method of a projection method according to an embodiment of the present invention;
fig. 4 is a diagram illustrating an apparatus structure of a projection server according to an embodiment of the present invention;
fig. 5 is an interface schematic diagram of a projection control interface according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some embodiments, but not all embodiments, of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In a traditional projection mode, videos to be displayed are generally directly projected onto a projection screen, so that the visual experience of the audience on the scene is difficult to bring, namely, the visual experience of the audience brought by the planar display effect is not high.
To this end, embodiments of the present invention provide a projection system, a method, a server, and a control interface, the projection system including a display device, a projection film, and a projector, simultaneously presenting the first video data and the second video data respectively through the display device and the projection film, the first video data and the second video data carry video data of video images in different depth ranges, respectively, so that when being displayed, the content of the video image in the first depth range can be shown through the first video data, the content of the video image in the second depth range can be shown through the second video data, since the time axis adopted by the first video data and the second video data is the same as that of the video image, and are displayed simultaneously, which is equivalent to displaying the video image together through the projection film and the display equipment, and the images on the projection film and the display equipment are linked.
Moreover, since the first depth range and the second depth range respectively comprise a part of the depth range in the video image in which the target object moves, during the projection display, the target object may appear on the display device when in the first range, jump from onto the projection film when the target object moves to the second range, since the display device is disposed behind the projection film, the display device displays the first video data carrying the deeper portion of the video data, and the projection film displays the second video data carrying the shallower portion of the video data, the user viewing the projection display can be made to feel the movement of the target object between the display device and the projection film with the depth change as the target object moves, therefore, the three-dimensional display effect is achieved, the user can have an immersive visual sense more easily, and the user experience is improved.
Next, a projection system provided by an embodiment of the present invention, such as that shown in FIG. 1, may include a display device 100, a projection film 200, and a projector 300. Compared with the traditional mode, the display device 100 is added instead of only adopting a projection screen or a projection film as a display medium during projection, and the display device 100 and the projection film 200 are matched to display video images during projection to form a comprehensive projection mode, so that a better projection effect is achieved.
In an embodiment of the present invention, the projection film 200 is a visually-penetrable object and may serve as a medium for displaying a video image projected by a projector, for example, the projection film 200 may be a holographic projection film. Since the projection film 200 can be visually penetrated to see the content at the back, in the projection system of the embodiment of the present invention, in the direction of displaying the video image, the display apparatus 100 can be disposed at the back of the projection film 200, that is, the projection film 200 is closer to the user viewing the projection than the display apparatus 100, and since the projection film 200 does not block the display apparatus from displaying the first video data when displaying the second video data in the displaying direction, the user viewing the projection can see both the video image displayed on the projection film 200 and the video image displayed on the display apparatus 100 behind the projection film 200. And the projector 300 may be disposed at a position capable of projecting the first video data onto the projection film 200 according to different projection manners, for example, the projector 300 may be disposed above or behind the user in a manner of playing a movie as in a cinema.
In constructing a projection system according to embodiments of the present invention, the projection film 200 may be suspended from a ceiling or may be supported from a floor, as may be the case with the display device 100. The present invention is not limited to the type of the display device 100, and may have a function of displaying video data, for example, a projection medium similar to the projection film 200, such as a projection screen, a projection film, etc., or a display screen with an active display function, such as an LED screen. When the display apparatus 100 is a projection screen or a projection film, the first video data may be projected onto the display apparatus 100 through another projector (not shown in fig. 1), when the display apparatus 100 is a display screen, the first video data may be remotely transmitted to the display apparatus 100 in a wired or wireless manner so that the display apparatus 100 plays and displays the first video data, or when the display apparatus 100 has a storage medium, the first video data may be stored locally on the display apparatus 100, and the display apparatus 100 may directly play the first video data stored locally.
It should be noted that the depth and the depth range described in the present application may be determined according to an object to be highlighted in the video image, that is, a target object, and the depth of the video frame in the video data may be used to identify a relative position or a relative depth between objects in the video frame, and the depth of an object may be changed as the object moves in the video image. And the depth range of the target object may be used to identify a range between the farthest point and the closest point of the target object moving in the video image, where the farthest or closest may be a concept determined with respect to the viewer, i.e. the position where the target object is located when the viewer sees the target object as smallest may be the farthest point, and the position where the target object is located when the viewer sees the target object as largest may be the closest point. And the depth of the target object may be used to identify a particular numerical value in the depth range that the target object is at a particular time. For example, in a video image showing the revolution of the moon around the earth, the moon moves to a greater extent, and the earth does not move substantially, the moon may be used as a target object, the moon may show a process of becoming larger and smaller during the revolution, and the range of the moon from the minimum depth to the maximum depth may be the depth range of the moon. For another example, in a video image showing how a monkey King flips from far to near, if the degree of movement of monkey King is large, the monkey King can be used as a target object, and the range from the minimum depth to the maximum depth of the monkey King can be a depth range of the monkey King.
In disposing the projection film 200 and the display device 100, it is necessary to dispose the display device 100 behind the projection film 200 in the video projection display direction. The display surface of the display device 100 may be a plane or a curved surface, and when the display surface of the display device 100 is a plane, in order to improve the display effect, the display device 100 and the projection film 200 may be disposed in a relatively parallel manner, and a connection line between the display center of the display device 100 and the display center of the projection film 200 may be perpendicular to the projection film 200 as much as possible, and this disposition may be regarded as a relatively parallel manner. The distance between the display device 100 and the projection film 200 can be set according to the specific field or display requirement, and in order to increase the display angle and avoid affecting the viewing experience of the viewer at the side of the projection film 200, the size of the projection film 200 is generally equal to or larger than the size of the display device 100.
The presentation apparatus 100 is used to present the first video data and the projector 300 is used to project the second video data onto the projection film 200. The first video data and the second video data can be used for displaying contents in different depth ranges in the same video image, wherein the video image can be obtained by modeling in advance according to display requirements, for example, a video image of a moon revolving around the earth can be obtained by establishing models of the moon and the earth in advance, a behavior mode of the moon revolving around the earth is set, and the video image can be determined according to the modeling.
After explaining the concept of depth and depth range in the embodiment of the present application, the first video data and the second video data are explained next.
The first video data and the second video data can be produced according to the video images, and can also be independently produced according to the content required to be carried. For example, the video image may include a pre-made virtual 3D or flat scene, and according to a depth range determined by a motion range of the target object, two paths of video data, i.e., first video data and second video data, may be generated in advance for the video image, or a real scene may be shot as the video image in a specific shooting manner, wherein the two paths of video data, i.e., the first video data and the second video data, are synthesized by shooting at least twice or recording shot contents in a shooting manner of a plurality of cameras.
The first depth range and the second depth range, and the first range and the second range are both concepts of continuous depth ranges, wherein the first depth range needs to include a first range, i.e. a part of a moving range of a target object, so that the first video data can show the target object during the presentation, and the second depth range needs to include a second range, i.e. another part of the moving range of the target object, so that the second video data can show the target object during the presentation, where the first range and the second range belong to different depth ranges in the depth range of the target object. In order to improve the display effect and the consistency during display, the first range and the second range can be provided with no intersection part, so that the target object can be displayed on one of the display device and the projection film at the same time. Furthermore, the first range and the second range may form a coherent interval, for example, the first range and the second range constitute a depth range of the target object, so that the display consistency of the target object can be improved during the display.
There may also be an intersection between the first range and the second range, e.g. the first range being from a depth a to a depth b and the second range being from a depth c to a depth d, wherein depth b is a depth value falling within the second range. The first and second ranges have some intersection or overlap at the edges of the ranges to facilitate alignment or calibration of the video data stitching.
The present application does not limit the manner of determining the first depth range and the second depth range, for example, two parts may be divided into the first depth range and the second depth range according to the total depth range of the video image, in this case, the first depth range may include other depth ranges besides the first depth range, and similarly, the second depth range may include other depth ranges besides the second depth range.
The determination may be performed according to the depth range of the target object, for example, the depth range of the target object may be divided into two parts as a first depth range and a second depth range, in which case, the first depth range may be the same as the first range, and the second depth range may be the same as the second range. For example, in the above example of the grandchild monkey, the depth range that the grandchild monkey represents from the farthest to the nearest may be used as a basis for dividing which video data of the first video data and the second video data carries the video image.
The first depth range and the second depth range may also be determined based on the requirements of the particular scene, such as the distance between the presentation location and the audience, or the distance between the presentation apparatus 100 and the projection film 200. Since the display apparatus 100 is disposed behind the projection film 200 from the perspective of viewing the projection, for reasonable projection display, the first depth range of the content carried by the first video data displayed on the display apparatus 100 is deeper than the second depth range of the content carried by the second video data projected on the projection film 200, and correspondingly, the first depth range is also deeper than the second depth range. Take a video image of a revolution of the moon around the earth as an example, wherein the first depth range is the same as the first range, and the second depth range is the same as the second range. As shown in fig. 2a, in the video image, assuming that the depth range in which the moon 21 revolves around the earth 20 is 100 meters, the depth when the moon 21 has the smallest volume in the visual presentation (point a in fig. 2 a) is 100 meters, and the depth when the moon has the largest volume in the visual presentation (point B in fig. 2 a) is 0 meters, both the first depth range and the second depth range can be 50 meters by a relatively average division method. Since the first depth range is deeper than the second depth range, it can be divided into a first depth range of 100 m to 50 m and a second depth range of 49 m to 0 m, so that the resulting first video data comprises content in the first depth range and the second video data comprises content in the second depth range, as shown in fig. 2 b. When the first video data is displayed, the video image in the depth of 100 m to 50 m in the video image will be displayed on the display device 100, and when the second video data is projected, the video image in the depth of 49 m to 0 m in the video image will be displayed on the projection film 200.
In order to keep the pictures displayed on the display device 100 and the projection film 200 synchronized when displaying the first video data and the second video data, the time axes of the first video data and the second video data are all required to be the same as the time axis of the video image, and taking the video image corresponding to fig. 2a as an example, the length of the video image is 10 seconds, the moon at the 0 th second is at the point a, and the moon at the 10 th second is moved counterclockwise to the point B. The 5 second moon is at a position of a depth of 50 m, the 5.1 second moon is at a position of a depth of 51 m, and if the first depth range is 100 m to 50 m, the second depth range is 49 m to 0 m. Since the time axes of the first video data and the second video data are both the same as the time axis of the video image and are displayed simultaneously, when the first video data is displayed by the display apparatus 100 and the second video data is displayed by the projection film 200, the moon is located on the display apparatus 100 when the first video data and the second video data are output for 5 seconds, and the moon disappears from the display apparatus 100 and appears on the projection film 200 when the first video data and the second video data are output for 5.1 seconds.
It should be noted that although the moon is not shown on the projection film 200 at the time of the 5 th second, the projection film 200 does not show any content in the first 5 seconds, and also shows the content of the video image in the second depth range, such as the moon orbit, and the like, and similarly, although the moon will no longer appear on the display apparatus 100 from the 5.1 th second to the 10 th second, the display apparatus 100 needs to show the content of the video image in the first depth range, such as the earth, the moon orbit, and the like.
It can be seen that, the projection system includes a display device, a projection film and a projector, the display device and the projection film respectively display the first video data and the second video data simultaneously, the first video data and the second video data respectively carry the video data of the video image in the different depth ranges, so when displaying, the content of the video image in the first depth range can be displayed through the first video data, the content of the video image in the second depth range can be displayed through the second video data, since the time axes adopted by the first video data and the second video data are the same as the video image and are displayed simultaneously, which is equivalent to displaying the video image together through the projection film and the display device, and the images on the projection film and the display device are linked. Moreover, since the first depth range and the second depth range respectively comprise a part of the depth range in the video image in which the target object moves, during the projection display, the target object may appear on the display device when in the first range, jump from onto the projection film when the target object moves to the second range, since the display device is disposed behind the projection film, the display device displays the first video data carrying the deeper portion of the video data, and the projection film displays the second video data carrying the shallower portion of the video data, the user viewing the projection display can be made to feel the movement of the target object between the display device and the projection film with the depth change as the target object moves, therefore, the three-dimensional display effect is achieved, the user can have an immersive visual sense more easily, and the user experience is improved.
In addition to the first video data and the second video data can be displayed through projection to achieve the physical display effect in the embodiment of the application, the third video data can be projected in the projection system on the basis.
The third video data carries video data of a movable object in the video image, wherein a movement range of the movable object in the video image comprises the first depth range and/or the second depth range. It can be seen that the moving ranges of the movable object and the target object in the video image may be similar, for example, the moving range of the movable object includes a first depth range and a second depth range, which may be understood as the case where the movable object moves in the first depth range, the case where the movable object moves in the second depth range, and the case where the movable object moves in a depth range other than the first depth range and the second depth range. Or the range of movement of the movable object relative to the target object is more different, for example the range of movement of the movable object is in the first depth range or the second depth range, which is to be understood as the case where the movable object will move in the first depth range and possibly also in other depth ranges, but not in the second depth range, or the case where the movable object will move in the second depth range and possibly also in other depth ranges, but not in the first depth range.
The movable object is also an object that can move in the video image, like the target object, for example, in the case of a moon revolving around the earth, the movable object may be an artificial satellite around the earth, or a meteor or that is stroked from the edge of the earth.
In the embodiment of the present application, the third video data is projected by a projection device, for example, when the projector has a function of multi-path projection, the projection device may be the projector; or the projection device may be another device having a projection function, which is different from the projector.
The projection equipment is used for displaying the third video data while the display equipment displays the first video data, and the time axis adopted by the third video data is the same as that of the video image, so that the third video data can be kept synchronous with the video pictures displayed in the third video data, the first video data and the second video data when being projected.
The projection device projects the third video data in a manner that is different from the manner in which the first video data is projected. Since the movable object may move from the first range to the second range or from the second range to the first range over time in presenting the third video data. In order to make the display effect more stereoscopic and cooperate with the display of the target object, the projection device may project the third video data to the display device or the projection film according to a depth range of the movable object in the third video data. Thus, both the movable object and the target object may be displayed on the display device when they are within the first range and on the projection film when they are within the second range.
The time when the movable object is in the first range and/or the time when the movable object is in the second range may be recorded in the third video data in advance according to the depth range of the movable object and the time of the time axis, so that when the projection apparatus is projecting the third video data, the position where the third video data is projected may be adjusted according to the pre-recorded time, for example, switching between the projection film and the presentation apparatus.
Through the projection of the third video data, the projection display effect can be more flexible, the displayed content and combination are richer, and the display effect is further improved.
Next, a projection method provided by an embodiment of the invention is described.
Fig. 3 is a flowchart of a method of a projection method according to an embodiment of the present invention, where the method includes:
s301: the method comprises the steps that first video data are displayed on display equipment, the display equipment is arranged behind a projection film in the video image display direction, the first video data carry video data which are located in a first depth range in video images, the first depth range comprises a first range in the depth range of moving target objects in the video images, and the time axis of the first video data is the same as the time axis of the video images.
S302: and simultaneously projecting second video data on the projection film, wherein the second video data carries video data in a second depth range in the video image, the second depth range comprises a second range in the depth range of the target object moving in the video image, the time axis of the second video data is the same as the time axis of the video image, and the first depth range is deeper than the second depth range.
It should be noted that S301 and S302 are implemented simultaneously, so that when the first video data and the second video data are displayed, the first video data displayed on the display device and the second video data projected on the projection film can be synchronized to improve the display effect.
The display device may be, for example, a projection screen, a projection film, or a display screen. When the display device is a projection screen or a projection film, the first video data may be projected on the projection screen by means of projection. When the display device is a display screen, the display screen can directly display the first video data on the display screen.
Optionally, when the projection film displays the second video data, the display device is not shielded in the display direction to display the first video data.
Optionally, the display surface of the display device is planar or curved; when the display surface of the display device is planar, the display device and the projection film are parallel, and a connecting line between the display center of the display device and the display center of the projection film is perpendicular to the projection film.
Optionally, the size of the projection film is greater than or equal to the size of the display device.
Optionally, the first range and the second range do not intersect, and the first range and the second range constitute a depth range in which the target object moves in the video image.
Optionally, the first range and the second range partially intersect, and the first range and the second range constitute a depth range in which the target object moves in the video image.
Optionally, the third video data carries video data of a movable object in the video image, a moving range of the movable object in the video image includes the first depth range and/or the second depth range, a time axis adopted by the third video data is the same as a time axis of the video image, and the system further includes a projection device:
projecting the third video data to the presentation device or a projection film according to a depth range in the third video data where the movable object is located while the presentation device is presenting the first video data.
It can be seen that, in the display system, the first video data and the second video data are respectively and simultaneously displayed through the display device and the projection film, and the first video data and the second video data respectively carry the video data of the video image in the different depth ranges, so that during display, the content of the video image in the first depth range can be displayed through the first video data, and the content of the video image in the second depth range can be displayed through the second video data. Moreover, since the first depth range and the second depth range respectively comprise a part of the depth range in the video image in which the target object moves, during the projection display, the target object may appear on the display device when in the first range, jump from onto the projection film when the target object moves to the second range, since the display device is disposed behind the projection film, the display device displays the first video data carrying the deeper portion of the video data, and the projection film displays the second video data carrying the shallower portion of the video data, the user viewing the projection display can be made to feel the movement of the target object between the display device and the projection film with the depth change as the target object moves, therefore, the three-dimensional display effect is achieved, the user can have an immersive visual sense more easily, and the user experience is improved.
Next, a projection server in an embodiment of the present application is described, and as shown in fig. 4, the server includes a generation module 401 and a control module 402:
the generating module 401 is configured to generate first video data and second video data according to a video image, where the first video data carries video data in a first depth range in the video image, the first depth range includes a first range in a depth range in which a target object moves in the video image, the second video data carries video data in a second depth range in the video image, the second depth range includes a second range in the depth range in which the target object moves in the video image, a time axis used by the first video data and the second video data is the same as a time axis of the video image, and the first range is deeper than the second range.
The control module 402 is configured to control the projector to project the second video data on the projection film, and is further configured to display the first video data on a display device while projecting the second video data.
Therefore, the generation module of the server can generate the first video data and the second video data required by projection for the projection system of the application, and the server also provides a uniform control module for providing uniform play control when the second video data is projected and the first video data is displayed, so that the first video data and the second video data can be synchronously displayed, and the display effect is improved.
In order to improve the generation efficiency and the accuracy of the first video data and the second video data, optionally, a modeling module is further provided in the server, and the modeling module is configured to perform modeling according to a display requirement and acquire a video image meeting the display requirement according to the modeling.
The efficiency of obtaining video images through the mode of modeling is higher than that of obtaining video images through the mode of directly shooting real scenes, and modeling can be adjusted according to display requirements, so that the video images which are more accurate and meet the display requirements can be obtained compared with uncontrollable real scenes.
In addition to the first video data and the second video data can be displayed through projection to achieve the physical display effect in the embodiment of the application, the third video data can be projected on the basis. Optionally, the generating module is further configured to generate third video data according to a video image, where the third video data carries video data of a movable object in the video image, a moving range of the movable object in the video image includes the first depth range and/or the second depth range, and a time axis used by the third video data is the same as a time axis of the video image;
the control module is further configured to project the third video data to the presentation device or a projection film according to a depth range of the movable object in the third video data while the presentation device presents the first video data.
Through the projection of the third video data, the projection display effect can be more flexible, the displayed content and combination are richer, and the display effect is further improved.
Moreover, since the first depth range and the second depth range respectively comprise a part of the depth range in the video image in which the target object moves, during the projection display, the target object may appear on the display device when in the first range, jump from onto the projection film when the target object moves to the second range, since the display device is disposed behind the projection film, the display device displays the first video data carrying the deeper portion of the video data, and the projection film displays the second video data carrying the shallower portion of the video data, the user viewing the projection display can be made to feel the movement of the target object between the display device and the projection film with the depth change as the target object moves, therefore, the three-dimensional display effect is achieved, the user can have an immersive visual sense more easily, and the user experience is improved.
Referring next to a projection control interface provided by an embodiment of the present application, as shown in fig. 5, the control interface 500 may include an input sub-interface 510 and an output sub-interface 520:
the input sub-interface 510 includes an input interface for receiving first video data and second video data, the first video data carrying video data in a first depth range in a video image, the first depth range including a first range in a depth range in which a target object moves in the video image, the second video data carrying video data in a second depth range in the video image, the second depth range including a second range in the depth range in which the target object moves in the video image, a time axis adopted by the first video data and the second video data is the same as a time axis of the video image, and the first range is deeper than the second range.
The output sub-interface 520 includes an output interface for outputting the first video data and the second video data simultaneously when an output instruction is triggered.
For example, through the input interface for inputting video data provided by the control interface, a technician may input video data to be displayed and projected through the input interface, and after the first video data and the second video data are successfully input, the technician may output the first video data and the second video data through the output sub-interface 520 by issuing an output instruction, thereby completing output of the two paths of video data to corresponding display devices. The control interface provides convenience for technical personnel to implement the projection method in the embodiment of the application, and can effectively achieve the effect of simultaneously outputting two paths of video data.
Besides the realization of outputting video data simultaneously, the control interface 500 can also realize the adjustment of video data, optionally, the control interface 500 further includes an adjustment sub-interface:
the adjusting sub-interface is used for receiving an adjusting instruction, wherein the adjusting instruction comprises an instruction for adjusting the output position of the first video data and/or the second video data, and the adjusting instruction further comprises an instruction for adjusting the output format of the first video data and/or the second video data.
By receiving the adjustment instruction, the output positions of the two paths of video data can be adjusted through the adjustment sub-interface, for example, the first video data is adjusted to other display devices from the output position where the first video data is originally output to the display devices, so that the first video data can be displayed on the other display devices when the first video data is output.
Moreover, the output format of the video data can be adjusted by receiving the adjustment instruction, so that the requirements of different types of projectors or display equipment on projection and playing can be met, and the application range of projection is widened.
The control interface of the embodiment of the present application may also simulate a display effect, so as to see a display situation that may be implemented in advance before actually performing projection display, and optionally, the control interface 500 further includes a simulation sub-interface:
the simulation sub-interface is used for simulating the display effect of the first video data and/or the second video data.
In addition to the first video data and the second video data can be displayed through projection to achieve the physical display effect in the embodiment of the application, the third video data can be projected on the basis. Optionally, the input sub-interface is further configured to receive third video data, where the third video data carries video data of a movable object in the video image, a moving range of the movable object in the video image includes the first depth range and/or the second depth range, and a time axis used by the third video data is the same as a time axis of the video image;
the output sub-interface is further used for simultaneously outputting the first video data, the second video data and the third video data when the output instruction is triggered.
Through the projection of the third video data, the projection display effect can be more flexible, the displayed content and combination are richer, and the display effect is further improved.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium may be at least one of the following media: various media that can store program codes, such as read-only memory (ROM), RAM, magnetic disk, or optical disk.
It should be noted that, in the present specification, all the embodiments are described in a progressive manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus and system embodiments, since they are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for related points. The above-described embodiments of the apparatus and system are merely illustrative, and the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (16)
1. A projection system, comprising a display device, a projection film, and a projector:
the display device is used for displaying first video data, the display device is arranged behind the projection film in the video image display direction, the first video data carries video data in a first depth range in a video image, the first depth range comprises a first range in a depth range in which a target object moves in the video image, and the time axis of the first video data is the same as the time axis of the video image;
the projector is configured to project, onto the projection film, while the presentation apparatus presents the first video data, second video data carrying video data in a second depth range in the video image, the second depth range including a second range in a depth range in which the target object moves in the video image, the second video data having a same time axis as a time axis of the video image, the first range being deeper than the second range, and both the first range and the second range being continuous depth ranges, and the first range and the second range constituting a depth range in which the target object moves in the video image,
wherein the third video data carries video data of a movable object in the video image, a moving range of the movable object in the video image includes the first depth range and/or the second depth range, a time axis adopted by the third video data is the same as a time axis of the video image, and the system further includes a projection device:
the projection device is used for projecting the third video data to the display device or a projection film according to the depth range of the movable object in the third video data while the display device displays the first video data.
2. The system of claim 1, wherein the projection film does not obscure the presentation device from presenting the first video data in a presentation direction when presenting the second video data.
3. The system of claim 1 or 2, wherein the display surface of the display device is planar or curved;
when the display surface of the display device is planar, the display device and the projection film are parallel, and a connecting line between the display center of the display device and the display center of the projection film is perpendicular to the projection film.
4. The system of claim 1 or 2, wherein the projection film has a size greater than or equal to a size of the display device.
5. The system of claim 1, wherein the first range and the second range are disjoint.
6. The system of claim 1, wherein the first range partially intersects the second range.
7. The system of claim 1, wherein the display device is a projection screen, a projection film, or a display screen.
8. A method of projection, the method comprising:
displaying first video data on display equipment, wherein the display equipment is arranged behind a projection film in the video image display direction, the first video data carries video data in a first depth range in a video image, the first depth range comprises a first range in a depth range in which a target object moves in the video image, and the time axis of the first video data is the same as the time axis of the video image;
simultaneously projecting second video data on a projection film, the second video data carrying video data in a second depth range of video imagery, the second depth range including a second range of depth ranges in which the target object moves in the video imagery, the second video data having a same time axis as the video imagery, the first depth range being deeper than the second depth range, and the first range and the second range both being continuous depth ranges, and the first range and the second range constituting a depth range in which the target object moves in the video imagery,
wherein the third video data carries video data of a movable object in the video image, a moving range of the movable object in the video image includes the first depth range and/or the second depth range, a time axis adopted by the third video data is the same as a time axis of the video image, and the method further includes:
projecting the third video data to the presentation device or a projection film according to a depth range in the third video data where the movable object is located while the presentation device is presenting the first video data.
9. The method of claim 8, wherein the projection film does not obscure the presentation device from presenting the first video data in a presentation direction when presenting the second video data.
10. A method according to claim 8 or 9, wherein the display surface of the display device is planar or curved; when the display surface of the display device is planar, the display device and the projection film are parallel, and a connecting line between the display center of the display device and the display center of the projection film is perpendicular to the projection film.
11. The method of claim 8 or 9, wherein the projection film has a size greater than or equal to a size of the display device.
12. The method of claim 8, wherein the first range and the second range are disjoint.
13. The method of claim 8, wherein the first range partially intersects the second range.
14. The method of claim 8, wherein the presentation device is a projection screen, a projection film, or a display screen, and wherein presenting the first video data on the presentation device comprises:
projecting first video data on a projection screen when the display device is the projection screen or the projection film;
and when the display equipment is a display screen, displaying the first video data on the display screen.
15. A projection server, the server comprising a generation module and a control module:
the generation module is used for generating first video data and second video data according to the video image, the first video data carrying video data in a first depth range in the video presentation, the first depth range comprises a first range of depth ranges in which a target object moves in the video imagery, the second video data carries video data in the video imagery within a second depth range, the second depth range comprises a second range of depth ranges in which the target object moves in the video imagery, the first video data and the second video data have the same time axis as the video image, the first range is deeper than the second range, the first range and the second range are continuous depth ranges, and the first range and the second range form a depth range in which the target object moves in the video image;
the control module is used for controlling the projector to project the second video data on the projection film and displaying the first video data on a display device while projecting the second video data,
the generating module is further configured to generate third video data according to a video image, where the third video data carries video data of a movable object in the video image, a moving range of the movable object in the video image includes the first depth range and/or the second depth range, and a time axis used by the third video data is the same as a time axis of the video image;
the control module is further configured to project the third video data to the presentation device or a projection film according to a depth range of the movable object in the third video data while the presentation device presents the first video data.
16. The server of claim 15, further comprising a modeling module:
and the modeling module is used for modeling according to the display requirement and acquiring the video image meeting the display requirement according to the modeling.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710135001.0A CN108574833B (en) | 2017-03-08 | 2017-03-08 | Projection system, method and server |
| TW106138271A TWI759351B (en) | 2017-03-08 | 2017-11-06 | Projection system, method, server and control interface |
| PCT/CN2018/077306 WO2018161816A1 (en) | 2017-03-08 | 2018-02-27 | Projection system, method, server, and control interface |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710135001.0A CN108574833B (en) | 2017-03-08 | 2017-03-08 | Projection system, method and server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108574833A CN108574833A (en) | 2018-09-25 |
| CN108574833B true CN108574833B (en) | 2020-06-23 |
Family
ID=63447282
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710135001.0A Active CN108574833B (en) | 2017-03-08 | 2017-03-08 | Projection system, method and server |
Country Status (3)
| Country | Link |
|---|---|
| CN (1) | CN108574833B (en) |
| TW (1) | TWI759351B (en) |
| WO (1) | WO2018161816A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112730468B (en) * | 2019-10-28 | 2022-07-01 | 同方威视技术股份有限公司 | Article detection device and method for detecting article |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2535762A2 (en) * | 2010-03-04 | 2012-12-19 | Tovis Co. Ltd. | Multi-layer image display device |
| CN104102085A (en) * | 2013-04-01 | 2014-10-15 | 上海科斗电子科技有限公司 | Composite projection naked eye 3D system and 3D imaging screen thereof |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2005117458A2 (en) * | 2004-05-26 | 2005-12-08 | Tibor Balogh | Method and apparatus for generating 3d images |
| US20120057006A1 (en) * | 2010-09-08 | 2012-03-08 | Disney Enterprises, Inc. | Autostereoscopic display system and method |
| US8646917B2 (en) * | 2011-01-20 | 2014-02-11 | Disney Enterprises, Inc. | Three dimensional display with multiplane image display elements |
-
2017
- 2017-03-08 CN CN201710135001.0A patent/CN108574833B/en active Active
- 2017-11-06 TW TW106138271A patent/TWI759351B/en active
-
2018
- 2018-02-27 WO PCT/CN2018/077306 patent/WO2018161816A1/en active Application Filing
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2535762A2 (en) * | 2010-03-04 | 2012-12-19 | Tovis Co. Ltd. | Multi-layer image display device |
| CN104102085A (en) * | 2013-04-01 | 2014-10-15 | 上海科斗电子科技有限公司 | Composite projection naked eye 3D system and 3D imaging screen thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018161816A1 (en) | 2018-09-13 |
| CN108574833A (en) | 2018-09-25 |
| TW201834450A (en) | 2018-09-16 |
| TWI759351B (en) | 2022-04-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10121284B2 (en) | Virtual camera control using motion control systems for augmented three dimensional reality | |
| US9332222B2 (en) | Controlled three-dimensional communication endpoint | |
| US7796134B2 (en) | Multi-plane horizontal perspective display | |
| US6583808B2 (en) | Method and system for stereo videoconferencing | |
| US7868847B2 (en) | Immersive environments with multiple points of view | |
| US20050219694A1 (en) | Horizontal perspective display | |
| EP2408191A1 (en) | A staging system and a method for providing television viewers with a moving perspective effect | |
| Fafard et al. | Design and implementation of a multi-person fish-tank virtual reality display | |
| Yoshida | fVisiOn: glasses-free tabletop 3D display to provide virtual 3D media naturally alongside real media | |
| CN108574833B (en) | Projection system, method and server | |
| CN112291543A (en) | Projection method and system for immersive three-dimensional content | |
| KR102492989B1 (en) | A digital theme park simulation device that provides a digital twin-based metaverse | |
| JPH04204842A (en) | Video simulation system | |
| Prevoteau et al. | Multiview shooting geometry for multiscopic rendering with controlled distortion | |
| Grau et al. | 3D-TV R&D activities in europe | |
| Schild et al. | Integrating stereoscopic video in 3D games | |
| JPH09311383A (en) | Video display system | |
| Hsu et al. | Holographic remote interactive operating technology for controlling networked communication | |
| Holliman | Cosmic origins: experiences making a stereoscopic 3D movie | |
| Turner | Case study: Beauty and the Beast 3D: benefits of 3D viewing for 2D to 3D conversion | |
| Galloso et al. | Foundations of a new interaction paradigm for immersive 3D multimedia | |
| Andersson | Simulations in 3D research: Can Unity3D be used to simulate a 3D display system? | |
| CN115022615A (en) | Virtual sensing system and method based on projection | |
| GB2586831A (en) | Three-Dimensional Content Generation using real-time video compositing | |
| Sun | Perceived Depth Control in Stereoscopic Cinematography |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211111 Address after: Room 507, floor 5, building 3, No. 969, Wenyi West Road, Wuchang Street, Yuhang District, Hangzhou City, Zhejiang Province Patentee after: Zhejiang tmall Technology Co., Ltd Address before: P.O. Box 847, 4th floor, Grand Cayman capital building, British Cayman Islands Patentee before: Alibaba Group Holdings Limited |