CN111988650B - Video playing method, device, equipment and storage medium of three-dimensional screen - Google Patents
Video playing method, device, equipment and storage medium of three-dimensional screen Download PDFInfo
- Publication number
- CN111988650B CN111988650B CN202010821091.0A CN202010821091A CN111988650B CN 111988650 B CN111988650 B CN 111988650B CN 202010821091 A CN202010821091 A CN 202010821091A CN 111988650 B CN111988650 B CN 111988650B
- Authority
- CN
- China
- Prior art keywords
- screen
- sub
- video
- playing
- screens
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 230000000007 visual effect Effects 0.000 claims abstract description 42
- 239000000463 material Substances 0.000 claims abstract description 16
- 230000008569 process Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 10
- 230000006870 function Effects 0.000 claims description 9
- 238000005286 illumination Methods 0.000 claims description 8
- 230000004044 response Effects 0.000 claims description 2
- 238000010008 shearing Methods 0.000 claims 2
- 230000000694 effects Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 241000251468 Actinopterygii Species 0.000 description 2
- 230000001788 irregular Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000009795 derivation Methods 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000001172 regenerating effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/41415—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The disclosure provides a video playing method, device, equipment and storage medium of a stereoscopic screen. The method comprises the following steps: acquiring a playing visual angle of at least one sub-screen of the three-dimensional screen, wherein the sub-screen is obtained by dividing according to the structural characteristics of the three-dimensional screen; acquiring video sources corresponding to the playing visual angles of the sub-screens, wherein the video sources are generated by shooting materials from corresponding angles according to the playing visual angles and splicing; and playing the corresponding video source on each sub-screen. In this way, the multi-angle playing can be carried out on the video images, so that the stereoscopic impression of the images can be enhanced, and the visual experience of a user is improved.
Description
Technical Field
Embodiments of the present disclosure relate generally to the field of image processing technology, and more particularly, to a video playing method, apparatus, device, and storage medium for a stereoscopic screen.
Background
With the development of display technology, for example, in some large conference rooms, exhibition halls, and video halls, in order to create better visual immersive experience, a non-planar screen is often used to display a whole picture, and at present, the non-planar screen mainly includes an arc screen, a spherical screen, and a large screen formed by connecting a plurality of planar screens at a certain angle.
In order to realize the effect of displaying an integral video image on a large screen spliced by a plurality of flat screens, the multi-screen splicing method is widely applied. For example, in the multi-screen projection splicing display, an entire video image is divided into a plurality of sub-images, and the plurality of sub-images are projected onto the multi-screens by using a plurality of projectors to form a continuous and complete display image together, which requires a division and splicing process on the multi-screen display image in the background. According to the traditional multi-screen splicing method, a whole video image is displayed, the content of the video image is shot from the same angle, so that the shot image has poor stereoscopic impression and the visual experience of a user is influenced.
Disclosure of Invention
According to the embodiment of the disclosure, a video playing scheme of a three-dimensional screen is provided, which can enhance the three-dimensional effect of images and further improve the visual experience of a user.
In a first aspect of the present disclosure, a video playing method for a stereoscopic screen is provided, including:
acquiring a playing visual angle of at least one sub-screen of the three-dimensional screen, wherein the sub-screen is obtained by dividing according to the structural characteristics of the three-dimensional screen;
acquiring video sources corresponding to the playing visual angles of the sub-screens, wherein the video sources are generated by shooting materials from corresponding angles according to the playing visual angles and splicing;
and playing the corresponding video source on each sub-screen.
The above aspect and any possible implementation manner further provide an implementation manner, where the process of obtaining the sub-screens according to the structural feature division of the stereoscopic screen includes:
if the video playing area of the three-dimensional screen comprises a plurality of planes, taking each plane as a sub-screen;
and if the video playing area of the three-dimensional screen is an integral curved surface, dividing the video playing area into a plurality of sub-screens according to preset conditions.
The above aspect and any possible implementation manner further provide an implementation manner, where the process of obtaining the sub-screens according to the structural feature division of the stereoscopic screen includes:
dividing the stereoscopic screen into lines along the vertical direction, and determining a fitting curve of the sub-screens in each line;
for each fitting curve, determining a breakpoint of the fitting curve, wherein the breakpoint is a discontinuous point of a derivative function;
and determining a dividing line of the video playing area according to the breakpoint in each line, and dividing the video playing area into a plurality of sub-screens.
As to the above-described aspect and any possible implementation, there is further provided an implementation, further including:
judging whether the area of the divided sub-screens is larger than a first preset threshold value or not;
responding to the fact that the area of the sub-screen is larger than the first preset threshold, further judging whether the length-width ratio of the sub-screen is smaller than a second preset threshold, if the length-width ratio of the sub-screen is smaller than the second preset threshold, determining the sub-screen as an effective sub-screen, and if the length-width ratio of the sub-screen is larger than or equal to the second preset threshold, determining the sub-screen as an ineffective sub-screen;
and in response to the fact that the area of the sub-screen is smaller than or equal to the first preset threshold value, determining the sub-screen as an invalid sub-screen.
The above-described aspect and any possible implementation manner further provide an implementation manner, where the determining a playing perspective of each sub-screen includes:
if the sub-screen is a plane, determining the vertical line direction of the sub-screen as the illumination visual angle of the sub-screen;
and if the sub-screen is a curved surface, determining the vertical line direction of the tangent plane at the vertex of the sub-screen as the illumination visual angle of the sub-screen.
The above-described aspect and any possible implementation further provide an implementation, where the video source is specifically generated by:
the method comprises the steps of framing a video stream shot from each playing visual angle to generate multi-frame video frames, and aligning the framed video frames based on time;
and cutting the aligned video frames to ensure that the boundaries of the video frames displayed on the adjacent sub-screens in each frame are overlapped to generate a video source.
The foregoing aspect and any possible implementation manner further provide an implementation manner, where the cropping the aligned video frames to make the boundaries of the video frames displayed on the adjacent sub-screens in each frame coincide, and generating a video source, where the method includes:
selecting one from a plurality of sub-screens as a main video playing area, and determining the boundary of a video frame in the main video playing area;
and determining the boundary of the video frame from the video frames of the adjacent sub-screens according to the characteristic points at the boundary of the video frame, and cutting the video frames of the adjacent sub-screens along the boundary to generate a video source.
In a second aspect of the present disclosure, there is provided a video playback device of a stereoscopic screen, including:
the sub-screen determining module is used for acquiring the structural characteristics of the three-dimensional screen and dividing the three-dimensional screen into a plurality of sub-screens according to the structural characteristics;
the illumination visual angle determining module is used for determining the playing visual angle of each sub-screen;
the video source module is used for providing a video source, and the video source is obtained by shooting material in and out from corresponding angles according to the playing visual angle, processing video streams obtained by shooting from multiple angles and determining a picture range played by a corresponding sub-screen;
and the video playing module is used for playing the corresponding video source on each sub-screen.
In a third aspect of the present disclosure, an electronic device is provided, comprising a memory having stored thereon a computer program and a processor implementing the method as described above when executing the program.
In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, which program, when being executed by a processor, is adapted to carry out the method as set forth above.
It should be understood that what is described in this summary section is not intended to define key or essential features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following description.
By the video playing method of the three-dimensional screen, the video images can be played at multiple angles, so that the three-dimensional effect of the images can be enhanced, and the visual experience of a user can be improved.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, like or similar reference characters designate like or similar elements, and wherein:
fig. 1 shows a flowchart of a video playing method of a stereoscopic screen according to a first embodiment of the present disclosure;
fig. 2 shows a flowchart of a video playing method of a stereoscopic screen according to a second embodiment of the disclosure;
fig. 3 is a schematic functional structure diagram of a video playing apparatus with a stereoscopic screen according to a third embodiment of the present disclosure;
fig. 4 shows a schematic structural diagram of a video playing device with a stereoscopic screen according to a fourth embodiment of the disclosure;
fig. 5 illustrates an effect diagram of a video playing method of a stereoscopic screen according to an embodiment of the present disclosure.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are some, but not all embodiments of the present disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.
In addition, the term "and/or" herein is only one kind of association relationship describing an associated object, and means that there may be three kinds of relationships, for example, a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
In the embodiment of the disclosure, the video source of the material is played in multiple angles, so that the stereoscopic impression of the image can be enhanced, and the visual experience of a user can be improved.
Specifically, as shown in fig. 1, it is a flowchart of a video playing method of a stereoscopic screen according to a first embodiment of the present disclosure. As shown in fig. 1, the method of this embodiment may include the following steps:
s101: and acquiring a playing visual angle of at least one sub-screen of the three-dimensional screen, wherein the sub-screen is obtained by dividing according to the structural characteristics of the three-dimensional screen.
The video playing method of the three-dimensional screen can be applied to scenes such as stations, airports, markets or open squares, and the video is played through the three-dimensional screen, so that the stereoscopic impression of the played picture is stronger, people can be attracted more easily, and a better propaganda effect is achieved.
The stereoscopic screen in the embodiment of the present disclosure refers to a screen having a spatial structure, including but not limited to a rectangular parallelepiped, a cylinder, a sphere, and the like, and may also be other stereoscopic screens having a spatial structure, and of course, may also be a simple curved surface, including an arc-shaped surface and a folded surface. In the prior art, a multi-screen projection splicing display is to divide an integral video image into a plurality of sub-images, and project the plurality of sub-images onto a plurality of screens by using a plurality of projectors respectively to form a continuous and complete display picture together. The difference from the prior art is that the disclosed embodiment displays video content from multiple angles, as shown in fig. 5, which is an effect diagram of a video playing method of a stereoscopic screen of the disclosed embodiment. Fig. 5 shows only one frame of the continuous video. As can be seen from fig. 5, the stereoscopic screen in the embodiment of the present disclosure displays video content from different playing perspectives, and the video content displayed at different angles is synchronous, and the screens are continuous, and the video pictures displayed on the screens are also continuous. The screen shown in fig. 5 is a rectangular parallelepiped, and the display area from the screen includes three areas, denoted as a left display area, a middle display area, and a right display area, and the right display area in the figure is not visible and thus not displayed. The picture displayed in fig. 5 is a fish tank, and is a picture within the fish tank photographed from different directions, and the picture photographed from different directions is displayed in the screen display area in the corresponding direction. Thereby forming more outstanding stereoscopic impression, making the picture content more lifelike, thereby attracting people's attention more easily, playing better propaganda effect. In the multi-screen projection splicing display technology in the prior art, the displayed content is equivalent to the content of one display area in the embodiment, and the content of the area is only split and then displayed on different screens, so that the displayed content is spliced into a plane picture.
When the video playing method of the stereoscopic screen of the embodiment is implemented, firstly, the structural characteristics of the stereoscopic screen need to be acquired, and the stereoscopic screen is divided into a plurality of sub-screens according to the structural characteristics.
Specifically, when the stereoscopic screen is divided into a plurality of sub-screens according to the structural features, it may be determined whether the stereoscopic screen includes a plurality of plane areas, and if the stereoscopic screen includes a plurality of planes, each plane is used as a sub-screen, such as a rectangular parallelepiped screen shown in fig. 5, or may be a screen with other prism structures. If the video playing area of the three-dimensional screen is not the integral curved surface, judging whether the video playing area of the three-dimensional screen is the integral curved surface, and if the video playing area is the integral curved surface, dividing the video playing area into a plurality of sub-screens according to preset conditions. For example, if the video playing area of the stereoscopic screen is a cylindrical surface, the curved surface may be divided according to a preset phase angle, for example, every 60 degrees, or the video playing area may be equally divided into a corresponding number of sub-screens according to a preset number of sub-screens. For example, if the radian of the curved surface is 0.5, that is, 180 degrees, the video playing area may be divided into 3 sub-screens equally, and the angle of each sub-screen is 60 degrees, or may be divided into 4 sub-screens equally, and the angle of each sub-screen is 45 degrees. Of course, the division may be uneven. The number of the preset sub-screens in this embodiment can be determined according to actual needs, and is only exemplary.
As an optional embodiment of the present disclosure, in the process of dividing the stereoscopic screen into a plurality of sub-screens, for an irregular stereoscopic screen, the stereoscopic screen may be further divided into lines in the vertical direction, a fitting curve of the sub-screens in each line is determined, that is, the stereoscopic screen is sliced in the horizontal direction, each sliced screen is fitted, a fitting curve corresponding to the screen slice is determined, it can be understood that the fitting curve is a fitting curve of the screen surface, and then a break point of the fitting curve is determined. Specifically, derivation may be performed on a function expression of the fitted curve, and an extremum of the derivative function at a certain point does not exist, that is, the derivative function is discontinuous at the point, which indicates that the point is a breakpoint of the fitted curve. Then, according to the break points in each line, the partition line of the video playing area is determined, and the video playing area is divided into a plurality of sub-screens. In general, the break points of the fitting curve are the points at the junction of the two sub-screens, so that the stereoscopic screen can be divided into a plurality of sub-screens according to the fold line where the break points in each line are located, and the fold line is the junction line of the two adjacent sub-screens. And for the two sub-screens with smooth transition, the breakpoint of the layer can be determined according to the breakpoints of the upper and lower adjacent layers, and then the dividing line of the two sub-screens is determined.
The method for dividing the stereoscopic screen can adapt to the division of irregular stereoscopic screens.
After the stereoscopic screen is divided into a plurality of sub-screens, the playing view angle of each sub-screen can be further determined. In the embodiment of the disclosure, in order to enhance the stereoscopic impression of an image and improve the visual experience of a user, a video image is played in multiple angles, wherein each sub-screen corresponds to one angle, and therefore the playing view angle of each sub-screen needs to be determined.
Specifically, if the sub-screen is a plane, the perpendicular direction of the sub-screen is determined as the lighting viewing angle of the sub-screen.
And if the sub-screen is a curved surface, determining the vertical line direction of the tangent plane at the vertex of the sub-screen as the illumination visual angle of the sub-screen.
In practical applications, the stereoscopic screen is generally located at a higher position, and the audience is located at a lower position, so that when people watch a video picture played by the stereoscopic screen, a certain elevation angle is needed and recorded as α. Therefore, in order to achieve a better playing effect and improve user experience, the playing angle of view can be adjusted based on the determination by the method. Specifically, the playing view angle may be tilted downward, and the tilt angle is 0.5 α to α.
S102: and acquiring a video source corresponding to the playing visual angle of each sub-screen, wherein the video source is generated by shooting the material from the corresponding angle according to each playing visual angle and splicing.
After the playing visual angles of the sub-screens are determined, video sources corresponding to the playing visual angles of the sub-screens can be further acquired, and the video sources are generated by shooting materials from corresponding angles according to the playing visual angles and performing splicing processing.
Specifically, the video source is obtained by selecting a playing material, shooting the playing material from a view angle corresponding to the playing view angle of each sub-screen to obtain a video stream, and then cutting the obtained video stream to enable the video streams of adjacent sub-screens to be connected at the boundary of the sub-screens, so that the played video contents can be synchronized.
In addition, the video source is obtained by firstly selecting a playing material, shooting the playing material from a visual angle corresponding to the playing visual angle of each sub-screen to obtain a video stream, then unfreezing the video stream shot from each playing visual angle to generate a plurality of frames of video frames, and aligning the unfrozen frames of the video frames based on time; and cutting the aligned video frames to ensure that the boundaries of the video frames displayed on the adjacent sub-screens in each frame are overlapped to generate a video source.
When the aligned video frames are cut, the boundary of the video frame can be determined from the video frames of the adjacent sub-screens according to the feature points at the boundary of the video frame, and the video frames of the adjacent sub-screens are cut along the boundary to generate a video source.
Specifically, a main sub-screen may be determined, then the corresponding video frame may be cut according to the shape of the main sub-screen, the boundary of the video frame of the adjacent sub-screen may be determined from the video frames of the adjacent sub-screens according to the feature points at the boundary of the cut video frame, and then the video frame of the adjacent sub-screen may be cut along the determined boundary of the video frame of the adjacent sub-screen. The video source is generated by cropping the video frames frame by frame.
In the process of cutting the video frame, for example, two rows of pixels may be selected from the boundary of the video frame of the main sub-screen, the ratio or the difference between the two rows of pixels is calculated, then the corresponding two rows of pixels are determined from the video frame of the adjacent sub-screen according to the calculated ratio or difference, and then the video frame of the adjacent sub-screen is cut along the outermost pixels.
Regenerating a video stream from the cut video frame as a sub video source; the video sources comprise the clipped sub video sources, wherein each sub video source further comprises an identifier of a corresponding sub screen so as to determine the corresponding sub screen to be played.
S103: and playing the corresponding video source on each sub-screen.
And after the video source is acquired, playing the video on the corresponding sub-screen, so that the video picture displayed by each sub-screen presents a three-dimensional effect.
The video playing method of the three-dimensional screen can play the video images at multiple angles, so that the three-dimensional effect of the images can be enhanced, and the visual experience of a user can be improved.
As an embodiment of the present disclosure, after the stereoscopic screen is divided, it may be further determined whether the divided sub-screen is a valid sub-screen, that is, whether a video picture needs to be played on the sub-screen alone. In practical application, after the stereoscopic screen is divided according to the method, a sub-screen with a small area may exist in a division result, and a narrow-band-shaped sub-screen may also exist in the division result. Therefore, it is necessary to judge the validity of the divided sub-screen.
Specifically, as shown in fig. 2, it is a flowchart of a video playing method of a stereoscopic screen according to a second embodiment of the disclosure. Fig. 2 shows how to determine whether the divided sub-screen is a valid sub-screen, which specifically includes the following steps:
s201: and acquiring the structural characteristics of the three-dimensional screen, and dividing the three-dimensional screen into a plurality of sub-screens according to the structural characteristics.
S202: and judging whether the area of the divided sub-screen is larger than a first preset threshold value.
In this embodiment, after the stereoscopic screen is divided, whether the corresponding sub-screen is the valid sub-screen may be determined according to the area of the divided sub-screen. Specifically, whether the area of the divided sub-screen is larger than a first preset threshold value is judged. If the threshold value is greater than the first preset threshold value, the process proceeds to step S203, and if the threshold value is less than or equal to the first preset threshold value, the process proceeds to step S205. The first preset threshold in this embodiment may be determined according to actual needs, and is not specifically limited herein.
S203: and judging whether the length-width ratio of the sub-screen is smaller than a second preset threshold value.
If the area of the divided sub-screen is larger than a first preset threshold, whether the length-width ratio of the sub-screen is smaller than a second preset threshold is further judged, and the step can avoid taking the narrow-band sub-screen as an effective sub-screen. If the aspect ratio of the sub-screen is smaller than a second preset threshold, the process proceeds to step S205, and if the aspect ratio of the sub-screen is greater than or equal to the second preset threshold, the process proceeds to step S204.
S204: determining the sub-screen as an active sub-screen.
S205: determining the sub-screen as an invalid sub-screen.
Through the steps, the effective sub-screen in the divided sub-screens can be effectively identified, and the sub-screen determined as the ineffective sub-screen can be classified as the adjacent sub-screen, and the video picture played in the ineffective sub-screen is a part of the video playing picture of the sub-screen to which the ineffective sub-screen belongs.
The method of the embodiment can effectively remove the invalid sub-screen after the screen division, so that the video playing picture of the three-dimensional screen has more sense of unity, and the visual experience of a user is improved.
It should be noted that for simplicity of description, the above-mentioned method embodiments are described as a series of acts, but those skilled in the art should understand that the present disclosure is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present disclosure. Further, those skilled in the art will appreciate that the embodiments described in the specification are exemplary embodiments and that acts and modules are not necessarily required for the disclosure.
The above is a description of embodiments of the method, and the embodiments of the apparatus are further described below.
Fig. 3 is a schematic functional structure diagram of a video playing device with a stereoscopic screen according to a third embodiment of the present disclosure. The video playing device of the stereoscopic screen of the embodiment comprises:
the sub-screen determining module 301 is configured to obtain a structural feature of the stereoscopic screen, and divide the stereoscopic screen into a plurality of sub-screens according to the structural feature.
And an illumination view angle determining module 302, configured to determine a playing view angle of each sub-screen.
And a video source module 303, configured to provide a video source, where the video source is obtained by shooting material from a corresponding angle according to the playing angle, and processing a video stream obtained by shooting from multiple angles, and determining a picture range played on a corresponding sub-screen.
And the video playing module 304 is configured to play the corresponding video source on each sub-screen.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the described module may refer to the corresponding process in the foregoing method embodiment, and is not described herein again.
The system of this embodiment can achieve similar technical effects as those of the method embodiments described above, and will not be described again here.
Fig. 4 shows a schematic structural diagram of a video playing device with a stereoscopic screen according to a fourth embodiment of the present disclosure. The terminal device shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.
As shown in fig. 4, the computer system includes a Central Processing Unit (CPU) 401 that can perform various appropriate actions and processes based on a program stored in a Read Only Memory (ROM) 402 or a program loaded from a storage section 408 into a Random Access Memory (RAM) 403. In the RAM403, various programs and data necessary for system operation are also stored. The CPU 401, ROM 402, and RAM403 are connected to each other via a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.
The following components are connected to the I/O interface 405: an input section 406 including a keyboard, a mouse, and the like; an output section 407 including a display device such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 408 including a hard disk and the like; and a communication section 409 including a network interface card such as a LAN card, a modem, or the like. The communication section 409 performs communication processing via a network such as the internet. Drivers 410 are also connected to the I/O interface 405 on an as needed basis. A removable medium 411 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 410 on an as-needed basis so that a computer program read out therefrom is mounted into the storage section 408 on an as-needed basis.
In particular, based on the embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 409, and/or installed from the removable medium 411. The computer program performs the above-described functions defined in the method of the present application when executed by a Central Processing Unit (CPU) 401.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a load programmable logic device (CPLD), and the like.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
Further, while operations are depicted in a particular order, this should be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single implementation. Conversely, various features that are described in the context of a single implementation can also be implemented in multiple implementations separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims (9)
1. A video playing method of a stereoscopic screen is characterized by comprising the following steps:
acquiring a playing visual angle of at least one sub-screen of the three-dimensional screen, wherein the sub-screen is obtained by dividing according to the structural characteristics of the three-dimensional screen;
acquiring a video source corresponding to the playing visual angle of each sub-screen, wherein the video source is a video source which is generated by shooting materials from corresponding angles according to each playing visual angle and splicing, and the video source is specifically generated in the following way: the method comprises the steps of performing frame splitting on video streams shot from various playing visual angles to generate multi-frame video frames, and aligning the video frames after frame splitting based on time; shearing the aligned video frames to ensure that the boundaries of the video frames displayed on the adjacent sub-screens in each frame are overlapped to generate a video source;
and playing corresponding video sources on each sub-screen to play video images in the video sources at multiple angles, wherein the video sources are generated by shooting materials from corresponding angles according to each playing visual angle and splicing.
2. The method for playing the video on the stereoscopic screen according to claim 1, wherein the process of dividing the sub-screens according to the structural features of the stereoscopic screen comprises:
if the video playing area of the three-dimensional screen comprises a plurality of planes, taking each plane as a sub-screen;
and if the video playing area of the three-dimensional screen is an integral curved surface, dividing the video playing area into a plurality of sub-screens according to a preset condition.
3. The video playing method of the stereoscopic screen according to claim 1, wherein the process of dividing the sub-screen according to the structural features of the stereoscopic screen comprises:
dividing the stereoscopic screen into lines along the vertical direction, and determining a fitting curve of the sub-screens in each line;
for each fitting curve, determining a breakpoint of the fitting curve, wherein the breakpoint is a discontinuous point of a derivative function;
and determining a dividing line of the video playing area according to the breakpoint in each line, and dividing the video playing area into a plurality of sub-screens.
4. The video playback method of a stereoscopic screen according to claim 2 or 3, further comprising:
judging whether the area of the divided sub-screen is larger than a first preset threshold value or not;
responding to the fact that the area of the sub-screen is larger than the first preset threshold, further judging whether the length-width ratio of the sub-screen is smaller than a second preset threshold, if the length-width ratio of the sub-screen is smaller than the second preset threshold, determining the sub-screen as an effective sub-screen, and if the length-width ratio of the sub-screen is larger than or equal to the second preset threshold, determining the sub-screen as an ineffective sub-screen;
and determining the sub-screen as an invalid sub-screen in response to the area of the sub-screen being less than or equal to the first preset threshold.
5. The video playing method of the stereoscopic screen according to claim 4, wherein determining the playing view angle of each sub-screen comprises:
if the sub-screen is a plane, determining the vertical line direction of the sub-screen as the illumination visual angle of the sub-screen;
and if the sub-screen is a curved surface, determining the vertical line direction of the tangent plane at the vertex of the sub-screen as the illumination visual angle of the sub-screen.
6. The video playing method of the stereoscopic screen according to claim 1, wherein the cropping the aligned video frames to make the boundaries of the video frames displayed on the adjacent sub-screens in each frame coincide to generate a video source comprises:
selecting one from a plurality of sub-screens as a main video playing area, and determining the boundary of a video frame in the main video playing area;
and determining the boundary of the video frame from the video frames of the adjacent sub-screens according to the characteristic points at the boundary of the video frame, and cutting the video frames of the adjacent sub-screens along the boundary to generate a video source.
7. A video playback device with a stereoscopic screen, comprising:
the sub-screen determining module is used for acquiring the structural characteristics of the three-dimensional screen and dividing the three-dimensional screen into a plurality of sub-screens according to the structural characteristics;
the illumination visual angle determining module is used for determining the playing visual angle of each sub-screen;
a video source module, configured to provide a video source, where the video source is obtained by shooting material from a corresponding angle according to the play angle, processing a video stream obtained by shooting from multiple angles, and determining a picture range played by a corresponding sub-screen, where the video source is specifically generated in the following manner: the method comprises the steps of performing frame splitting on video streams shot from various playing visual angles to generate multi-frame video frames, and aligning the video frames after frame splitting based on time; shearing the aligned video frames to ensure that the boundaries of the video frames displayed on the adjacent sub-screens in each frame are overlapped to generate a video source;
and the video playing module is used for playing the corresponding video sources on each sub-screen so as to play the video images in the video sources at multiple angles, wherein the video sources are generated by shooting the materials from corresponding angles according to each playing visual angle and splicing the materials.
8. An electronic device comprising a memory and a processor, the memory having stored thereon a computer program, wherein the processor, when executing the program, implements the method of any of claims 1-6.
9. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, is adapted to carry out the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010821091.0A CN111988650B (en) | 2020-08-14 | 2020-08-14 | Video playing method, device, equipment and storage medium of three-dimensional screen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010821091.0A CN111988650B (en) | 2020-08-14 | 2020-08-14 | Video playing method, device, equipment and storage medium of three-dimensional screen |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111988650A CN111988650A (en) | 2020-11-24 |
| CN111988650B true CN111988650B (en) | 2022-11-04 |
Family
ID=73435104
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010821091.0A Active CN111988650B (en) | 2020-08-14 | 2020-08-14 | Video playing method, device, equipment and storage medium of three-dimensional screen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111988650B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009010915A (en) * | 2007-05-31 | 2009-01-15 | Takeshi Yanagisawa | Video display method and video system |
| CN104244019A (en) * | 2014-09-18 | 2014-12-24 | 孙轩 | Panoramic video image indoor split screen display method and system |
| CN106028115A (en) * | 2016-05-18 | 2016-10-12 | 乐视控股（北京）有限公司 | Video playing method and device |
| CN107172413A (en) * | 2016-03-21 | 2017-09-15 | 三立房有限公司 | Method and system for displaying video of real scene |
| CN109308174A (en) * | 2018-10-10 | 2019-02-05 | 烟台职业学院 | Across screen picture splicing control method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102336997B1 (en) * | 2017-08-16 | 2021-12-08 | 삼성전자 주식회사 | Server, display apparatus and control method thereof |
-
2020
- 2020-08-14 CN CN202010821091.0A patent/CN111988650B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009010915A (en) * | 2007-05-31 | 2009-01-15 | Takeshi Yanagisawa | Video display method and video system |
| CN104244019A (en) * | 2014-09-18 | 2014-12-24 | 孙轩 | Panoramic video image indoor split screen display method and system |
| CN107172413A (en) * | 2016-03-21 | 2017-09-15 | 三立房有限公司 | Method and system for displaying video of real scene |
| CN106028115A (en) * | 2016-05-18 | 2016-10-12 | 乐视控股（北京）有限公司 | Video playing method and device |
| CN109308174A (en) * | 2018-10-10 | 2019-02-05 | 烟台职业学院 | Across screen picture splicing control method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111988650A (en) | 2020-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107678722B (en) | Multi-screen splicing method and device and multi-projection spliced large screen | |
| EP3534336B1 (en) | Panoramic image generating method and apparatus | |
| US20180330698A1 (en) | Projection method with multiple rectangular planes at arbitrary positions to a variable projection center | |
| WO2017092303A1 (en) | Virtual reality scenario model establishing method and device | |
| US9704282B1 (en) | Texture blending between view-dependent texture and base texture in a geographic information system | |
| JP2020533710A (en) | Image stitching method and device, storage medium | |
| US20150178977A1 (en) | Rendering Vector Maps in a Geographic Information System | |
| US6515658B1 (en) | 3D shape generation apparatus | |
| US20130027389A1 (en) | Making a two-dimensional image into three dimensions | |
| CN109741431B (en) | Two-dimensional and three-dimensional integrated electronic map frame | |
| CN112351266B (en) | Three-dimensional visual processing method, device, equipment, display system and medium | |
| CN104182194A (en) | Method and system for seamless edge blending processing in projection display | |
| WO2023207963A1 (en) | Image processing method and apparatus, electronic device, and storage medium | |
| US11783445B2 (en) | Image processing method, device and apparatus, image fitting method and device, display method and apparatus, and computer readable medium | |
| CN114928718A (en) | Video monitoring method and device, electronic equipment and storage medium | |
| CN108881873B (en) | Method, device and system for fusing high-resolution images | |
| CN108765582B (en) | Panoramic picture display method and device | |
| CN108093245B (en) | Multi-screen fusion method, system, device and computer readable storage medium | |
| CN111988650B (en) | Video playing method, device, equipment and storage medium of three-dimensional screen | |
| WO2024002023A1 (en) | Method and apparatus for generating panoramic stereoscopic image, and electronic device | |
| CN109885172B (en) | Object interaction display method and system based on Augmented Reality (AR) | |
| CN112911260B (en) | Multimedia exhibition hall sand table projection display system | |
| CN114004953A (en) | Method and system for realizing reality enhancement picture and cloud server | |
| CN112243149B (en) | Method, device and system for displaying ultra-wide picture | |
| CN115665461B (en) | Video recording method and virtual reality device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |