CN109729338B - Display data processing method, device and system - Google Patents

Display data processing method, device and system Download PDF

Info

Publication number
CN109729338B
CN109729338B CN201811435965.8A CN201811435965A CN109729338B CN 109729338 B CN109729338 B CN 109729338B CN 201811435965 A CN201811435965 A CN 201811435965A CN 109729338 B CN109729338 B CN 109729338B
Authority
CN
China
Prior art keywords
visual angle
image
virtual camera
display unit
sub
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811435965.8A
Other languages
Chinese (zh)
Other versions
CN109729338A (en
Inventor
常明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Virtual Point Technology Co Ltd
Original Assignee
Beijing Virtual Point Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Virtual Point Technology Co Ltd filed Critical Beijing Virtual Point Technology Co Ltd
Priority to CN201811435965.8A priority Critical patent/CN109729338B/en
Publication of CN109729338A publication Critical patent/CN109729338A/en
Application granted granted Critical
Publication of CN109729338B publication Critical patent/CN109729338B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Controls And Circuits For Display Device (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The application discloses a method, a device and a system for processing display data. The method comprises the following steps: acquiring an image picture to be broadcasted; processing the image picture by using a plurality of virtual cameras to obtain a plurality of sub-image pictures, wherein each virtual camera corresponds to a visual angle respectively, and each virtual camera acquires image data in a corresponding visual angle range from the image picture; and respectively transmitting the plurality of sub-picture images to corresponding display units for display, wherein the curved surface display screen is formed by splicing the plurality of display units receiving the sub-picture images, and each virtual camera corresponds to one display unit. The technical problem that video data played by a curved screen in the related art does not have stereoscopic space type immersion is solved through the method and the device.

Description

Display data processing method, device and system
Technical Field
The application relates to the field of display of curved surface display screens, in particular to a method, a device and a system for processing display data.
Background
A common LED display device is shaped as a flat screen, and a planarized 2D image is correspondingly displayed on the flat screen. Occasionally, a specially shaped curved screen, such as a curved screen with a certain curvature, is also a video signal that is directly tiled on the screen, as shown in fig. 1, a pure 2D picture is spread on an arc screen along the display surface without any sense of immersion, and the larger the curvature is, the more serious the image deformation is played on both sides of the screen.
Correspondingly, the mainstream video data displayed by the LED display screen are collected by a camera or a virtual camera (located in the 3D software of the computer), and the video data are processed and converted into popular conventional video images on the market and displayed and output on a conventional flat screen. Such a collection camera corresponds a plane display output, can't satisfy the video data that has the three-dimensional sense of immersing of specially figurative display screen output.
Aiming at the technical problem that video data played by a curved screen in the related art does not have a stereoscopic space type immersion feeling, an effective solution is not provided at present.
Disclosure of Invention
The application provides a processing method, a device and a system of display data, and aims to solve the technical problem that video data played by a curved screen in the related art does not have stereoscopic space type immersion.
According to one aspect of the present application, a method of processing display data is provided. The method comprises the following steps: acquiring an image picture to be broadcasted; processing the image picture by using a plurality of virtual cameras to obtain a plurality of sub-image pictures, wherein each virtual camera corresponds to a visual angle respectively, and each virtual camera acquires image data in a corresponding visual angle range from the image picture; and respectively transmitting the plurality of sub-picture images to corresponding display units for display, wherein the curved surface display screen is formed by splicing the plurality of display units receiving the sub-picture images, and each virtual camera corresponds to one display unit.
Optionally, processing the image frame by using a plurality of virtual cameras to obtain a plurality of sub-image frames includes: acquiring a visual angle of each display unit in the curved surface display screen, wherein the visual angle is a visual angle when a target object watches the display unit; determining the visual angle of each virtual camera based on the visual angle of each display unit in the curved surface display screen, wherein the visual angle of each display unit is the same as the visual angle of the corresponding virtual camera, and the number of the virtual cameras is the same as that of the display units; and extracting image data of each virtual camera in the corresponding view angle range from the image picture to generate a plurality of sub-image pictures, wherein each virtual camera provides the corresponding sub-image picture for one display unit.
Optionally, extracting image data of each virtual camera in a corresponding view angle range from the image frames, and generating the plurality of sub-image frames includes: determining an image picture in each visual angle range according to the visual angle range of each virtual camera; and dividing the image picture to be played according to the image picture in each visual angle range to obtain the plurality of sub-image pictures.
Optionally, before determining the image frames in each view angle range according to the view angle range of each virtual camera, the method further includes: acquiring a visual angle range of each display unit in the curved surface display screen, wherein the visual angle range is a visual range of a target object when the target object watches the display units; the viewing angle range of each virtual camera is set to be the same as that of the corresponding display unit.
Optionally, the obtaining of the view angle range of each display unit in the curved display screen includes: determining the center of a curved surface arc circle of the curved surface display screen, wherein a plurality of display units contained in the curved surface display screen are arranged in an array mode according to a preset radian; and setting an included angle between the left edge and the right edge of the display unit and the arc circle center of the curved surface as the visual angle range of the display unit.
Optionally, before the plurality of sub-image frames are respectively transmitted to the corresponding display units to be displayed, the method further includes: determining the position information of a sub-image picture projected by each virtual camera in the curved surface display screen based on the coordinates of each display unit in the curved surface display screen and the corresponding relation between the virtual camera and the display unit; and determining a display unit corresponding to each sub-image picture based on the position information of the sub-image picture projected by each virtual camera in the curved surface display screen.
According to another aspect of the present application, there is provided a processing apparatus for displaying data. The device includes: the first acquisition unit is used for acquiring an image picture to be broadcasted; the second acquisition unit is used for processing the image picture by using a plurality of virtual cameras to obtain a plurality of sub-image pictures, wherein each virtual camera corresponds to a visual angle respectively, and each virtual camera acquires image data in a corresponding visual angle range from the image picture; and the display unit is used for respectively transmitting the plurality of sub-image pictures to the corresponding display units for displaying, wherein the curved surface display screen is formed by splicing the plurality of display units receiving the sub-image pictures, and each virtual camera corresponds to one display unit.
According to another aspect of the present application, a processing system for displaying data is provided. The processing system comprises: the information processing terminal comprises a plurality of virtual cameras and a plurality of display units, wherein the virtual cameras are used for acquiring image pictures to be played and processing the image pictures through the virtual cameras to obtain a plurality of sub-image pictures, each virtual camera corresponds to one visual angle respectively, and each virtual camera acquires image data in a corresponding visual angle range from the image pictures; the information display terminal comprises a plurality of display units and is used for acquiring a plurality of sub-images generated by the information processing terminal and respectively transmitting the sub-images to the corresponding display units for display, wherein the curved surface display screen is formed by splicing the plurality of display units which receive the sub-images, and each virtual camera corresponds to one display unit.
According to another aspect of the present application, there is provided a storage medium including a stored program, wherein the program executes the method of processing display data of any one of the above.
According to another aspect of the present application, there is provided a processor for executing a program, wherein the program executes a processing method of display data according to any one of the above.
Through the application, the following steps are adopted: acquiring an image picture to be broadcasted; processing the image picture by using a plurality of virtual cameras to obtain a plurality of sub-image pictures, wherein each virtual camera corresponds to a visual angle respectively, and each virtual camera acquires image data in a corresponding visual angle range from the image picture; the plurality of sub-picture frames are respectively transmitted to the corresponding display units to be displayed, wherein the curved surface display screen is formed by splicing the plurality of display units receiving the sub-picture frames, each virtual camera corresponds to one display unit, and the problem that video data played by the curved surface display screen in the related technology has no stereoscopic space type immersion sense is solved.
That is, the image frames to be played are processed by the plurality of virtual cameras to obtain a plurality of sub-image frames with different viewing angles, and the plurality of display units of the curved surface display screen respectively play the corresponding sub-image frames, so that the different display units respectively play the sub-image frames with different viewing angles.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the application and, together with the description, serve to explain the application and are not intended to limit the application. In the drawings:
FIG. 1 is a schematic illustration of a display image of a curved display screen provided in accordance with the prior art;
FIG. 2 is a flow chart of a method for processing display data according to an embodiment of the present application;
FIG. 3 is a schematic view of an alternative curved display screen provided in accordance with an embodiment of the present application;
FIG. 4 is a schematic diagram of an alternative data processing provided in accordance with an embodiment of the present application;
FIG. 5 is a schematic illustration of an alternative data display provided in accordance with an embodiment of the present application;
FIG. 6a is a first schematic diagram of alternative curved display screen display data according to an embodiment of the present application;
FIG. 6b is a second schematic diagram of alternative curved display screen display data according to an embodiment of the present application;
FIG. 6c is a third schematic diagram of alternative curved display screen display data provided in accordance with an embodiment of the present application;
FIG. 6d is a fourth schematic diagram of alternative curved display screen display data provided in accordance with an embodiment of the present application;
FIG. 7 is a schematic diagram of a device for processing display data according to an embodiment of the present application;
fig. 8 is a schematic diagram of a processing system for displaying data according to an embodiment of the application.
Wherein the figures include the following reference numerals:
10. a curved display screen; 11. a display unit; 20. image pictures to be broadcast; 21. a near target; 22. a distant target; 30. user perspective limit range.
Detailed Description
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged under appropriate circumstances such that embodiments of the application described herein may be used. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
According to an embodiment of the present application, there is provided a method of processing display data.
Fig. 2 is a flowchart of a processing method of display data according to an embodiment of the present application. As shown in fig. 2, the method comprises the steps of:
step S102, acquiring an image picture needing to be broadcasted.
And step S104, processing the image picture by using a plurality of virtual cameras to obtain a plurality of sub-image pictures, wherein each virtual camera corresponds to one visual angle respectively, and each virtual camera acquires image data in a corresponding visual angle range from the image picture.
Optionally, in the method for processing display data provided in the embodiment of the present application, processing an image frame using a plurality of virtual cameras to obtain a plurality of sub-image frames includes: acquiring a visual angle of each display unit in the curved surface display screen, wherein the visual angle is a visual angle when a target object watches the display unit; determining the visual angle of each virtual camera based on the visual angle of each display unit in the curved surface display screen, wherein the visual angle of each display unit is the same as the visual angle of the corresponding virtual camera, and the number of the virtual cameras is the same as that of the display units; and extracting image data of each virtual camera in the corresponding view angle range from the image picture to generate a plurality of sub-image pictures, wherein each virtual camera provides the corresponding sub-image picture for one display unit.
That is, the plurality of virtual cameras extract image data within the view angle range corresponding to each display unit from the image picture according to the visual angle of the user viewing each display unit in front of the curved display screen.
Optionally, in the method for processing display data provided in the embodiment of the present application, extracting image data of each virtual camera in a corresponding view angle range from an image frame, and generating a plurality of sub-image frames includes: determining an image picture in each visual angle range according to the visual angle range of each virtual camera; and dividing the image picture to be played according to the image picture in each visual angle range to obtain a plurality of sub-image pictures.
That is, each virtual camera determines an image frame corresponding to the viewing angle range according to the viewing angle range corresponding to the virtual camera, and then performs segmentation processing on the image frame to be played on the basis of determining a plurality of image frames to obtain sub-image frames.
Optionally, in the method for processing display data provided in the embodiment of the present application, before determining, according to a viewing angle range of each virtual camera, an image frame in each viewing angle range, the method further includes: acquiring the visual angle range of each display unit in the curved surface display screen, wherein the visual angle range is the visual range of a target object when the target object watches the display units; the viewing angle range of each virtual camera is set to be the same as that of the corresponding display unit.
That is, the virtual cameras simulate the visual angle of the user viewing each display unit in front of the curved display screen, and extract the image data within the visual angle range corresponding to each display unit from the image picture.
In an alternative example, as shown in fig. 3, the user views each display unit in the curved display screen at a point O at the center of the curved display screen, and at this time, there is one display unit with a corresponding viewing angle α in the plurality of display units in the curved display screen. Further, the image frames are processed by the virtual camera with the angle of view α, so as to extract the image data within the range of the angle of view α from the image frames, wherein the image data is finally played in the display unit with the corresponding angle of view α.
Further, as shown in fig. 3, the viewing angles corresponding to the near object 21 and the far object 22 in one sub-picture are the same as those corresponding to the display unit playing the sub-picture.
In an alternative example, the viewing angle range of each display unit in the curved display screen may be determined by: determining the arc center of a curved surface display screen, wherein a plurality of display units contained in the curved surface display screen are arranged in an array mode according to a preset radian; and setting an included angle between the left edge and the right edge of the display unit and the arc center of the curved surface as the visual angle range of the display unit.
That is, assuming that the user is located at the center of the arc-shaped circle of the curved surface display screen to view the image content played by the curved surface display screen, at this time, the viewing angle range of each display unit is: the user is positioned in the range of an included angle formed by the center of the arc of the curved surface and the left edge and the right edge of the display unit.
And step S106, respectively transmitting the plurality of sub-images to corresponding display units for displaying, wherein the curved surface display screen is formed by splicing the plurality of display units receiving the sub-images, and each virtual camera corresponds to one display unit.
Optionally, in the method for processing display data provided in this embodiment of the present application, before the plurality of sub-image frames are respectively transmitted to the corresponding display units to be displayed, the method further includes: determining the position information of a sub-image picture projected by each virtual camera in the curved surface display screen based on the coordinates of each display unit in the curved surface display screen and the corresponding relation between the virtual camera and the display unit; and determining a display unit corresponding to each sub-image picture based on the position information of the sub-image picture projected by each virtual camera in the curved surface display screen.
That is, when an image frame to be played is acquired and a plurality of sub-image frames are obtained by processing the image frame with a plurality of virtual cameras, in order to determine a display unit corresponding to each sub-image frame, the processing method first determines position information of projection of each sub-image frame on a curved display screen, and then determines the display unit corresponding to each sub-image frame according to the position information.
According to the display data processing method provided by the embodiment of the application, the image picture to be played is acquired; processing the image picture by using a plurality of virtual cameras to obtain a plurality of sub-image pictures, wherein each virtual camera corresponds to a visual angle respectively, and each virtual camera acquires image data in a corresponding visual angle range from the image picture; the plurality of sub-picture frames are respectively transmitted to the corresponding display units to be displayed, wherein the curved surface display screen is formed by splicing the plurality of display units receiving the sub-picture frames, each virtual camera corresponds to one display unit, and the technical problem that video data played by the curved surface display screen in the related technology has no stereoscopic space type immersion sense is solved.
That is, the image frames to be played are processed by the plurality of virtual cameras to obtain a plurality of sub-image frames with different viewing angles, and the plurality of display units of the curved surface display screen respectively play the corresponding sub-image frames, so that the different display units respectively play the sub-image frames with different viewing angles.
To sum up, the processing method for display data provided in the embodiment of the present application performs 1: 1 array output, and the technical purpose of completely matching the covering visual angle, the perspective distance sense and the visual field height is realized, thereby achieving the completely immersive three-dimensional display effect.
For example, the following steps are carried out: as shown in fig. 3, a plurality of LED display units are arranged according to a certain radian to form an inner arc-shaped curved display screen, wherein the radian of the curved display screen can be 0 to 360 degrees, and the audience is positioned in the arc-shaped inner part of the curved display screen and looks towards the screen.
Starting from the circle center o of the curved surface display screen, the LED display units correspond to each other, and then a plurality of sectors with the angles of alpha are formed. Further, a plurality of virtual cameras with fixed viewing angles are determined according to the plurality of alpha angles, and the image pictures to be played on the curved surface display screen are processed by using the plurality of virtual cameras with fixed viewing angles to obtain a plurality of sub-image pictures, wherein the number of the virtual cameras is the same as that of the LED display units, and the viewing angle of each virtual camera is the same as the fan-shaped angle alpha of the corresponding display unit. Further, as shown in fig. 4, the multiple sub-images processed by the multiple virtual cameras are merged and integrated, and the merged and integrated whole image is transmitted to the display end, so that each display unit plays the corresponding sub-image. At this time, as shown in fig. 5, the viewer is placed in the LED curved display screen, and the viewer sees the picture played by the LED curved display screen through the curved display screen, so that the viewer has a strong sense of spatial immersion.
That is, the processing method of display data provided in the embodiment of the present application achieves an immersive stereoscopic display effect as in fig. 6a, 6b, 6c, and 6D through the following key technical features, so that a user can be immersed in a 3D environment generated by a curved display screen.
Firstly, according to the display unit array condition of the LED curved surface display screen on the actual site, the visual angles corresponding to a plurality of virtual cameras are determined, and a plurality of sub-image pictures processed by the virtual cameras are obtained.
And secondly, integrating a plurality of sub-image pictures obtained by processing the plurality of virtual cameras according to parameters such as actual radian, radius, height and the like of the curved surface display screen, and inputting the integrated sub-image pictures into the corresponding display units in the curved surface display screen for displaying so as to form a special and complete image picture and achieve a space three-dimensional display effect.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.
The embodiment of the present application further provides a processing apparatus for display data, and it should be noted that the processing apparatus for display data of the embodiment of the present application may be used to execute the processing method for display data provided in the embodiment of the present application. The following describes a display data processing apparatus according to an embodiment of the present application.
Fig. 7 is a schematic diagram of a device for processing display data according to an embodiment of the present application. As shown in fig. 7, the apparatus includes: a first acquisition unit 71, a second acquisition unit 73, and a transmission unit 75.
A first obtaining unit 71, configured to obtain an image picture to be played;
a second obtaining unit 73, configured to process the image frame by using a plurality of virtual cameras to obtain a plurality of sub-image frames, where each virtual camera corresponds to a viewing angle, and each virtual camera obtains image data in a corresponding viewing angle range from the image frame;
and a transmission unit 75, configured to transmit the multiple sub-images to corresponding display units respectively for display, where the curved display screen is formed by splicing multiple display units that receive the sub-images, and each virtual camera corresponds to one display unit.
Optionally, in the processing apparatus for display data provided in the embodiment of the present application, the second obtaining unit 73 includes: the acquisition subunit is used for acquiring the visual angle of each display unit in the curved surface display screen, wherein the visual angle is the visual angle of a target object when the target object watches the display unit; the determining subunit is used for determining the visual angle of each virtual camera based on the visual angle of each display unit in the curved surface display screen, wherein the visual angle of each display unit is the same as the visual angle of the corresponding virtual camera, and the number of the virtual cameras is the same as that of the display units; and the generating subunit is used for extracting the image data of each virtual camera in the corresponding view angle range from the image picture and generating a plurality of sub-image pictures, wherein each virtual camera respectively provides the corresponding sub-image picture for one display unit.
Optionally, in the apparatus for processing display data provided in the embodiment of the present application, the generating subunit includes: the determining module is used for determining an image picture in each visual angle range according to the visual angle range of each virtual camera; and the dividing module is used for dividing the image picture to be played according to the image picture in each visual angle range to obtain a plurality of sub-image pictures.
Optionally, in the apparatus for processing display data provided in the embodiment of the present application, the apparatus further includes: the acquisition module is used for acquiring the visual angle range of each display unit in the curved surface display screen before determining the image picture in each visual angle range according to the visual angle range of each virtual camera, wherein the visual angle range is the visual range of a target object when the target object watches the display unit; and the setting module is used for setting the visual angle range of each virtual camera to be the same as that of the corresponding display unit.
Optionally, in the apparatus for processing display data provided in the embodiment of the present application, the obtaining module includes: the determining submodule is used for determining the arc circle center of a curved surface of the curved surface display screen, wherein a plurality of display units contained in the curved surface display screen are arranged in an array mode according to a preset radian; and the setting submodule is used for setting an included angle between the left edge and the right edge of the display unit and the arc circle center of the curved surface as a visual angle range of the display unit.
Optionally, in the apparatus for processing display data provided in the embodiment of the present application, the apparatus further includes: the first determining unit is used for determining the position information of the sub-image pictures projected by each virtual camera in the curved surface display screen based on the coordinates of each display unit in the curved surface display screen and the corresponding relation between the virtual camera and the display units before the plurality of sub-image pictures are respectively transmitted to the corresponding display units to be displayed; and the second determining unit is used for determining the display unit corresponding to each sub-image picture based on the position information of the sub-image pictures projected by each virtual camera in the curved surface display screen.
The processing apparatus for display data provided in the embodiment of the present application, through the first obtaining unit 71, is configured to obtain an image picture to be played; a second obtaining unit 73, configured to process the image frame by using a plurality of virtual cameras to obtain a plurality of sub-image frames, where each virtual camera corresponds to a viewing angle, and each virtual camera obtains image data in a corresponding viewing angle range from the image frame; and the transmission unit 75 is used for transmitting the plurality of sub-image pictures to the corresponding display units respectively for displaying, wherein the curved surface display screen is formed by splicing the plurality of display units receiving the sub-image pictures, and each virtual camera corresponds to one display unit, so that the problem that video data played by the curved surface display screen in the related art has no stereoscopic space type immersion sense is solved.
That is, the image frames to be played are processed by the plurality of virtual cameras to obtain a plurality of sub-image frames with different viewing angles, and the plurality of display units of the curved surface display screen respectively play the corresponding sub-image frames, so that the different display units respectively play the sub-image frames with different viewing angles.
The processing device for display data comprises a processor and a memory, wherein the first acquiring unit 71, the second acquiring unit 73, the transmission unit 75 and the like are stored in the memory as program units, and the processor executes the program units stored in the memory to realize corresponding functions.
The processor comprises a kernel, and the kernel calls the corresponding program unit from the memory. The kernel can be set to be one or more than one, and when the curved surface display screen plays the space video information by adjusting the kernel parameters, the picture content of the curved surface display screen has the visual perception of a three-dimensional space.
The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
The embodiment of the present application further provides a processing system for display data, and it should be noted that the processing system for display data of the embodiment of the present application may be used to execute the processing method for display data provided in the embodiment of the present application. The following describes a processing system for display data provided in an embodiment of the present application.
FIG. 8 is a schematic diagram of a processing system for displaying data according to an embodiment of the application. As shown in fig. 8, the system includes: an information processing terminal 81 and an information display terminal 83.
The information processing terminal 81 includes a plurality of virtual cameras, and is configured to acquire an image frame to be played, and process the image frame through the plurality of virtual cameras to obtain a plurality of sub-image frames, where each virtual camera corresponds to a viewing angle, and each virtual camera acquires image data within a corresponding viewing angle range from the image frame;
the information display terminal 83 includes a plurality of display units, and is configured to acquire a plurality of sub-images generated by the information processing terminal 81, and transmit the plurality of sub-images to corresponding display units respectively for display, where the curved display screen is formed by splicing the plurality of display units that receive the sub-images, and each virtual camera corresponds to one display unit.
The processing system for display data provided in the embodiment of the application includes, through the information processing terminal 81, a plurality of virtual cameras for acquiring image frames to be played, and processing the image frames through the plurality of virtual cameras to obtain a plurality of sub-image frames, where each virtual camera corresponds to one view angle, and each virtual camera acquires image data within a corresponding view angle range from the image frames; the information display terminal 83 includes a plurality of display units, and is configured to obtain a plurality of sub-images generated by the information processing terminal 81, and transmit the plurality of sub-images to corresponding display units respectively for display, where a curved display screen is formed by splicing the plurality of display units that receive the sub-images, and each virtual camera corresponds to one display unit, so as to solve the problem that video data played by the curved display screen in the related art does not have a stereoscopic immersion effect.
That is, the image frames to be played are processed by the plurality of virtual cameras to obtain a plurality of sub-image frames with different viewing angles, and the plurality of display units of the curved surface display screen respectively play the corresponding sub-image frames, so that the different display units respectively play the sub-image frames with different viewing angles.
An embodiment of the present invention provides a storage medium on which a program is stored, the program implementing a processing method of display data when executed by a processor.
The embodiment of the invention provides a processor, which is used for running a program, wherein a processing method for displaying data is executed when the program runs.
The embodiment of the invention provides equipment, which comprises a processor, a memory and a program which is stored on the memory and can run on the processor, wherein the processor executes the program and realizes the following steps: acquiring an image picture to be broadcasted; processing the image picture by using a plurality of virtual cameras to obtain a plurality of sub-image pictures, wherein each virtual camera corresponds to a visual angle respectively, and each virtual camera acquires image data in a corresponding visual angle range from the image picture; and respectively transmitting the plurality of sub-picture images to corresponding display units for display, wherein the curved surface display screen is formed by splicing the plurality of display units receiving the sub-picture images, and each virtual camera corresponds to one display unit.
Optionally, processing the image frame by using a plurality of virtual cameras to obtain a plurality of sub-image frames includes: acquiring a visual angle of each display unit in the curved surface display screen, wherein the visual angle is a visual angle when a target object watches the display unit; determining the visual angle of each virtual camera based on the visual angle of each display unit in the curved surface display screen, wherein the visual angle of each display unit is the same as the visual angle of the corresponding virtual camera, and the number of the virtual cameras is the same as that of the display units; and extracting image data of each virtual camera in the corresponding view angle range from the image picture to generate a plurality of sub-image pictures, wherein each virtual camera provides the corresponding sub-image picture for one display unit.
Optionally, extracting image data of each virtual camera in a corresponding viewing angle range from the image frames, and generating a plurality of sub-image frames includes: determining an image picture in each visual angle range according to the visual angle range of each virtual camera; and dividing the image picture to be played according to the image picture in each visual angle range to obtain a plurality of sub-image pictures.
Optionally, before determining the image frame in each view angle range according to the view angle range of each virtual camera, the method further includes: acquiring the visual angle range of each display unit in the curved surface display screen, wherein the visual angle range is the visual range of a target object when the target object watches the display units; the viewing angle range of each virtual camera is set to be the same as that of the corresponding display unit.
Optionally, the obtaining of the view angle range of each display unit in the curved display screen includes: determining the arc center of a curved surface display screen, wherein a plurality of display units contained in the curved surface display screen are arranged in an array mode according to a preset radian; and setting an included angle between the left edge and the right edge of the display unit and the arc center of the curved surface as the visual angle range of the display unit.
Optionally, before the plurality of sub-image frames are respectively transmitted to the corresponding display units to be displayed, the method further includes: determining the position information of a sub-image picture projected by each virtual camera in the curved surface display screen based on the coordinates of each display unit in the curved surface display screen and the corresponding relation between the virtual camera and the display unit; and determining a display unit corresponding to each sub-image picture based on the position information of the sub-image picture projected by each virtual camera in the curved surface display screen. The device herein may be a server, a PC, a PAD, a mobile phone, etc.
The present application further provides a computer program product adapted to perform a program for initializing the following method steps when executed on a data processing device: acquiring an image picture to be broadcasted; processing the image picture by using a plurality of virtual cameras to obtain a plurality of sub-image pictures, wherein each virtual camera corresponds to a visual angle respectively, and each virtual camera acquires image data in a corresponding visual angle range from the image picture; and respectively transmitting the plurality of sub-picture images to corresponding display units for display, wherein the curved surface display screen is formed by splicing the plurality of display units receiving the sub-picture images, and each virtual camera corresponds to one display unit.
Optionally, processing the image frame by using a plurality of virtual cameras to obtain a plurality of sub-image frames includes: acquiring a visual angle of each display unit in the curved surface display screen, wherein the visual angle is a visual angle when a target object watches the display unit; determining the visual angle of each virtual camera based on the visual angle of each display unit in the curved surface display screen, wherein the visual angle of each display unit is the same as the visual angle of the corresponding virtual camera, and the number of the virtual cameras is the same as that of the display units; and extracting image data of each virtual camera in the corresponding view angle range from the image picture to generate a plurality of sub-image pictures, wherein each virtual camera provides the corresponding sub-image picture for one display unit.
Optionally, extracting image data of each virtual camera in a corresponding viewing angle range from the image frames, and generating a plurality of sub-image frames includes: determining an image picture in each visual angle range according to the visual angle range of each virtual camera; and dividing the image picture to be played according to the image picture in each visual angle range to obtain a plurality of sub-image pictures.
Optionally, before determining the image frame in each view angle range according to the view angle range of each virtual camera, the method further includes: acquiring the visual angle range of each display unit in the curved surface display screen, wherein the visual angle range is the visual range of a target object when the target object watches the display units; the viewing angle range of each virtual camera is set to be the same as that of the corresponding display unit.
Optionally, the obtaining of the view angle range of each display unit in the curved display screen includes: determining the arc center of a curved surface display screen, wherein a plurality of display units contained in the curved surface display screen are arranged in an array mode according to a preset radian; and setting an included angle between the left edge and the right edge of the display unit and the arc center of the curved surface as the visual angle range of the display unit.
Optionally, before the plurality of sub-image frames are respectively transmitted to the corresponding display units to be displayed, the method further includes: determining the position information of a sub-image picture projected by each virtual camera in the curved surface display screen based on the coordinates of each display unit in the curved surface display screen and the corresponding relation between the virtual camera and the display unit; and determining a display unit corresponding to each sub-image picture based on the position information of the sub-image picture projected by each virtual camera in the curved surface display screen.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims (5)

1. A method for processing display data, the method comprising:
acquiring an image picture to be broadcasted;
processing the image picture by using a plurality of virtual cameras to obtain a plurality of sub-image pictures, wherein each virtual camera corresponds to a visual angle respectively, and each virtual camera acquires image data in a corresponding visual angle range from the image picture;
respectively transmitting the plurality of sub-image pictures to corresponding display units for displaying, wherein the curved surface display screen is formed by splicing the plurality of display units receiving the sub-image pictures, and each virtual camera corresponds to one display unit;
wherein processing the image frame using the plurality of virtual cameras to obtain a plurality of sub-image frames comprises: acquiring a visual angle of each display unit in the curved surface display screen, wherein the visual angle is a visual angle when a target object watches the display unit; determining the visual angle of each virtual camera based on the visual angle of each display unit in the curved surface display screen, wherein the visual angle of each display unit is the same as the visual angle of the corresponding virtual camera, and the number of the virtual cameras is the same as that of the display units; extracting image data of each virtual camera in a corresponding view angle range from the image pictures to generate a plurality of sub-image pictures, wherein each virtual camera provides a corresponding sub-image picture for one display unit;
wherein extracting image data of each virtual camera within a corresponding view angle range from the image frames, and generating the plurality of sub-image frames comprises: determining an image picture in each visual angle range according to the visual angle range of each virtual camera; dividing the image picture to be played according to the image picture in each visual angle range to obtain a plurality of sub-image pictures;
before determining the image frames in each view angle range according to the view angle range of each virtual camera, the method further comprises the following steps: acquiring a visual angle range of each display unit in the curved surface display screen, wherein the visual angle range is a visual range of a target object when the target object watches the display units; setting the visual angle range of each virtual camera to be the same as that of the corresponding display unit;
wherein, obtaining the visual angle range of each display unit in the curved surface display screen comprises: determining the center of a curved surface arc circle of the curved surface display screen, wherein a plurality of display units contained in the curved surface display screen are arranged in an array mode according to a preset radian; setting an included angle between the left edge and the right edge of the display unit and the arc center of the curved surface as the visual angle range of the display unit;
the curved surface display screen comprises a plurality of display units, wherein the plurality of display units are arranged in an array mode according to a preset radian.
2. The method according to claim 1, wherein before the plurality of sub-picture frames are respectively transmitted to the corresponding display units for display, the method further comprises:
determining the position information of a sub-image picture projected by each virtual camera in the curved surface display screen based on the coordinates of each display unit in the curved surface display screen and the corresponding relation between the virtual camera and the display unit;
and determining a display unit corresponding to each sub-image picture based on the position information of the sub-image picture projected in the curved surface display screen by each virtual camera.
3. A processing apparatus for displaying data, comprising:
the first acquisition unit is used for acquiring an image picture to be broadcasted;
the second acquisition unit is used for processing the image picture by using a plurality of virtual cameras to obtain a plurality of sub-image pictures, wherein each virtual camera corresponds to a visual angle respectively, and each virtual camera acquires image data in a corresponding visual angle range from the image picture;
the display unit is used for respectively transmitting the plurality of sub-image pictures to the corresponding display units for displaying, wherein the curved surface display screen is formed by splicing the plurality of display units receiving the sub-image pictures, and each virtual camera corresponds to one display unit;
the processing device for the display data is further used for acquiring a visual angle of each display unit in the curved display screen, wherein the visual angle is a visual angle when a target object watches the display unit; determining the visual angle of each virtual camera based on the visual angle of each display unit in the curved surface display screen, wherein the visual angle of each display unit is the same as the visual angle of the corresponding virtual camera, and the number of the virtual cameras is the same as that of the display units; extracting image data of each virtual camera in a corresponding view angle range from the image pictures to generate a plurality of sub-image pictures, wherein each virtual camera provides a corresponding sub-image picture for one display unit;
wherein the generating subunit includes: the determining module is used for determining an image picture in each visual angle range according to the visual angle range of each virtual camera; the segmentation module is used for segmenting the image picture to be played according to the image picture in each visual angle range to obtain a plurality of sub-image pictures;
wherein, the device still includes: the acquisition module is used for acquiring the visual angle range of each display unit in the curved surface display screen before determining the image picture in each visual angle range according to the visual angle range of each virtual camera, wherein the visual angle range is the visual range of a target object when the target object watches the display unit; the setting module is used for setting the visual angle range of each virtual camera to be the same as the visual angle range of the corresponding display unit;
wherein, the acquisition module includes: the determining submodule is used for determining the arc circle center of a curved surface of the curved surface display screen, wherein a plurality of display units contained in the curved surface display screen are arranged in an array mode according to a preset radian; the setting submodule is used for setting an included angle between the left edge and the right edge of the display unit and the center of the curved arc-shaped circle as a visual angle range of the display unit;
the curved surface display screen comprises a plurality of display units, wherein the plurality of display units are arranged in an array mode according to a preset radian.
4. A system for processing display data, comprising:
the information processing terminal comprises a plurality of virtual cameras and a plurality of display units, wherein the virtual cameras are used for acquiring image pictures to be played and processing the image pictures through the virtual cameras to obtain a plurality of sub-image pictures, each virtual camera corresponds to a visual angle, and each virtual camera acquires image data in a corresponding visual angle range from the image pictures;
the information display terminal comprises a plurality of display units and is used for acquiring the plurality of sub-image pictures generated by the information processing terminal and respectively transmitting the plurality of sub-image pictures to the corresponding display units for display, wherein the curved surface display screen is formed by splicing the plurality of display units which receive the sub-image pictures, and each virtual camera corresponds to one display unit;
wherein, the information processing terminal is further configured to: acquiring a visual angle of each display unit in the curved surface display screen, wherein the visual angle is a visual angle when a target object watches the display unit; determining the visual angle of each virtual camera based on the visual angle of each display unit in the curved surface display screen, wherein the visual angle of each display unit is the same as the visual angle of the corresponding virtual camera, and the number of the virtual cameras is the same as that of the display units; extracting image data of each virtual camera in a corresponding view angle range from the image pictures to generate a plurality of sub-image pictures, wherein each virtual camera provides a corresponding sub-image picture for one display unit;
wherein, the information processing terminal is further configured to: determining the center of a curved surface arc circle of the curved surface display screen, wherein a plurality of display units contained in the curved surface display screen are arranged in an array mode according to a preset radian; setting an included angle between the left edge and the right edge of the display unit and the arc-shaped circle center of the curved surface as a visual angle range of the display unit, wherein the visual angle range is a visual range of a target object when the display unit is watched; setting the visual angle range of each virtual camera to be the same as that of the corresponding display unit; determining an image picture in each visual angle range according to the visual angle range of each virtual camera; and dividing the image picture to be played according to the image picture in each visual angle range to obtain the plurality of sub-image pictures.
5. A storage medium characterized by comprising a stored program, wherein the program executes the processing method of display data according to claim 1 or 2.
CN201811435965.8A 2018-11-28 2018-11-28 Display data processing method, device and system Active CN109729338B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811435965.8A CN109729338B (en) 2018-11-28 2018-11-28 Display data processing method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811435965.8A CN109729338B (en) 2018-11-28 2018-11-28 Display data processing method, device and system

Publications (2)

Publication Number Publication Date
CN109729338A CN109729338A (en) 2019-05-07
CN109729338B true CN109729338B (en) 2021-10-01

Family

ID=66294740

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811435965.8A Active CN109729338B (en) 2018-11-28 2018-11-28 Display data processing method, device and system

Country Status (1)

Country Link
CN (1) CN109729338B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111142825B (en) * 2019-12-27 2024-04-16 杭州拓叭吧科技有限公司 Multi-screen visual field display method and system and electronic equipment
CN113453041A (en) * 2020-03-27 2021-09-28 阿里巴巴集团控股有限公司 Data processing method, device, equipment and storage medium
CN112351266B (en) * 2020-10-27 2023-03-24 郑州捷安高科股份有限公司 Three-dimensional visual processing method, device, equipment, display system and medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69729454T2 (en) * 1997-10-30 2005-06-09 Constantopoulos, Ioannis Vassilios passenger aircraft
EP3148186A1 (en) * 2015-09-24 2017-03-29 Airbus Operations GmbH Virtual windows for airborne vehicles
CN107197135B (en) * 2016-03-21 2021-04-06 成都理想境界科技有限公司 Video generation method and video generation device
CN108124193A (en) * 2017-12-25 2018-06-05 中兴通讯股份有限公司 Method for processing video frequency and device

Also Published As

Publication number Publication date
CN109729338A (en) 2019-05-07

Similar Documents

Publication Publication Date Title
KR102052567B1 (en) Virtual 3D Video Generation and Management System and Method
KR101907945B1 (en) Displaying graphics in multi-view scenes
CN103731656B (en) Image display control apparatus and method
WO2017113681A1 (en) Video image processing method and apparatus based on virtual reality technology
CN109729338B (en) Display data processing method, device and system
JP2019511024A (en) Adaptive Stitching of Frames in the Process of Generating Panoramic Frames
CN106375748A (en) Method and apparatus for splicing three-dimensional virtual reality panoramic view, and electronic device
CN106228530B (en) A kind of stereography method, device and stereo equipment
CN108833877B (en) Image processing method and device, computer device and readable storage medium
US20190068993A1 (en) Multi-Camera Image Coding
CN109640070A (en) A kind of stereo display method, device, equipment and storage medium
US20190318458A1 (en) Method For Rendering A Final Image From Initial Images Acquired By A Camera Array, Corresponding Device, Computer Program Product And Computer-Readable Carrier Medium
CN110933461B (en) Image processing method, device, system, network equipment, terminal and storage medium
CN113408484A (en) Picture display method, device, terminal and storage medium
US20070122029A1 (en) System and method for capturing visual data and non-visual data for multi-dimensional image display
CN109978945B (en) Augmented reality information processing method and device
CN114827465A (en) Image acquisition method and device and electronic equipment
CN114449303A (en) Live broadcast picture generation method and device, storage medium and electronic device
US9942540B2 (en) Method and a device for creating images
CN109300182B (en) Panoramic image data processing method, processing device and storage medium
CN113382222B (en) Display method based on holographic sand table in user moving process
CN100498840C (en) Method of and scaling unit for scaling a three-dimensional model
KR101773929B1 (en) System for processing video with wide viewing angle, methods for transmitting and displaying vide with wide viewing angle and computer programs for the same
CN112261400B (en) Method, device and product for processing dome screen video stream based on 720-degree capsule screen
RU2591168C2 (en) 3d intelligent terminal and system using glasses

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20200803

Address after: No.206, floor 2, No.11, Fengzhi East Road, Baiwang Innovation Technology Park, Xibeiwang Town, Haidian District, Beijing 100094

Applicant after: Beijing Virtual Dynamic Technology Co.,Ltd.

Address before: 100091, No. 9 Hongqi West Street, Beijing, Haidian District

Applicant before: LEYARD OPTOELECTRONIC Co.,Ltd.

GR01 Patent grant
GR01 Patent grant