CN113556443A - LED screen real-time correction method facing virtual playing environment and virtual playing system - Google Patents
LED screen real-time correction method facing virtual playing environment and virtual playing system Download PDFInfo
- Publication number
- CN113556443A CN113556443A CN202110817609.8A CN202110817609A CN113556443A CN 113556443 A CN113556443 A CN 113556443A CN 202110817609 A CN202110817609 A CN 202110817609A CN 113556443 A CN113556443 A CN 113556443A
- Authority
- CN
- China
- Prior art keywords
- led screen
- led
- real
- correction method
- time correction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
- G09G3/30—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
- G09G3/32—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0271—Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0626—Adjustment of display parameters for control of overall brightness
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/066—Adjustment of display parameters for control of contrast
Abstract
The invention discloses a virtual studio environment-oriented LED screen real-time correction method and a virtual studio system. The real-time correction method of the LED screen comprises the following steps: tracking the position of a camera in a three-dimensional space built by an LED screen in real time to obtain the spatial position relation of each area in the LED screen relative to the camera; and dynamically correcting the display elements in different areas of the LED screen according to the influence of the spatial position relation on the LED display effect. By using the invention, the shooting effect of the XR virtual playing technology can be improved.
Description
Technical Field
The invention relates to a real-time correction method for an LED screen, in particular to a method for correcting different areas of the LED screen in real time for the requirements of a virtual studio environment, and also relates to a virtual studio system adopting the method, belonging to the technical field of XR virtual studio.
Background
The XR (eXtended Reality) virtual presentation technology is a virtual production method that uses the depth fusion of an LED screen, a camera tracking system, a real-time graphics rendering engine, and the like to place performers in a virtual world in real time without a green screen and a post-production process. In the practical application level, the XR virtual studio technology has a tendency of subversing and replacing the original shooting mode of the blue-green box.
In XR virtual presentation technology, a high quality LED screen (usually presented as a circular or spherical screen) simultaneously displays a three-dimensional virtual environment preloaded by a real-time graphics rendering Engine (usually using a non-real Engine or Notch). These LED screens constitute the background for movie or live events, while providing illumination of the scene. This facilitates seamless fusion of the real character with the virtual environment and reduces the time for further lighting adjustments. When an accurate camera tracking system is added, the camera begins to move around seamlessly integrated real and virtual elements within the LED screen, creating a fused immersive illusion for viewers looking through the camera view. Therefore, the LED screen plays an irreplaceable important role in XR virtual presentation technology, and directly determines the quality of the shooting effect.
On the other hand, LED screens all have a viewing angle characteristic. By visual angle is meant the angle at which a user can clearly view all content on the LED screen from different directions. The visual angle of the LED screen comprises two indexes of a horizontal visual angle and a vertical visual angle. The horizontal visual angle is based on the vertical normal of the display screen (i.e. the vertical imaginary line in the middle of the display screen), and the display image can still be normally seen at a position which is vertical to the normal and has a certain angle at the left or right, and the angle range is the horizontal visual angle of the LED screen; similarly, if the horizontal normal is taken as a reference, the viewing angle in the up-down direction is referred to as the vertical viewing angle. Generally, the viewing angle is based on the contrast change. As the viewing angle increases, the contrast of the displayed image seen at that location decreases. In addition, the visual angle has a great relationship with factors such as the viewing angle and the viewing distance of the user. For an LED screen, the size of the viewing angle is mainly determined by the die packaging manner, and belongs to the basic performance parameters which are already cured before the factory shipment.
The display effect of the LED screen is corrected and optimized in the XR virtual playing technology, and the shooting effect is undoubtedly greatly improved. However, at present, no mature technical solution is available in this regard.
Disclosure of Invention
The invention aims to provide a real-time LED screen correction method facing to a virtual playing environment.
Another technical problem to be solved by the present invention is to provide a virtual studio system using the LED screen real-time correction method.
In order to achieve the purpose, the invention adopts the following technical scheme:
according to a first aspect of the embodiments of the present invention, there is provided a method for correcting an LED screen in real time for a virtual studio environment, including the following steps:
tracking the position of a camera in a three-dimensional space built by an LED screen in real time to obtain the spatial position relation of each area in the LED screen relative to the camera;
and dynamically correcting the display elements in different areas of the LED screen according to the influence of the spatial position relation on the LED display effect.
Preferably, the display elements include, but are not limited to, any one or more of brightness, contrast, and gray scale.
Preferably, the dynamic correction includes adjusting the LED supply current to the region to increase or decrease the brightness.
Preferably, the dynamic correction includes implementing gray scale and color adjustments using a pulse width modulation method.
Preferably, the same display element correction parameter is adopted for each pixel point of each region.
Preferably, the corresponding correction parameters of the display elements are obtained based on the visual angles of two sides of the splicing line of the adjacent LED screens;
and integrally compensating the pixel points in each adjacent LED screen based on the display element correction parameters.
Preferably, the real-time correction method for the LED screen further comprises the following steps:
and carrying out optical measurement on a three-dimensional space built on an LED screen in advance, making the obtained measurement parameters into a display element correction parameter table, and storing the display element correction parameter table in a server of the virtual presentation system.
Preferably, after obtaining the spatial position relationship of the camera relative to different areas of the LED screen, the display element correction parameters to be used in the area are obtained by table lookup or curve fitting.
Preferably, the granularity of the display element correction parameter table is consistent with the area subdivision degree of the LED screen.
According to a second aspect of the embodiments of the present invention, a virtual studio system is provided, which includes an LED display system, a camera system, a lighting system, a hanging system, a network system, and an LED display dynamic adjustment server; the LED display dynamic adjustment server executes the LED screen real-time correction method and dynamically corrects the display elements in different areas of the LED screen.
Compared with the prior art, the LED screen real-time correction method provided by the invention dynamically corrects the display elements in different areas of the LED screen respectively according to the influence of the spatial position relationship between the camera and the different areas of the LED screen on the LED display effect, so as to eliminate the adverse influence caused by the visual angle characteristic of the LED screen. By using the invention, the shooting effect of the XR virtual playing technology can be improved.
Drawings
FIG. 1 is a schematic diagram of a three-dimensional space constructed by LED screens in a virtual studio system;
FIG. 2 is a flow chart of a real-time calibration method for an LED screen according to the present invention;
FIGS. 3-5 show different exemplary diagrams of the partitioning of the LED screen into different regions, respectively;
fig. 6 is an exemplary architecture diagram of a virtual studio system provided by the present invention.
Detailed Description
The technical contents of the invention are described in detail below with reference to the accompanying drawings and specific embodiments.
As shown in fig. 1, in an embodiment of the virtual broadcasting system provided by the present invention, 2 or more LED screens are selected, an observation window of a virtual three-dimensional space is constructed in a pairwise orthogonal manner, and then the virtual three-dimensional space is mapped onto the LED screens in a correct perspective relationship by a real-time rendering technique, so as to construct a real shooting scene. And finally, under the capture of a camera tracking system and the processing of hardware, the virtual playing system can output a high-definition vivid three-dimensional portrait in real time.
It should be noted that, constructing the three-dimensional space is not limited to the LED screens in a pairwise orthogonal manner, but other manners such as setting 2 intersecting LED screens on the front side, suspending another LED screen above the front side, and mapping the virtual three-dimensional space to each of the LED screens in a correct perspective relationship by a real-time rendering technique can also achieve a similar presentation effect.
In order to obtain better shooting effect, the LED screen in the virtual studio system should have high contrast and high refresh rate. High contrast can promote the stereovision and the vividness of picture, can easily deal with the all-round pursuit of camera and shoot, and the image display that shoots is close human naked eye more sees, and detail and information exhibition are not lost. The high refresh rate can guarantee that the camera does not generate Moire patterns in the shooting process, and the shooting is more clear and real.
On the other hand, in order to overcome the limitation of the inherent viewing angle characteristic of the LED screen, as shown in fig. 2, the LED screen real-time correction method provided by the present invention adopts the following operation steps: tracking the position of a camera (indicated by O in figure 1) in a three-dimensional space constructed by an LED screen in real time to obtain the spatial position relation of each area in the LED screen relative to the camera; according to the influence of the spatial position relation on the LED display effect, display elements (including but not limited to brightness, contrast, gray scale and the like) in different areas of the LED screen are dynamically corrected in real time respectively so as to eliminate the adverse influence brought by the visual angle characteristic of the LED screen.
For example, the brightness displayed in the camera lens is the highest in a certain area of the LED screen directly opposite to the camera, and the shooting effect is usually the best. In other areas of the LED screen not directly opposite to the camera, due to the effect of the viewing angle characteristic, the brightness displayed in the lens of the camera varies with the spatial position relationship between the two areas, for example, the greater the inclination angle with respect to the vertical normal of the LED screen, the lower the brightness displayed in the lens, and therefore, it is necessary to take technical measures to correct the brightness. Specific corrective measures include adjusting the LED supply current or the flashing duty cycle of the area to increase or decrease brightness, using Pulse Width Modulation (PWM) methods to achieve gray scale and color adjustments, etc. In the actual shooting process, the position of the camera is constantly changed, and the spatial position relation of different areas of the LED screen relative to the camera lens is also constantly changed, so the correction process of the display elements is dynamically carried out in real time.
Theoretically, the dynamic correction process is executed on each pixel point in the LED screen, and the shooting effect is definitely better. However, the control process of this operation is complicated, the implementation cost is high, and the operation is not necessary in general. In actual shooting, the inventor finds that color difference and brightness difference are most likely to occur at two sides of a splicing line of two LED screens, so that the simplest compensation method can be to obtain corresponding display element correction parameters based on viewing angles at two sides of the splicing line and perform overall compensation on pixel points in two adjacent LED screens. Further, in another embodiment of the present invention, it is preferable to divide the LED screen into different regions, and track the spatial position of the LED screen relative to the camera in real time in the different regions, so as to dynamically correct the display elements in the regions. Fig. 3 to 5 show different examples of dividing the LED screen into different areas, respectively. In each region, a plurality of pixel points are included, and the same display element correction parameters are adopted. The display element calibration parameters include, but are not limited to, the magnitude of the LED supply current, pulse width modulation parameters, etc., and will not be described in detail herein.
In an embodiment of the present invention, in order to obtain the correction parameters of the display elements in different areas in advance, optical measurement may be performed in a three-dimensional space built by an LED screen by using a measurement tool such as a spot luminance meter, and the obtained measurement parameters are made into a display element correction parameter table and stored in an LED display dynamic adjustment server (abbreviated as a server) of the virtual presentation system. Therefore, after the tracking and positioning system obtains the spatial position relation of the camera relative to different areas of the LED screen, the display element correction parameters which should be adopted by the areas can be quickly obtained through a table look-up mode or by utilizing a curve fitting algorithm and the like, so that the requirement of dynamic real-time correction is met. Therefore, the implementation difficulty and the implementation cost of the real-time LED screen correction method provided by the invention can be greatly simplified, and the method is convenient to popularize and apply.
In a preferred embodiment of the above embodiment, the display element correction parameter table can be quickly created by selecting the corresponding spatial position and performing optical measurement with reference to the division manner of different areas in the LED screen. For example, when the LED screen is divided into a grid-shaped area, the sampling points for performing optical measurement are also distributed in a corresponding grid shape; when the LED screen is divided into horizontal or vertical stripe regions, the sampling points for optical measurement also select corresponding positions in the horizontal or vertical direction. In this way, the granularity of the display element correction parameter table is consistent with the area subdivision degree of the LED screen, and the display element correction parameter table can adapt to the specific requirements of different use scenes.
As shown in fig. 6, the present invention further provides a virtual studio system. The virtual broadcasting system comprises an LED display system (namely an LED screen), a camera system (namely a camera), a lighting system, a hanging system, a synchronization system, a network system and an LED display dynamic adjustment server. In addition, a tracking and positioning system, a recording and broadcasting system, a multimedia server and broadcasting control system, a rendering server and a visual special effect system are realized by software or firmware installed in a computer. The tracking and positioning system acquires coordinates of a camera system (namely a camera) in a three-dimensional space in real time, obtains the spatial position relation of each area in the LED screen relative to the camera, and transmits the spatial position relation to the camera to the LED display dynamic adjustment server. The LED display dynamic adjustment server executes the LED screen real-time correction method, and dynamically corrects display elements (including but not limited to brightness, contrast, gray scale and the like) in different areas of the LED screen according to the influence of the spatial position relation on the LED display effect so as to eliminate the adverse influence brought by the visual angle characteristic of the LED screen.
The LED screen real-time correction method and the virtual broadcasting system for the virtual broadcasting environment provided by the present invention are explained in detail above. It will be apparent to those skilled in the art that any obvious modifications thereof can be made without departing from the spirit of the invention, which infringes the patent right of the invention and bears the corresponding legal responsibility.
Claims (10)
1. A real-time LED screen correction method for a virtual studio environment is characterized by comprising the following steps:
tracking the position of a camera in a three-dimensional space built by an LED screen in real time to obtain the spatial position relation of each area in the LED screen relative to the camera;
and dynamically correcting the display elements in different areas of the LED screen according to the influence of the spatial position relation on the LED display effect.
2. The LED screen real-time correction method of claim 1, characterized in that:
the display elements include, but are not limited to, any one or more of brightness, contrast, and gray scale.
3. The LED screen real-time correction method of claim 1, characterized in that:
the dynamic correction includes adjusting the LED supply current to the region to increase or decrease brightness.
4. The LED screen real-time correction method of claim 1, characterized in that:
the dynamic correction includes achieving gray scale and color adjustments using a pulse width modulation method.
5. The LED screen real-time correction method of claim 1, characterized in that:
and each pixel point of each area adopts the same display element correction parameter.
6. The LED screen real-time correction method of claim 1, characterized in that:
acquiring corresponding display element correction parameters based on the visual angles of two sides of the splicing line of the adjacent LED screens;
and integrally compensating the pixel points in each adjacent LED screen based on the display element correction parameters.
7. The LED screen real-time correction method of claim 1, further comprising the steps of:
and carrying out optical measurement on a three-dimensional space built on an LED screen in advance, making the obtained measurement parameters into a display element correction parameter table, and storing the display element correction parameter table in a server of the virtual presentation system.
8. The LED screen real-time correction method of claim 7, wherein:
after the spatial position relation of the camera relative to different areas of the LED screen is obtained, display element correction parameters which should be adopted by the areas are obtained through a table look-up or curve fitting mode.
9. The LED screen real-time correction method of claim 7, wherein:
the granularity of the display element correction parameter table is consistent with the area subdivision degree of the LED screen.
10. A virtual studio system comprises an LED display system, a camera system, a lighting system, a hanging system, a network system and an LED display dynamic adjustment server, and is characterized in that the LED display dynamic adjustment server executes the LED screen real-time correction method of any one of claims 1 to 9 to dynamically correct display elements in different areas of the LED screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110817609.8A CN113556443A (en) | 2021-07-20 | 2021-07-20 | LED screen real-time correction method facing virtual playing environment and virtual playing system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110817609.8A CN113556443A (en) | 2021-07-20 | 2021-07-20 | LED screen real-time correction method facing virtual playing environment and virtual playing system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113556443A true CN113556443A (en) | 2021-10-26 |
Family
ID=78132209
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110817609.8A Pending CN113556443A (en) | 2021-07-20 | 2021-07-20 | LED screen real-time correction method facing virtual playing environment and virtual playing system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113556443A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114520903A (en) * | 2022-02-17 | 2022-05-20 | 阿里巴巴（中国）有限公司 | Rendering display method, device, storage medium and computer program product |
| CN116433848A (en) * | 2023-04-21 | 2023-07-14 | 北京优酷科技有限公司 | Screen model generation method, device, electronic equipment and storage medium |
| WO2023176269A1 (en) * | 2022-03-15 | 2023-09-21 | ソニーグループ株式会社 | Information processing device, information processing method, and program |
| WO2023189456A1 (en) * | 2022-03-29 | 2023-10-05 | ソニーグループ株式会社 | Information processing device, information processing method, and recording medium |
-
2021
- 2021-07-20 CN CN202110817609.8A patent/CN113556443A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114520903A (en) * | 2022-02-17 | 2022-05-20 | 阿里巴巴（中国）有限公司 | Rendering display method, device, storage medium and computer program product |
| CN114520903B (en) * | 2022-02-17 | 2023-08-08 | 阿里巴巴（中国）有限公司 | Rendering display method, rendering display device, electronic equipment and storage medium |
| WO2023176269A1 (en) * | 2022-03-15 | 2023-09-21 | ソニーグループ株式会社 | Information processing device, information processing method, and program |
| WO2023189456A1 (en) * | 2022-03-29 | 2023-10-05 | ソニーグループ株式会社 | Information processing device, information processing method, and recording medium |
| CN116433848A (en) * | 2023-04-21 | 2023-07-14 | 北京优酷科技有限公司 | Screen model generation method, device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113556443A (en) | LED screen real-time correction method facing virtual playing environment and virtual playing system | |
| JP5340952B2 (en) | 3D projection display | |
| Zilly et al. | Production rules for stereo acquisition | |
| US8189035B2 (en) | Method and apparatus for rendering virtual see-through scenes on single or tiled displays | |
| US9401041B2 (en) | Multi view synthesis method and display devices with spatial and inter-view consistency | |
| US8711204B2 (en) | Stereoscopic editing for video production, post-production and display adaptation | |
| CN107341832B (en) | Multi-view switching shooting system and method based on infrared positioning system | |
| CN107147899B (en) | CAVE display system and method adopting LED3D screen | |
| WO2007149322A2 (en) | System and method for displaying images | |
| US20070291047A1 (en) | System and method for generating scale maps | |
| WO2016098411A1 (en) | Video display device, video display system, and video display method | |
| KR101174551B1 (en) | Lighting apparatus | |
| WO2007149323A2 (en) | Mesh for rendering an image frame | |
| JP2014522591A (en) | Alignment, calibration, and rendering systems and methods for square slice real-image 3D displays | |
| CN111869202B (en) | Method for reducing crosstalk on autostereoscopic displays | |
| US10368048B2 (en) | Method for the representation of a three-dimensional scene on an auto-stereoscopic monitor | |
| US10244216B2 (en) | Projector, video display device, and video display method | |
| US20090195758A1 (en) | Meshes for separately mapping color bands | |
| CN115578970A (en) | Spherical LED screen correction method, device and system and electronic equipment | |
| CN109782452B (en) | Stereoscopic image generation method, imaging method and system | |
| US9681114B2 (en) | System and method for adaptive scalable dynamic conversion, quality and processing optimization, enhancement, correction, mastering, and other advantageous processing of three dimensional media content | |
| KR20180003590A (en) | Generating images for stereoscopic image display without spectacles | |
| CN115083303A (en) | Method, medium and device for correcting spatial color of LED display screen under mobile visual angle | |
| US20160037148A1 (en) | 3d-mapped video projection based on on-set camera positioning | |
| US11977811B2 (en) | Controlling characteristics of light output from LED walls |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |