CN117309147A

CN117309147A - Color calibration method, device, equipment and medium for virtual shooting system

Info

Publication number: CN117309147A
Application number: CN202311240235.3A
Authority: CN
Inventors: 范文龄; 曹祎冰
Original assignee: Shenli Vision Shenzhen Cultural Technology Co ltd
Current assignee: Shenli Vision Shenzhen Cultural Technology Co ltd
Priority date: 2023-09-22
Filing date: 2023-09-22
Publication date: 2023-12-29

Abstract

The present disclosure relates to a color calibration method, apparatus, device, and medium for a virtual photographing system, the method comprising: responding to triggering a screen calibration function of any screen in the virtual shooting system in an interactive interface of the terminal equipment, and displaying a screen measurement result corresponding to the screen, wherein the screen measurement result is used for guiding a user to calibrate the screen brightness of the screen; and responding to triggering a color calibration function in an interactive interface of the terminal equipment, and displaying a first color card and a second color card, wherein the first color card and the second color card are used for guiding a user to calibrate the colors of pictures to be displayed on a screen. According to the embodiment of the disclosure, the accuracy and usability of color calibration can be improved, the dependence on subjective experience of professionals is reduced, and the efficiency of color calibration is improved.

Description

Color calibration method, device, equipment and medium for virtual shooting system

Technical Field

The disclosure relates to the technical field of virtual shooting, and in particular relates to a color calibration method, device, equipment and medium for a virtual shooting system.

Background

The virtual shooting is to cast a virtual picture onto an LED screen for display, then the actor performs by using the LED screen as a background, an image acquisition device (such as a camera) shoots the actor and the LED screen at the same time, and then the shot image is synthesized with the original virtual picture, so that the real actor is placed in the virtual scene, and the effect of shooting the external scene or the science fiction background in the film studio is achieved.

The virtual shooting process generally comprises screen display on a virtual picture, shooting of an LED screen by a camera, and transferring of a shot screen image to a display for viewing by a director, wherein in the process, the color of the image shot by the camera is required to be calibrated with the color of the screen image due to the influence of external environment (such as external environment light) on the brightness of the LED screen, the difference of the color ranges of the camera and the LED screen, noise existing in the transmission process of image data between different devices and the like, so that when deviation exists between the color of the screen image shot by the camera and the original color in the virtual picture, the color of the image shot by the camera is required to meet the requirements of color consistency and accuracy.

The existing color calibration process mostly relies on experience of professionals, colors in virtual pictures are debugged by observing color differences between screen images displayed in monitors and the virtual pictures through naked eyes, and the method has the problems of low accuracy, dependence on subjective experience of professionals, low usability and the like.

Disclosure of Invention

In view of this, the disclosure provides a color calibration method, device, equipment and medium for a virtual shooting system, which can improve the accuracy and usability of color calibration, reduce the dependence on subjective experience of professionals, and improve the color calibration efficiency.

According to an aspect of the present disclosure, there is provided a color calibration method for a virtual photographing system including a camera and at least one screen, the method being applied to a terminal apparatus, including: responding to triggering a screen calibration function of any screen in the virtual shooting system in an interactive interface of the terminal equipment, and displaying a screen measurement result corresponding to the screen, wherein the screen measurement result comprises a measurement color value and a measurement brightness value extracted from a first image sequence acquired when a first color sequence is displayed on the screen by the camera, and an original color value and an original brightness value contained in the first color sequence, and the screen measurement result is used for guiding a user to calibrate the screen brightness of the screen; and responding to triggering a color calibration function in an interactive interface of the terminal equipment, displaying a first color card and a second color card, wherein the first color card represents measurement color values of multiple colors extracted from a second image sequence acquired when the camera displays a second color sequence on the screen, the second color card represents original color values of multiple colors in the second color sequence, and the first color card and the second color card are used for guiding a user to calibrate the colors of pictures to be displayed on the screen.

In one possible implementation manner, when the second color sequence is displayed, the screen further displays two-dimensional identification codes ArUco codes, different colors in the second color sequence correspond to different ArUco codes, and different ArUco codes corresponding to different colors in the second color sequence are used for indicating original color values of different colors in the second color sequence.

In one possible implementation, before displaying the first color card and the second color card, the method further includes: controlling the screen to simultaneously display various colors in the second color sequence and ArUco codes corresponding to the various colors in the second color sequence, and simultaneously controlling the camera to acquire images of the screen to obtain a second image sequence; obtaining a plurality of measurement color values and a plurality of corresponding original color values extracted from the second image sequence by carrying out color extraction and ArUco code identification on a screen area where the screen is located in the second image sequence; and generating a first color card and a second color card according to the plurality of measured color values and the corresponding plurality of original color values extracted from the second image sequence.

In one possible implementation, the interactive interface is further configured to at least one of: the number of types of color sequences in the second color sequence, the display size and the display position of the ArUco code when displayed in a screen; wherein, the controlling the screen to simultaneously display each color in the second color sequence and the ArUco code corresponding to each color in the second color sequence includes: and controlling the screen to display various colors in a second color sequence corresponding to the configured category number, and simultaneously displaying ArUco codes corresponding to the various colors in the second color sequence in the screen according to the display size and the display position configured in the interactive interface.

In one possible implementation, before displaying the first color card and the second color card, the method further includes: displaying first prompt information, wherein the first prompt information is used for indicating at least one of the generation progress and the residual generation duration of the first color card and the second color card; and/or controlling the screen to display second prompt information, wherein the second prompt information is used for reminding a user that the screen cannot be blocked.

In one possible implementation, the method further includes: and generating a color mapping relation according to the measured color values of the multiple colors in the first color card and the original color values of the multiple colors in the second color card, wherein the color mapping relation is used for calibrating the colors of the picture to be displayed on the screen.

In one possible implementation, the first color sequence is at least one of: a red R channel color sequence, a green G channel color sequence, and a blue B channel color sequence, wherein the R channel color sequence includes a plurality of colors in which the R channel is a maximum color value and the G and B channels are different color values; the G channel color sequence comprises a plurality of colors with the G channel being the maximum color value and the R channel and the B channel being different color values; the B channel color sequence comprises a plurality of colors with the B channel being the maximum color value and the R channel and the G channel being different color values; when the screen displays the first color sequence, two-dimensional identification code ArUco codes are also displayed, different colors in the first color sequence correspond to different ArUco codes, and different ArUco codes corresponding to different colors in the first color sequence are used for indicating original color values and original brightness values of different colors in the first color sequence.

In one possible implementation, before displaying the calibrated luminance value of the screen, the method further comprises: controlling the screen to simultaneously display various colors in the first color sequence and ArUco codes corresponding to the various colors in the first color sequence, and simultaneously controlling the camera to acquire images of the screen to obtain a first image sequence; performing color extraction and ArUco code identification on a screen area where the screen is located in the first image sequence to obtain a plurality of measured color values and corresponding original color values in the first image sequence; converting the first image sequence into a gray scale map and determining a plurality of measured brightness values and corresponding original brightness values in the second image sequence based on the converted gray scale map.

In a possible implementation manner, the interactive interface is further used for configuring a sampling frame number for the camera to perform image acquisition on a single color; the controlling the camera to acquire the images of the screen to obtain a first image sequence comprises the following steps: and controlling the camera to acquire images of the screen according to the configured sampling frame number, so as to obtain a first image sequence.

According to another aspect of the present disclosure, there is provided a color calibration apparatus for a virtual photographing system including a camera and at least one screen, the apparatus being applied to a terminal device, including: a screen calibration module, configured to respond to triggering a screen calibration function on any screen in the virtual shooting system in an interactive interface of the terminal device, and display a screen measurement result corresponding to the screen, where the screen measurement result includes a measurement color value and a measurement brightness value extracted from a first image sequence acquired when the camera displays a first color sequence on the screen, and an original color value and an original brightness value included in the first color sequence, and the screen measurement result is used to instruct a user to calibrate screen brightness of the screen; the color calibration module is used for responding to triggering a color calibration function in an interactive interface of the terminal equipment, displaying a first color card and a second color card, wherein the first color card represents measurement color values of multiple colors extracted from a second image sequence acquired when the camera displays a second color sequence on the screen, the second color card represents original color values of multiple colors in the second color sequence, and the first color card and the second color card are used for guiding a user to calibrate the colors of pictures to be displayed on the screen.

According to another aspect of the present disclosure, there is provided a terminal device including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the above-described method when executing the instructions stored by the memory.

According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon computer program instructions, wherein the computer program instructions, when executed by a processor, implement the above-described method.

According to another aspect of the present disclosure, there is provided a computer program product comprising a computer readable code, or a non-transitory computer readable storage medium carrying computer readable code, which when run in a processor of an electronic device, performs the above method.

According to the embodiment of the disclosure, the screen measurement result is visually displayed by triggering the screen calibration function to guide a user to calibrate the screen brightness, so that the influence of uneven screen brightness of the screen equipment on color calibration can be reduced, and the screen can have a better color display effect; the color calibration function is triggered to visually display two color cards so as to guide a user to perform color calibration on the colors of the pictures to be displayed, and thus the user can be efficiently helped to realize the color calibration on the pictures to be displayed through a friendly and convenient human-computer interaction process, the accuracy and usability of the color calibration are improved, the dependence on subjective experience of professionals is reduced, the user can be guided to accurately and efficiently complete the color calibration through a visual and procedural interaction interface, and the shooting efficiency of virtual shooting is improved.

Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments, which proceeds with reference to the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments, features and aspects of the present disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 shows a schematic diagram of a virtual photographing system according to an embodiment of the present disclosure.

Fig. 2 illustrates a flowchart of a color calibration method for a virtual camera system according to an embodiment of the present disclosure.

Fig. 3 shows a schematic diagram of an interactive interface for triggering a screen calibration function according to an embodiment of the present disclosure.

Fig. 4 shows a schematic diagram of an interactive interface prior to presentation of screen measurements, according to an embodiment of the present disclosure.

Fig. 5 shows a schematic diagram of an interactive interface showing screen measurements according to an embodiment of the present disclosure.

Fig. 6 shows a schematic diagram of an interactive interface for triggering a color calibration function according to an embodiment of the present disclosure.

Fig. 7 shows a schematic diagram of an interactive interface prior to the presentation of two color cards, according to an embodiment of the present disclosure.

Fig. 8 shows a schematic diagram of an interactive interface displaying two color cards according to an embodiment of the present disclosure.

Fig. 9 shows a block diagram of a color calibration apparatus for a virtual photographing system according to an embodiment of the present disclosure.

Fig. 10 shows a block diagram of a terminal device 800 according to an embodiment of the present disclosure.

Detailed Description

Various exemplary embodiments, features and aspects of the disclosure will be described in detail below with reference to the drawings. In the drawings, like reference numbers indicate identical or functionally similar elements. Although various aspects of the embodiments are illustrated in the accompanying drawings, the drawings are not necessarily drawn to scale unless specifically indicated.

The word "exemplary" is used herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

In addition, numerous specific details are set forth in the following detailed description in order to provide a better understanding of the present disclosure. It will be understood by those skilled in the art that the present disclosure may be practiced without some of these specific details. In some instances, methods, means, elements, and circuits well known to those skilled in the art have not been described in detail in order not to obscure the present disclosure.

Fig. 1 shows a schematic diagram of a virtual photographing system according to an embodiment of the present disclosure, which includes a camera 01 for photographing and three screens (021, 022, 023) for displaying pictures, as shown in fig. 1. The terminal device 03 for performing the color calibration method according to the embodiment of the present disclosure may establish communication connection with the camera 01 and the three screens (021, 022, 023), respectively, and the embodiment of the present disclosure does not limit the communication connection manner between the devices.

Wherein, camera 01 is used for carrying on the video camera of the image acquisition to the screen, the embodiment of the disclosure does not limit the type of the video camera; the screen used in the virtual shooting system may be of a type such as an LED display screen, a liquid crystal display screen, or a structure such as a curved screen or a planar screen, and it should be understood that, according to actual needs, a person skilled in the art may set the type, the number, the size, the resolution, etc. of the screen in the virtual shooting system in a user-defined manner, which is not limited to the embodiments of the present disclosure.

The color calibration method of the embodiment of the disclosure may be deployed on various terminal devices through software or hardware modification, the terminal device related to the embodiment of the disclosure may refer to a device having a wireless connection function and/or a wired connection function, the wireless connection function may refer to that the terminal device related to the embodiment of the disclosure may be connected with other devices (such as the above-mentioned camera, each screen, etc.) through a wireless connection manner such as wifi, bluetooth, etc., and may also communicate with other devices through a wired connection function. The terminal device related to the embodiment of the disclosure may be a touch screen, or may be a non-screen, where the touch screen may control the terminal device by clicking, sliding, etc. on a display screen with a finger, a stylus, etc., and the non-touch screen device may be connected to an input device such as a mouse, a keyboard, a touch panel, etc., and the non-touch screen device may control the terminal device through the input device, and the non-screen device may be a bluetooth speaker without a screen, for example. For example, terminal devices of embodiments of the present disclosure may include, but are not limited to, user Equipment (UE), mobile devices, user terminals, handheld devices, tablet computers, notebook computers, palm computers, computing devices, and the like.

Fig. 2 illustrates a flowchart of a color calibration method for a virtual camera system according to an embodiment of the present disclosure. As shown in fig. 2, the method includes: step S21 to step S22.

In step S21, in response to triggering a screen calibration function for any screen in the virtual shooting system in the interactive interface of the terminal device, a screen measurement result corresponding to the screen is displayed, wherein the screen measurement result includes a measurement color value and a measurement brightness value extracted from a first image sequence acquired when the camera displays a first color sequence for the screen, and an original color value and an original brightness value included in the first color sequence, and the screen measurement result is used for guiding a user to calibrate the screen brightness of the screen.

As described above, the color calibration method of the embodiment of the present disclosure may be deployed in a terminal device through software, for example, may be deployed in a terminal device in the form of an application program APP, and when a user desires to perform color calibration, the application program APP may be opened and a color calibration function may be selected, and the color calibration method enters the above-mentioned interactive interface, where a button control for triggering the screen calibration function may be displayed in the interactive interface, and the user may click the button control in the interactive interface to trigger the screen calibration function for any screen in the virtual shooting system. The screen calibration function mainly guides a user to calibrate the screen brightness of the screen by measuring the actual color display effect of the screen, so that the interference of the screen brightness on color calibration is reduced.

As described above, the screen in the virtual photographing system may be an LED screen, and since the display of the LED screen may be performed according to a plurality of LED lamps displaying three primary colors of red, green, and blue, the brightness of the LED lamps of the three primary colors of red, green, and blue may be corrected, respectively, when the brightness of the LED screen is corrected. Thus, the first color sequence may comprise at least one of: a red R channel color sequence, a green G channel color sequence, and a blue B channel color sequence, wherein the R channel color sequence includes a plurality of colors in which the R channel is a maximum color value and the G and B channels are different color values; the G channel color sequence comprises a plurality of colors with the G channel being the maximum color value and the R channel and the B channel being different color values; the B-channel color sequence includes multiple colors where the B-channel is the maximum color value and the R-channel and G-channel are different color values.

It should be appreciated that a multi-channel color is typically composed of the color values of three channels of RGB, with the R channel being the largest color value, i.e., 255, the color values of the G and B channels increasing from 0 to 255 at intervals, then the red color in the R channel color sequence may contain a variety of different red colors from dark to light, the larger the color values of the G and B channels, the lighter the red color; and, for convenience of subsequent presentation of the measured color values and the original color values, the color values of the B channel and the G channel in the R channel color sequence may be the same. Likewise, the colors in the G channel color sequence may be that the G channel is 255, the color values of the R channel and the B channel are increased from 0 to 255 at intervals, the larger the color values of the R channel and the B channel are, the lighter the green is, and the color values of the R channel and the B channel in the G channel color sequence may be the same; the colors in the B-channel color sequence may be that the B-channel is the maximum color value 255, the color values of the R-channel and the G-channel are increased from 0 to 255 at intervals, the larger the color values of the R-channel and the G-channel are, the lighter the blue is, and the color values of the R-channel and the G-channel in the B-channel color sequence may be the same.

In practical application, in order to correlate the measured color value and the measured brightness value proposed from the first image sequence with the original color value and the original brightness value in the first color sequence, so as to better display the measurement result of the screen, in one possible implementation manner, when the first color sequence is displayed, the screen further displays a two-dimensional identifier ArUco code, different colors in the first color sequence correspond to different ArUco codes, and different ArUco codes corresponding to different colors in the first color sequence are used for indicating the original color value and the original brightness value of different colors in the first color sequence. In this way, the camera also contains ArUco codes in different screen images in the first image sequence obtained by shooting the screen, so that the original color value corresponding to the extracted measured color value in different screen images and the original brightness value corresponding to the extracted measured brightness value can be obtained by identifying the ArUco codes in different screen images.

It is known that the ArUco code is a square mark composed of binary codes, which are formed by a wide black frame and an internal binary code, and code values of the ArUco code can be obtained by identifying the binary codes, and it should be understood that the ArUco code can be generated by those skilled in the art using the ArUco code generation technique known in the art, and the embodiment of the present disclosure is not limited thereto.

In one possible implementation, before the calibrating the luminance value of the display screen, the method further comprises:

the method comprises the steps that a screen is controlled to simultaneously display various colors in a first color sequence and ArUco codes corresponding to the various colors in the first color sequence, and a camera is controlled to acquire images of the screen to obtain a first image sequence;

performing color extraction and ArUco code identification on a screen area where a screen is located in a first image sequence to obtain a plurality of measured color values and corresponding original color values in the first image sequence;

the first image sequence is converted into a gray scale map and a plurality of measured brightness values and corresponding raw brightness values in the second image sequence are determined based on the converted gray scale map.

As described above, the first image sequence may include a red R channel color sequence, a green G channel color sequence, and a blue B channel color sequence, and the screen may be controlled to sequentially display the red R channel color sequence, the green G channel color sequence, and the blue B channel color sequence, so that a first image sequence obtained by capturing an image of the screen by the camera may include: the first image sequence corresponding to the R channel color sequence, the first image sequence corresponding to the G channel color sequence and the first image sequence corresponding to the B channel color sequence.

Alternatively, as shown in fig. 3, the screen currently undergoing screen calibration may be selected by selecting a screen name (e.g., "right one") at a "sampling screen" in the interactive interface, so that the screen with the screen name right one may be controlled to display the first image sequence; the interactive interface may also be used to configure at least one of: the sampling frame number of the camera, the display size and the display position of the ArUco code when displayed in a screen; the sampling frame number is used for controlling the camera to collect the number of images of a single color, that is, the sampling frame number can instruct the camera to collect several screen images of each color, for example, a '3' set at the sampling frame number of the single image in fig. 3 represents that 3 frames of screen images of each color are collected, and the stay time of each color in a screen can be controlled to be longer than the time consumed by the camera to collect the screen images of each color, so that the camera can effectively collect at least one screen image of each color; wherein, the display size is used to control the size of the ArUco code displayed in the screen, and since the ArUco code is generally square, adjusting the display size of the ArUco code, that is, adjusting the side size, for example, "6" set at the size of the ArUco code in FIG. 3 can be understood as that the display size of the ArUco code in the screen is 6, or the side length is 6; the display position is used to control the position of the ArUco code displayed in the screen, and the display position may specifically include an abscissa and an ordinate, for example, the abscissa X set at the position of the ArUco code in fig. 3 is 0.5, and the ordinate Y is 0.5, where a coordinate system may be established with any screen vertex of each screen as an origin, that is, the display position of the ArUco code, that is, the coordinates in the coordinate system.

Based on the content configured in the interactive interface, the controlling the screen to simultaneously display each color in the first color sequence and the ArUco code corresponding to each color in the first color sequence, and simultaneously controlling the camera to acquire images of the screen to obtain a first image sequence may include: controlling the screen to display various colors in the first color sequence and simultaneously displaying ArUco codes corresponding to the various colors in the screen according to the display size and the display position configured in the interactive interface; and simultaneously controlling the camera to acquire images of the screen according to the configured sampling frame number to obtain a first screen image sequence. Wherein, according to the display size and the display position configured in the interactive interface, the ArUco code corresponding to each color in the first color sequence is displayed in the screen, which can be understood as displaying the ArUco code with the configured display size at the position indicated by the display position configured in the screen; the camera is controlled to acquire images of the screen according to the configured sampling frame numbers to obtain a first image sequence, and the first image sequence can be obtained by acquiring the screen images of the configured sampling frame numbers when the screen displays each color. Optionally, the camera may further perform video acquisition when displaying each color on the screen, and extract an image frame of a sampling frame number corresponding to each color from the acquired video data, so as to obtain at least one screen image corresponding to each color, that is, obtain the first image sequence. The embodiment of the disclosure does not limit the acquisition mode of the first image sequence.

After the first image sequence is obtained, the measured color value and the corresponding original color value of the screen area in each screen image can be obtained by carrying out color extraction and ArUco code identification on each screen image in the first image sequence. It should be understood that those skilled in the art may implement the extraction of the measured color values and the identification of the code values of the ArUco code using color extraction algorithms and ArUco code identification algorithms known in the art, and the embodiments of the present disclosure are not limited in this respect. For example, the average value of the color values of the pixels in the screen area may be taken as the measured color value, and if the original color values indicated by the ArUco codes in the plurality of screen images are the same, the average value of the measured color values proposed from the screen areas in the plurality of screen images with the same original color values may be taken as the measured color value corresponding to the original color value. In practical application, before performing color extraction and ArUco code identification on each screen image in the first image sequence, detection of a screen area in each screen image may be performed first, and then color extraction and ArUco code identification may be performed based on the detected screen area.

The measured brightness value can be determined by converting each screen image in the first image sequence into a gray image according to the gray value of a pixel point in a screen area in each gray image, for example, the average value of the gray values of each pixel in the screen area in the gray image corresponding to one screen image can be used as the measured brightness value extracted from the one screen image, and the original brightness value indicated by the ArUco code is identified from the one screen image; if the original brightness values indicated by the ArUco codes in the plurality of screen images are the same, the average value of the measured brightness values provided from the screen areas in the plurality of gray images corresponding to the plurality of screen images with the same original brightness values can be used as the measured brightness value corresponding to the original brightness values.

Optionally, the interactive interface shown in fig. 3 further includes a display area of "acquisition result", where the display area of the acquisition result may be used to display a screen measurement result of the screen, and "no acquisition result is temporarily displayed" when there is no screen measurement result; and the interactive interface can also comprise a display area of the live-action picture, and the live-action picture in the current field of view of the camera can be displayed, so that a user can check whether the shooting field of view of the camera meets the requirement of acquiring an image sequence, and when the user clicks the equipment pre-calibration, namely, the screen calibration function is triggered, the camera can be controlled to formally start acquiring the first image sequence. The display area of the live-action picture can also be provided with a function control for creating or deleting the acquisition point, wherein the creation of the acquisition point (for example, a green point in the live-action picture displayed in fig. 3 can represent the created acquisition point) can be realized by clicking any position in the live-action picture displayed in the display area, and then the deletion of the acquisition point can be realized by clicking the created acquisition point, wherein the position of the created acquisition point in the live-action picture can be used for indicating the position of the focus of the camera in the shooting view, namely, the position of the focus of the camera in the shooting view can be controlled according to the position of the acquisition point created in the live-action picture; of course, the acquisition point is not required to be set, so that the camera can automatically focus.

It should be understood that the interactive interface shown in fig. 3 is one possible implementation manner provided by the embodiments of the present disclosure, and those skilled in the art may design the layout of the pages, the functionality controls included in the interactive interface according to actual requirements, which are not limited to the embodiments of the present disclosure.

In practical application, any screen to be calibrated can be controlled to display various colors in the first color sequence under preset brightness, and a camera is controlled to collect a plurality of screen images of the screen, which are displayed in various colors, under the preset brightness, so as to obtain a first image sequence and transmit the first image sequence to a terminal device. The preset brightness may be, for example, the maximum brightness that the screen may display, where the preset brightness is the brightness that the screen should display, but since the maximum brightness that the screen can display in different display areas of the screen may be different from the set brightness in actual situations, this may be, for example, due to different attenuation degrees of different LED lamps in the LED screen, or different interference degrees of ambient light on the brightness of the LED lamps, so that the finally displayed brightness is not consistent with the set brightness. According to the embodiment of the disclosure, the screen brightness of the screen is calibrated in advance, so that the interference of the screen brightness on the color calibration can be reduced, the color display effect of the screen on various colors is better, and the accuracy of the color calibration is improved.

Optionally, in consideration of that it usually takes a certain period of time to determine the screen measurement result, in the process from when the user triggers the screen calibration function to when the screen measurement result is displayed, for example, prompt information of "not to block the screen" may be controlled to be displayed in the screen so as to remind the user not to block the screen; and the method can also control the inoperable of each functional control in the interactive interface and display the generation progress and/or the residual duration of the screen measurement result in the interactive interface. For example, fig. 4 shows a schematic diagram of an interactive interface from when the user triggers the screen calibration function to when the screen measurement result is displayed, as shown in fig. 4, prompt information such as "50%" of the generation progress of the screen measurement result and "in pre-calibration" is displayed, and information such as "in scanning", "please keep equipment steady" may also be displayed at the acquisition result.

Optionally, after obtaining the plurality of measured brightness values and the corresponding original brightness values, and the plurality of measured color values and the corresponding original color values from the first image sequence, the screen measurement result may be displayed in a symbol, a graph, a line, or the like manner, and the display manner of the screen measurement result is not limited in the embodiments of the present disclosure.

For example, fig. 5 shows a schematic diagram in an interactive interface, as shown in fig. 5, a screen measurement result may be fitted to a curve, and the screen measurement result is displayed in a graph manner in a display area of "acquisition result", where a black line (third bar from top) is a curve fitted according to a plurality of measured brightness values and corresponding original brightness values, an abscissa corresponding to the black line may represent the measured brightness values, an ordinate represents the possible original brightness values, and a red line (second bar from top) is a curve fitted according to a plurality of measured color values extracted from a first image sequence corresponding to a color sequence of R channels and corresponding original color values, an abscissa of the red line represents the original color values of B channels and G channels, and an ordinate represents the measured color values of the B channels and the G channels; the green curve (first bar of the lower number) is a curve fitted according to a plurality of measured color values extracted from a first image sequence corresponding to the color sequence of the G channel and corresponding original color values, the abscissa of the green line represents the original color values of the R channel and the B channel, and the ordinate represents the measured color values of the R channel and the B channel; the blue curve (first bar above) is a curve fitted according to a plurality of measured color values extracted from a first image sequence corresponding to the B-channel color sequence and corresponding original color values, and the abscissa of the blue line represents the original color values of the R-channel and the G-channel and the ordinate represents the measured color values of the R-channel and the G-channel.

It can be appreciated that, theoretically, if the screen has no brightness display error, the measured brightness value should be the same as the original brightness value, that is, the black line in the graph of fig. 5 should be a straight line; if the actual black line deviates upwards, the actual measured brightness value is higher, or more bright areas in the screen image are represented, so that the screen brightness of the whole screen can be reduced, otherwise, if the actual black line deviates downwards, the actual measured brightness value is lower, so that the screen brightness of the whole screen can be improved, wherein the screen brightness can be understood as the intensity of light emitted by the screen, and the screen display picture can be clearer and more vivid by properly adjusting the screen brightness.

As described above, since the display of the LED screen may be performed according to a plurality of LED lamps having three primary colors of red, green and blue, calibrating the screen brightness of the LED screen may also include calibrating the brightness of the LED lamps displaying the three primary colors of red, green and blue, respectively, it is understood that, theoretically, if the screen has no brightness display error, the measured color value should be the same as the original color value, if the actual red line is shifted upward, the measured color values representing the G channel and the B channel extracted from the first image sequence are higher, or the red displayed on the screen is shallower, thereby improving the brightness of the LED lamps displaying red, whereas if the actual red line is shifted downward, the measured color values representing the actual G channel and the B channel are lower, or the red displayed on the screen is deeper, thereby reducing the brightness of the LED lamps displaying red; and by analogy, the brightness of the LED lamps for displaying green and blue can be calibrated according to the green lines and the blue lines respectively, so that the overall display color of the LED screen is more consistent and uniform, and the LED screen has better color display effect.

Optionally, the recommended adjustment amount of the screen brightness can be calculated and displayed according to the brightness deviation between the measured brightness value and the original brightness value and the color value deviation between the measured color value and the original color value, so that the user can be guided to calibrate the screen brightness based on the recommended adjustment amount; for example, a mapping relationship between the brightness deviation and the color value deviation and the adjustment amount of the screen brightness, respectively, may be preset, and further, the recommended adjustment amounts under different brightness deviations and different color value deviations may be calculated based on the mapping relationship. This can more intelligently guide the user to more accurately adjust the screen brightness.

Alternatively, the screen measurement results of a plurality of screens may be simultaneously displayed, for example, the screen measurement result fitting curves of the respective screens are respectively displayed in fig. 5.

Optionally, as shown in fig. 5, immediately after calculating and displaying the screen measurement result, a prompt message of "pre-calibration complete" may also be displayed, that is, prompt the user that the screen measurement result has been calculated and displayed; the interactive interface can also provide a button control for re-calibration, after the user finishes the calibration of the screen brightness once, the screen calibration function can be re-triggered by clicking the button control for re-calibration, namely, the screen measurement result is re-calculated and displayed until the calibration requirement of the user on the screen brightness is met, and then the user can enter the subsequent color calibration flow by clicking the button control indicated by the formal color calibration.

Step S22, a first color card and a second color card are displayed in response to triggering of a color calibration function in an interactive interface of the terminal equipment, wherein the first color card comprises multiple colors extracted from a second image sequence acquired when a second color sequence is displayed on a screen by a camera, the second color card comprises multiple colors in the second color sequence, and the first color card and the second color card are used for guiding a user to calibrate the colors of pictures to be displayed on the screen.

It should be understood that the interactive interface that triggers the screen calibration function and the interactive interface that triggers the color calibration function may be the same interface or different interfaces, which is not a limitation of the embodiments of the present disclosure.

The number of types of color sequences included in the second color sequence (i.e., the number of color levels in the second color sequence) may be greater than the number of types of color sequences included in the first color sequence (i.e., the number of color levels in the first color sequence). For example, the first color sequence may include three color sequences of three color levels of red, green and blue, and the second color sequence may include seven color sequences of seven color levels of red, orange, yellow, green, blue and violet, respectively, and each color sequence may include a plurality of colors from light color to dark color. The embodiment of the present disclosure does not limit the number of kinds of color sequences in the second color sequence. To meet the calibration requirement of the user on the color calibration function, the interactive interface for triggering the color calibration function may also be used to configure the number of types of color sequences in the second color sequence, for example, fig. 6 illustrates an interactive interface, where 12 set at "RGB tone scale" in the interactive interface may represent the number of types of color sequences included in the second color sequence, that is, 12 types of color sequences included in the second color sequence, as illustrated in fig. 6; the user may implement the trigger color calibration function, for example, by clicking a "color card calibration" button control in the interactive interface.

In order to correlate the measured color values and the original color values proposed from the second image sequence, so as to more easily show the first color card and the second color card, in one possible implementation manner, the screen further displays two-dimensional identification codes ArUco when displaying the second color sequence, different colors in the second color sequence correspond to different ArUco codes, and different ArUco codes corresponding to different colors in the second color sequence are used for indicating the original color values of different colors in the second color sequence.

In one possible implementation, before displaying the first color card and the second color card, the method further includes:

controlling a screen to simultaneously display various colors in a second color sequence and ArUco codes corresponding to the various colors in the second color sequence, and simultaneously controlling a camera to acquire images of the screen to obtain a second image sequence;

color extraction and ArUco code identification are carried out on a screen area where a screen is located in the second image sequence, so that a plurality of measured color values and a plurality of corresponding original color values extracted from the second image sequence are obtained;

and generating a first color card and a second color card according to the plurality of measured color values and the corresponding plurality of original color values extracted from the second image sequence.

Alternatively, as shown in fig. 6, the display size and the display position of the ArUco code when displayed in the screen may also be configured in the interactive interface for triggering the color calibration function, and it should be understood that the display size and the display position configured in the interactive interface may control the ArUco code corresponding to each color in the second color sequence. Based on this, in one possible implementation manner, the control screen simultaneously displays each color in the second color sequence and the ArUco code corresponding to each color in the second color sequence, including: and controlling the screen to display various colors in the second color sequence corresponding to the configured category number, and simultaneously displaying ArUco codes corresponding to the various colors in the second color sequence in the screen according to the display size and the display position configured in the interactive interface.

In practical application, before performing color extraction and ArUco code identification on each screen image in the second image sequence, detection of a screen region in each screen image may be performed first, and then color extraction and ArUco code identification may be performed based on the detected screen region. As described above, the color extraction algorithm and the ArUco code recognition algorithm known in the art may be used by those skilled in the art to extract the measured color values and recognize the code values of the ArUco code, which is not a limitation of the embodiments of the present disclosure. For example, the average value of the color values of the pixels in the screen area may be taken as the measured color value, and if the original color values indicated by the ArUco codes in the plurality of screen images are the same, the average value of the measured color values proposed from the screen areas in the plurality of screen images with the same original color values may be taken as the measured color value corresponding to the original color value.

In consideration of the fact that the time required for generating the first color chart and the second color chart in the color calibration function may be long, the user can be reminded of the generation progress of the color chart and other staff can be reminded through the screen not to block the screen. In one possible implementation, before displaying the first color card and the second color card, the method further includes:

displaying first prompt information, wherein the first prompt information is used for indicating at least one of the generation progress and the residual generation duration of the first color card and the second color card; and/or the number of the groups of groups,

the control screen displays second prompt information, and the second prompt information is used for reminding a user that the screen cannot be blocked.

By way of example, fig. 7 shows an interactive interface, as shown in fig. 7, "50%" shown in the interactive interface may represent the progress of generation, and "estimated still 3min needed" may represent the remaining duration of generation; and a second prompt message of 'scanning request does not shelter from the screen' is also displayed in the screen in the live-action picture displayed in the interactive interface. It should be understood that the representation of the first prompt message and the second prompt message presented in fig. 7 is some possible implementations provided by the embodiments of the present disclosure, and those skilled in the art may design the representation of the first prompt message and the second prompt message according to actual needs, which is not limited to the embodiments of the present disclosure.

After the plurality of measured color values and the corresponding plurality of original color values are extracted from the second image sequence, a first color card and a second color card can be generated based on the plurality of measured color values and the corresponding plurality of original color values, wherein the first color card can contain a plurality of color blocks corresponding to the plurality of measured color values, and the second color card can contain a plurality of color blocks corresponding to the plurality of original color values. For example, fig. 8 shows an interactive interface, as shown in fig. 8, two color cards may be displayed in the "acquisition result" area, where the two color cards may be a first color card and a second color card, respectively, each color card includes multiple color patches, where the measured color value of the same color may be the same as the color patch positions of the original color value in the first color card and the second color card, so that the user may compare the measured color value with the original color value to calibrate the color of the picture to be displayed on the screen. The screen to be displayed on the screen may be a virtual screen or a real screen, which is not limited to the embodiment of the present disclosure.

The color calibration function can obtain the comparison effect between the measured color value of the color in the screen image and the original color value in the second color sequence, so that the user can judge the deviation value of each color gradation according to the measured color value and the original color value, calibrate the color of the picture to be displayed according to the deviation value, for example, if the red color in the first color card is darker than the red color in the second color card, at least one of the hue, the brightness and the saturation of the red color in the picture to be displayed can be adjusted to lighten the red color in the picture.

Optionally, in order to calibrate the color of the picture to be displayed more accurately, the method may further include: and generating a color mapping relation according to the measured color values of the multiple colors in the first color card and the original color values of the multiple colors in the second color card, wherein the color mapping relation is used for calibrating the colors of the picture to be displayed on the screen. The color mapping relationship may be understood as a mapping relationship between a plurality of measured color values and a plurality of corresponding original color values, and further, color calibration may be automatically performed on colors in a picture to be displayed by using the color mapping relationship. The color mapping relationship can be calculated by a person skilled in the art by using a color calibration algorithm known in the art, and the color of the picture is calibrated by using the color mapping relationship, which is not limited to the embodiments of the present disclosure.

Optionally, as shown in fig. 8, after the first color card and the second color card are generated, a prompt message of "calibration success" may be displayed, and a button control of "re-color card calibration" may be displayed in the interactive interface, so that when calibration fails (for example, a measured color value and an original color value that are not proposed from the second image sequence due to the screen being blocked), the color calibration function may be re-executed by clicking the button control of "re-color card calibration".

According to the embodiment of the disclosure, the screen measurement result is visually displayed by triggering the screen calibration function to guide a user to calibrate the screen brightness, so that the influence of uneven screen brightness of the screen equipment on color calibration can be reduced, and the screen can have a better color display effect; the color calibration function is triggered to visually display two color cards so as to guide a user to perform color calibration on the colors of the pictures to be displayed, and thus the user can be efficiently assisted in realizing the color calibration on the pictures through friendly and convenient man-machine interaction flow, the accuracy and usability of the color calibration are improved, the dependence on subjective experience of professionals is reduced, the user can be guided to accurately and efficiently complete the color calibration through a visual and flow-shaped interaction interface, and the shooting efficiency of virtual shooting is improved.

According to the embodiment of the disclosure, for the virtual shooting project requiring accuracy and efficiency, accuracy, smoothness and efficiency of color calibration can be improved by combining usage habit of field personnel on terminal equipment, visual display of accurate color card comparison and smooth and efficient guiding flow. Through the whole color calibration process from the first calibration screen to the color projection to the color card comparison, operators can be guided according to steps to realize color calibration, the pain points of more screen devices and difficult debugging in a color calibration scene can be solved, and the dependence on the service experience of professionals can be reduced by visually showing accurate screen measurement results and color card comparison to users, so that the efficiency and the accuracy of the color calibration process are improved.

Fig. 9 shows a block diagram of a color calibration apparatus for a virtual photographing system according to an embodiment of the present disclosure, which is applicable to the above-described terminal device, as shown in fig. 9, including:

a screen calibration module 901, configured to respond to triggering a screen calibration function on any screen in the virtual shooting system in an interactive interface of the terminal device, and display a screen measurement result corresponding to the screen, where the screen measurement result includes a measurement color value and a measurement brightness value extracted from a first image sequence acquired when the camera displays a first color sequence on the screen, and an original color value and an original brightness value included in the first color sequence, and the screen measurement result is used to instruct a user to calibrate screen brightness of the screen;

the color calibration module 902 is configured to respond to triggering a color calibration function in an interactive interface of the terminal device, and display a first color card and a second color card, where the first color card characterizes measurement color values of multiple colors extracted from a second image sequence acquired when the camera displays a second color sequence on the screen, the second color card characterizes original color values of multiple colors in the second color sequence, and the first color card and the second color card are used for guiding a user to calibrate colors of a picture to be displayed on the screen.

In one possible implementation, before displaying the first color card and the second color card, the apparatus further includes: the first control module is used for controlling the screen to simultaneously display various colors in the second color sequence and ArUco codes corresponding to the various colors in the second color sequence, and simultaneously controlling the camera to acquire images of the screen to obtain a second image sequence; the color value extraction module is used for extracting colors of a screen area where the screen is located in the second image sequence and identifying ArUco codes to obtain a plurality of measured color values and a plurality of corresponding original color values extracted from the second image sequence; and the color card generation module is used for generating a first color card and a second color card according to the plurality of measured color values and the corresponding plurality of original color values extracted from the second image sequence.

In one possible implementation, before displaying the first color card and the second color card, the apparatus further includes: the prompt module is used for displaying first prompt information, and the first prompt information is used for indicating at least one of the generation progress and the residual generation duration of the first color card and the second color card; and/or controlling the screen to display second prompt information, wherein the second prompt information is used for reminding a user that the screen cannot be blocked.

In one possible implementation, the apparatus further includes: the mapping relation determining module is used for generating a color mapping relation according to the measured color values of the plurality of colors in the first color card and the original color values of the plurality of colors in the second color card, and the color mapping relation is used for calibrating the colors of the pictures to be displayed on the screen.

In one possible implementation, before displaying the calibrated luminance value of the screen, the apparatus further comprises: the second control module is used for controlling the screen to simultaneously display various colors in the first color sequence and ArUco codes corresponding to the various colors in the first color sequence, and simultaneously controlling the camera to acquire images of the screen to obtain a first image sequence; the color value determining module is used for extracting colors of a screen area where the screen is located in the first image sequence and identifying ArUco codes to obtain a plurality of measured color values and corresponding original color values in the first image sequence; and the brightness determining module is used for converting the first image sequence into a gray level diagram and determining a plurality of measured brightness values and corresponding original brightness values in the second image sequence based on the converted gray level diagram.

In some embodiments, functions or modules included in an apparatus provided by the embodiments of the present disclosure may be used to perform a method described in the foregoing method embodiments, and specific implementations thereof may refer to descriptions of the foregoing method embodiments, which are not repeated herein for brevity.

The disclosed embodiments also provide a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the above-described method. The computer readable storage medium may be a volatile or nonvolatile computer readable storage medium.

The embodiment of the disclosure also provides an electronic device, which comprises: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the above-described method when executing the instructions stored by the memory.

Embodiments of the present disclosure also provide a computer program product comprising computer readable code, or a non-transitory computer readable storage medium carrying computer readable code, which when run in a processor of an electronic device, performs the above method.

Fig. 10 shows a block diagram of a terminal device 800 according to an embodiment of the present disclosure. Referring to fig. 10, a terminal device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output interface 812 (I/O interface), a sensor component 814, and a communication component 816.

The processing component 802 generally controls overall operation of the terminal device 800, such as operations associated with display, data communication, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interactions between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operations at the terminal device 800. Examples of such data include instructions for any application or method operating on terminal device 800, contact data, phonebook data, messages, pictures, video, and the like. The memory 804 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

The power supply component 806 provides power to the various components of the terminal device 800. The power components 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the terminal device 800.

The multimedia component 808 comprises a terminal screen between the terminal device 800 and the user providing an output interface. In some embodiments, the terminal screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the terminal screen includes a touch panel, the terminal screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. The front camera and/or the rear camera may receive external multimedia data when the terminal device 800 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the terminal device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 further includes a speaker for outputting audio signals.

Input/output interface 812 provides an interface between processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.

The sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of the terminal device 800. For example, the sensor assembly 814 may detect an on/off state of the terminal device 800, a relative positioning of the components, such as a display and keypad of the terminal device 800, the sensor assembly 814 may also detect a change in position of the terminal device 800 or a component of the terminal device 800, the presence or absence of a user's contact with the terminal device 800, an orientation or acceleration/deceleration of the terminal device 800, and a change in temperature of the terminal device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate communication between the terminal device 800 and other devices, either wired or wireless. The terminal device 800 may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the terminal device 800 can be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.

In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 804 including computer program instructions executable by processor 820 of terminal device 800 to perform the above-described method.

The present disclosure may be a system, method, and/or computer program product. The computer program product may include a computer readable storage medium having computer readable program instructions embodied thereon for causing a processor to implement aspects of the present disclosure.

The computer readable storage medium may be a tangible device that can hold and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: portable computer disks, hard disks, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static Random Access Memory (SRAM), portable compact disk read-only memory (CD-ROM), digital Versatile Disks (DVD), memory sticks, floppy disks, mechanical coding devices, punch cards or in-groove structures such as punch cards or grooves having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media, as used herein, are not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., optical pulses through fiber optic cables), or electrical signals transmitted through wires.

The computer readable program instructions described herein may be downloaded from a computer readable storage medium to a respective computing/processing device or to an external computer or external storage device over a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmissions, wireless transmissions, routers, firewalls, switches, gateway computers and/or edge servers. The network interface card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium in the respective computing/processing device.

Computer program instructions for performing the operations of the present disclosure can be assembly instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, c++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions may be executed entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present disclosure are implemented by personalizing electronic circuitry, such as programmable logic circuitry, field Programmable Gate Arrays (FPGAs), or Programmable Logic Arrays (PLAs), with state information of computer readable program instructions, which can execute the computer readable program instructions.

Various aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.

These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable medium having the instructions stored therein includes an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The foregoing description of the embodiments of the present disclosure has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the various embodiments described. The terminology used herein was chosen in order to best explain the principles of the embodiments, the practical application, or the technical improvements in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A color calibration method for a virtual camera system comprising a camera and at least one screen, characterized in that the method is applied to a terminal device, comprising:

responding to triggering a screen calibration function of any screen in the virtual shooting system in an interactive interface of the terminal equipment, and displaying a screen measurement result corresponding to the screen, wherein the screen measurement result comprises a measurement color value and a measurement brightness value extracted from a first image sequence acquired when a first color sequence is displayed on the screen by the camera, and an original color value and an original brightness value contained in the first color sequence, and the screen measurement result is used for guiding a user to calibrate the screen brightness of the screen;

And responding to triggering a color calibration function in an interactive interface of the terminal equipment, displaying a first color card and a second color card, wherein the first color card represents measurement color values of multiple colors extracted from a second image sequence acquired when the camera displays a second color sequence on the screen, the second color card represents original color values of multiple colors in the second color sequence, and the first color card and the second color card are used for guiding a user to calibrate the colors of pictures to be displayed on the screen.

2. The method of claim 1, wherein the screen further displays a two-dimensional identification code ArUco code when displaying the second color sequence, wherein different colors in the second color sequence correspond to different ArUco codes, and wherein different ArUco codes corresponding to different colors in the second color sequence are used to indicate original color values of different colors in the second color sequence.

3. The method of claim 2, wherein prior to displaying the first color chip and the second color chip, the method further comprises:

controlling the screen to simultaneously display various colors in the second color sequence and ArUco codes corresponding to the various colors in the second color sequence, and simultaneously controlling the camera to acquire images of the screen to obtain a second image sequence;

Obtaining a plurality of measurement color values and a plurality of corresponding original color values extracted from the second image sequence by carrying out color extraction and ArUco code identification on a screen area where the screen is located in the second image sequence;

4. A method according to claim 3, wherein the interactive interface is further configured to at least one of: the number of types of color sequences in the second color sequence, the display size and the display position of the ArUco code when displayed in a screen;

wherein, the controlling the screen to simultaneously display each color in the second color sequence and the ArUco code corresponding to each color in the second color sequence includes:

and controlling the screen to display various colors in a second color sequence corresponding to the configured category number, and simultaneously displaying ArUco codes corresponding to the various colors in the second color sequence in the screen according to the display size and the display position configured in the interactive interface.

5. The method of any one of claims 1 to 4, wherein prior to displaying the first color chip and the second color chip, the method further comprises:

and controlling the screen to display second prompt information, wherein the second prompt information is used for reminding a user that the screen cannot be blocked.

6. The method according to any one of claims 1 to 4, further comprising:

and generating a color mapping relation according to the measured color values of the multiple colors in the first color card and the original color values of the multiple colors in the second color card, wherein the color mapping relation is used for calibrating the colors of the picture to be displayed on the screen.

7. The method of claim 1, wherein the first color sequence is at least one of: a red R channel color sequence, a green G channel color sequence, and a blue B channel color sequence, wherein the R channel color sequence includes a plurality of colors in which the R channel is a maximum color value and the G and B channels are different color values; the G channel color sequence comprises a plurality of colors with the G channel being the maximum color value and the R channel and the B channel being different color values; the B channel color sequence comprises a plurality of colors with the B channel being the maximum color value and the R channel and the G channel being different color values;

When the screen displays the first color sequence, two-dimensional identification code ArUco codes are also displayed, different colors in the first color sequence correspond to different ArUco codes, and different ArUco codes corresponding to different colors in the first color sequence are used for indicating original color values and original brightness values of different colors in the first color sequence.

8. The method of claim 7, wherein prior to displaying the calibrated luminance value of the screen, the method further comprises:

controlling the screen to simultaneously display various colors in the first color sequence and ArUco codes corresponding to the various colors in the first color sequence, and simultaneously controlling the camera to acquire images of the screen to obtain a first image sequence;

performing color extraction and ArUco code identification on a screen area where the screen is located in the first image sequence to obtain a plurality of measured color values and corresponding original color values in the first image sequence;

converting the first image sequence into a gray scale map and determining a plurality of measured brightness values and corresponding original brightness values in the second image sequence based on the converted gray scale map.

9. The method of claim 8, wherein the interactive interface is further configured to configure a number of sampling frames for the camera to image capture a single color; the controlling the camera to acquire the images of the screen to obtain a first image sequence comprises the following steps:

And controlling the camera to acquire images of the screen according to the configured sampling frame number, so as to obtain a first image sequence.

10. A color calibration device for a virtual camera system comprising a camera and at least one screen, characterized in that the device is applied to a terminal device, comprising:

a screen calibration module, configured to respond to triggering a screen calibration function on any screen in the virtual shooting system in an interactive interface of the terminal device, and display a screen measurement result corresponding to the screen, where the screen measurement result includes a measurement color value and a measurement brightness value extracted from a first image sequence acquired when the camera displays a first color sequence on the screen, and an original color value and an original brightness value included in the first color sequence, and the screen measurement result is used to instruct a user to calibrate screen brightness of the screen;

the color calibration module is used for responding to triggering a color calibration function in an interactive interface of the terminal equipment, displaying a first color card and a second color card, wherein the first color card represents measurement color values of multiple colors extracted from a second image sequence acquired when the camera displays a second color sequence on the screen, the second color card represents original color values of multiple colors in the second color sequence, and the first color card and the second color card are used for guiding a user to calibrate the colors of pictures to be displayed on the screen.

11. A terminal device, comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to implement the method of any one of claims 1 to 9 when executing the instructions stored by the memory.

12. A non-transitory computer readable storage medium having stored thereon computer program instructions, which when executed by a processor, implement the method of any of claims 1 to 9.