JP6430435B2 - Image processing system, image processing method, and program - Google Patents

Description

  The present invention relates to an image processing system, an image processing method, and a program for presenting content.

  As a method for providing information at a place where many people gather, such as an airport, a station, or a commercial facility, there is a method of presenting an image (content) indicating a guidance message or the like on a presentation surface. As a method for presenting content on a presentation surface, there is a method of projecting by a projection device such as a projector using a wall surface of a facility as a projection surface. Such a method is called a projection sign and is being put into practical use. As another presentation method, there is a method in which a large display device is installed on a wall surface of a facility and the content is displayed on the display surface of the display device.

  Japanese Patent Application Laid-Open No. 2004-133620 discloses a technique for detecting a change in ambient illumination when an image is projected by a projector and correcting the projection image so that the luminance of the projection image becomes a predetermined value in accordance with the change in illumination. In this technique, a projection image of a projector is taken by a camera, an illumination change is detected from the taken image, and the luminance of the entire projection image is corrected according to the illumination change.

JP 2012-10250 A

  In the technique disclosed in Patent Document 1, only the brightness of the entire projection image is corrected according to the surrounding illumination change, so that flexible control can be performed with respect to changes in the content presentation environment. Therefore, it is difficult to present high-quality content.

  For example, in information guidance using content, it is common to continue presenting content for a long time (for example, all day). In addition, it is common to present large contents on a large presentation surface so that many people can visually recognize the contents even from a remote location. Therefore, the content presentation environment, for example, the lighting state of the presentation surface due to external light such as sunlight changes, for example, sunlight enters a part of a large presentation surface, and an image of an area where sunlight is inserted is visually recognized. It may be difficult. In addition, when projecting content on a wall or glass surface in a facility, it is difficult to prepare a projection surface with uniform color and reflectivity, and part of the content may vary depending on the color and reflectivity of the projection surface. It may be difficult to see.

  With the technique disclosed in Patent Document 1, since the brightness of the entire projection image is changed, it is difficult to cope with a case where it becomes difficult to visually recognize a partial area of the content.

  Also, for example, if the sunset is inserted into the entire facility where the content presentation surface is provided and the entire surrounding environment of the presentation surface is tinged with yellow, the content composed of yellowish colors will blend into the surrounding environment. It becomes difficult to see. In this case, like the technique disclosed in Patent Document 1, even if the brightness of the content is increased, it remains difficult to visually recognize.

  An object of the present invention made in view of the above problems is to provide an image processing system, an image processing method, and a program capable of presenting content with higher quality according to the content presentation environment. It is in.

  In order to solve the above-described problems, an image processing system according to the present invention is an image processing system for presenting content, and includes a photographing unit that photographs a presentation surface on which the content is presented, and a photographed image of the photographing unit. Based on the estimation result of the environment estimation unit that estimates the presentation environment of the content and the environment estimation unit, a correction region that corrects at least one of color and brightness in the content to be presented is specified, and the specified correction A control unit that determines at least one of color and brightness for correcting the image of the region.

  In order to solve the above-mentioned problem, an image processing method according to the present invention is an image processing method in an image processing system for presenting content, in which a photographing unit photographs a presentation surface on which the content is presented. The environment estimating unit estimating the presentation environment of the content based on the captured image of the imaging unit, and the control unit based on the estimation result of the environment estimating unit, the color and brightness in the content to be presented Determining a correction area for correcting at least one of the above, and determining at least one of color and brightness for correcting the image of the specified correction area.

  In order to solve the above-described problem, a program according to the present invention includes a process for photographing a presentation surface on which a content is presented by a photographing unit on a computer in an image processing system for presenting the content, A process for estimating the presentation environment of the content based on the photographed image, and a correction area for correcting at least one of color and brightness in the content to be presented based on the estimated presentation environment, and the specified correction area And a process for determining at least one of color and brightness for correcting the image.

  According to the image processing system, the image processing method, and the program according to the present invention, it is possible to present content with higher quality according to the content presentation environment.

1 is a diagram illustrating a main configuration of an image processing system according to an embodiment of the present invention. It is a figure which shows an example of the presentation environment of the content to the presentation surface shown in FIG. It is a figure which shows an example of operation | movement of the image processing system shown in FIG. It is a figure which shows another example of operation | movement of the image processing system shown in FIG. It is a figure which shows another example of operation | movement of the image processing system shown in FIG.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. It should be noted that the present invention is not limited to the following embodiments, and various modifications can be made without departing from the spirit of the present invention.

  FIG. 1 is a diagram illustrating a main configuration of an image processing system 10 according to an embodiment of the present invention. The image processing system 10 according to the present embodiment is for content presentation, specifies a correction region for correcting at least one of color and brightness in the content according to the content presentation environment, and specifies the specified correction At least one of the color and brightness for correcting the image of the area is determined, and the content is corrected and presented according to the determined content, or the determined content is recommended to a system administrator or the like.

  An image processing system 10 illustrated in FIG. 1 includes a content data storage unit 11, a projector 12, a camera 13 (imaging unit), an environment estimation unit 14, and a control unit 15.

  The content data storage unit 11 stores content data indicating content. The content format is not limited to a specific format. The content includes not only jpg and gif format images and still images, but also mp4 format moving images, HTML format content, JavaScript (registered trademark) and libraries (such as canvas in HTML5). Various formats are included.

  The projector 12 presents (projects) the content on the presentation surface 1 (projection surface) under the control of the control unit 15. In the present embodiment, the content is presented using an example in which the projector 12 projects the content. However, for example, the content may be displayed on the display surface of the display device.

  The camera 13 captures a predetermined range including the presentation surface 1 and outputs the captured image to the environment estimation unit 14. For example, the camera 13 faces the presentation surface 1 and is provided at a predetermined distance.

  The environment estimation unit 14 estimates the content presentation environment based on the captured image of the camera 13 and outputs the estimation result to the control unit 15.

  Based on the presentation environment estimation result output from the environment estimation unit 14, the control unit 15 specifies a correction region for correcting at least one of color and brightness in the content to be presented. Then, the control unit 15 determines at least one of the color and brightness for correcting the image of the specified correction area, corrects the image of the correction area on the content based on the determined content, and outputs the determined content to the outside. Do. The control unit 15 also controls the projection of content by the projector 12. The control unit 15 includes a content control unit 151 and a projector management unit 152.

  Based on the estimation result of the environment estimation unit 14, the content control unit 151 specifies a correction area in the content to be presented, and determines at least one of color and brightness to correct the specified correction area. And the content control part 151 correct | amends the image of the correction | amendment area | region on the content of presentation object according to the determination content, for example. Further, the content control unit 151 outputs (displays) the determination content to a display unit (not shown) in FIG. 1 and corrects the content from the input unit (not shown in FIG. 1) according to the output. When permission is input, the image in the correction area on the content to be presented is corrected according to the determined content.

  When the content control unit 151 does not need to correct the content to be presented, the projector management unit 152 projects the content to be presented on the projector 12 as it is, and the content control unit 151 corrects the content to be presented. First, the corrected content is projected on the projector 12.

  Next, the operation of the image processing system 10 according to the present embodiment will be described.

  FIG. 2 is a diagram illustrating an example of a content presentation environment on the presentation surface 1, and more specifically, a state in which content is projected on the presentation surface 1 including the glass 20 and a frame 21 that supports the glass 20. FIG.

  As shown in FIG. 2, sunlight 22 enters from the outside of a facility (for example, an airport), and the sunlight hits a part of the presentation surface 1. In this case, in the area 23 exposed to sunlight, the gradation information is lost and whitening occurs in the projected content, and the image in the area 23 becomes difficult to visually recognize. Further, in the region 24 where the glass 20 and the frame 21 are adjacent to each other, the glass 20 and the frame 21 have different reflectivities. Therefore, the content of the glass 20 and the frame 21 are different from each other. In the portion 21, the projected content is overexposed, making it difficult to view.

  In this way, the presentation surface 1 is presented on the presentation surface 1 due to the environmental change of the presentation surface 1 (the illumination state of the light on the presentation surface 1 or the change in the reflectance of the presentation surface 1), which is one of the content presentation environments. Content may be difficult to see.

  In addition, for example, the glass 20 used as a projection surface may have a specific color (for example, bluish). When the projection surface and the surrounding glass 20 have a specific color, it is difficult to visually recognize the content when the content having the same color system as the projection surface is projected. Also, for example, if a sunset is inserted into the facility and the entire surrounding environment of the presentation surface 1 is yellowish, even if the content consisting of a yellow color is projected, the content is not conspicuous in the surrounding environment, It becomes difficult to see.

  As described above, the content is presented on the presentation surface 1 according to the surrounding environment of the presentation surface 1 (the presentation surface 1 itself or the color around it, or the color of the entire surrounding environment of the presentation surface 1), which is one of the content presentation environments. Content may be difficult to view.

  The environment estimation unit 14 estimates the content presentation environment (environmental change of the presentation surface 1 and the surrounding environment of the presentation surface 1) based on the captured image of the camera 13.

  When estimating the environmental change of the presentation surface 1 as the content presentation environment, the environment estimation unit 14 presents the content in the captured image of the camera 13 in a state where the presentation target content is presented on the presentation surface 1, and the presentation target Compare with content. For example, the environment estimation unit 14 extracts an area (pixel) in which the difference between the color feature values is larger than a predetermined threshold among the corresponding pixels of both images. The color characteristic value includes various values such as hue H, saturation S, brightness V in the HSV color space, R value, G value, and B value in the RGB color space. When the feature value of the color of the corresponding pixel of both the content in the photographed image and the content to be presented is equal to or greater than the threshold value, white color due to irradiation of sunlight or the like is applied to the presented content due to an environmental change of the presentation surface 1. It can be estimated that a jump (region 23 in FIG. 2), a white jump (region 24 in FIG. 2) due to the reflectance of the presentation surface 1, and the like have occurred. By extracting a region where the feature value of the color of the corresponding pixel of both the content in the captured image and the content to be presented is greater than the threshold, the region is affected by the visibility due to the environmental change of the presentation surface 1 Can be estimated.

  In addition, the environment estimation unit 14 determines the entire periphery of the presentation surface 1 based on the captured image of the camera 13 by inserting a sunset or the like in which the presentation surface 1 and its periphery (for example, glass) have a specific color. The surrounding environment of the presentation surface 1, such as having a specific color, is estimated. And the environment estimation part 14 specifies the whole content of presentation object as a correction | amendment area | region based on the estimated surrounding environment, for example.

  As a method for estimating the surrounding environment of the presentation surface 1, for example, there are the following methods.

  The environment estimation unit 14 analyzes the captured image of the camera 13 in which the periphery of the presentation surface 1 is captured, and measures the color code of each pixel of the captured image and the ratio of the pixels of each color code. Here, when shooting is performed in a state where the content is presented on the presentation surface 1, the content control unit 151 performs measurement except for the content presentation portion in the captured image. By performing such measurement, it is possible to estimate the surrounding environment of the presentation surface 1 such as the hue around the presentation surface 1. In place of the color code, for example, the HSV value, RGB value, etc. of each pixel may be detected. By performing such measurement, it is possible to estimate the surrounding environment of the presentation surface 1 (the presentation surface 1 and the surrounding color).

  Next, an example of a method for determining a color or the like for correcting content by the content control unit 151 will be described.

  The content control unit 151 estimates that an area where the feature value of the color of the corresponding pixel of both the content in the captured image extracted by the environment estimation unit 14 and the content to be presented is larger than a threshold (estimated that whiteout occurs). Area on the content to be corrected) is specified as a correction area, and the brightness (brightness and saturation) of the image in that area is increased. By doing so, occurrence of whiteout can be suppressed.

  In addition, the content control unit 151 determines, for example, the content for the hue of the surrounding environment based on the color code of each pixel of the captured image by the environment estimation unit 14 and the measurement result of the ratio occupied by the pixel of each color code. Determine the color and brightness to correct the entire content so that it stands out.

  Note that the content includes a message indicating a guide for a user to a vacant counter and a content indicating a caution message for noting a specific action. The content control unit 151 may determine a color or the like for correcting the content in consideration of the semantic content of the message indicated by the content.

  In the following, an example of a method for determining the color and brightness for correcting the content in consideration of the semantic content of the message indicated by the content will be described.

The content control unit 151 specifies the color C _max having the highest ratio in the captured image from the color code of each pixel in the captured image by the environment estimation unit 14 and the measurement result of the ratio of the pixel of each color code. To do. Next, the content control unit 151 obtains the saturation S (C _max ) and the lightness V (C _max ) of the color C _max when the content to be presented indicates a guidance message. Then, the content control unit 151 determines a color that becomes H (C _org ) S (C _max ) V (C _max ) as a color for correcting the content for each color C _org constituting the content indicating the guidance message. To do. Each color C _org constituting the content indicating the guide message, color saturation C _max, is corrected in accordance with the lightness, guide high color occupancy contents indicating the message around the presentation surface 1 C _max Since the content can be presented with the same brightness as the content, high-quality content can be presented.

  In addition, when the content to be presented indicates a guidance message, the content control unit 151 captures a captured image of the camera 13 at the latest capturing timing and a captured image captured in the past from the captured image (for example, one before And the color and brightness for correcting the content may be determined.

  In this case, the content control unit 151 calculates the change amount average ΔS of the saturation S and the change amount average ΔV of the lightness V of each pixel corresponding to the captured image at the latest capturing timing and the captured image captured in the past. To do. Then, the content control unit 151 adds, for each color constituting the content indicating the guidance message, a value obtained by multiplying the saturation S by the variation average ΔS by −1 (S−ΔS), and the lightness V by the variation amount. A color obtained by adding the average ΔV multiplied by −1 (V−ΔV) may be determined as a color for correcting the content. That is, the content control unit 151 corrects the saturation and lightness in the direction opposite to the environmental change at the latest shooting timing from the past shooting timing. By doing so, it is possible to present the content indicating the guidance message so as to compensate for the change in the surrounding environment of the presentation surface 1, so that the content can be presented with high quality. it can.

In addition, the content control unit 151 identifies one or more colors that are separated from the color C _{max in the} color space as accent colors among the colors indicated by a predetermined number of color codes having a higher ratio in the captured image. Then, the accent color is determined as a color for correcting the content. By correcting the content with a color at a position away from the color _{Cmax in the} color space among the colors of the surrounding environment of the presentation surface 1, the content stands out from the surrounding environment and becomes easy to visually recognize. Can be presented.

In addition, when the content indicates a caution message, the content control unit 151 specifies a complementary color C _com (a color positioned in the opposite direction in the hue ring) of the color C _max and sets H (C _com ) S100V100 as a color for correcting the content. (The color having the same hue as the complementary color C _com and the maximum saturation lightness) is determined. Since the combination of complementary colors has a synergistic effect of enhancing each other's colors, the content including the attention message is corrected with the complementary color C _com of the color C _max , so that the surrounding environment is more effective than the case where the accent color is used. It is possible to enhance the content. As a result, it becomes easier for the user to visually recognize the caution message, and high-quality presentation of content can be achieved.

  Note that the color and brightness determination method is not limited to the above-described method, and various methods can be used.

  FIG. 3 is a diagram illustrating an example of the operation of the image processing system 10. In FIG. 3, the operation example in the case of correcting the content according to the environmental change of the presentation surface 1 is shown.

  The camera 13 photographs the presentation surface 1 on which the content to be presented is presented (step S11).

  As preprocessing, the environment estimation unit 14 performs reverse conversion on the content to be presented with respect to the conversion of the content to be presented based on the keystone correction by the projector 12, the projection incident angle, and the like (step S12).

  Next, the environment estimation unit 14 compares the content in the captured image of the camera 13 with the content after the inverse transformation (step S13), and the difference in color feature value between the corresponding pixels of both images is predetermined. A portion larger than the threshold value is extracted (step S14).

  The content control unit 151 identifies the region extracted by the environment estimation unit 14 on the display target content as the correction region, and increases the saturation and brightness of the image in the correction region (step S15). The projector management unit 152 causes the projector 12 to project the content corrected by the content control unit 151 (step S16).

  The image processing system 10 repeats the above-described processing at every predetermined timing. As the predetermined timing, every predetermined time interval (for example, every minute), every time the content to be presented is switched, and when the projector 12 is a moving projector that can move up and down, left and right, etc. There is a timing such as every movement.

  FIG. 4 is a diagram illustrating another example of the operation of the image processing system 10. FIG. 4 shows an operation example in the case where the content is corrected according to the change in the surrounding environment of the presentation surface 1.

  The camera 13 photographs the presentation surface 1 and its surroundings (step S21).

  When the content is presented on the presentation surface 1, the environment estimation unit 14 removes the content presentation portion from the photographed image of the camera 13 as preprocessing (step S <b> 22).

  Next, the environment estimation unit 14 analyzes the photographed image (image around the presentation surface 1) excluding the presentation part of the content, and the color code of each pixel of the photographed image and the ratio of the pixels of each color code Is measured (step S23).

  Next, the content control unit 151 acquires the semantic information of the content to be presented (whether it is content indicating a guidance message or content indicating an attention message) from, for example, the content data storage unit 11 (step S24). ). Then, the content control unit 151 uses the color code of each pixel of the captured image by the environment estimation unit 14 and the measurement result (presentation environment) of the ratio occupied by the pixel of each color code and the semantic information of the content to be presented. Based on the determined content, the color to be corrected is determined based on the determined content, and the content is corrected (step S25). The projector management unit 152 causes the projector 12 to project the content corrected by the content control unit 151 (step S26).

  In the case where the image processing system 10 is a moving projector that can move up and down, left and right, etc., every predetermined time interval (for example, every minute), and whenever the content to be presented changes, as in FIG. The above-described processing is repeated at a predetermined timing such as every movement of the projector 12.

  In FIG. 4, the description has been made using the example in which the content is corrected and then projected after determining the color to be corrected, but the present invention is not limited to this.

  FIG. 5 is a flowchart illustrating another example of the operation of the image processing system 10 when the content to be presented is corrected in accordance with the change in the surrounding environment of the presentation surface 1. In FIG. 5, processes similar to those in FIG. 4 are denoted by the same reference numerals and description thereof is omitted.

  When the content control unit 151 acquires the semantic information of the presentation target content, the environment estimation unit 14 measures the color code of each pixel of the captured image and the ratio occupied by the pixel of each color code, and the content to be presented. Based on the semantic information, the color or the like for correcting the content is determined (step S31).

  Next, the content control unit 151 outputs (recommends) the determined content to a system administrator or the like (step S32).

  Next, the content control unit 151 determines whether or not an input indicating that content correction is permitted is input in accordance with the determined content (step S33).

  If it is determined that permission to correct the content has been input (step S33: Yes), the content control unit 151 corrects the content to be presented according to the determination, and causes the projector 12 to project the corrected content (step S31). S34).

  If it is determined that content correction is not permitted (step S33: No), the content control unit 151 returns to the process of step S31, for example, and determines the color for correcting the content according to another determination method, for example. Try again.

  For example, the image processing system 10 performs the operation described with reference to FIG. 5 when adjusting the content to be presented before the start of information guidance, and performs the operation described with reference to FIG. 4 during information guidance.

  In the present embodiment, the environment estimation unit 14 has been described using an example in which the entire content to be presented is specified as a correction area based on the estimated surrounding environment. However, the present invention is not limited to this. For example, the environment estimation unit 14 may determine a region having a predetermined width from the outer periphery of the content to be presented as the correction region. In this case, the content control unit 151 determines, for example, a color at a position away from the hue of the surrounding environment of the presentation surface 1 in the color space as a color for correcting the correction region. By doing so, the division between the content and the surrounding environment becomes clear, and the content can be presented with high quality.

  As described above, in the present embodiment, the image processing system 10 estimates the content presentation environment based on the camera 13 (photographing unit) that captures the presentation surface 1 that presents the content, and the captured image of the camera 13, and estimates the content. Based on the presented presentation environment, the environment estimation unit 14 that specifies a correction region that corrects at least one of the color and brightness in the content to be presented, and the color and brightness that correct the image in the correction region specified by the environment estimation unit 14 And a control unit 15 for determining at least one of the lengths.

  Based on the content presentation environment, by specifying the correction area for correcting the color and brightness in the content to be presented, and determining the color and brightness for correcting the image of the specified correction area, for example, the presentation surface Since the content can be corrected only in the area affected by the environmental change of 1 (sunlight insertion into a part of the presentation surface 1, change in the reflectance of the presentation surface 1, etc.), more flexible control is possible. This makes it possible to provide high-quality presentation of content. In addition, by correcting not only the brightness of the content but also the color, it is possible to perform a presentation that maintains and improves the visibility of the content with respect to the hue of the surrounding environment of the presentation surface 1. Quality presentation can be achieved.

  Note that the present embodiment has been described using an example in which the content presentation environment is estimated and the color and brightness of the content to be presented are corrected (changed) based on the estimated presentation environment. However, the color may not be changed depending on the image. For example, even if an image showing a yellow giraffe is inconspicuous at sunset, changing the color of the image showing the giraffe from yellow to blue, for example, to be noticeable at sunset, the recognizability of giraffe is remarkably high. descend. In addition, if a specific color such as a logo of a company or product, an emergency exit sign, etc. is meaningful or if a specific color is customarily used, changing the specific color will significantly reduce the recognition. .

  Therefore, for example, when a specific color area that cannot be changed in advance is specified and the color of the area needs to be changed (when the specific color area is specified as a correction area), It is conceivable that the color is changed only at the outer periphery of the region (for example, the border is black). That is, only a part of the change target area (correction area) may be changed according to the presentation environment.

  The content can also be configured by a combination of one or more elements (symbols, announcements, etc.). In this case, it is conceivable to change the elements constituting the content including the area to be changed (in the above example, a giraffe image, a company, a product logo, etc.) or the entire content. For example, in the image of a giraffe that is an element that constitutes content, if sunlight is inserted only in the neck part of the giraffe, if the edge of only the neck part is taken, the balance of the appearance will be lost, It can also be considered that the whole content is connected.

  Further, for example, when the environment estimation unit 14 estimates that there is a region where sunlight is inserted in the content presentation surface 1 as the content presentation environment, the elements constituting the content in the region where the sunlight is inserted May not be arranged. That is, the arrangement of the elements constituting the content may be changed according to the estimation result of the environment estimation unit 14. Although the element presented in the area where sunlight is inserted is difficult for the user to visually recognize, each element can be changed by changing the arrangement of the elements constituting the content according to the estimation result of the content presentation environment by the environment estimation unit 14. Can be easily recognized by the user.

  The method performed in the image processing system 10 according to the present invention may be applied to a program for causing a computer to execute. In addition, the program can be stored in a storage medium and can be provided to the outside via a network.

  Although the present invention has been described based on the drawings and embodiments, it should be noted that those skilled in the art can easily make various variations or modifications based on the present disclosure. Therefore, it should be noted that these variations or modifications are included in the scope of the present invention.

DESCRIPTION OF SYMBOLS 10 Image processing system 11 Content data storage part 12 Projector 13 Camera 14 Environment estimation part 15 Control part 151 Content control part 152 Projector management part 20 Glass 21 Frame

Claims (8)

An image processing system for presenting content,
A photographing unit for photographing a presentation surface for presenting the content;
An environment estimation unit that estimates a presentation environment of the content based on a captured image of the imaging unit;
Based on the estimation result of the environment estimation unit, a correction area for correcting at least one of color and brightness in the content to be presented is specified, and at least one of color and brightness for correcting the image of the specified correction area is determined. A control unit,
Equipped with a,
The photographing unit photographs the presentation surface and the periphery of the presentation surface,
The environment estimation unit measures the color of each pixel of an image in an area other than the area where the content is presented in the captured image of the imaging unit,
The control unit corrects the image in the correction region according to the measurement result of the color of each pixel in the region other than the region where the content is presented in the captured image of the photographing unit by the environment estimation unit, and brightness image processing system characterized that you determine at least one of. The image processing system according to claim 1 ,
When the content to be presented indicates a message, the control unit selects at least one of a color and brightness for correcting the image in the correction area according to the meaning content of the message and the presentation environment of the content. An image processing system characterized by determining. The image processing system according to claim 1 or 2 ,
The control unit changes an arrangement of elements constituting the content based on a result of estimation by the environment estimation unit. In the image processing system according to any one of claims 1 to 3 ,
The environment estimation unit estimates the presentation environment at a predetermined timing, specifies the correction region,
The control unit determines at least one of a color and brightness for correcting an image in the correction area according to the specification of the correction area by the environment estimation unit. In the image processing system according to any one of claims 1 to 4 ,
When the control unit determines at least one of the color and brightness for correcting the image of the correction area, the control unit corrects the image of the correction area in the content to be presented and presents it on the presentation surface according to the determination content, Alternatively, when the content of the determination is output, and an input indicating that the correction of the content to be presented is permitted according to the output, the image of the correction area in the content to be presented is corrected and the presentation surface An image processing system characterized by being presented in In the image processing system according to any one of claims 1 to 5 ,
The control unit may change a color of a part of the correction area according to the presentation environment when a specific color area specified in advance is specified as the correction area. . An image processing method in an image processing system for presenting content,
A step of photographing a presentation surface on which the photographing unit presents the content;
An environment estimating unit estimating a presentation environment of the content based on a photographed image of the photographing unit;
Based on the estimation result of the environment estimation unit, the control unit specifies a correction region for correcting at least one of the color and the brightness in the content to be presented, and the color and the brightness for correcting the image of the specified correction region. determining at least one, only including,
The photographing unit photographs the presentation surface and the periphery of the presentation surface,
The environment estimation unit measures the color of each pixel of an image in an area other than the area where the content is presented in the captured image of the imaging unit,
The control unit corrects the image in the correction region according to the measurement result of the color of each pixel in the region other than the region where the content is presented in the captured image of the photographing unit by the environment estimation unit, and An image processing method for determining at least one of brightness . To a computer in the image processing system for content presentation,
A process of photographing a presentation surface on which the content is presented by the photographing unit;
A process of estimating a presentation environment of the content based on a photographed image of the photographing unit;
A process of identifying a correction area for correcting at least one of color and brightness in the content to be presented based on the estimated presentation environment and determining at least one of color and brightness for correcting the image of the specified correction area and, to the execution,
In the process of photographing the presentation surface, the photographing unit photographs the presentation surface and the periphery of the presentation surface,
In the process of estimating the presentation environment, the color of each pixel of the image in the region other than the region where the content is presented in the photographed image of the photographing unit is measured,
In the determining process, at least one of a color and brightness for correcting the image in the correction area according to a measurement result of a color of each pixel in an area other than the area where the content is presented in the captured image of the imaging unit. program that determines the.

Images