WO2013140456A1

WO2013140456A1 - System for projecting contrast-enhanced images

Info

Publication number: WO2013140456A1
Application number: PCT/JP2012/001998
Authority: WO
Inventors: 洋一平山; 高志中杉; 隆行森岡; 伸夫池庄司; 高嗣東
Original assignee: 株式会社日立製作所
Priority date: 2012-03-23
Filing date: 2012-03-23
Publication date: 2013-09-26
Also published as: JP6002753B2; JPWO2013140456A1

Abstract

When a painting is projected by a projector with the intent of facilitating viewing of the same painting, instead of the shading of the painting being enhanced, some light is projected onto the dark areas as well, giving rise to a whitish appearance in these areas. Conversely, when the brightness of the projector is reduced with the intention of preventing whitish appearance, the overall appearance is dark. To solve the aforementioned problem, the system is characterized by receiving image data corresponding to a painting; adjusting the pixel values of the colors of the pixels of the projected image, on the basis of a color distribution database that stores relationships between pixel values of each color component, i.e., the red component, the green component, and the blue component, from the received image data, and the numbers of pixels having those pixel values; and projecting the painting.

Description

Contrast-enhanced image projection system

This relates to a technology that increases the contrast of the actual picture by the image projected from the projector.

Conventionally, data has been displayed using a projector or the like. In addition, for example, Patent Document 1 describes that display data is processed and projected in order to increase contrast. On the other hand, as described in Non-Patent Document 1, there is a description that a projected image is processed and projected onto a real image by a projector in order to increase the contrast of the real image.

JP 2001-257905 A

Even if the same image data as the painting is projected with a projector to make it easy to appreciate the painting, the shade of the painting itself is not emphasized, and some light is projected even in the dark part, so the white floating of that part Happens. On the other hand, if the brightness of the projector is reduced in order to prevent whitening, it will become dark overall. Even if the contrast of the projected image itself of the projector as in Patent Document 1 (Japanese Patent Laid-Open No. 2001-257905) is increased, the dark portion is not exposed to light, and the above problem cannot be solved.

Also, as in Non-Patent Document 1, the contrast of the processed image is emphasized, but this also does not mean that the light does not hit the dark part, and the above problem cannot be solved.

In order to solve the above object, as an example, the present invention includes a projection device that projects an image and a computer connected to the projection device, and the computer receives image data corresponding to the picture. A color distribution database that stores a relationship between a pixel value and the number of pixels having the pixel value for each color component of a red component, a green component, and a blue component from the received image data; and the color distribution database And a color distribution changing unit that adjusts the pixel value of each color of the pixels of the projection image, and the projection device projects the projection image adjusted by the computer onto a picture.

It can increase the contrast of the actual picture efficiently.

The system block diagram in one Embodiment of this invention. The figure showing image data and color distribution in one embodiment of the present invention. 5 is a flowchart showing image data processing according to an embodiment of the present invention. The system block diagram which controls the display data and audio | voice in one Embodiment of this invention. The figure showing the database which manages the display data and audio | voice data in one Embodiment of this invention. The flowchart which shows the registration process to the database of the data in one Embodiment of this invention. The figure showing the time table which controls the display data and audio | voice in one Embodiment of this invention. The flowchart which shows the display data and audio | voice control process in one Embodiment of this invention. The figure showing the color distribution database in one Embodiment of this invention.

FIG. 1 shows a system configuration of an embodiment of the present invention. There are a computer 100, a projector 170 for projecting an image in the computer, an actual picture 180, and a projector projection screen 190 projected onto the actual picture, and the picture data 110 obtained by photographing the actual picture into digital data in the computer. A color distribution analysis unit 120 for analyzing the color distribution of the painting data 110, a color distribution database 125 as an analysis result, a color distribution changing unit 130 for changing the color distribution of the painting data 110, and a color distribution changing unit for the painting data 110 It consists of display data 140 resulting from the change at 130. The picture data 110 is taken in by the image data reading unit.

The picture data 110 in the computer 100 is analyzed by the color distribution analysis unit 120 for color distribution, and the result of analysis as a color distribution database 125 is temporarily stored. The color distribution changing unit 130 changes the picture data with reference to the color distribution database 125, which becomes display data 140, and is projected as a projector projection screen 190 on the actual picture via the projector 170. Here, although it was set as a real picture, it is realistic that this is what is called a replica or printed matter. In addition, how to install this actual picture (etc.) (mechanical fixing such as magnet, adhesive, screw, etc.) does not matter.

FIG. 9 shows a specific configuration of the color distribution database 125. The color distribution database 125 stores the number of pixels corresponding to the pixel value 920. The pixel value 920 is a value representing a color itself. When the channel is represented by 8 bits, the pixel value 920 is in the range of (0) to (255), the pixel value 920 (0) means black, and the pixel value 920 (255) means white. When the picture data 110 is represented by three channels of red, green, and blue, each channel 910 has a database. For example, when the pixel color is green, the red pixel value 920 is represented by three pixel values 920, (0), the green pixel value 920 is (255), and the red pixel value 920 is (0).

The table of the color distribution database 900 has a vertical classification of channel 910 red, green and blue, and a horizontal classification of pixel values 920 (0) to (255). Some pixel values are omitted by dotted lines because of the size of the drawing. The contents of the table are the number of pixels. For example, the pixel value 920 (222) indicates that there are 15 in channel red, 8 in channel green, and 3 in channel blue. It also has the total number of red, green and blue pixels in the channel. When the number of pixels is sequentially viewed from the pixel value 920 (0), the channel red has a pixel value of 920 (30) and the number of pixels of 11 appears for the first time. Similarly, the channel green has a pixel value of 920 (30) and the number of pixels of 26 appears for the first time. Similarly, the channel blue has a pixel value of 920 (30) and the number of pixels of 19 appears for the first time. That is, the smallest pixel value with a value of 1 or more in the color distribution database 900 is specified, and the darkest color of the image is the pixel value 920 (30). When the number of pixels is sequentially viewed from the pixel value 920 (255), the brightest color of the image represented by the color distribution database 900 is the pixel value 920 (222).

The color distribution database 211/221/231 shown in FIG. 2 is a graphical representation of FIG. The horizontal axis of the graph indicates the pixel value, and the vertical axis indicates the number of pixels. The number of pixels is a numerical value obtained by adding the numbers of channels red, green, and blue.

FIG. 2 shows picture data and color distribution according to an embodiment of the present invention. The color distribution database 211/221/231 shown in FIG. 2 shows specific values of the color distribution database 125 of FIG.

Fig. 2a shows original picture data 110 obtained by photographing a real picture 180 and converting it into digital data, and a color distribution database 211 of the analysis result of the color distribution analysis unit 120. Looking at the color distribution database 211, the darkest color has a pixel value 920 (30) and the brightest color has a pixel value 920 (222).

FIG. 2 b shows the picture data when the color of the darkest part in FIG. 2 a is changed to black, and the color distribution database 221 of the analysis result of the color distribution analysis unit 120. In the color distribution database 211 of the picture data 110, the darkest color is the pixel value 920 (30), so the following conversion formula 1 is derived. Conversion formula 1: Pixel value after conversion = pixel value-30. That is, the conversion formula 1 is applied to all pixel values. For example, the pixel value 920 (128) becomes the pixel value 920 (98) and becomes dark. In the color distribution database 221, the darkest color has a pixel value 920 (0) and the brightest color has a pixel value 920 (192).・
Here, we considered the case where the darkest pixel values of the red, green, and blue channels are all (30). However, each channel has a different value, and the minimum pixel value of each channel is It does not necessarily match. In that case, the darkest pixel value is selected from among red, green, and blue, and the largest pixel value among them (red, green, and blue) is subtracted from all the pixel values.

For example, if the combination of red, green and blue pixel values is (30, 40, 50) and the blue pixel value (30) is the smallest, subtract (50) from all the pixel values.

As another method, for example, L represented by red, green, and blue pixel values, that is, RGB values are converted into L * a * b * color systems to represent the degree of brightness. It is also possible to identify the lowest L value by looking at the value. Specifically, if each pixel value of red, green, and blue is set to R, G, and B, first, Y = 0.2123 * ((R / 255) to the power of 2.2) +0.7010 * ((G / 255) 2) + 0.0858 * ((B / 255) to the power of 2.2), Y0 = 100, and if Y / Y0> 0.008856, L = 116 * ((Y / Y0) to the 1/3 power)- 16 (L is in the range of 0 to 100), and Y / Y0 <= 0.008856, L = 116 * ((903.3 * (Y / Y0) +16) / 116) -16 (L is in the range of 0 to 100) Calculate as The largest value of red, green and blue pixel values specified as the darkest by L is subtracted from all pixel values.

In the present embodiment, the darkest pixel value 920 is changed to black. However, an input of an appropriate pixel value may be accepted to convert the pixel value. In this case, the conversion formula 1 is the pixel value after conversion = pixel value−the value of the accepted pixel value.

In FIG. 2c, the black color of the pixel value 920 (0) in FIG. 2b is not changed, and the color distribution database 231 of the picture data when the brightness and saturation of other colors are increased and the analysis result of the color distribution analysis unit 120 are displayed. Indicates. There are various methods for increasing the lightness and saturation. Here, the pixel value 920 (0) to the pixel value 920 (127) is evenly assigned to the pixel value 920 (0) to (255). Took the way. The conversion method between the pixel value 920 (0) and the pixel value 920 (127) is the following conversion formula 2. Conversion formula 2: Pixel value after conversion = pixel value before conversion / 127 × 255.

If the conversion formula 2 is applied, for example, the pixel value 920 (0) becomes 0. Pixel value 920 (64) is 128.5 and rounded off, and pixel value 920 is (129). Pixel value 920 (127) becomes pixel value 920 (255).

A conversion method between the pixel value 920 (128) and the pixel value 920 (255) is expressed by the following conversion formula 3. Conversion formula 3: Pixel value after conversion = 255. When the conversion formula 3 is applied, the pixel value 920 (255) to the pixel value 920 (255) becomes the pixel value 920 (255). The color distribution database looks like 231.
As described above, in this embodiment, in order to increase the brightness and the saturation, the pixel values of red, blue, and yellow are increased to 127, which is the median value of the pixel values, thereby increasing the brightness and the saturation. For 920 (128) and later, the maximum pixel value of pixel value 920 (255) is assumed. However, the present invention is not limited to this, and even if it is not the median value, up to the pixel value 920 (180) or the pixel value 920 (200) can be received by accepting the input of the upper limit pixel value to increase the brightness and saturation. It is also possible to increase the pixel value up to an arbitrary pixel value. Also, in order to increase brightness and saturation, pixel values 920 (0) to (255) are equally allocated, but this also accepts pixel value input in a range that is equally allocated, and performs allocation processing based on the values. It is good as well. In this case, the conversion formula 2 is the pixel value after conversion = the pixel value before conversion / the upper limit pixel value to increase the brightness and saturation × the pixel value in the range to be allocated uniformly.

FIG. 3 is a flowchart of a picture data processing method according to an embodiment of the present invention. Next, this example will be described with reference to the flowchart of FIG.

In step 310, a picture data 110 obtained by photographing a real picture and converting it into digital data is prepared. In step 320, the color distribution analysis unit 120 is used to create the color distribution database 125 of the painting data 210. The channel red, green, and blue pixel values 920 of all the pixels of the picture data 210 are read, and 1 is added to the corresponding place in the table of FIG. The horizontal axis is the pixel value 920, and the vertical axis is the total number of pixels.

In step 325, the darkest color of the painting data 210 is obtained using the created color distribution database 125. In this case, the pixel value is 920 (30). The brightest color is the pixel value 920 (222).

In step 330, the color distribution changing unit 130 refers to the color distribution database 125 and subtracts the pixel value of the darkest color specified in the painting data 210 from the pixel value. Specifically, the pixel value 920 (30) is changed to the pixel value 920 (0). Subtract 30 for other colors as well. In this case, the darkest color has a pixel value 920 (0) and the brightest color has a pixel value 920 (192). As a result, the state of the color distribution database is 221.

In step 340, the color distribution changing unit 130 refers to the color distribution database 125 and increases the brightness and saturation of other colors without changing the black color of the painting data FIG. 2b. That is, with reference to the color distribution database 125, the brightness and saturation of other colors are increased without changing the portion of the pixel value 920 that has been changed (0). There are various methods for increasing the brightness and the saturation, but here, the pixel value 920 (0) to the pixel value 920 (127) are equally allocated from the pixel value 920 (0) to the pixel value 920 (255). Pixel values 920 (128) to 920 (255) are all assigned to pixel value 920 (255). The resulting color distribution database is 231.

In step 350, using the projector 170, the picture data FIG. 2 c reflecting the color adjustment created from the changed color distribution database is projected as the display data 140 onto the projector projection screen 190 on the actual picture 180.
In this way, FIG. 2B is created by darkening all the pixels so that the darkest color of the painting data is black (using the conversion formula 1) with respect to FIG. 2A. FIG. 2c is created by brightening the darker color, that is, the pixels other than black (using conversion equations 2 and 3). The basic method of projecting the image on the picture using FIG. 2c as display data is shown in FIGS.

This shows how to use it as an application. In addition to the basics, a display data and audio data database 500 is added to synchronize display timing and audio. In the present embodiment, the display data database and the audio data database are combined into one, but the present invention is not limited and may be separate. By using the present invention, it becomes a unique system for explaining a painting or a painting using a reproduction.

FIG. 4 shows a system configuration for controlling display data and sound according to an embodiment of the present invention. FIG. 4 is an expanded configuration of FIG. There are a computer 400, a projector 170 for projecting an image in the computer, a real picture 180, and a projector projection screen 190 projected onto the real picture, and the picture data 110 obtained by photographing the real picture and converting it into digital data 110 A color distribution analysis unit 120 for analyzing the color distribution of the painting data 110, a color distribution database 125 as an analysis result, a color distribution changing unit 130 for changing the color distribution of the painting data 110, and a color distribution changing unit for the painting data 110 It consists of a display data database 440 resulting from the change in 130, a data control unit 445 that controls the display method of the display data, an audio data database 440, a data control unit 445 that controls the playback method of the audio data, and a speaker 460. The

The picture data 110 in the computer 400 is analyzed by the color distribution analysis unit 120 for color distribution, and the result of analysis as a color distribution database 125 is temporarily stored. The color distribution changing unit 130 changes the picture data with reference to the color distribution database 125 and registers it in the display data database 440. The display data is projected as a projector projection screen 190 by the data control unit 445 on the actual picture via the projector 170. Furthermore, audio data is also registered in the audio data database 440 in advance, and is reproduced by the data control unit 445 via the speaker 460.

FIG. 5 shows the configuration of a display data and audio data database 500 according to an embodiment of the present invention. It consists of a data ID 510, a data type 520, a data file name 530, and a storage location path 540. ID = 001 registers type = image, file name = display data 1.jpg, path = c: \ root, ID = 002 stores type = image, file name = display data 2.jpg, path = c : \ root, ID = 003 has type = image, file name = display data 3.jpg, path = c: \ root, ID = 004 has type = sound, file name = sound data 1.wav, path = c : \ root is registered.

FIG. 6 is a flowchart showing a registration method to the database according to the embodiment of the present invention. In step 610, the variable ID is set to 001, and the variable path = c: \ root is set by user designation (path input reception).

If it is not determined in step 620 whether there is data to be registered, the process ends. To determine the presence of data, check the directory of the variable path = c: \ root, and if there is a file, “data is present”. When the determination is made again by the loop processing, the data once determined as “data present” is not determined. Judgment processing is implemented with flags and if statements.

In step 630, it is determined whether the data is an image. There are various methods for determining whether the image is an image or not, but here it is determined by the file name. If a character string such as .jpg, .tif, or .png is included at the end of the file name, it is regarded as an image.

If it is determined in step 630 that the data is an image, the painting data 110 is processed as shown in FIG. 3 in step 640, and stored in the specified path with the file name specified by the user. However, the degree of lightness and saturation and the range of the painting to be raised vary depending on the content of the painting. For example, if the commentary covers the entire painting, an image with a lightness and saturation increased to a small degree is required for the entire painting, and if the next commentary content wants to emphasize the central part, After increasing the lightness and saturation with, an image in which only the central part is increased is required.

In step 650, the variable ID is set in the data ID item of the display data and audio data database 500, the image is set in the type item of the display data and audio data database 500, and the file name item of the display data and audio data database 500 is entered. The file name specified by the user is set, and the variable path is set in the path item of the display data and audio data database 500.

If it is determined in step 630 that the data is audio data, in step 660, the processing is performed on the audio data. The audio data prepared in advance is cut off before and after, and saved in a specified path with a file name specified by the user. Step 670 is set in the display data and audio data database 500 as in step 650. However, the type is voice. In step 680, the variable ID is incremented by one.

FIG. 7 shows a time table for controlling display data and sound according to an embodiment of the present invention. One time table consists of four elements. The first shows a time ID 701 and a time table ID. The second is used at time 710 as a trigger to start the operation. The third determines the target ID 720 and the opponent of the action. The target ID specifies the data ID of the display data and audio data database 500 in FIG. The fourth is the operation 730 itself. In FIG. 7, there are five timetables. The time tables 001, 002, 003, 004, and 005 are executed in order from the top.

When the time ID = 001 is 0 minute 0 second, it means that the data of the target ID = 001 is displayed with the display effect of dissolve 2 seconds. The data of the target ID = 001 is the data ID = reference ID data of the display data and audio data database 500 in FIG. Therefore, in the time table = 001, when 0 minute 0 second is reached, it means that the image of c: \ root \ display data 1.jpg has a display effect of dissolve 2 seconds.
Similarly, when the time ID = 002 reaches 0 minute 0 second, it means that the data of the target ID = 004 is reproduced from the position of 0 second. When time ID = 003 becomes 1 minute 0 seconds, it means that the data of object ID = 002 is displayed with the display effect of dissolve 2 seconds. When time ID = 004 reaches 2 minutes and 0 seconds, it means that the data of object ID = 003 is displayed with the display effect of dissolve 2 seconds. When the time ID = 005 is 3 minutes and 0 seconds, it means that the sound reproduction of the data of the target ID = 005 is stopped.

FIG. 8 is a flowchart of display data and audio control according to an embodiment of the present invention. In step 810, it is determined whether or not there is a time table, in step 811 the database type and file name and path are acquired using the target ID of the time table, and in step 821, the time is determined. Proceed to step 822 to determine the type. If it is determined that the type is an image, the file name and path acquired in step 830 are displayed using the specified operation. If the type is determined to be audio data in step 822, the audio data operation in step 850 is performed. Proceed to the determination. If it is determined that playback is in the determination of the operation state in step 850,
If the audio data is played back with the specified operation using the acquired file name and path in step 851, and if it is determined to be stopped in step 850, the process proceeds to step 852, and the operation is performed with the acquired file name and path. Stop. Next, in step 890, the next time table is referenced.

Execute the time table of FIG. 7 using the flow of FIG. 8 as follows. First, the system sets the time to 0 minutes and 0 seconds and starts the timer. If time ID = 001 of the time table exists, the database 500 of the display data and audio data database 500 in FIG. 5 is referred to based on the target ID = 001.

．Get type, file name and path from data ID = 001 of database 500. Run because the timer has passed 0 minutes 0 seconds. Using type = image, file = c: \ root \ display data 1.jpg, the operation executes display with a display effect of dissolve 2 seconds. Next, when time ID = 002 exists, the database 500 is referred to based on the target ID = 004. Get type, file name and path from database data ID = 004. Run because the timer has passed 0 minutes 0 seconds. Using the type = sound, file = c: \ root \ sound data 1.wav, the operation starts sound playback from the 0 second position. Next, when time ID = 003 exists, the database 500 is referred to based on the target ID = 002. Get type, file name and path from database data ID = 002. Wait until the timer reaches 1 minute 0 seconds. Executes display with the display effect of dissolve 2 seconds using type = image, file = c: \ root \ display data 2.jpg. Next, when time ID = 004 exists, the database 500 is referred to based on the target ID = 003. Get type, file name and path from database data ID = 003. Wait until the timer reaches 2 minutes 0 seconds. Using type = image, file = c: \ root \ display data 3.jpg, the operation executes display with a display effect of dissolve 2 seconds. Next, when the time ID = 005 exists, the database 500 is referred to based on the target ID = 004. Get type, file name and path from database data ID = 004. Wait until the timer reaches 3 minutes and 0 seconds. Using type = sound, file = c: \ root \ sound data 1.wav, the operation performs a sound stop.

In FIG. 4, FIG. 5, FIG. 6, FIG. 7, and FIG. 8, display data and audio data are automatically controlled according to a predetermined time table. As another application, a system in which display data and audio data are displayed and reproduced by a user input using a mouse, a touch panel, or the like may be used.

Painting data: 110, color distribution analysis unit 120, color distribution database 125, color distribution change unit 130, display data 140, projector: 170

Claims

A projection device for projecting an image;
A computer connected to the projection device;
An image data reading unit for receiving image data corresponding to a picture by the computer, and a relationship between a pixel value and the number of pixels having the pixel value for each color component of a red component, a green component, and a blue component from the received image data. A color distribution database to store;
A color distribution changing unit that adjusts the pixel value of each color of the pixels of the projection image based on the color distribution database;
The projection apparatus projects a projection image adjusted by the computer onto the picture.
In claim 1,
The contrast distribution image projection system, wherein the color distribution changing unit subtracts a pixel value determined based on the color distribution database from pixel values of all colors of all pixels.
In claim 2,
The color distribution changing unit specifies the smallest pixel value with the number of pixels in the color distribution database being 1 or more, and subtracts the specified pixel value from the pixel values of all colors of all pixels. Contrast-enhanced image projection system.
In claim 3,
A color distribution analysis unit that counts the number of pixels corresponding to the pixel value for each pixel value representing a color component of a red component, a green component, and a blue component from the received image data and stores the number in the color distribution database; Contrast-enhanced image projection system.
A contrast-enhanced image projection system according to any one of claims 1 to 4,
The color distribution changing unit subtracts all pixel values with the largest pixel value among the pixel values of the red component, the green component, and the blue component of the pixel having the specified pixel value. Contrast-enhanced image projection system.
A contrast-enhanced image projection system according to each of claims 1 to 4,
The color distribution changing unit calculates the L value of the L * a * b * color system of each pixel from the pixel values of the red component, the green component, and the blue component, and identifies the pixel having the smallest L value. A contrast-enhanced image projection system characterized by subtracting all pixel values from the pixel values of the red component, green component, and blue component of the pixel with the largest pixel value.
A contrast-enhanced projection image generation device according to each of claims 1 to 6,
The color distribution changing unit further includes
A contrast-enhanced image projection system, wherein a value obtained by multiplying each of the subtracted pixel values by a specific value and dividing the result by the brightest pixel value is a new pixel value.
A step of projecting an image on the picture by the projection unit;
The step of receiving image data corresponding to the picture by the image data reading unit, and the relationship between the pixel value and the number of pixels having the pixel value for each of the red, green, and blue color components from the received image data. Storing in a color distribution database;
A step of adjusting a pixel value of each color of a pixel of a projection image based on the color distribution database by a color distribution changing unit;
A contrast-enhanced image projection method comprising:
An image data reading unit that receives image data corresponding to a picture, and a color that stores a relationship between a pixel value and the number of pixels having the pixel value for each color component of a red component, a green component, and a blue component from the received image data A distribution database;
A contrast-enhanced image projection program that functions as a color distribution changing unit that adjusts pixel values of each color of pixels of a projection image based on the color distribution database.