WO2012165089A1

WO2012165089A1 - Imaged content correction device and method, and imaged content distribution system

Info

Publication number: WO2012165089A1
Application number: PCT/JP2012/061043
Authority: WO
Inventors: 竜太郎溝上
Original assignee: 富士フイルム株式会社
Priority date: 2011-05-31
Filing date: 2012-04-25
Publication date: 2012-12-06
Also published as: JP2012252382A

Abstract

Web content is acquired (B1), the acquired web content is converted to an image (B2), luminosity-associated information is acquired from a client (B3, B9), luminosity information, which denotes luminosity of a periphery of the client, is acquired on the basis of the acquired luminosity-associated information, and the converted image is corrected according to the acquired luminosity information (B8, B11).

Description

Imaging content correction apparatus, method, and imaging content distribution system

The present invention relates to a technique for distributing imaged Web content, and more particularly to a technique for correcting the imaged Web content according to visual conditions.

Patent Document 1 extracts an outline that is difficult for a color blind person to see from an input image, and displays the extracted outline together with the image.

Patent Document 2 adjusts brightness or contrast in addition to color adjustment by identifying day and night or indoor and outdoor.

JP 2008-276655 A JP 2010-175710 A

In recent years, many mobile terminals equipped with browsers such as mobile phones and smartphones have become widespread. On mobile terminals, text data, compressed image data such as jpeg (Joint (PhotographicoExperts Group), and data formats such as HTML data can be almost viewed. Since mobile terminals are carried around and used in various places, browsing conditions are not fixed, making it difficult to identify the color of content.

On the other hand, it is said that there are 3 million people in Japan alone who are difficult to discriminate against some color combinations. When information is obtained using the Internet, it cannot be said that the content represented by the Web site gives sufficient consideration to color blind people. Moreover, even a healthy person has difficulty in visualizing content under use conditions, for example, in bright outdoors. Therefore, image correction according to the use conditions is required.

However, the communication network of mobile terminals is poor compared to wired LAN lines and has low specifications compared to personal computers. For this reason, there is a limit to display control that makes it easy to identify the color of the content according to the usage environment of the mobile terminal.

Furthermore, since the mobile terminal is used under various conditions due to its portability, visibility is not improved if image correction conditions are generally set and images are corrected under those conditions.

The present invention has been made in view of such problems, and corrects an image viewed on a mobile terminal used under various conditions in accordance with the use condition, and is visually recognized by a color blind person or a normal person. Improve sexiness.

The present invention provides a Web content acquisition unit that acquires Web content, an image conversion unit that converts the Web content acquired by the Web content acquisition unit into an image, and a brightness-related information acquisition unit that acquires brightness-related information from a client. The brightness information acquisition unit that acquires brightness information indicating the brightness of the surroundings of the client based on the brightness related information acquired by the brightness related information acquisition unit, and the brightness information acquired by the brightness information acquisition unit Accordingly, there is provided an imaging content correction apparatus including a correction unit that corrects the image converted by the image conversion unit.

Preferably, the brightness related information acquisition unit acquires the position information of the client, and the brightness information acquisition unit predicts the brightness corresponding to the position information, and acquires the predicted brightness as the brightness information.

Preferably, the brightness related information acquisition unit acquires image information via the imaging device, and the brightness information acquisition unit acquires brightness information as brightness information from the image information acquired by the brightness related information acquisition unit. To do.

Preferably, the correction unit corrects the brightness of the image converted by the image conversion unit in accordance with the brightness information acquired by the brightness information acquisition unit.

Preferably, the image conversion unit includes a determination unit that determines whether there is a color combination that is difficult to identify from the converted image, and the correction unit includes an image that is determined by the determination unit to have a color combination that is difficult to identify. The color information is corrected according to the brightness information acquired by the brightness information acquisition unit.

Preferably, the correction unit superimposes a halftone pattern having an intensity according to the brightness information acquired by the brightness information acquisition unit on one color region of the color combination that is difficult to identify.

Preferably, the correction unit inserts a line having a thickness according to the brightness information acquired by the brightness information acquisition unit in a boundary region where the combination of colors that are difficult to identify touches.

Preferably, the color information correction unit shifts the hue of each color combination that is difficult to identify along the hue ring by an amount corresponding to the brightness information acquired by the brightness information acquisition unit.

Preferably, a transmission unit that transmits the image corrected by the correction unit to the client is provided.

According to the present invention, the information processing apparatus acquires the Web content, converts the acquired Web content into an image, acquires the brightness related information from the client, and the acquired brightness related information. Provided is an imaging content correction method for executing brightness information indicating brightness around a client and correcting an image converted according to the acquired brightness information.

A computer-readable non-transitory recording medium (a non-transitory computer-readable medium) on which an image content correction program for causing the information processing apparatus to execute the image content correction method is also included in the present invention.

The present invention relates to a client that notifies brightness-related information, a Web content acquisition unit that acquires Web content requested by the client, an image conversion unit that converts the Web content acquired by the Web content acquisition unit into an image, and a client A brightness-related information acquisition unit that acquires brightness-related information, and a brightness information acquisition unit that acquires brightness information indicating brightness around the client based on the brightness-related information acquired by the brightness-related information acquisition unit And a correction unit that corrects the image converted by the image conversion unit according to the brightness information acquired by the brightness information acquisition unit, and a transmission unit that transmits the image corrected by the correction unit to the client. Provide a distribution system.

In the present invention, since the Web content converted into the image is corrected according to the brightness around the client, the visibility of the Web content by a color blind person or a healthy person can be improved.

Schematic configuration diagram of content distribution system Figure showing an example of an image file The figure which shows an example of the group N1 of the color information graphed regarding this image, and the node connected by the link Flow chart of content distribution processing Diagram showing a state where a line of a predetermined color is inserted at the boundary of a color that is difficult to identify Graph showing color information after color insertion A figure showing a shaded pattern superimposed Graphical representation of color information after shading The figure which shows an example which correct | amended each hue of the group of the color information difficult to identify by shifting along the hue circle Diagram showing an example of a color wheel The figure which illustrates a mode that each hue of a set of color information which is difficult to identify was converted into another corresponding hue and corrected according to a predetermined conversion table

<First Embodiment>
FIG. 1 shows a configuration of a content distribution system according to a preferred first embodiment of the present invention. This system includes an image server 2 and a client 3. The image server 2 is configured by a computer (information processing device) including an arithmetic device (CPU), a storage device, an input / output circuit, and the like.

Specifically, the image server 2 includes a Web content acquisition unit 21, an image conversion unit 22, a color information analysis unit 23, a color information correction unit 24, a lightness correction unit 25, a Web content distribution unit 27, a luminance information management DB 28, An inside / outside prediction unit 29 is provided. The image conversion unit 22, the color information analysis unit 23, the color information correction unit 24, the brightness correction unit 25, and the indoor / outdoor prediction unit 29 are collectively referred to as a correction unit 200.

The control unit 26 is composed of a CPU and the like, and performs overall control of each unit in response to a request for Web content from the client 3. The brightness information management DB 28 is configured by a storage device such as a hard disk or a memory, and stores information necessary for processing such as various variables such as brightness thresholds and programs.

The Web content acquisition unit 21 is connected to one or more Web servers 1 via a network, and in response to a request for content from the client 3, HTML, CSS, Java (registered trademark) script, image, video The web content configured by the above is requested, and the transmitted web content is acquired. The Web content that can be requested from the client 3 may be anything as long as it can be transmitted from the Web server 1. The content request is made by specifying a URL.

The image conversion unit 22 converts (renders) the Web content into an image file. This image file conforms to a format (JPEG or the like) that can be browsed by the client 3. Various known techniques can be adopted as the image conversion method.

The color information analysis unit 23 is composed of an image analysis engine or the like, analyzes image information of Web content, and acquires color information such as color and brightness. The color information is graphed by connecting the colors constituting the object (subject) in the image and the ratio of each color by “nodes” and adjacent objects by “links”. FIG. 2 is an example of an image file I, and FIG. 3 is an example of a set N1 of color information graphed with respect to the image and a node connected by a link.

The color information correction unit 24 and the lightness correction unit 25 are configured by a CPU or the like. These perform various image corrections such as hue correction, lightness correction, saturation correction, graphic replacement and superposition on the Web content itself acquired by the Web content acquisition unit 21 or video information of the Web content, and Web The data is output to the content distribution unit 27. Image correction by the color information correction unit 24 and the lightness correction unit 25 may be performed either alone or in combination.

The Web content distribution unit 27 transmits the Web content corrected by the color information correction unit 24 and the brightness correction unit 25 to the client 3 connected via the network.

The client 3 is an information terminal including display means capable of reproducing an image, communication means, arithmetic device (CPU), storage device, input / output circuit, operation means, imaging device, and the like. For example, the client 3 is a smartphone or a tablet computer. Composed. Note that the client 3 accessing the image server 2 may be an unspecified number. Specifically, the client 3 includes a control unit 31, a luminance detection unit 32, a browsing unit, and a position information acquisition unit 34. The control unit 31 and the luminance detection unit 32 are configured by an information processing device such as a CPU, and the browsing unit 33 includes display means and video generation means for the display means. The position information acquisition unit 34 is configured by a GPS receiver or the like.

FIG. 4 is a flowchart of content distribution processing executed by the content distribution system. A program for executing this processing is stored in a non-transitory computer-readable storage medium such as a memory of the image server 2 and the client 3, and is executed by each block of the Web server 1 and the client 3. Thereafter, the client 3 executes processes A1 to A10, and the image server executes processes B1 to B12.

In A1, the control unit 31 of the client 3 accepts a content acquisition request by specifying a URL from the user.

In A2, the control unit 31 of the client 3 requests the image server to transmit the content for which the request has been accepted.

In B1, the control unit 26 of the image server 2 requests the content requested from the client 3 to the Web server 1, and acquires the content transmitted from the Web server 1 in response to the request.

In B2, the image conversion unit 22 of the image server 2 converts the acquired content into an image file.

In A3, the control unit 31 of the client 3 proceeds to A4 in response to receiving the start of the brightness correction application activation from the user.

In A4, the control unit 31 of the client 3 controls the luminance detection unit 32 to periodically detect the luminance. For example, the luminance detection unit 32 acquires ambient luminance information with an imaging device such as a CCD camera or a CMOS camera at predetermined time intervals. The control unit 31 determines whether or not the luminance has changed by comparing the luminances acquired at different points in time. If the control unit 31 determines that the luminance has changed, the control unit 31 proceeds to A5.

In A5, the control unit 31 of the client 3 transmits luminance information to the image server 2. Note that image information including luminance and color difference may be sent from the client 3 to the image server 2 and the image server 2 may extract the luminance from the image information.

In B3, the control unit 26 of the image server 2 receives the luminance information from the client 3.

In B4, the control unit 26 of the image server 2 analyzes the color information of the converted image file.

In B5, the control unit 26 of the image server 2 determines whether or not color correction is necessary based on the analyzed color information. For example, the control unit 26 determines that color correction is necessary when a combination of color information between nodes connected by a link corresponds to a predefined combination of color information that is difficult to view. For example, in FIG. 3, the combination of color information that is difficult to visually recognize is green and red N1.

In B6, the color information correction unit 24 of the image server 2 performs correction of color information that facilitates visual recognition corresponding to a combination of color information that is difficult to visually recognize according to the received luminance information.

For example, in FIG. 5, for a set of green and red, a line of a predetermined color (white) is inserted at the boundary where green and red touch so that colors that are difficult to identify can be easily distinguished from each other. Yes. The thickness of this line is determined according to the luminance information. That is, the brighter the brightness information received from the client 3, the thicker the boundary line. FIG. 6 is a graph showing the color information after this color insertion.

In FIG. 7, for the group of green and red, a shaded pattern is superimposed on the green area. FIG. 8 is a graph showing the color information after the shading insertion. The strength of the halftone pattern (the line thickness of the stitch pattern, the size of the stitch pattern, the strength of the color of the stitch pattern, etc.) is determined according to the luminance information. For example, the brighter the luminance information from the client 3, the thicker the shaded line.

Alternatively, in FIG. 9, according to the hue circle, each hue of the set of color information that is difficult to identify is corrected by shifting along the hue circle. The amount of shift is determined according to the luminance information from the client 3. The shift direction may be counterclockwise or clockwise. FIG. 10 shows an example of a hue circle. Alternatively, in FIG. 11, according to a predetermined conversion table, each hue of a set of color information that is difficult to identify is converted and corrected to another corresponding hue. The conversion table defines the same content as the hue shift on the hue circle.

In B7, the control unit 26 of the image server 2 compares the received luminance information with the threshold value of the luminance information stored in the luminance information management DB 28, and determines whether or not the received luminance information exceeds the threshold value. Judging. If the luminance information exceeds the threshold value, it is determined that brightness (brightness) correction is necessary, and the process proceeds to B8. If the luminance information does not exceed the threshold value, it is determined that brightness correction is unnecessary and the process proceeds to B9.

In B8, the brightness correction unit 25 of the image server 2 performs correction to increase the brightness (brightness) of the image by a value corresponding to the change in luminance.

In A7, the position information acquisition unit 34 of the client 3 acquires the current position information.

In A8, the position information acquisition unit 34 of the client 3 transmits the acquired position information and the acquisition date and time to the image server 2. In some cases, the location information cannot be acquired because the client 3 is in the room. In this case, it is determined that the location is indoors, and information for substituting the location information is generated. 2 may be transmitted.

In B9, the indoor / outdoor prediction unit 29 of the image server 2 receives the position information of the client 3 and its acquisition date and time.

In B10, the indoor / outdoor prediction unit 29 of the image server 2 predicts the brightness around the client 3 based on the current position information of the client 3 and the acquisition date and time. For example, the indoor / outdoor prediction unit 29 receives the current position information of the client 3 and the weather corresponding to the acquisition time from the Web server 1 that provides the weather information, and sets the brightness corresponding to the weather to a predetermined table. Predict based on For example, the table stipulates that 10:00 am sunny outdoors = 120,000 lux, 10 am cloudy outdoors = 35,000 lux, 10:00 am sunny indoors = 200 lux, etc., and the location information of client 3 If the weather corresponding to “10 am outdoor” is “sunny”, the brightness is predicted to be “120,000 lux”.

The current position information of the client 3 may include the detection value of the gravity sensor in addition to the coordinate information on the ground surface. For example, if the display surface of the client 3 faces vertically upward, the indoor / outdoor prediction unit 29 adds a predetermined positive correction value to the brightness determined by the predetermined table, so that the display surface of the client 3 moves vertically downward. If it is suitable, a predetermined negative correction value is added to the brightness determined by the predetermined table. In this way, the brightness can be predicted according to the display position.

The brightness correction unit 25 of the image server 2 determines whether or not the predicted brightness has exceeded a predetermined threshold value. If Yes, it is determined that the brightness of the image needs to be corrected and proceeds to B11. If No, go to B12.

In B11, the brightness correction unit 25 of the image server 2 performs a correction for incrementing the luminance of the image by a value corresponding to the predicted brightness.

In B12, the Web content distribution unit 27 of the image server 2 transmits the Web content image whose brightness and color are corrected in B6, 8, and 11 to the client 3.

In A9, the control unit 31 of the client 3 receives an image.

In A10, the browsing unit 33 of the client 3 displays an image. In this image, colors and patterns are added to make it easy to distinguish combinations of colors that are difficult to see. Further, since this image is corrected so as to increase the brightness corresponding to the variation in the brightness of the place where the client 3 is used, when displayed on the browsing unit 33, it is easy to see even in a bright place. For this reason, according to various use conditions of the client 3, not only a color blind person but a healthy person can improve the visibility of a web content.

Second Embodiment
The determination of the necessity of color information / brightness correction and the image color information / brightness correction shown in the first embodiment may be executed by the client 3. This is realized by providing the client 3 with processing blocks related to the correction unit 200 of the image server 2. For example, in order to perform the processing of B8 on the client 3, the color information analysis unit 23, the color information correction unit 24, the brightness correction unit 25, and the luminance information management DB 28 may be provided in the client 3. In this case, the client 3 can correct itself an image received from the image server 2, an image stored in its own memory, an image captured by its own camera, or an image acquired from a portable medium or various networks. Even when the correction unit 200 is provided in the client 3, there may be a case where the position information cannot be acquired due to reasons such as being in the room. In this case, the position information is obtained by determining that the place is indoors. It can be replaced.

DESCRIPTION OF SYMBOLS 1 ... Web server, 2 ... Image server, 3 ... Client, 21 ... Web content acquisition part, 22 ... Image conversion part, 23 ... Color information analysis part, 24 ... Color information correction part, 25 ... Lightness correction part, 26 ... Control Part

Claims

A web content acquisition unit for acquiring web content;
An image conversion unit for converting the Web content acquired by the Web content acquisition unit into an image;
A brightness-related information acquisition unit that acquires brightness-related information from the client;
A brightness information acquisition unit that acquires brightness information indicating brightness around the client based on the brightness related information acquired by the brightness related information acquisition unit;
A correction unit that corrects the image converted by the image conversion unit in accordance with the brightness information acquired by the brightness information acquisition unit;
An imaging content correction apparatus comprising:
The brightness related information acquisition unit acquires position information of the client,
The imaging content correction apparatus according to claim 1, wherein the brightness information acquisition unit predicts brightness corresponding to the position information and acquires the predicted brightness as the brightness information.
The brightness related information acquisition unit acquires image information via an imaging device,
The imaging content correction apparatus according to claim 1, wherein the brightness information acquisition unit acquires luminance information as the brightness information from the image information acquired by the brightness related information acquisition unit.
4. The imaging content correction apparatus according to claim 1, wherein the correction unit corrects the brightness of the image converted by the image conversion unit in accordance with the brightness information acquired by the brightness information acquisition unit.
A determination unit that determines the presence or absence of a combination of colors that are difficult to identify from the image converted by the image conversion unit;
5. The correction unit according to claim 1, wherein the correction unit corrects color information of an image that is determined by the determination unit to have a color combination that is difficult to identify in accordance with brightness information acquired by the brightness information acquisition unit. The imaging content correction apparatus according to any one of the above.
The said correction | amendment part superimposes the halftone pattern of the intensity | strength according to the brightness information which the said brightness information acquisition part acquired in the area | region of one color of the combination of the said color which is difficult to identify. Imaging content correction device.
The imaging content according to claim 5, wherein the correction unit inserts a line having a thickness according to the brightness information acquired by the brightness information acquisition unit into a boundary region where the combination of colors that are difficult to identify is in contact. Correction device.
The color information correction unit shifts the hue of each of the difficult-to-identify color combinations by an amount according to the brightness information acquired by the brightness information acquisition unit along a hue circle. The imaging content correction apparatus described.
The imaging content correction apparatus according to claim 1, further comprising a transmission unit that transmits the image corrected by the correction unit to the client.
Information processing device
Obtaining web content;
Converting the acquired web content into an image;
Obtaining brightness-related information from the client;
Acquiring brightness information indicating brightness around the client based on the acquired brightness-related information;
Correcting the converted image according to the acquired brightness information;
An imaging content correction method for executing
A computer-readable recording medium on which an imaged content correction program for causing an information processing apparatus to execute the imaged content correction method according to claim 10 is recorded.
A client to notify brightness related information,
A web content acquisition unit for acquiring the web content requested by the client;
An image conversion unit for converting the Web content acquired by the Web content acquisition unit into an image;
A brightness-related information acquisition unit that acquires brightness-related information from the client;
A brightness information acquisition unit that acquires brightness information indicating brightness around the client based on the brightness related information acquired by the brightness related information acquisition unit;
A correction unit that corrects the image converted by the image conversion unit in accordance with the brightness information acquired by the brightness information acquisition unit;
A transmission unit that transmits the image corrected by the correction unit to the client;
An imaged content distribution system comprising: