JP4301774B2 - Image processing method and program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
  The present inventionImage processing method andProgramToIn detail,An image processing method for creating an image in which an emphasized portion is easily recognized by a user (user) as an output image of the document based on input document information instructed to output an image by emphasizing a predetermined portion of the document And a program for causing a computer to execute the image processing methodAbout.
[0002]
[Prior art]
The part of the document image that the title or writer wants to convey strongly to the reader may be emphasized by using a character size, color, or font that is different from the other parts, or by adding a symbol other than a character such as an underline. Many.
[0003]
As such a document emphasis method, for example, a technique has been proposed in which, for example, character information and color information are stored in pairs, and a writer can easily create a document that emphasizes a necessary part (specialty). (See Kaihei 9-120398, JP-A-10-240727, JP-A-11-219355, etc.). Japanese Patent Laid-Open No. 6-324659 describes a device for a color palette for easily displaying information emphasized by a writer using different colors. That is, these techniques are intentionally emphasized by the document writer.
[0004]
Conventionally, instead of intentionally performing emphasis processing by the writer, a method that automatically performs emphasis processing on the necessary part of the document can be determined by the reader, such as hiragana and katakana homomorphic characters. There has been proposed a method for displaying difficult characters by changing the font (see Japanese Examined Patent Publication No. 2-26256), and in a system such as a computer that reads a document, the color of the portion of the document being read is changed and displayed. A method has been proposed (see Japanese Patent Publication No. 9-265466).
[0005]
[Problems to be solved by the invention]
However, in the conventional technique, various methods for appropriately emphasizing a document have been proposed, but information for emphasis added by a writer (creator) or given as necessary is It is not always transmitted correctly to the reader (user) side. For example, even if the creator creates a document in which the emphasized portion is different from the normal text portion, if the user is color blind / color weak, the difference in color cannot be determined, and the emphasized portion is not Even if the author is an elderly person, even if the author creates a document in the Mincho style with the normal text part and the Gothic style in the emphasized part, it may be received in the same way as the text part. In some cases, it may not be possible to distinguish the minor differences between Mincho and Gothic, and improvements were needed to properly convey the emphasis to the reader.
[0006]
  Therefore,BookThe invention emphasizes and outputs a predetermined part of a document.When applying different emphasis methodsFor the userFor each user as a way to obtain a higher degree of emphasisEmphasize a specific part of a document with a determined emphasis methodApply processing to the output imageThat the document creator wants to emphasizeProfitSuitable for usersToErukoAndIt is aimed.
[0023]
[Means for Solving the Problems]
  Claim1'sinventionIsEmphasize certain parts of the documentimageOutputAn image processing method in an image processing apparatus that creates image data for output of a document based on document data instructed to generate each image for emphasis degree determination using a different emphasis method for each screen. A determination image display step for displaying on the display, and a response time measurement step for measuring each response time of the user who responds to each enhancement degree determination image displayed in the determination image display processing step with a correct visual recognition result, An enhancement method determination step for determining an enhancement method corresponding to the enhancement degree determination image that obtained the shortest measurement result in the response time measured in the response time measurement step as an execution method, and a determination in the enhancement method determination step An output image generation step of performing an emphasis process on the predetermined portion of the document by the generated method and generating image data for output of the document..
  The invention of claim 2 is an image processing method in an image processing apparatus for creating output image data of a document based on document data instructed to output an image by emphasizing a predetermined portion of the document, An image for determining the degree of emphasis is generated using different emphasis methods by dividing an area on the same screen, and an image for determining the degree of emphasis displayed in the determination image display step displayed on the display for determination A line-of-sight movement measuring step for measuring the movement state of the user's line of sight relative to the start of display, and analyzing the line-of-sight movement order with respect to each enhancement degree determination image from the line-of-sight movement state measured in the line-of-sight movement measuring step An enhancement method determining step of determining an enhancement method corresponding to the enhancement degree determination image that has obtained the highest enhancement degree among the obtained enhancement methods as an execution method, and the enhancement method determination process In performing emphasis processing by the determined method to the predetermined portion of the document, and having and an output image generating step of generating an output image data of the document.
  The invention of claim 3 is an image processing method in an image processing apparatus for creating output image data of a document based on document data instructed to output an image by emphasizing a predetermined portion of the document, An image for determining the degree of emphasis is generated using different emphasis methods by dividing an area on the same screen, and an image for determining the degree of emphasis displayed in the determination image display step displayed on the display for determination Emphasis by analyzing the gaze movement measuring step for measuring the movement state of the user's line of sight with respect to each of the images, and analyzing the gaze time for each enhancement degree determination image from the movement state of the line of sight measured in the gaze movement measurement step. An enhancement method determining step for determining the enhancement method corresponding to the enhancement degree determination image that has obtained the highest enhancement degree as the execution method, and the enhancement method determination step. Methods subjected to emphasis processing on the predetermined portion of the document by, and having and an output image generating step of generating an output image data of the document.
  According to a fourth aspect of the present invention, in the image processing method according to any one of the first to third aspects, the different emphasis method used for the emphasis degree determination image in the determination image display step is based on a difference in color. And
  According to a fifth aspect of the present invention, in the image processing method according to the fourth aspect, the enhancement degree determination image has the same elements other than the color used as the enhancement method.
  According to a sixth aspect of the present invention, in the image processing method according to any one of the first to third aspects, the different emphasis method used for the emphasis degree determination image in the determination image display step is based on a difference in character size. It is characterized by that.
  The invention according to claim 7 is the image processing method according to claim 6, wherein the enhancement degree determination image has the same elements other than the character size used as the enhancement method.
  The invention according to claim 8 is the image processing method according to any one of claims 1 to 3, wherein the different emphasis method used for the emphasis degree determination image in the determination image display step is a thickness of a character / line segment. It is characterized by the difference.
  According to a ninth aspect of the present invention, in the image processing method according to the eighth aspect, the enhancement degree determination image has the same elements other than the thickness of the character / line segment used as the enhancement method. .
  According to a tenth aspect of the present invention, in the image processing method according to any one of the first to third aspects, the different enhancement method used for the enhancement degree determination image in the determination image display processing step is based on a difference in font. Features.
  The invention according to claim 11 is the image processing method according to claim 10, wherein the enhancement degree determination image has the same elements other than the font used as the enhancement method.
  The invention of claim 12 is a program for causing a computer to perform each step of the image processing method according to any one of claims 1 to 11.
[0057]
DETAILED DESCRIPTION OF THE INVENTION
DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described in detail with reference to the accompanying drawings. The embodiments described below are preferred embodiments of the present invention, and thus various technically preferable limitations are given. However, the scope of the present invention is particularly limited in the following description. As long as there is no description which limits, it is not restricted to these aspects.
[0058]
  1 to 5 show the present invention.Image processingMethodNo. related to1 embodimentexplainFIG.
[0059]
  FIG.Apply emphasis processing to a predetermined part of the output image documentOf the present inventionImage processingDirectionLegalFirst embodimentImage processing apparatus according toIt is a principal part block block diagram.In the image processing described below, an emphasis process performed on a predetermined portion of an image document is a main part. Therefore, this image processing apparatus is referred to as a document emphasis apparatus 1.
[0060]
  In FIG. 1, a document enhancement apparatus 1 includes a determination image generation unit 2, a document input unit 3, an enhancement processing unit 4, an image display unit 5, a display 6, and the like.For executing the image processing process of FIG. 5 to be described laterBuilt by installing the program.
[0061]
The determination image generation unit 2 creates an image exemplified for the user and outputs the image to the image display unit 5. The image display unit 5 allows the user to see the image from the determination image generation unit 2. Display on the display 6. As the display 6, for example, a CRT (Cathode Ray Tube), an LCD (Liquid Crystal Display), or the like is used, and is driven by the image display unit 5 to display various images.
[0062]
The document input unit 3 inputs a document to be emphasized, and the enhancement processing unit 4 determines an enhancement method based on information from the determination image generation unit 2 and enhances the document input from the document input unit 4. The portion is emphasized by the determined emphasis method and displayed on the display 6 through the image display unit 5.
[0063]
  next,As shown in FIG.Document enhancement device 1The operation of will be described.First, the determination image creating unit 2 creates images of the same shape with different colors as determination images. For example, as shown in FIG. 2, when the color used for displaying the normal part is black and the candidate color used for displaying the emphasized part is red / green / blue, as shown in FIG. A plurality of green / blue colors of the same size are arranged on the example image. In addition, in order to eliminate the influence of the display position, an image in which the position and number of candidate color circles used for displaying the emphasized portion are changed is prepared as the determination image. In FIG. 2, the number of red / green / blue circles is 2 and 3 images, one for each color.ZIn addition, a total of 6 images are prepared, and the number of images is considerably reduced for the sake of clarity. However, in practice, the number of circles and the variety of positions are increased for more judgment. An image may be generated. In this way, it is possible to increase the color determination accuracy that the user feels easy to identify.
[0064]
The document emphasizing apparatus 1 gives the user a task of counting the number of red / green / blue in each determination image, and the red / green / blue becomes black as the task can be performed faster. It is judged that is emphasized.
[0065]
Therefore, the image display unit 5 sequentially displays the six images shown in FIG. 2 from the upper left to the lower right of the screen of the display 6.
[0066]
In parallel with the image display of the image display unit 5, the enhancement processing unit 4 measures the reaction time from when each image is displayed until the user responds to the number, and determines the color with the shortest average response time for each color. Determined as emphasized color. It is assumed that the response time of an image displaying a red circle is the shortest.
[0067]
Then, it is assumed that a document as shown in FIG. In the document shown in FIG. 3, a tag is given, and the document between the tag <emphasis> and the tag </ emphasis> is a portion that the creator of the document desires to highlight.
[0068]
When the display of the exemplary image (determination image) on the display 6 is completed, the image display unit 5 requests the enhancement processing unit 4 to perform the enhancement processing of the input document of FIG. 3 input from the document input unit 3. .
[0069]
The enhancement processing unit 4 generates document image data in which the emphasized portion is red for the document in FIG. 3 and sends the document image data to the image display unit 5. The image display unit 5 displays the received image on the display 6 as shown in FIG. In FIG. 4, the portion highlighted in red is indicated by “”, and actually, there is no “”, characters are displayed in red, and characters in other portions are displayed in black.
[0070]
The above processing will be described in detail based on the flowchart shown in FIG. 5. The document emphasizing apparatus 1 sets the color used for displaying the normal portion as shown in FIG. When the candidate color used for displaying the highlighted portion is red / green / blue, an image in which a plurality of circles of the same shape and the same size in black and red / green / blue are arranged on the example image is used for determination. Images are created as images (example images) (step S101), and the image display unit 5 sequentially displays the six example images from the upper left to the lower right of the screen of the display 6 (step S102).
[0071]
When the example image is displayed on the image display unit 5, the enhancement processing unit 4 displays each image in parallel with the image display on the display 6 by the image display unit 5 until the user responds to the number. The process of measuring the reaction time is performed for each example image (steps S102 and S103).
[0072]
When the document enhancement apparatus 1 completes the measurement of response time until the user answers the number of images for the six exemplary images, the document enhancement apparatus 1 calculates the average response time for each color (step S104), and has the shortest average response time for each color. The color is determined as the highlight color (step S105).
[0073]
When the document emphasizing apparatus 1 determines the emphasis color, the emphasis processing unit 4 performs the emphasis processing unit 4 on the document input from the document input unit 3, for example, with the tags <emphasis> and </ emphasis>. Processing for creating a display document image with the determined color as the highlighted color for the sandwiched portion (step S106), and displaying the display document image created by the enhancement processing unit 4 on the display 6 Are sequentially performed on the documents input from the document input unit 3, and a display document image with an emphasized portion as an emphasized color is created for all input documents, and the image display unit 5 displays the image on the display 6. Then, the process ends (step S107).
[0074]
As described above, the document emphasizing apparatus 1 according to the present embodiment sets, for each user, an emphasis method having a high emphasis level for the user when emphasizing and outputting a predetermined portion of the document. Thus, a predetermined portion of the document is emphasized by the determined emphasis method.
[0075]
Therefore, it is possible to emphasize the part that the document creator wants to emphasize in a form that is easy for the user of the document to understand the emphasis, and to appropriately convey the emphasis to the user.
[0076]
Further, the document enhancement apparatus 1 according to the present embodiment presents a determination image for determining the degree of enhancement to the user, gives a predetermined task to the determination image to the user, and The response to the task is analyzed, the degree of emphasis on the user is determined, and the emphasis method is set.
[0077]
Therefore, by analyzing the task given to the user, the visual characteristics of the user can be acquired more appropriately, and emphasis can be conveyed more appropriately to the user.
[0078]
Furthermore, the document enhancement apparatus 1 according to the present embodiment uses an image in which a predetermined image is drawn in a plurality of colors as the determination image.
[0079]
Therefore, when the visual characteristic with respect to the color of the user is acquired and emphasized by color, it is possible to acquire a color with a high emphasis level for the user, and it is possible to convey the emphasis more appropriately to the user.
[0080]
Further, the document enhancement apparatus 1 according to the present embodiment uses the determination image as a determination image with respect to image elements other than colors such as the size and shape of the image area of each color included in the determination image. An image that does not work is used.
[0081]
Therefore, it is possible to more appropriately acquire the visual characteristics for the user's color, and more appropriately acquire the color with a high degree of emphasis for the user when emphasizing by color. Can convey emphasis.
[0082]
In the above description, a circle having the same shape and the same size is used as the determination image. However, the image used for the determination image is not limited to the circle, and the visual characteristics of the user (user) are determined. Any shape can be used as long as it can be determined appropriately.
[0083]
  6 and 7 show the present invention.Image processingMethodNo. related to2 embodimentexplainFIG.
[0084]
  The present embodiment is the same as the document emphasizing apparatus of the first embodiment.Implemented by equipment configurationTherefore, in the description of the present embodiment, the reference numerals used in the description of the first embodiment will be used as they are.
[0085]
The document emphasizing apparatus 1 of the present embodiment highlights an emphasized portion of an input document with different colors / sizes / line thicknesses.
[0086]
Therefore, in the document emphasizing apparatus 1 of the present embodiment, the determination image generation unit 2 creates images having different colors / sizes / line thicknesses as determination images.
[0087]
Since the size of the image is limited by the size of the screen of the display 6, the determination screen is created with the largest size within the range where the input document can be displayed on the display screen of the display 6.
[0088]
Also, as the thickness of the line, if the line is too thick, the line segment between the characters is crushed and cannot be read as a character. Therefore, the thickest line within the range in which the input document can be appropriately displayed as a character on the display screen of the display 6. Now create a judgment screen.
[0089]
Then, the determination image generation unit 2 creates the following combination of determination images. That is, the determination image generation unit 2 displays a black circle and a red circle, a circle having the same size as the maximum character size, a circle having a size equivalent to the size of the character displaying the text, a circle with the thickest line, and the text. A judgment image of a combination of circles of thickness lines of characters to be displayed is created.
[0090]
Then, the determination-use image generation unit 2 generates an image obtained by changing the positions and numbers of circles having different colors / sizes / line thicknesses, for example, as shown in FIG. A total of six images are created as determination images, one for each of the number 2 and the number 3 images of the circles / circles of maximum thickness. In FIG. 6, in the upper left image and the lower right image, the circle of the portion described as red is a red circle.
[0091]
Similar to the processing shown in FIG. 5, the document enhancement device 1 uses the determination image creation unit 2 to change the color used for displaying the normal part as shown in FIG. The candidate circle used for displaying the emphasized portion is created as an image for determination by arranging a plurality of circles of red / maximum size / maximum thickness on the example image, and the image display unit 5 displays these six example images. The display 6 is sequentially displayed from the upper left to the lower right of the screen. When the image display unit 5 displays the exemplary images on the display 6, the enhancement processing unit 4 displays each image in parallel with the image display of the image display unit 5 until the user responds to the number. The process of measuring the reaction time is performed for each example image.
[0092]
When the document enhancement apparatus 1 completes the measurement of the response time until the user answers the number of six example images, the document enhancement device 1 calculates the average response time for each example image, and the average response time for each example image is the shortest. The example image is defined as an emphasized image.
[0093]
When the emphasized image is determined, the document emphasizing apparatus 1 sandwiches the document input from the document input unit 3 by the emphasis processing unit 4 between emphasized portions of the document, for example, tags <emphasis> and </ emphasis>. From the document input unit 3, the display document image is created by using the determined portion as the determined emphasized image, and the image display unit 5 displays the display document image created by the enhancement processing unit 4 on the display 6. When the input document is sequentially performed and a display document image with the emphasized portion as an emphasized image is created for all the input documents and the image display unit 5 displays the image on the display 6, the processing ends.
[0094]
For example, assuming that the response time of the image displaying the maximum size circle is the shortest, the emphasis processing unit 4 performs partial emphasis between the tags <emphasis> and </ emphasis> with respect to the document of FIG. Document image data having a maximum size is generated and sent to the image display unit 5. The image display unit 5 displays the received image on the display 6 as shown in FIG.
[0095]
  As described above, the document emphasizing apparatus 1 according to the present embodiment has a plurality of sizes as determination images.CircleIs used.
[0096]
Therefore, it is possible to acquire a visual characteristic with respect to the size of the user's character, and to acquire a size with a high degree of emphasis for the user when emphasizing with the size of the character. I can tell you.
[0097]
In addition, the document enhancement apparatus 1 according to the present embodiment does not affect the degree of enhancement for the user with respect to image elements other than the size such as the color and shape of characters included in the determination image as the determination image. The image is used.
[0098]
Therefore, it is possible to more appropriately acquire the visual characteristics with respect to the size of the user's character, and more appropriately acquire the size of the character having a high degree of emphasis for the user when emphasizing with the character size. Can be emphasized more appropriately by the user.
[0099]
Furthermore, the document emphasizing apparatus 1 according to the present embodiment uses an image including a plurality of thick line segments or a plurality of thick line characters as the determination image.
[0100]
Therefore, it is possible to acquire a visual characteristic with respect to the thickness of the line of the user, and to acquire a line thickness with a high degree of emphasis for the user when emphasizing with the line thickness. Can convey emphasis.
[0101]
In addition, the document enhancement device 1 according to the present embodiment uses, as the determination image, image elements other than the line thickness such as the color, length, and shape of the line segment or character included in the determination image. An image that does not affect the degree of emphasis on the user is used.
[0102]
Therefore, it is possible to more appropriately acquire the visual characteristic with respect to the line thickness of the user, and more appropriately acquire the thickness of the line having a high degree of emphasis for the user when emphasizing with the line thickness. Can be emphasized more appropriately by the user.
[0103]
Furthermore, the document emphasizing apparatus 1 according to the present embodiment acquires user characteristics for information such as the color, size, and thickness of the determination image, and sets an emphasis method based on the user characteristics. Yes.
[0104]
Therefore, it is possible to comprehensively acquire the user's characteristics with respect to information such as color, size, thickness, etc., and more appropriately convey the emphasis to the user.
[0105]
  8 to 10 show the present invention.Image processingMethodNo. related to3 embodimentexplainFIG.
[0106]
  The present embodiment is the same as the document emphasizing apparatus of the first embodiment.Implemented by equipment configurationTherefore, in the description of the present embodiment, the reference numerals used in the description of the first embodiment will be used as they are.
[0107]
The document emphasizing apparatus 1 according to the present embodiment highlights an emphasized portion of an input document with different fonts.
[0108]
Therefore, in the document enhancement device 1 according to the present embodiment, the determination image generation unit 2 creates an image with a different font as a determination image.
[0109]
For example, when the body text other than the emphasized portion of the input document is written in the Century font, the emphasized portion is displayed in, for example, one of the fonts of the Courier / Impact / Tahoma font.
[0110]
The determination image generation unit 2 creates a determination image of the following combination. That is, the determination-use image generation unit 2 uses the same character “” in which the font is changed in one type of character, for example, an image drawn in a Century font that is the font of the text “A” as shown in FIG. For example, as shown in FIG. 8, the number of characters 2 and 3 of the characters “Courier / Impact / Tahoma” is one for each of the images in which the position and the number of “A” are changed. Is created as a judgment image.
[0111]
Then, in the same way as the processing shown in FIG. 5, the document emphasizing apparatus 1 uses the determination image creation unit 2 to change the character used for displaying the normal part as shown in FIG. The candidate character “A” to be used for display is set as Courier / Impact / Tahoma, and a plurality of arranged images are created as judgment images (example images). The image display unit 5 creates these six example images from the upper left to the right of the screen. The images are sequentially displayed on the display 6 below. When the example image is displayed on the display 6, the emphasis processing unit 4 performs the response from the display of each image until the user responds to the number in parallel with the image display on the display 6 by the image display unit 5. Processing for measuring time is performed for each example image.
[0112]
When the document enhancement apparatus 1 completes the measurement of the response time until the user answers the number of six example images, the document enhancement device 1 calculates the average response time for each example image, and the average response time for each example image is the shortest. The example image “A” is defined as an emphasized image.
[0113]
When the document emphasizing apparatus 1 determines an emphasized image, the emphasis processing unit 4 inputs from the document input unit 3 an emphasis portion of the document as shown in FIG. 9 with an <emphasis> tag and an </ emphasis> tag. For the document, a display document image in which the portion between the <emphasis> tag and the </ emphasis> tag of the input document is used as the determined emphasized image font is created, and the display created by the emphasis processing unit 4 is created. The processing for displaying the document image on the image display unit 5 is sequentially performed on the document input from the document input unit 3, and a display document image with the emphasized portion as an emphasized image is displayed for all input documents. When it is created and displayed on the display 6 by the image display unit 5, the process is terminated.
[0114]
For example, assuming that the response time of the image displayed in the Impact font is the shortest, the emphasis processing unit 4 has a partial emphasis portion sandwiched between tags <emphasis> and </ emphasis> with respect to the document of FIG. Is generated as an Impact font and sent to the image display unit 5. The image display unit 5 displays the received image on the display 6 as shown in FIG.
[0115]
As described above, the document enhancement device 1 according to the present embodiment uses an image including a plurality of font characters as the determination image.
[0116]
Therefore, it is possible to acquire the visual characteristics of the user's character font and emphasize the font with the character font, so that the user can acquire a font with a high degree of emphasis for the user, and more appropriately convey the emphasis to the user. it can.
[0117]
In addition, the document enhancement apparatus 1 according to the present embodiment does not affect the degree of emphasis on the user with respect to image elements other than fonts such as colors and sizes of characters included in the determination image as the determination image. Uses images.
[0118]
Therefore, it is possible to more appropriately obtain the visual characteristics of the user's character font, and more appropriately obtain a font having a high degree of emphasis for the user when emphasizing with the character font. I can convey the emphasis more appropriately.
[0119]
  11 to 13 show the present invention.Image processingMethodNo. related to4 embodimentexplainFIG.Apply emphasis processing to a predetermined part of the output image documentOf the present inventionImage processingDirectionLegalFourth embodimentImage processing apparatus according toIt is a principal part block block diagram.In the image processing described below, an emphasis process performed on a predetermined portion of an image document is a main part. Therefore, this image processing apparatus is referred to as a document emphasis apparatus 10.
[0120]
  The present embodiment is the same as the document emphasizing apparatus of the first embodiment.Implemented by equipment configurationIn the description of the present embodiment, the same components as those in the document emphasizing apparatus 1 of the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.
[0121]
The document emphasizing apparatus 10 according to the present embodiment is similar to the document emphasizing apparatus 1 according to the first embodiment. The determination image generating unit 2, the document input unit 3, the emphasizing processing unit 4, the image display unit 5, and the display 6. And the line-of-sight detection unit 11 and is constructed by installing a document enhancement processing program on a computer or the like.
[0122]
The line-of-sight detection unit 11 detects which position of the display 6 the user is looking at.
[0123]
In the document emphasizing apparatus 10 of the present embodiment, the determination image generation unit 2 creates images of the same shape with different colors as determination images. For example, when the candidate color used for displaying the emphasized portion of the document is red / green / blue, the determination image generation unit 2 displays a circle of the same size for each color combination as shown in FIG. Place two on top. At this time, in order to eliminate the influence of the display position, images with different arrangement positions are prepared, and a total of six images as shown in FIG. 12 are prepared. Of the images shown in FIG. 12, the upper row is an image for stabilizing the user's gazing point with respect to the determination image. In FIG. 12, the number of images is considerably reduced for easy understanding. However, in actuality, it is assumed that by increasing the variety of the positions of the circles and generating more determination images, the determination accuracy of the color that the user feels easy to identify is improved. Then, the image display unit 5 displays the determination image from the left to the right of the screen of the display 6.
[0124]
Then, as shown in FIG. 13, in the document emphasizing apparatus 10 of the present embodiment, when the determination image generation unit 2 generates an exemplary image that is the determination image (step S201), first, the upper black color is displayed. The image display unit 5 displays an exemplary image (determination image) on the display 6 (step S202).
[0125]
The user is asked to look at each determination image and pay attention to the black circle while the upper image in FIG. 12 is displayed.
[0126]
First, the image display unit 5 displays the upper left image in FIG. 12, and at the same time, the line-of-sight detection unit 11 measures which part of the screen the user is gazing at, so that the user can It is checked whether or not the black circle is being watched (step S203).
[0127]
Various methods can be used as a method for detecting the user's line of sight. For example, several methods have been proposed. For example, the method described in Japanese Patent No. 2505854 can be used. .
[0128]
When the line-of-sight detection unit 11 detects that the user is gazing at the black circle, the line-of-sight detection unit 11 sends a confirmation signal to the image display unit 5, and when the image display unit 5 receives the confirmation signal, the image in the lower part of FIG. It is displayed on the display 6 for only one second (step S204). Meanwhile, the line-of-sight detection unit 11 detects which position on the screen the user is looking at, measures the time during which each user is gazing, and notifies the enhancement processing unit 4 of the time. The document emphasizing apparatus 10 performs this process on each example image in FIG. 12 (steps S202 to S204), and when the process for all the example images is completed, notifies the enhancement processing unit 4 of the end of the process.
[0129]
When the enhancement processing unit 4 receives the notification of the end of the display processing of the determination image, it calculates the total gaze time for each color (step S205), and determines the color with the longest gaze time as the emphasized color (step S206).
[0130]
Then, as an input document, for example, when the same input document as in Example 1 of the first embodiment shown in FIG. 3 is input from the document input unit 3, a tag is given to this input document, Since the portion between <emphasis> and </ emphasis> is the portion that the document creator desires to highlight, the emphasis processing unit 4 determines the emphasis portion as the emphasis color for the input document image. Document image data having a color, for example, red is generated (step S207) and sent to the image display unit 5. The image display unit 5 displays the received enhanced document image on the display 6 as shown in FIG. 4, for example, and ends the processing (step S208).
[0131]
As described above, the document enhancement apparatus 10 according to the present embodiment presents a determination image for determining the degree of enhancement to the user, analyzes the movement of the user's line of sight with respect to the determination image, and enhances the image. The degree is determined and the emphasis method is set.
[0132]
Therefore, by analyzing the movement of the user's line of sight, the visual characteristics of the user can be acquired more appropriately, and emphasis can be transmitted more appropriately to the user.
[0133]
Further, the document enhancement device 10 of the present embodiment presents a determination image for determining the degree of enhancement to the user, acquires the movement of the user's line of sight relative to the determination image, and The degree of emphasis is determined based on the movement order, and the emphasis method is set.
[0134]
Therefore, by analyzing the order of movement of the user's line of sight, the user's visual characteristics can be acquired more appropriately, and emphasis can be conveyed more appropriately to the user.
[0135]
Furthermore, the document enhancement apparatus 10 according to the present embodiment presents a determination image for determining the degree of enhancement to the user, acquires the movement of the user's line of sight with respect to the determination image, and The degree of enhancement is determined based on the presence time (gazing time) on the determination image, and the enhancement method is set.
[0136]
Therefore, by analyzing the gaze time on the image for determining the user's line of sight, the user's visual characteristics can be acquired more appropriately, and the emphasis can be transmitted more appropriately to the user.
[0137]
In the description of the present embodiment, an image with a different color is used as the determination image to emphasize the difference in color. However, due to the difference in size, thickness, font, or the like. In the case of emphasis, the same can be applied. In this case, an image having a different size, line thickness, font, or the like is used as the determination image.
[0138]
The invention made by the present inventor has been specifically described based on the preferred embodiments. However, the present invention is not limited to the above, and various modifications can be made without departing from the scope of the invention. Needless to say.
[0139]
In each of the above-described embodiments, each part of the document emphasizing apparatuses 1 and 10 is distributed and arranged in terminal devices connected via a network, or a document to be emphasized is transmitted from a terminal device connected via a network via the network. For example, it may be constructed in a network environment.
[0140]
In this way, using the network environment, it is possible to appropriately emphasize and convey the portion that the document creator wants to emphasize to the user.
[0141]
【The invention's effect】
  According to the present invention, the responsiveness of the user who visually recognizes each emphasis determination image generated using different emphasis methods (color, character size, character / line thickness, font difference) for each screen. By determining the most effective emphasis method for each user (user) according to (response time, eye movement order, gaze time), and using the obtained emphasis method for the output image to the user, a predetermined part of the document is obtained. Optimize the enhancement level of output images that are instructed to be outputCan.
[Brief description of the drawings]
FIG. 1 is a block diagram of a main part of a document emphasizing apparatus to which a first embodiment of a document emphasizing method, a document emphasizing processing program, and a document emphasizing apparatus according to the present invention is applied.
2 is a diagram illustrating an example of a determination image (exemplary image) created by the determination image generation unit of FIG. 1 and displayed on a display by an image display unit;
3 is a diagram showing an example of an input document input from a document input unit of the document emphasizing apparatus in FIG. 1. FIG.
4 is a view showing an example of a document obtained by emphasizing an emphasized portion of the input document shown in FIG. 3 by the document enhancing apparatus shown in FIG. 1;
FIG. 5 is a flowchart showing document emphasis processing by the document emphasizing apparatus of FIG. 1;
FIG. 6 is a diagram illustrating an image generation unit for determination of a document enhancement apparatus to which a second embodiment of the document enhancement method, the document enhancement processing program, and the document enhancement apparatus according to the present invention is applied; The figure which shows an example of the image for determination (exemplary image)
7 is a view showing an example of a document obtained by emphasizing an emphasized portion of an input document by an emphasis method determined from the determination image in FIG. 6;
FIG. 8 is generated by a determination image generation unit of a document enhancement apparatus to which a third embodiment of the document enhancement method, document enhancement processing program, and document enhancement apparatus of the present invention is applied, and is displayed on a display by an image display unit; The figure which shows an example of the image for determination (exemplary image)
FIG. 9 is a diagram illustrating an example of an input document input from a document input unit of a document emphasizing apparatus to which a third embodiment of the document emphasizing method, document emphasizing processing program, and document emphasizing apparatus of the present invention is applied;
10 is a diagram showing an example of a document obtained by emphasizing an emphasized portion of the input document in FIG. 9 with an emphasized font determined from the determination image in FIG. 9;
FIG. 11 is a block diagram of a main part of a document emphasizing apparatus to which a fourth embodiment of the document emphasizing method, document emphasizing processing program, and document emphasizing apparatus of the present invention is applied.
12 is a diagram showing an example of a determination image (exemplary image) created by the determination image generation unit of FIG. 11 and displayed on the display by the image display unit.
13 is a flowchart showing document enhancement processing by the document enhancement apparatus of FIG.
[Explanation of symbols]
1 Document enhancement device
2 Image generator for determination
3 Document input part
4 Emphasis processing section
5 Image display section
6 Display
10 Document enhancement device
11 Gaze detection unit

Claims (12)

An image processing method in an image processing apparatus for generating output image data of a document based on document data instructed to output an image while emphasizing a predetermined part of the document,
A determination image display step of generating each enhancement degree determination image using a different enhancement method for each screen and displaying the image on a display;
A response time measuring step for measuring each response time of a user who responds with a correct visual recognition result to each image for enhancement degree determination displayed in the image display processing step for determination;
An enhancement method determination step of determining, as an execution method, an enhancement method corresponding to the enhancement degree determination image that obtained the shortest measurement result in the response time measured in the response time measurement step;
An output image generation step of performing enhancement processing on the predetermined portion of the document by the method determined in the enhancement method determination step, and generating output image data of the document;
An image processing method characterized by have a. An image processing method in an image processing apparatus for generating output image data of a document based on document data instructed to output an image while emphasizing a predetermined part of the document,
An image display step for determination that generates an image for determining each degree of enhancement using different enhancement methods by dividing an area on the same screen, and displays the image on a display.
A line-of-sight movement measuring step of measuring the movement state of the user's line of sight with respect to each image for enhancement degree determination displayed in the image display step for determination;
The degree of emphasis is obtained by analyzing the order of movement of the line of sight with respect to each image for emphasis degree determination from the movement state of the line of sight measured in the line-of-sight movement measurement step, and the degree of emphasis determination for obtaining the highest degree of emphasis obtained. An enhancement method determination step for determining an enhancement method corresponding to an image as an execution method;
An output image generation step of performing enhancement processing on the predetermined portion of the document by the method determined in the enhancement method determination step, and generating output image data of the document;
An image processing method characterized by have a. An image processing method in an image processing apparatus for generating output image data of a document based on document data instructed to output an image while emphasizing a predetermined part of the document,
An image display step for determination that generates an image for determining each degree of enhancement using different enhancement methods by dividing an area on the same screen, and displays the image on a display.
A line-of-sight movement measuring step of measuring the movement state of the user's line of sight with respect to each image for enhancement degree determination displayed in the image display step for determination;
The degree of emphasis is obtained by analyzing the gaze time for each image for emphasizing degree determination from the movement state of the line of sight measured in the line-of-sight movement measuring step, and the image for emphasizing degree determination that has obtained the highest degree of emphasis is obtained. An emphasis method determination step for determining a corresponding emphasis method as an execution method;
An output image generation step of performing enhancement processing on the predetermined portion of the document by the method determined in the enhancement method determination step, and generating output image data of the document;
An image processing method characterized by have a. The image processing method according to any one of claims 1 to 3,
The different emphasis methods used in enhancement degree determination image in the judgment image display step, an image processing method comprising Rukoto by the difference in color. The image processing method according to claim 4,
An image processing method characterized in that the enhancement degree determination image has the same elements other than colors used as an enhancement method. The image processing method according to any one of claims 1 to 3,
The different emphasis methods used in enhancement degree determination image in the judgment image display step, an image processing method and by said Rukoto the difference in size of characters. The image processing method according to claim 6.
The enhancement degree determination image, the image processing method comprising same to Rukoto elements other than the character size to be used as enhancement method. The image processing method according to any one of claims 1 to 3,
The different emphasis methods used in enhancement degree determination image in the judgment image display step, an image processing method and by said Rukoto the difference in the character-line thickness. The image processing method according to claim 8, wherein
The enhancement degree determination image, the image processing method comprising same to Rukoto elements other than the thickness of a character-line used as enhancement method. The image processing method according to any one of claims 1 to 3,
The different emphasis methods used in enhancement degree determination image in the judgment image display step, an image processing method comprising Rukoto by the difference in font. The image processing method according to claim 10,
The enhancement degree determination image, the image processing method comprising same to Rukoto elements other than the font used as enhancement method. The program for making a computer perform each process of the image processing method as described in any one of Claims 1 thru | or 11.

Images