JP2009290254A - Image forming device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image forming device that allows free and easy change of a UI screen (a user interface screen) and improves the accuracy of extraction of a part additionally written onto the UI screen. <P>SOLUTION: The image forming device 1 includes a UI display section 2 for displaying a predetermined image; an additionally written part extracting section 16 for extracting a part additionally hand-written onto a UI display image 19 displayed on the UI display section 2; an additionally written image and UI display image correlating section 17 for generating additionally written image and UI display image correlation information 21, and correlating an additionally written image 20 extracted by the additionally written part extracting section 16 with the UI display image 19; a storage section 4 for separately storing the additionally written image 20 and the UI display image 19, correlated by the additionally written image and UI display image correlating section 17; and an image superimposing section 18 for superimposing the additionally written image 20 on the UI display image 19 stored in the storage section 4, based on the additionally written image and UI display image correlation information 21 and displaying the superimposed images on the UI display section 2. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image forming apparatus and a program.

  2. Description of the Related Art Conventionally, an image forming apparatus such as a copier, a printer, a scanner, a facsimile, and a multifunction machine including these includes a display screen having a touch panel function. The image forming device has a display screen that matches the local language at the time of shipment from the factory, and the display screen language only supports the languages of major countries. There is a problem that can not be. Moreover, the operation | work which changes a display content is an operation | work which requires special knowledge and takes time.

  In such a background, a technique in which a user easily changes display contents is disclosed (for example, Patent Documents 1 and 2). In the invention described in Patent Document 1, a document describing a layout of operation keys that a user thinks is read by an image reading unit, the read image is analyzed, layout information is displayed, and a function is provided for each operation key. It is a technique of assigning. As a result, the display content desired by the user can be changed.

On the other hand, the invention described in Patent Document 2 is a program for extracting annotation data written in handout material. When the user instructs printing of the distributed material, the distributed material is printed with a file ID. At this time, the printing image data is stored in the document storage with a file ID. When the user writes an annotation on the distribution material and reads it with the scanner, the file ID of the input image data is detected, and print image data is acquired from the document storage based on the file ID. Annotation data is extracted from the difference image data between the printing image data and the input image data. The annotation data is combined with the original print image data and displayed. As a result, electronic handwritten annotations can be easily shared.
JP 2004-7579 A Japanese Patent Laid-Open No. 5-263558

  However, there is a demand not only to change the layout of the operation keys (blocking areas) but also to easily change the language (characters) of the display screen as described above. Further, there is a demand for a customization function that allows only necessary portions to be easily changed, instead of selecting a function from an enormous number of menu lists and assigning the function to all closed areas.

  In addition, since the method of extracting the postscript part by extracting the difference between the image data for printing and the input image data is extraction of the difference between images, the extraction accuracy of the postscript part is lowered in the case of a high-definition image such as a photograph. There is a problem such as.

  In view of such a background, the present invention provides a technique that can freely and easily change a display screen in an image forming apparatus and improve the extraction accuracy of a portion added to the display screen. Objective.

  The invention according to claim 1 is a display unit that displays a predetermined image, an additional recording part extraction unit that extracts a part that is added by handwriting to the display image displayed on the display unit, and the additional recording part extraction An association unit that generates association information that associates the additional image extracted by the unit and the display image, a storage unit that individually stores the additional image and the display image associated by the association unit, An image forming apparatus comprising: an image superimposing unit that superimposes the additional image on the display image stored in the storage unit based on the related information and displays the superimposed image on the display unit.

  The invention according to claim 2 is the invention according to claim 1, wherein a printing unit that prints the display image, and a reading unit that reads an image added by hand to the display image printed by the printing unit. The additional recording part extraction unit extracts the additional part by subtracting the image read by the reading unit from the display image printed by the printing unit.

  The invention according to claim 3 is the invention according to claim 1, further comprising: an additional writing input unit for performing additional writing by handwriting on the screen displayed on the display unit, wherein the additional writing part extraction unit is configured to input the additional writing. The added part is extracted by making a difference between the image input by the unit and the display image.

  The invention according to claim 4 is the invention according to claim 3, wherein the additional writing input unit is configured by a touch panel and a touch pen.

  The invention according to claim 5 is the invention according to claim 2, further comprising: a recordable area generating unit that generates a recordable area by deleting or filling a specific area in the display image, and the printing unit Is characterized in that a display image in which a recordable area is generated is printed.

  The invention according to claim 6 is the invention according to claim 5, wherein the additional recordable area generating unit generates an additional recordable area by deleting or filling out characters in the display image. .

  According to a seventh aspect of the present invention, in the second aspect of the present invention, the print color of the display image is selected when printing by the printing unit.

  The invention described in claim 8 is characterized in that, in the invention described in claim 2, the print magnification of the display image is selected at the time of printing by the printing unit.

  The invention according to claim 9 is configured to select a reading magnification when the image read by the reading unit is different from the size of the display image in the invention according to claim 2. It is characterized by.

  A tenth aspect of the invention is characterized in that, in the first aspect of the invention, the related information includes information in which an ID of the additional image and an ID of the display image are associated with each other.

  The invention according to claim 11 is a program executed by the image forming apparatus having the configuration according to claim 1, wherein the display step displays a predetermined image, and the display image displayed by the display step is displayed. An additional recording part extracting step for extracting a part additionally recorded, an associating step for generating related information associating the additional recording image extracted by the additional recording part extracting step with the display image, and an association step. And storing the additional image and the display image separately, and overlaying the additional image on the display image stored in the storage step based on the related information and displaying the superimposed image on the display unit. This is a program for executing an image superposition step.

  According to the invention described in claim 1, since the display image is added by handwriting, there is no restriction on the shape and language, and it can be freely described and the display contents can be easily changed. . Further, since the additional image and the original display image are stored separately in the storage unit, the original display contents and functions are not changed at all. Therefore, the original display image can be restored to the display unit at any time by hiding the additional image.

  According to the second aspect of the present invention, since the printed display image is added by handwriting, there is no limitation on the shape and language, and it can be freely described, and only the added image is read. The display content can be changed. Further, since the additional recording part is extracted by making a difference between the read image and the printed display image, the extraction accuracy of the additional recording part is improved.

  According to the invention described in claim 3, since the additional writing is performed by handwriting on the screen displayed on the display unit, the display content can be changed more easily. Further, the reading unit can be omitted.

  According to the fourth aspect of the present invention, since the additional writing is performed on the screen of the display unit using the touch pen, the display content can be changed more easily.

  According to the fifth aspect of the present invention, only the necessary part can be changed by generating the additionally recordable area in the display image. In addition, since the additionally writable area is generated by deletion or filling, even if the display image is a high-definition image such as a photograph, the additional write portion can be extracted with high accuracy.

  According to the sixth aspect of the present invention, the additionally writable area is generated by deleting or filling out the characters in the display image, so that the characters in the display image can be easily changed.

  According to the seventh aspect of the present invention, the print color of the display image is selected from gray scale, colorless, light color, and the like. By selecting the print color, even if the display image is a high-definition image such as a photograph, the accuracy of extracting the additional writing portion is improved.

  According to the invention described in claim 8, the display size reflected on the display unit can be changed by selecting the print magnification of the display image.

  According to the ninth aspect of the present invention, when the read image is different from the size of the display image, the display size reflected on the display unit can be changed by selecting the reading magnification.

  According to the invention described in claim 10, since the additional image and the display image can be stored separately in the storage unit, the original display image can be restored to the display unit at any time by hiding the additional image. Can be made.

  According to the eleventh aspect of the present invention, since the display image is handwritten to the display image, there is no restriction on the shape and language, and it can be freely described and the display contents can be easily changed. . Further, since the additional image and the original display image are stored separately in the storage unit, the original display contents and functions are not changed at all. For this reason, the original display image can be restored to the display unit at any time.

1. First Embodiment Hereinafter, an example of an image forming apparatus capable of changing characters in a UI screen (user interface screen) will be described.

(Configuration of image forming apparatus)
FIG. 1 is a block diagram of an image forming apparatus according to the first embodiment. The image forming apparatus 1 includes a UI display unit 2, a control unit 3, a storage unit 4, a printer 5, and a scanner 6. The image forming apparatus 1 has a function of changing characters such as a title name, a button name, and a caption name on the UI screen. For example, the English notation of the “Copy” button shown in FIG. It can be changed to notation.

  The UI display unit 2 is a display screen having a touch panel function, for example. An operation screen for customizing the UI screen displayed on the UI display unit 2 is shown in FIG. FIG. 2 shows a UI print screen (A) for instructing printing of a UI screen, and a UI scan screen (B) for instructing reading of an image added to the printed UI screen. The user first prints a UI screen from the printer 5 by operating the UI print screen 7. Then, after the additional writing is performed on the printed UI screen, the scanner 6 is caused to read the added image by operating the UI scan screen 8. By this operation, the added content is reflected on the UI screen.

  The UI print screen 7 selects a print color selection unit 9 for selecting the print color of the UI screen, a print magnification selection unit 10 for selecting the print magnification of the UI screen, and whether or not to delete characters on the UI screen. A character deletion selection unit 11 and a UI screen print button 12 are provided. The print color selection unit 9 includes a drop-down menu, and for example, gray scale, colorless, or light color can be selected. The print magnification selection unit 10 is also configured with a drop-down menu. For example, the print magnification can be selected between 50% and 200% (enlargement, equal magnification, reduction). The character deletion selection unit 11 is composed of check boxes, and deletion of characters displayed on the UI screen can be selected depending on the presence or absence of a check. The UI screen print button 12 is a button for instructing printing.

  The UI scan screen 8 includes a reading magnification selection unit 13 that selects a reading magnification of a UI screen that has been added, and a UI screen scan button 14. The reading magnification selection unit 13 can select a magnification to be reflected on the UI screen when the reading size is different from the UI screen size. For example, the reading magnification can be selected between 50% and 200% (enlargement, equal magnification, reduction). An item that automatically fits the reading size to the UI screen size may be selectable.

  The control unit 3 is composed of a semiconductor integrated circuit, and reads and executes a program stored in the storage unit 4. The program includes a recordable area generating unit 15, a recordable part extracting unit 16, a recordable / UI association unit 17, and an image superimposing unit 18. In addition to this program, the storage unit 4 stores a UI display image 19, a postscript image 20, and a postscript / UI related information 21.

  When the character deletion selection unit 11 on the UI print screen 7 shown in FIG. 2 is checked, the additionally recordable area generation unit 15 generates the additional recordable area 22 by deleting or filling the characters in the UI display image 19. For example, by deleting the characters of the “Copy” button and the “Scan” button shown in FIG. 1, the additionally recordable area 22 shown in FIG. 1 is generated. The additionally recordable area 22 may be generated by deleting or filling a specific area (blocking area such as an operation button) in the UI display image 19. The UI display image 19 ′ in which the additionally recordable area 22 is generated is printed from the printer 5 based on the settings of the print color selection unit 9 and the print magnification selection unit 10 on the UI print screen 7 shown in FIG.

  For example, the user manually writes “copy” in the additionally recordable area 22 and operates the UI scan screen 8 shown in FIG. 2 to cause the scanner 6 to read the additionally recorded image. At this time, if the size of the read image 23 read is different from the UI screen size, the reading magnification selection unit 13 of the UI scan screen 8 shown in FIG. 2 can be selected, and the user selects the reading magnification. .

  The additional recording portion extraction unit 16 extracts the additional recording image 20 by subtracting the UI display image 19 ′ in which the additional recording possible region 22 is generated and the read image 23 read by the scanner 6. The postscript image 20 is stored in the storage unit 4.

  The additional recording / UI association unit 17 generates related information between the additional recording image 20 and the UI display image 19. The postscript / UI related information 21 includes a table. FIG. 3 is a diagram showing postscript / UI related information. A UI screen ID is assigned to the UI display image 19, and an additional recording ID is assigned to the additional recording image 20. Further, the postscript / UI related information 21 can associate a plurality of postscript images 20 with one UI display image 19. Further, the postscript / UI related information 21 stores the number of postscripts representing the number of postscript images 20 associated with one UI display image 19.

  Based on the postscript / UI related information 21, the image superimposing unit 18 superimposes the postscript image 20 on the UI display image 19 and causes the UI display unit 2 to display it. As a result, the UI display image 19 displayed on the UI display unit 2 is changed to the superimposed image 24.

(Operation of image forming apparatus)
FIG. 4 is a flowchart (A) and (B) of a program for customizing the UI screen. The flowchart includes a print time (A) for printing the UI screen and a scan time (B) for reading the added UI screen. The program for executing this flowchart can be provided by being stored in a storage medium such as a CDROM.

  Hereinafter, a flow when printing a UI screen will be described. Predetermined settings are made on the UI print screen 7 shown in FIG. 2, and printing is instructed by operating the UI screen print button 12 (step S1). When the character deletion selection unit 11 on the UI print screen 7 is selected (YES in step S2), the additional recordable area generation unit 15 adds the information to the UI display image 19 by deleting the characters in the UI screen. A possible area 22 is generated (step S3). On the other hand, when the character deletion selection unit 11 is not selected (NO in step S2), the additionally recordable area 22 is not generated in the UI display image 19.

  If the print magnification selection unit 10 on the UI print screen 7 in FIG. 2 is set, the UI display image 19 is enlarged or reduced (step S4). If the print color selection unit 9 on the UI print screen 7 in FIG. 2 is set, the UI display image 19 is changed to the set print color (step S5). Then, the UI display image 19 is printed by the printer 5 (step S6).

  Next, a flow when scanning the UI screen will be described. By operating the UI screen scan button 14 on the UI scan screen 8 shown in FIG. 2, scanning is instructed (step S7). When the size of the read image 23 is larger than the UI screen size (YES in step S8), the magnification to be reflected on the UI screen is selected by operating the reading magnification selection unit 13 of the UI scan screen 8 shown in FIG. (Step S9). When the size of the read image 23 is smaller than the UI screen size (YES in step S8), the magnification to be reflected on the UI screen is selected by operating the reading magnification selection unit 13 of the UI scan screen 8 shown in FIG. (Step S9). When the size of the read image 23 is equal to the UI screen size (NO in step S8), the read image 23 is read at the same magnification.

  Then, by adding the difference between the read image 23 and the UI display image 19 ′, a postscript portion is extracted (step S 10), and a postscript image 20 is generated (step S 11). The generated additional recording image 20 and the UI display image 19 are stored in association with each other (step S12). Based on the additional recording / UI related information 21, the additional recording image 20 is superimposed on the UI display image 19, and the superimposed image 24 is displayed. Is displayed on the UI display unit 2 (step S13).

(Advantages of the first embodiment)
Hereinafter, the superiority of the first embodiment will be described. According to the first embodiment, the characters displayed on the UI display unit 2 can be easily changed. In other words, since the UI display image 19 is additionally written by handwriting, there is no restriction on the shape and language, and it can be freely described, and the characters can be changed simply by reading the added medium. it can.

  Further, since the postscript image 20 and the original UI display image 19 are separately stored in the storage unit 4, the original display contents and functions are not changed at all. For this reason, the original UI display image 19 can be restored to the UI display unit 2 at any time by hiding the postscript image 20.

  Further, since the “copy” character that is the additional recording portion is extracted by subtracting the read image 23 from the UI display image 19 ′, the extraction accuracy of the additional recording portion is improved. Furthermore, only the necessary part can be changed by generating the additionally recordable area 22 in the UI display image 19. Further, since the additionally recordable area 22 is generated by deletion or filling, even if the UI display image 19 is a high-definition image such as a photograph, it is possible to accurately extract the “copy” that is the additionally recordable portion. it can.

  Further, the printing color of the UI display image 19 is configured to be selected from gray scale, colorless, light color, and the like. By selecting the print color, even if the UI display image 19 is a high-definition image such as a photograph, the extraction accuracy of the “copy” character that is the additional writing portion is improved.

  In addition, the display size to be reflected on the UI display unit 2 can be changed by selecting the print magnification of the UI display image 19. When the read image 23 is different from the size of the UI display image 19, the display size reflected on the UI display unit 2 can be changed by selecting the read magnification of the read image 23.

  Moreover, since the additional recording image 20 and the UI display image 19 can be separately stored in the storage unit 4 by the additional recording / UI related information 21, the original UI display image 19 can be displayed by hiding the additional recording image 20. Can be restored to the UI display unit 2 at any time.

2. Second Embodiment Hereinafter, an example of an image forming apparatus capable of adding a note (annotation) to a UI screen will be described.

  FIG. 5 is a block diagram of an image forming apparatus according to the second embodiment. The image forming apparatus 25 is configured not to include the additionally recordable area generating unit 15 shown in FIG. Other configurations are the same as those of the image forming apparatus 1 shown in FIG. The image forming apparatus 25 has a function of adding annotations and the like to the UI screen. Hereinafter, the operation of the image forming apparatus 25 will be described with reference to the flowchart of FIG.

  Since the image forming apparatus 25 is configured not to include the additional recordable area generating unit 15, Step S2 and Step S3 are excluded from the flowchart when the UI screen is printed. That is, the additional displayable area 22 is not generated for the UI display image 19, and only the print magnification selection (step S4) and the print color selection (step S5) are executed and then printed (step S6). ). For example, the user adds annotations “x” and “unusable” to the “Copy” button shown in FIG. 5 by hand, and causes the scanner 6 to read the read image 23.

  When scanning the UI screen, if the size of the read image 23 is different from the UI screen size (YES in step S8), the UI screen is operated by operating the reading magnification selection unit 13 of the UI scan screen 8 shown in FIG. Is selected (step S9). When the size of the read image 23 is equal to the UI screen size (NO in step S8), the read image 23 is read at the same magnification.

  Then, by adding the difference between the read image 23 and the UI display image 19, annotations “X mark” and “unusable” which are additional writing portions are extracted (step S 10), and the additional writing image 20 is generated (step S 11). ). The generated additional image 20 and the UI display image 19 are associated with each other and stored in the storage unit 4 (step S12), and the additional image 20 is superimposed on the UI display image 19 based on the additional recording / UI related information 21. The image 24 thus displayed is displayed on the UI display unit 2 (step S13).

(Advantage of the second embodiment)
According to the second embodiment, annotations can be easily added to the UI screen. In addition, the structure which does not provide the additionally recordable area | region production | generation part 15 shown in FIG. 1 is applicable.

3. Third Embodiment Hereinafter, an example of an image forming apparatus capable of adding a note (annotation) on a UI screen will be described.

  FIG. 6 is a block diagram of an image forming apparatus according to the third embodiment. The image forming apparatus 26 does not include the printer 5, the scanner 6, and the additionally recordable area generation unit 15 shown in FIG. Further, the image forming apparatus 26 includes a UI additional recording input unit 27, and other configurations are the same as those of the image forming apparatus 1 shown in FIG. The UI additional recording input unit 27 includes a touch panel and a touch pen that can be directly added on the UI screen displayed on the UI display unit 2. For example, the user adds annotations “X” and “unusable” to the “Copy” button shown in FIG. 6 using a touch pen.

  Hereinafter, the operation of the image forming apparatus 26 will be described with reference to the flowchart of FIG. FIG. 7 is a flowchart of a program for customizing the UI screen. The program for executing this flowchart can be provided by being stored in a storage medium such as a CDROM.

  When the UI screen additional recording mode is instructed (step S14), the user performs additional recording using the touch pen (step S15). The additional writing part extraction unit 16 extracts the additional writing part by subtracting the UI display image 19 from the additionally written read image 23 (step S16). Then, the postscript image 20 is generated (step S17). The postscript image 20 is stored in the storage unit 4 in association with the UI display image 19 (step S18). The additional image 20 is superimposed on the UI display image 19 by the image superimposing unit 18 and displayed on the UI display unit 2 (step S19).

(Advantage of the third embodiment)
According to the third embodiment, additional writing is performed using the touch pen on the UI screen, so that the display content can be easily changed. Note that the present invention can also be applied to a configuration in which the scanner 6 shown in FIG. 1 is not provided.

  The present invention can be used for an image forming apparatus such as a copier, a printer, a scanner, a facsimile machine, and a multifunction machine including these.

1 is a block diagram of an image forming apparatus according to a first embodiment. They are a UI print screen (A) for instructing printing of the UI screen, and a UI scan screen (B) for instructing reading of an image added to the printed UI screen. It is a figure which shows additional recording and UI related information. It is a flowchart (A) and (B) of the program which customizes UI screen. FIG. 6 is a block diagram of an image forming apparatus according to a second embodiment. FIG. 10 is a block diagram of an image forming apparatus according to a third embodiment. It is a flowchart of the program which customizes UI screen.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Image forming apparatus, 2 ... UI display part, 3 ... Control part, 4 ... Memory | storage part, 5 ... Printer, 6 ... Scanner, 7 ... UI print screen, 8 ... UI scan screen, 9 ... Print color selection part, 10 DESCRIPTION OF SYMBOLS ... Print magnification selection part, 11 ... Character deletion selection part, 12 ... UI screen print button, 13 ... Reading magnification selection part, 14 ... UI screen scan button, 15 ... Additional recordable area production | generation part, 16 ... Additional write part extraction part, 17 ... additional recording / UI association unit, 18 ... image superimposition unit, 19 ... UI display image, 20 ... additional recording image, 21 ... additional recording / UI related information, 22 ... additional recordable area, 23 ... read image, 24 ... superimposed image, 25 ... Image forming apparatus, 26... Image forming apparatus, 27.

Claims (11)

A display unit for displaying a predetermined image;
An additional writing part extraction unit that extracts a portion added by handwriting to the display image displayed on the display unit;
An associating unit that generates related information in which the additional image extracted by the additional recording part extracting unit and the display image are associated;
A storage unit for separately storing the additional image and the display image associated by the association unit;
An image forming apparatus comprising: an image superimposing unit that superimposes the additional image on the display image stored in the storage unit based on the related information and displays the superimposed image on the display unit. A printing unit for printing the display image;
A reading unit that reads an image that is added by hand to the display image printed by the printing unit,
2. The image according to claim 1, wherein the additional recording portion extraction unit extracts a portion that has been additionally recorded by subtracting an image read by the reading unit from a display image printed by the printing unit. Forming equipment. On the screen displayed on the display unit, with an additional writing input unit for additional writing by handwriting,
2. The image forming apparatus according to claim 1, wherein the additional recording part extraction unit extracts an additional recording part by subtracting the image input by the additional recording input unit from the display image.   The image forming apparatus according to claim 3, wherein the additional writing input unit includes a touch panel and a touch pen. A recordable area generating unit that generates a recordable area by deleting or filling a specific area in the display image,
The image forming apparatus according to claim 2, wherein the printing unit prints a display image in which the additional writable area is generated.   The image forming apparatus according to claim 5, wherein the additionally recordable area generation unit generates an additional recordable area by deleting or filling out characters in the display image.   The image forming apparatus according to claim 2, wherein a printing color of the display image is selected when printing is performed by the printing unit.   The image forming apparatus according to claim 2, wherein the image forming apparatus is configured to select a print magnification of the display image during printing by the printing unit.   The image forming apparatus according to claim 2, wherein when the image read by the reading unit is different from a size of the display image, a reading magnification is selected.   The image forming apparatus according to claim 1, wherein the related information includes information in which an ID of the additional image and an ID of the display image are associated with each other. A program for causing an image forming apparatus having the configuration according to claim 1 to execute,
A display step for displaying a predetermined image;
An additional writing part extraction step for extracting a portion added to the display image displayed by the display step;
An associating step for generating related information associating the additional image extracted by the additional portion extraction step with the display image;
A storage step of separately storing the additional image and the display image associated by the associating step;
A program for executing an image superposition step of superimposing the additional image on the display image stored in the storage step based on the related information and displaying the superimposed image on the display unit.

Images