JP2011204190A - Document-processing method and document-processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily obtain the contents of documents which are hard to see or is hard to read documents.SOLUTION: A scanner 11 converts documents of paper medium arranged by a receiver into digital data, and a pickup image generating part 17a generates a pickup image from the digital data. A division part 17b divides the pickup image into a plurality of regions, and a display control part 17c controls a display part 12 to display the pickup image. An optical sensor of the display part 12 specifies the position of visible light emitted from a remote controller 20 on the display part 12, and a specification part 17d specifies the position of the visible light specified by the optical sensor on the display part 12 and specifies a region corresponding to the acquired position from a plurality of regions divided by the division part 17b. An expanded image generating part 17e generates an expanded image obtained by expanding the region specified by the specification part 17d, and a display control part 17c controls the display part 12 to display the expanded image.

Description

  The present invention relates to a document processing method and a document processing system.

  2. Description of the Related Art Conventionally, an apparatus for supporting a person who has difficulty in viewing or reading a document due to factors such as a reduction in visual acuity due to aging has been developed.

  As such an apparatus, for example, an apparatus that enlarges a document to be read at a high magnification by an autofocus function is known (see, for example, Non-Patent Document 1).

“Enlarged reading device”, [online], [March 23, 2010 search], Internet <http://www.kougakudo.jp/newpage-6.html>

  By the way, for example, when reading a postcard, the reader sees the entire document and a certain part of the document alternately, such as looking at the entire document, reading a part of the document, or looking at a photo in the document. It is common to read or read. However, the prior art described above only expands the specific range specified by the reader. Therefore, the reader has to operate the above-described device so that the range to be viewed and the range to be read are expanded in the document to be read.

  That is, the above-described conventional technique has a problem that it is difficult to easily grasp the contents of a document that is difficult to see or read.

  Accordingly, the present invention has been made to solve the above-described problems of the prior art, and a document processing method and a document processing system capable of easily grasping the contents of a document that is difficult to see or read. The purpose is to provide.

  In order to solve the above-described problems and achieve the object, this method includes a shooting step for generating an image of a document placed by a user, and the image generated by the shooting step is divided into a plurality of regions. A dividing step, a display control step for controlling the image generated by the photographing step to be displayed on a predetermined display unit, and the image displayed on the predetermined display unit by the control of the display control step In the state, a detection step of detecting light transmitted from the optical transmission device to the predetermined display unit, a position of the light detected by the detection step is acquired, and an area corresponding to the acquired position is A specifying step for specifying from the plurality of regions divided by the dividing step, and an enlarged image in which the region specified by the specifying step is enlarged A large image generating step, the second display control step and the requirement that it contained be controlled so as to further display the enlarged image generated by the enlarged image generating step in the predetermined display unit.

  Further, this system is a document processing system including a document processing device that processes a document and an optical transmission device that transmits light, and the document processing device photographs a document placed by a user. An imaging unit that generates an image, a dividing unit that divides the image generated by the imaging unit into a plurality of regions, and a display that controls the image generated by the imaging unit to be displayed on a predetermined display unit Control means, and detection means for detecting light transmitted from the optical transmission device to the predetermined display section in a state where the image is displayed on the predetermined display section under the control of the display control means; A specifying unit that acquires the position of the light detected by the detecting unit, and specifies a region corresponding to the acquired position from the plurality of regions divided by the dividing unit; and the specifying unit Enlarged image generating means for generating an enlarged image obtained by enlarging the determined area, and second display control for controlling to further display the enlarged image generated by the enlarged image generating means on the predetermined display unit And means.

  According to the disclosed method and system, it is possible to easily grasp the contents of a document that is difficult to see or read.

FIG. 1 is a diagram for explaining the configuration of the document processing system according to the first embodiment. FIG. 2 is a diagram for explaining an example of the appearance of the remote control according to the first embodiment. FIG. 3 is a diagram for explaining an example of the appearance of the document processing apparatus according to the first embodiment. FIG. 4 is a diagram for explaining the configuration of the document processing apparatus according to the first embodiment. FIG. 5 is a diagram for explaining the dividing unit. FIG. 6 is a diagram for explaining an example of a captured image displayed by the display control unit. FIG. 7 is a diagram for explaining an example of visible light emitted from the recipient. FIG. 8 is a diagram for explaining the specifying unit. FIG. 9 is a diagram for explaining an example of an enlarged image displayed by the display control unit. FIG. 10 is a diagram for explaining processing of the enlarged image generation unit and the display control unit in response to an image processing instruction. FIG. 11 is a flowchart for explaining processing of the document processing apparatus according to the first embodiment. FIG. 12 is a diagram for explaining an example of the appearance of the remote control according to the second embodiment. FIG. 13 is a diagram for explaining the configuration of the document processing apparatus according to the second embodiment. FIG. 14 is a diagram for explaining determination processing by the audio output control unit. FIG. 15 is a diagram for explaining audio output processing by the audio output control unit. FIG. 16 is a diagram for explaining the display process of the display control unit accompanying the audio output process of the audio output control unit. FIG. 17 is a flowchart for explaining processing of the document processing apparatus according to the second embodiment.

  Exemplary embodiments of a document processing method and a document processing system according to the present invention will be described below in detail with reference to the accompanying drawings. In the following, a document processing system that executes the document processing method according to the present invention will be described as an embodiment.

  First, the configuration of the document processing system according to the first embodiment will be described with reference to FIG. FIG. 1 is a diagram for explaining the configuration of the document processing system according to the first embodiment.

  As shown in FIG. 1, the document processing system according to the first embodiment includes a document processing apparatus 10 that processes a paper medium document (for example, a postcard) sent by a sender, and a remote controller that transmits visible light. 20 and so on. Here, the document processing device 10 and the remote controller 20 shown in FIG. 1 are devices operated by a recipient who has received a paper medium document.

  FIG. 2 is a diagram for explaining an example of the appearance of the remote control according to the first embodiment. As shown in FIG. 2, the remote controller 20 has a visible light switch 21 for irradiating visible light from the irradiation port 22. The remote controller 20 irradiates visible light from the irradiation port 22 when the visible light switch 21 is pressed by the recipient. The remote controller 20 also has various buttons for instructing processing related to an image displayed on the document processing apparatus 10. Specifically, the remote controller 20 has an enlarge button 23 (“enlarge” shown in the figure), a reduce button 24 (“reduce” shown in the figure), and an erase button 25 (“delete” shown in the figure). The enlargement button 23, the reduction button 24, and the delete button 25 will be described in detail later.

  FIG. 3 is a diagram for explaining an example of the appearance of the document processing apparatus according to the first embodiment. As illustrated in FIG. 3, the document processing apparatus 10 includes a scanner 11, a display unit 12, a signal receiving unit 13, a speaker 14, and an input unit 15.

  The scanner 11 is used to generate a photographed image obtained by photographing a paper document arranged by a recipient, reads the document, and converts the read document into digital data.

  The display unit 12 is an optical sensor built-in display in which an optical sensor is incorporated. Specifically, the display unit 12 displays a captured image generated from the digital data converted by the scanner 11 using a display function. Moreover, the display part 12 detects the visible light irradiated from the remote control 20 with the built-in optical sensor.

  The signal receiving unit 13 receives various image processing instructions transmitted from the enlarge button 23, the reduce button 24, and the delete button 25.

  The speakers 14 are used for sound output, and are installed at two places on the front surface of the document processing apparatus 10 as shown in FIG. 3, for example.

  The input unit 15 includes various buttons for a recipient to turn on / off the document processing apparatus 10, start scanning with the scanner 11, and end processing with the document processing apparatus 10.

  Here, even if it is difficult for the recipient of the document to view or read the document because of old age, for example, it is difficult to see the document by using the document processing apparatus 10 and the remote controller 20 having such an appearance. Alternatively, it is possible to easily grasp the contents of a document that is difficult to read. Hereinafter, functions of the document processing apparatus 10 will be described in detail with reference to FIG.

  FIG. 4 is a diagram for explaining the configuration of the document processing apparatus according to the first embodiment. As illustrated in FIG. 4, the document processing apparatus 10 according to the first embodiment includes a storage unit 16 and a control unit 17 together with the scanner 11, the display unit 12, the signal reception unit 13, the speaker 14, and the input unit 15 described above. .

  The storage unit 16 stores various processing results obtained by the control unit 17, and includes an image storage unit 16a and a division result storage unit 16b as particularly related to the present embodiment, as shown in FIG.

  The image storage unit 16a stores processing results from a captured image generation unit 17a and a magnified image generation unit 17e to be described later, and a division result storage unit 16b stores processing results from a division unit 17b to be described later. Will be described in detail later.

  The control unit 17 executes various processes based on various information transferred from the scanner 11, the display unit 12, and the signal reception unit 13, and particularly as related to the present embodiment, the captured image generation unit 17 a and the division unit 17b, a display control unit 17c, a specifying unit 17d, an enlarged image generation unit 17e, and an instruction determination unit 17f.

  The captured image generation unit 17a generates an image (captured image) obtained by capturing a document from the digital data transferred from the scanner 11, and stores the generated captured image in the image storage unit 16a.

  The dividing unit 17b reads the captured image generated by the captured image generating unit 17a from the image storage unit 16a, and divides the read captured image into a plurality of regions. Here, a document such as a postcard can generally be divided into a plurality of areas according to the contents, such as a photograph, a text, and sender information (address, name, telephone number, etc.). The document can be divided into an area occupied by the background color of the document and an area occupied by a color tone different from the background color. That is, by specifying an area surrounded by the background color of the document, the document can be divided into a plurality of areas according to the contents described in the document.

  Therefore, the dividing unit 17b identifies the background color of the photographed image and identifies the region surrounded by the identified background color, thereby dividing the photographed image into a plurality of regions according to the contents depicted in the photographed image. To do. FIG. 5 is a diagram for explaining the dividing unit.

  For example, as shown in FIG. 5A, the document from which the photographed image is generated includes a “photograph” area, a “text 1” area, a “text 2” area, and “sender information”. ”And four regions.

  In such a case, the dividing unit 17b identifies the background color of the captured image, and identifies the region surrounded by the identified background color, thereby corresponding to the “photo” region, as shown in FIG. “Area A”, “Area B” corresponding to the “Body 1” area, “Area C” corresponding to the “Body 2” area, and “Area D” corresponding to the “Sender information” area And divide the captured image.

  Then, as illustrated in FIG. 5B, the dividing unit 17b stores the position information of the area A in the captured image as “position information A” in the division result storage unit 16b. Similarly, as illustrated in FIG. 5B, the dividing unit 17 b performs “position information B” that is position information of the region B in the captured image and “position information C” that is position information of the region C in the captured image. And “position information D”, which is position information of the region D in the captured image, are stored in the division result storage unit 16b.

  Note that the granularity of the dividing process by the dividing unit 17b can be arbitrarily changed according to the setting of the recipient. For example, when the division granularity is set coarsely by the division setting button of the input unit 15, the division unit 17b, as shown in (C) of FIG. 5, "area A" corresponding to the "photograph" area, The captured image is divided into “area B” corresponding to the areas of “text 1”, “text 2”, and “sender information”.

  Returning to FIG. 4, the display control unit 17 c performs control so that the captured image generated by the captured image generation unit 17 a is read from the image storage unit 16 a and the read captured image is displayed on the display unit 12. FIG. 6 is a diagram for explaining an example of a captured image displayed by the display control unit. For example, as shown in FIG. 6, the display control unit 17 c displays a captured image generated from the document described with reference to FIG. 5A at the center of the display unit 12.

  In a state where the photographed image is displayed by the control of the display control unit 17c, the recipient irradiates the visible light from the remote controller 20 toward an area that the photographer wants to enlarge and display. And the optical sensor of the display part 12 detects the visible light irradiated from the remote control, and pinpoints the position in the display part 12 of the detected visible light. FIG. 7 is a diagram for explaining an example of visible light emitted from the recipient.

  For example, as shown in FIG. 7, the recipient causes the remote controller 20 to irradiate visible light toward the text 1 in the captured image displayed on the display unit 12. And the optical sensor of the display part 12 detects the visible light irradiated from the remote control 20, and pinpoints the position in the display part 12 of the detected visible light.

  Returning to FIG. 4, the specifying unit 17 d acquires the position of the visible light in the display unit 12 specified by the optical sensor of the display unit 12, and a plurality of regions obtained by dividing the region corresponding to the acquired position by the dividing unit 17 b. Specify from the area. Specifically, the specifying unit 17d determines which position in the captured image the position irradiated with visible light is based on the position of visible light on the display unit 12 specified by the optical sensor and the display position on the display unit 12 of the captured image. Specify whether it corresponds to. And the specific | specification part 17d specifies the area | region corresponding to the position where visible light was irradiated with reference to the positional information on each area | region stored in the division | segmentation result memory | storage part 16b. FIG. 8 is a diagram for explaining the specifying unit. For example, as illustrated in FIG. 8, the specifying unit 17 d determines that the position of the visible light on the display unit 12 specified by the optical sensor of the display unit 12 is in a position corresponding to “position information B”, and is visible. It is specified that the light irradiation position corresponds to “region B” divided from the captured image by the dividing unit 17b.

  Returning to FIG. 4, the enlarged image generating unit 17e generates an enlarged image obtained by enlarging the area specified by the specifying unit 17d, and stores the generated enlarged image in the image storage unit 16a. Then, the display control unit 17c controls to read the enlarged image generated by the enlarged image generation unit 17e from the image storage unit 16a and display the read enlarged image on the display unit 12. FIG. 9 is a diagram for explaining an example of an enlarged image displayed by the display control unit.

  For example, the enlarged image generating unit 17e generates an enlarged image obtained by enlarging the region B specified by the specifying unit 17d, and the display control unit 17c displays the enlarged image of the region B on the display unit 12 as illustrated in FIG. Let As a result, the display unit 12 enlarges and displays the text 1 of the document as shown in FIG.

  Here, the display control unit 17c displays an enlarged image in front of the captured image in a state where the captured image is displayed on the display unit 12. For example, as shown in FIG. 9, the display control unit 17c performs control so that the enlarged image of the text 1 is displayed in front of the captured image obtained by capturing the entire document.

  In a state where the enlarged image is displayed in front of the photographed image under the control of the display control unit 17c, the recipient can transmit an image processing instruction for the enlarged image by operating various buttons of the remote controller 20. .

  For example, the recipient presses the enlarge button 23 to further enlarge the enlarged image. Further, the recipient presses the reduction button 24 when he wants to reduce the enlarged image. The recipient presses the delete button 25 when the user wants to delete the enlarged image and refer to the captured image again, or when he wants to delete the enlarged image and refer to another area in the captured image.

  When the recipient presses the enlarge button 23, the remote controller 20 transmits an instruction to enlarge the displayed enlarged image at a predetermined magnification. For example, the recipient continuously presses the enlarge button 23 until the displayed enlarged image is enlarged to a desired size. Further, when the recipient presses the reduction button 24, the remote controller 20 transmits an instruction to reduce the displayed enlarged image at a predetermined magnification. For example, the recipient continuously presses the reduction button 24 until the displayed enlarged image is reduced to a desired size.

  The image processing instruction signal transmitted from the remote controller 20 by such an operation is received by the signal receiving unit 13 shown in FIGS. 3 and 4, and the signal receiving unit 13 converts the received image processing instruction signal into the instruction shown in FIG. The data is transferred to the determination unit 17f.

  The instruction determination unit 17f determines the instruction content included in the image processing instruction signal transferred from the signal reception unit 13, and transfers the determination result to the enlarged image generation unit 17e and the display control unit 17c. FIG. 10 is a diagram for explaining processing of the enlarged image generation unit and the display control unit in response to an image processing instruction.

  For example, when the determination result is the enlargement process of the enlarged image, the instruction determination unit 17f transfers the enlargement rate to the enlarged image generation unit 17e, and the enlarged image generation unit 17e enlarges the enlarged image based on the transferred enlargement rate. Is further enlarged, and the generated enlarged image is newly stored in the image storage unit 16a. Then, the display control unit 17c reads out an enlarged image newly stored in the image storage unit 16a and causes the display unit 12 to display the enlarged image. For example, the display control unit 17c causes the display unit 12 to display an enlarged image in which the text 1 is further enlarged as illustrated in FIG.

  When the determination result is the enlargement image reduction process, the instruction determination unit 17f transfers the reduction rate to the enlargement image generation unit 17e, and the enlargement image generation unit 17e performs the enlargement image based on the transferred reduction rate. Is generated, and the generated reduced image is newly stored in the image storage unit 16a. Then, the display control unit 17c reads the reduced image newly stored in the image storage unit 16a and causes the display unit 12 to display the reduced image. For example, the display control unit 17c causes the display unit 12 to display a reduced image obtained by reducing the text 1 as illustrated in FIG.

  If the determination result is an enlarged image erasing process, the instruction determination unit 17f transfers an instruction to hide the enlarged image to the display control unit 17c, and the display control unit 17c removes the displayed enlarged image. Display. Then, the recipient operates the remote controller 20 to enlarge the photographed image, for example.

  The document processing described above ends when the processing end button of the input unit 15 is pressed by the recipient. In the present embodiment, for example, when the recipient moves the visible light irradiation position while pressing the visible light switch 21 while the visible light is irradiated from the remote controller 20 on the displayed enlarged image, the display control is performed. It is also possible to control the unit 17c to move the display position of the enlarged image.

  Subsequently, a processing procedure of the document processing apparatus 10 according to the first embodiment will be described with reference to FIG. FIG. 11 is a flowchart for explaining processing of the document processing apparatus according to the first embodiment. In FIG. 11, processing after the recipient places a paper document on the scanner 11 will be described.

  As shown in FIG. 11, the document processing apparatus 10 according to the first embodiment determines whether a scan start request is received from the recipient via the input unit 15 (step S101). When the scan start request is not accepted (No at Step S101), the document processing apparatus 10 enters a standby state. On the other hand, when a scan start request is accepted (Yes at step S101), the scanner 11 performs a document reading process to convert the document into digital data, and the captured image generation unit 17a receives the digital data transferred from the scanner 11. A captured image is generated from the data (step S102).

  Then, the dividing unit 17b divides the captured image generated by the captured image generating unit 17a into a plurality of regions (step S103). Specifically, the dividing unit 17b specifies the background color of the photographed image, identifies the region surrounded by the identified background color, and thereby converts the photographed image into a plurality of images according to the contents depicted in the photographed image. Divide into areas.

  Thereafter, the display control unit 17c controls the display unit 12 to display the captured image generated by the captured image generation unit 17a (step S104), and the optical sensor of the display unit 12 is visible from the remote controller 20. It is determined whether or not light has been detected (step S105).

  Here, when visible light is detected (Yes at Step S105), the optical sensor of the display unit 12 specifies the position of the detected visible light on the display unit 12. And the specific | specification part 17d acquires the position in the display part 12 of the visible light which the optical sensor of the display part 12 specified, and specifies the area | region corresponding to the said acquired position from the several area | region divided | segmented by the division part 17b. (Step S106).

  Subsequently, the enlarged image generation unit 17e generates an enlarged image obtained by enlarging the area specified by the specifying unit 17d (step S107), and the display control unit 17c displays the enlarged image generated by the enlarged image generation unit 17e. It controls to display on the part 12 (step S108). Specifically, the display control unit 17c displays an enlarged image on the front surface of the captured image.

  After the process of step S108, or when the optical sensor of the display unit 12 does not detect visible light (No in step S105), the signal receiving unit 13 determines whether an image processing instruction is received from the remote controller 20 or not. (Step S109). Here, when an image processing instruction is received from the remote controller 20 (Yes in step S109), the signal receiving unit 13 transfers the received image processing instruction to the instruction determining unit 17f, and the instruction determining unit 17f is transmitted from the signal receiving unit 13. The contents of the transferred image processing instruction are determined (step S110). That is, the instruction determination unit 17f determines whether the content of the image processing instruction is enlargement processing of an enlarged image, reduction processing of an enlarged image, or deletion processing of an enlarged image.

  Then, the instruction determination unit 17f transfers the determination result to the enlarged image generation unit 17e and the display control unit 17c, and the enlarged image generation unit 17e and the display control unit 17c execute a process according to the determination result (step S111). . For example, when the determination result is the enlargement process of the enlarged image, the instruction determination unit 17f transfers the enlargement rate to the enlarged image generation unit 17e, and the enlarged image generation unit 17e enlarges the enlarged image based on the transferred enlargement rate. The display control unit 17c causes the display unit 12 to display the enlarged image. When the determination result is the enlargement image reduction process, the instruction determination unit 17f transfers the reduction rate to the enlargement image generation unit 17e, and the enlargement image generation unit 17e performs the enlargement image based on the transferred reduction rate. The reduced control image is generated, and the display control unit 17c causes the display unit 12 to display the reduced image. If the determination result is an enlarged image erasing process, the instruction determination unit 17f transfers an instruction to hide the enlarged image to the display control unit 17c, and the display control unit 17c removes the displayed enlarged image. Display.

  After the process of step S111, or when the signal receiving unit 13 has not received an image processing instruction (No at step S109), the document processing apparatus 10 determines whether a processing end request has been received (step S112). .

  Here, when the process end request is not accepted (No at Step S112), the process returns to Step S105, and the optical sensor of the display unit 12 determines whether or not the visible light emitted from the remote controller 20 has been detected.

  On the other hand, when the process end request is received (Yes at step S112), the document processing apparatus 10 ends the process.

  As described above, in the first embodiment, the scanner 11 reads a paper medium document placed by the recipient, converts the document into digital data, and the captured image generation unit 17a receives the data from the scanner 11. A captured image is generated from the transferred digital data. Then, the dividing unit 17b divides the photographed image generated by the photographed image generating unit 17a into a plurality of areas, and the display control unit 17c causes the display unit 12 to display the photographed image generated by the photographed image generating unit 17a. To control. And the optical sensor of the display part 12 specifies the position in the display part 12 of the visible light irradiated from the remote control 20, and the specific part 17d is the position in the display part 12 of the visible light which the optical sensor of the display part 12 specified. And the region corresponding to the acquired position is specified from the plurality of regions divided by the dividing unit 17b. The enlarged image generation unit 17e generates an enlarged image obtained by enlarging the area specified by the specifying unit 17d, and the display control unit 17c displays the enlarged image generated by the enlarged image generation unit 17e on the display unit 12. To control.

  Therefore, according to the first embodiment, the recipient refers to the enlarged image together with the photographed image by enlarging a portion where it is difficult to see or read by only a simple operation of irradiating visible light from the remote controller 20. Can do. As a result, the recipient can refer to the enlarged image while referring to the photographed image, and can easily grasp the contents of the document which is difficult to see or read.

  Further, in the first embodiment, the display control unit 17c displays an enlarged image on the front surface of the captured image, so that the recipient can reliably refer to the enlarged image obtained by enlarging a desired area.

  In the first embodiment, the remote controller 20 transmits an image processing instruction for instructing processing related to the enlarged image displayed on the display unit 12, and the signal receiving unit 13 receives the image processing instruction received from the remote controller 20. The instruction determination unit 17f transfers to the instruction determination unit 17f, and the instruction determination unit 17f determines whether the content of the image processing instruction transferred from the signal reception unit 13 is an enlargement image enlargement process, an enlargement image reduction process, It is determined whether it is an erasing process.

  Then, the instruction determination unit 17f transfers the determination result to the enlarged image generation unit 17e and the display control unit 17c, and the enlarged image generation unit 17e and the display control unit 17c execute a process according to the determination result. That is, when the determination result is the enlargement process of the enlarged image, the instruction determination unit 17f transfers the enlargement rate to the enlarged image generation unit 17e, and the enlarged image generation unit 17e performs the enlarged image based on the transferred enlargement rate. The display control unit 17c causes the display unit 12 to display the enlarged image. When the determination result is the enlargement image reduction process, the instruction determination unit 17f transfers the reduction rate to the enlargement image generation unit 17e, and the enlargement image generation unit 17e performs the enlargement image based on the transferred reduction rate. The reduced control image is generated, and the display control unit 17c causes the display unit 12 to display the reduced image. If the determination result is an enlarged image erasing process, the instruction determination unit 17f transfers an instruction to hide the enlarged image to the display control unit 17c, and the display control unit 17c removes the displayed enlarged image. Display.

  Therefore, according to the first embodiment, the recipient can change a portion that is difficult to see or difficult to read to a magnification that is easily recognized by the recipient only by a simple operation such as operating a button of the remote controller 20. In addition, when it is desired to enlarge another portion, the enlarged image displayed at the present time can be deleted. As a result, the recipient can more easily grasp the contents of the document that is difficult to see or read.

  In the first embodiment described above, the case where the enlarged image of the area designated by the recipient is displayed has been described. In the second embodiment, a case where a character string included in an area designated by the recipient is output by voice will be described with reference to FIGS. FIG. 12 is a diagram for explaining an example of the appearance of the remote control according to the second embodiment, FIG. 13 is a diagram for explaining the configuration of the document processing apparatus according to the second embodiment, and FIG. It is a figure for demonstrating the determination process by an audio | voice output control part. FIG. 15 is a diagram for explaining the audio output process by the audio output control unit, and FIG. 16 is a diagram for explaining the display process of the display control unit accompanying the audio output process of the audio output control unit. is there.

  The document processing system according to the second embodiment includes a document processing apparatus 10 and a remote controller 20 in the same manner as the document processing system described with reference to FIG. However, the remote controller 20 according to the second embodiment has a volume increase button 26 (see FIG. 12) used for adjusting the volume, as compared with the remote controller 20 according to the first embodiment described with reference to FIG. “Large” in the figure) and a volume decrease button 27 (“Small” in the figure), a reproduction speed increase button 28 (“Fast” in the figure) used for adjusting the reproduction speed, and a reproduction speed decrease button 29. The difference is that it further has ("slow" in the figure).

  Further, the document processing apparatus 10 according to the second embodiment has the same appearance as the document processing apparatus 10 according to the first embodiment described with reference to FIG. However, as compared with the document processing apparatus 10 according to the first embodiment described with reference to FIG. 4, the document processing apparatus 10 according to the second embodiment includes a character string recognition unit 17 g as illustrated in FIG. 13. The difference is that it further includes a voice synthesis unit 17h and a voice output control unit 17i, and the storage unit 16 further includes a voice storage unit 16c.

  Hereinafter, the document processing apparatus 10 and the remote controller 20 according to the second embodiment will be described focusing on these.

  The character string recognition unit 17g reads the captured image generated by the captured image generation unit 17a from the image storage unit 16a, and recognizes the character string included in the read captured image. For example, the character string recognition unit 17g recognizes a character string included in a captured image generated from the document described with reference to FIG. As a result, the character string recognition unit 17g recognizes, for example, “I'm sending you well ...” that is the character string described in “Body 1”. To do. In addition, the character string recognition unit 17g acquires position information in the captured image of the recognized character string. The character string recognition unit 17g can also recognize a character string included in the photograph.

  The voice synthesizer 17h shown in FIG. 13 synthesizes the voice data of the character string recognized by the character string recognizer 17g. For example, the voice synthesizer 17h synthesizes the voice data “I'm fine? ...” described in “Body 1”. Then, the voice synthesizer 17h stores the synthesized voice data in the voice storage unit 16c in association with position information in the captured image of the character string used for synthesizing the voice data.

  Note that the dividing unit 17b divides the captured image into a plurality of regions, as in the first embodiment. For example, as illustrated in FIG. 5B, the dividing unit 17 b performs “area A” corresponding to the “photograph” area, “area B” corresponding to the “text 1” area, and “text 2”. The photographed image is divided into “region C” corresponding to the region “” and “region D” corresponding to the “sender information” region.

  Further, the display control unit 17c displays the captured image on the display unit 12 as in the first embodiment. And the specific | specification part 17d acquires the position in the display part 12 of the visible light which the optical sensor of the display part 12 specified similarly to Example 1, and the area | region corresponding to the acquired position is divided | segmented by the division part 17b. Identify from multiple areas.

  Then, similarly to the first embodiment, the enlarged image generation unit 17e generates an enlarged image obtained by enlarging the area specified by the specifying unit 17d. Further, the display control unit 17c controls the display unit 12 to display the enlarged image generated by the enlarged image generation unit 17e, as in the first embodiment.

  Here, in Example 2, the audio output control unit 17i determines whether or not a character string is included in the area specified by the specifying unit 17d. Specifically, the audio output control unit 17i refers to the audio storage unit 16c and determines whether there is audio data associated with the position information in the area specified by the specifying unit 17d.

  For example, as shown in FIG. 14, the audio output control unit 17 i performs the audio data “How are you?” Associated with the position information in the area B specified by the specifying unit 17 d. .. Is stored in the voice storage unit 16c, it is determined that the character string is included in the area B.

  When the character string is included in the area specified by the specifying unit 17d, the voice output control unit 17i reads out the voice data synthesized from the character string by the voice synthesizing unit 17h from the voice storage unit 16c and reads the speaker 14 Control to output from.

  For example, as shown in FIG. 15, the audio output control unit 17i displays “sound data: how are you?” From the speaker 14 while the enlarged image of the text 1 is displayed on the display unit 12. "... will be sent."

  The present embodiment may be a case where display processing as described below is performed by the display control unit 17c in synchronization with the output of audio data under the control of the audio output control unit 17i. . For example, as shown in FIG. 16A, the display control unit 17c displays an operation screen of the audio output software. Thereby, the recipient can recognize that the voice data of the character string included in the area enlarged and displayed by himself / herself is reproduced. Or the display control part 17c may display the location of the character string applicable to the audio | voice data currently reproduced | regenerated in an enlarged image, as shown to (B) of FIG. For example, the example shown in FIG. 16B shows that “How are you?” In the main text 1 is currently being played back. Thereby, the recipient can recognize which part of the character string included in the area enlarged and displayed by himself / herself is being reproduced.

  When audio data is output under the control of the audio output control unit 17i, the receiver operates the volume increase button 26, volume decrease button 27, reproduction speed increase button 28, and reproduction speed decrease button 29 of the remote controller 20. Thus, it is possible to transmit an audio processing instruction for instructing a process related to audio data output from the speaker 14.

  For example, the recipient presses the volume increase button 26 or the volume decrease button 27 to adjust the volume of the audio data output from the speaker 14. The recipient presses the playback speed increase button 28 or the playback speed decrease button 29 to adjust the playback speed of the audio data output from the speaker 14.

  The audio processing instruction signal transmitted from the remote controller 20 by such an operation is received by the signal receiving unit 13, and the signal receiving unit 13 transfers the received audio processing instruction signal to the instruction determining unit 17f. Then, the instruction determination unit 17f determines the instruction content included in the audio processing instruction signal transferred from the signal reception unit 13, and transfers the determination result to the audio output control unit 17i. Then, the audio output control unit 17i controls the volume of the audio data and the reproduction speed of the audio data based on the determination result of the instruction determination unit 17f.

  For example, when the determination result is an increase in volume, the audio output control unit 17i increases the output volume from the speaker 14, and when the determination result is a decrease in volume, the audio output control unit 17i is output from the speaker 14. Decrease the output volume. When the determination result is an increase in the reproduction speed, the audio output control unit 17i increases the reproduction speed from the speaker 14, and when the determination result is a decrease in the reproduction speed, the audio output control unit 17i Reduce playback speed from.

  In addition, when the operation screen of the audio output software as shown in FIG. 16A is displayed on the display unit 12, by using the optical sensor function of the display unit 12 as a touch panel function, the recipient can It is also possible to give a desired voice output instruction by pressing the “play”, “stop”, “fast forward” and “rewind” buttons on the operation screen of the voice output software.

  Also, the processing according to the image processing instruction described in the first embodiment can be executed in the second embodiment. Further, the document processing described above ends when the recipient presses the processing end button of the input unit 15 as in the first embodiment.

  Subsequently, a processing procedure of the document processing apparatus 10 according to the second embodiment will be described with reference to FIG. FIG. 17 is a flowchart for explaining processing of the document processing apparatus according to the second embodiment. In FIG. 17, processing after the recipient places a paper document on the scanner 11 will be described.

  As shown in FIG. 17, the document processing apparatus 10 according to the second embodiment determines whether a scan start request is received from the recipient via the input unit 15 (step S201). When the scan start request is not accepted (No at Step S201), the document processing apparatus 10 enters a standby state. On the other hand, when a scan start request is received (Yes at step S201), the scanner 11 performs a document reading process to convert the document into digital data, and the captured image generation unit 17a receives the digital data transferred from the scanner 11. A captured image is generated from the data (step S202).

  Then, the dividing unit 17b divides the photographed image generated by the photographed image generating unit 17a into a plurality of regions (step S203), and the character string recognizing unit 17g recognizes a character string included in the photographed image (step S204). The voice synthesizer 17h synthesizes the voice data of the character string recognized by the character string recognizer 17g (step S205). The voice synthesizer 17h stores the synthesized voice data in the voice storage unit 16c in association with position information in the captured image of the character string used to synthesize the voice data.

  Thereafter, the display control unit 17c controls the display unit 12 to display the captured image generated by the captured image generation unit 17a (step S206), and the optical sensor of the display unit 12 is visible from the remote controller 20. It is determined whether or not light is detected (step S207).

  Here, when visible light is detected (Yes at Step S207), the optical sensor of the display unit 12 specifies the position of the detected visible light on the display unit 12. And the specific | specification part 17d acquires the position in the display part 12 of the visible light which the optical sensor of the display part 12 specified, and specifies the area | region corresponding to the said acquired position from the several area | region divided | segmented by the division part 17b. (Step S208).

  Subsequently, the enlarged image generating unit 17e generates an enlarged image obtained by enlarging the area specified by the specifying unit 17d (Step S209), and the display control unit 17c displays the enlarged image generated by the enlarged image generating unit 17e. It controls to display on the part 12 (step S210).

  Then, the audio output control unit 17i determines whether or not a character string is included in the area specified by the specifying unit 17d (step S211). Specifically, the audio output control unit 17i refers to the audio storage unit 16c and determines whether there is audio data associated with the position information included in the area specified by the specifying unit 17d. .

  Here, when the character string is included in the area specified by the specifying unit 17d (Yes in step S211), the voice output control unit 17i is synthesized by the voice synthesizing unit 17h from the character string included in the area. The audio data is controlled to be output from the speaker 14 (step S212).

  After the process of step S211, when the optical sensor of the display unit 12 does not detect visible light (No at step S207), or when the character string is not included in the area specified by the specifying unit 17d (No at step S211), the signal receiving unit 13 determines whether an image processing instruction or an audio processing instruction is received from the remote controller 20 (step S213). Here, when an image processing instruction or an audio processing instruction is received from the remote controller 20 (Yes in step S213), the signal receiving unit 13 transfers the received instruction to the instruction determining unit 17f, and the instruction determining unit 17f The contents of the instruction transferred from 13 are determined (step S214). That is, the instruction determination unit 17f determines whether the content of the instruction is an enlargement image enlargement process, an enlargement image reduction process, an enlargement image deletion process, or an audio data volume adjustment process. It is determined whether the playback speed adjustment processing is for audio data.

  Then, the instruction determination unit 17f transfers the determination result to the enlarged image generation unit 17e and the display control unit 17c or the audio output control unit 17i according to the content of the determination result, and the enlarged image generation unit to which the determination result has been transferred. 17e and the display control unit 17c or the audio output control unit 17i execute a process according to the determination result (step S215).

  After the process of step S215 or when the signal receiving unit 13 has not received an image processing instruction (No at step S213), the document processing apparatus 10 determines whether a processing end request has been received (step S216). .

  Here, when the processing end request is not received (No at Step S216), the process returns to Step S207, and the optical sensor of the display unit 12 determines whether or not the visible light emitted from the remote controller 20 has been detected.

  On the other hand, when the process end request is received (Yes at step S216), the document processing apparatus 10 ends the process.

  As described above, in the second embodiment, the character string recognizing unit 17g recognizes a character string included in the photographed image, and the voice synthesizing unit 17h uses the voice data of the character string recognized by the character string recognizing unit 17g. Synthesize. Then, when the character string is included in the area specified by the specifying unit 17d, the voice output control unit 17i performs control so that the voice data synthesized by the voice synthesizing unit 17h from the character string is output from the speaker 14. .

  Therefore, according to the second embodiment, the recipient can enlarge and refer to a place where the recipient is difficult to see or read, and can recognize the characters included in the place by voice. As a result, the recipient can easily grasp the contents of the document which is difficult to see or read by voice.

  In the second embodiment, the remote controller 20 transmits an audio processing instruction for adjusting the volume and reproduction speed of the audio output from the speaker 14, and the signal receiving unit 13 receives the audio processing instruction received from the remote controller 20. The instruction determination unit 17 f determines the content of the image processing instruction transferred from the signal reception unit 13. Then, the instruction determination unit 17f transfers the determination result to the audio output control unit 17i, and the audio output control unit 17i performs control for adjusting the volume or the reproduction speed according to the determination result.

  Therefore, according to the second embodiment, the recipient can make the sound volume and reproduction speed of the sound output from the speaker 14 easily recognizable by only a simple operation such as operating a button on the remote controller 20. Can be changed. As a result, the recipient can more easily grasp the part where his / her confidence is difficult to see or read by voice.

  In the first and second embodiments described above, the case where visible light is emitted from the remote controller 20 when displaying an enlarged image has been described. However, the present invention applies when infrared light or the like is emitted from the remote controller 20 when displaying an enlarged image. It may be.

  In addition, among the processes described in this embodiment, all or part of the processes described as being performed automatically can be performed manually, or the processes described as being performed manually can be performed. All or a part can be automatically performed by a known method. In addition, the processing procedure, control procedure, specific name, and information including various data and parameters shown in the above-described document and drawings can be arbitrarily changed unless otherwise specified.

  Further, each component of each illustrated apparatus is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution / integration of each device is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed or arbitrarily distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured. Further, all or any part of each processing function performed in each device may be realized by a CPU and a program analyzed and executed by the CPU, or may be realized as hardware by wired logic.

  The document processing method described in this embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. This program can be distributed via a network such as the Internet. The program can also be executed by being recorded on a computer-readable recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, an MO, and a DVD and being read from the recording medium by the computer.

  As described above, the document processing method and the document processing system according to the present invention are useful when image processing is performed on a paper medium document, and in particular, it is easy to grasp the contents of a document that is difficult to see or read. Suitable for.

10 Document Processing Device 11 Scanner 12 Display Unit (Display with Built-in Optical Sensor)
13 Signal receiver 14 Speaker 15 Input unit 16 Storage unit 16a Image storage unit 16b Division result storage unit 17 Control unit 17a Captured image generation unit 17b Division unit 17c Display control unit 17d Identification unit 17e Enlarged image generation unit 17f Instruction determination unit 20 Remote control 21 Visible light switch 22 Irradiation port 23 Enlarge button 24 Reduce button 25 Erase button

Claims (6)

A shooting step for generating an image of the document placed by the user;
A dividing step of dividing the image generated by the photographing step into a plurality of regions;
A display control step for controlling the image generated by the photographing step to be displayed on a predetermined display unit;
A detection step of detecting light transmitted from the optical transmission device to the predetermined display unit in a state where the image is displayed on the predetermined display unit by the control of the display control step;
A step of acquiring the position of the light detected by the detection step, and specifying a region corresponding to the acquired position from the plurality of regions divided by the division step;
An enlarged image generating step for generating an enlarged image obtained by enlarging the area specified by the specifying step;
A second display control step for controlling the enlarged image generated by the enlarged image generating step to be further displayed on the predetermined display unit;
A document processing method comprising:   2. The second display control step performs control so that the enlarged image is displayed in front of the image in a state where the image is displayed on the predetermined display unit. Document processing method. A character string recognition step for recognizing a character string included in the image generated by the photographing step;
A voice synthesis step of synthesizing voice data of the character string recognized by the character string recognition step;
When a character string is included in the area specified by the specifying step, a voice output control step for controlling the voice data synthesized from the character string by the voice synthesis step to be output from a predetermined voice output unit;
The document processing method according to claim 1, further comprising: The optical transmission device further transmits an image processing instruction for instructing processing related to an image displayed on the predetermined display unit,
The second display control step controls an enlargement ratio of the enlarged image based on the image processing instruction transmitted from the optical transmission device. The document processing method described. The optical transmission device further transmits an audio processing instruction for instructing processing related to audio data output from the predetermined audio output unit;
The audio output control step controls the volume of the audio data or the reproduction speed of the audio data based on the audio processing instruction transmitted from the optical transmitter. The document processing method according to any one of the above. A document processing system including a document processing device that processes a document and an optical transmission device that transmits light,
The document processing apparatus includes:
Photographing means for generating an image of a document placed by a user;
Dividing means for dividing the image generated by the photographing means into a plurality of regions;
Display control means for controlling the image generated by the photographing means to be displayed on a predetermined display unit;
Detection means for detecting light transmitted from the optical transmission device to the predetermined display section in a state where the image is displayed on the predetermined display section under the control of the display control section;
A specifying unit that acquires the position of the light detected by the detecting unit, and that specifies the region corresponding to the acquired position from the plurality of regions divided by the dividing unit;
An enlarged image generating means for generating an enlarged image obtained by enlarging the area specified by the specifying means;
Second display control means for controlling to further display the enlarged image generated by the enlarged image generating means on the predetermined display unit;
A document processing system comprising:

Images