JP2017204670A - Image reading apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce a burden on a user when generating image data of satisfactory visibility on a portable terminal by using an image reading apparatus.SOLUTION: The image reading apparatus reads an image displayed in a document and generates terminal display image data for displaying on the portable terminal with a display screen having a predetermined aspect ratio. The image reading apparatus comprises: an image extraction part which generates the image data obtained by reading the image displayed in the document and extracts at least one partial image out of the image data expressed by the image data; a terminal display image data generation part which generates image data for terminal display expressing the extracted partial image; and a transmission part which transmits to the portable terminal the terminal display image data.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image reading apparatus.

  An image forming apparatus (for example, a printer, a multifunction printer, or a multifunction printer) can read a document and transmit an image of the document to a mobile terminal or the like connected by short-range wireless communication. The image forming apparatus performs image reading assuming a standard paper size such as A4 size or B4 size, whereas a display screen of a mobile terminal or the like (for example, LCD (Liquid Crystal Display) or OLED (Organic Light Emitting Diode)). Is a size that does not assume the size of the standard paper.

  To deal with such a problem, for example, Patent Document 1 discloses a method of dividing a digital image larger than a display screen of a mobile terminal or the like into a plurality of sub-images and storing them as file names so that the mutual positional relationship can be understood. is suggesting. Patent Document 2 proposes a method of converting the number of pixels of image data of an object instructed by a mobile terminal into data suitable for display means in the mobile terminal and transmitting it to a monitoring system center device.

JP 2002-99481 A Japanese Patent Laid-Open No. 2003-199097

  However, the technique disclosed in Patent Document 1 has a problem in that unnecessary images such as a blank portion of an image are also subject to division, while the necessary portion is divided to impair the visibility of the image. In the technique of Patent Document 2, an image to be displayed must be indicated, and the image reading operation becomes complicated.

  The present invention has been made in view of such a situation, and an object of the present invention is to provide a technique for reducing the burden on the user when generating image data with good visibility in a portable terminal using an image reading apparatus. To do.

  The image reading apparatus of the present invention reads an image displayed on a document and generates terminal display image data to be displayed on a portable terminal having a display screen having a predetermined aspect ratio. The image reading device reads an image displayed on the document to generate image data, and extracts at least one partial image from an image represented by the image data; and the extracted A terminal display image data generation unit that generates the terminal display image data representing the partial image, and a transmission unit that transmits the terminal display image data to the portable terminal.

  ADVANTAGE OF THE INVENTION According to this invention, the technique which reduces the user burden at the time of producing | generating the image data with favorable visibility in a portable terminal using an image reader can be provided.

1 is a block diagram illustrating a functional configuration of an image forming system 10 according to an embodiment of the present invention. It is explanatory drawing which shows a mode that the image data produced | generated by the image data production | generation process which concerns on a comparative example is displayed on the display screen of a portable terminal. It is a flowchart which shows the content of the image data generation process for terminal display which concerns on one Embodiment. It is a flowchart which shows the content of the portable terminal preparation process which concerns on one Embodiment. It is explanatory drawing which shows an example of a mode that the image data produced | generated with the image data for terminal display which concerns on one Embodiment are displayed on the display screen of a portable terminal. It is explanatory drawing which shows the other example of a mode that the image data produced | generated with the image data for terminal display concerning one Embodiment is displayed on the display screen of a portable terminal. 4 is an explanatory diagram illustrating operation display screens 131a and 131b of the image forming apparatus 100 according to an embodiment. FIG.

  Hereinafter, modes for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a functional configuration of an image forming system 10 according to an embodiment of the present invention. The image forming system 10 includes an image forming apparatus 100 and a smartphone 200. The image forming apparatus 100 includes a control unit 110, an image forming unit 120, an operation display unit 130, a storage unit 140, and a communication interface unit 150. The smartphone 200 includes a control unit 210, an operation display unit 230, a storage unit 240, and a communication interface unit 250.

  The smartphone 200 is connected to the image forming apparatus 100 through short-range wireless communication via the communication interface unit 150 and the communication interface unit 250. In this embodiment, near field communication uses BLUETOOTH (registered trademark) CLASS1. CLASS1 of BLUETOOTH is communication with an output of 1 mW, and is short-range wireless communication that enables communication between the image forming apparatus 100 and the smartphone 200 within about 1 m.

  The image forming unit 120 reads an image from a document and generates image data, an image processing unit 122 that processes image data according to print settings, and prints on a print medium based on the processed image data. The image output part 123 which performs is provided.

  The operation display unit 130 of the image forming apparatus 100 includes a display 131 and an operation processing unit 132. The operation display unit 230 of the smartphone 200 includes a display 231 and an operation processing unit 232. The displays 131 and 231 function as a touch panel and display various menus as input screens. The operation processing units 132 and 232 receive user operation inputs from the displays 131 and 231 that function as touch panels and various buttons and switches (not shown).

  The control units 110 and 210 include main storage means such as RAM and ROM, and control means such as MPU (Micro Processing Unit) and CPU (Central Processing Unit). The control unit 110 also has controller functions related to various I / O, USB (Universal Serial Bus), bus, and other hardware interfaces, and controls the entire image forming apparatus 100 and the smartphone 200, respectively. .

  The storage units 140 and 240 are storage devices including a hard disk drive or a flash memory that is a non-temporary recording medium, and store control programs and data for processes executed by the control units 110 and 210, respectively. The storage unit 240 stores device-specific information 241 such as the number of pixels of the display 231 of the smartphone 200, display resolution, screen size, and aspect ratio. The storage unit 140 is associated with each record of the unique information database 141 including the unique information of each portable device such as the number of pixels of the display of each portable device, the display resolution, the screen size, and the aspect ratio, and the unique information database 141. The image data of the display surface of each portable device is stored. The unique information database 141 and the image data may exist in the cloud computer, for example, and do not necessarily need to be stored in the storage unit 140.

  FIG. 2 is an explanatory diagram illustrating a state in which the image data generated by the image data generation process according to the comparative example is displayed on the display screen of the mobile terminal. On the document P, a first graphic F1, a second graphic F2, and a third graphic F3 are displayed. The document P is an A4 size document. The image reading unit 121 of the image forming apparatus 100 reads an image of an A4 size document P and generates image data.

  The smartphone 200 displays an image D1 represented by the image data on the display 231. In the image D1, three first figures F1, a second figure F2, and a third figure F3 are displayed in a small size. This is because the image reading unit 121 has selected a standard size (A4 size) with a small operation burden at the time of image reading by the user. Since the display 231 has an aspect ratio different from the aspect ratio of the display 231, the band area B as a non-display area is displayed together with the image D1.

  FIG. 3 is a flowchart showing the contents of terminal display image data generation processing according to an embodiment. In step S10, the user performs portable terminal preparation processing. The portable terminal preparation process is a process for enabling the smartphone 200 to function as the image forming system 10 in cooperation with the image forming apparatus 100.

  FIG. 4 is a flowchart showing the contents of the portable terminal preparation process according to an embodiment. In step S <b> 11, the user scans the smartphone 200 with the image reading unit 121. Specifically, the user sets the display 231 of the smartphone 200 toward the document table (not shown) and presses a start button (not shown). Thereby, the scanning of the smartphone 200 is started. In addition, the surface of the mobile terminal (smart phone 200) on the side where the display screen (display 231) is arranged is also referred to as a display surface.

  In step S12, the control unit 110 analyzes the read image of the smartphone 200, compares the image with the image data on the display surface of each portable device, and identifies matching image data. The control unit 110 extracts a record associated with the specified image data from the specific information database 141, specifies the model, and acquires specific information such as the number of display pixels, display resolution, screen size, and aspect ratio. . The identification of the image data may be performed outside the image forming apparatus 100, for example, a cloud computer.

  In step S13, the control unit 110 executes a mobile terminal connection process. The portable terminal connection process is a process for attempting near field communication to the smartphone 200 via the communication interface unit 150. The user operates the smartphone 200 to establish short-range wireless communication between the smartphone 200 and the image forming apparatus 100.

  The establishment of the short-range wireless communication can be started, for example, when the control unit 110 displays the QR code QC (registered trademark) on the display 131 and the user reads the QR code with the smartphone 200. The QR code includes information such as an ID and a password for the smartphone 200 to start short-range wireless communication with the image forming apparatus 100.

  In step S14, the control unit 110 inquires of the smartphone 200 whether or not the application 142 has been installed. Control unit 110 proceeds with the process to step S15 in response to an answer indicating that it has not been installed, and skips the application installation process (step S15) and proceeds to step S16 in response to an answer that it has been installed.

  In step S16, the control unit 110 performs unique information confirmation processing. The unique information confirmation process is a process of receiving the unique information 241 data from the smartphone 200 via short-range wireless communication and confirming the unique information estimated in the unique information database 141.

  In the present embodiment, if at least one of estimation of unique information by the unique information database 141 and acquisition of unique information from the smartphone 200 is possible, the mobile terminal preparation process (step S10) can be completed. Confirmation of both is not necessarily required. That is, the screen size and aspect ratio of the image representing the display 231 among the read images of the smartphone 200 may be directly used as the screen size and aspect ratio.

  In step S20, the user starts reading a document. Specifically, the user sets the document P toward the document table (not shown) and presses a start button (not shown). In step S30, the control unit 110 functions as an image extraction unit, and executes analysis of the read image. The analysis of the read image includes extraction processing of the first graphic F1, the second graphic F2, and the third graphic F3 displayed on the document P. The extracted image is also called a partial image.

  FIG. 5 is an explanatory diagram illustrating an example of a state in which the image data generated by the terminal display image generation processing according to the embodiment is displayed on the display screen of the mobile terminal. The control unit 110 specifies the display area A in which the first graphic F1, the second graphic F2, and the third graphic F3 are displayed. The display area can be specified by the following method, for example.

  Specifically, first, a threshold value is determined by, for example, histogram analysis or the like, and binarization processing is executed. Second, the sub-scanning straight line M1 having the coordinates of the first pixel that changes from the white image to the non-white image when scanned in the main scanning direction, and the coordinates of the last pixel that changes from the non-white image to the white image. The width X in the main scanning direction can be acquired based on the straight line M2 in the sub scanning direction. Thirdly, the straight line S1 in the main scanning direction having the coordinates of the first pixel that changes from the white image to the non-white image by scanning in the sub-scanning direction and the coordinates of the last pixel that changes from the non-white image to the white image The length Y in the sub-scanning direction can be acquired based on the straight line S2 in the main scanning direction.

  As described above, the control unit 110 specifies the display area A in which the first graphic F1, the second graphic F2, and the third graphic F3 are displayed. The control unit 110 further specifies an image range that can be displayed on the display 231 having the aspect ratio (a / b) based on the unique information 241 of the smartphone 200. In this example, the image range is a range in which the width X in the main scanning direction matches the long side (a side) of the display 231 and the length Y in the sub scanning direction falls within the short side (b side) of the display 231. Is determined.

  FIG. 6 is an explanatory diagram illustrating another example in which the image data generated by the terminal display image generation processing according to the embodiment is displayed on the display screen of the mobile terminal. In this example, the control unit 110 can also extract the first graphic F1, the second graphic F2, and the third graphic F3 individually. Specifically, contour tracking processing is executed on the first graphic F1 and the third graphic F3 detected by specifying the display area A, and the respective areas (image area candidates) of the first graphic F1 and the third graphic F3. Can be specified.

  Next, each area of the first figure F1 and the third figure F3 is converted into a white area, and the second figure F2 is detected by scanning in the main scanning direction and the sub-scanning direction, and the area is closed by the contour tracking process. I can confirm that. The control unit 110 can further specify the image ranges of the first graphic F1, the second graphic F2, and the third graphic F3 that can be displayed on the display 231 having the aspect ratio (a / b).

  In step S40, control unit 110 determines whether there is an image region candidate. If it is determined that there is an image area candidate, the process proceeds to step S50. If it is determined that there is no image area candidate, the process proceeds to step S60.

  FIG. 7 is an explanatory diagram illustrating operation display screens 131a and 131b of the image forming apparatus 100 according to an embodiment. In step S50, the control unit 110 displays operation display screens 131a and 131b for selecting image region candidates on the display 131. When the operation display unit 130 selects the transmission (image reading or scanning) function and touches the tab T1 used on the mobile terminal, the operation display unit 131 displays operation display screens 131a and 131b for selecting image region candidates. The operation display screen 131a is a screen displayed in response to the touch of the whole icon 131e. The operation display screen 131b is a screen that is displayed in response to the touch of the division icon 131f.

  When the user desires to acquire image data representing one image that collectively displays the first graphic F1, the second graphic F2, and the third graphic F3, the user confirms the image on the operation display screen 131a and confirms the OK icon 131h. It can be selected by touching.

  When the user desires to acquire image data representing at least one image that individually displays a plurality of images of the first graphic F1, the second graphic F2, and the third graphic F3, the acquisition is performed on the operation display screen 131b. The desired image can be arbitrarily selected by touching the desired image and touching the OK icon 131h.

  The user acquires image data representing one image that collectively displays a plurality of images of the first graphic F1, the second graphic F2, and the third graphic F3, and a plurality of image data representing images that are displayed individually. Can be selected by touching the collective icon 131g on either of the operation display screens 131a and 131b and touching the OK icon 131h. In this case, these images are preferably linked and managed using, for example, Exif information.

  In step S60, the control unit 110 functions as a terminal display image data generation unit, and generates terminal display image data of the selected image. The terminal display image data is generated as image data suitable for display on the display 231 of the smartphone 200 having the aspect ratio (a / b) for the selected image.

  In step S <b> 70, the control unit 110 connects to the smartphone 200 via short-range wireless communication via the communication interface unit 150 of the image forming apparatus 100. In step S <b> 80, the image forming apparatus 100 transmits the terminal display image data to the smartphone 200 via the communication interface unit 150 that functions as a transmission unit.

  In the smartphone 200, the control unit 210 displays an image based on the terminal display image data acquired on the display 231 in response to reception of the terminal display image data. The user confirms the image and touches an OK icon (not shown) to approve it. The smartphone 200 transmits data including information (reception completion) indicating approval to the image forming apparatus 100.

  In step S <b> 90, the image forming apparatus 100 releases the short-range wireless communication connection with the smartphone 200 in response to the completion of reception and approval of the terminal display image data.

  As described above, according to the image forming apparatus 100 according to the embodiment, terminal display image data with good visibility can be generated semi-automatically on the display 231 of the smartphone 200 and transmitted to the smartphone 200. As a result, the image forming system 10 can reduce the burden on the user when the image forming apparatus 100 is used to generate image data with good visibility on the smartphone 200.

  The present invention can be implemented not only in the above embodiments but also in the following modifications.

  Modification 1: In the above-described embodiment, the image forming apparatus has a function of transmitting an application to a smartphone and automatically installing the application. However, a function of installing the image forming apparatus on the smartphone is not necessarily required. Specifically, for example, a configuration that requires an application to be installed on a smartphone in advance may be used. However, if there is an installation function provided by the image forming apparatus, the burden on the user can be reduced. The application may be provided from the website by the provider of the image forming apparatus.

  Modification 2: In the above embodiment, an image representing a figure having a predetermined contour on a white background is extracted. However, a feature amount (for example, a feature amount representing a person's face) focused on a local region such as luminance or an edge in advance is extracted. A specific image (for example, a human face) may be extracted from the image stored in the storage unit 140.

  Modification 3: In the above embodiment, the present invention is applied to the image forming apparatus, but can also be applied to an image reading apparatus. Furthermore, the present invention is not limited to smartphones, and the present invention can also be used to generate image data for display on an electronic pad or electronic book.

DESCRIPTION OF SYMBOLS 10 Image forming system 100 Image forming apparatus 110,210 Control part 120 Image forming part 121 Image reading part 122 Image processing part 123 Image output part 130,230 Operation display part 131,231 Display 132,232 Operation processing part 140,240 Storage part 141 Unique Information Database 241 Unique Information 142 Application 150, 250 Communication Interface Unit 200 Smartphone

Claims (7)

An image reading device that reads an image displayed on a document and generates image data for terminal display for display on a portable terminal having a display screen having a predetermined aspect ratio,
An image extracting unit that reads an image displayed on the document to generate image data, and extracts at least one partial image from the image represented by the image data;
A terminal display image data generation unit for generating the terminal display image data representing the extracted partial image;
A transmission unit for transmitting the terminal display image data to the mobile terminal;
An image reading apparatus. The image reading apparatus according to claim 1,
The terminal display image data generation unit includes the extracted partial image, and generates the terminal display image data representing the image having the predetermined aspect ratio. The image reading apparatus according to claim 1, wherein
The image extraction unit reads the display surface of the mobile terminal to generate image data, specifies a model of the mobile terminal based on the image data, and sets the predetermined aspect ratio based on the specified model. The image reading device to be determined. The image reading apparatus according to claim 1, wherein
The image extraction unit reads the display surface of the mobile terminal to generate image data, and determines the predetermined aspect ratio based on an image representing the display screen of the mobile terminal based on the image data apparatus. The image reading apparatus according to any one of claims 1 to 4,
The terminal display image data generation unit extracts a plurality of partial images from the image represented by the image data, and combines the partial images individually representing the plurality of partial images and the plurality of partial images. An image reading device that generates the terminal display image data representing a partial image to be represented. The image reading apparatus according to any one of claims 1 to 5, further comprising:
An image reading apparatus having an operation display unit for displaying the extracted partial image. The image reading apparatus according to claim 6,
The terminal display image data generation unit extracts a plurality of partial images from the image represented by the image data, and combines the partial images individually representing the plurality of partial images and the plurality of partial images. Generating the terminal display image data representing the partial image to be represented,
The operation display unit displays an operation display screen capable of arbitrarily selecting a partial image that individually represents the plurality of partial images and a partial image that collectively represents the plurality of partial images.