JP2014017736A - Image processing apparatus, and image processing system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing apparatus, and an image processing system and program for easily performing accurate adjustment to read images.SOLUTION: An image processing apparatus, when display performance of a display unit 18 is higher than display performance of a display area 30, displays images based on read images; when display performance of the display unit 18 in not higher than display performance of the display area 30, displays simplified images obtained by simplifying the read images; when display performance of the display unit 18 is higher than display performance of the display area 30, transmits simplified image information to a smartphone 14; and when display performance of the display unit 18 is not higher than display performance of the display area 30, transmits read image information to the smartphone 14.

Description

  The present invention relates to an image processing apparatus, an image processing system, and a program.

  Patent Document 1 discloses an image processing apparatus that acquires an original image from an image file, creates a thumbnail image, displays the created thumbnail image, and creates an in-document image for display based on the original image. ing. When an instruction to rotate the thumbnail image is given, the image processing apparatus rotates and displays the thumbnail image according to the given instruction, and also rotates the in-document image, and the document including the rotated in-document image is displayed. Print.

  Patent Document 2 discloses a print image creation apparatus that reduces a current print page image and displays it as a preview image when an annotation and a comment are simply inserted into a document on a computer.

  In Patent Document 3, the image forming apparatus transmits image data indicating a print preview image obtained by reducing the image in the print area to the mobile phone, and the mobile phone indicates the print area indicated by the image data transmitted from the image forming apparatus. A system for displaying the above image on a display is disclosed.

JP 2000-113203 A JP 2001-101163 A JP 2004-088344 A

  An object of the present invention is to provide an image processing apparatus, an image processing system, and a program that easily perform high-precision adjustment on a read image.

  In order to solve the above-described problem, an image processing apparatus according to claim 1, comprising: a reading unit that reads a read area to obtain a read image; a display unit that displays an image; and an image based on transmitted information. When the display means has a display capability higher than that of the display area of the communication destination having the display area to be displayed, the display means displays an image based on the read image obtained by the reading means, and the reading means When simplified image information indicating a simplified image obtained by simplifying an image is transmitted to the communication destination and the display capability of the display unit is not higher than the display capability of the display area, the simplified image is displayed on the display unit. And a control means for controlling to display read image information indicating the read image to the communication destination.

  The image processing apparatus according to claim 1, as in the invention according to claim 2, a determination unit that determines whether the display capability of the display unit is higher than the display capability of the display area, and the determination When it is determined by the means that the display capability of the display means is higher than the display capability of the display area, a simplified image indicated by the simplified image information to be transmitted to the communication destination is displayed in the display area. When the determination means determines that the display capability of the display unit is not higher than the display capability of the display area, the simplified image to be displayed on the display unit is created. Creating means for creating the display means so as to correspond to the display capability of the display means.

  According to a second aspect of the present invention, in the image processing apparatus according to the third aspect of the present invention, when the creation unit further has a display capability of the display unit higher than a display capability of the display area by the determination unit. If determined, an image based on the read image to be displayed on the display unit is created so as to correspond to the display capability of the display unit.

  The image processing apparatus according to any one of claims 1 to 3, wherein the control means is configured such that the display means has a display capability higher than the display capability of the display area, as in the invention according to claim 4. Is higher, the adjustment receiving image used when receiving the adjustment content of the read image is further displayed on the display unit together with the image based on the read image in a screen that is not different from the image based on the read image. It was supposed to be controlled.

  In the image processing apparatus according to claim 4, when the control unit receives the adjustment content using the adjustment reception image displayed on the display unit, as in the invention according to claim 5. Further, in place of the image based on the read image currently displayed on the display unit, further control is performed so that the image based on the read image adjusted according to the adjustment content is displayed on the display unit. .

  In order to solve the above-mentioned problem, the image processing system according to claim 6, the image processing apparatus according to any one of claims 1 to 5, and the display capability of the display unit are When the display capability is higher than the display capability, the simplified image information transmitted from the image processing device is received, and when the display capability of the display means is not higher than the display capability of the display region, the simplified image information is transmitted from the image processing device. Receiving means for receiving the read image information, and controlling so that the simplified image indicated by the simplified image information received by the receiving means is displayed in the display area, and received by the receiving means. A communication device that operates as the communication destination, including display control means for controlling the image based on the read image indicated by the read image information to be displayed in the display area. Configuration was.

  In the image processing system according to claim 6, as in the invention according to claim 7, the control unit accepts the adjustment content of the read image in a state where the simplified image is displayed in the display area. The simplified image information adjusted according to the adjustment content is further transmitted to the communication device, and the display control means replaces the simplified image currently displayed in the display area. Thus, control is performed so that the simplified image indicated by the latest simplified image information received by the receiving unit is displayed in the display area.

  In the image processing system according to claim 6 or 7, when the control means does not have a display capability of the display area higher than the display capability of the display area, as in the invention according to claim 8, Further control is performed to transmit adjustment acceptance image information indicating an adjustment acceptance image used when accepting the adjustment content of the read image to the communication device, and the reception unit transmits the transmitted adjustment acceptance image information. , And the display control means indicates the adjustment acceptance image indicated by the adjustment acceptance image information received by the reception means in the display area by the read image information received by the reception means. Control is performed so that the image is displayed together with the image based on the read image in a screen that is not different from the image based on the read image.

  The image processing system according to claim 8, and the communication device according to the invention according to claim 9, wherein the communication device receives the adjustment content using the adjustment reception image displayed in the display area. In addition, adjustment content information indicating the adjustment content received by the reception unit is transmitted to the image processing apparatus, and the control unit adjusts according to the adjustment content indicated by the adjustment content information transmitted from the communication device. The read image information is transmitted to the communication device, and the display control means receives the read image information by the receiving means in a state where an image based on the read image is displayed in the display area. In the case where it is determined that the latest read image received by the receiving unit is used instead of the image based on the read image currently displayed in the display area. Image based on the read image indicated by the information is assumed to be controlled so as to be displayed in the display area.

  In the image processing system according to claim 9, as in the invention according to claim 10, the control unit receives the adjustment content information from the communication device in a state where the simplified image is displayed on the display unit. When transmitted, instead of the simplified image currently displayed on the display means, the simplified image adjusted according to the adjustment content indicated by the adjustment content information transmitted from the communication device is displayed. Further control was made so as to display on the means.

  The image processing system according to any one of claims 6 to 10, and the communication device as in the invention according to claim 11, further comprising detection means for detecting the orientation of the communication device, When the orientation information indicating the orientation of the communication device detected by the detection unit is transmitted to the image processing device, and the control unit sets the simplified image information as a transmission target to the communication device, the display area The aspect ratio and screen resolution of the simplified image display screen on which the simplified image is displayed are acquired, and the orientation of the communication device indicated by the acquired aspect ratio and screen resolution and the orientation information transmitted from the communication device The simplified image indicated by the simplified image information to be transmitted is based on the aspect ratio of the read image in a predetermined direction with respect to the orientation of the communication device. And it shall be adjusted to the simplified image information to be the transmission object to appear maximally image display screen.

  In the image processing system according to claim 11, when the control unit sets the read image information to be transmitted to the communication device as in the invention according to claim 12, the read image in the display area is used. The aspect ratio and the screen resolution of the read image display screen on which an image based on the image is displayed are acquired, and based on the acquired aspect ratio and screen resolution and the orientation of the communication device indicated by the orientation information transmitted from the communication device The transmission target is such that an image based on the read image indicated by the read image information as the transmission target is displayed on the read image display screen to the maximum in the predetermined direction at the aspect ratio of the read image. The read image information is adjusted.

  The image processing system according to any one of claims 6 to 10, and, as in the invention according to claim 13, the communication device further includes detection means for detecting a direction of the communication device, When the orientation information indicating the orientation of the communication device detected by the detection unit is transmitted to the image processing device, and the control unit sets the read image information as a transmission target to the communication device, The aspect ratio and screen resolution of a read image display screen on which an image based on the read image is displayed are acquired, and the orientation of the communication device indicated by the acquired aspect ratio and screen resolution and the orientation information transmitted from the communication device The image based on the read image indicated by the read image information to be transmitted is based on the orientation of the read image in a predetermined direction with respect to the direction of the communication device. In was assumed to adjust the read image information and the transmission target to appear maximally on the read image display screen.

  In order to solve the above-described problem, the program according to claim 14 is used for causing a computer to function as the control means according to any one of claims 1 to 5.

  According to the inventions according to claim 1, claim 6 and claim 14, the display capability of the display means is higher than the display capability of the display area of the communication destination having the display area for displaying the image based on the transmitted information. In this case, an image based on the read image obtained by the reading unit is displayed on the display unit, and simplified image information indicating a simplified image obtained by simplifying the read image is transmitted to the communication destination, which is displayed rather than the display capability of the display area. When the display capability of the means is not high, a simplified image is displayed on the display means, and a highly accurate adjustment with respect to the read image is easy as compared with a case where the read image information indicating the read image is not transmitted to the communication destination. The effect that it is performed is obtained.

  According to the invention of claim 2, when it is determined whether or not the display means has a higher display ability than the display area, and the display means has a higher display ability than the display area. The simplified image indicated by the simplified image information to be transmitted to the communication destination is created so as to correspond to the display capability of the display area, and it is determined that the display capability of the display means is not higher than the display capability of the display area. In this case, the simplified image can be displayed with higher accuracy than the case where the simplified image to be displayed on the display unit is not configured to correspond to the display capability of the display unit. can get.

  According to the invention according to claim 3, when it is determined that the display capability of the display means is higher than the display capability of the display area, an image based on the read image to be displayed on the display means is used as the display capability of the display means. Compared to the case where the configuration is not created so as to correspond, an effect that an image based on the read image is displayed with high accuracy can be obtained.

  According to the invention of claim 4, when the display capability of the display means is higher than the display capability of the display area, the adjustment acceptance image used when accepting the adjustment content of the read image is an image based on the read image in the display means. As compared with the case where the image displayed together with the image based on the read image is not included in the screen which is not different from the above, an effect that the highly accurate adjustment with respect to the read image is easily performed is obtained.

  According to the fifth aspect of the present invention, when the adjustment content is received using the adjustment reception image displayed on the display unit, the adjustment is performed instead of the image based on the read image currently displayed on the display unit. As compared with the case where the image based on the read image adjusted according to the contents is not displayed on the display unit, an effect that the mode of the read image after adjustment is easily grasped can be obtained.

  According to the invention of claim 7, when the adjustment content of the read image is received in a state where the simplified image is displayed in the display area, the simplified image information adjusted according to the adjustment content is transmitted to the communication device, Instead of the simplified image displayed in the display area, instead of the simplified image displayed in the display area, the simplified image indicated by the latest simplified image information received is simple and simple. The effect that the converted image is updated is obtained.

  According to the eighth aspect of the present invention, when the display capability of the display means is not higher than the display capability of the display area, the adjustment reception image information indicating the adjustment reception image used when the adjustment content of the read image is received. On-screen that is not different from the image based on the read image indicated by the read image information received by the receiving means, the adjustment accepting image transmitted to the communication device and received in the display area by the receiving means received by the receiving means Compared to the case where the image is not displayed together with the image based on the read image, an effect that the highly accurate adjustment with respect to the read image is easily performed is obtained.

  According to the invention of claim 9, adjustment content information indicating the adjustment content received by the receiving unit of the communication device is transmitted to the image processing device, and adjustment is performed according to the adjustment content indicated by the adjustment content information transmitted from the communication device. When the read image information is transmitted to the communication device and the reception unit receives the read image information in a state where the image based on the read image is displayed in the display area, the read image information currently displayed in the display area is displayed. In place of the image based on the read image, the image based on the read image with a simple configuration compared to the case where the image based on the read image indicated by the latest read image information received by the receiving unit is not displayed on the display area. The effect that is updated is obtained.

  According to the invention according to claim 10, when the adjustment content information is transmitted from the communication device in a state where the simplified image is displayed on the display means, instead of the simplified image currently displayed on the display means, The simplified image is updated with a simple configuration as compared with the case where the simplified image adjusted according to the adjustment content indicated by the adjustment content information transmitted from the communication device is not displayed on the display unit. Is obtained.

  According to the invention of claim 11, when the simplified image information is to be transmitted to the communication device, the aspect ratio and the screen resolution of the simplified image display screen on which the simplified image in the display area is displayed are acquired, Based on the acquired aspect ratio and screen resolution, and the orientation of the communication device indicated by the orientation information transmitted from the communication device, the simplified image indicated by the simplified image information to be transmitted is previously set with respect to the orientation of the communication device. Compared to the case where there is no configuration that adjusts the simplified image information to be transmitted so that it can be displayed on the simplified image display screen to the maximum with the aspect ratio of the scanned image in the specified direction, the communication can be performed with a simpler configuration. The effect that the deterioration of the visibility of the simplified image accompanying the change in the orientation of the apparatus is suppressed can be obtained.

  According to the twelfth and thirteenth aspects of the present invention, when the read image information is to be transmitted to the communication device, the aspect ratio and screen of the read image display screen on which an image based on the read image in the display area is displayed. An image based on the read image indicated by the read image information to be transmitted is determined in advance based on the acquired aspect ratio, the screen resolution, and the orientation of the communication device indicated by the orientation information transmitted from the communication device. Compared to the case where there is no configuration that adjusts the read image information to be transmitted so that it is displayed on the read image display screen to the maximum with the aspect ratio of the read image in the specified direction, the orientation of the communication device is simple. The effect that the deterioration of the visibility of the image based on the read image accompanying the change of is suppressed is acquired.

It is a functional block diagram which shows an example of the principal part function of the image processing system which concerns on embodiment. It is a schematic perspective view which shows an example of the external appearance of the image processing system which concerns on embodiment. It is a block diagram which shows an example of a principal part structure of the electric system of the image processing apparatus contained in the image processing system which concerns on embodiment. It is a block diagram which shows an example of the principal part structure of the electrical system of the smart phone contained in the image processing system which concerns on embodiment. It is a flowchart which shows an example of the flow of the 1st image processing which concerns on embodiment. It is a flowchart which shows an example of the flow of the image adjustment non-support process which concerns on embodiment. It is a flowchart which shows an example of the flow of the image adjustment assistance process which concerns on embodiment. It is a continuation of the flowchart shown in FIG. It is a flowchart which shows an example of the flow of the 2nd image processing which concerns on embodiment. It is a display mode figure which shows an example of the image based on the read image displayed on the touchscreen display in the smart phone which concerns on embodiment, and the image for adjustment reception, and the example of the simplification image displayed on the touchscreen display of an image processing apparatus. . FIG. 11 is a display mode diagram illustrating an example of a state in which a neutralization process is performed on an image based on a read image and a simplified image illustrated in FIG. 10. It is a figure which shows the example of a mode at the time of changing direction of a smart phone from landscape orientation to portrait orientation. It is a figure which shows the example of a mode at the time of changing direction of a smart phone from portrait orientation to landscape orientation. FIG. 10 is a continuation of the flowchart shown in FIG. 9. It is a schematic block diagram which shows an example of a structure of the operation panel which concerns on a comparative example.

[Comparative example]
Prior to the description of embodiments of the disclosed technology, a comparative example of the disclosed technology will be described. FIG. 15 shows an operation panel 500 according to this comparative example. The operation panel 500 outputs, for example, a read image obtained by optically reading an area to be read (for example, a predetermined area including a document or a partial area in the document) with an image reading device (a scanner as an example). It is provided in a processing device (not shown). For example, the image processing apparatus performs printing by forming a read image on a sheet which is an example of a recording medium.

  An operation panel 500 displays an operation unit 502 that is operated when an instruction regarding various processes (for example, an instruction for image quality adjustment or an instruction to start printing) is given to the image processing apparatus, and information necessary for performing various processes. And a touch panel display 504 that receives various instructions. The operation unit 502 includes, for example, a start button 502A for instructing start of printing, a stop button 502B for instructing stop of printing, a numeric keypad 502C, and the like. The touch panel display 504 is roughly divided into a preview display area 504A at the center of the screen and a reception area 504B other than the preview display area. The preview display area 504A is formed in a rectangular shape and displays a simplified image. The simplified image refers to, for example, an image obtained by simplifying the read image (for example, an image obtained by thinning out pixels of the read image). A scroll bar is displayed on the lower side and the right side of the preview display area 504A when viewed from the front, and the simplified image moves in the preview display area 504A when the user operates the scroll bar through the touch panel.

  In the reception area 504B, a pull-down box 506 is displayed in addition to a start button for instructing start of printing and a stop button for instructing stop of printing. The pull-down box 506 displays the magnification of the simplified image displayed in the preview display area 504A, and the touch panel display 504 and the operation unit 502 accept any magnification displayed in the pull-down box. In the preview display area 504A, a simplified image is displayed at a magnification accepted by the touch panel display 504 or the operation unit 502.

  However, since the reception area 504B is displayed on the touch panel display 504, the display area of the preview display area 504A is limited. Therefore, it is difficult to grasp the entire image from the simplified image displayed in the preview display area 504A shown in FIG. 15 as compared with the case where the entire image of the simplified image is displayed using the entire surface of the touch panel display 504. It is. In addition, when the local area of the simplified image is confirmed in detail from the state where the entire image of the simplified image is displayed, it is necessary to enlarge the simplified image and to operate the scroll bar. . Even when the simplified image is enlarged and displayed and then the entire image of the simplified image is displayed again, it is necessary to return the magnification of the simplified image to the original (for example, from 600% to 100%). Therefore, it is difficult to confirm the local image while confirming the entire image of the adjusted read image after performing some adjustment on the read image. In addition, since the simplified image is displayed, it is difficult to grasp in detail the state of the read image after adjustment, compared to the case of displaying a higher definition image than the simplified image. Therefore, when fine adjustment is required for the read image (for example, when it is necessary to repeatedly display and check the entire image and the local image, it is necessary to check the state of the read image after adjustment in detail. In the case of ()), it is expected that the work until final output will be difficult.

[Embodiment]
Next, an example of an embodiment of the disclosed technology will be described in detail. In the following description, a multifunctional mobile phone, a so-called smartphone will be described as an example of a communication device, but the disclosed technology is not limited to this. The disclosed technology may be applied to various communication apparatuses such as portable personal computers, PDAs (Personal Digital Assistants), and stationary personal computers.

  FIG. 1 is a block diagram illustrating an example of the configuration of an image processing system 10 according to the present embodiment. As shown in FIG. 1, the image processing system 10 includes an image processing device 12 and a smartphone 14. The image processing apparatus 12 includes a reading unit 16, a display unit 18, a control unit 20, a determination unit 22, and a creation unit 24. On the other hand, the smartphone 14 includes a reception unit 26, a display control unit 28, a display area 30, a reception unit 32, and a detection unit 33.

  In the image processing apparatus 12, the reading unit 16 reads a read area to obtain a read image. The display unit 18 displays an image. In this embodiment, when the read image condition is satisfied, an image based on the read image obtained by the reading unit 16 (for example, an image created according to the screen resolution and aspect ratio of the display unit 18 determined in advance) is displayed. When the read image display condition is not satisfied, a simplified image obtained by simplifying the read image obtained by the reading unit 16 is displayed. In this embodiment, an image having a lower resolution than an image based on a read image is employed as an example of a simplified image.

  In the present embodiment, as an example of the “read image display condition”, a condition that the display capability of the display unit 18 is higher than the display capability of the display area 30 in the smartphone 14 is adopted. Further, in the present embodiment, screen resolution is adopted as an example of “display capability”. Therefore, the case where the read image condition is satisfied in the present embodiment refers to a case where the screen resolution of the display unit 18 is higher than the screen resolution of the display area 30, and the case where the read image condition is not satisfied in the present embodiment. Indicates a case where the screen resolution of the display unit 18 is not higher than the screen resolution of the display area 30. Other examples of “display capability” include screen size (screen area), screen brightness, screen aspect ratio, and the like. In addition, the value obtained by multiplying the numerical value for evaluating the screen resolution height, the numerical value for evaluating the screen size, the numerical value for evaluating the screen brightness, the numerical value for evaluating the aspect ratio of the screen, and the like as the “display capability” Good. That is, instead of determining the display capability based only on the screen resolution, the display capability may be determined by quantifying various elements that can serve as an index of the ease of visual recognition of the image and comprehensively judging them. . Note that the numerical value for evaluating the brightness of the screen refers to a numerical value that becomes higher as the brightness is close to a predetermined brightness, for example, as a brightness that is easy to visually recognize, and the numerical value for evaluating the aspect ratio of the screen is, for example, A numerical value in which the evaluation becomes higher as the aspect ratio is closer to the aspect ratio of the read image.

  When the read image display condition is satisfied, the control unit 20 causes the display unit 18 to display an image based on the read image obtained by the reading unit 16 and transmits simplified image information indicating the simplified image to the smartphone 14. To control. In addition, when the read image display condition is not satisfied, the control unit 20 causes the display unit 18 to display a simplified image and transmits read image information indicating the read image obtained by the reading unit 16 to the smartphone 14. To control.

  The determination unit 22 determines whether the read image display condition is satisfied. That is, in this embodiment, it is determined whether the display capability of the display unit 18 is higher than the display capability of the display area 30 in the smartphone 14.

  When the determination unit 22 determines that the read image display condition is satisfied, the creation unit 24 corresponds to the display capability of the display area 30 for the simplified image indicated by the simplified image information to be transmitted to the smartphone 14. Create as follows. The creation unit 24 creates a simplified image to be displayed on the display unit 18 so as to correspond to the display capability of the display unit 18 when the determination unit 22 determines that the read image display condition is not satisfied. To do. Furthermore, when the determination unit 22 determines that the read image display condition is satisfied, the creation unit 24 corresponds to the display capability of the display unit 18 for an image based on the read image to be displayed on the display unit 18. create.

  When the read image display condition is satisfied, the control unit 20 displays an image based on the read image within the screen on which the adjustment reception image used when receiving the adjustment content of the read image is not different from the image based on the read image on the display unit 18. Control to be displayed together. The “adjustment content” here means, for example, enlargement of the read image, reduction of the read image, deletion of the outer frame of the read image, deletion of the read image, image shift, tilt correction, image area extraction, and image area deletion. And so on. The above “deleting” refers to a process of erasing a black streak image corresponding to a fold obtained by reading an area including a fold of a booklet, for example. Further, as the “adjustment acceptance image” referred to here, for example, an image representing an operation button operated when an instruction for adjustment content is given to the image processing apparatus 12 or an input of an instruction for adjustment content to the user. For example, an image representing an urging message.

  When the adjustment content is received using the adjustment reception image displayed on the display unit 18, the control unit 20 receives the adjustment content instead of the image based on the read image currently displayed on the display unit 18. Further control is performed so that an image based on the read image adjusted according to the adjustment content is displayed on the display unit 18.

  Further, when the adjustment content of the read image is received in a state where the simplified image is displayed in the display area 30, the control unit 20 further transmits the simplified image information adjusted according to the adjustment content to the smartphone 14. Control.

  In addition, when the read image display condition is not satisfied, the control unit 20 further controls to transmit adjustment acceptance image information indicating the adjustment acceptance image to the smartphone 14.

  In addition, when the adjustment content information indicating the adjustment content transmitted from the smartphone 14 is transmitted, the control unit 20 transmits the read image information adjusted according to the adjustment content indicated by the transmitted adjustment content information to the smartphone 14. To control.

  In addition, when the adjustment content information is transmitted from the smartphone 14 in a state where the simplified image is displayed on the display unit 18, the control unit 20 replaces the simplified image currently displayed on the display unit 18 with the smartphone. 14 further controls the display unit 18 to display the simplified image adjusted in accordance with the adjustment content indicated by the adjustment content information transmitted from 14.

  In addition, when the simplified image information is to be transmitted to the smartphone 14, the control unit 20 acquires and acquires the aspect ratio and screen resolution of the simplified image display screen on which the simplified image in the display area 30 is displayed. Based on the aspect ratio, the screen resolution, and the orientation of the smartphone 14 indicated by the orientation information described later transmitted from the smartphone 14, the simplified image indicated by the simplified image information to be transmitted is previously set with respect to the orientation of the smartphone 14. The simplified image information to be transmitted is adjusted so as to be displayed on the simplified image display screen to the maximum in the predetermined direction with the aspect ratio of the read image.

  Further, when the read image information is to be transmitted to the smartphone 14, the control unit 20 acquires and acquires the aspect ratio and screen resolution of the read image display screen on which an image based on the read image in the display area 30 is displayed. Based on the aspect ratio, the screen resolution, and the orientation of the smartphone 14 indicated by the orientation information transmitted from the smartphone 14, an image based on the read image indicated by the read image information to be transmitted is determined in advance with respect to the orientation of the smartphone 14. The read image information to be transmitted is adjusted so that the aspect ratio of the read image is maximized on the read image display screen in the determined direction.

  On the other hand, in the smartphone 14, the reception unit 26 receives the simplified image information transmitted from the image processing device 12 when the read image display condition is satisfied. Further, the receiving unit 26 receives the read image information transmitted from the image processing device 12 when the read image display condition is not satisfied. Further, the receiving unit 26 receives the adjustment acceptance image information transmitted from the image processing device 12.

  The display control unit 28 performs control so that the simplified image indicated by the simplified image information received by the receiving unit 26 is displayed in the display region 30 when the read image display condition is satisfied. In addition, when the read image display condition is not satisfied, the display control unit 28 performs control so that an image based on the read image indicated by the read image information received by the receiving unit 26 is displayed in the display area 30.

  Further, the display control unit 28 displays a simplified image indicated by the latest simplified image information received by the receiving unit 26 in the display region 30 instead of the simplified image currently displayed in the display region 30. To be controlled.

  The display control unit 28 also includes an image based on the read image indicated by the read image information received by the reception unit 26 in the display area 30 and the adjustment reception image indicated by the adjustment reception image information received by the reception unit 26. Control is performed so that the image is displayed together with an image based on the read image in a screen that is not different from the image.

  Further, when the reception unit 26 receives read image information in a state where an image based on the read image is displayed in the display area 30, the display control unit 28 is based on the read image currently displayed in the display area 30. Instead of an image, control is performed so that an image based on the read image indicated by the latest read image information received by the receiving unit 26 is displayed in the display area 30.

  The accepting unit 32 accepts the adjustment content using the adjustment accepting image displayed in the display area 30. The smartphone 14 transmits adjustment content information indicating the adjustment content received by the reception unit 32 to the image processing device 12.

  The detection unit 33 detects the orientation of the smartphone 14. The smartphone 14 transmits orientation information indicating the orientation of the smartphone 14 detected by the detection unit 33 to the image processing device 12. Note that the “direction of the smartphone 14” here refers to a relative direction with respect to a reference direction such as a relative direction with respect to the vertical direction or a relative direction with respect to the horizontal direction when the smartphone 14 is in a standing state, for example. .

  FIG. 2 schematically shows the image processing system 10 according to the present embodiment. The image processing apparatus 12 shown in FIG. 1 has an image reading function for optically reading a read area of a document and generating read image information indicating a read image obtained by reading. Further, the image processing apparatus 12 has an image forming function for forming an image on a sheet based on read image information obtained by optically reading a read area of a document by an image reading function or image information acquired from the outside. Yes. In addition, the image processing apparatus 12 includes an operation panel 34. The operation panel 34 is operated by a user or the like of the image processing apparatus 12, and is necessary for performing various processes with an operation unit 36 that is operated when an instruction regarding various processes is given to the image processing apparatus 12. A touch panel display 38 for displaying various information and receiving various instructions. The operation unit 36 includes, for example, a power-on operation button, a numeric keypad, a start button operated when instructing start of printing, and a stop button operated when instructing stop of printing. Yes. The touch panel display 38 is formed, for example, by superimposing a transmissive touch panel on a liquid crystal display, and functions as the display unit 18 shown in FIG.

  The image processing apparatus 12 according to the present embodiment is provided with an image adjustment support mode and an image adjustment non-support mode. Either the image adjustment support mode or the image adjustment non-support mode is set in the image processing device 12. An instruction for setting these modes is received by the operation panel 34. When the image adjustment support mode is set by instructing the setting of the image adjustment support mode, communication is established between the image processing device 12 and the smartphone 14. Then, an image based on the read image is displayed on one of the touch panel display 38 and the smartphone 14 of the image processing apparatus 12 and a simplified image is displayed on the other. That is, in this case, the image based on the read image and the simplified image are presented to the user at a time that is not different. On the other hand, when the image adjustment non-support mode is set by instructing the setting of the image adjustment non-support mode, an image based on the read image is not displayed on the smartphone 14, and the touch panel display 38 of the image processing apparatus 12 is displayed. A simplified image is displayed.

  On the other hand, the smartphone 14 includes a so-called general mobile phone function and a touch panel display 39 which is an example of the display area 30 and the reception unit 32 shown in FIG. The image processing device 12 and the smartphone 14 both have a communication function for exchanging information with each other. For example, the image processing apparatus 12 and the smartphone 14 exchange information with each other by wireless communication in an ad hoc mode (hereinafter referred to as “ad hoc communication”) by using a communication function. In the image processing system 10 according to the present embodiment, a communication area related to ad hoc communication performed between the image processing device 12 and the smartphone 14 is limited to a range of several meters from the image processing device 12 as an example. Accordingly, if at least one of the image processing device 12 and the smartphone 14 is out of the communication area, ad hoc communication cannot be performed between the image processing device 12 and the smartphone 14.

  The transmission unit 20, the control unit 22, and the reception unit 24 illustrated in FIG. 1 are realized by, for example, the computer 40 and other input / output devices illustrated in FIG. FIG. 3 shows an example of the main configuration of the electrical system of the image processing apparatus 12. As shown in FIG. 3, the computer 40 includes a CPU (Central Processing Unit) 42, a memory 44, and a nonvolatile storage unit 46, which are configured to include an address bus, a control bus, a system bus, and the like. 48 are connected to each other. The storage unit 46 is realized by an HDD (Hard Disk Drive), a flash memory, or the like. A first image processing program 50 is stored in the storage unit 46 as a storage medium. In addition, image information for accepting adjustment is stored in a predetermined storage area 52 of the storage unit 46.

  The CPU 42 reads the first image processing program 50 from the storage unit 46 and develops it in the memory 44, and sequentially executes the processes that the first image processing program 50 has. The first image processing program 50 includes a control process 54, a determination process 56, and a creation process 58. The CPU 42 operates as the control unit 20 illustrated in FIG. 1 by executing the control process 54. The CPU 42 operates as the determination unit 22 illustrated in FIG. 1 by executing the determination process 56. The CPU 42 operates as the creation unit 24 illustrated in FIG. 1 by executing the creation process 58.

  Although the case where the first image processing program 50 is read from the storage unit 46 is illustrated here, it is not necessarily stored in the storage unit 46 from the beginning. For example, the first image processing program 50 is first stored in an arbitrary “portable storage medium” such as a flexible disk connected to the computer 40, so-called FD, CD-ROM, DVD disk, magneto-optical disk, IC card or the like. May be stored. The computer 40 may acquire and execute the first image processing program 50 from these portable storage media. Further, the first image processing program 50 is stored in another computer or server device connected to the computer 40 via the Internet, a LAN (Local Area Network), or the like, and the computer 40 then stores the first image processing program. 50 may be acquired and executed.

  The image processing apparatus 12 is an input / output interface (I / O) that electrically connects the computer 40 and various input / output devices to control transmission and reception of various information between the computer 40 and various input / output devices. ) 60. In this embodiment, as an input / output device that is electrically connected to the computer 40 via the bus 48 by being connected to the I / O 60, the operation panel 34, the reading unit 62, the image forming unit 68, and the ad hoc communication interface are used. (I / F) 70 is provided.

  The reading unit 62 acquires read image information by scanning the read area using an image sensor, and operates as the reading unit 16 illustrated in FIG. In the present embodiment, as the reading unit 62, a CCD (Charge Coupled Devices) optical reduction type image scanner, which is a flood head type scanner equipped with an automatic document feeder (so-called ADF), is applied. However, the present invention is not limited to this, and a handy type or drum type image scanner may be applied. In addition, an image scanner including another imaging device such as a CIS (Contact Image Sensor) contact sensor type image scanner may be applied, without being limited to a CCD (Charge Coupled Devices) optical reduction type image scanner.

  The image forming unit 68 forms a read image indicated by the read image information on a sheet. In this embodiment, a xerographic printer is applied as an example of the image forming unit 68. However, the present invention is not limited to this, and an inkjet printer, a thermal printer, a dot impact printer, or the like may be applied.

  The ad hoc communication I / F 70 controls the exchange of various information with the smartphone 14 by ad hoc communication.

  On the other hand, the receiving unit 26, the display control unit 28, and the detection unit 33 illustrated in FIG. 1 can be realized by, for example, the computer 72 and other input / output devices illustrated in FIG. FIG. 4 shows an example of the main configuration of the electrical system of the smartphone 14. As shown in FIG. 4, the computer 72 includes a CPU 74, a memory 76, and a nonvolatile storage unit 78, which are connected to each other via a bus 80 including an address bus, a control bus, a system bus, and the like. Has been. The storage unit 78 can be realized by an HDD, a flash memory, or the like. A second image processing program 82 is stored in the storage unit 78 as a storage medium. The CPU 74 reads the second image processing program 82 from the storage unit 78 and develops it in the memory 76, and sequentially executes the processes included in the second image processing program 82. The second image processing program 82 includes a reception process 84, a display control process 86, and a detection process 88. The CPU 74 operates as the reception unit 26 illustrated in FIG. 1 by executing the reception process 84. The CPU 74 operates as the display control unit 28 shown in FIG. 1 by executing the display control process 86. The CPU 74 operates as the detection unit 33 illustrated in FIG. 1 by executing the detection process 88.

  Although the case where the second image processing program 82 is read from the storage unit 78 is illustrated here, it is not necessarily stored in the storage unit 78 from the beginning. For example, first, the second image processing program 82 is stored in an arbitrary “portable storage medium” such as a flexible disk connected to the computer 72, so-called FD, CD-ROM, DVD disk, magneto-optical disk, IC card, or the like. May be stored. The computer 40 may acquire the second image processing program 82 from these portable storage media and execute it. In addition, the second image processing program 82 is stored in another computer or server device connected to the computer 40 via the Internet, a LAN (Local Area Network), or the like, from which the computer 40 can store the second image processing program. 82 may be acquired and executed.

  The smartphone 14 includes an I / O 90 that electrically connects the computer 72 and various input / output devices to control transmission and reception of various information between the computer 72 and various input / output devices. In the present embodiment, as an input / output device that is electrically connected to the computer 72 via the bus 80 by being connected to the I / O 90, the touch panel display 39, the communication unit 95, the transmitter 96, and the receiver 98 and ad hoc communication I / F99. In addition, the smartphone 14 includes an acceleration sensor 91 that detects acceleration, which is an example of a physical quantity used when detecting the orientation of the smartphone 14, and the acceleration sensor 91 is also connected to the I / O 90. Yes.

  The communication unit 95 transmits and receives various information between the information processing apparatus (not shown) connected to the wireless communication network and the computer 72 by performing wireless communication with the nearest base station of the wireless communication network. To manage. The communication unit 95 includes, for example, an antenna (not shown) and an RF (Radio Frequency) circuit (not shown). In this case, for example, the communication unit 95 receives a signal wirelessly transmitted from an external information processing apparatus via a base station by an antenna, demodulates the received signal by an RF circuit, and is included in the received signal. Information is supplied to the computer 72. In addition, the communication unit 95 modulates the information supplied from the computer 72 and transmits the information to an external information processing apparatus via an antenna via a base station.

  The transmitter 96 captures the voice that the user of the smartphone 14 uttered during a call and outputs a voice signal indicating the captured voice to the computer 72. The transmitter 96 includes, for example, a microphone (not shown) and a signal processing circuit (not shown). In this case, for example, a voice is captured by a microphone, and the voice captured by the microphone is converted into a voice signal by a signal processing circuit and output to the communication unit 95 via the computer 72. Here, an example in which an audio signal is output to the communication unit 95 via the computer 72 is illustrated, but a signal processing unit included in the transmitter 96 may be directly output to the communication unit 95.

  The receiving unit 98 outputs the voice indicated by the voice information received by the communication unit 95. The receiver 98 includes, for example, a D / A (digital / analog) conversion circuit (not shown), an amplifier (not shown), and a speaker (not shown). In this case, for example, the D / A conversion circuit performs D / A conversion on the audio signal supplied from the computer 72, and outputs the signal amplified by the amplifier after D / A conversion to the speaker. The speaker outputs sound corresponding to the signal supplied from the D / A conversion circuit to the outside. Here, an example in which the audio signal received by the communication unit 95 is supplied to the receiver 98 via the computer 72 is illustrated, but the audio signal received by the communication unit 95 does not pass through the computer 72. May be supplied directly to the receiver 98.

  The ad hoc communication I / F 99 is responsible for exchanging various information with the image processing apparatus 12 by ad hoc communication.

  Next, as an operation of the present embodiment, the first image processing performed by the image processing apparatus 12 when the CPU 42 executes the first image processing program 50 will be described with reference to FIG. In the first image processing shown in FIG. 5, first, in step 100, the control unit 20 causes the reading unit 62 to start reading the read area of the document. Subsequently, in step 102, the control unit 20 executes step 100, whereby the read image information obtained by the reading unit 62 is acquired, and the acquired read image information is stored in the memory 44. In the next step 104, simplified image information is created by the creating unit 20 based on the read image information stored in the memory 44 in step 102, and the created simplified image information is stored in the memory 44. Here, the creation unit 24 creates simplified image information so as to correspond to the display capability of the touch panel display 38. For example, the simplified image information is displayed so that the simplified image is displayed to the maximum on the screen based on the screen resolution and aspect ratio of the screen predetermined as the screen on which the simplified image is displayed on the touch panel display 38. Create

  In the next step 106, the control unit 20 determines whether or not the image adjustment support mode is set. If it is determined in step 106 that the image adjustment support mode is not set, the determination is negative and the routine proceeds to step 108. In step 108, the control unit 20 executes the image adjustment non-support processing program shown in FIG. 6 to perform the image adjustment non-support processing, and then ends the first image processing.

  FIG. 6 is a flowchart showing an example of the flow of the image adjustment non-support processing program. In step 150 shown in FIG. 6, the control unit 20 determines whether or not an instruction to display a simplified image (simplified image display instruction) is received by the touch panel display 38. In step 150, if a simplified image display instruction is accepted, the determination is affirmed and the process proceeds to step 152. On the other hand, if the simplified image display instruction is not accepted, the determination is denied and the process proceeds to step 154. . In step 152, the simplified image indicated by the simplified image information stored in the memory 44 is displayed on the display unit 18.

  In step 154, the control unit 20 determines whether or not the touch panel display 38 has received the adjustment content to be performed on the read image indicated by the read image information stored in the memory 44. In this step 154, if the adjustment content is accepted, the determination is affirmed and the process proceeds to step 156, whereas if the adjustment content is not accepted, the process proceeds to step 160.

  In step 156, the read image information stored in the memory 44 is adjusted by the control unit 24 according to the adjustment content received in step 154. Subsequently, in step 158, the simplified image information stored in the memory 44 is updated by the control unit 18 based on the read image information adjusted in step 156. Then, the simplified image indicated by the updated simplified image information is displayed on the touch panel display 38 by the control unit 18 instead of the simplified image currently displayed. That is, instead of the simplified image currently displayed, a simplified image reflecting the adjustment content is displayed on the touch panel display 38.

  In step 160, the control unit 20 determines whether or not an instruction to form an image (image formation instruction) on the image forming unit 68 has been received by the receiving unit 64. In step 160, if an image formation instruction is accepted, the determination is affirmed and the process proceeds to step 162. If the image formation instruction is not accepted, the determination is negative and the process proceeds to step 164. In step 164, it is determined whether or not a predetermined condition (image adjustment non-support process end condition) is satisfied as a condition for ending this image adjustment non-support process. In step 164, if the image adjustment non-support process end condition is satisfied, the determination is affirmed and the process proceeds to step 166. On the other hand, if the image adjustment non-support process end condition is not satisfied, the process returns to step 154. As the image adjustment non-support process end condition, for example, a condition that a predetermined time has elapsed since the execution of step 158 described above, a condition that the touch panel display 38 receives an instruction to end the image adjustment non-support process, or the like. Can be mentioned.

  In step 162, the control unit 20 causes the image forming unit 68 to form an image based on the read image indicated by the read image information currently stored in the memory 44 on the sheet. Subsequently, in step 166, the read image information and simplified image information stored in the memory 44 (hereinafter referred to as “image information” when there is no need to distinguish between them) are stored in the memory 44 by the control unit 20. And this image adjustment non-support process is terminated.

  On the other hand, if the image adjustment support mode is set in step 106, the determination is affirmed and the routine proceeds to step 110. In step 110, the control unit 20 determines whether or not ad hoc communication between the image processing apparatus 12 and the smartphone 14 has been established. In this step 110, when ad hoc communication between the image processing apparatus 12 and the smartphone 14 is established, the determination is affirmed and the process proceeds to step 112. In step 112, the control unit 20 executes the image adjustment support processing program shown in FIG. 7 to perform the image adjustment support processing, and then ends the first image processing.

  FIG. 7 is a flowchart showing an example of the flow of the image adjustment support processing program. In step 200 shown in FIG. 7, the control unit 20 transmits a provision request signal for requesting provision of display capability information indicating the display capability of the display area 30 to the smartphone 14. In response to this, display capability information is transmitted by executing step 308 of second image processing, which will be described later, by the smartphone 14. Subsequently, in step 202, the control unit 20 determines whether display capability information has been received. If the display capability information is received in step 202, the determination is affirmed and the process proceeds to step 204. If the display capability information is not received, the determination is denied and the process proceeds to step 206. In step 206, the control unit 20 determines whether or not a predetermined time has elapsed since the transmission of the provision request signal was first started in step 200. In step 206, when a predetermined time has elapsed since the transmission of the provision request signal was first started, the determination is affirmed, and the process proceeds to step 208 shown in FIG. In step 206, if the predetermined time has not elapsed since the transmission of the provision request signal was first started, the determination is negative and the routine returns to step 200.

  In step 208 shown in FIG. 8, the simplified image information currently stored in the memory 44 is transmitted to the smartphone 14 by the control unit 20. However, if the determination is negative in step 204 described later, in this step 208, a display in which the simplified image indicated by the simplified image information currently stored in the memory 44 is received by the creating unit 24 in step 202 is displayed. Adjusted according to capability information. Here, the display capability (for example, screen resolution) of the touch panel display 39 is employed as an example of the display capability of the display area 30 indicated by the display capability information. Accordingly, the simplified image indicated by the simplified image information currently stored in the memory 44 is created so as to correspond to the display capability of the touch panel display 39. Then, simplified image information indicating the created simplified image is transmitted to the smartphone 14 by the control unit 20.

  Subsequently, in step 210, the creation unit 24 creates an image based on the read image indicated by the read image information stored in the memory 44. Here, the creation unit 24 creates an image based on the read image so as to correspond to the display capability of the touch panel display 38. For example, the read image according to the screen resolution and aspect ratio of a screen (an area other than the area where the adjustment acceptance image is displayed as an example here) predetermined as a screen on which an image based on the read image is displayed on the touch panel display 38 Create an image based on. An image based on the read image created in this way is displayed on the touch panel display 38 by the control unit 20. In step 210, the control unit 20 reads the adjustment acceptance image indicated by the adjustment acceptance image information stored in the predetermined storage area 52 within a screen that is not different from the image based on the read image. Displayed with an image based image.

  In step 212, the control unit 20 determines whether or not adjustment content of the read image has been received by the touch panel display 38. In step 212, when the adjustment content of the read image is accepted, the process proceeds to step 214. On the other hand, when the adjustment content of the read image is not accepted, the determination is negative and the process proceeds to step 220.

  In step 214, the read image information stored in the memory 44 is adjusted by the control unit 20 according to the adjustment content received in step 212. Subsequently, in step 216, the creation unit 24 creates an image based on the read image indicated by the read image information stored in the memory 44. Then, the control unit 20 displays an image based on the latest read image created on the touch panel display 38 instead of the image based on the read image currently displayed. The control unit 20 continues to display the adjustment acceptance image in a screen that is not different from the image based on the read image.

  In the next step 218, the simplified image information stored in the memory 44 is updated by the control unit 20 based on the read image information adjusted in step 214. Then, the updated simplified image information is transmitted to the smartphone 14 by the control unit 20.

  In the next step 220, the control unit 20 determines whether or not an image formation instruction has been received by the receiving unit 64. In step 220, if an image formation instruction is accepted, the determination is affirmed and the process proceeds to step 238. On the other hand, if the image formation instruction is not accepted, the determination is negative and the process proceeds to step 222.

  In step 222, it is determined whether or not a predetermined condition (image adjustment support process end condition) is satisfied as a condition for ending the image adjustment support process. If the image adjustment support process end condition is satisfied in step 222, the determination is affirmed and the process proceeds to step 242. On the other hand, if the image adjustment support process end condition is not satisfied, the process returns to step 212. Examples of the condition for ending the image adjustment support process include a condition that a predetermined time has elapsed since the execution of step 218, a condition that the touch panel display 38 has received an instruction to end the image adjustment support process, and the like. It is done.

  On the other hand, in step 204, the determination unit 22 has a relationship of “display capability of the touch panel display 39 indicated by the display capability information received in step 202 ≧ display capability of the touch panel display 38 of the image processing device 12”. It is determined whether it is established. In this step 204, when the relationship “the display capability of the touch panel display 39 indicated by the display capability information received in step 202 ≧ the display capability of the touch panel display 38 of the image processing apparatus 12” is not established. The determination is negative and the routine proceeds to step 208 shown in FIG. In this step 204, when the relationship “the display capability of the touch panel display 39 indicated by the display capability information received in step 202 ≧ the display capability of the touch panel display 38 of the image processing device 12” is established. The determination is affirmed and the routine proceeds to step 224.

  In step 224, the read image information currently stored in the memory 44 and the adjustment acceptance image information stored in the predetermined storage area 52 are transmitted to the smartphone 14 by the control unit 20. Subsequently, in step 226, the simplified image indicated by the simplified image information stored in the memory 44 is displayed on the touch panel display 38 by the control unit 20.

  In the next step 228, the control unit 20 determines whether or not adjustment content information transmitted by executing step 322 of the second image processing described later is received. In step 228, if adjustment content information is received, the determination is affirmed and the process proceeds to step 230. On the other hand, if adjustment content information is not received, the determination is negative and the process proceeds to step 236. In step 230, the control unit 20 adjusts the read image information stored in the memory 44 in accordance with the adjustment content indicated by the adjustment content information received in step 228. Subsequently, in Step 232, the read image information adjusted in Step 230 is transmitted to the smartphone 14 by the control unit 20.

  In the next step 234, the simplified image information stored in the memory 44 is updated by the control unit 20 based on the read image information adjusted in step 230. Then, the control unit 20 displays a simplified image indicated by the updated simplified image information on the touch panel display 38.

  Subsequently, in step 236, the control unit 20 determines whether an image formation instruction has been received by the receiving unit 64. In step 236, if an image formation instruction is accepted, the determination is affirmed and the process proceeds to step 238. On the other hand, if the image formation instruction is not accepted, the determination is negative and the process proceeds to step 240.

  In step 240, the control unit 20 determines whether or not a predetermined condition (image adjustment support process end condition) is satisfied as a condition for ending this image adjustment support process. If the image adjustment support process end condition is satisfied in step 240, the determination is affirmed and the process proceeds to step 242. If the image adjustment support process end condition is not satisfied, the process returns to step 228. Examples of the condition for ending the image adjustment support process include a condition that a predetermined time has elapsed since the execution of step 234 described above, a condition that the touch panel display 38 has received an instruction to end the image adjustment support process, and the like. It is done.

  In step 238, the control unit 20 causes the image forming unit 68 to form an image based on the read image indicated by the read image information currently stored in the memory 44 on the sheet.

  In the next step 242, the control unit 20 determines whether a condition for disconnecting ad hoc communication between the image processing device 12 and the smartphone 14 (communication disconnection condition) is satisfied. Examples of the communication disconnection condition include a condition that a predetermined time has elapsed since the execution of step 238 described above, and a condition that the touch panel display 38 receives an instruction to disconnect ad hoc communication with the smartphone. In step 242, if the communication disconnection condition is satisfied, the determination is affirmed and the process proceeds to step 244. On the other hand, if the communication disconnection condition is not satisfied, the determination is negative and the process proceeds to step 246.

  In step 244, the ad hoc communication between the image processing apparatus 12 and the smartphone 14 is disconnected by the control unit 20. Subsequently, in step 246, the control unit 20 deletes the image information stored in the memory 44 from the memory 44, and the present image adjustment support process is terminated.

  On the other hand, if the ad hoc communication between the image processing apparatus 12 and the smartphone 14 is not established in step 110, the determination is negative and the process proceeds to step 114. In step 114, the control unit 20 determines whether or not a response signal transmitted by executing step 306 of the second image processing described later has not been received yet. In step 114, if a response signal is received, the determination is negative and the process returns to step 110. On the other hand, if the response signal is not received, the determination is affirmative and the process proceeds to step 116.

  In step 116, the control unit 20 transmits a communication establishment request signal for requesting establishment of communication with the image processing apparatus 12 to the smartphone 14. Subsequently, in step 118, the control unit 20 determines whether or not a predetermined time has elapsed since the step 116 was first executed. In step 118, if the predetermined time has elapsed since the first execution of step 116, the determination is affirmed and the process proceeds to step 120. On the other hand, if the predetermined time has not elapsed, the determination is made. Is denied and the routine proceeds to step 114.

  In step 120, the control unit 20 executes time-out handling processing, and then ends the first image processing. Examples of the time-out handling process include the image adjustment non-support process in step 108 or a process for notifying the display unit 66 that an error has occurred (for example, that communication establishment has not been established). In addition to this, for example, while waiting for reception of an image formation instruction while a notification that an error has occurred is performed for a certain period of time, a read image is displayed to the image forming unit 68 when the image formation instruction is received. An example of a process for handling a time-out is a process to form on a sheet.

  Next, the second image processing performed by the smartphone 14 when the CPU 74 in the smartphone 14 executes the second image processing program 82 will be described with reference to FIG. In the second image processing illustrated in FIG. 9, first, in step 300, the receiving unit 26 determines whether or not ad hoc communication between the image processing device 12 and the smartphone 14 has been established. In this step 300, if ad hoc communication between the image processing apparatus 12 and the smartphone 14 is established, the determination is affirmed and the process proceeds to step 302. If the ad-hoc communication between the image processing apparatus 12 and the smartphone 14 is not established in step 300, the determination is denied and the process proceeds to step 304.

  In step 304, it is determined whether or not the communication unit request signal transmitted from the image processing apparatus 12 is received by the reception unit 26 executing step 116 of the first image processing program 50 by the control unit 20. . If the communication establishment request signal has not been received in step 304, the determination is negative and the routine returns to step 300. If the communication establishment request signal is received in step 304, the determination is affirmed and the routine proceeds to step 306. In step 306, the response signal is transmitted to the image processing apparatus 12 by the receiving unit 26, and then the process returns to step 300.

  In step 302, the receiving unit 26 determines whether or not the provision request signal transmitted from the image processing apparatus 12 has been received by executing step 200 shown in FIG. If the provision request signal has not been received in step 302, the determination is negative and the routine proceeds to step 305. If the provision request signal is received in step 302, the determination is affirmed and the routine proceeds to step 308.

  In step 305, the receiving unit 26 determines whether or not a predetermined time has elapsed since the execution of step 300 described above. If it is determined in step 305 that the predetermined time has not elapsed, the determination is negative and the process returns to step 302. In step 305, when a predetermined time has elapsed, the determination is affirmed and the routine proceeds to step 342 shown in FIG.

  In step 308, the display unit 26 transmits display capability information to the image processing apparatus 12. Subsequently, in step 310, the receiving unit 26 determines whether or not the read image information transmitted from the image processing apparatus 12 has been received. If the read image information is not received in step 310, the determination is negative and the process proceeds to step 330 shown in FIG. If the read image information is received in step 310, the determination is affirmed and the process proceeds to step 312.

  In step 312, the display control unit 28 displays an image based on the read image indicated by the read image information received in step 310 on the touch panel display 39. Subsequently, in step 314, the receiving unit 26 determines whether adjustment acceptance image information has been received. If the adjustment acceptance image information is not received in step 314, the determination is negative and the process proceeds to step 316. In step 316, the receiving unit 26 determines whether or not a condition (second image processing end condition) set in advance as a condition for ending the second image processing is satisfied. In this step 316, if the second image processing end condition is satisfied, the determination is affirmed and the process proceeds to step 342 shown in FIG. 14, whereas if the second image processing end condition is not satisfied, the process returns to step 314. Examples of the second image processing end condition include a condition that a predetermined time has elapsed since the execution of step 312 and a condition that the touch panel display 39 receives an instruction to end the second image processing. It is done.

  On the other hand, if the adjustment acceptance image information is received at step 314, the determination is affirmed and the routine proceeds to step 318. In step 318, the adjustment acceptance image indicated by the adjustment acceptance image information received in step 314 is different from the image based on the read image currently displayed on the touch panel display 39 by the display control unit 28. Displayed together with the image based on the read image in the screen.

  FIG. 10 illustrates an example of an image based on a read image displayed on a screen that is not different from the touch panel display 39 of the smartphone 14 and an image for accepting adjustment, and simplification displayed on the touch panel display 38 of the image processing apparatus 12. An example of an image is shown. The example shown in FIG. 10 shows an aspect in which a schematic overall image of a read image is displayed as an image based on the read image indicated by the read image information received in step 310 above on a part of the touch panel display 39. ing. Further, the example shown in FIG. 10 shows a mode in which the adjustment acceptance image is displayed in a region other than the image based on the read image of the touch panel display 39. The adjustment acceptance image shown in FIG. 10 includes a start button that is pressed when instructing the image processing device 12 to start image formation and a stop button that instructs the image processing device 12 to stop image formation. It is. Further, the adjustment acceptance image shown in FIG. 10 includes an area designation button that is operated when an area to be displayed on the touch panel display 38 of the image processing apparatus 12 is designated. In addition, the image for accepting adjustment shown in FIG. 10 includes a cancel button that is operated when instructing the cancel processing. Furthermore, the adjustment acceptance image shown in FIG. 10 includes an inclination correction button that is operated when a process for correcting the inclination of the read image on the screen is instructed.

  On the other hand, on the touch panel display 38 shown in FIG. 10, a simplified image adjusted according to the adjustment content currently set for the image processing apparatus 12 is displayed. Note that FIG. 10 illustrates an example in which a simplified image of an area corresponding to an area designated by the area designation button of the smartphone 14 among images based on the read image is displayed.

  In step 320, the display control unit 28 determines whether or not the adjustment content of the read image has been received by the touch panel display 39. If the adjustment content is not accepted in step 320, the determination is negative and the routine proceeds to step 324. In this step 320, when the adjustment content is accepted, the determination is affirmed and the routine proceeds to step 322. In step 322, the display control unit 28 indicates the adjustment content received in step 320, and the adjustment content information including the screen resolution of the read image display screen, the aspect ratio, and the orientation information obtained by the detection unit 33 is displayed in FIG. As shown in step 228 shown in FIG.

  In step 324, the receiving unit 26 determines whether or not the adjusted read image information transmitted from the image processing apparatus 12 has been received by the control unit 20 executing step 232 shown in FIG. 7. If the adjusted read image information is not received in step 324, the determination is negative and the process proceeds to step 328. If the adjusted read image information is received in step 324, the determination is affirmed and the process proceeds to step 326.

  In step 326, the display control unit 28 replaces the image based on the read image currently displayed on the touch panel display 39 with the read image indicated by the adjusted read image information received in step 324. An image is displayed on the touch panel display 39.

  FIG. 11 shows an example of a simplified image after adjustment displayed on the touch panel display 38 of the image processing apparatus 12, and an image and adjustment reception based on the read image after adjustment displayed on the touch panel display 39 of the smartphone 14. An example of an image for use is shown. In the example shown in FIG. 11, a state in which a slider for adjusting the amount of erase is displayed by operating the erase button on the smartphone 14 is shown. The erase amount specified by operating the slider is transmitted to the image processing apparatus 12 by executing step 322 described above. The image processing apparatus 12 receives the erase amount transmitted from the smartphone 14, and performs the erase processing on the read image according to the received erase amount. Then, a simplified image obtained by simplifying the read image subjected to the decoloring process is displayed on the touch panel display 38 as shown in FIG. 11 as an example. The read image information indicating the read image that has been subjected to the decoloring process is transmitted to the smartphone 14 by the image processing device 12, and the smartphone 14 receives the read image information by executing step 324 described above. As an example, an image based on the read image indicated by the received read image information is displayed on the touch panel display 39 as shown in FIG.

  The adjustment content information transmitted from the smartphone 14 to the image processing device 12 includes the screen resolution, aspect ratio, and orientation information of the read image display screen. Therefore, the image processing apparatus 12 adjusts the read image information to be transmitted to the smartphone 14 based on the screen resolution, aspect ratio, and orientation information of the read image display screen. 7 is executed by the control unit 20 so that the orientation of the image based on the read image displayed on the touch panel display 39 becomes a predetermined orientation with respect to the orientation of the smartphone 14. The read image information to be transmitted to the smartphone 14 is adjusted.

  In this case, for example, when the orientation of the smartphone 14 on which the image based on the read image is displayed on the touch panel display 39 is changed as shown in FIGS. In addition, the screen resolution and the aspect ratio of the read image display screen on which an image based on the read image on the touch panel display 39 is displayed are transmitted from the smartphone 14 to the image processing device 12. In addition, although the case where the image processing apparatus 12 acquires the orientation information, the screen resolution, and the aspect ratio by being transmitted from the smartphone 14 is illustrated here, the present invention is not limited thereto, and the orientation information, the screen resolution, and the aspect ratio are illustrated. At least one of the above may be received by the touch panel display 38. Further, at least one of the orientation information, the screen resolution, and the aspect ratio may be received by the touch panel display 39 of the smartphone 14 and the received information may be transmitted to the image processing device 12. If the communication destination smartphone 14 is fixed, at least one of orientation information, screen resolution, and aspect ratio is stored in the storage unit 46 in advance, and the orientation information, screen resolution, and At least one of the aspect ratios may be acquired.

  When the orientation information, the screen resolution and the aspect ratio of the read image display screen are transmitted from the smartphone 14 (step 322), the image processing apparatus 12 receives the orientation information, the screen resolution, and the aspect ratio (step 228) and has received them. The read image information is adjusted based on the orientation information, the screen resolution, and the aspect ratio (step 230). For example, as shown in FIG. 13, when the orientation of the smartphone 14 is changed from the portrait orientation to the landscape orientation, if the read image indicated by the read image information stored in the memory 44 is vertically long, the short direction of the read image display screen The read image information to be transmitted is adjusted in accordance with the number of pixels (the number of horizontal pixels) (so that it is within the shortest direction of the read image display screen). In addition, when the orientation of the smartphone 14 is changed from the landscape orientation to the portrait orientation as shown in FIG. 12, if the read image indicated by the read image information stored in the memory 44 is horizontally long, the longitudinal direction of the read image display screen is displayed. The read image information is adjusted according to the number of pixels (the number of vertical pixels) (so as to be within the maximum extent in the longitudinal direction of the read image display screen). Then, the image processing device 12 transmits the adjusted read image information to the smartphone 14 (step 232).

  In the smartphone 14, the latest read image information transmitted from the image processing device 12 is received by executing the above step 324 by the receiving unit 26. An image based on the read image indicated by the received read image information is illustrated as an example when the orientation of the smartphone 14 is changed from the vertical orientation to the horizontal orientation by the above-described step 326 being executed by the display control unit 28. 13 is displayed. Further, when the orientation of the smartphone 14 is changed from the landscape orientation to the portrait orientation, it is displayed as shown in FIG. 12 as an example. Although the case where the orientation information, the screen resolution, and the aspect ratio are included in the adjustment content information is illustrated here, the orientation of the smartphone 14 is changed without including the orientation information, the screen resolution, and the aspect ratio in the adjustment content information. Orientation information, screen resolution, and aspect ratio are transmitted to the image processing device 12, and the image processing device 12 adjusts the read image information based on the orientation information, screen resolution, and aspect ratio, and the adjusted read image information is displayed. You may make it transmit to the smart phone 14. FIG. Moreover, although the case where the direction of the image based on the read image displayed on the smartphone 14 is adjusted according to the change of the direction of the smartphone 14 is illustrated here, the smartphone 14 is changed according to the change of the direction of the smartphone 14. The orientation of the simplified image to be displayed may be adjusted. In this case, the method described above may be used.

  In step 328, the display control unit 28 determines whether or not a condition (adjustment end condition) set in advance as a condition for ending adjustment related to image display based on the read image is satisfied. In step 328, if the reading end condition is satisfied, the determination is affirmed and the process proceeds to step 342 shown in FIG. 14, whereas if the adjustment end condition is not satisfied, the process returns to step 320. As the adjustment end condition, for example, a condition that a predetermined time has elapsed since the execution of step 318 described above, a condition that the reception unit 92 has received an adjustment end instruction, or the like can be cited.

  On the other hand, in step 330 shown in FIG. 14, the receiving unit 26 determines whether or not the simplified image information transmitted from the image processing apparatus 12 is received by the CPU 42 executing step 218 shown in FIG. 8. The If the simplified image information is not received in step 330, the determination is denied and the process proceeds to step 332. If the simplified image information is received in step 330, the determination is affirmed and the process proceeds to step 334.

  In step 332, the receiving unit 26 determines whether or not a predetermined time has elapsed since the above step 308 was executed. If it is determined in step 332 that the predetermined time has not elapsed, the determination is negative and the processing returns to step 310. In step 332, if a predetermined time has elapsed, the determination is affirmed and the routine proceeds to step 342.

  In step 334, the simplified image indicated by the simplified image information received in step 330 is displayed on the touch panel display 39 by the display control unit 28. Subsequently, in step 336, it is determined whether or not the simplified simplified image information transmitted from the image processing apparatus 12 is received by the receiving unit 26 when the control unit 20 executes step 208 shown in FIG. Determined. If it is determined in step 336 that the simplified image information after adjustment has not been received, the determination is negative and the process proceeds to step 340. If the adjusted simplified image information is received in step 338, the determination is affirmed and the process proceeds to step 338. In step 338, the display control unit 28 displays a simplified image indicated by the adjusted simplified image information received in step 336 on the touch panel display 39.

  In step 340, the display control unit 28 determines whether or not the second image processing end condition is satisfied. In this step 316, if the second image processing end condition is satisfied, the determination is affirmed and the process proceeds to step 342. On the other hand, if the second image processing end condition is not satisfied, the process returns to step 336. Subsequently, in step 342, the display control unit 28 determines whether or not the communication disconnection condition is satisfied. In step 342, if the communication disconnection condition is satisfied, the determination is affirmed and the process proceeds to step 344. If the communication disconnection condition is not satisfied, the determination is negative and the second image processing is terminated. In step 344, the ad hoc communication between the image processing apparatus 12 and the smartphone 14 is disconnected by the display control unit 28, and then the second image processing ends.

  As described above, in the image processing system 10 according to the present embodiment, when the display capability of the display unit 18 is higher than the display capability of the display area 30 of the smartphone 14, an image based on the read image is displayed on the display unit 18 and simplified. An image is displayed in the display area 30. When the display capability of the display unit 18 is not higher than the display capability of the display area 30 of the smartphone 14, a simplified image is displayed on the display unit 18 and an image based on the read image is displayed on the display area 30. Therefore, in the image processing system 10 according to the present embodiment, compared with the operation panel 500 shown in FIG. 15, highly accurate adjustment with respect to the read image is easily performed.

  In the above embodiment, when the image processing apparatus 12 does not receive the display capability information within a predetermined time (step 206: Y shown in FIG. 7), the simplified image is displayed on the touch panel display 39 of the smartphone 14. Although the processing to be displayed on the screen has been described as an example, the present invention is not limited to this, and error processing may be performed. As an example of the “error processing” here, there is a process of displaying that the display capability information has not been received within a predetermined time and forcibly terminating the first image processing. It is done.

  In the above-described embodiment, the case where the image for accepting adjustment is displayed together with the image based on the read image in the screen that is not different from the image based on the read image is exemplified. The adjustment acceptance image may be displayed together with the simplified image. Further, the image for accepting adjustment may be displayed together with the read image in a screen that is not different from the image based on the read image, and the image for accepting adjustment may be displayed together with the simplified image in a screen that is not different from the simplified image. .

DESCRIPTION OF SYMBOLS 10 Image processing system 12 Image processing apparatus 14 Smartphone 16 Reading part 18 Display part 20 Control part 22 Determination part 24 Creation part 26 Reception part 28 Display control part 30 Display area 32 Reception part 33 Detection part

Claims (14)

Reading means for reading a read area to obtain a read image;
Display means for displaying an image;
When the display means has a display capability higher than the display capability of the display area of the communication destination having the display area for displaying the image based on the transmitted information, the image based on the read image obtained by the reading means is When displaying on the display means and transmitting simplified image information indicating a simplified image obtained by simplifying the read image to the communication destination, and when the display capability of the display unit is not higher than the display capability of the display area, Control means for controlling the display unit to display the simplified image and to transmit read image information indicating the read image to the communication destination;
An image processing apparatus. Determination means for determining whether or not the display capability of the display means is higher than the display capability of the display area;
When the determination means determines that the display capability of the display means is higher than the display capability of the display area, a simplified image indicated by the simplified image information to be transmitted to the communication destination is displayed in the display area The simplification to be displayed on the display means when the display means determines that the display ability of the display means is not higher than the display ability of the display area. The image processing apparatus according to claim 1, further comprising a creating unit that creates an image so as to correspond to the display capability of the display unit.   The creation means further determines an image based on the read image to be displayed on the display means when the determination means determines that the display capacity of the display means is higher than the display capacity of the display area. The image processing apparatus according to claim 2, wherein the image processing apparatus is created so as to correspond to the display capability of the display means.   When the display means has a higher display ability than the display area, the control means uses the adjustment means for receiving the adjustment contents of the read image as an image based on the read image in the display means. 4. The image processing apparatus according to claim 1, further controlling to display together with an image based on the read image in a screen that is not different from the image. 5.   When the adjustment content is received using the adjustment reception image displayed on the display unit, the control unit replaces the image based on the read image currently displayed on the display unit with the adjustment content. The image processing apparatus according to claim 4, further controlling so that an image based on the read image adjusted according to the adjustment content is displayed on the display unit. The image processing apparatus according to any one of claims 1 to 5,
When the display capability of the display means is higher than the display capability of the display area, the simplified image information transmitted from the image processing device is received, and the display capability of the display means is higher than the display capability of the display area. If not high, a receiving unit that receives the read image information transmitted from the image processing device and a simplified image indicated by the simplified image information received by the receiving unit are displayed in the display area. And a communication apparatus that operates as the communication destination, including display control means that controls the display area to display an image based on the read image indicated by the read image information received by the reception means. ,
Including an image processing system. When the adjustment content of the read image is received in a state where the simplified image is displayed in the display area, the control unit transmits the simplified image information adjusted according to the adjustment content to the communication device. And further control as
The display control means displays, in the display area, a simplified image indicated by the latest simplified image information received by the receiving means, instead of the simplified image currently displayed in the display area. The image processing system according to claim 6, wherein the image processing system is controlled so as to be performed. When the display capability of the display unit is not higher than the display capability of the display area, the control unit transmits adjustment reception image information indicating an adjustment reception image used when receiving adjustment contents of the read image. Further control to send to the device,
The receiving means further receives the transmitted image information for accepting adjustment,
The display control means is an image based on the read image indicated by the read image information received by the receiving means, the adjustment accepting image indicated by the adjustment accepting image information received by the receiving means in the display area. 8. The image processing system according to claim 6, wherein the image processing system is controlled so as to be displayed together with an image based on the read image in a screen that is not different from the image. The communication apparatus further includes a reception unit that receives the adjustment content using the adjustment reception image displayed in the display area, and the adjustment content information indicating the adjustment content received by the reception unit is processed in the image processing. To the device,
The control means controls to transmit the read image information adjusted according to the adjustment content indicated by the adjustment content information transmitted from the communication device to the communication device;
The display control means, when the read image information is received by the receiving means in a state where an image based on the read image is displayed in the display area, displays the read image currently displayed in the display area. The image processing system according to claim 8, wherein an image based on a read image indicated by the latest read image information received by the receiving unit is displayed in the display area instead of an image based on the display unit.   When the adjustment content information is transmitted from the communication device in a state where the simplified image is displayed on the display unit, the control unit replaces the simplified image currently displayed on the display unit. The image processing system according to claim 9, further controlling to display the simplified image adjusted according to the adjustment content indicated by the adjustment content information transmitted from the communication device on the display unit. The communication device further includes detection means for detecting the orientation of the communication device, and transmits orientation information indicating the orientation of the communication device detected by the detection means to the image processing device,
When the simplified image information is to be transmitted to the communication device, the control means acquires and acquires the aspect ratio and screen resolution of the simplified image display screen on which the simplified image is displayed in the display area. The simplified image indicated by the simplified image information to be transmitted is based on the aspect ratio and screen resolution and the orientation of the communication device indicated by the orientation information transmitted from the communication device. The simplified image information as the transmission target is adjusted so that the aspect ratio of the read image is maximized on the simplified image display screen in a predetermined direction with respect to a direction. Item 11. The image processing system according to any one of Items 10 to 10.   The control means acquires and acquires an aspect ratio and a screen resolution of a read image display screen on which an image based on the read image in the display area is displayed when the read image information is a transmission target to the communication device. The image based on the read image indicated by the read image information to be transmitted is determined in advance based on the aspect ratio and the screen resolution and the orientation of the communication device indicated by the orientation information transmitted from the communication device. The image processing system according to claim 11, wherein the read image information to be transmitted is adjusted so that the read image display screen is maximally displayed on the read image display screen in a predetermined direction with an aspect ratio of the read image. The communication device further includes detection means for detecting the orientation of the communication device, and transmits orientation information indicating the orientation of the communication device detected by the detection means to the image processing device,
The control means acquires and acquires an aspect ratio and a screen resolution of a read image display screen on which an image based on the read image in the display area is displayed when the read image information is a transmission target to the communication device. An image based on the read image indicated by the read image information to be transmitted is based on the aspect ratio, the screen resolution, and the orientation of the communication device indicated by the orientation information transmitted from the communication device. The read image information as the transmission target is adjusted so that the image is displayed on the read image display screen to the maximum in the aspect ratio of the read image in a predetermined direction with respect to the orientation of the read image. The image processing system according to any one of 10. Computer
The program for functioning as a control means of any one of Claims 1-5.