JP6221646B2 - Image processing apparatus and input receiving apparatus - Google Patents

Description

  The present invention relates to an image processing apparatus and an input receiving apparatus such as a scanner and a multi-function peripheral that execute image processing via an operation panel equipped with a touch panel, and more particularly to a technique for improving operability by a visually impaired person.

2. Description of the Related Art In recent years, image processing apparatuses such as scanners and multi-function peripherals equipped with an operation panel equipped with a touch panel have become widespread.
In such an image processing apparatus, for example, a plurality of icons are displayed on the display screen of the operation panel, and the function indicated by the icon displayed at the tapped position can be executed.

However, visually impaired persons have difficulty in viewing the displayed icons, and operations using the touch panel are virtually impossible.
Therefore, in the virtual pointing device described in Patent Document 1, different functions are assigned to the five fingers of the user in advance, and the five fingers of one hand of the user are pressed against the touch panel, and a specific finger is pressed. A configuration has been proposed in which, when tapped, a function assigned to the tapped finger is executed.

  It is also conceivable to apply such a configuration to the image processing apparatus so that a visually impaired person can operate the touch panel.

Japanese Patent Laid-Open No. 10-40014 JP 2003-099200 A Japanese Patent No. 4702959

However, since the virtual pointing device described in Patent Document 1 cannot confirm the contents of the functions previously assigned to the five fingers at the time of operation, the visually impaired person is assigned to the five fingers. If you forget the contents of the function, you can no longer operate correctly.
The present invention has been made in view of the circumstances as described above, and is an image processing that can be operated even if a visually impaired person has forgotten the function assigned to each finger. An object is to provide a device and an input receiving device.

In order to achieve the above object, according to a first aspect of the present invention, there is provided an image processing apparatus having a two-dimensional detection surface for detecting an area touched by a user's finger and A receiving means for accepting the first and second gesture operations, and when a plurality of fingers are in contact with the detection surface, a contact area where each finger is in contact is set as a virtual switch area; An assigning means for assigning a function related to image processing to a voice notification means for notifying the contents of the function assigned to the switch area corresponding to the finger that has performed the operation by voice when the first gesture operation is accepted. Upon receiving the second gesture operation, and execution means for executing a function assigned to the switch region corresponding to the finger performing the operation, a plurality of icons for operations Display means having a display surface for displaying, wherein the detection surface is disposed on the display surface, and the assigning means is configured to determine a contact area in contact with the detection surface of the plurality of fingers. As a switch area, a first assignment process for assigning a function related to image processing, and a detection area on the detection surface corresponding to each display area where the plurality of icons are displayed as a switch area, respectively, A second allocation process for allocating the function to be performed is selectively performed, and the selection between the first and second allocation processes is determined according to the number of fingers of the user who is simultaneously in contact with the detection surface. When the second allocation process is performed as an initial setting and more than N fingers touch the detection surface at the same time, the first allocation process is selected, and N is an integer equal to or greater than 2 In Even if the second assigning process is being carried out, the assigning means, when the contact of two or more N fingers to the detection surface continues for a predetermined time or more, Exceptionally, the first allocation process is selected .

In order to achieve the above object, according to a second aspect of the present invention, there is provided an input receiving device having a two-dimensional detection surface for detecting an area touched by a user's finger and the touching finger. Receiving means for accepting the first and second gesture operations according to the above, and when a plurality of fingers are in contact with the detection surface, a contact area where each finger is in contact is set as a virtual switch area, Assigning means for assigning a function for executing a predetermined process to the switch area, and receiving a first gesture operation, the contents of the function assigned to the switch area corresponding to the operated finger are notified by voice. When the voice notification means and the second gesture operation are received, the function assigned to the switch area corresponding to the finger that performed the operation is selected as an execution target. Means, display means having a display surface for displaying a plurality of icons for operation, wherein the sensing surface is arranged on the display surface, the allocation means, the detection of the plurality of fingers A contact area that is in contact with the screen as a switch area, and a first allocation process for allocating a function related to image processing, and a detection area on the detection surface corresponding to each display area where the plurality of icons are displayed As the switch area, a second assignment process for assigning a function related to image processing is selectively performed, and the selection of the first and second assignment processes is performed by a user who is in contact with the detection surface at the same time. When the second allocation process is performed as an initial setting and more than N fingers simultaneously touch the detection surface, the first allocation process is performed. N is an integer greater than or equal to 2, and the allocating means contacts the detection surface with 2 or more and N or less fingers even when the second allocation process is performed. Is exceptionally selected when the first allocation process is selected .

Here, for each function, a storage unit that stores the number of times of execution as a history is provided, and it is preferable that the allocation unit preferentially selects the function that has been executed a number of times and assigns it to a switch area. .
Alternatively, the assigning unit assigns only a switch area for receiving a final execution instruction for a specific image processing job to a specific finger contact area without performing assignment according to the executed history. It is desirable.

Alternatively, when one of the five fingers is in contact with the detection surface, each of the touched fingers includes a determination unit that determines any one of a thumb, an index finger, a middle finger, a ring finger, and a little finger, and the allocation unit includes: It is desirable to assign to the switch areas corresponding to the thumb, index finger, middle finger, little finger and ring finger in order from the most frequently executed function.
Moreover, it is desirable that the first and second gesture operations are different ones among a tap, a double tap, and a slide operation, respectively.

  Here, the allocating means sets the area of the switch region by a predetermined amount larger than the area where each finger is in contact with the detection surface, and the first gesture operation includes a tap, a double One of tap and slide operations, wherein the second gesture operation is performed on a part of the switch area other than the contact area of the finger that has performed the first gesture operation. It is desirable to perform a tap operation with a finger or a double tap operation.

  Further, the assigning means assigns a specific function to a specific pair of two or more fingers among the plurality of touched fingers, and the voice notification means includes the specific two fingers. When the first gesture operation is simultaneously performed by the above group, the content of the unique function assigned to the pair of fingers is notified by voice, and the execution unit performs the second gesture by the two or more fingers. When operations are performed simultaneously, it is desirable to temporarily disable the function assigned to each finger and execute the unique function assigned to the pair of two or more fingers.

  Further, it is preferable that the assigning unit executes a second assigning process when a user's finger is not in contact with the detection surface.

  According to the image processing apparatus having the above-described configuration, even when a user with visual impairment forgets the content of the function assigned to each switch area, the operation is performed when the first gesture operation is received. Since the contents of the function assigned to the switch area touched by the finger are notified by voice, the contents of the function can be known, and the second gesture is performed with the finger that has performed the first gesture operation. By performing the operation, the target function can be executed with peace of mind.

1 is an external perspective view illustrating a multifunction peripheral as an example of an image processing apparatus according to an embodiment of the present invention. It is a figure for demonstrating the structure of an operation panel. It is a block diagram which shows the relationship between the structure of a control part, and the main component used as the control object of this. It is a figure which shows the content of the function corresponding | compatible table used by the said operation panel reception control process. It is a figure which shows the content of the 1st usage history table used by the operation panel reception control process implemented by the said control part. It is a figure which shows the content of the 2nd usage log | history table used by the said operation panel reception control process. It is a flowchart which shows the content of the first half of the said operation panel reception control process. It is a flowchart which shows the content of the second half of the said operation panel reception control process. It is a figure explaining reception operation in reception mode for visually impaired people. It is a figure for demonstrating gesture operation (the 1). It is a figure for demonstrating gesture operation (the 2). It is a figure for demonstrating gesture operation (the 3).

Hereinafter, an embodiment of an image processing apparatus according to the present invention will be described with reference to the drawings, taking a color multifunction peripheral (hereinafter simply referred to as “multifunction peripheral”) as an example.
(1) Overall Configuration of Multifunction Device FIG. 1 is an external perspective view of a multifunction device 1 according to the present embodiment.
As shown in the figure, the MFP 1 includes a printer unit 10, a paper feeding unit 20, a scanner unit 30, and a control unit 50 as main components, and eliminates the space between the printer unit 10 and the scanner unit 30. A so-called in-body discharge type multi-function machine that is used as a paper tray, and an operation panel 40 is attached to the upper part of the printer unit 10.

  The multi-function device 1 is connected to a network (for example, a LAN), receives a print job execution instruction from an external terminal (not shown), has a function of executing a print process, and scans via the operation panel 40. In response to an instruction to execute various jobs such as copy and fax (hereinafter referred to as “operation panel reception control process”), these jobs are executed.

Here, the scanner unit 30 feeds and conveys the original set on the original placing table 31 one by one, reads the original image, and generates image data (scanning).
The printer unit 10 prints on a recording sheet conveyed from the paper feeding unit 20 based on image data read by the scanner unit 30 or image data sent together with a print job from an external terminal (copying, printing). .

The paper feeding unit 20 feeds the recording sheets stored in the paper feeding cassette one by one and transports them to the printer unit 10 in a timely manner.
The control unit 50 controls the printer unit 10, the paper feeding unit 20, the scanner unit 30, and an operation panel 40 described below in a centralized manner.
(2) Configuration of Operation Panel FIG. 2 is a diagram for explaining the configuration of the operation panel 40.

As shown in the figure, the operation panel 40 includes a hard key unit 41 including a plurality of buttons including an initial setting key 411 for performing initial setting, a liquid crystal display unit 42, a touch panel 43, a voice notification unit 44, and the like. Yes.
The liquid crystal display unit 42 is provided with a backlight light source on the back surface of an LCD (Liquid Crystal Display), and is controlled by the control unit 50, for example, start, copy, scan, print, color / monochrome switching, copy In addition to displaying an operation screen with various virtual buttons such as setting of magnification and paper selection, a job execution status and execution history, and a message indicating the error contents when an error occurs are displayed.

The touch panel 43 is a transparent touch panel capable of detecting multiple points, such as a projection capacitive method, and is stacked on the display surface of the liquid crystal display unit 42, and the control unit 50 is interposed via the touch panel 43. Accepts setting input (touch input) by the user.
The voice notification unit 44 is a speaker, and converts the voice signal output from the control unit 50 into voice.
(3) Configuration of Control Unit FIG. 3 is a block diagram illustrating a relationship between the configuration of the control unit 50 and main components that are the control targets thereof.

The control unit 50 includes a central processing unit (CPU) 51, a read only memory (ROM) 52, a random access memory (RAM) 53, a communication I / F unit 54, an image data storage unit 55, a first usage history storage unit 56, and A second usage history storage unit 57 and the like are provided.
The CPU 51 executes a program for controlling the printer unit 10, the paper feeding unit 20, the scanner unit 30, and the operation panel 40.

In the MFP 1 according to the present embodiment, in the above-described operation panel reception control process, a reception mode for healthy persons that receives operation instructions from healthy persons and a reception mode for visually impaired persons that receives operation instructions from visually impaired persons are provided. Have.
Here, the reception mode for healthy persons refers to the function indicated by the icon displayed at the touched position by the touch operation on the touch panel 43 while the user confirms the icon displayed on the liquid crystal display unit 42. This means a known reception mode to be executed.

In addition, the reception mode for the visually impaired means that a finger touch area touched on the touch panel 43 is a virtual switch for executing a predetermined function (hereinafter, referred to as a virtual switch) so that even a blind person can perform an operation. This is a mode that is set as “switch area”) and receives an operation instruction from the user while performing voice guidance.
The CPU 51 executes such an operation panel reception control process as part of the process for controlling the operation panel 40. Detailed contents will be described later.

The ROM 52 is a storage for storing various programs executed by the CPU 51 and image data to be displayed on the liquid crystal display unit 42, a program for executing the operation panel reception control process, and a table referred to when executing the process. (Hereinafter referred to as “function correspondence table”) 190 is also stored.
This table is registered with lower layer functions or operations that are executed in response to gesture operations of the fingers after the functions corresponding to the fingers are determined in the reception mode for the visually impaired. .

FIG. 4 is a diagram showing the configuration of the function correspondence table 190.
In the first column 191 from the left, functions that can be executed in the reception mode for the visually impaired are shown.
The second column 192 from the left shows the contents of functions executed when a tap operation is performed.

The third column 193 from the left shows the contents of the function executed when the double tap operation is performed.
Here, in column 192 and column 193, “with reading” is indicated, unlike other functions, by repeating tap operation and double tap operation, one function can be selected from a plurality of options. Since it is selected and executed, this means that each function is notified by voice of which function is currently selected.

The fourth column 194 from the left stores voice data 1 to 9 for notifying the contents of each function by voice when the user performs a slide operation.
Returning to FIG. 3, the RAM 53 is a work area when the CPU 51 executes the program.
The communication I / F unit 54 is an interface such as a LAN card or a LAN board for connecting to a LAN.

The image data storage unit 55 stores image data for printing and image data read by the scanner unit 30 sent from the external terminal via the communication I / F unit 54.
Each of the first usage history storage unit 56 and the second usage history storage unit 57 stores a table for registering usage histories of functions executed in accordance with operation instructions received in the visually impaired reception mode.

  Among these, the second usage history storage unit 57 updates the usage count of the corresponding table every time there is any operation from the touch panel between the start of the operation and the completion of the final job processing instruction. However, the first usage history storage unit 56 refers to the update contents in the second usage history storage unit 57, and the substantial usage is performed no matter how many times the same type of operation is performed for the same function until the job instruction is completed. The number of times is regarded as one, and the usage history is updated after the final job instruction is completed. For example, in the function correspondence table of FIG. 4, after the function “magnification” is selected, no matter how many times the tap operation is performed until the target magnification is finally determined, the magnification is performed once. By updating the history, a substantial usage history that matches the operator's intention is left.

FIG. 5 is a diagram illustrating an example of the contents of the first usage history table 160.
In the first column 162 from the left, the number of executions for each function received in the reception mode for visually impaired persons from the time of product delivery of the multifunction device 1 to the present is shown.
In the second column 163 from the left, the contents of the function instructed to be executed in the reception mode for visually impaired persons are shown.

Here, the content of the function includes, for example, start, number setting, reset, 2 in 1, magnification, double / single side switching, color / monochrome switching, stop, paper selection, and the like.
In the third column 164 from the left, values that are ranked so that the functions executed in the reception mode for visually impaired persons are ranked higher as the number of executions is larger are shown. In the usage history table 160, the data of each row is rearranged so that the values are in ascending order.

In the multifunction device 1 according to the present embodiment, when the touch panel 43 is touched with a plurality of fingers at the same time, it is estimated that the user is an audiovisual handicapped person, and the reception mode for visually impaired persons is changed from the reception mode for healthy persons. The function shown in the column 163 is assigned to the switch area on the touch panel 43 where each finger is placed.
The fourth column 165 from the left defines to which of these switch areas the function shown in the column 163 is assigned. In the present embodiment, for example, in order of increasing use frequency Allocating from the switch area located on the right side.

FIG. 6 is a diagram showing the configuration of the second usage history table 170.
As shown in the figure, the second usage history table 170 is substantially the same table as the first usage history table 160, and is executed by the user operating in the reception mode for the visually impaired in the first column from the left. Unlike the first usage history table 160, a column 171 for storing the number of executions for each function is newly added and there is no equivalent to the column 165 of the first usage history table 160. Yes.

The second and subsequent columns 172, 173, and 174 of the second usage history table 170 are the same as the columns 162, 163, and 164 of the first usage history table 160, respectively, and thus description thereof is omitted. .
In the second usage history table 170, when any function is executed, the corresponding values in the columns 171, 172, and 174 are updated by the control unit 50.

(4) Operation Panel Acceptance Control Process Hereinafter, the contents of the operation panel acceptance control process according to the present embodiment will be described.
7 and 8 are flowcharts showing the first half and the second half of the contents of the operation panel reception control process executed by the control unit 50, respectively.
This control is performed as a subroutine of a main flowchart (not shown) for controlling the operation of the entire multifunction device 1.

First, in step S101 in FIG. 7, the CPU 51 calls the area of the touch panel 43 immediately above the area where the icon of the liquid crystal display unit 42 is displayed as an area (hereinafter referred to as “switch area”) that functions as a switch. ) And assigns the function indicated by the icon to the switch area (step S101).
This allocation is possible because the CPU 51 controls the icon display of the liquid crystal display unit 42, and the currently displayed icon is on the two-dimensional coordinates on the display surface of the liquid crystal display unit 42. This is because it is grasped whether it is located and the correspondence between the two-dimensional coordinates and the two-dimensional coordinates of the touch panel 4 is grasped, or the two-dimensional coordinates of both are shared. For example, in the case of sharing, the above assignment is performed by storing a set of a region indicated by two-dimensional coordinates where an icon is displayed and a function indicated by the icon as a table. Is.

The reason why the process of step S101 is performed at the beginning of the operation panel reception control process is that it is based on the reception of the operation in the reception mode for healthy persons with a high operation frequency.
Next, the CPU 51 determines whether or not the user's finger is touching the touch panel 43. If the user's finger is touching the touch panel 43 (step S102: YES), the number of fingers may be three or more. If this is the case (step S103: YES), it is estimated that the user is a visually impaired person, and the first usage history table 160 stored in the first usage history storage unit 56 is referred to (step S104). For example, the functions that have been executed so far are assigned in order from the most frequently executed function, from the right side to the left side of each area on the touch panel 43 that is touched by the user's finger (step S105).

In the present embodiment, it is assumed that the operator operates by touching the touch panel 43 with the finger of the left hand. FIG. 9 is a diagram illustrating an example of function assignment when the five fingers of the left hand touch the touch panel.
The CPU 51 switches the switch area 201, the switch area 202, the switch area 203, and the switch area 204 that are touched by each finger of the user in accordance with the usage frequency order shown in the column 165 (see FIG. 5) of the first usage history table 160. In addition, in the order of the switch area 205, an area (hereinafter referred to as “switch area”) that functions as a switch for executing each function is assigned in the order of start, number of sheets, reset, 2in1, and magnification from the right side.

Usually, Japanese people have a habit of counting from the thumb, and when operating with the left hand as in this embodiment, it is visually impaired if the frequently used functions are arranged from the position of the thumb (right end). User-friendly functions are easy to operate intuitively, and user friendliness is improved.
In executing such assignment, the function of the switch area assigned for the acceptance mode for the healthy person in step S101 is invalidated.

  If no change occurs in the contact state of the user's finger within M seconds after the change in the detection state of the touch panel 43 last time (step S106: NO), the CPU 51 determines that the user is a healthy person. However, it is conceivable that the user touches the touch panel 43 unconsciously. In this case, in order to restart the operation panel reception control process from the beginning, the process returns to the main flowchart, and the main flowchart circulates. When the operation panel reception control process is executed, the processes after step S101 are executed again.

Here, the specific value of M seconds is set to 3 sec to 5 sec, for example.
On the other hand, if the contact state of the user's finger changes within M seconds after the user's finger touches the touch panel 43 (step S106: YES), the user operates in the reception mode for the visually impaired. Therefore, the process proceeds to step S107 in FIG. 8 to determine whether or not the change in the contact state is a slide operation (first gesture operation).

This sliding motion is detected as follows, for example.
That is, the CPU 51 acquires the two-dimensional coordinate value of the touch position on the touch panel 43 at a predetermined sampling period within a predetermined time, and refers to these two-dimensional coordinate values to perform a slide operation if the position has moved. It is determined that
If it is a slide operation (step S107: YES), the contents of the function assigned to the switch area corresponding to the slid finger are notified by voice (step S108), and the process returns to 106 in FIG. Processing for determining whether or not there is a change in the touch state is executed.

  Further, the change in the finger contact state is not due to the slide operation (step S107: NO), is not due to the double tap operation (second gesture operation) (step S109: NO), and is not due to the tap operation. In this case (step S110: NO), an error message indicating that an operation other than that assumed by the apparatus has been performed is notified by voice (step S111), and the processing after step S106 is executed.

  If the change in the finger contact state is due to a tap operation (second gesture operation) (step S107: NO, step S109: NO, step S110: YES), the CPU 51 refers to the function correspondence table 190. Then, the function assigned to the tap operation in the switch area touched by the finger that has performed the tap operation is selected, and the value of the operation count N of the function in the second usage history table 170 (column in FIG. 5). 171) is incremented by 1 (step S112), and only when the value of the operation count N is updated from 0 to 1, the value of the use count Q (see column 172 in FIG. 5) corresponding to this function. Is incremented by 1 (step S113).

Here, the tap operation is detected by acquiring a two-dimensional coordinate value of the touch position on the touch panel 43 at a predetermined sampling period within a predetermined time, and when a period in which the touch position is not detected occurs only once. If it is determined that there is a touch period and the period in which the touch position is not detected occurs only twice, it is determined that the operation is a double tap operation.
As described above, the value of the use count Q is incremented only when the value of the operation count N is updated from 0 to 1. For example, when setting the scale, the scale desired by the user is increased. Since the tap operation is repeated several times with the same finger, the number of times Q is incremented each time, and the number of times is counted more than the other functions. This is because information on another frequency of use cannot be obtained correctly.

  If it is determined that the change in the finger contact state is not due to the slide operation (step S107: NO) but due to the double tap operation (step S109: YES), the function correspondence table 190 is referred to. The function assigned to the double tap operation of the switch area in contact with the finger that has performed the double tap operation is selected, and the value N of the number of operations of the function in the second usage history table 170 (column 171 in FIG. 5). (See) is incremented by 1 (step S114), and the processing after step S113 is executed.

  Subsequently, the CPU 51 executes the selected function (step S115), and when the executed function is “start” for executing a final function for completing image processing such as copying or scanning. (Step S116: YES), the value of the number of times used up to now in the first usage history table 160 (see column 162 in FIG. 5) is used as the number of times Q ( In the case of updating to the value of the column 172 in FIG. 6 and the magnitude relationship of the number of times being switched, the value of the execution frequency order (see the column 164 in FIG. 5) and the right when assigning the function to the switch area (See column 165 in FIG. 5) is updated (step S117), and the values of N associated with each function in the second usage history table 170 are all reset to zero. Step S118), the process returns to the main flow chart (not shown).

For example, as shown in FIG. 6, when the order of execution frequency of “2 in 1” and “magnification” in the second usage history table 170 is switched, the order in the column 174 of the second usage history table 170 is in ascending order. In addition, after the rows are rearranged, the data in the columns 172 to 174 is overwritten and updated on the first usage history table 160.
Returning to FIG. 7, if the number of touches of the finger is 1 in the determination in step S119 (step S119: YES), it is considered that the operation in the reception mode for healthy persons is accepted, so the finger is tapped. The function indicated by the selected icon is selected as an execution target (step S120), and the processes after step S115 for executing the selected function are executed.

  Further, when the number of touches of the finger is 2 (step S103: NO → step S119: NO) and the finger touch position changes within K seconds after being touched (step S121: YES), 2 It is determined whether or not a pinch operation for enlarging or reducing the location is performed by expanding or narrowing the finger of the book (step S122), and if it is a pinch operation (step S122: YES), Enlargement or reduction display is performed according to the contents (step S123), and the process returns to the main flowchart (not shown).

If the operation is not a pinch operation (step S122: NO), the contents of this operation cannot be specified, and the process returns to the main flowchart (not shown).
On the other hand, if the touch position of the finger does not change within K seconds after being touched (step S121: NO), the user may try to operate the reception mode for the visually impaired with two fingers. Therefore, the processes after step S104 are executed.

Here, the specific value of K seconds is set to 3 sec to 5 sec, for example.
As described above, in the multifunction device 1 according to the present embodiment, when three or more fingers touch the touch panel 43, the user is assumed to be visually impaired and the user's finger on the touch panel 43 touches. The switch area for executing the function is assigned to the location where the user is touching, and when the finger is slid, the function assigned to the switch area touched by the finger is notified by voice. Even if you forget the contents of the assigned function, you can know the contents and prevent erroneous operations.

<Modification>
The present invention is not limited to the above-described embodiment, and the following modifications can be considered.
(1) In the above embodiment, one function is assigned to each contact area of each finger. However, the present invention is not limited to this, and the set of contact areas associated with a plurality of fingers One unique function may be assigned.

For example, as shown in FIG. 11, the function of switching to the color mode is provided for the combination of the switch area 202 and the switch area 203 corresponding to the second and third fingers from the right (the index finger 62 and the middle finger 63 in FIG. 11). May be assigned.
In this case, by sliding the index finger 62 and the middle finger 63 at the same time, the content of the function, for example, “Tap two fingers simultaneously to switch to the color mode. Be notified.

The voice mode can be switched to the color mode by tapping the index finger 62 and the middle finger 63 at the same time as the voice, and the monochrome mode can be restored by double tapping the index finger 62 and the middle finger 63 at the same time.
In this way, when a function is designated by a combination of two fingers, the function assigned to the switch area of one finger in the above embodiment is temporarily invalidated. As a result, when a function is designated by a combination of two fingers, it can be prevented that two functions assigned to individual fingers are mistakenly designated at the same time.

Of course, when the function is designated again with one finger, the normal function assignment state is restored.
Note that even if the user tries to perform a tap operation, a double tap operation, and a slide operation at the same time, strictly speaking, it seems that a slight time lag has occurred, and therefore a lag of about a few seconds has occurred. Even operations are considered to be operated at the same time.

The number of switch areas belonging to one set to which a function is assigned is not limited to two, and may be three or more.
(2) In the above modification (1), an example has been shown in which the variation of functions that can be executed is increased by assigning a function unique to the group to a group of a plurality of switch areas. Variations can be increased.

  For example, in FIG. 9, a function for switching functions assigned to the switch area 201 to the switch area 204 (hereinafter referred to as “menu update function”) is assigned to the switch area 205 in contact with the little finger 65. Each time the little finger 65 is tapped, the functions assigned to the switch area 201 to the switch area 204 are switched, and many functions can be executed.

Even in such a case, if you perform a slide operation with a finger touching the switch area where the function has been switched, the contents of the switched function will be notified by voice, so the user should execute the function without being confused Can do.
For example, when an optional post-processing device is attached to the multifunction peripheral, the setting items increase, and thus such a menu switching function is useful.

(3) In the embodiment and the modifications (1) and (2), the voice guidance and the function are executed by the tap and double tap operations in the slide operation. The gesture operation to be executed may be any gesture operation.
(4) In the above embodiment, the case where only one hand is used in the reception operation in the reception mode for the visually impaired has been described. However, the present invention is not limited to this, and both hands may be used.

For example, when the touch panel 43 is touched with ten fingers, the functions may be assigned in order from the right of the switch area touched by the ten fingers.
(5) In the above embodiment, when the number of finger touches is 3 or more, an operation is accepted in the acceptance mode for visually impaired persons (see step S103 in FIG. 7), but this is not limitative. Absent.

This is because it is assumed that a user who is a healthy person performs a pinch operation using two fingers, and an operation using three or more fingers is not assumed for a healthy person. It is.
However, the operation method seems to change with the times, and there is a possibility that a healthy person may use an operation method using three or more fingers.

Therefore, assuming that the maximum number of fingers used by the healthy person for the operation is R, the acceptance of the operation in the reception mode for visually impaired persons is when more than R fingers are simultaneously touching the touch panel 43. It is desirable that the acceptance of the operation in the acceptance mode for the healthy person is performed when R fingers or less are in contact with the touch panel 43 at the same time.
(6) In the above embodiment, the size of the switch region was not mentioned, but as shown in FIG. 9, each finger touches the touch panel 43 with the area of the switch region 201 to 205 corresponding to each finger. You may set slightly larger than the area which is carrying out.

In that case, it is necessary to make the size so that adjacent switch regions do not overlap each other.
In this way, for example, as shown in FIG. 12, when the tap operation is performed with the right index finger 162 on the switch area 202 touched by the left index finger, this is estimated as the same operation as the tap operation. The function assigned to the switch area can be executed.

Note that the CPU 51 normally determines the presence or absence of a finger contact in the switch area when detecting the tap action. However, when detecting the above-described action, the CPU 51 determines the increase or decrease in the finger contact area in the switch area. There is a need to.
(7) In the above embodiment, functions with high execution frequency are simply assigned from the right side of the switch area. However, the present invention is not limited to this.

  For example, as shown in FIG. 9, when five fingers of one hand are touching the touch panel 43, it is determined whether each finger is the thumb 61, the index finger 62, the middle finger 63, the ring finger 64, or the little finger 65. It is desirable to specify and assign to the switch area in which the thumb 61, the index finger 62, the middle finger 63, the little finger 65, and the ring finger 64 are in contact with each other in the order that the finger is moved from the function that is specified and frequently executed.

In this case, it is necessary to determine whether the hand is left or right. For this purpose, as shown in FIG. 8, the interval L1 between the fingertips of the thumb 61 and the index finger 62 is larger than the intervals L2 to L4 between the other fingers. Based on the above, it is possible to use a known determination method in which a left hand is used when the wide side is located on the right side and a right hand is used when the wide side is located on the left side.
(8) In the above embodiment, the functions are frequently assigned to the switch area from the frequently executed functions. However, the present invention is not limited to this, and each function may be fixedly assigned to the switch area.

For example, from the time of factory shipment, in the reception mode for visually impaired persons, the order of functions assigned from the right side (or from the left side) of the switch area has been set, and the initial setting key 411 (see FIG. 2) has been pressed. It is good also as a structure which can change this order only in the case.
For example, when the initial setting key 411 is pressed, the CPU 51 displays the first usage history table 160 of FIG. 4 on the liquid crystal display unit 42 and is shown in the column 165 based on a user instruction from the touch panel 43. Also, it is implemented by changing the order from the right when assigning functions to the switch area.

In this case, in the first usage history table 160, the columns 162 and 164 prepared for fluidly assigning each function to the switch area are no longer necessary, so it is desirable to delete them from this table.
Furthermore, since the second usage history table is also necessary for fluidly assigning each function to the switch area, it is desirable to delete it.

Along with these changes, part of the processing in the flowchart in FIG. 8 is no longer necessary, so the following changes are necessary.
That is, the process of incrementing the value of N in steps S112 and 114 is abolished, the process of incrementing the value of Q in step S113 is abolished, and steps S117 and S118 are further abolished.

(9) In the above embodiment, as shown in step S101 of the flowchart of FIG. 7, when the operation panel reception control process subroutine is executed, the mode is always shifted to the reception mode for healthy persons. Absent.
As described above, the operation panel reception control process is repeatedly performed as a sub-routine of a main flowchart (not shown) for controlling the operation of the entire multifunction device 1, and therefore, as necessary, to reduce the load on the CPU 51. It is desirable to switch modes, that is, assign functions to switch areas.

  For example, when it becomes impossible to detect a touch of a finger on the touch panel 43, the mode may be shifted to a reception mode for healthy persons in preparation for the next user operation, or the determination in step S119 is “YES” During the transition to step S120, the switch area may be assigned to the process of step S101, that is, the area of the touch panel 43 immediately above the area where the icon of the liquid crystal display unit 42 is displayed.

  (10) In the above embodiment, by performing at least one of operations such as tap and double tap (second gesture operation), for example, the function of changing the setting of the magnification is executed, or only the tap operation is performed. In this way, the function of selecting the reset is executed, but the operation (second gesture operation) for executing the function assigned to one switch area may be one type or two types. There may be more than one type.

(11) In the above embodiment, the example in which the liquid crystal display unit 42 is provided below the touch panel 43 has been described, but the present invention is not limited thereto.
Since visually impaired persons do not need to display the liquid crystal display unit 42 in the first place, a configuration in which the liquid crystal display unit 42 is not provided below the touch panel 43, for example, a touch panel is formed on the outer surface of the housing of the multifunction device 1, and this is used. It may be configured to perform a touch operation.

(12) In the above embodiment, the configuration of the multifunction peripheral 1 has been described as an example of the image processing apparatus. However, the configuration is not limited to this, and a scanner having an operation panel similar to the operation panel 40 may be used.
Moreover, you may combine the said embodiment and each modification as much as possible.

  The present invention is suitable as a technique for improving the operability of an image processing apparatus such as an input receiving apparatus and an image forming apparatus or an image reading apparatus.

DESCRIPTION OF SYMBOLS 1 Multifunction device 10 Printer part 20 Paper feed part 30 Scanner part 31 Document placing table 40 Operation panel 41 Hard key part 42 Liquid crystal display part 43 Touch panel 44 Voice notification part 50 Control part 51 CPU
52 ROM
53 RAM
54 communication I / F unit 55 image data storage unit 56 first use history storage unit 57 second use history storage unit 160 first use history table 170 second use history table 190 function correspondence table 201 switch region 201 region 201-205 switch Area 411 Initial setting key

Claims (9)

A receiving means having a two-dimensional detection surface for detecting a region touched by a user's finger and receiving first and second gesture operations by the touched finger;
When a plurality of fingers are in contact with the detection surface, assigning means for setting a contact area where each finger is in contact as a virtual switch area, and assigning a function related to image processing to each switch area;
Upon receiving the first gesture operation, voice notification means for notifying the content of the function assigned to the switch area corresponding to the finger that has performed the operation by voice;
When receiving the second gesture operation, execution means for executing the function assigned to the switch area corresponding to the finger that performed the operation ;
Display means having a display surface for displaying a plurality of icons for operation,
The detection surface is disposed on the display surface;
The assigning means includes
A first allocation process for allocating a function related to image processing, with a contact area in contact with the detection surface of the plurality of fingers as a switch area;
Selectively performing a second assignment process for assigning a function related to image processing, with the detection area on the detection surface corresponding to each display area where the plurality of icons are displayed as a switch area,
The selection between the first and second allocation processes is determined according to the number of fingers of the user who are simultaneously in contact with the detection surface,
When the second allocation process is performed as an initial setting and more than N fingers simultaneously touch the detection surface, the first allocation process is selected,
N is an integer greater than or equal to 2, and the allocating means contacts the detection surface with 2 or more and N or less fingers for a predetermined time even when the second allocation process is performed. The image processing apparatus characterized by exceptionally selecting the first allocation process when the process continues . For each function, a storage means for storing the number of executed times as a history is provided,
The image processing apparatus according to claim 1, wherein the assigning unit preferentially selects the function that has been executed many times and assigns it to a switch area. The assigning means includes
The switch area for accepting a final execution instruction for a specific image processing job is fixedly allocated to a specific finger contact area without performing allocation according to the history of execution. 2. The image processing apparatus according to 2. When one of the five fingers is in contact with the detection surface, each of the touched fingers includes a determination unit that determines any of the thumb, the index finger, the middle finger, the ring finger, and the little finger,
The image processing apparatus according to claim 2, wherein the assigning unit assigns to the switch areas corresponding to the thumb, the index finger, the middle finger, the little finger, and the ring finger in order from the function that has been executed frequently.   5. The image processing apparatus according to claim 1, wherein each of the first and second gesture operations is a different one of a tap, a double tap, and a slide operation. The assigning means sets the area of the switch region by a predetermined amount larger than the area where each finger is in contact with the detection surface,
The first gesture operation is one of a tap, a double tap, and a slide operation,
The second gesture operation is a tap operation or a double tap operation by another finger performed on a part of the switch area other than the contact area of the finger that has performed the first gesture operation. The image processing apparatus according to claim 1. Furthermore, the assigning means assigns a specific function to the set of two or more specific fingers among the plurality of touched fingers,
When the first gesture operation is simultaneously performed by the two or more specific pairs, the voice notification unit notifies the content of the unique function assigned to the pair of fingers by voice,
When the second gesture operation with the two or more fingers is performed at the same time, the execution means temporarily disables the function assigned to each finger and assigns the set to the two or more fingers. The image processing apparatus according to claim 1, wherein the specific function is executed. It said assigning means, wherein if the user's finger is not in contact with the detection surface, the image processing apparatus according to any one of claims 1 to 7, characterized in that performing the second allocation processing. A receiving means having a two-dimensional detection surface for detecting a region touched by a user's finger and receiving first and second gesture operations by the touched finger;
When a plurality of fingers are in contact with the detection surface, the contact area where each finger is in contact is set as a virtual switch area, and the function for executing a predetermined process is assigned to each switch area. Means,
Upon receiving the first gesture operation, voice notification means for notifying the content of the function assigned to the switch area corresponding to the finger that has performed the operation by voice;
Upon receiving the second gesture operation, a selection means for selecting a function assigned to the switch area corresponding to the finger that has performed the operation as an execution target ;
Display means having a display surface for displaying a plurality of icons for operation,
The detection surface is disposed on the display surface;
The assigning means includes
A first allocation process for allocating a function related to image processing, with a contact area in contact with the detection surface of the plurality of fingers as a switch area;
Selectively performing a second assignment process for assigning a function related to image processing, with the detection area on the detection surface corresponding to each display area where the plurality of icons are displayed as a switch area,
The selection between the first and second allocation processes is determined according to the number of fingers of the user who are simultaneously in contact with the detection surface,
When the second allocation process is performed as an initial setting and more than N fingers simultaneously touch the detection surface, the first allocation process is selected,
N is an integer greater than or equal to 2, and the allocating means contacts the detection surface with 2 or more and N or less fingers for a predetermined time even when the second allocation process is performed. An input receiving apparatus characterized by exceptionally selecting the first allocation process when the above is continued .

Images