JP6132726B2 - Operation input device and information processing device including the same - Google Patents

Description

  The present invention relates to an operation input device that receives a user operation and an information processing device including the same.

  2. Description of the Related Art Conventionally, there has been known an apparatus that enables visually impaired persons with visual impairments to input information using finger braille (see, for example, Patent Document 1). Finger Braille is a communication technique in which characters are expressed by a finger keystroke pattern and conversation is performed. An apparatus that can transmit information to a visually impaired person using finger braille is also known (see, for example, Patent Document 2). These devices are useful for communication between a healthy person and a visually impaired person.

JP 2001-166684 A International Publication No. 01/24140

  However, since the above-mentioned devices dedicated to Braille are special, it is not easy to prepare those devices from the viewpoint of cost. On the other hand, a touch panel is often used as an input / output interface used by a healthy person in an information processing apparatus such as a multifunction machine or a personal computer.

  The objective of this invention is providing the operation input apparatus and information processing apparatus which can aim at communication between a visually impaired person and a healthy person using a touch panel.

  An operation input device according to one aspect of the present invention includes a touch panel, a vibration unit, and a display control unit. The touch panel can detect simultaneous operations on a plurality of locations. The vibration unit vibrates the touch panel for each of a plurality of partial areas. The display control unit displays character information received from an information processing apparatus connected via a communication network by vibration of one or a plurality of the partial areas by the vibration unit according to a predetermined finger braille pattern. .

  An information processing apparatus according to another aspect of the present invention includes the operation input device. The operation input device includes a touch panel, a vibration unit, and a display control unit. The touch panel can detect simultaneous operations on a plurality of locations. The vibration unit vibrates the touch panel for each of a plurality of partial areas. The display control unit displays character information received from an information processing apparatus connected via a communication network by vibration of one or a plurality of the partial areas by the vibration unit according to a predetermined finger braille pattern. .

  ADVANTAGE OF THE INVENTION According to this invention, the operation input apparatus and information processing apparatus which can aim at communication between a visually impaired person and a healthy person using a touch panel are implement | achieved.

FIG. 1 is a configuration diagram of an image processing system according to an embodiment of the present invention. FIG. 2 is a configuration diagram of the image processing apparatus according to the embodiment of the present invention. FIG. 3 is an enlarged view of a main part of the operation display unit of the image processing apparatus according to the embodiment of the present invention. 4 is a plan view of an operation display unit of the image processing apparatus shown in FIG. FIG. 5 is a diagram showing an example of finger braille information and operation correspondence information used in the image processing apparatus shown in FIG. FIG. 6 is a flowchart showing an example of a procedure of mode switching processing executed by the image processing apparatus shown in FIG. FIG. 7 is a flowchart showing an example of a procedure of finger braille operation processing executed by the image processing apparatus shown in FIG. FIG. 8 is a flowchart showing an example of a procedure of finger braille operation processing executed by the image processing apparatus shown in FIG. FIG. 9 is a flowchart illustrating an example of a procedure of reception display processing executed by the image processing apparatus illustrated in FIG. FIG. 10 is a flowchart showing an example of a procedure of character information transmission / reception processing executed by the information terminal of the image processing system shown in FIG. FIG. 11 is a diagram showing an example of a touch panel display screen in a finger braille operation process executed by the image processing apparatus shown in FIG. 12 is a diagram illustrating an example of a display screen of a touch panel in finger braille operation processing executed by the image processing apparatus illustrated in FIG. FIG. 13 is a diagram illustrating an example of a display screen of a touch panel in finger braille operation processing executed by the image processing apparatus illustrated in FIG. FIG. 14 is a diagram showing an example of a touch panel display screen in the finger braille operation process executed by the image processing apparatus shown in FIG.

  Embodiments of the present invention will be described below with reference to the accompanying drawings for understanding of the present invention. In addition, the following embodiment is an example which actualized this invention, Comprising: The thing of the character which limits the technical scope of this invention is not.

[Image forming system 100]
As shown in FIG. 1, the image forming system 100 according to the present embodiment includes an image processing apparatus 10 and an information terminal 20. The image processing apparatus 10 and the information terminal 20 are connected to be able to perform data communication via a communication network 30 such as a LAN or the Internet. Note that one or more of the image processing apparatus 10 and the information terminal 20 can be connected to the image forming system 100.

[Information terminal 20]
As shown in FIG. 1, the information terminal 20 is a personal computer including a control unit 21, a communication I / F 22, an operation unit 23, a display unit 24, and a storage unit 25. The information terminal 20 may be a mobile phone, a smartphone, a tablet terminal, or a PDA.

  The control unit 21 includes control devices such as a CPU, a ROM, and a RAM. The CPU is a processor that executes various arithmetic processes. The ROM is a non-volatile storage unit in which information such as a control program for causing the CPU to execute various processes is stored in advance. The RAM is a volatile storage unit that stores various types of information, and is used as a temporary storage memory (working area) for various types of processing executed by the CPU. And the said control part 21 controls the said information terminal 20 centrally by executing the various control programs previously stored in the said ROM by said CPU.

  The communication I / F 22 is a communication that connects the information terminal 20 to the communication network 30 in a wired or wireless manner and performs data communication with an external device such as the image processing apparatus 10 via the communication network 30. Interface.

  The operation unit 23 includes a keyboard and a mouse for inputting various types of information to the control unit 5 in response to a user operation. The display unit 24 includes a liquid crystal display or an organic EL display that displays various types of information in accordance with control instructions from the control unit 5.

  The storage unit 25 is a storage device such as a hard disk or an SSD that stores various types of information. Specifically, the storage unit 25 stores a control program called a printer driver for controlling the image processing apparatus 10 from the information terminal 20. The control unit 21 can cause the image processing apparatus 10 to execute an image forming process or an image reading process by executing a process according to the printer driver. Furthermore, the control unit 21 can execute a character information transmission / reception process (see FIG. 10) described later according to the printer driver.

  Specifically, the control unit 21 includes a transmission control unit 211 and a reception control unit 212. Here, the control unit 21 functions as the transmission control unit 211 and the reception control unit 212 by the CPU executing various processes according to the printer driver. When the user performs a character information transmission start operation on the operation unit 23, the transmission control unit 211 transmits the character information input by the operation unit 23 to the image processing apparatus 10 as a message. When receiving the character information from the image processing apparatus 10, the reception control unit 212 displays the character information on the display unit 24.

[Image processing apparatus 10]
On the other hand, as shown in FIGS. 1 and 2, the image processing apparatus 10 includes an ADF 1, an image reading unit 2, an image forming unit 3, a paper feeding unit 4, a control unit 5, an operation display unit 6, a storage unit 7, and This is a multi-function machine equipped with a communication I / F 8 or the like. In the present embodiment, an apparatus including the control unit 5 and the operation display unit 6 is an example of an operation input device according to the present invention. The image processing apparatus 10 is only an example of an information processing apparatus according to the present invention. For example, a printer, a facsimile machine, a scanner, a personal computer, a tablet terminal, or the like is an example of the information processing apparatus according to the present invention.

  The ADF 1 is an automatic document feeder that drives each of the transport rollers 12 to transport the document set on the document placement unit 11 to the discharge tray 13 through the image reading position of the image reading unit 2. is there.

  The image reading unit 2 includes a document table 21, a light source unit 22, mirrors 23 and 24, an optical lens 25, a CCD (Charge Coupled Device) 26, and the like. The document table 21 is a document placement unit provided on the upper surface of the image reading unit 2. The reading unit 22 includes an LED light source 221 and a mirror 222, and is movable in the sub-scanning direction 2A.

  The LED light source 221 includes a large number of white LEDs arranged along a main scanning direction perpendicular to the sub-scanning direction 2A. The mirror 222 reflects the light emitted from the LED light source 221 and reflected by the surface of the document at the reading position on the document table 21 toward the mirror 23. The light reflected by the mirror 222 is guided to the optical lens 25 by the mirrors 23 and 24. The optical lens 25 collects incident light and makes it incident on the CCD 26. The CCD 26 includes a photoelectric conversion element that inputs an electrical signal corresponding to the amount of light incident from the optical lens 25 to the control unit 5 as image data of the document.

  The image forming unit 3 performs an image forming process (printing process) based on image data read by the image reading unit 2 or image data input from an information processing apparatus such as an external personal computer. This is a printing apparatus of the type. Specifically, the image forming unit 3 includes a transport unit 30, a photosensitive drum 31, a charging device 32, an exposure device (LSU) 33, a developing device 34, a transfer roller 35, a cleaning device 36, a fixing roller 37, and a pressure roller. 38, a paper discharge tray 39, and the like.

  The sheet feeding unit 4 supplies sheets, such as paper, stored in a sheet feeding cassette 41 detachable from the image processing apparatus 10 to the image forming unit 3. The sheet supplied to the image forming unit 3 passes the fixing roller 37 and the pressure roller 38 through the photosensitive drum 31 and the transfer roller 35 by the conveying unit 30, and then is a discharge tray 39. To be discharged. At this time, in the image forming unit 3, an image forming process for forming an image on a sheet supplied from the paper feeding unit 4 and conveyed by the conveying unit 30 is executed according to the following procedure.

  First, the photosensitive drum 31 is uniformly charged to a predetermined potential by the charging device 32. Next, the exposure device 33 irradiates the surface of the photosensitive drum 31 with light based on image data. As a result, an electrostatic latent image corresponding to the image data is formed on the surface of the photosensitive drum 31. The electrostatic latent image on the photosensitive drum 31 is developed (visualized) with magnetic toner by the developing device 34. The developing device 34 is supplied with magnetic toner from a toner container 34 </ b> A that can be attached to and detached from the image forming unit 3. Subsequently, the toner image formed on the photosensitive drum 31 is transferred to a sheet by the transfer roller 35. Thereafter, the toner image transferred to the sheet is heated and fixed by the fixing roller 37 when the sheet passes between the fixing roller 37 and the pressure roller 38. The magnetic toner remaining on the surface of the photosensitive drum 31 after the image forming process by the image forming unit 3 is removed by the cleaning device 36.

  The control unit 5 includes control devices such as a CPU, a ROM, and a RAM. The CPU is a processor that executes various arithmetic processes. The ROM is a non-volatile storage unit in which information such as a control program for causing the CPU to execute various processes is stored in advance. The RAM is a volatile storage unit that stores various types of information, and is used as a temporary storage memory (working area) for various types of processing executed by the CPU. Then, the control unit 5 controls the image processing apparatus 10 by executing various control programs stored in advance in the ROM by the CPU.

  The operation display unit 6 is provided on the outer surface of the image processing apparatus 10. The operation display unit 6 receives user operations and inputs information to the control unit 5, and displays various types of information according to control instructions from the control unit 5.

  The storage unit 7 is a storage unit such as an EEPROM, a hard disk, or an SSD that stores various types of information. Specifically, the storage unit 7 includes a mode switching process (see FIG. 6), a finger braille operation process (see FIGS. 7 and 8), and a reception display process (see FIG. 9) described later. A control program for execution is stored. The storage unit 7 stores finger braille information and operation correspondence information, which will be described later.

  The communication I / F 8 is a communication that connects the image processing apparatus 10 to the communication network 30 in a wired or wireless manner and performs data communication with an external device such as the information terminal 20 via the communication network 30. Interface.

[Configuration of Operation Display Unit 6]
Next, the operation display unit 6 will be described with reference to FIGS. 3 and 4.

  As shown in FIG. 3, the operation display unit 6 includes a touch panel 61 and hard keys 62. The touch panel 61 includes a display panel such as a liquid crystal panel that displays various operation keys, and can detect a user operation on the operation keys. The hard key 62 includes various operation buttons such as a numeric keypad and a start key.

  For example, the touch panel 61 is a projected capacitive touch panel that detects the position of a user's touch operation based on a change in capacitance. The touch panel 61 has a multi-point detection function (multi-touch function) capable of detecting simultaneous operations on a plurality of locations. When the touch panel 61 detects a user's touch operation, the touch panel 61 inputs a touch operation signal for specifying each detection position of the touch operation to the control unit 5. Since the projected capacitive touch panel having the multipoint detection function is well known, the description thereof is omitted here. However, for simplicity, a finger touches a matrix electrode pattern arranged vertically and horizontally. The electrostatic coupling generated at the spot is detected as an operation. Of course, the touch panel 61 is not limited to a capacitive touch panel as long as the multi-point detection function can be implemented.

  As shown in FIG. 4, the touch panel 61 includes a piezoelectric sheet 63 disposed on the back side of the touch surface of the touch panel 61. The piezoelectric sheet 63 is disposed on the front or back surface of the liquid crystal panel in the touch panel 61. Here, the piezoelectric sheet 63 is provided so as to correspond to the entire detectable region 61A of the touch operation on the touch panel 61, and has a plurality of partial regions 63A arranged in a lattice pattern. Note that the number of the partial regions 63A of the piezoelectric sheet 63 shown in FIG. 4 is merely an example, and for example, the finer partial regions 63A may be provided in the piezoelectric sheet 63.

  Here, the piezoelectric sheet 63 is formed by stacking a plurality of sheets. Each of the sheets is provided with a piezoelectric element corresponding to one partial region 63A. In the touch panel 61, a voltage can be individually applied to each piezoelectric element of the piezoelectric sheet 63. Accordingly, the control unit 5 can control the touch panel 61 to apply a voltage to each of the piezoelectric elements and vibrate each of the partial regions 63A individually. Here, the piezoelectric sheet 63 is an example of a vibrating portion.

  Further, the touch panel 61 can individually detect a voltage generated in the piezoelectric element of the piezoelectric sheet 63 by a pressing operation of a predetermined amount or more of force on the partial region 63A. When the touch panel 61 detects a pressing operation by the user, the touch panel 61 inputs a pressing operation signal for specifying each detection position of the pressing operation to the control unit 5. Thereby, the control unit 5 can individually detect the pressing operation for each of the partial areas 63 </ b> A detected by the touch panel 61. That is, the touch panel 61 can detect a pressing operation of pressing the touch panel 61 by distinguishing it from a touch operation in which the touch panel 61 is lightly touched.

  In the present embodiment, an example in which a function of simultaneously vibrating the plurality of partial areas 63A using the piezoelectric sheet 63 and a function of simultaneously detecting pressing operations of the plurality of partial areas 63A are realized. However, other configurations may be used as long as the same function can be achieved. For example, a configuration in which the touch panel 61 includes a large number of individually connected piezoelectric elements arranged at positions corresponding to the partial regions 63A instead of the piezoelectric sheet 63 is also conceivable as another embodiment.

  In the image processing apparatus 10, the touch panel 61 is used by executing a mode switching process (see FIG. 6) and a finger braille operation process (see FIGS. 7 and 8) described later by the control unit 5. Operation input is performed. The control unit 5 can selectively execute a normal mode and a finger braille mode as operation modes of the touch panel 61. In the normal mode, the control unit 5 performs various operation inputs in accordance with the operation of each operation key displayed on the touch panel 61. On the other hand, in the finger braille mode, the control unit 5 performs various operation inputs in response to pressing operations in accordance with a predetermined finger braille pattern on the touch panel 61.

  Specifically, in order to realize an operation input according to the finger braille pattern, the storage unit 7 stores finger braille information and operation correspondence information that the control unit 5 refers to when executing the finger braille mode. Yes. Here, an example of the finger braille information and the operation correspondence information will be described with reference to FIGS. 5 (A) and 5 (B).

  As shown in FIG. 5A, in the finger braille information, “A”, “I”, “U”, “E”,... And “Number”, “1”, “2”, “ Characters such as “3”, “4”,... Are associated with finger braille patterns (“◯” indicates keystroke) according to a conversation technique using finger braille. For example, the control unit 5 determines that the number “1” is input by inputting the finger Braille pattern corresponding to “1” after the finger Braille pattern corresponding to “number” is input. . On the other hand, when the finger braille pattern corresponding to “a”, which is the same as “1”, is input without the finger braille pattern corresponding to “number” being input, the control unit 5 changes the character “a”. Judge that it was input. In addition, in the above-mentioned finger braille information, in addition to the Japanese syllabary and numbers, muddy sounds, semi-voiced sounds, roaring sounds (ca, ga, etc.), special sounds (za, tee, etc.), symbols (punctuation marks, midpoints, question marks, etc.) Finger braille patterns corresponding to various characters such as English symbols, alphabets, and Chinese characters are stored.

  Accordingly, the control unit 5 can identify a finger Braille pattern that matches the keystroke pattern detected by the touch panel 61 based on the finger Braille information, and can input characters corresponding to the finger Braille pattern. It is. The control unit 5 can notify the user of various characters by vibrating each partial area 63A of the piezoelectric sheet 63 according to the finger Braille pattern based on the finger Braille information.

  On the other hand, as shown in FIG. 5B, in the operation correspondence information, the contents of operation inputs that can be selected for each operation screen displayed on the touch panel 61 and the contents of the finger braille pattern corresponding to each operation input. (Operation command) is associated. For example, in the display screen “function list”, it is determined that the finger braille pattern corresponding to the operation input “original size” is the number “1”. The finger braille pattern corresponding to the input “inner tray” is defined to be the number “1”.

  Accordingly, the control unit 5 can identify a finger braille pattern that matches the keystroke pattern detected by the touch panel 61 based on the operation correspondence information, and extract an operation input corresponding to the finger braille pattern. Is possible. For example, when the operation of the finger braille pattern corresponding to the number “1” is performed on the display screen “function list”, the control unit 5 has received an operation input corresponding to the operation input “original size”. to decide. Further, the control unit 5 vibrates each of the partial regions 63A of the piezoelectric sheet 63 according to the finger Braille pattern based on the finger Braille information and the operation correspondence information. Information regarding the operation of the image processing apparatus 10 can be notified to the user.

[Function of control unit 5]
In the image processing apparatus 10, as shown in FIG. 1, the control unit 5 includes an input control unit 51, a display control unit 52, a verification processing unit 53, a login processing unit 54, a logout processing unit 55, and a vibration control unit. 56 and an output processing unit 57. Here, the control unit 5 executes various processes in accordance with the control program by the CPU, whereby the input control unit 51, the display control unit 52, the collation processing unit 53, and the login processing unit 54. , Function as the logout processing unit 55, the vibration control unit 56, and the output processing unit 57. Note that some or all of the input control unit 51, the display control unit 52, the collation processing unit 53, the login processing unit 54, the logout processing unit 55, the vibration control unit 56, and the output processing unit 57 are included. It may be a circuit module.

  The input control unit 51 inputs characters according to the detection result by the touch panel 61 and the finger braille pattern. Specifically, the input control unit 51 inputs characters corresponding to the finger braille pattern according to the detection result by the touch panel 61 and the finger braille information stored in the storage unit 7.

  The display control unit 52 receives character information received from an information processing apparatus such as the information terminal 20 connected via the communication network 30, and each of the partial areas 63A of the piezoelectric sheet 63 according to the finger braille pattern. Display by vibration. Specifically, the input control unit 51 vibrates each of the partial areas 63 </ b> A according to the character information and the finger braille information stored in the storage unit 7.

  The collation processing unit 53 collates character information input by the input control unit 51 with preset authentication information of each user. That is, the collation processing unit 53 can accept an operation input according to a finger braille pattern performed using the touch panel 61 during a user authentication process.

  In the present embodiment, the case where the user authentication process is executed by character input according to the finger braille pattern only in the finger braille mode will be described as an example, but the present invention is not limited to this. That is, in the image processing apparatus 10, the control unit 5 uses character input according to the finger braille pattern as one of the login methods even when the operation mode of the touch panel 61 is not the finger braille mode. It is possible that the user authentication process can be executed. Thereby, even when a healthy person operates, it is possible to input character information for user authentication without being seen by others.

  The login processing unit 54 logs in the user corresponding to the authentication information when the collation processing unit 53 determines that the character information and the authentication information match.

  In addition, the logout processing unit 55 changes from a state where the interval between two operation areas corresponding to the user's thumb on the touch panel 61 is greater than or equal to a preset threshold to a state less than the threshold in the user's login state. It is possible to log out the user on the condition. That is, the logout is executed when the user performs an operation of matching the thumbs of both hands. However, when a character is input using the touch panel 61, the logout processing unit 55 is a case where the interval between the two operation areas corresponding to the thumb changes to a state less than the threshold. Do not log out. This is because, when characters are input using the touch panel 61, the input control unit 51 determines the currently input character by the same operation.

  The vibration control unit 56 indicates the success or failure of the login of the user by the login processing unit 54 as vibration of each of the partial regions 63A of the piezoelectric sheet 63 according to the predetermined finger braille pattern. Thereby, the visually impaired can recognize the execution result of the login operation.

  The output processing unit 57 can execute print processing and transmission processing of character information input by the input control unit. A configuration in which the output processing unit 57 can execute only one of printing processing and transmission processing of character information input by the input control unit is also conceivable as another embodiment.

[Processing of Image Processing System 100]
Hereinafter, according to the flowcharts of FIGS. 6 to 10, various processes executed by the control unit 5 of the image processing apparatus 10 and the control unit 21 of the information terminal 20 in the image processing system 100 will be described in order. Moreover, FIGS. 11-14 is a figure which shows the example of operation in the said various processes, and it refers suitably in the following description. In addition, when the operation display unit 6 is provided with a control unit separately from the control unit 5, the control unit may execute various processes instead of the control unit 5.

[Mode switching processing]
FIG. 6 is a flowchart showing an example of the procedure of the mode switching process executed by the control unit 5.

<Step S1>
In step S <b> 1, based on the touch operation signal input from the touch panel 61, the control unit 5 performs any ten touch operations (hereinafter referred to as “switching operation”) on the touch panel 61 at the same time. Determine if it is done. At this time, the control unit 5 determines the presence / absence of the switching operation in the entire detectable area 61 </ b> A of the touch panel 61. Thereby, since it is not necessary to perform the switching operation on a predetermined position on the touch panel 61, a visually impaired person can easily perform the switching operation.

  FIG. 11A is a diagram showing a function list screen corresponding to the copy process displayed on the touch panel 61. FIG. 11B shows a touch of 10 points on the touch panel 61 by the user. It is a figure which shows the state in which operation is performed simultaneously. In FIGS. 11 to 14, a place where a touch operation is performed on the touch panel 61 (a hollow circle) is a touch operation area 611, and a place where a press operation is performed on the touch panel 61. The “filled circle” is referred to as a pressing operation area 631. Each of the touch operation area 611 and the pressing operation area 631 includes an operation location on the touch panel 61 and a range in the vicinity thereof (for example, an area having a radius of 5 mm with the operation location as the center).

  Here, when it is determined that the switching operation is not performed on the touch panel 61 (No side of S1), the control unit 5 shifts the process to step S2. On the other hand, when it is determined that the switching operation is performed on the touch panel 61 (Yes side of S1), the control unit 5 shifts the process to step S101.

  In the present embodiment, a case will be described in which it is determined that the switching operation is performed when 10 simultaneous operations are detected, but the number is not limited to 10 and is determined in advance. It is sufficient if it is the number above. However, the number of simultaneous operations in the switching operation is preferably 6 points or more corresponding to the number of fingers used for finger Braille. This prevents the operation mode of the touch panel 61 from being switched from the normal mode to the finger braille mode due to a user's erroneous operation.

<Steps S2 to S4>
In step S <b> 2, the control unit 5 executes a normal mode as an operation mode of the touch panel 61. In the normal mode, the control unit 5 executes an operation input corresponding to the operation key in response to a touch operation of various operation keys performed on the touch panel 61 (Yes in S3) (S4). Thereafter, the control unit 5 returns the processing to step S1. Thus, when ten touch operations are not simultaneously detected on the touch panel 61, the control unit 5 executes the normal mode.

<Step S101>
On the other hand, in step S <b> 101, the control unit 5 executes a finger braille mode as an operation mode of the touch panel 61. That is, the operation mode of the touch panel 61 in the image processing apparatus 10 is switched from the normal mode to the finger braille mode. Thereafter, the control unit 5 returns the processing to step S1. Thus, when ten touch operations are simultaneously detected on the touch panel 61, the finger braille mode is executed by the control unit 5. In the finger braille mode, when the simultaneous operation of 10 points is not detected (No side of S1), when the image processing apparatus 10 is in the user login state, the control unit 5 logs out the user. Then, the operation mode is switched to the normal mode.

[Finger Braille operation processing]
In the finger braille mode, the controller 5 executes finger braille operation processing (see FIGS. 7 and 8). In the finger braille operation process, the control unit 5 executes a process corresponding to an input operation according to a finger braille pattern on the touch panel 61 of the operation display unit 6. That is, in the finger braille mode, even when a touch operation is performed on each operation key displayed on the touch panel 61, an operation input corresponding to the operation key is not executed. Hereinafter, the finger braille operation process will be described with reference to FIGS. 7 and 8. The control unit 5 executes the mode switching process and the finger braille operation process substantially in parallel.

<Step S11>
In step S <b> 11, when the switching operation is detected by the touch panel 61, the control unit 5 displays each of the touch operation areas 611 where the touch operation is performed according to the position of the touch operation area 611. Associate with each finger. The correspondence relationship between the touch operation area 611 and the finger is stored in the storage unit such as the RAM or the EEPROM of the control unit 5. At this time, the control unit 5 stores, as the touch operation area 611, position coordinates of a predetermined range (for example, an area having a radius of 5 mm centered on the detection position) including the detection position of the touch operation on the touch panel 61 and the vicinity thereof. . As described above, by setting the area in the vicinity of the detection location on the touch panel 61 as the touch operation area 611, a slight shift of each finger of the user during the operation is allowed.

  In step S11, the partial area 63A of the piezoelectric sheet 63 corresponding to each of the touch operation areas 611 is associated with each finger of the user according to the position of the touch operation area 611. Specifically, the correspondence between the position coordinates on the touch panel 61 and the partial area 63 </ b> A of the piezoelectric sheet 63 is stored in advance in the ROM or the like of the control unit 5. Then, the control unit 5 specifies the partial area 63A of the piezoelectric sheet 63 corresponding to the position coordinates of each of the touch operation areas 611 based on the correspondence relationship, and associates each partial area 63A with each finger of the user. .

  For example, the control unit 5 associates each of the touch operation areas 611 with each finger of the user according to the position coordinates in the left-right direction on the touch panel 61. That is, the leftmost touch operation area 611 in the touch operation area 611 is associated with the little finger of the left hand, and the touch operation area 611 located on the right sequentially from there is assigned the left ring finger, middle finger, index finger, thumb. Associate with the right thumb, index finger, middle finger, ring finger, and little finger.

  As a result, in the following processing, the control unit 5 recognizes the touch operation and the pressing operation of each of the touch operation areas 611 on the touch panel 61 as an operation with a finger associated with the touch operation area 611. Is possible. In addition, the control unit 5 can specify the partial area 63A corresponding to each finger of the user when vibrating the partial areas 63A according to the finger braille pattern.

  The association method described here corresponds to a case where the number of simultaneous operations in the switching operation is 10 points. On the other hand, for example, when the number of simultaneous touch operations determined as the switching operation is 6, the control unit 5 corresponds the leftmost touch operation region 611 among the touch operation regions 611 to the ring finger of the left hand. Each of the touch operation areas 611 located on the right is sequentially associated with the middle finger, the index finger, the index finger, the middle finger, and the ring finger of the right hand.

<Step S12>
Next, in step S12, the control unit 5 confirms that the current operation mode is the finger braille mode by vibration of the one or more partial areas 63A by the piezoelectric sheet 63 according to the finger braille pattern. Notify users. At this time, the control unit 5 vibrates the partial area 63A corresponding to the position of one or a plurality of fingers according to the finger braille pattern based on the association performed in step S11.

  Specifically, the control unit 5 converts each character of the “finger-braille mode” into the finger-braille pattern based on the finger-braille information, and the user associated in step S11 according to the finger-braille pattern The piezoelectric elements in the partial regions 63A at the finger positions are simultaneously vibrated. For example, “yu”, “bi”, “te”, “n”, “ji”, “mo”, “-”, “do” are converted into the finger braille pattern, and the finger braille pattern Accordingly, each of the partial areas 63A corresponding to each finger of the user is vibrated in order. Thereby, the user who is visually impaired can recognize that the operation mode of the touch panel 61 has been switched to the finger braille mode.

<Step S13>
In step S <b> 13, the control unit 5 sends a login operation request for notifying that a login operation is to be executed to one or more of the parts by the piezoelectric sheet 63 according to the finger braille pattern as in step 12. The user is notified by the vibration of the area 63A.

  Specifically, based on the finger braille information, the control unit 5 converts each character of “login operation start” into the finger braille pattern, and the user's associated in step S11 according to the finger braille pattern. The piezoelectric elements in each of the partial regions 63A at the finger position are vibrated simultaneously. For example, each character of “RO”, “GU”, “I”, “N”, “SO”, “U”, “SA”, “KA”, “I”, “SH” is changed to the finger braille pattern. Each of the partial areas 63A corresponding to each finger of the user is sequentially vibrated according to the finger braille pattern. Thereby, the user who is visually impaired can recognize that the login operation to the touch panel 61 is necessary. Note that the control unit 5 may notify the login operation request by voice using a speaker (not shown) mounted on the image processing apparatus 10.

<Step S14>
Next, in step S <b> 14, the control unit 5 inputs characters as authentication information according to the detection result of the pressing operation by the touch panel 61 and the finger braille pattern. Specifically, the authentication information is a user ID and password used to authenticate the user. Here, when the character information corresponding to the authentication information is input, the control unit 5 may not display the authentication information on the touch panel 61. This prevents the authentication information from being seen by others when the user inputs the authentication information. In addition, when the character information corresponding to the authentication information is not input, the control unit 5 causes the touch panel 61 to display the character information input by the touch panel 61.

  For example, the control unit 5 causes the touch panel 61 to display a character input screen D1 as shown in FIG. In addition, although a healthy person uses the said character input screen D1 in order to identify the said normal mode and the said finger braille mode, a visually handicapped person does not refer to the content of the said character input screen D1. Therefore, it is also conceivable as another embodiment that the character input screen D1 is not displayed.

  At this time, the control unit 5 inputs a character according to a pressing operation rather than a touch operation on the touch panel 61. Therefore, a visually handicapped person can input a character by pressing the touch panel 61 while putting his / her fingers on the touch panel 61 and pressing only the finger necessary for the finger braille pattern. it can. Therefore, it is not necessary to lift a finger that is not used for character input by the finger braille pattern, and the burden on the visually impaired person during character input is reduced.

  The detection of the finger braille pattern is not based on an operation pattern performed at the same time, but based on an operation pattern performed within a preset operation time in order to allow some errors. For example, when the pressing operation of the middle finger of the right hand is detected 0.5 seconds after the pressing operation of the left index finger is detected, the control unit 5 performs the pressing operation simultaneously with the two fingers. The finger braille pattern is determined as a thing. The operation time is appropriately set by the control unit 5 according to the operation of the operation display unit 6 by the user in the initial setting of the image processing apparatus 10, for example.

  Some of the finger braille patterns represent one command by two or more consecutive operations. For example, the number “1” is a sequence of a finger braille pattern called a number mark operated with the left and right index fingers, middle finger and ring finger, and a finger braille pattern operated only with the left index finger in that order. It is expressed by operating. For this reason, in the detection of the finger braille pattern, an operation until a predetermined detection interval elapses is determined as a continuous operation. The detection interval is appropriately set by the control unit 5 according to the operation of the operation display unit 6 by the user in the initial setting of the image processing apparatus 10, for example. Thereby, a visually handicapped person can input characters represented by two or more continuous operations using the piezoelectric sheet 63. Here, the detection interval needs to be longer than the operation time. For example, the control unit 5 may be controlled so that the detection interval cannot be set shorter than the operation time in the initial setting.

  Here, FIG. 13A to FIG. 13D are diagrams showing an example of character input operation using the character input screen D1 in the finger braille mode. Specifically, FIG. 13A shows a case where only the left index finger is pressed on the touch panel 61. In this case, “A” corresponding to the pressing operation in the pressing operation area 631 is performed. Is input to the character input field D11. FIG. 13B shows a case where the left index finger and middle finger are operated on the touch panel 61. In this case, the character “I” corresponding to the pressing operation in the pressing operation area 631 is performed. Is input to the character input field D11. FIG. 13C shows a case where the left index finger and the right index finger are operated on the touch panel 61. In this case, “U” corresponding to the pressing operation in the pressing operation area 631 is performed. Is input to the character input field D11. FIG. 13D shows a case where a three-point operation of the left index finger, middle finger, and right index finger is performed on the touch panel 61, and in this case, the press operation in the press operation area 631 corresponds to “ The character “e” is entered in the character input field D11.

  In step S14, two items of user ID and password are input. Therefore, for example, after the user's ID is input, the control unit 5 determines the input of the ID when the interval between the two touch operation areas 611 corresponding to the user's thumb becomes smaller than the threshold value. It is possible to change to a password input waiting state. The control unit 5 receives an input of a user password. In addition, when accepting the input of the password in this way, the control unit 5 may notify the user to that effect by vibration of each of the partial areas 63A of the piezoelectric sheet 63 of the touch panel 61.

<Step S15>
In step S <b> 15, the control unit 5 determines whether or not a predetermined confirmation operation has been performed based on an operation signal input from the touch panel 61. Specifically, the control unit 5 determines that the confirmation operation has been performed when the interval between the two touch operation areas 611 corresponding to the thumbs of both hands of the user has decreased to the threshold value or less. For example, the control unit 5 determines that the confirmation operation has been performed when the touch operation areas 611 corresponding to the thumbs of both hands of the user touch each other.

  Here, FIG. 12B shows a state in which the distance between the two touch operation areas 611 corresponding to the thumb has become smaller than the threshold value. As described above, in the image processing apparatus 10, the user can confirm the input of characters by a simple operation method in which the thumb is brought close to the image processing apparatus with few false detections. Here, if the said control part 5 judges that the said confirmation operation was performed (Yes side of S15), it will transfer a process to step S16. In addition, the said control part 5 transfers a process to the said step S14 until the said confirmation operation is performed (No side of S15).

<Step S16>
In step S <b> 16, the control unit 5 determines the input of the character information input in step S <b> 14 and collates the character information with the authentication information stored in advance in the storage unit 7. At this time, the control unit 5 logs in the user corresponding to the authentication information if the collation result matches. The user information is registered in the storage unit 7 by the control unit 5 in advance by operating the operation display unit 6 in the image processing apparatus 10.

  Thereafter, when the control unit 5 is in the logged-in state of the user and is not in the middle of character input by the touch panel 61, the interval between the two touch operation areas 611 corresponding to the user's thumb on the touch panel 61 is equal to or greater than the threshold value. The user is logged out on the condition that the state has changed from a state of (1) to a state of less than the threshold.

  In the image processing apparatus 10, the character input confirmation operation and the logout operation by the touch panel 61 are performed by the same operation, but different operation methods may be employed as these operation methods. For example, it is conceivable that any one of the character input confirmation operation and the logout operation by the touch panel 61 is a simultaneous pressing operation of 10 points on the touch panel 61. Further, it is conceivable that one of the character input confirmation operation and the logout operation by the touch panel 61 is an operation in which the operation of bringing the thumb close is performed twice in succession.

<Step S17>
In step S17, the control unit 5 notifies the user of the success or failure of the login of the user as in step S12 as the collation result in step S16. Specifically, the control unit 5 notifies the user of the collation result by vibration of one or a plurality of the partial areas 63A by the piezoelectric sheet 63 according to the finger braille pattern. Note that the control unit 5 may notify the collation result by voice using a speaker (not shown) mounted on the image processing apparatus 10.

<Step S18>
In step S18, the control unit 5 determines whether or not the collation result is coincident. Here, if the collation result is coincident (Yes side of S18), the control unit 5 shifts the process to Step S19, and if the collation result is not coincident (No side of S18), the control unit 5 performs the process. Return to step S14.

<Step S19>
In step S19, various types of notification information generated in the image processing apparatus 10 are notified to the user in the same manner as in step S12. Specifically, the notification information includes the content of the current display screen of the touch panel 61, the content of the operation input executable on the display screen, the content of the finger braille pattern corresponding to each of the operation inputs, or an error notification. Content. Note that the control unit 5 may notify the notification information by voice using a speaker (not shown) mounted on the image processing apparatus 10.

  For example, when the function list display screen is displayed on the touch panel 61 (see FIG. 14A), the control unit 5 converts the characters of “function list” into the finger braille pattern, and after the conversion The user is notified by vibrating each partial area 63A of the piezoelectric sheet 63 in accordance with the finger braille pattern. Subsequently, the control unit 5 includes “original size”, “original setting direction”, “original size mixed loading”, “discharge destination”, and the contents of operation inputs that can be executed on the display screen “function list”. The content of the finger braille pattern corresponding to each of the operation inputs is notified to the user by vibrating each partial area 63A of the piezoelectric sheet 63. For example, the control unit 5 converts each character of “1 for document size”, “2 for document setting”, “3 for mixed document size”, and “4 for paper discharge destination” into the finger braille pattern, Each of the partial areas 63A corresponding to each finger of the user is vibrated in order according to the finger braille pattern. Thereby, the visually impaired person can display the contents of the function list display screen displayed on the touch panel 61, the contents of the operation input executable on the function list display screen, and the finger braille pattern corresponding to each of the operation inputs. Can be recognized (input command).

  Further, when various errors occur in the image processing apparatus 10, the control unit 5 converts the content of the error into the finger braille pattern, and the partial area of the piezoelectric sheet 63 according to the converted finger braille pattern. The user is notified by vibrating each of 63A. The error includes, for example, a paper jam, a paper out, and a toner out. Thereby, even a visually handicapped person can grasp an error currently occurring in the image processing apparatus 10. In the normal mode, predetermined notification information regarding the operation of the image processing apparatus 10 such as an error currently occurring in the image processing apparatus 10 and status information is displayed on the upper and lower ends of the touch panel 61, or the like. An error screen is displayed on the touch panel 61.

<Step S20>
Thereafter, in step S <b> 20, the control unit 5 determines whether or not a keystroke operation corresponding to any of the finger Braille patterns included in the operation correspondence information has been detected by the piezoelectric sheet 63. Specifically, the pressing operation of each of the partial areas 63A associated in step S11 is defined as the key pressing operation of the finger corresponding to each of the partial areas 63A, and the finger pressing operation pattern and the finger braille pattern of the operation correspondence information Judge whether there is a match.

  Here, when it is determined that a keystroke operation corresponding to the finger braille pattern of the operation correspondence information has been performed (Yes side of S20), the control unit 5 shifts the process to step S201. On the other hand, if the keystroke operation corresponding to the finger braille pattern of the operation correspondence information is not performed (No side of S20), the control unit 5 shifts the process to step S21.

<Step S201>
In step S201, the control unit 5 performs various operation inputs in accordance with the pressing operation according to the finger braille pattern detected by the piezoelectric sheet 63 in step S20 based on the operation correspondence information. Accordingly, while the touch panel 61 is simultaneously detecting 10 points, that is, while the user places the fingers of both hands on the touch panel 61, the operation input in the finger braille mode is performed by the control unit 5. Executed.

  Here, FIGS. 14A and 14B are diagrams showing examples of operation input in the finger braille mode. As shown in FIG. 14 (A), when the left index finger, the right index finger, and the middle finger are pressed simultaneously on the touch panel 61, the control unit 5 displays the “function list” display screen. It is determined that the operation of pressing the “1” finger braille pattern corresponding to the content of the operation input of “discharge destination” is performed. Then, as shown in FIG. 14B, the control unit 5 displays the display screen of the touch panel 61 as “processing for the paper discharge destination” which is the content of the operation input corresponding to the number “1”. Transition to “discharge destination”.

  Note that FIG. 14A shows the case where the number mark pressing operation is omitted, but a configuration that requires the number mark pressing operation is also conceivable. Further, in the present embodiment, a case will be described in which numeric input corresponding to various operation inputs is used as a command for executing each of the operation inputs. On the other hand, when the content of each operation input is input according to the finger braille pattern, the control unit 5 may execute the operation input corresponding to the character.

<Step S21>
On the other hand, in step S <b> 21, based on the pressing operation signal input from the touch panel 61, the control unit 5 determines whether or not the ten simultaneous pressing operations on the piezoelectric sheet 63 have been performed twice in succession. Judging. Here, when it is determined that the simultaneous pressing operation of 10 points has been continuously performed twice (Yes side of S21), the control unit 5 shifts the process to step S22. On the other hand, when the simultaneous pressing operation of 10 points is not performed twice continuously (No side of S21), the control unit 5 returns the process to step S19.

  In the present embodiment, a case is described in which it is determined whether or not there is a simultaneous pressing operation of 10 points in step S21 and steps S31 and S37 described later. However, the number is not limited to 10 and the finger braille It may be an arbitrary number that is larger than the maximum number of simultaneous keystrokes in the pattern. For example, in the finger braille, 6 points is the maximum number of simultaneous keystrokes, and therefore the arbitrary number can be 7 points or more and 10 points or less, which is larger than 6 points.

<Step S22>
In step S22, the control unit 5 shifts the operation mode of the image processing apparatus 10 to the character information transmission mode. That is, the control unit 5 switches the operation mode of the image processing apparatus 10 to the character information transmission mode in response to detection of the simultaneous pressing operation of 10 points on the piezoelectric sheet 63. This processing is executed by the output processing unit 57 of the control unit 5. The character information transmission mode is an operation mode for transmitting character information input using the touch panel 61 to the information terminal 20. For example, when the visually impaired person uses the image processing apparatus 10 and an error such as a paper jam occurs, the character information transmission mode is a message to other users who use the information terminal 20. Used to send The character information transmission mode is also used when a visually handicapped person transmits a message such as a question or a consultation regarding the operation of the image processing apparatus 10 to another user who uses the information terminal 20. The Specifically, in the character information transmission mode, steps S23 to S27 described later are executed.

<Step S23>
In step S23, the control unit 5 notifies the user that the operation mode of the image processing apparatus 10 has shifted to the character information transmission mode. Specifically, the control unit 5 notifies the user that the character information transmission mode has been changed by vibration of one or a plurality of the partial areas 63A by the piezoelectric sheet 63 according to the finger braille pattern. Note that the control unit 5 may notify by voice using a speaker (not shown) mounted in the image processing apparatus 10 that the character information transmission mode has been changed. Thereby, the user who is visually impaired can recognize that the operation mode of the image processing apparatus 10 has been switched to the character information transmission mode.

<Step S24>
In step S24, the control unit 5 inputs a character in response to a pressing operation corresponding to the finger braille pattern on the touch panel 61, as in step S14.

(Step S25)
Thereafter, in step S25, based on the touch operation signal input from the touch panel 61, the control unit 5 determines whether or not the determination operation (see FIG. 12B) similar to step S15 has been performed. to decide.

  Here, when it is determined that the confirmation operation has been performed (Yes in S25), the control unit 5 shifts the process to step S26. On the other hand, when the determination operation is not performed (No side in S25), the control unit 5 shifts the process to step S27. Thus, until it is determined in step S25 that the confirmation operation has been performed (No in S25), the control unit 5 performs character input (S24) according to the finger braille pattern on the touch panel 61. The

(Step S26)
In step S26, the control unit 5 determines the character input in step S24 and transmits the character information to a preset destination via the communication network 30. For example, the control unit 5 transmits a mail to the mail address of the information terminal 20 registered in advance for each user. As a result, the information terminal 20 allows the user to refer to the character information input from the image processing apparatus 10. In step S26, it may be possible to input a destination such as the e-mail address.

  For example, the control unit 5 displays a setting screen for inputting the e-mail address on the touch panel 61 of the operation display unit 6 and displays a message prompting the input of the e-mail address in the partial area 63A of the piezoelectric sheet 63. The user is notified by each vibration. And it is possible that the said control part 5 inputs the said mail address according to operation according to the said finger braille pattern of the user with respect to the said touch panel 61. FIG. In step S26, the character information may be transmitted to a server (not shown) connected via the communication network 30, and the character information may be stored in the server.

  Moreover, the transmission method of the said character information in the said step S26 should just be a method which can transmit the said character information to information processing apparatuses, such as the said information terminal 20, not only email. For example, the control unit 5 may use the error notification function of the printer driver installed in the information terminal 20 to display the character information on the information terminal 20 in a pop-up screen. The control unit 5 may use the network scan function of the printer driver to convert the character information into image data and send it to the information terminal 20 as a scan result.

(Step S27)
Thereafter, in step S27, based on the pressing operation signal input from the touch panel 61, the control unit 5 determines whether or not the simultaneous pressing operation of 10 points on the piezoelectric sheet 63 has been performed twice in succession. to decide. Here, when it is determined that the simultaneous pressing operation of 10 points has been performed twice in succession (Yes in S27), the control unit 5 shifts the process to step S28. On the other hand, when the simultaneous pressing operation of 10 points is not performed twice continuously (No side of S27), the control unit 5 returns the process to step S24.

<Step S28>
In step S28, the control unit 5 shifts the operation mode of the image processing apparatus 10 to the character information printing mode. That is, the control unit 5 switches the operation mode of the image processing apparatus 10 to the character information printing mode in response to the detection of the simultaneous pressing operation of 10 points on the piezoelectric sheet 63. This processing is executed by the output processing unit 57 of the control unit 5. The character information printing mode is an operation mode for printing character information input using the touch panel 61 by the image forming unit 3. For example, in the character information print mode, when an visually impaired person uses the image processing apparatus 10 and an error such as a paper jam occurs, the printed matter is shown to other users. Used to communicate the situation. Specifically, in the character information printing mode, steps S29 to S33 described later are executed.

<Step S29>
In step S29, the control unit 5 notifies the user that the operation mode of the image processing apparatus 10 has shifted to the character information printing mode. Specifically, the control unit 5 notifies the user that the character information printing mode has been changed by the vibration of one or a plurality of the partial areas 63A by the piezoelectric sheet 63 according to the finger braille pattern. Note that the control unit 5 may notify by voice using a speaker (not shown) mounted on the image processing apparatus 10 that the character information printing mode has been shifted. Thereby, the user who is visually impaired can recognize that the operation mode of the image processing apparatus 10 has been switched to the character information printing mode.

<Step S30>
In step S <b> 30, the control unit 5 inputs a character in response to a pressing operation corresponding to the finger braille pattern on the touch panel 61 as in step S <b> 14.

(Step S31)
Thereafter, in step S31, the control unit 5 determines whether or not the determination operation (see FIG. 12B) similar to step S15 has been performed based on the touch operation signal input from the touch panel 61. to decide.

  Here, when it is determined that the confirmation operation has been performed (Yes in S31), the control unit 5 shifts the process to step S32. On the other hand, when the determination operation is not performed (No side of S31), the control unit 5 shifts the process to step S33. Thus, until it is determined in step S31 that the confirmation operation has been performed (No side of S31), the control unit 5 performs character input (S30) according to the finger braille pattern on the touch panel 61. The

(Step S32)
In step S32, the control unit 5 determines the character input in step S30, and executes an image forming process using the image forming unit 3 based on the character information. Thereby, the character information input by the image processing apparatus 10 can be obtained as a printed matter, and the contents can be confirmed by a healthy person. In step S32, various printing conditions for printing the character information are also set.

  For example, the control unit 5 displays a setting screen for setting the printing conditions on the touch panel 61 of the operation display unit 6, and similarly to step S19, operation information regarding the printing conditions is displayed on the piezoelectric sheet 63. The user is notified by the vibration of each of the partial areas 63A. And it is possible that the said control part 5 sets the said printing conditions according to operation according to the said user's finger braille pattern with respect to the said touch panel 61. FIG.

(Step S33)
Thereafter, in step S33, based on the pressing operation signal input from the touch panel 61, the control unit 5 determines whether or not the simultaneous pressing operation of 10 points on the piezoelectric sheet 63 has been performed twice in succession. to decide. Here, when it is determined that the simultaneous pressing operation of 10 points has been performed twice in succession (Yes side of S33), the control unit 5 shifts the process to step S19. On the other hand, when the simultaneous pressing operation of 10 points is not performed twice continuously (No side of S33), the control unit 5 returns the process to step S30.

[Receive display processing]
Next, an example of the procedure of the reception display process executed by the control unit 5 will be described with reference to FIG. The control unit 5 executes the reception display process substantially in parallel with the mode switching process and the finger braille operation process.

<Step S41>
In step S41, the control unit 5 determines whether or not the current input mode of the operation display unit 6 of the image processing apparatus 10 is the finger braille mode. Here, if the said control part 5 judges that the said input mode is the said finger braille mode (Yes side of S41), it will transfer a process to step S42. If the input mode is not the finger braille mode (No side of S41), the control unit 5 causes the process to wait in step S41.

<Step S42>
In step S <b> 42, the control unit 5 determines whether character information is received from an external terminal such as the information terminal 20. Note that the transmission of the character information from the information terminal 20 to the image processing apparatus 10 is performed using, for example, the function of the printer driver or by mail transmission. Here, if the said control part 5 judges that the said character information was received (Yes side of S42), it will transfer a process to step S43. In addition, the said control part 5 returns a process to the said step S41, when the said character information is not received (No side of S42).

<Step S43>
In step S43, the control unit 5 notifies the user that the character information has been received. Specifically, the control unit 5 informs the user that the character information has been received by the vibration of the one or more partial areas 63A by the piezoelectric sheet 63 according to the finger braille pattern, as in step S12. Notice. Thereby, the user who is visually impaired can recognize that the character information has been received. It is also conceivable that the control unit 5 notifies the user of the reception of the character information by vibrating the partial area 63A corresponding to all the user's fingers on the touch panel 61 once or twice simultaneously.

<Step S44>
In step S44, the control unit 5 notifies the user of the contents of the character information. Specifically, the control unit 5 notifies the user of the content of the character information by vibration of one or a plurality of the partial areas 63A by the piezoelectric sheet 63 according to the finger braille pattern, as in step S12. . As described above, when a predetermined number of the touch operations are simultaneously detected on the touch panel 61 (Yes in S41), the control unit 5 sets the character information according to the finger braille pattern. Alternatively, the character information is displayed by the vibration of the partial area 63A of the piezoelectric sheet 63 corresponding to the positions of a plurality of fingers. Thereby, a user who is visually impaired can recognize the content of the character information and can communicate with the user of the information terminal 20.

[Character information transmission / reception processing]
Next, an example of a procedure of character information transmission / reception processing executed by the control unit 21 of the information terminal 20 will be described with reference to FIG. The character information transmission / reception process is a process executed by the control unit 21 according to the printer driver.

<Step S51>
In step S <b> 51, the control unit 21 determines whether character information has been received from the image processing apparatus 10. Note that the transmission of the character information from the image processing apparatus 10 to the information terminal 20 is performed using, for example, the function of the printer driver as described above, or by mail transmission. Here, if the said control part 21 judges that the said character information was received (Yes side of S51), it will transfer a process to step S511. In addition, the said control part 21 returns a process to step S52, when the said character information is not received (No side of S51).

<Step S511>
In step S511, the control unit 21 causes the display unit 24 to display the character information. For example, the character information is displayed on the display screen of the display unit 24 in a pop-up screen. Thereby, the user of the information terminal 20 can recognize the character information input by the visually impaired person in the image processing apparatus 10.

<Step S52>
In step S <b> 52, the control unit 21 determines whether or not a transmission start operation for transmitting character information to the image processing apparatus 10 has been performed on the operation unit 23. For example, the transmission start operation is performed by operating a transmission start key displayed on the printer operation screen displayed on the display unit 24 when the control unit 21 executes a printer driver.

  Here, if the said control part 21 judges that the said transmission start operation was performed (Yes side of S52), it will transfer a process to step S53. In addition, the said control part 21 returns a process to the said step S51, when the said transmission start operation is not performed (No side of S52).

<Step S53>
In step S <b> 53, the control unit 21 receives a character information input operation by the operation unit 23. When the character information input confirmation operation is performed, the process proceeds to step S54.

<Step S54>
In step S54, the control unit 21 transmits the character information input in step S53 to the image processing apparatus 10. Thereby, when the image processing apparatus 10 is in the finger braille mode, the character information is notified to the visually impaired person by the reception display process (see FIG. 9) executed by the image processing apparatus 10. The visually impaired person can recognize the content of the character information transmitted from the information terminal 20. For example, the control unit 21 may transmit the character information as a mail to the image processing apparatus 10 using general-purpose mail software. It is also conceivable that the printer driver executed by the control unit 21 is equipped with a function for transmitting the character information.

  As described above, in the image processing system 100, the visually impaired person who is the user of the image processing apparatus 10 can use the touch panel 61 without using a special device dedicated to finger braille as in the past. And a healthy person who is a user of the information terminal 20 can be achieved. Further, in the image processing apparatus 10, it is possible to perform a login operation with finger braille using the touch panel 61 without using a special device dedicated to finger braille as in the past.

  In the present embodiment, the touch operation of the touch panel 61 and the pressing operation are distinguished from each other, and the case where character information is input according to the pressing operation has been described as an example. On the other hand, it is also conceivable as another embodiment that the operation display unit 6 does not include the piezoelectric sheet 63 and the control unit 5 inputs character information in response to a touch operation on the touch panel 61. In this case, it is conceivable that the notification of information to the visually impaired person in the image processing apparatus 10 is performed by sound output from a speaker (not shown) mounted on the image processing apparatus 10.

1: ADF
2: Image reading unit 3: Image forming unit 4: Paper feeding unit 5: Control unit 6: Operation display unit 61: Touch panel 61 A: Operable area 62: Operation button 63: Piezoelectric sheet 63 A: Partial areas S 1, S 2,. *: Processing procedure (step) number 10: Image processing apparatus 20: Information terminal 30: Communication network 100: Image processing system

Claims (4)

An information processing apparatus including an operation input device,
The operation input device is
A touch panel that can detect simultaneous operations on multiple locations;
A vibrating section that vibrates the touch panel for each of a plurality of partial areas;
It is possible to execute a normal mode in which characters are input in accordance with operation of an operation key displayed on the touch panel, and a finger braille mode in which characters are input in accordance with an operation according to a predetermined finger braille pattern on the touch panel. Input control means for switching from the normal mode to the finger braille mode when a predetermined number of preset multi-point operations are detected by the touch panel in the normal mode;
Character information received from another information processing apparatus connected via a communication network in the finger braille mode is displayed by vibration of one or a plurality of the partial areas by the vibrator according to a predetermined finger braille pattern A display control unit,
Equipped with a,
When the display control unit receives the character information from the other information processing apparatus during execution of the finger braille mode, the number of the partial areas corresponding to all the fingers of the user in the vibration unit An information processing apparatus that displays the character information by vibration of one or a plurality of the partial areas by the vibration unit after being displayed by simultaneous vibration . When the predetermined number of touch operations are detected simultaneously, the display control unit associates each touch operation area where the touch operation is performed with each finger of the user according to the position of the touch operation area. The information processing apparatus according to claim 1, wherein the character information is displayed by vibration of the partial area corresponding to the position of one or a plurality of fingers according to the finger braille pattern. The touch panel can detect touch operations on a plurality of locations,
When the display control unit detects a predetermined number of touch operations at the same time, the vibration of the partial area corresponding to the position of one or more fingers according to the finger braille pattern is used as the character information. The information processing apparatus according to claim 1, wherein the character information is displayed. The information processing apparatus according to any one of claims 1 to 3, further comprising an output processing unit capable of executing at least one of the printing process or transmission process character information inputted by the input control unit in the finger Braille mode.

Images