JP2019020662A - Braille device coordination system, braille device, and braille device coordination system control method - Google Patents

Abstract

To provide a braille device coordination system that shares a typical touch panel to be used by normal persons with visually impaired persons without requiring special operations.SOLUTION: A main body control device 110 of a main body device 100 is configured to, when detecting a touch with respect to a touch panel 120, compare the detected touch with a timing of contacting with an object transmitted from a Braille device 200; determine whether the touch is conducted by the Braille device 200; and, when determining that the touch is conducted by the Braille device 200, switch control with respect to the touch to Braille device handling control of making selection operations by the touch invalid.SELECTED DRAWING: Figure 9

Description

  The present invention relates to a Braille device cooperation system, a Braille device, and a control method of the Braille device cooperation system.

  In general, a visually impaired person cannot operate with a normal touch panel. In order to solve such a problem, the technique disclosed in Patent Document 1 discloses a touch panel device that can switch between a normal mode and a visually impaired person mode. In this apparatus, the operator switches to the visually impaired person mode by wearing headphones or by operating the determination switch. In the visually impaired person mode, when the operator touches the touch panel, the touch information is not notified to the control means, but only the touched position information is notified to the control means. The control means guides the screen information corresponding to the position information by voice. If the screen information is desired, the operator turns on a determination switch different from the touch panel. When the determination switch is turned on, the touch panel device notifies the control unit of touch information so that the same operation as in the normal mode can be performed.

  In the technique disclosed in Patent Document 2, an input device using an operator wearing a finger cap capable of wireless communication is disclosed, and the following processing is executed. When the operator wearing the finger cap touches the touch panel, a Braille matrix signal corresponding to the operation type information at the coordinate position of the touch is transmitted to the finger cap. On the finger cap side, a three-dimensional Braille pattern corresponding to the Braille matrix signal is generated inside. The operator recognizes the type of key by tracing the inner braille pattern.

JP 2004-271748 A JP 2000-172408 A

  However, although the technique disclosed in Patent Document 1 can share the touch panel between a healthy person and a visually impaired person, switching to the visually impaired person mode can be performed by depressing a dedicated determination switch, It is done by detecting the installation hardware. In Patent Document 2, there is no mention of mode switching, but the operation key selection operation is performed by pressing the push button with another hand. From this, it can be understood that visually impaired persons need some mode switching for operation.

  As described above, in the conventional technique, when the visually impaired person and the healthy person use the same touch panel, it is necessary to switch the mode by some special operation, which is troublesome.

  This invention is made in view of the said situation, and provides the braille device cooperation system which can share the normal touch panel which a healthy person uses with a visually handicapped person and a healthy person, without requiring special operation. With the goal.

  The above object of the present invention is achieved by the following means.

(1) A Braille device cooperation system including a main body device that receives an operation, and a Braille device that is attached to an operator's hand,
The main unit is
A touch panel for displaying an image on the display surface and detecting a touch on the display surface by an operator;
A communication unit that communicates with the braille device;
A main body control unit,
The braille device is
A finger cover covering the operator's fingertips;
A sensor unit that is disposed at a position corresponding to the belly of the finger of the finger cover and detects that the outside of the finger cover is in contact with an object;
A braille display portion that is arranged inside the finger cover and capable of displaying braille information;
A communication department;
A braille device controller,
With
The Braille device control unit transmits a contact timing to an object according to a detection signal of the sensor unit to the main body device,
When the main body control unit detects a touch on the touch panel, the main body control unit determines whether the touch is due to the Braille device by comparing with the contact timing to the object received from the Braille device,
When it determines with the said touch being the said Braille device, the Braille device cooperation system which switches the control to the said touch to the Braille device corresponding | compatible control which invalidates selection operation of the operation key by a touch.

(2) When the main body control unit switches to the Braille device compatible control, the main body control unit transmits an enable signal indicating the switching to the Braille device,
The Braille device cooperation system according to (1), wherein when the enable signal is received, the Braille device control unit causes the Braille display unit to display information indicating that the control is switched to the Braille device support control.

  (3) When the main body control unit detects a touch on the touch panel by an object other than the Braille device immediately before or immediately after the timing of switching to the Braille device compatible control, the main body control unit performs a process related to the operation of the touch. The braille device cooperation system according to (1) or (2) above, wherein undo processing or invalidation processing for returning to the original state is performed.

(4) After switching to the Braille device compatible control, the main body control unit transmits information on operation keys corresponding to the touch position of the touch panel by the current Braille device to the Braille device,
The Braille device control system according to any one of (1) to (3), wherein the Braille device control unit displays the information received from the main body control unit by the Braille display unit.

(5) The Braille device further includes a determination switch that receives an operation of the operator,
When the determination switch is operated, the Braille device control unit transmits an ON signal indicating that it has been operated to the main body device,
The braille device cooperation system according to (4), wherein when the ON signal is received from the braille device, the main body control unit performs the operation key selection operation corresponding to the touch position by the braille device.

(6) A Braille device capable of communicating with a main body device including a touch panel that detects a touch on a display surface by an operator,
A finger cover covering the operator's fingertips;
A sensor unit that is disposed at a position corresponding to the belly of the finger of the finger cover and detects that the outside of the finger cover is in contact with an object;
A Braille display unit that is arranged inside the finger cover and that can display a three-dimensional Braille pattern that produces a feel of Braille on the fingertip;
A communication department;
A decision switch operated by the operator;
A braille device controller,
With
The Braille device control unit transmits a contact timing to an object according to a detection signal of the sensor unit to the main body device,
The main body device includes a Braille device correspondence control that invalidates a selection operation to the operation key of the touch panel by touching the Braille device and enables a selection operation of the operation key by the determination switch,
The Braille device control unit receives an enable signal indicating that the main body device has switched to the Braille device compatible control from the main body device, and receives an ON signal indicating that the determination switch has been operated, Braille device that is sent to the main unit.

  (7) The above (6) further includes a switching unit that changes a conductive characteristic at a position corresponding to the belly of the finger of the finger cover and switches the finger cover to an invalid state in which contact with the touch panel of the finger cover is not detected. Braille device as described in.

  (8) The Braille device according to (7), wherein the Braille device control unit sets the invalid state by the switching unit when communication with the main device is not possible.

(9) A main body device that accepts an operation through a touch panel, a Braille device that is attached to an operator's hand, and is disposed at a position corresponding to the finger belly of the finger cover that covers the fingertip of the operator. A Braille device cooperation system comprising: a sensor unit that detects that the outside of the finger cover is in contact with an object; and a Braille device that is disposed inside the finger cover and includes a Braille display unit capable of displaying Braille information. Control method,
(A) transmitting a contact timing to an object according to a detection signal of the sensor unit of the Braille device to the main body device;
(B) When the touch on the touch panel is detected by the main body device, it is determined whether or not the touch is due to the Braille device by comparing with the contact timing to the object received from the Braille device. Steps,
(C) When the touch is determined to be caused by the Braille device, the control of the touch is switched to the Braille device compatible control that invalidates the operation key selection operation by the touch on the touch panel. When,
Including a control method.

(10) (d) When switching to the braille device compatible control in the step (c), a step of transmitting an enable signal indicating the switching from the main unit to the braille device;
(E) When the Braille device receives the enable signal, the Braille device further includes a step of displaying information indicating that switching to the Braille device compatible control is performed by the Braille display unit. Control method.

  (11) (f) When switching to the braille device compatible control in the step (c), the main body apparatus detects an object other than the braille device immediately before or immediately after the timing of switching to the braille device compatible control. The method according to (9) or (10), further including a step of performing an undo process or an invalidating process for returning a process related to the operation of the touch to an original state when a touch on the touch panel is detected. Control method.

  According to the present invention, when the main body control unit of the main body apparatus detects a touch on the touch panel, it is compared with the contact timing to the object transmitted from the Braille device, so that the touch is due to the Braille device. Determine whether. And if it is a touch by a Braille device, the control to this touch will be switched to the Braille device corresponding | compatible control which invalidates selection operation of the operation key by touch. Thereby, a normal touch panel used by a healthy person can be shared by a visually impaired person and a healthy person without requiring a special operation.

It is a perspective view which shows the external appearance of the braille device cooperation system which concerns on 1st Embodiment. It is a perspective view which shows the external appearance of a braille device. It is a block diagram which shows the hardware constitutions of a main body apparatus. It is a block diagram which shows the hardware constitutions of a braille device. It is a cross-sectional schematic diagram around a finger cover. It is an example of the operation screen displayed on a touch panel. It is an example of the braille image data for braille corresponding to FIG. It is a schematic diagram which shows the internal structure of a switching part. It is a flowchart which shows the control by the braille device side. It is a main flowchart which shows the control by the side of a main body apparatus. 10 is a flowchart of a sub of FIG. 9. It is a cross-sectional schematic diagram which shows the structure of the braille device which concerns on the modification 1. FIG. 10 is a block diagram illustrating a hardware configuration of a main body device according to Modification 2. FIG. It is a block diagram which shows the hardware constitutions of the braille device which concerns on the modification 2.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted. In addition, the dimensional ratios in the drawings are exaggerated for convenience of explanation, and may be different from the actual ratios.

  FIG. 1A is a perspective view showing an external appearance of the Braille device cooperation system 500 according to the first embodiment, and shows a state in which the touch panel 120 is operated with the Braille device 200. FIG. 1B is a perspective view showing an external appearance of the braille device 200. FIG. 2 is a block diagram illustrating a hardware configuration of the main device 100. FIG. 3 is a block diagram showing a hardware configuration of the braille device 200. As shown in FIGS. 1A to 3, the Braille device cooperation system 500 includes a main body device 100 and a Braille device 200.

(Main unit 100)
The main device 100 is, for example, an MFP (Multifunction Peripheral). As illustrated in FIG. 2, the main device 100 includes a main body control unit 110, a touch panel 120, a printer unit 130, a scanner unit 140, a facsimile unit 150, and a wireless communication unit 160.

  The main body control unit 110 includes a CPU, a RAM, and a ROM. Further, an auxiliary storage device such as an HDD (Hard Disk Drive) may be further provided. The ROM stores various programs and various data in advance, and the RAM temporarily stores programs and data as a work area. The CPU controls the entire main device 100 according to the program.

  The touch panel 120 is also referred to as a touch panel or a touch screen, and includes a display unit 121 configured by a liquid crystal screen or the like, and a touch detection unit 122 that detects an operation of an operator's finger.

  The touch detection unit 122 is, for example, a capacitance type detection unit, and when an operator's finger touches the surface of the touch panel 120, based on the change in capacitance, the presence or absence of the finger contact, and its The contact position (coordinates) is detected. It also supports detection of simultaneous touch (multi-touch) with multiple fingers.

  The printer unit 130 forms an image on a sheet based on print data by a known electrophotographic method or inkjet method.

  The scanner unit 140 includes an original glass on which an original is placed, a light source that irradiates the original with light, an optical system such as a lens, and an optical element such as a CCD that generates image data from reflected light. The scanner unit 140 reads an image of a document placed on a document glass or a document transported by an automatic document transport device, and generates image data.

  The facsimile unit 150 includes a modem and a data access unit. The modem is connected to a data access unit and a communication line network such as a telephone line. The data access unit has a function of outputting a pulse signal corresponding to the destination telephone number. The facsimile unit 150 transmits image data to and from the other party's facsimile apparatus through a communication line network.

  The wireless communication unit 160 includes a wireless communication interface such as BLE (Bluetooth (registered trademark) Low Energy), Bluetooth (registered trademark), IEEE 802.11, or IrDA. Further, as short-range wireless communication, a communication method such as FeliCa (registered trademark), ISO / IEC 14443 (MIFARE (registered trademark) communication method), or ISO / IEC 18092 (NFC: Near Field Communication) may be used. .

  In addition to the above, the main body device 100 is a wired interface, such as a LAN connection interface based on a standard such as Ethernet (registered trademark) or FDDI, a serial interface such as USB or IEEE1394, or a parallel interface such as SCSI or IEEE1284. Etc. may be provided.

(Braille device 200)
As shown in FIGS. 1A, 1B, and 2, the Braille device 200 includes a Braille device control unit 210, a contact sensor 220, a Braille display unit 230, an operation determination switch 240, a switching unit 250 that changes a conductive state, and A wireless communication unit 260 is provided.

  As shown in FIGS. 1A and 1B, a braille device 200 is worn on the hand of an operator such as a visually impaired person, a glove body 291, a finger cover 292 that covers the index finger in the worn state, and this glove A unit case 293 is provided on the back of the hand of the main body 291. The braille device 200 is attached to the operator's hand by a wrist band (not shown) of the glove body 291.

  A contact sensor 220, a Braille display unit 230, a determination switch 240, and a switching unit 250 are provided at the tip of the finger cover 292. A Braille device control unit 210 and a wireless communication unit 260 are provided inside the unit case 293. It is done.

(Braille device control unit 210, wireless communication unit 260)
The Braille device control unit 210 includes a CPU, a RAM, and a ROM. The wireless communication unit 260 communicates with the wireless communication unit 160 by wireless communication. These functions are the same as those of the main body control unit 110 and the wireless communication unit 160, respectively, and description thereof is omitted.

(Contact sensor 220)
The contact sensor 220 is disposed at a position corresponding to the belly of the finger of the finger cover 292 and detects that the outside of the finger cover 292 has contacted an object such as the surface of the touch panel 120. The contact sensor 220 may be a mechanical sensor such as a micro switch or a pressure sensor, or may be an optical sensor. Further, when a pressure sensor is used, it may be determined that a contact has been made when an object is contacted at a pressure higher than a predetermined pressure. When the operator wearing the braille device 200 touches any object such as the touch panel 120 with the tip of the finger cover 292, the contact sensor 220 detects the touch.

(Braille display unit 230)
The Braille display unit 230 is disposed inside the finger cover 292 and displays (implements) a three-dimensional Braille pattern that causes the operator to feel Braille. FIG. 4 is a schematic cross-sectional view around the finger cover 292. As shown in the figure, the braille display unit 230 is provided with a large number of pins that make the fingertip feel a tactile sense, and the protruding amount of the pins in the height direction can be individually changed by a piezoelectric element. The pin density (resolution) is higher than a typical Braille pitch (2 to 3 mm), and text information and simple images can be displayed in addition to the Braille pattern.

  Hereinafter, an example of a Braille pattern displayed on the Braille display unit 230 will be described with reference to FIGS. 5 and 6. FIG. 5 is an example of an operation screen displayed on the touch panel 120. On the operation screen, a plurality of operation keys k1 to k4 (hereinafter collectively referred to as “operation keys k”) are arranged and visually displayed. FIG. 6 shows Braille image data d1 to d4 for Braille corresponding to FIG. 5 (hereinafter, these are collectively referred to as “Braille image data d”). Braille information included in the Braille image data d1 to d4 corresponds to character data indicated by the operation keys k1 to k4, respectively. This correspondence relationship is merely an example, and the character data of the operation keys k1 to k4 and the braille image data do not have to correspond one-to-one, and the semantic content only needs to correspond. For example, the number of braille characters (number of characters) in the braille image data may be less than the number of characters in the character data of the operation keys. Both the image data for the screen in FIG. 5 and the image data for Braille in FIG. 6 are stored in the storage unit of the main body control unit 110.

  In the normal mode, a process corresponding to each operation key k is executed by touching each operation key k with a finger. For example, when the operation key k1 is touched, the operation screen changes to a setting screen related to copying. In Braille device correspondence control, which will be described later, when the operator wearing the Braille device 200 touches the operation key k on the operation screen with the finger cover 292, the corresponding Braille image data d is displayed on the Braille display unit 230. Specifically, for example, by touching any position in the frame (square frame) of the operation key k1 on the surface of the touch panel 120 with the finger cover 292, the braille image data d1 corresponding to the operation key k1 is received from the main body device 100. , Transmitted to the braille device 200 by wireless communication. Then, the braille device 200 displays the received braille image data d1 on the braille display unit 230. In the example of FIG. 6, the braille image data d1 is composed of 6 pieces of data with 6 pins as a set of data. Each data may be sequentially displayed by the braille display unit 230 at predetermined time intervals. Alternatively, six pieces of data may be scrolled and displayed by a slide operation within the operation key k1 by the operator. Further, the braille image data d1 may include not only the braille information but also a figure such as a frame surrounding the whole.

(Decision switch 240)
The determination switch 240 is a pressure sensor arranged so as to overlap the Braille display unit 230. When the operator presses the finger F downward and a pressure greater than or equal to a predetermined value is detected by the pressure sensor, the Braille device control unit 210 determines that the determination switch has been turned ON by the operator. The determination switch 240 is not limited to this, and may be a tact switch operated with a free hand. In this case, the tact switch may be disposed on the upper part of the unit case 293.

(Switching unit 250)
The switching unit 250 is disposed at a position corresponding to the belly of the finger of the finger cover 292, changes the conductive state outside the finger cover 292, and prevents the capacitive touch panel 120 from reacting. In the following, even if the touch panel 120 is touched with the finger cover 292, a state in which contact is not detected is referred to as an invalid state, and a detected state is referred to as an effective state.

  FIG. 7A is a schematic diagram illustrating an internal configuration of the switching unit 250, and FIG. 7B is a partially enlarged view thereof. The switching unit 250 includes a large number of minute conductive plate pieces 251, and the adjacent plate pieces 251 are electrically connected by a switch 252. Each plate piece 251 is of a size that cannot be detected by the touch panel 120 by itself. This size is, for example, a 1 mm square size, and may be appropriately selected depending on the sensitivity of the touch panel 120. Each plate piece 251 is electrically connected by the switch 252 to be in an effective state, and disconnected to be in an invalid state. Switching to the invalid state is performed under a situation where wireless communication cannot be established as will be described later. However, the operator may switch between the invalid state and the valid state by operating a switch (not shown). Good.

(Control method)
Hereinafter, a control method of the Braille device cooperation system 500 will be described with reference to FIGS. FIG. 8 is a flowchart showing control on the Braille device 200 side. FIG. 9 is a main flowchart showing control on the main device 100 side, and FIG. 10 is a sub flowchart.

(Control on the braille device 200 side)
(Step S101)
The braille device control unit 210 determines whether or not communication with the main device 100 is possible. If wireless communication by BLE, for example, can be established with main device 100 (YES), the process proceeds to step S102, and if communication cannot be established (NO), the process proceeds to step S111.

(Step S102)
The braille device control unit 210 switches to the valid state by the switching unit 250. Thereafter, the touch operation on the touch panel 120 by the braille device 200 and other capacitive touch panels becomes possible.

(Step S103)
Here, the Braille device control unit 210 monitors the output of the contact sensor 220 and transmits sensor information, that is, information on contact timing to any object to the main body device 100 in real time. The data to be transmitted is obtained by converting the output of the contact sensor 220 into a signal having a period of several tens of Hz.

(Step S104)
Here, it is determined whether or not Braille information is received from main device 100. If braille information has been received (YES), the process proceeds to step S105.

(Step S105)
Braille information is displayed on the Braille display unit 230. If the display content is braille information related to the enable signal in step S302 described later, for example, all the pins of the braille display unit 230 are lifted. Thereby, the operator can recognize that the braille device 200 is touching the touch panel 120 of the apparatus corresponding to braille device corresponding | compatible control. Further, the content of the operation key k can be recognized as long as it is braille information corresponding to the operation key k in step S303 described later.

(Step S106)
The operator recognizes the content of the operation key k from the display content of the braille display unit 230. If it is a desired operation key k, the determination switch 240 is turned ON (pressed down). If the determination switch 240 is turned on (YES), the braille device controller 210 advances the process to step S107. If not ON (NO), the process returns to step S105.

(Step S107)
The braille device 200 transmits an ON signal of the determination switch 240 to the main device 100.

(Step S111)
If the wireless communication with the main device 100 cannot be established, the braille device control unit 210 switches to the invalid state by the switching unit 250. Thereafter, a touch operation on the touch panel 120 or the like by the braille device 200 is not detected.

(Step S112)
Here, the braille device control unit 210 is not used in the braille display unit 230. For example, by lowering all the pins of the braille display unit 230 to the lowest point, the operator can recognize the invalid state, and thereafter, the operation of the braille display unit 230 is stopped.

(Control on the main device 100 side)
(Step S201)
The main body control unit 110 of the main body device 100 determines whether or not communication with the Braille device control unit 210 is possible. If wireless communication with Braille device control unit 210 can be established (YES), the process proceeds to step S202. If communication cannot be established (NO), the process proceeds to step S211.

(Step S202)
Here, the main body control unit 110 sequentially receives the sensor information transmitted in real time by the Braille device 200 in step S103.

(Step S203)
The main body control unit 110 determines whether a touch on the touch panel 120 is detected. If a touch is detected, the process proceeds to step S204.

(Step S204)
Here, it is determined whether or not the touch detected in step S203 is a touch made by the braille device 200. If the touch is made by the braille device 200 (YES), the process proceeds to step S206; NO), the process proceeds to step S205. This determination is performed based on, for example, whether the waveform indicating the contact timing of the sensor information transmitted from the braille device 200 is the same as the waveform indicating the touch timing on the touch panel 120. More specifically, if the timing at which the sensor information changes from non-contact to contact matches the timing at which the main device 100 detects a touch, the touch detected at step S203 is touched by the braille device 200. Judge that it is. For example, when receiving sensor information with a 60 Hz cycle from the Braille device 200, the main body device 100 determines that the timing at which the main device 100 changes from non-contact to contact is the same cycle or a difference of about one cycle (about 16 msec). The touch is determined to be 200.

(Step S205)
Since the touch operation is performed by a device other than the Braille device 200, normal touch processing is executed. For example, when the operation key k on the operation screen is touched, processing corresponding to the operation key k is executed.

(Braille device support control (subroutine of step S206))
For the touch by the Braille device 200, the Braille device correspondence control shown in FIG. 10 is executed. In the present embodiment, even when the braille device correspondence control is being executed, the touch operation by a device other than the braille device 200 is continuously determined. For example, when a visually handicapped person touches the touch panel 120 with a Braille device, Braille device correspondence control described below is executed. And during this execution or before and after, when a healthy person accompanies and operates another operation key k of the touch panel 120 with bare hands, normal control corresponding to this operation is executed. Instead of this control, when it is determined that the touch is performed by the braille device, only the braille device correspondence control is executed for a predetermined time from this point until the end operation is performed by the braille device 200. Then, the mode may be shifted to a braille device compatible mode in which touch other than the braille device 200 is invalidated.

(Step S301)
Here, erroneous operation prevention processing is executed. Specifically, when switching to Braille device compatible control, that is, when a touch on the touch panel 120 by an object other than the Braille device is detected before and after the timing determined to be a touch by the Braille device 200 (S204: YES), touch Then, an undo process (undo) or an invalidation process for returning the process related to the above operation to the original state is performed. For example, when the touch panel 120 is touched with a finger other than the index finger wearing the finger cover 292 immediately before the touch related to the determination timing, this operation is regarded as an erroneous operation. If processing related to this operation (for example, screen transition or processing execution start) has already been performed, undo processing is performed. If the touch is immediately after the determination timing, the touch is invalidated. Here, the timing before and after this is a case where there is a significant time difference exceeding about one period if the signal has a period of 60 Hz as described above. For example, it is about several hundreds of msec before and after the timing when it is determined that the touch is performed by the braille device 200. In addition, the determination that the touch panel 120 is touched by an object other than the braille device is performed by the process in step S204 described above. In addition, the process related to the past touch operation is stored in the storage unit together with the time when the touch device is performed for a predetermined period.

(Step S302)
The main body control unit 110 transmits to the braille device 200 braille information related to the enable signal indicating that the control has been switched to the braille device compatible control.

(Step S303)
Subsequently, the main body control unit 110 transmits Braille information corresponding to the touch position to the Braille device 200. For example, if the touch is inside the frame of the operation key k1 on the operation screen, the braille image data d1 corresponding to the operation key k1 is transmitted (see FIGS. 5 and 6). After that, when the fingertip (finger cover 292) is slid into the frame of the operation key k2, Braille image data d2 is transmitted.

(Step S304)
The main body control unit 110 waits for reception of the ON signal of the determination switch. If an ON signal has been received (YES), the process proceeds to step S305. If not, the process returns to step S303.

(Step S305)
In response to receiving the ON signal of the determination switch, the main body control unit 110 executes a function process corresponding to the operation key k touched by the braille device 200 at the present time.

  As described above, in the Braille device cooperation system according to the present embodiment, when the main body control unit 110 detects a touch on the touch panel 120, the main body control unit 110 compares this with the contact timing to the object transmitted from the Braille device 200. It is determined whether or not the touch is by the braille device 200. And if it is a touch by the braille device 200, the control to this touch will be switched to the braille device corresponding | compatible control which invalidates selection operation of the operation key by touch. Thereby, a normal touch panel used by a healthy person can be shared by a visually impaired person and a healthy person without requiring a special operation.

  The configurations of the main body device and the Braille device of the Braille device compatible cooperative system described above are the main configurations in describing the features of the first embodiment, and are not limited to the above configurations. Various modifications can be made within the range of. Moreover, the structure with which a general main body apparatus and a braille device are provided is not excluded. For example, the following modifications are possible.

(Modification)
(Modification 1)
In the first embodiment, the switching unit 250 switches between an invalid state where a touch is not detected and a valid state on the capacitive touch panel by switching the conductive state of the conductive plate piece 251. The Braille device 200B according to the first modification described below switches between the invalid state and the valid state by moving the switching unit 250B.

  FIG. 11 is a schematic cross-sectional view showing the configuration of the braille device 200B according to the first modification, and is a view seen from the fingertip direction of the operator's finger F. In the modification 1, since it has the same structure as the braille device 200 shown in FIGS. 1-4 except the structure shown to the figure, description is abbreviate | omitted.

  As shown in FIG. 11, the finger cover 292 </ b> B is a finger cover having a hollow annular cross section inside, and the conductive switching unit 250 </ b> B disposed inside is moved inside by a moving mechanism (not shown). It is configured to be possible.

  In FIG. 11A, the switching unit 250B is disposed at a position facing the belly of the finger F. At this time, the braille device 200 is in an effective state, and the operator can perform a touch operation by operating the touch panel with the belly of the finger F through the finger cover 20B.

  In FIG. 11B, the switching unit 250 </ b> B is disposed at a position facing the back of the finger F. At this time, the braille device 200 is in an invalid state, and even if the operator operates the touch panel with the belly of the finger F through the finger cover 20B, the touch operation cannot be detected on the touch panel side.

  Thus, even when the braille device 200B according to the first modification is used, the same effect as that of the first embodiment can be obtained. Note that the switching unit 250B illustrated in FIG. 11 switches the conductive member to the invalid state by rotating the conductive member to the back side of the finger along the outer periphery of the finger F. The switching unit 250B may be kept away from the touch panel 120. For example, in the invalid state, the switching unit 250B is moved away from the outer peripheral surface of the finger cover 292 by about 1 to 2 mm. It is good also as a mechanism which switches to an invalid state in this way.

(Modification 2)
In the first embodiment, the Braille device 200 and the main body device 100 transmit and receive data by wireless communication. In the second modification shown below, communication is performed by contact communication (so-called human body communication).

  FIGS. 12 and 13 are block diagrams showing hardware configurations of the main body device 100C and the braille device 200C according to the second modification. It differs from the apparatus according to the first embodiment shown in FIGS. 2 and 3 in that it includes a human body communication unit. Other configurations are the same as those of the first embodiment, and a description thereof will be omitted.

  The main device 100 includes a human body communication unit 123. The human body communication unit 123 is arranged so as to overlap the display unit 121 and the touch detection unit 122 of the touch panel 120.

  The braille device 200 includes a human body communication unit 270. This human body communication unit 270 is publicly known when the operator wearing the braille device 200 touches the touch panel 120 with the fingertip of the finger cover 292 (finger side of the finger) or the fingertip of the finger not covered with the finger cover 292. Contact communication (also called human body communication).

  The human body communication unit 270 controls the charge amount so that an amount of charge corresponding to the data is induced on the fingertip of the operator's finger cover 292 or on the fingertip. This amount of charge changes according to data communicated at a predetermined speed corresponding to the communication speed (information amount). And the human body communication part 123 which functions as an antenna receives the data signal according to the change of the charge amount induced by the change of the charge amount of the finger cover 292 of the operator. The above is the data transmission method from the braille device 200 to the main device 100, and the communication in the reverse direction is also performed by the same method.

  In the second modification, the determination of whether communication is possible (steps S101 and S201) shown in FIGS. 8 and 9 is that the fingertip of the finger cover 292 touches the touch panel, and data transmission / reception is started by contact communication. Is done. In the second modification, as shown in FIG. 13, the braille device 200 </ b> C includes a contact sensor 220, but the contact sensor is omitted, and instead, communication by the human body communication units 123 and 270 is performed. May be determined to be a touch by the braille device 200C (step S204).

  As described above, even when the Braille device cooperation system including the main body device 100 </ b> C and the Braille device 200 </ b> C according to Modification 2 is used, the same effects as those of the first embodiment can be obtained.

(Other variations)
In the first embodiment and the like, the braille image data d is stored in the main body control unit 110, but may be stored in the braille device control unit 210 of the braille device 200. In this case, the main body control unit 110 may transmit only text data, that is, a character code to the braille device 200.

  Further, as a response to multi-touch, the following processing may be performed. Specifically, when the touch with the finger cover 292 (index finger) of the braille device 200 and the touch with another finger (middle finger or thumb) are performed together, multi-touch is determined. In this case, it is necessary to exclude a touch by a finger other than the braille device 200. For example, when there is a significant time difference (exceeding one signal cycle) between the touch by the Braille device 200 and the touch by another finger, it can be dealt with by the above-described erroneous operation prevention process (S301). On the other hand, if there is no significant time difference between a plurality of touches, an intermediate point (coordinates) of multi-touch may be determined as a touch position, or the touch itself may be invalidated. Further, when invalidating, the fact may be displayed on the braille display unit 230.

  The braille device linkage system and the means and method for performing various processes in the braille device according to the first embodiment and the modifications described above can be realized by either a dedicated hardware circuit or a programmed computer. It is. The program may be provided by a computer-readable recording medium such as a CD-ROM (Compact Disc Read Only Memory), or may be provided online via a network such as the Internet. In this case, the program recorded on the computer-readable recording medium is usually transferred to and stored in a storage unit such as a hard disk. The program may be provided as a single application software, or may be incorporated into the software of the apparatus as one function of the Braille device cooperation system.

500 Braille device cooperation system 100 Main body device 110 Main body control unit 120 Touch panel 160 Wireless communication unit 200, 200B, 200C Braille device 210 Braille device control unit 220 Contact sensor 230 Braille display unit 240 Determination switch 250 Switching unit 260 Wireless communication unit 270 Human body communication 291 Glove body 292 Finger cover 293 Unit case

Claims (11)

A braille device cooperation system including a main body device that accepts an operation, and a braille device that is attached to an operator's hand,
The main unit is
A touch panel for displaying an image on the display surface and detecting a touch on the display surface by an operator;
A communication unit that communicates with the braille device;
A main body control unit,
The braille device is
A finger cover covering the operator's fingertips;
A sensor unit that is disposed at a position corresponding to the belly of the finger of the finger cover and detects that the outside of the finger cover is in contact with an object;
A braille display portion that is arranged inside the finger cover and capable of displaying braille information;
A communication department;
A braille device controller,
With
The Braille device control unit transmits a contact timing to an object according to a detection signal of the sensor unit to the main body device,
When the main body control unit detects a touch on the touch panel, the main body control unit determines whether the touch is due to the Braille device by comparing with the contact timing to the object received from the Braille device,
When it determines with the said touch being the said Braille device, the Braille device cooperation system which switches the control to the said touch to the Braille device corresponding | compatible control which invalidates selection operation of the operation key by a touch. When the main body control unit switches to the Braille device compatible control, it transmits an enable signal indicating the switching to the Braille device,
The Braille device cooperation system according to claim 1, wherein when the enable signal is received, the Braille device control unit displays information indicating that the Braille display unit has switched to the Braille device compatible control.   When the main body control unit detects a touch on the touch panel by an object other than the Braille device immediately before or after the timing of switching to the Braille device compatible control, the process related to the operation of the touch is returned to the original state. The braille device cooperation system according to claim 1 or 2, wherein an undo process or an invalidation process to be returned to is performed. The main body control unit, after switching to the braille device-compatible control, transmits information on operation keys corresponding to the touch position of the touch panel by the current braille device to the braille device,
The Braille device cooperation system according to any one of claims 1 to 3, wherein the Braille device control unit displays the information received from the main body control unit by the Braille display unit. The braille device further includes a determination switch that receives an operation of the operator,
When the determination switch is operated, the Braille device control unit transmits an ON signal indicating that it has been operated to the main body device,
The braille device cooperation system according to claim 4, wherein the main body control unit executes a selection operation of the operation key corresponding to a touch position by the braille device when the ON signal is received from the braille device. A braille device capable of communicating with a main body device including a touch panel that detects a touch on a display surface by an operator,
A finger cover covering the operator's fingertips;
A sensor unit that is disposed at a position corresponding to the belly of the finger of the finger cover and detects that the outside of the finger cover is in contact with an object;
A Braille display unit that is arranged inside the finger cover and that can display a three-dimensional Braille pattern that produces a feel of Braille on the fingertip;
A communication department;
A decision switch operated by the operator;
A braille device controller,
With
The Braille device control unit transmits a contact timing to an object according to a detection signal of the sensor unit to the main body device,
The main body device includes a Braille device correspondence control that invalidates a selection operation to the operation key of the touch panel by touching the Braille device and enables a selection operation of the operation key by the determination switch,
The Braille device control unit receives an enable signal indicating that the main body device has switched to the Braille device compatible control from the main body device, and receives an ON signal indicating that the determination switch has been operated, Braille device that is sent to the main unit.   The braille according to claim 6, further comprising a switching unit that changes a conductive characteristic at a position corresponding to the finger belly of the finger cover and switches to an invalid state in which contact with the touch panel of the finger cover is not detected. device.   The braille device according to claim 7, wherein the braille device control unit sets the invalid state by the switching unit when communication with the main device is not possible. A main body device that accepts an operation through a touch panel; a braille device that is attached to an operator's hand, and is disposed at a position corresponding to a finger cover of the finger cover of the operator; A control method for a Braille device cooperation system, comprising: a sensor unit that detects that the outside of the cover is in contact with an object; and a Braille device that is disposed inside the finger cover and includes a Braille display unit that can display Braille information. Because
(A) transmitting a contact timing to an object according to a detection signal of the sensor unit of the Braille device to the main body device;
(B) When the touch on the touch panel is detected by the main body device, it is determined whether or not the touch is due to the Braille device by comparing with the contact timing to the object received from the Braille device. Steps,
(C) When the touch is determined to be caused by the Braille device, the control of the touch is switched to the Braille device compatible control that invalidates the operation key selection operation by the touch on the touch panel. When,
Including a control method. (D) when switching to the braille device compatible control in the step (c), transmitting an enable signal indicating the switching from the main unit to the braille device;
(E) When the Braille device receives the enable signal, the Braille device further includes a step of displaying information indicating that the Braille display unit has switched to the Braille device compatible control. Control method. (F) When switching to the braille device compatible control in the step (c), the main body device touches the touch panel with an object other than the braille device immediately before or immediately after the timing of switching to the braille device compatible control. 11. The control method according to claim 9, further comprising a step of performing an undo process or an invalidation process for returning a process related to an operation of the touch to an original state when a touch on the touch is detected.