JP2015216456A - Control signal generating method, control signal generating apparatus, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a control signal generating method capable of simply performing an operation input of a control object apparatus.SOLUTION: The control signal generating method for generating different control signals in accordance with a signal in a sense range of human touch among obtained detected signals when obtaining a detected signal from a tactile sensor and generating a control signal on the basis of the obtained signal.

Description

  The present invention relates to a control signal generation method, a control signal generation device, and a control signal generation program for generating a control signal for controlling a control target device.

  There are various devices to be controlled in the environment surrounding us. For example, there are devices to be controlled such as a television, an air conditioner, and an electric lamp. In order to operate these control target devices, an operation input to the control target device by the user is required. In order to perform operation input, a dedicated remote controller is often used as an operation input device.

  In addition, a touch panel type remote control has appeared instead of a push button type remote control. Furthermore, a portable information terminal with a touch panel function such as a smartphone or a tablet PC may be used as a remote controller. In this case, it can also be used as a dual-purpose remote controller that operates a plurality of devices to be controlled with one portable information terminal.

  Also disclosed is a technique for detecting an operation of a user and performing an operation input using a projector that projects a touch screen and a motion tracking camera that detects the operation of the user who executes the operation input. This technology enables a user to operate a control target device by touching a wall or the like on which an image is projected with a finger (see, for example, Non-Patent Document 1).

  In addition, a technique for numerically measuring and reproducing the tactile sensation when a person touches an object is disclosed (for example, see Patent Document 1).

  In addition, a technique for visually expressing acquired tactile information is disclosed (for example, see Patent Document 2).

  In addition, a technique for presenting various tactile information that changes with time is disclosed (for example, see Patent Document 3).

  In addition, a technique for inputting information by transmitting vibration with a finger to a portable information terminal is disclosed (for example, see Patent Document 4).

WO2010 / 134349 JP 2008-250978 A JP 2003-99177 A WO2010 / 024030 Turn any surface into a touch screen, [online], Ubi Interactive Inc, [April 14, 2014 search], Internet, <URL: http://www.ubi-interactive.com/>

  However, when a dedicated remote controller is used as the operation input device, in an environment where a plurality of devices to be controlled are installed, a plurality of remote controllers exist around the environment. If too many remote controllers are present in a predetermined range of environment, the aesthetics in the environment may be impaired and the cost of installing the remote controller may be excessive.

  In addition, when one portable information terminal is used as a dual-purpose remote controller, an operation panel such as a screen of the portable information terminal is small. Considering the portability of the portable information terminal, it is difficult to enlarge the operation panel. Operation is not easy with a small operation panel.

  In addition, it is physically and costly difficult to install a large touch panel in a predetermined range of environment.

  In addition, when an operation input is performed by detecting a user's operation operation, the operation operation is visually detected. Therefore, a blind spot may occur in the camera depending on the positional relationship between the projector, the camera, and the user. If a blind spot occurs, the user's operation cannot be detected.

  As described above, there is a problem that it is difficult to easily perform operation inputs of various control target devices existing in the user's environment.

  In one aspect, an object of the present invention is to provide a control signal generation method capable of easily performing an operation input of a device to be controlled.

  In one proposal, when a detection signal from a tactile sensor is acquired and a control signal is generated based on the acquired detection signal, according to a signal in the human touch sense area of the acquired detection signal, A control signal generation method is provided for generating different control signals.

  According to the embodiment, the operation input of the control target device can be easily performed.

It is a figure which shows the basic functional block of the control signal generation apparatus which concerns on this Embodiment. It is a figure for demonstrating the principle of a tactile sensitivity distribution filter. It is a figure which shows the example of application of the control signal generation apparatus which concerns on this Embodiment. It is a figure for demonstrating the whole image of the control signal generation apparatus which concerns on this Embodiment. It is a figure which shows the example of an output of a contact sensor. It is a figure which shows the example of the tactile sense control corresponding | compatible database. It is a figure for demonstrating the view of the problem solution by the control signal generation process which concerns on this Embodiment. It is a flowchart which shows the flow of the registration process which the computer of a control signal production | generation apparatus performs. It is a flowchart which shows the flow of the control signal production | generation process which the computer of a control signal production | generation apparatus performs. It is a figure which shows the example of the tactile sense corresponding | compatible database using an operation group. It is a block diagram of information processing apparatus.

Hereinafter, embodiments will be described in detail with reference to the drawings.
FIG. 1 is a diagram illustrating basic functional blocks of a control signal generation device according to the present embodiment.

  In FIG. 1, the control signal generation device 1 is an information processing device such as a workstation, a personal computer, or a mobile communication terminal. The control signal generation device 1 is connected to the contact sensor 2, the control target device 3, and the tactile sensation control correspondence database 4. The control signal generation device 1 includes a detection signal acquisition unit 11, a detection signal separation unit 12, a control signal generation unit 13, a tactile sensation control registration unit 14, a search unit 15, and a control unit 16. Note that the control signal generation device 1 may include a tactile sensation control correspondence database 4 therein. In addition, the control signal generation device 1 may include a contact sensor 2 inside.

  The contact sensor 2 is a contact sensor of various known methods such as a switch method, a resistance film method, a surface acoustic wave method, and a capacitance method.

  The control target device 3 is a device subject to operation control, such as a personal computer, a lighting device, a television receiver, a washing machine, an air conditioner, a refrigerator, a microwave oven, a power strip, and a hair dryer.

  The contact object 5 is an object that exists in the surrounding environment of the user, such as a stuffed animal, a sofa, a wall, clothes, a human body, and the like.

  The detection signal acquisition unit 11 acquires a detection signal from the contact sensor 2 that detects a contact state with the contact object 5 from the contact sensor 2 via the transmission path. Here, the detection signal is, for example, a vibration waveform detected by the piezoelectric element. Desirably, as will be described later, a result obtained by converting a vibration waveform into a frequency spectrum by FFT (Fast Fourier Transform) is used.

  The detection signal separation unit 12 separates the detection signal acquired by the detection signal acquisition unit 11 into tactile information and non-tactile information (context information). Here, the tactile sensation information is information that can be perceived by humans, such as “smooth”, “roughness”, “sarabashi”, “bumpy”, “gogogotsu”, etc., and non-tactile information is information that cannot be perceived by humans. . For separation of tactile sensation information and non-tactile sensation information, a tactile sensibility distribution filter 6 stored in advance in an external memory or the like is used.

FIG. 2 is a diagram for explaining the principle of the tactile sensitivity distribution filter.
FIG. 2A shows the arrangement of human skin structure and tactile receptors. A human determines the tactile sensation from vibration information generated at a contact site such as a fingertip. The human finger senses skin vibrations mainly from three types of tactile receptors: Merkel cells (SAI), Meissner bodies (FAI), and Patini bodies (FAII).

  Each tactile receptor has a sensitivity distribution related to the vibration frequency as shown in FIG. The minimum vibration amplitude portion of the sensitivity distribution of each tactile receptor is used as the tactile sensitivity distribution filter 6.

  That is, the detection signal separation unit 12 separates, as tactile information, a region having a higher intensity (a larger amplitude) than the tactile sensitivity distribution filter 6 from the detection signal acquired by the detection signal acquisition unit 11, and has a lower intensity (amplitude). Are separated as non-tactile information.

  The control signal generation unit 13 generates a control signal for controlling the control target device 3 according to the tactile sensation information and the non-tactile sensation information separated by the detection signal separation unit 12. Here, the control signal for controlling the control target device 3 includes information for specifying the control target device 3 and control contents. For example, the control signal generation unit 13 generates a control signal for turning on the power of the lamp A that is the control target device 3.

  The tactile sensation control registration unit 14 stores the tactile sensation information and the non-tactile sensation information in association with the operation information defining the control content for the control target device 3 in the tactile sensation control correspondence database 4. Operation information defining similar control contents is associated with similar tactile information. Further, similar non-tactile sensation information is given a similar control target device 3.

  The retrieval unit 15 retrieves operation information associated with the tactile sensation information or the non-tactile sensation information stored in the tactile sensation control correspondence database 4 based on the tactile sensation information or the non-tactile sensation information separated by the detection signal separation unit 12. To do. In this case, the control signal generation unit 13 generates a control signal corresponding to the operation information searched by the search unit 15.

  In addition, when the correlation value between the tactile sensation information separated by the detection signal separation unit 12 and the tactile sensation information stored in the tactile sensation control correspondence database 4 is within a predetermined range, the search unit 15 performs the predetermined range. The operation information associated with the tactile sensation information inside is extracted from the tactile sensation control correspondence database 4. In this case, the control signal generation unit 13 generates a control signal having the same control content corresponding to the operation information extracted by the search unit 15 or a control signal for the same type of control target device.

  In addition, the search unit 15 determines the predetermined value when the correlation value between the non-tactile sensation information separated by the detection signal separation unit 12 and the non-tactile sensation information stored in the tactile sensation control correspondence database 4 is within a predetermined range. The operation information associated with the non-tactile sensation information within the range is extracted from the tactile sensation control correspondence database 4. In this case, the control signal generation unit 13 generates a control signal for the control target device 3 corresponding to the operation information extracted by the search unit 15.

  And the control part 16 controls the said control object apparatus 3 with the control signal produced | generated by the said control signal production | generation part 13. FIG.

  The control signal generation device 1 as described above associates various tactile sensations existing in the environment surrounding the user with operation keys for operating the control target device 3. The control signal generation device 1 determines that the operation input of the corresponding control target device 3 has been performed by detecting the tactile sensation. Then, the control signal generation device 1 causes the control target device 3 to be operated. That is, the control signal generation device 1 is an operation input device based on tactile sensation. Operation input using tactile sensation is useful for operation input in situations where sight and hearing cannot be used, or in situations where sight and hearing are not desired to be disturbed. For example, it is useful for operation input in darkness, input operation on the back side of the operation device, input operation during driving, or the like.

FIG. 3 is a diagram illustrating an application example of the control signal generation device according to the present embodiment.
In FIG. 3, the control signal generation device 1 includes a contact sensor 2 that can be worn on a user's finger and a mobile communication terminal 31 such as a smartphone.

  The mobile communication terminal 31 executes a control signal generation process to be described later. A user wearing the contact sensor 2 on a finger contacts the contact object 5 with the contact sensor 2. The contact sensor 2 may be a pen that has a sensing function in addition to a type that can be worn on the user's finger. Further, the mobile communication terminal 31 itself may have a sensing function. The user wears the contact sensor 2 that can be worn on the user's finger, a pen having a sensing function, and the mobile communication terminal 31 itself having a sensing function. It is desirable.

  The mobile communication terminal 31 converts the vibration waveform detected by the contact sensor 2 at the time of contact into a frequency spectrum by FFT. The mobile communication terminal 31 separates the converted frequency spectrum into tactile information and non-tactile information. The tactile sensation information is information that can be perceived by humans, for example, “smooth”, and the non-tactile information is information that cannot be perceived by humans. For separation of tactile sensation information and non-tactile sensation information, a tactile sensitivity distribution filter 6 indicating a sensitivity distribution with respect to the frequency of the human tactile receptor is used. The mobile communication terminal 31 assigns the same operation input (for example, lighting of a light) to vibration waveforms (similar tactile sensations) having similar frequency components of tactile sensation information. In addition, the mobile communication terminal 31 assigns the difference in the frequency component of the non-tactile information to the difference in the context of the operation input (the lamp A in the adjacent room). Then, the mobile communication terminal 31 determines which operation input is performed in which context with respect to the obtained vibration waveform, and executes control of the control target device 3 via wireless communication or wired communication.

FIG. 4 is a diagram for explaining the overall image of the control signal generation device according to the present embodiment.
In FIG. 4, the control signal generation device 1 includes a contact sensor 2, a tactile sensation control correspondence database 4, an FFT unit 41, a filter unit 42, a tactile sensation control registration unit 14, a search unit 15, a control unit 16, an operation storage unit 43, and a registration. An input mode switching unit 44 is provided.

  The contact sensor 2 is a contact sensor of various well-known systems such as a switch system, and is detected when contacting and moving on the surface of the contact object 5 that is an object existing in the user's surrounding environment such as a stuffed toy. Output vibration waveform. The output vibration waveform is obtained by lightly scanning the contact sensor 2 on the surface of the contact object 5.

FIG. 5 is a diagram illustrating an output example of the contact sensor.
FIG. 5A shows a vibration waveform when the skin of a patient with atopic dermatitis is measured with the contact sensor 2. FIG. 5B shows a vibration waveform when the skin of a healthy person is measured by the contact sensor 2. Thus, it can be seen that the vibration waveform output varies depending on the skin properties.

  The FFT unit 41 acquires the vibration waveform obtained by the contact sensor 2, converts it into a frequency spectrum, and outputs it.

  FIG. 5C shows the result of converting the vibration waveform of the skin of a patient with atopic dermatitis into a frequency spectrum. (D) of FIG. 5 shows the result of converting the vibration waveform of a healthy person's skin into a frequency spectrum.

  The filter unit 42 separates the frequency spectrum obtained by the FFT unit 41 into a frequency spectrum (tactile sensation information) in a range that can be sensed by humans and a frequency spectrum (non-tactile sensation information, context information) in a range that cannot be sensed. , Output each. This corresponds to the detection signal separation unit 12 described above.

  The tactile sensation control registration unit 14 extracts the correspondence relationship between the tactile sensation and the operation designated by the user from the operation storage unit 43 that stores an operation group associated with the tactile sensation. Then, it is registered in the tactile sensation operation correspondence table stored in the tactile sensation correspondence database 4 as a triplet of tactile sensation information and context information obtained by the filter unit 42 and operations stored in the operation storage unit 43.

FIG. 6 is a diagram illustrating an example of a tactile sensation control correspondence database.
In the tactile sensation operation correspondence table of the tactile sensation correspondence correspondence database 4 illustrated in FIG. 6, “ON operation” for the lights in “room 1” and “room 2” is common as “tactile sensation information 1”. However, the context information is distinguished as “context information 1” and “context information 3”. Similarly, “OFF operation” for the lamps of “room 1” and “room 2” is common as “tactile sensation information 2”. However, the context information is distinguished as “context information 2” and “context information 4”. In this way, the user can operate the “room 1” and “room 2” lamps “on operation” or “off operation” with the same tactile sensation. That is, the control signal generation device 1 makes the same tactile sensation (tactile sensation information 1) different for the user based on “context information 1” and “context information 3”, and turns on the lights of “room 1” and “ The room 2 "can be turned on. Further, the control signal generation device 1 makes the same tactile sensation (tactile sensation information 2) different for the user based on the “context information 2” and the “context information 4”, and turns off the lights of “room 1” and “ Turn off the light in “Room 2”.

  The retrieval unit 15 retrieves operation information associated with the tactile sensation information or the non-tactile sensation information stored in the tactile sensation control correspondence database 4 based on the tactile sensation information or the non-tactile sensation information separated by the filter unit 42. If the correlation value between the tactile sensation information and the tactile sensation information stored in the tactile sensation control correspondence database 4 is within a predetermined range, the operation information associated with the tactile sensation information within the predetermined range is converted to the tactile sensation control. Extracted from the correspondence database 4. If the correlation value between the non-tactile sensation information and the non-tactile sensation information stored in the tactile sensation control correspondence database 4 is within a predetermined range, the operation information associated with the non-tactile sensation information within the predetermined range is displayed. Extracted from the tactile sensation control correspondence database 4.

  The control unit 16 controls the control target device 3 by an execution command that realizes the operation information searched and extracted by the search unit 15.

  The registration / input mode switching unit 44 is a mode (registration mode) in which the correspondence relationship between the current tactile sensation and the operation is registered by the tactile sensation control registration unit 14 based on a user instruction, or the current tactile sensation by the search unit 15. The mode is switched to the mode (input mode) for executing the operation associated with.

  FIG. 7 is a diagram for explaining the concept of problem solving by the control signal generation processing according to the present embodiment.

  As described above, the control signal generation device 1 according to the present embodiment extracts information (tactile sensation information) related to the tactile sensation from the vibration waveform obtained by the contact sensor 2 (piezoelectric element or the like) when contacting the contact target object 5. To do. And control operation of the control object apparatus 3 is allocated with respect to the obtained tactile information.

  For this purpose, it is necessary to use various tactile sensations existing in the user's surrounding environment as input for the control operation. However, as shown in FIG. 7A, simply by making various tactile sensations existing in the surrounding environment correspond to the input of the control operation, the types of input of the control operation are increased, and the user has a correspondence relationship. The burden to remember increases. Further, as shown in FIG. 7B, if the number of tactile sensations used is reduced for the purpose of reducing the burden on the user, the types of possible control operation inputs are reduced.

  Therefore, as shown in FIG. 7C, the user should memorize by assigning tactile information groups perceived as similar tactile sensations in human tactile sensation to tactile information corresponding to similar operation inputs with different contexts. Reduce correspondence. For example, consider operation inputs C1 and C2 for turning on lights L1 and L2 in different rooms R1 and R2. These operation inputs C1 and C2 are the same regarding the operation of “lighting”. Therefore, the operation inputs C1 and C2 are assigned to the tactile information S1 and S2 obtained from the objects O1 and O2 in the rooms R1 and R2, respectively. As a result, if the correspondence relationship between the common tactile sensation T and the operation (abstract operation) of the lighting (abstract operation) is stored for the user, different specific operations of lighting the lights L1 and L2 in the rooms R1 and R2 are performed. There is no need to store the correspondence between the tactile information S1 and S2, which is different from the operation inputs C1 and C2, and the stored correspondence can be reduced.

  As described above, the control signal generation device 1 according to the present embodiment uses the contact sensor 2 that exceeds the human tactile ability. The control signal generation device 1 includes means for determining the similarity of the tactile sensation from the tactile sensation information (vibration waveform) obtained by the contact sensor 2.

  As described above, vibrations that humans sense as tactile sensations have a sensitivity distribution, and humans do not use all vibration information obtained at the time of touching for tactile sensation discrimination. Therefore, the control signal generation device 1 uses the human tactile sensitivity distribution as the tactile sensitivity distribution filter 6 and separates the vibration waveform obtained from the contact sensor 2 into tactile information or non-tactile information. Then, the similarity of tactile sensation is determined based on the vibration waveform of the separated tactile sensation information. Further, in order to make a tactile sensation information group determined to be a similar tactile sensation for humans correspond to each operation input, a difference in vibration waveform of non-tactile sensation information is used. Since the sensitivity distribution is given as sensitivity to the vibration frequency, and since the vibration waveform itself is a vibration time series, it is difficult to determine the similarity, so the similarity is determined using the frequency spectrum by FFT obtained from the vibration waveform. .

  FIG. 8 is a flowchart showing the flow of registration processing executed by the computer of the control signal generation device.

  The registration process shown in FIG. 8 is executed when the registration / input mode switching unit 44 switches to a mode (registration mode) for registering the correspondence relationship between the current tactile sensation and the operation based on a user instruction. .

  First, in step S801, an input operation to be registered (assigned) in the control signal generation device 1 described above, for example, the above-mentioned “light-on operation in the room 1” is determined.

  In step S <b> 802, the detection signal acquisition unit 11 acquires a detection signal from the contact sensor 2 that detects a contact state with the contact object 5 using the contact sensor 2 attached to the fingertip of the user.

  In step S803, the FFT unit 41 converts the vibration waveform obtained in step S802 into a frequency spectrum by FFT and outputs it.

  In step S804, the filter unit 42 converts the frequency spectrum obtained in step S803 into a frequency spectrum in a range that can be detected by humans (tactile information) and a frequency spectrum in a range that cannot be detected (non-tactile information, context information). Separate and output each. A tactile sensitivity distribution filter 6 is used to separate tactile information and non-tactile information. Vibrations that appear only below the sensitivity curves of the three receptors shown in FIG. 2 are vibrations that cannot be detected by humans. Since the frequency component obtained by the FFT has a relation between the vibration width and the frequency, it can be determined whether or not the vibration frequency can be sensed below or above the tactile sensitivity distribution filter 6 shown in FIG. The frequency component of the vibration waveform thus obtained is separated into tactile information and non-tactile information (context information).

  In step S 805, the set of the assigned operation, tactile sensation information, and context information is registered in the tactile sensation operation correspondence table stored in the tactile sensation control correspondence database 4.

  FIG. 9 is a flowchart showing a flow of control signal generation processing executed by the computer of the control signal generation device.

  The control signal generation process shown in FIG. 9 is performed when the registration / input mode switching unit 44 switches to a mode (input mode) for executing an operation associated with the current tactile sensation based on a user instruction. Executed.

  First, in step S <b> 901, the detection signal acquisition unit 11 acquires a detection signal from the contact sensor 2 that detects a contact state with the contact object 5 using the contact sensor 2 attached to the user's fingertip or the like.

  In step S902, the FFT unit 41 converts the vibration waveform obtained in step S901 into a frequency spectrum by FFT and outputs it.

  In step S903, the filter unit 42 converts the frequency spectrum obtained in step S902 into a frequency spectrum in a range that can be detected by humans (tactile information) and a frequency spectrum in a range that cannot be detected (non-tactile information, context information). Separate and output each.

  In step S904, a tactile similarity determination process is executed. In step S905, the tactile similarity is similar to the current tactile sensation based on the correlation value between the tactile information of the currently obtained tactile sensation and the registered tactile sensation tactile information. It is determined whether or not there is a registered tactile sensation. The presence or absence of similarity is determined based on whether or not the correlation value exceeds a preset threshold value. For example, the similarity determination is performed as follows.

  The human tactile receptor cannot sense vibrations having a frequency having a vibration width below the sensitivity curve. When the vibration width is above the tactile sensitivity distribution curve (see the tactile sensitivity distribution filter 6 shown in FIG. 2), it can be determined that the vibration frequency can be detected, and when the vibration width is below, it can be determined that the vibration frequency cannot be detected.

  A frequency component F obtained by performing FFT on the vibration waveform W obtained by the contact sensor 2 has a relationship between the frequency and the vibration width. Now, a finite number of frequencies f1, f2,..., Fn are selected from the frequencies appearing in the frequency component F and are called representative frequencies. A frequency component F quantized with components of representative frequencies f1, f2,..., Fn is called a representative frequency component and is represented by F *. F * represents the representative frequencies f1, f2,..., Fn as dimensions, and the vibration frequencies v1, v2,..., Vn at the representative frequencies f1, f2,. It is expressed by a vector <v1: f1, v2: f2,..., Vn: fn> as a value in frequency. vi: fi represents that the vibration width of the representative frequency fi is vi.

  According to the determination using the tactile sensitivity distribution curve, each representative frequency f1, f2,..., Fn of the frequency component F is a frequency that can be sensed depending on the values of the respective vibration widths v1, v2,. Determine if frequency is not possible. The frequency components in which the vibration width, which is the value of the representative frequency component F * that can be detected and cannot be detected, are set to 0 are referred to as tactile sensation information and context information, and are represented as F + and F−. Here, when the representative frequency fi is a detectable representative frequency, the vibration width vi at the representative frequency fi in the tactile sensation information is set to a value (0) in the representative frequency component F 1. If the representative frequency fi is an undetectable representative frequency, the context information is set to 0 (value in the representative frequency component F *).

  Next, the similarity s (F1, F2) between the frequency components F1 and F2 quantized with the representative frequency is given by, for example, a correlation coefficient between the frequency components F1 and F2. The similarity s (F1, F2) is not limited to the correlation coefficient, and may be given by other methods.

  For example, it is assumed that the tactile sensation information F + and the context information F− are obtained from the contact object 5 through the contact sensor 2 and the FFT unit 41. At this time, the retrieval unit 15 selects tactile information F ′ + having the highest similarity s (F +, *) to the tactile information F + from the tactile information group recorded in the tactile operation correspondence table, and further selects the tactile operation correspondence table. Context information F′− having the highest similarity s (F−, *) with respect to the current context information F− from the context information group corresponding to the tactile information F ′ + having the highest similarity. Select. However, a threshold δ is set for the similarity in advance, and the similarity is that the similarity is equal to or greater than the threshold δ. In addition, tactile sensation information and context information with low similarity are not selected from the tactile sensation operation correspondence table. In the tactile sensation operation correspondence table, if the operation corresponding to the tactile sensation information F ′ + and the context information F′− is C ′, the operation C ′ is sent from the search unit 15 to the control unit 16 and executed.

  If it is determined in step S905 that there is no registered tactile sensation similar to the current tactile sensation (step S905: NO), the process returns to step S901. If it is determined that there is a tactile sensation (step S905: YES), in step S906 It is determined whether or not a similar registered tactile sensation is unique.

  If it is unique (step S906: YES), in step S907, the control unit 16 performs an operation for the tactile sensation.

  On the other hand, when there are a plurality of similar registered tactile sensations (step S906: NO), context determination is performed on the plurality of registered tactile sensations in step S908, and the obtained tactile sensation is obtained in step S909. It is determined whether there is registered tactile context information similar to the current tactile sense from the correlation value between the context information and the registered tactile context information. The presence or absence of similarity is determined based on whether or not the correlation value exceeds a preset threshold value.

  If it is determined that there is no registered tactile sensation context information similar to the current tactile sensation (step S909: NO), the process returns to step S901, and if it is determined that there is (step S909: YES), in step S910, the context information The control unit 16 performs an operation on the registered tactile sensation that is determined to be the most similar.

  The tactile sensation input described above assigns a single operation to each tactile sensation. However, for example, there are many operations in the single control target device 3 such as on / off, illuminance decrease, illuminance increase, and illumination pattern change. Here, a set of operations related to the same control target device 3 is referred to as an “operation group”.

FIG. 10 is a diagram illustrating an example of a tactile sensation control correspondence database using operation groups.
In the tactile sensation operation correspondence table of the tactile sensation control correspondence database 4 illustrated in FIG. 10, compared with the tactile sensation operation correspondence table illustrated in FIG. 6, an “operation group” that is an identifier to which operation group belongs is added. Yes.

  When a common tactile sensation is registered in different operation groups, it may be determined which operation is associated by determining the operation group. Therefore, if the most similar registered tactile sensation cannot be determined in the above-described control signal generation process, for example, a message such as “Please input the tactile assigned to another operation (of the same operation group)” is displayed. An operation group may be determined from the tactile sensation that is presented to the user and input, and the associated operation may be determined.

  For example, as illustrated in the tactile sensation operation correspondence table of FIG. 10, “Tactile sensation information” is “Tactile sensation information 1” and “Context information” is “ Context information 1 ”, which is the same. For the user, “room 1 lamp on operation” and “room 3 TV on operation” are different operations, but the control signal generator 1 cannot distinguish them.

  However, since “room 1 lamp on operation” and “room 3 TV on operation” that belong to the same “operation group” have tactile information different from “tactile information 2” and “tactile information 6”, the control signal The generation apparatus 1 can determine which operation is performed by inquiring (inputting) the tactile sensation of another operation to the user.

  As described above, the present embodiment has been described, but the control signal generation device 1 according to this embodiment can be applied as follows.

  For example, there are cases where operation input using a plurality of tactile sensations is useful, such as password input or stepwise abstract operation narrowing down. In the case of “turning on only half of the lighting”, the stepwise abstracting of the abstract operations is an operation input such as first inputting a tactile sensation in the order of “lighting”, “half”, and “lighting”. Therefore, operation determination using a tactile sensation sequence or simultaneous tactile sensation input, and further a tactile sensation duration may be performed.

  In addition, the user himself / herself can tie the tactile sensation obtained from the contact object 5 existing in the environment to be operated to the input operation, thereby realizing the input operation using the tactile sensation around the user. . For example, touching a wall to turn on and off the light switch, or touching something that cannot be directly seen, such as a cloth inside the pocket, is used for input.

  Further, by setting the correspondence relationship by itself and hiding the input information correspondence relationship corresponding to the tactile sensation information, it is possible to input the password in the order of stuffed animals, cups, carpets, for example. This is effective when only a specific user knows the correspondence between tactile sensation and operation.

  In addition, for the contact object 5 that has been tactilely detected in advance, a correspondence relationship indicating what operation the tactile sensation of a specific part of the contact object 5 corresponds to is described in the contact object 5. The contact object 5 notified to the user can be a tactile sensation input panel. In this case, the user performs an input operation to the control target device 3 by touching the surface of the contact object 5 (printed material such as a poster, a picture book, and a manual) on which an operation to be performed is described. This is effective in a situation where the user does not know or can not remember the correspondence between tactile sensation and operation in advance.

FIG. 11 is a configuration diagram of the information processing apparatus.
The control signal generation device 1 in FIG. 1 can be realized using, for example, an information processing device (computer) as shown in FIG. 11 includes a CPU (Central Processing Unit) 1101, a memory 1102, an input device 1103, an output device 1104, an external recording device 1105, a medium driving device 1106, and a network connection device 1107. These are connected to each other by a bus 1108.

  The memory 1102 is, for example, a semiconductor memory such as a ROM (Read Only Memory), a RAM (Random Access Memory), or a flash memory, and stores a program and data used for control signal generation processing executed by the control signal generation device 1. . For example, the CPU 1101 performs the control signal generation process described above by executing a program using the memory 1102.

  The input device 1103 is, for example, a keyboard, a pointing device, and the like, and is used for inputting instructions and information from an operator. The output device 1104 is, for example, a display device, a printer, a speaker, or the like, and is used to output an inquiry to an operator or a processing result.

  The external recording device 1105 is, for example, a magnetic disk device, an optical disk device, a magneto-optical disk device, a tape device, or the like. The external recording device 1105 includes a hard disk drive. The information processing apparatus can store programs and data in the external recording apparatus 1105 and load them into the memory 1102 for use.

  The medium driving device 1106 drives a portable recording medium 1109 and accesses the recorded contents. The portable recording medium 1109 is a memory device, a flexible disk, an optical disk, a magneto-optical disk, or the like. The portable recording medium 1109 includes a compact disk read only memory (CD-ROM), a digital versatile disk (DVD), a universal serial bus (USB) memory, and the like. An operator can store programs and data in the portable recording medium 1109 and load them into the memory 1102 for use.

  As described above, the computer-readable recording medium for storing the program and data used for the control signal generation processing includes physical (non-temporary) such as the memory 1102, the external recording device 1105, and the portable recording medium 1109. Recording medium).

  The network connection device 1107 is a communication interface that is connected to the communication network 1110 and performs data conversion accompanying communication. The information processing apparatus can receive programs and data from an external apparatus via the network connection apparatus 1107, and can use them by loading them into the memory 1102.

  Although the disclosed embodiment and its advantages have been described in detail, those skilled in the art can make various modifications, additions and omissions without departing from the scope of the present invention as explicitly described in the claims. I will.

The following notes are further disclosed with respect to the embodiment described with reference to the drawings.
(Appendix 1)
Get the detection signal from the tactile sensor,
When generating a control signal based on the acquired detection signal, a different control signal is generated according to a signal in a human touch sense area of the acquired detection signal.
A control signal generation method characterized by the above.
(Appendix 2)
When the signal pattern of the human tactile sensation area in the acquired detection signal has a predetermined similarity with a predetermined pattern, a control signal having the same control content or a control signal for the same type of device is generated.
The control signal generation method according to supplementary note 1, wherein:
(Appendix 3)
The control signal generation method according to appendix 1 or 2, wherein a transmission destination of the generated control signal is controlled in accordance with a signal in a dead zone of human tactile sensation among the acquired detection signals.
(Appendix 4)
Storing the sensitive area and the dead area in association with operation information defining the control content for the control target device in a tactile sense correspondence database;
The control signal generation method according to supplementary note 3, wherein
(Appendix 5)
Based on the sensitive area, search the operation information stored in the tactile sense correspondence database,
Generating a control signal corresponding to the retrieved operation information;
The control signal generation method according to appendix 4, wherein the control signal is generated.
(Appendix 6)
When the correlation value between the detection area of the human tactile sensation in the detection signal and the detection area stored in the tactile sensation control correspondence database is within a predetermined range, it is associated with the detection area within the predetermined range. Extract operation information from the tactile sensation control support database,
Generating a control signal of the same control content corresponding to the extracted operation information or a control signal for the same type of control target device;
The control signal generation method according to appendix 5, wherein
(Appendix 7)
When the correlation value between the dead zone of the human tactile sensation in the detection signal and the dead zone stored in the tactile sensation control correspondence database is within a predetermined range, an operation associated with the dead zone within the predetermined range Information is extracted from the tactile sensation control compatible database,
Generating a control signal for the control target device corresponding to the extracted operation information;
The control signal generation method according to appendix 5, wherein
(Appendix 8)
Controlling the device to be controlled by the generated control signal;
8. The control signal generation method according to any one of appendices 1 to 7, characterized in that:
(Appendix 9)
An acquisition unit for acquiring a detection signal from the tactile sensor;
A generation unit that generates a different control signal in accordance with a signal in a human tactile sensation area among the acquired detection signals;
A control signal generating device comprising:
(Appendix 10)
When the signal pattern of the human tactile sensation area in the acquired detection signal has a predetermined similarity with a predetermined pattern, a control signal having the same control content or a control signal for the same type of device is generated.
The control signal generation device according to appendix 9, wherein
(Appendix 11)
11. The control signal generation device according to appendix 9 or 10, wherein a transmission destination of the generated control signal is controlled in accordance with a signal in a human tactile sensation dead region among the acquired detection signals.
(Appendix 12)
Storing the sensitive area and the dead area in association with operation information defining the control content for the control target device in a tactile sense correspondence database;
The control signal generation device according to appendix 11, wherein
(Appendix 13)
Based on the sensitive area, search the operation information stored in the tactile sense correspondence database,
Generating a control signal corresponding to the retrieved operation information;
Item 13. The control signal generation device according to appendix 12.
(Appendix 14)
When the correlation value between the detection area of the human tactile sensation in the detection signal and the detection area stored in the tactile sensation control correspondence database is within a predetermined range, it is associated with the detection area within the predetermined range. Extract operation information from the tactile sensation control support database,
Generating a control signal of the same control content corresponding to the extracted operation information or a control signal for the same type of control target device;
14. The control signal generation device according to appendix 13, wherein
(Appendix 15)
When the correlation value between the dead zone of the human tactile sensation in the detection signal and the dead zone stored in the tactile sensation control correspondence database is within a predetermined range, an operation associated with the dead zone within the predetermined range Information is extracted from the tactile sensation control compatible database,
Generating a control signal for the control target device corresponding to the extracted operation information;
14. The control signal generation device according to appendix 13, wherein
(Appendix 16)
Controlling the device to be controlled by the generated control signal;
16. The control signal generation device according to any one of supplementary notes 9 to 15, wherein
(Appendix 17)
Get the detection signal from the tactile sensor,
When generating a control signal based on the acquired detection signal, a different control signal is generated according to a signal in a human touch sense area of the acquired detection signal.
A control signal generation program that causes a computer to execute processing.
(Appendix 18)
When the signal pattern of the human tactile sensation area in the acquired detection signal has a predetermined similarity with a predetermined pattern, a control signal having the same control content or a control signal for the same type of device is generated.
18. The control signal generation program according to appendix 17, which causes a computer to execute processing.
(Appendix 19)
19. The control signal generation program according to appendix 17 or 18, wherein a transmission destination of the generated control signal is controlled in accordance with a signal in a dead zone of human tactile sensation among the acquired detection signals.
(Appendix 20)
Storing the sensitive area and the dead area in association with operation information defining the control content for the control target device in a tactile sense correspondence database;
The control signal generation program according to appendix 19, which causes a computer to execute processing.
(Appendix 21)
Based on the sensitive area, search the operation information stored in the tactile sense correspondence database,
Generating a control signal corresponding to the retrieved operation information;
The control signal generation program according to appendix 20, which causes a computer to execute processing.
(Appendix 22)
When the correlation value between the detection area of the human tactile sensation in the detection signal and the detection area stored in the tactile sensation control correspondence database is within a predetermined range, it is associated with the detection area within the predetermined range. Extract operation information from the tactile sensation control support database,
Generating a control signal of the same control content corresponding to the extracted operation information or a control signal for the same type of control target device;
The control signal generation program according to appendix 21, which causes a computer to execute processing.
(Appendix 23)
When the correlation value between the dead zone of the human tactile sensation in the detection signal and the dead zone stored in the tactile sensation control correspondence database is within a predetermined range, an operation associated with the dead zone within the predetermined range Information is extracted from the tactile sensation control compatible database,
Generating a control signal for the control target device corresponding to the extracted operation information;
The control signal generation program according to appendix 21, which causes a computer to execute processing.
(Appendix 24)
Controlling the device to be controlled by the generated control signal;
The control signal generation program according to any one of appendices 17 to 23, which causes a computer to execute processing.

DESCRIPTION OF SYMBOLS 1 Control signal production | generation apparatus 2 Contact sensor 3 Control object apparatus 4 Tactile sense corresponding | compatible database 5 Contact object 6 Tactile sensitivity distribution filter 11 Detection signal acquisition part 12 Detection signal separation part 13 Control signal generation part 14 Tactile sense registration part 15 Search part 16 Control unit 31 Mobile communication terminal 41 FFT unit 42 Filter unit 43 Operation storage unit 44 Registration / input mode switching unit 1101 CPU (Central Processing Unit)
1102 Memory 1103 Input device 1104 Output device 1105 External recording device 1106 Medium drive device 1107 Network connection device 1108 Bus 1109 Portable recording medium 1110 Communication network

Claims (10)

Get the detection signal from the tactile sensor,
When generating a control signal based on the acquired detection signal, a different control signal is generated according to a signal in a human touch sense area of the acquired detection signal.
A control signal generation method characterized by the above. When the signal pattern of the human tactile sensation area in the acquired detection signal has a predetermined similarity with a predetermined pattern, a control signal having the same control content or a control signal for the same type of device is generated.
The control signal generation method according to claim 1.   The control signal generation method according to claim 1, wherein a transmission destination of the generated control signal is controlled in accordance with a signal in a dead zone of human tactile sensation among the acquired detection signals. Storing the sensitive area and the dead area in association with operation information defining the control content for the control target device in a tactile sense correspondence database;
The control signal generation method according to claim 3. Based on the sensitive area, search the operation information stored in the tactile sense correspondence database,
Generating a control signal corresponding to the retrieved operation information;
The control signal generation method according to claim 4, wherein: When the correlation value between the detection area of the human tactile sensation in the detection signal and the detection area stored in the tactile sensation control correspondence database is within a predetermined range, it is associated with the detection area within the predetermined range. Extract operation information from the tactile sensation control support database,
Generating a control signal of the same control content corresponding to the extracted operation information or a control signal for the same type of control target device;
The control signal generation method according to claim 5. When the correlation value between the dead zone of the human tactile sensation in the detection signal and the dead zone stored in the tactile sensation control correspondence database is within a predetermined range, an operation associated with the dead zone within the predetermined range Information is extracted from the tactile sensation control compatible database,
Generating a control signal for the control target device corresponding to the extracted operation information;
The control signal generation method according to claim 5. Controlling the device to be controlled by the generated control signal;
The control signal generation method according to claim 1, wherein: An acquisition unit for acquiring a detection signal from the tactile sensor;
A generation unit that generates a different control signal in accordance with a signal in a human tactile sensation area among the acquired detection signals;
A control signal generating device comprising: Get the detection signal from the tactile sensor,
When generating a control signal based on the acquired detection signal, a different control signal is generated according to a signal in a human touch sense area of the acquired detection signal.
A control signal generation program that causes a computer to execute processing.