JP2024011485A - Information processing device, information processing program, and information processing system - Google Patents

Abstract

To provide an information processing device, an information processing program, and an information processing system that emit voice corresponding to how to touch.SOLUTION: An information processing system includes a mobile information terminal that communicates with an interface device in addition to a body pillow having the interface device, a sensor unit, and a speaker. A control unit 30 of a mobile information terminal 3 as an information processing device functions as pressure data acquisition means 300 for acquiring pressure data from a plurality of pressure sensors provided in the sensor unit, audio data selection and decoding means 301 for selecting and decoding a way according to which a user touches the sensor unit from a plurality of predetermined candidates based on a combination of changes in pressure data of the pressure sensors, and audio data transmitting means 302 for outputting audio data corresponding to the selected way of touch for reproduction by the interface device.SELECTED DRAWING: Figure 3

Description

The present invention relates to an information processing device, an information processing program, and an information processing system.

As a conventional technique, an information processing device that controls sound output based on a detected state of the device has been proposed (for example, see Patent Document 1).

The information processing device disclosed in Patent Document 1 includes a control section that controls sound output by the device based on the detected state of the device, and the control section controls whether the device normally outputs sound depending on the amount of change in the state. Continuously changes the output mode of the synthesized sound that can be output in the state. Further, the processor controls the output of the sound by the device based on the detected state of the device, and controlling the synthesized sound that the device can output in the normal state according to the amount of change in the state. Continuously change the output mode.

International Publication 2020/129422

According to the information processing device of Patent Document 1 mentioned above, a pressure sensor is cited as an example of a sensor that detects the state of the device, and audio output is continuously performed according to the amount of change in the pressure value detected by the pressure sensor. Although it changes, the state of the device is detected using a one-dimensional parameter called pressure value, and it even detects how the device is being touched, such as by stroking, kneading, or pinching. The problem is that it cannot be done.

An object of the present invention is to provide an information processing device, an information processing program, and an information processing system that emit sounds depending on the way the object is touched.

In order to achieve the above object, one aspect of the present invention provides the following information processing apparatus, information processing program, and information processing system.

[1] Obtain pressure data from multiple pressure sensors provided in the sensor section,
selecting a way of touching the sensor portion from a plurality of predetermined candidates based on a combination of changes in pressure data of the pressure sensor;
An information processing device including a control unit that reproduces audio data corresponding to the selected touch method.
[2] The sensor section has a pressure sensor in a surface layer and a deep layer of the sensor section,
The control unit selects at least stroking, pinching, and kneading as the plurality of touch options based on a combination of changes in pressure data of the superficial pressure sensor and changes in pressure data of the deep pressure sensor. The information processing device according to [1] above.
[3] The information processing device according to [1], wherein the audio data is pre-stored audio data or externally downloaded audio data.
[4] Acquisition means for acquiring pressure data from a plurality of pressure sensors provided in the sensor section;
selection means for selecting a way of touching the sensor section from a plurality of predetermined candidates based on a combination of changes in pressure data of the pressure sensor;
an information processing program comprising: a transmitting means for outputting audio data corresponding to the selected touch method for external playback;
[5] A sensor section provided with a plurality of pressure sensors;
Obtaining pressure data from a plurality of pressure sensors provided in the sensor section, selecting a way of touching the sensor section from a plurality of predetermined candidates based on a combination of changes in pressure data of the pressure sensors, and selecting the method of touching the sensor section. An information processing system comprising: a terminal that reproduces and processes audio data corresponding to the type of touch;

According to the inventions according to claims 1, 4, and 5, it is possible to emit a sound depending on the way of touching.
According to the invention according to claim 2, at least stroking, pinching, and kneading are selected as a plurality of touch options based on a combination of changes in pressure data from the surface pressure sensor and changes in pressure data from the deep pressure sensor. You can choose.
According to the third aspect of the invention, pre-stored audio data or externally downloaded audio data can be used as the audio data.

FIG. 1 is a schematic diagram showing an example of the configuration of an information processing system according to an embodiment. FIG. 2 is a block diagram illustrating a configuration example of an information processing system according to an embodiment. FIG. 3 is a block diagram showing an example of the configuration of a portable information terminal. FIG. 4 is a schematic diagram showing an example of the configuration of the sensor section. FIG. 5 is a schematic perspective view showing an example of the configuration of the sensor. FIG. 6 is a schematic diagram showing an example of the configuration of selection conditions. FIGS. 7(a) to 7(c) are schematic diagrams showing how a user touches the sensor section and the amount of change in the pressure sensor. FIG. 8 is a flowchart for explaining the operation of the information processing system. FIG. 9 is a schematic diagram showing another example of the configuration of the sensor section.

[Embodiment]
(Configuration of information processing system)
FIG. 1 is a schematic diagram showing an example of the configuration of an information processing system according to an embodiment. Further, FIG. 2 is a block diagram showing a configuration example of an information processing system according to an embodiment.

This information processing system includes a body pillow 4 having an interface device 1, a sensor section 2, and a speaker 40, as well as a portable information terminal 3 that communicates with the interface device 1. The sensor section 2 includes a plurality of pressure sensors, detects the touch of the user 5, and outputs a signal to the interface device 1. The interface device 1 performs AD conversion on the signal output from the sensor unit 2 in the control unit 10 and transmits it to the mobile information terminal 3 as pressure data, and also transmits audio data as a response of the mobile information terminal 3 to the transmitted pressure data. Upon reception, the audio output unit 11 drives the speaker 40 to output audio. The mobile information terminal 3 determines the type of contact of the user 5 with the sensor unit 2 based on the pressure data received from the interface device 1, and determines audio information to be output based on the determination result. The sensor unit 2 disposed in the body pillow is touched by the user 5, for example, by stroking, kneading, pinching, etc., but is not limited thereto.

The interface device 1 includes electronic components such as a CPU (Central Processing Unit) having a function for processing information, an AD/DA converter, an amplifier, and a flash memory.

The sensor unit 2 has one or more sensors inside, and each sensor is an example of a capacitive pressure sensor, but a pressure sensor using a resistive film method, an optical method, etc. may also be used. Alternatively, a piezoelectric element, MEMS, etc. may be used.

The mobile information terminal 3 is an information processing device such as a smartphone, a tablet terminal, or a PC (Personal Computer), and includes electronic components such as a CPU and a flash memory that have a function for processing information in the main body.

The connection between the mobile information terminal 3 and the interface device 1 uses wired communication such as USB (Universal Serial Bus) or wireless communication such as Bluetooth.

FIG. 3 is a block diagram showing an example of the configuration of the mobile information terminal 3. As shown in FIG.

The portable information terminal 3 includes a control section 30 that is composed of a CPU and the like and controls each section and executes various programs, and a storage section 31 that is composed of a storage medium such as a flash memory and stores information. Note that the control unit 30 includes a communication unit that communicates with the outside via a network.

The control unit 10 functions as a pressure data acquisition means 300, an audio data selection means 301, an audio data transmission means 302, a charging operation means 303, etc. by executing an application 310 to be described later.

The pressure data acquisition means 300 acquires pressure data from the interface device 1.

The audio data selection means 301 acquires corresponding audio data from among the plurality of candidates for the audio data 311 based on the pressure data acquired by the pressure data acquisition means 300 and the selection condition 312 .

The audio data transmitting means 302 transmits the audio data selected by the audio data selecting means 301 to the interface device 1.

The billing operation means 303 accesses the external voice data database 6 in response to the operation of the user 5 on the operation section of the mobile information terminal 3, charges the voice data or acquires the voice data free of charge, and stores it in the storage section 31.

The storage unit 31 stores an application 310 that causes the control unit 30 to operate as each of the above-mentioned means 300 to 303, audio data 311, selection conditions 312, and the like.

FIG. 4 is a schematic diagram showing an example of the configuration of the sensor section 2. As shown in FIG.

The sensor section 2 includes a surface sensor 20s, which is a pressure sensor provided on the surface layer of the sensor section 2, and a deep sensor 20i, which is a pressure sensor provided in the deep layer. Here, the "surface layer" refers to the inside of the surface of the sensor section 2 that is close to the area touched by the user 5, and the "deep layer" refers to the inside that is far away.

FIG. 5 is a schematic perspective view showing an example of the configuration of the sensor.

The sensor 20 includes conductive cloths 200a and 200b each having a terminal, and a nonconductor 201 such as a sponge provided between them, and changes depending on the pressure applied between the conductive cloths 200a and 200b. The capacitance changes depending on the distance between the conductive cloths 200a and 200b.

FIG. 6 is a schematic diagram showing a configuration example of the selection condition 312.

The selection conditions 312 include the way the user 5 touches the sensor unit 2, the amount of change in the pressure sensors of the surface sensor 20s and the deep sensor 20i (the amount of change in the capacitance of the sensor 20), the surface sensor 20s and the deep sensor 20i. has a pattern of change in pressure value (pattern of change in capacitance of the sensor 20).

(Operation of information processing device)
Next, the operation of this embodiment will be explained. FIG. 8 is a flowchart for explaining the operation of the information processing system.

First, the user 5 turns on the power of the body pillow 4 (the interface device 1 and the sensor section 2) in order to use the body pillow 4, and also launches the application 310 of the mobile information terminal 3. This operation starts the application 310 of the interface device 1 and the mobile information terminal 3 (S10). The interface device 1 and the portable information terminal 3 communicate with each other wirelessly. Note that the control unit 10 of the interface device 1 may automatically establish communication with the mobile information terminal 3 when the interface device 1 is started, and start the application 310 (directly or in the background).

Next, the user 5 uses the body pillow 4 by touching the sensor section 2, as shown in FIG. 7, which will be described later. The sensor 20 of the sensor section 2 outputs a signal depending on the way the user 5 touches it. The interface device 1 performs AD conversion or the like on the output signal of the sensor section 2 and transmits it to the mobile information terminal 3 as pressure data.

The pressure data acquisition means 300 of the portable information terminal 3 receives pressure data from the interface device 1 and acquires a pressure value (S11).

Next, the audio data selection means 301 of the mobile information terminal 3 refers to the selection conditions 312 (S12), and selects the audio data 311 based on the pressure data acquired by the pressure data acquisition means 300 and the selection conditions 312 shown in FIG. Among them, the corresponding audio data is determined (S13). Specifically, as shown in FIGS. 7(a) to 7(c) shown below, when the user 5 touches, the amount of change in the output value of the pressure sensor 20 changes depending on how the user 5 touches, so this is used to set the selection conditions. 312 is defined.

FIGS. 7A to 7C are schematic diagrams showing how the user 5 touches the sensor section 2 and the amount of change in the pressure sensor 20. FIG.

For example, as shown in FIG. 7A, when the user 5 strokes the sensor part 2, the shape of the surface layer of the sensor part 2 changes slightly, so the amount of change in the pressure value of the surface sensor 20s changes. The amount of change in the pressure value of the depth sensor 20i is small, and the amount of change in the pressure value of the depth sensor 20i is almost zero. Therefore, the threshold value for the amount of change in the pressure value of the surface sensor 20s is set to a small value (a value smaller than the dynamic range of the pressure sensor 20), and the threshold value is set for the amount of change in the pressure value of the deep layer sensor 20i. By setting the value to a value that is considered to be 0 (a value that allows noise and slight errors to be ignored), if the threshold value is satisfied, the audio data selection means 301 selects the "stroking" type of touch among the selection conditions 312. It is determined that

For example, as shown in FIG. 7(b), when the user 5 pinches the sensor unit 2, the shape of the surface layer of the sensor unit 2 changes significantly, so the amount of change in the pressure value of the surface sensor 20s is large, and the amount of change in pressure value of the deep sensor 20i is almost zero. Therefore, the threshold value for the amount of change in the pressure value of the surface sensor 20s is set to a large value (larger value than the dynamic range of the pressure sensor 20), and the threshold value is set for the amount of change in the pressure value of the deep layer sensor 20i. By setting the value to a value that is considered to be 0 (a value that allows noise and slight errors to be ignored), if the threshold value is satisfied, the audio data selection means 301 selects the "pinch" touch type among the selection conditions 312. It is determined that

Further, for example, as shown in FIG. 7(c), when the user 5 rubs the sensor section 2, the shape of the entire sensor section 2 changes greatly, so the amount of change in the pressure value of the surface sensor 20s is large. At the same time, the amount of change in the pressure value of the depth sensor 20i increases. Therefore, the threshold value for the amount of change in the pressure value of the surface sensor 20s is set to a large value (larger value than the dynamic range of the pressure sensor 20), and the threshold value is also set for the amount of change in the pressure value of the deep layer sensor 20i. By setting the value to a larger value, the audio data selection means 301 determines that the touch type is "kneading" among the selection conditions 312 when the threshold value is satisfied.

As described above, since the amount of change in the surface sensor 20s and the deep sensor 20i differs depending on how the user 5 touches the sensor section 2, selection conditions 312 can be prepared in advance for other touch methods other than the above-mentioned touch methods. We can respond. Further, selection conditions 312 for various ways of touching may be prepared using machine learning or the like. Further, the selection condition 312 may be any condition as long as there is a correlation between the touch method and the pressure value, and is not limited to table-like information, and may exist as learning result information if it is obtained by machine learning etc. It may be.

Next, the audio data selection means 301 of the mobile information terminal 3 acquires the corresponding audio data determined by the above operation from among the audio data 311 (S14).

Next, the audio data transmitting means 302 of the mobile information terminal 3 transmits the audio data selected by the audio data selecting means 301 to the interface device 1. The interface device 1 drives the speaker 40 based on the received audio data to output audio (S15).

In addition, the user 5 selects audio data 311 (and a set of selection conditions 312 for selecting the audio data 311) to be reproduced as a reaction to the sensor unit 2, in addition to the audio data prepared in advance in the mobile information terminal 3. In order to make a purchase from the data database 6, the mobile information terminal 3 is operated.

The billing operation means 303 accesses the voice data database 6 in response to the operation of the user 5 on the operation section (not shown) of the mobile information terminal 3, executes processing such as payment, downloads the voice data, and stores it in the storage section 31. Store. Through these operations, the types of sounds output from the speaker 40 via the interface device 1 can be increased.

(Effects of embodiment)
According to the embodiment described above, the sensor unit 2 is provided with a plurality of sensors, and the selection condition 312 is prepared that defines the amount of change and change pattern of the output value of each sensor according to the touch method of the user 5. Since the audio data 311 is selected and reproduced based on the selection condition 312, it is possible to emit a sound depending on the way of touching.

[Other embodiments]
Note that the present invention is not limited to the embodiments described above, and various modifications can be made without departing from the spirit of the present invention.

For example, in the above embodiment, the interface device 1, the sensor unit 2, and the mobile information terminal 3 are shown as separate devices, but each device may be integrated in any combination, or some of the functions of each device may be Alternatively, the entire system may be included in another device, or it may be configured to be divided into four or more devices.

Further, the sensor section 2 described in the above embodiment may be configured as described below.

FIG. 9 is a schematic diagram showing another example of the configuration of the sensor section 2. As shown in FIG.

The sensor section 2A is another configuration example of the sensor section 2, and includes a surface layer sensor 20s that is a pressure sensor provided on the surface layer, a deep layer sensor 20i that is a pressure sensor provided in the deep layer, and a balloon-shaped adjustment sensor. It has a member 21. The adjustment member 21 has a structure that can increase or decrease the amount of air inside, and by changing the amount of air, the bulge, hardness, etc. of the sensor section 2A can be changed, and the adjustment between the surface sensor 20s and the deep sensor 20i can be adjusted. Distance etc. can be changed.

Further, the body pillow 4 may have a plurality of sensor sections 2, and may reproduce different audio data depending on how each sensor section 2 is touched. Furthermore, each sensor section 2 may be configured to be replaceable with another sensor section 2 having a different feel and size according to the user's 5 preference. Furthermore, different audio data 311 may be selected in response to replacement of another sensor section 2.

In the above embodiment, the functions of each means 300 to 303 of the control unit 30 are realized by a program, but all or part of each means may be realized by hardware such as ASIC. Further, the programs used in the above embodiments can also be provided by being stored in a recording medium such as a CD-ROM. Furthermore, the above steps explained in the above embodiments can be replaced, deleted, added, etc. without changing the gist of the present invention.

1: Interface device 2, 2A: Sensor unit 3: Mobile information terminal 4: Body pillow 5: User 6: Voice data database 10: Control unit 11: Voice output unit 20: Pressure sensor 20i: Deep sensor 20s: Surface sensor 21 : Adjustment member 30 : Control part 31 : Storage part 40 : Speakers 200a, 200b : Conductive cloth 201 : Non-conductor 300 : Pressure data acquisition means 301 : Audio data selection means 302 : Audio data transmission means 303 : Billing operation means 310 : Application 311: Audio data 312: Selection conditions

Claims (5)

Obtain pressure data from multiple pressure sensors installed in the sensor section,
selecting a method of touching the sensor portion from a plurality of predetermined candidates based on a combination of changes in pressure data of the pressure sensor;
An information processing device including a control unit that reproduces audio data corresponding to the selected touch method. The sensor section has pressure sensors in a surface layer and a deep layer of the sensor section,
The control unit selects at least stroking, pinching, and kneading as the plurality of touch options based on a combination of changes in pressure data of the superficial pressure sensor and changes in pressure data of the deep pressure sensor. The information processing device according to claim 1. The information processing apparatus according to claim 1, wherein the audio data is pre-stored audio data or externally downloaded audio data. acquisition means for acquiring pressure data from a plurality of pressure sensors provided in the sensor section;
selection means for selecting a way of touching the sensor section from a plurality of predetermined candidates based on a combination of changes in pressure data of the pressure sensor;
an information processing program comprising: a transmitting means for outputting audio data corresponding to the selected touch method for external playback; a sensor section provided with a plurality of pressure sensors;
Acquire pressure data from a plurality of pressure sensors provided in the sensor section, select a method of touching the sensor section from a plurality of predetermined candidates based on a combination of changes in pressure data of the pressure sensors, and select the method of touching the sensor section from a plurality of predetermined candidates. An information processing system comprising: a terminal that reproduces and processes audio data corresponding to the type of touch;

Images