JP7487385B1 - Information processing system, pen-type input device, and program - Google Patents

Abstract

[Problem] To provide an input using a pen-type input device that approximates the sensation of actually writing on a writing medium. [Solution] An information processing device includes a sensor unit that detects contact with the pen-type input device, and a parameter output unit that transmits feedback parameters to the pen-type input device, including at least parameters for controlling the vibration of the pen-type input device, in response to the detection of contact by the sensor unit, the pen-type input device includes a vibration control unit that vibrates a vibration unit based on the received feedback parameters, and a sound output control unit that outputs sound from a sound output unit at a timing according to the vibration of the vibration unit, based on the feedback parameters output by the parameter output unit, to form an information processing system. [Selected Figure] Figure 2

Description

The present invention relates to an information processing system, a pen-type input device, and a program.

When inputting information to an interactive display system, it is known to use a pen-shaped stylus (pen-type input device) as an input device, which is capable of providing tactile feedback by generating vibrations that drive a tactile actuator.

JP 2017-537395 A

By emitting vibrations from the pen-type input device, the tactile sensation of sliding the tip of a pen across a writing medium such as paper can be simulated, allowing users who are using the pen-type input device to obtain a sensation similar to that of writing on a writing medium.

When inputting data using a pen-type input device, it is desirable to have a sensation as close as possible to that of writing on an actual writing medium.
In consideration of the above-mentioned problems, the present invention has an object to provide an input using a pen-type input device that provides a sensation similar to that felt when actually writing on a writing medium.

One aspect of the present invention that solves the above-mentioned problems is an information processing system that includes an information processing device and a pen-type input device, the information processing device includes a sensor unit that detects contact with the pen-type input device, and a parameter output unit that transmits feedback parameters to the pen-type input device, including at least parameters for controlling vibration of the pen-type input device, in response to detection of the contact by the sensor unit, the pen-type input device includes a vibration unit and a vibration control unit that vibrates the vibration unit based on the received feedback parameters, and at least one of the pen-type input device and the information processing device includes a sound output control unit that outputs sound from a sound output unit at a timing corresponding to the vibration of the vibration unit, based on the feedback parameters output by the parameter output unit.

One aspect of the present invention is a pen-type input device that includes a communication unit that communicates with an information processing device that transmits feedback parameters to the pen-type input device, including at least parameters for controlling vibration of the pen-type input device, in response to detection of contact with the pen-type input device, a vibration unit, a vibration control unit that vibrates the vibration unit based on the received feedback parameters, and a sound output control unit that outputs sound from a sound output unit at a timing corresponding to the vibration of the vibration unit based on the received feedback parameters.

One aspect of the present invention is a program for causing a computer serving as a pen-type input device to function as a sensor unit that detects contact with the pen-type input device, a communication unit that communicates with an information processing device and transmits feedback parameters to the pen-type input device, including at least parameters for controlling vibration of the pen-type input device, in response to detection of the contact by the sensor unit, a vibration control unit that vibrates a vibration unit based on the received feedback parameters, and a sound output control unit that outputs sound from a sound output unit at a timing corresponding to the vibration of the vibration unit, based on the received feedback parameters.

The present invention has the effect of providing an input using a pen-type input device that is closer to the sensation of actually writing on a writing medium.

1 is a diagram illustrating an example of the external configuration of an information processing system according to a first embodiment. 1 is a diagram illustrating an example of a functional configuration according to tactile and writing sound feedback between an information processing device and a pen-type input device in a first embodiment. FIG. 5 is a diagram showing an example of parameter data stored in a parameter storage unit in the first embodiment; FIG. 4 is a diagram showing an example of handwriting sound data stored in a handwriting sound data storage unit in the first embodiment; FIG. 10 is a flowchart illustrating an example of a processing procedure executed by the information processing device and the pen-type input device in response to tactile and writing sound feedback in the first embodiment. FIG. 13 is a diagram illustrating an example of a functional configuration corresponding to tactile and writing sound feedback between an information processing device and a pen-type input device in a second embodiment. 13 is a flowchart illustrating an example of a processing procedure executed by an information processing device and a pen-type input device in response to tactile and writing sound feedback according to the second embodiment. FIG. 13 is a diagram illustrating an example of a functional configuration corresponding to tactile and writing sound feedback between an information processing device and a pen-type input device according to a third embodiment. 13 is a flowchart illustrating an example of a processing procedure executed by an information processing device and a pen-type input device in response to tactile and writing sound feedback according to the third embodiment.

First Embodiment
1 shows an example of the external configuration of an information processing system according to the present embodiment. As shown in the figure, the information processing system according to the present embodiment includes an information processing device 100 and a pen-type input device 200.

The information processing device 100 is capable of executing information processing in response to an input operation by the pen-type input device 200. The information processing device 100 in the figure shows an example in which it is a tablet terminal or a notebook-type personal computer, etc.

The information processing device 100 includes a touch panel display unit 102. The touch panel display unit 102 is a component that combines a touch panel and a display unit. The touch panel display unit 102 displays an image on a display surface, and allows operation by contacting the display surface with an operating object such as a pen-type input device or a finger.

The pen-type input device 200 is a pen-type input device that is used by a user to perform operations on the touch panel of the touch panel display unit 102 of the information processing device 100 .
A user holds the pen-type input device 200 and moves the pen tip so as to contact the display surface of the touch panel display unit 102, thereby performing a handwritten input operation of characters, pictures, figures, etc.

In addition, when operating using the pen-type input device 200, the "contact" of the pen tip with the display surface of the touch panel display unit 102 includes not only physical contact, but also a state in which there is no physical contact with the display surface but the pen tip is close enough for the touch panel of the touch panel display unit 102 to detect it.
Furthermore, operations using the pen-type input device 200 may also include pointing operations on a user interface image displayed on the touch panel display unit 102 .

In addition, the detection method of the pen-type input device 200 by the touch panel in the touch panel display unit 102 of this embodiment is not particularly limited, but examples include a capacitance method and a pressure-sensitive method.

An application compatible with input operations using the pen-type input device 200 (pen operation compatible application) is installed in the information processing device 100 .
The pen operation compatible application may be capable of displaying characters or pictures on the touch panel display unit 102 in response to handwriting input operations such as character input or drawing, which are performed by touching the tip of the pen of the pen-type input device 200 to the touch panel display unit 102, and of executing processes such as converting characters or pictures drawn by the operation into data.

In addition, in the information processing system of this embodiment, the pen-type input device 200 vibrates in response to an operation corresponding to writing (writing operation) being performed. This vibration of the pen-type input device 200 allows the user to feel a tactile sensation similar to that felt when writing on a writing medium such as paper, and allows the user to obtain a sensation similar to that felt when writing on a writing medium with an actual writing implement.

Furthermore, in the information processing system of this embodiment, the pen-type input device 200 is configured to output a sound (writing sound) that is generated by writing on a writing medium with an actual writing instrument in response to an operation corresponding to writing.
In this way, when a writing operation is performed using the pen-type input device 200, a writing sound is output along with the generation of vibrations, making it possible to further approximate the sensation of writing on a writing medium with an actual writing instrument.

In the following description, the generation of vibrations and the output of writing sounds when a writing operation is being performed with the pen-type input device 200 will also be referred to as "tactile/writing sound feedback."

FIG. 2 shows an example of a functional configuration of the information processing apparatus 100 and the pen-type input device 200 according to this embodiment, which corresponds to tactile and writing sound feedback.
First, a description will be given of an example of a functional configuration of the information processing device 100. The functions of the information processing device 100 shown in the figure are realized by a central processing unit (CPU), a graphics processing unit (GPU), and the like included in the hardware of the information processing device 100 executing a program.
The information processing device 100 in the figure includes a communication unit 101 , a touch panel display unit 102 , a control unit 103 , and a storage unit 104 .

The communication unit 101 performs wireless communication with the pen-type input device 200. There are no particular limitations on the wireless communication method supported by the communication unit 101. Note that the communication unit 101 may also be capable of supporting wired communication with the pen-type input device 200.

The touch panel display unit 102 is a device that combines a display unit 121 and a touch panel 122 (an example of a sensor unit). The display unit 121 displays an image according to the control of the control unit 103. The touch panel 122 is provided corresponding to the display surface of the display unit 121, detects the position touched by the pen tip of the pen-type input device 200, and outputs the coordinates of the detected position as pen operation information.

The control unit 103 executes various controls in the information processing device 100. The control unit 103 includes an application support processing unit 131 that executes processing corresponding to a pen operation compatible application.
The application-compatible processing unit 131 includes a parameter output unit 1311. When a writing operation is performed with the pen type input device 200 as an operation for a pen operation-compatible application, pen operation information is input from the touch panel 122 to the application-compatible processing unit 131. In response to the input of the pen operation information, the application-compatible processing unit 131 outputs feedback parameters for causing the pen type input device 200 to perform a tactile/writing sound feedback operation. The communication unit 101 transmits the output feedback parameters D1 to the pen type input device 200.

The storage unit 104 stores various information corresponding to the information processing device 100. The storage unit 104 includes a parameter storage unit 141 and a writing setting data storage unit 142.

The parameter storage unit 141 stores predetermined parameter data to be included in the feedback parameters.
3 shows an example of parameter data stored in the parameter storage unit 141. In the figure, an example is shown in which the parameter storage unit 141 stores vibration waveform data and writing sound data as parameter data for each writing implement type.
The vibration waveform data is data that indicates a vibration waveform that is generated so as to cause the pen-type input device 200 to have a desired vibration state.

The pen operation compatible application of this embodiment is capable of setting a writing implement type when performing a writing operation using the pen type input device 200. Specifically, examples of the writing implement type include pencils, ballpoint pens, crayons, felt tip pens, and calligraphy brushes. The pen operation compatible application performs drawing in a stroke corresponding to the set writing implement type in response to the writing operation using the pen type input device 200.
In reality, the tactile sensation felt when writing on a writing medium differs depending on the type of writing implement. Each of the vibration waveform data stored in the parameter storage unit 141 is created to reproduce the tactile sensation of the corresponding writing implement type.

The feel when writing also differs depending on the type of writing medium, such as Western paper, Japanese paper, resin, etc. In other words, the feel when writing may differ for each combination of writing implement type and writing medium. Therefore, the parameter storage unit 141 may store different parameter data (vibration waveform data) for each combination of writing implement type and writing medium type, for example.

Returning to FIG.
The writing setting data storage unit 142 is setting data including data on the type of writing implement (writing implement type data) set in response to a writing operation by the pen-type input device 200 in a pen operation compatible application. The writing setting data may also include data indicating the set writing medium (writing medium data).

Next, an example of the functional configuration of the pen-type input device 200 will be described. The functions of the pen-type input device 200 shown in the figure may be realized, for example, by causing a microprocessor such as an MCU (Micro Controller Unit) provided in the pen-type input device 200 as hardware to execute a program.

The pen-type input device 200 in the figure includes a communication unit 201, a vibration unit 202, a sound output unit 203, a control unit 204, and a memory unit 205.

The communication unit 201 is communicatively connected to the communication unit 101 of the information processing device 100.

The vibration unit 202 (actuator) is a part that vibrates to give a tactile sensation to a user holding the pen-type input device 200 during a writing operation. The vibration of the vibration unit 202 is controlled by the vibration control unit 241.

The sound output unit 203 includes, for example, a speaker, and outputs handwriting sounds according to the control of the sound output control unit 242. Note that the sound output unit 203 may also be capable of outputting sounds such as electronic sounds and voices.

The control unit 204 executes various controls in the pen-type input device 200. The control unit 204 includes a vibration control unit 241 and a sound output control unit 242.

The vibration control unit 241 vibrates the vibration unit 202 based on the vibration waveform data contained in the received feedback parameters.

The sound output control unit 242 outputs audio data as handwriting sound data stored in the handwriting sound data storage unit 251 to the sound output unit 203, thereby causing the sound output unit 203 to output handwriting sounds.

The storage unit 205 stores various types of information supported by the pen type input device 200. The storage unit 205 includes a handwriting sound data storage unit 251.
The handwriting sound data storage unit 251 stores handwriting sound data. Fig. 4 shows an example of handwriting sound data stored in the handwriting sound data storage unit 251. As shown in the figure, the handwriting sound data storage unit 251 stores handwriting sound data corresponding to each writing implement type.
In reality, the handwriting sounds emitted when writing on a writing medium differ depending on the type of writing implement. Each piece of handwriting sound data stored in the handwriting sound data storage unit 251 is created to reproduce the handwriting sounds emitted for the corresponding type of writing implement.

With reference to the flowchart in FIG. 5, an example of a processing procedure executed by the information processing device 100 and the pen-type input device 200 configured as shown in FIG. 2 in response to tactile and writing sound feedback will be described.

First, an example of a processing procedure executed by the information processing device 100 will be described.
Step S100: In the information processing device 100, the touch panel 122 detects coordinates designated in response to a writing operation using the pen-type input device 200, and outputs pen operation information indicating the detected coordinates. The application processing unit 131 acquires the pen operation information output from the touch panel 122.
The application corresponding processing unit 131 executes processing such as drawing handwriting corresponding to the acquired pen operation information on the display unit 121. At this time, when the parameter output unit 1311 receives pen pressure data indicating the pen pressure detected by the pen type input device 200, for example, the parameter output unit 1311 may draw the handwriting so that the thickness, etc. of the handwriting is changed according to the pen pressure indicated by the received pen pressure data.

Step S102: Furthermore, in response to the acquisition of the pen operation information in step S100, the parameter output unit 1311 acquires parameter data to be included in the feedback parameters.
For example, the currently set writing implement type is determined by referring to the writing setting data stored in the writing setting data storage unit 142. The parameter output unit 1311 acquires data indicating the determined writing implement type (writing implement type data) as one piece of parameter data.
Furthermore, the parameter output unit 1311 acquires, as a feedback parameter, vibration waveform data stored in the parameter storage unit 141 in association with the determined writing implement type.
Furthermore, when the writing setting data includes writing volume data that sets the volume of the writing sound output from the pen-type input device 200, the parameter output unit 1311 may acquire the volume indicated by the writing volume data as one of the parameter data. Alternatively, when the writing pressure data transmitted by the pen-type input device 200 is received, the parameter output unit 1311 may acquire the writing volume set according to the writing pressure indicated by the received writing pressure data as the parameter data.

Step S104: The parameter output unit 1311 causes the communication unit 101 to transmit the feedback parameter D1, which includes the parameter data acquired in step S102, to the pen-type input device 200.

The process of acquiring parameter data in steps S102 and S104 and transmitting it to the pen-type input device 200 as feedback parameters D1 may be realized by an API (Application Programming Interface) that is configured to support tactile and writing sound feedback.

Next, an example of a processing procedure executed by the pen type input device 200 will be described.
Step S200: In the pen type input device 200, the communication unit 201 receives the feedback parameter D1 transmitted from the information processing device 100 in step S104.

Step S202: The vibration control unit 241 drives the vibration unit 202 to vibrate using the vibration waveform data included in the feedback parameters received in step S200.

Step S204: The sound output control unit 242 also acquires from the handwriting sound data storage unit 251 handwriting sound data stored in association with the writing instrument type indicated by the writing instrument type data included in the feedback parameters received in step S200.

Step S206: The sound output control unit 242 causes the sound output unit 203 to output a writing sound based on the writing sound data acquired in step S204. At this time, if the feedback parameters include writing volume data, the sound output control unit 242 may adjust the volume of the writing sound output from the sound output unit 203 based on the writing volume data.

For example, there are known drawing applications that are configured to output sounds in response to writing with a pen-type input device, but there are also drawing applications that do not support sound output in response to writing. In this case, whether or not sound is output in response to writing depends on whether or not the application has a function that supports sound output in response to writing.
In contrast, according to the above configuration of the present embodiment, even if the drawing application does not have a function for outputting sounds corresponding to writing, the API allows a feedback parameter to be transmitted from the pen operation compatible application to the pen type input device 200, so that the pen type input device 200 can output the writing sound. Also, depending on the process of Fig. 4, the vibration of the vibration unit 202 in step S202 and the output of the writing sound in step S204 are performed in response to the same pen operation information acquired in step S100, and therefore are performed at synchronized timing. Specifically, the writing sound is output at the same timing as the vibration is generated in the pen type input device 200.
In this case, the information processing device 100 only needs to apply the above API, and no major changes to the hardware or software, for example, are required.
In this embodiment, handwriting sound data for each writing implement type is stored in the pen type input device 200, and the writing implement data indicating the writing implement type set in the pen operation compatible application is included in the feedback parameters. With this configuration, it is possible to output handwriting sounds that match the writing implement type set in the pen operation compatible application. Even if a plurality of different pen operation compatible applications are implemented in the information processing device 100, each of the pen operation compatible applications has the above configuration, so that handwriting sounds that match the set writing implement type can be output in response to any of the pen operation compatible applications.
In addition, in a drawing application that outputs sounds in response to writing with a pen-type input device, sounds in response to writing are output from an information processing device. In contrast, in this embodiment, writing sounds are output from the pen-type input device 200, so it is possible to more closely resemble the sensation of actually writing with a writing implement.

In this embodiment, the information processing device 100 may store handwriting sound data associated with each writing implement type (or combination of writing implement type and writing medium) as data corresponding to a pen operation compatible application, instead of the pen type input device 200. In this case, the feedback parameters include handwriting sound data associated with the set writing implement type (or combination of writing implement type and writing medium).
The pen-type input device 200 may output a writing sound by using the writing sound data included in the received feedback parameters.

Second Embodiment
Next, a description will be given of a second embodiment. The information processing system of this embodiment is configured so that an information processing device 100 outputs writing sounds.

6 shows an example of a functional configuration corresponding to tactile and writing sound feedback between the information processing device 100 and the pen-type input device 200 of this embodiment. In this figure, the same parts as those in FIG. 2 are given the same reference numerals, and differences from FIG. 2 will be mainly described.
In this embodiment, the control unit 103 of the information processing device 100 includes a sound output control unit 132 .
The storage unit 104 of the information processing device 100 includes a parameter storage unit 141, a writing setting data storage unit 142, and a handwriting sound data storage unit 143.
The information processing device 100 also includes a sound output unit 105 .

The sound output control unit 132 is a functional unit corresponding to the writing sound output software resident in the information processing device 100, and the handwriting sound data storage unit 143 is a storage unit provided in correspondence with the writing sound output software.

2 are omitted in the pen-type input device 200. The sound output unit 203, the handwriting sound data storage unit 251, and the sound output control unit 242 are omitted in the control unit 204. In place of the sound output control unit 242, a sound output instruction unit 243 is provided in the control unit 204.
The sound output instruction unit 243 instructs the sound output control unit 132 of the information processing device 100 to output a handwriting sound.

With reference to the flowchart in FIG. 7, an example of a processing procedure executed by the information processing device 100 and the pen-type input device 200 configured as shown in FIG. 6 in response to tactile and writing sound feedback will be described.

First, an example of a processing procedure executed by the information processing device 100 will be described.
The processes in steps S300 to S304 may be similar to those in steps S100 to S104 in FIG.

Step S306: In response to the transmission of the feedback parameters D1 in step S304, the pen-type input device 200 transmits a sound output instruction signal D2. The sound output instruction signal D2 is a signal that instructs the sound output control unit 132 to output a writing sound. In the information processing device 100, the communication unit 101 receives the transmitted sound output instruction signal D2. The sound output instruction signal includes writing implement type data, writing volume data, etc. as parameter data that was included in the feedback parameters transmitted in step S204.

Step S306: In response to receiving the sound output instruction signal D2, the writing sound data associated with the writing instrument type indicated by the writing instrument type data included in the received sound output instruction signal D2 is obtained from the writing setting data storage unit 142.

Step S308: The sound output control unit 132 causes the sound output unit 105 to output the writing sound based on the writing sound data acquired in step S306. At this time, the volume of the writing sound output from the sound output unit 105 may be adjusted based on the writing volume data included in the received sound output instruction signal D2.

Next, an example of a processing procedure executed by the pen type input device 200 will be described.
The processes in steps S400 and S402 may be similar to those in steps S200 and S202 in FIG.

Step S404: The sound output instruction unit 243 generates a sound output instruction signal D2 including the writing implement type data (and writing volume data) included in the feedback parameters received in step S400. The sound output instruction unit 243 causes the communication unit 201 to transmit the generated sound output instruction signal D2 to the information processing device 100.

According to the configuration of the information processing system of the present embodiment, in response to a writing operation using the pen-type input device 200 on the touch panel display unit 102 of the information processing device 100, a writing sound can be output from the information processing device 100 along with a tactile vibration corresponding to the writing with the pen-type input device 200. Also, according to the process of Fig. 7, the vibration of the vibration unit 202 in step S402 and the output of the writing sound in step S404 are performed in response to the same pen operation information acquired in step S300, and therefore are performed at synchronized timing.
Furthermore, the pen type input device 200 in this embodiment is configured to include the writing implement type data (and writing volume data) included in the feedback parameters transmitted from the information processing device 100 in the sound output instruction signal D2 and return it as data that the sound output control unit 132 of the information processing device 100 can use to control sound output. With this configuration, even in an environment in which a plurality of different pen operation compatible applications are installed in the information processing device 100, it is possible to output an appropriate writing sound corresponding to the set writing implement type in response to any of the pen operation compatible applications.

Third Embodiment
Next, a description will be given of a third embodiment. The information processing system of this embodiment is configured so that an information processing device 100 outputs writing sounds.

8 shows an example of a functional configuration corresponding to tactile and writing sound feedback between the information processing device 100 and the pen-type input device 200 of this embodiment. In this figure, the same parts as those in FIG. 6 are given the same reference numerals, and differences from FIG. 6 will be mainly described.
In this embodiment, the control unit 103 of the information processing device 100 is provided with a sound output control unit 132A. Moreover, in the pen type input device 200, the sound output instruction unit 243 is omitted.

The sound output control unit 132A is a functional unit corresponding to the writing sound output software resident in the information processing device 100, and in this respect is similar to the sound output control unit 132 in FIG. 6. However, while the sound output control unit 132 in FIG. 6 outputs writing sounds based on the sound output instruction signal D2 transmitted from the pen-type input device 200, the sound output control unit 132A in this embodiment is configured to obtain feedback parameters output by the parameter output unit 1311 for transmission from the communication unit 101.

With reference to the flowchart in FIG. 9, an example of a processing procedure executed by the information processing device 100 and the pen-type input device 200 configured as shown in FIG. 8 in response to tactile and writing sound feedback will be described.

First, an example of a processing procedure executed by the information processing device 100 will be described.
The processing of steps S500 to S504 may be similar to steps S300 to S304 in Fig. 7. However, the feedback parameters transmitted in step S504 need only include vibration waveform data, and need not include data related to output control of the writing sound, such as writing volume data.

Step S506: The sound output control unit 132A acquires the feedback parameters that the parameter output unit 1311 output to the communication unit 101 in step S504 to be transmitted to the pen-type input device 200.

Step S508: The sound output control unit 132A acquires, from the writing setting data storage unit 142, writing sound data associated with the writing instrument type indicated by the writing instrument type data included in the feedback parameters acquired in step S506.

Step S510: The sound output control unit 132A causes the sound output unit 105 to output the writing sound based on the writing sound data acquired in step S508. At this time, if the feedback parameters include writing volume data, the volume of the writing sound output from the sound output unit 105 may be adjusted based on the writing volume data.

The processing of steps S600 and S602 executed by the pen-type input device 200 may be similar to steps S400 and S402 in FIG. 7.

According to the configuration of the information processing system of the present embodiment, in response to a writing operation using the pen-type input device 200 on the touch panel display unit 102 of the information processing device 100, a writing sound can be output from the information processing device 100 in synchronization with the vibration of the tactile sensation corresponding to the writing on the pen-type input device 200. In addition, the pen-type input device 200 vibrates the vibration unit 202 according to the vibration waveform data included in the feedback parameter D1 transmitted from the information processing device 100. With such a configuration, in this embodiment as well, in response to a user writing on the touch panel display unit 102 using the pen-type input device 200, the pen-type input device 200 vibrates and a writing sound synchronized with the vibration of the pen-type input device 200 can be output from the information processing device 100. In this case, in this embodiment, the feedback parameter D1 transmitted by the information processing device 100 may include a vibration waveform corresponding to the set writing implement type for the vibration waveform. As a result, a vibration corresponding to the set writing implement type can be given to the pen-type input device 200. Furthermore, with the above configuration, even in this embodiment, even in an environment in which multiple different pen operation-compatible applications are installed in the information processing device 100, it is possible to output an appropriate writing sound that corresponds to the set writing implement type in response to any of the pen operation-compatible applications.

Note that by combining the configuration of the second or third embodiment with the first embodiment described above, it may be possible to configure it so that writing sounds can be output from both the pen-type input device 200 and the information processing device 100. In this case, it may be possible to switch between the pen-type input device 200 and the information processing device 100 from which writing sounds are output, depending on, for example, a user's operation or application conditions.

In addition, a program for realizing the functions of the above-mentioned information processing device 100, pen-type input device 200, etc. may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed to perform processing as the above-mentioned information processing device 100, pen-type input device 200, etc. Here, "reading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. In addition, the "computer system" may include multiple computer devices connected via a network including the Internet, WAN, LAN, dedicated lines, and other communication lines. In addition, the "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, and storage devices such as HDDs and SSDs built into a computer system. In this way, the recording medium storing the program may be a non-transient recording medium such as a CD-ROM. In addition, the recording medium also includes a recording medium provided inside or outside and accessible from a distribution server to distribute the program. The code of the program stored in the recording medium of the distribution server may be different from the code of the program in a format executable by the terminal device. In other words, as long as it can be downloaded from the distribution server and installed in a format executable by the terminal device, the format in which it is stored in the distribution server does not matter. The program may be divided into multiple parts, downloaded at different times, and then combined on the terminal device, or each of the divided programs may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a memory that holds a program for a certain period of time, such as a volatile memory (RAM) inside a computer system that becomes a server or a client when a program is transmitted over a network. The program may also be a program for realizing part of the above-mentioned functions. Furthermore, the program may be a so-called difference file (difference program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

100 Information processing device, 101 Communication unit, 102 Touch panel display unit, 103 Control unit, 104 Memory unit, 105 Sound output unit, 121 Display unit, 122 Touch panel, 131 Application processing unit, 132 Sound output control unit, 132A Sound output control unit, 141 Parameter storage unit, 142 Writing setting data storage unit, 143 Handwriting sound data storage unit, 200 Pen-type input device, 201 Communication unit, 202 Vibration unit, 203 Sound output unit, 204 Control unit, 205 Storage unit, 241 Vibration control unit, 242 Sound output control unit, 243 Sound output instruction unit, 251 Handwriting sound data storage unit, 1311 Parameter output unit

Claims (4)

An information processing device and a pen-type input device are provided,
The information processing device includes:
a sensor unit for detecting a contact of the pen-type input device;
A first storage unit that stores vibration waveform data;
a parameter output unit configured to transmit, to the pen-type input device, feedback parameters including at least vibration waveform data acquired from the first storage unit as parameters for controlling vibration of the pen-type input device in response to detection of the contact by the sensor unit ;
Equipped with
The pen-type input device is
A vibration part;
a vibration control unit that vibrates the vibration unit based on vibration waveform data included in the received feedback parameters ;
A second storage unit that stores handwriting sound data;
A sound output unit;
a sound output control unit that outputs a sound based on the handwriting sound data stored in the second storage unit from the sound output unit at a timing corresponding to the vibration of the vibration unit in response to an output of the feedback parameter by the parameter output unit.
Information processing system. the feedback parameters include writing implement type data indicating a writing implement type set corresponding to the pen-type input device,
The information processing system according to claim 1 , wherein the sound output unit outputs a handwriting sound corresponding to the writing implement type indicated by the writing implement type data. An information processing device that transmits feedback parameters to the pen-type input device, the feedback parameters including vibration waveform data acquired from a first storage unit as parameters for controlling vibration of the pen-type input device in response to detection of contact with the pen-type input device , the information processing device including: a communication unit that communicates with the information processing device having the first storage unit ;
A vibration part;
a vibration control unit that vibrates the vibration unit based on vibration waveform data included in the received feedback parameters ;
A second storage unit that stores handwriting sound data;
A sound output unit;
and a sound output control unit that outputs a sound based on the handwriting sound data stored in the second storage unit from the sound output unit at a timing corresponding to the vibration of the vibration unit in response to reception of a feedback parameter. A computer as a pen-type input device
an information processing device that transmits, in response to detection of contact with a pen-type input device, feedback parameters including vibration waveform data acquired from a first storage unit as parameters for controlling vibration of the pen-type input device to the pen-type input device, the information processing device including: a communication unit that communicates with the information processing device having the first storage unit ;
a vibration control unit that vibrates a vibration unit included in the pen-type input device based on vibration waveform data included in the received feedback parameters;
A program for causing the pen-type input device to function as a sound output control unit that outputs, in response to receiving feedback parameters, a sound based on handwriting sound data stored in a second storage unit provided in the pen-type input device, from a sound output unit provided in the pen-type input device, at a timing corresponding to the vibration of the vibration unit.

Images