KR102341253B1 - Ellectronic apparatus and the controlling method thereof - Google Patents

Abstract

An electronic device is disclosed. The electronic device includes at least one of a plurality of pads each including a touch sensor and an acceleration sensor, a sound output unit for outputting a plurality of sounds set for each of the plurality of pads, a display unit for providing visual feedback, and a plurality of pads. When a user touch is detected by the touch sensor and the intensity of the user's touch is detected by the acceleration sensor as greater than or equal to a preset threshold, a processor for determining that a strike has been made to at least one pad, wherein the processor is configured to detect the strike The sound output unit is controlled to output a type of sound set to correspond to the pad at a size corresponding to the strength of the blow, and the display unit is controlled to provide visual feedback corresponding to the blow.

Description

ELECTRONIC APPARATUS AND THE CONTROLLING METHOD THEREOF

The present invention relates to an electronic device and a control method therefor, and more particularly, to an electronic device and a control method for detecting a blow and providing feedback corresponding to the sensed hit.

With the development of electronic technology, various types of electronic products are being developed and distributed. In particular, various display devices such as TV, mobile phone, PC, notebook PC, PDA, etc. are widely used in most general homes. In particular, the technologies for these various electronic products are being utilized in various electronic musical instruments, and the demand for such electronic musical instruments is increasing.

For example, among electronic musical instruments, electronic drums attach a piezo sensor to each pad to convert shock, vibration, and pressure transmitted to each sensor into electrical signals to reproduce sound, and electronic drum sticks are equipped with LEDs and sensors Thus, when the tip of the electronic drumstick hits a certain surface, the LED blinks and a percussion sound can be played.

In other words, the existing electronic musical instrument used a piezo sensor to implement a percussion instrument, and was manufactured to respond to the shock and vibration when struck using a stick. Here, the price of the piezo sensor is higher than that of the acceleration sensor, and it has a characteristic that it responds to a minute amount of vibration. In the case of a technology using a piezo sensor, there is a disadvantage that each sensor must be applied to an independent structure. That is, it is difficult to receive multiple inputs in a structure connected to one.

In addition, although a percussion instrument can be implemented only with an acceleration sensor, since data on minute vibrations are also reflected between the acceleration sensors in the connected structure, there is a problem in that it is difficult to determine whether the pad part is accurately struck in signal processing.

Accordingly, it is intended to propose various methods for accurately determining which pad is struck within a structure connected to one another and providing feedback thereto.

The present invention has been devised to solve the above problems, and an object of the present invention is to provide an electronic device and a control method thereof for determining whether to hit by combining signals from an acceleration sensor and a touch sensor, and providing a corresponding feedback. is in

To achieve this object, an electronic device according to an embodiment of the present invention provides a plurality of pads each including a touch sensor and an acceleration sensor, a sound output unit for outputting a plurality of sounds set for each of the plurality of pads, and visual feedback. When a user touch is detected by the touch sensor in at least one of the plurality of pads and the intensity of the user's touch is detected by the acceleration sensor as being equal to or greater than a preset threshold, the at least one A processor for determining that a strike has been made to the pad, wherein the processor controls the sound output unit to output a sound of a type set to correspond to the pad in which the strike is sensed at a size corresponding to the strength of the strike, The display unit may be controlled to provide the visual feedback corresponding to the hit.

Here, the processor may detect the user's touch based on a change in the touch value corresponding to the touch sensor signal, and detect the intensity of the user's touch based on the acceleration value calculated from the acceleration sensor signal.

Also, the processor may determine that a strike has been made to a pad in which the touch value is ON and the acceleration value is equal to or greater than the preset threshold value among the plurality of pads.

Also, the processor may determine that a strike is not made to a pad in which the touch value is OFF or the acceleration value is less than the preset threshold value among the plurality of pads.

In addition, the plurality of pads includes a first pad and a second pad, and the processor is configured to be configured to be configured to be configured to be configured to be configured to be configured to be configured to be configured to be configured to perform the first touch value when a first touch value sensed through the first pad is ON and a first acceleration value is greater than or equal to the preset threshold value. It is determined that the first pad is hit, and the intensity of the user's touch is determined based on the first acceleration value, and the second touch value sensed through the second pad is OFF or the second acceleration value is the preset value. If it is less than the threshold, it may be determined that the second pad is not hit.

Also, the processor may compensate an offset due to gravitational acceleration with respect to the acceleration sensor signal, and calculate the acceleration value based on the offset-compensated acceleration sensor signal.

Here, the offset by the gravitational acceleration may be changed according to the inclination of the electronic device.

In addition, the processor, based on the intensity of the hit, may provide a different sound level and the visual feedback corresponding to the hit and the sound level set to correspond to the pad in which the hit is sensed.

In addition, the display unit includes an LED unit, and the processor turns on an LED corresponding to a pad in which a blow is sensed among the LED units, and adjusts at least one of the brightness and color of the LED according to the intensity of the hit. have.

Meanwhile, the electronic device according to an embodiment of the present invention further includes an input unit for receiving sound content from an external source, and the processor includes a sound set to correspond to the input sound content and the pad in which the strike is sensed. can be mixed and output.

Here, the processor may differently provide the visual feedback based on the input information about the sound content and the intensity of the blow.

In addition, the electronic device according to another embodiment of the present invention further includes an input unit for receiving sound content from an external source, wherein the processor includes, according to a user manipulation, the input sound content and the pad in which the strike is sensed. It may operate in one of a first mode for mixing and outputting a type of sound set to correspond to , and a second mode for outputting only the input sound content except for a type of sound set to correspond to the pad in which the hit is sensed.

Meanwhile, the method of controlling an electronic device according to an embodiment of the present invention includes a plurality of pads each including a touch sensor and an acceleration sensor, and a sound output unit for outputting a plurality of sounds set for each of the plurality of pads. A control method, comprising: detecting a user's touch by the touch sensor in at least one of the plurality of pads; detecting the intensity of the user's touch by the acceleration sensor; detecting the user's touch; When it is detected that the intensity of the user's touch is greater than or equal to a preset threshold, determining that the at least one pad has been struck and a sound of a type set to correspond to the pad in which the hit is sensed is applied to a size corresponding to the intensity of the hit It may include outputting to and providing a visual feedback corresponding to the hit.

Here, the detecting of the user's touch includes detecting the user's touch based on a change in a touch value corresponding to a touch sensor signal, and the detecting of the intensity of the user's touch includes an acceleration calculated from an acceleration sensor signal. The intensity of the user's touch may be sensed based on the value.

Here, in the determining, it may be determined that a strike is made to a pad in which the touch value is ON and the acceleration value is equal to or greater than the preset threshold value among the plurality of pads.

Also, in the determining, it may be determined that the touch value of the plurality of pads is OFF or the pad having the acceleration value less than the preset threshold value is not hit.

Here, the plurality of pads includes a first pad and a second pad, and the determining may include when a first touch value sensed through the first pad is ON and a first acceleration value is greater than or equal to the preset threshold. It is determined that the first pad is hit, and the intensity of the user's touch is determined based on the first acceleration value, and the second touch value sensed through the second pad is OFF or the second acceleration value is the If it is less than a preset threshold, it may be determined that the second pad is not hit.

Here, the sensing of the intensity of the user's touch may include compensating for an offset caused by gravitational acceleration with respect to the acceleration sensor signal, and calculating the acceleration value based on the offset-compensated acceleration sensor signal.

Also, the offset due to the gravitational acceleration may be changed according to the inclination of the electronic device.

In addition, in the providing step, based on the strength of the blow, a sound level of a type set to correspond to the pad in which the blow is sensed and the visual feedback corresponding to the blow may be differently determined and provided.

According to various embodiments of the present invention as described above, it is possible to distinguish whether an impact is applied to a part other than the pad through signal analysis of the acceleration sensor and the touch sensor provided in each pad, It is possible to make a distinction between

1 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present invention.
2A and 2B are diagrams illustrating a plurality of pad structures according to an embodiment of the present invention.
3 is a view showing a process of determining whether to hit according to an embodiment of the present invention.
4 is a diagram illustrating an acceleration sensor signal and a touch sensor signal according to an embodiment of the present invention.
5A and 5B are diagrams illustrating an offset by gravitational acceleration according to an embodiment of the present invention.
6A and 6B are diagrams illustrating a change in a touch value according to an embodiment of the present invention.
7 to 12 are diagrams illustrating the shape of an acceleration sensor and a touch sensor signal for each situation according to various embodiments of the present disclosure.
13 is a diagram illustrating a touch sensor signal and an acceleration sensor signal of each pad that are sensed when a strike is made through the first pad and the second pad according to an embodiment of the present invention.
14A and 14B are diagrams for explaining a visual feedback corresponding to a hit according to an embodiment of the present invention.
15 is a block diagram illustrating a configuration of an electronic device according to another embodiment of the present invention.
16 illustrates a function key for selecting a mode according to an embodiment of the present invention.
17 to 18 are diagrams illustrating examples of utilization of an electronic device according to an embodiment of the present invention.
19 is a diagram illustrating a multi-channel structure of a pad according to an embodiment of the present invention.
20 is a block diagram showing the configuration of a hit detection algorithm according to an embodiment of the present invention.
21 to 22 are flowcharts illustrating an operation process according to various embodiments of the present disclosure.
23 is a block diagram illustrating a specific configuration of the electronic device illustrated in FIG. 1 .
24 is a diagram of a software module stored in a storage unit according to an embodiment of the present invention.
25 is a flowchart illustrating a method of controlling an electronic device according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings. In the description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. And, the terms to be described later are terms defined in consideration of functions in the present invention, which may vary depending on the intention or relationship of a user or an operator. Therefore, the definition should be made based on the content throughout this specification.

1 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present invention.

Referring to FIG. 1 , the electronic device 100 includes a plurality of pads 110 , a sound output unit 120 , a display unit 130 , and a processor 140 .

The electronic device 100 used herein is an electronic device that detects a user touch according to a user manipulation, senses the intensity of the user's touch, and generates or outputs a sound corresponding to the sensed user's touch and touch intensity among general electronic devices. This means that the electronic device 100 may be implemented not only with percussion instruments such as electronic drums and electronic drum sticks, but also TVs, laptops, tablets, game consoles, mobile phones, smart watches, etc., but is not limited thereto.

In addition, functions performed by the processor 140 of the electronic device 100 of the present invention to be described later may be implemented in the form of a software module, and it is natural that the implemented software module may operate in various electronic devices.

Meanwhile, each of the plurality of pads 110 includes a touch sensor and an acceleration sensor. A touch sensor is a sensor that can input an instruction displayed on a screen when pressed with a fingertip. As a principle of such a touch sensor, there are a capacitance change type, an electrical conductivity change type (resistance change type), a light quantity change type, and the like. In addition, the acceleration sensor processes an output signal to measure a dynamic force such as acceleration, vibration, or impact of an object, and there are various types.

Specifically, the plurality of pads 110 may be implemented with the structure shown in FIGS. 2A and 2B . 2A and 2B are diagrams illustrating a plurality of pad structures according to an embodiment of the present invention.

Referring to FIG. 2A , each of the plurality of pads 110 may be implemented in a structure in which an acceleration sensor 220 and a touch sensor 230 are positioned under the pad 210 and the pad 210 to receive a user manipulation. . That is, the pad 210 may include a surface or plate that a user can tap. And, since the accelerometer 220 and the touch sensor 230 are positioned under the pad 210, when a user touch is made on the pad 210, whether the user touch can be detected by the touch sensor 230, The strength of the sensed user's touch may be measured by the acceleration sensor 220 .

Also, referring to FIG. 2B , each of the plurality of pads 110 may be implemented in a structure in which the touch pad 240 and the acceleration sensor 220 are located under the touch pad 240 . That is, unlike in FIG. 2A , the touch pad 240 of FIG. 2B may directly sense a user's touch. The touch pad 240 may be composed of several layers, such as a layer in which the finger is in direct contact, a layer in which horizontal/vertical electrodes are formed in a grid shape, and a connected circuit board layer. It is recorded so that it can be continuously grasped, the layer with electrodes is charged by a constant alternating current, and when a finger approaches the electrode grid, the current is cut off and the fact that the interruption is detected by the circuit board can detect user touch.

Meanwhile, the sound output unit 120 may output a plurality of sounds set for each of the plurality of pads 110 . Here, among the plurality of pads, the sound set to the first pad and the sound set to the second pad may be different or the same according to a user manipulation. For example, the sound set to the first pad may be set to a sound corresponding to a low-mid and low-pitched sound range, and the sound set to the second pad may be set to a sound corresponding to a high-pitched sound range.

In addition, the sound output unit 120 may output a sound set for each pad in response to a user touch sensed through the plurality of pads 110 .

The display unit 130 may provide visual feedback. Here, the display unit 130 may display letters, numbers, images, and the like, and may display images of a preset pattern in response to a user touch sensed through the plurality of pads 110 .

To this end, the display 110 may be implemented as a liquid crystal display (LCD), an organic light emitting diode (OLED), a plasma display panel (PDP), or the like.

In addition, the display unit 130 of the present invention is defined as including an LED provided in the electronic device 100 , and similarly, the LED may emit light in response to a user touch sensed through the plurality of pads 110 . . A detailed description thereof will be provided later.

When a user touch is sensed by a touch sensor in at least one of the plurality of pads 110 and the intensity of the user's touch is determined to be greater than or equal to a preset threshold by the acceleration sensor, the processor 140 may It can be judged that the damage has been done.

That is, the processor 140 sets a preset intensity of the user's touch measured by the acceleration sensor included in the first pad under the premise that the user's touch is sensed by the touch sensor included in the first pad among the plurality of pads 110 . It may be determined that the first pad has been hit only when the threshold is greater than or equal to the threshold value. Also, the processor 140 may perform the same determination process for the second pad, the third pad, etc. included in the plurality of pads 110 .

Accordingly, the processor 140 may determine whether at least one of the plurality of pads 110 is hit based on the combination of the acceleration sensor signal and the touch sensor signal, and the value obtained by processing the acceleration sensor signal is a preset threshold value. Above, when the touch value changes from Off to On in the corresponding section range, it can be determined that the corresponding pad has been hit. It will be described in detail with reference to FIG. 3 .

3 is a view showing a process of determining whether to hit according to an embodiment of the present invention.

Referring to FIG. 3 , the processor 140 may detect a user touch based on a change in a touch value corresponding to the touch sensor signal, and detect the intensity of the user's touch based on an acceleration value calculated from the acceleration sensor signal. .

Specifically, the processor 140 detects Z-axis data (ADC Data) from the acceleration sensor signal (310), and calculates the section average and section standard deviation for each preset section using the detected Z-axis data to calculate an offset. There is (320).

Basically, since the acceleration sensor outputs a value that reflects the effect of the gravitational acceleration, it is necessary to compensate for the effect of the gravitational acceleration with respect to the acceleration sensor signal. It is possible to determine a non-existent section, that is, a section in which a user's touch is not detected, calculate a section average and a section standard deviation for the corresponding section, and calculate an offset based on the calculated section average and section standard deviation.

Then, the processor 140 may compensate the offset by reflecting the calculated offset to the acceleration sensor signal ( 330 ). That is, if the offset calculated based on the calculated section average and section standard deviation is removed from the acceleration sensor signal, the processor 140 can obtain an offset, ie, an acceleration sensor signal excluding the effect of gravitational acceleration.

Then, the processor 140 may calculate an acceleration value by converting the offset-compensated acceleration sensor signal into an absolute value ( 340 ).

Then, the processor 140 may determine the maximum value for each section from the calculated acceleration value.

In addition, the processor 140 calculates an offset from the acceleration sensor signal, reflects the calculated offset to the acceleration sensor signal, converts it into an absolute value, calculates an acceleration value, and determines a maximum value based on the calculated acceleration value. During the operation, it is possible to detect a user's touch by checking whether the touch value corresponding to the touch sensor signal changes (360). Specifically, the processor 140 may detect the user's touch by checking whether a touch value corresponding to the touch sensor signal is changed from off to on.

Then, when the user's touch is sensed and the calculated acceleration value is greater than or equal to a preset threshold, the processor 140 may determine that the corresponding pad has been hit, and accordingly, the maximum value for each section is set to the corresponding volume level. It can be converted (370).

A process in which the processor 140 determines that a hit is made based on an acceleration sensor signal and a touch sensor signal will be described in detail with reference to a graph.

4 is a diagram illustrating an acceleration sensor signal and a touch sensor signal according to an embodiment of the present invention.

Referring to FIG. 4 , an acceleration sensor signal and a touch sensor signal sensed through an acceleration sensor and a touch sensor currently provided in one pad are illustrated.

Here, the x-axis of the graph section means time, and the y-axis means the signal strength.

Specifically, the touch sensor signal 410, the actual acceleration sensor signal 420, the actual acceleration sensor signal 430 in which the offset is reflected, the absolute value 440 and the sound level 450 of the actual acceleration sensor signal in which the offset is reflected are shown. has been

Here, since the touch sensor signal 410 has a constant value other than 0, the processor 140 may determine that the touch value is changed from off to on, and detect the user's touch.

In addition, the actual acceleration sensor signal 420 is a signal in which both the user's touch and the effect of the gravitational acceleration are reflected, and accordingly, the processor 140 calculates the actual acceleration sensor signal 420 for each preset section by section average and section standard deviation. It is possible to calculate an offset by gravity acceleration based on the section average and section standard deviation within the section by determining the section in which there is no movement.

In addition, the processor 140 may detect the actual acceleration sensor signal 430 to which the offset is reflected by removing the calculated offset from the actual acceleration sensor signal 420 . Thereafter, the processor 140 may convert the actual acceleration sensor signal 430 to which the offset is reflected into an absolute value, detect the absolute value 440 of the actual acceleration sensor signal to which the offset is reflected, and calculate the acceleration value.

In addition, the processor 140 may determine that a hit is made to a pad having a touch value of ON and an acceleration value equal to or greater than a preset threshold value among the plurality of pads. Referring to FIG. 4 , the processor 140 detects a user touch by determining that the touch value of the touch sensor signal 410 is changed from off to on, and the absolute value 440 of the actual acceleration sensor signal to which the offset is reflected, that is, , when it is determined that the acceleration value is equal to or greater than a preset threshold value, it may be determined that the corresponding pad has been hit.

Then, the processor 140 detects the maximum value of the acceleration value within the section in which the blow is determined, converts the detected maximum value into a sound level 450 corresponding thereto, and outputs it through the sound output unit 120 . can

Meanwhile, the processor 140 may determine that a strike is not performed on a pad having a touch value of OFF or an acceleration value less than a preset threshold value among the plurality of pads.

That is, in the section in which the touch sensor signal 410 is 0 instead of a constant constant value in FIG. 4 or in the section in which the touch sensor signal 410 has a constant constant value and an acceleration value is present, the acceleration value is less than a preset threshold in the corresponding pad. It can be judged that no damage has been done.

Meanwhile, the plurality of pads 110 includes a first pad and a second pad, and the processor 140 may determine whether a blow is made to each of the first pad and the second pad. Specifically, if the first touch value sensed through the first pad is ON and the first acceleration value is greater than or equal to a preset threshold, the processor 140 determines that a hit has been made to the first pad and based on the first acceleration value The intensity of the user's touch may be determined. Also, when the second touch value sensed through the second pad is OFF or the second acceleration value is less than a preset threshold, the processor 140 may determine that the second pad is not hit. The touch sensor signal and the acceleration sensor signal sensed through the first pad and the second pad, respectively, may be displayed as shown in FIG. 4 , and the processor 140 is based on the touch sensor signal and the acceleration sensor signal detected through the first pad. Thus, it is possible to determine whether a hit has been made to the first pad, and it can be determined whether a hit has been made to the second pad based on a touch sensor signal and an acceleration sensor signal sensed through the second pad. A detailed description thereof will be provided later.

Meanwhile, the processor 140 may compensate an offset due to gravitational acceleration with respect to the acceleration sensor signal, and may calculate an acceleration value based on the offset-compensated acceleration sensor signal. As described in advance, since the acceleration sensor outputs a value reflecting the influence of the gravitational acceleration, it is necessary to compensate for the influence of the gravitational acceleration. The offset may be calculated by determining the section average and the section standard deviation of the acceleration sensor signal in the non-existent section.

Here, the offset by the gravitational acceleration may be changed according to the inclination of the electronic device 100 . That is, the effect of the acceleration of gravity on the electronic device 100 may vary according to the inclination of the electronic device 100 . Specifically, it will be described with reference to FIGS. 5A and 5B.

5A and 5B are diagrams illustrating an offset by gravitational acceleration according to an embodiment of the present invention.

Referring to FIG. 5A , when the user taps one of the plurality of pads 110 of the electronic device 100 in a state in which the electronic device 100 is placed horizontally on the ground, it is detected by a touch sensor and an acceleration sensor. A touch sensor signal and an acceleration sensor signal are shown.

And, as described in advance, the processor 140 may calculate the offset by determining the section average and section standard deviation of the acceleration sensor signal in a section in which there is no movement, that is, a section in which a user touch is not detected. An offset 510 is shown.

For example, when the electronic device 100 is placed horizontally on the ground, the direction of gravitational acceleration is vertical to the plurality of pads 110 provided in the electronic device 100 . In addition, it outputs a value reflecting all the effects of the gravitational acceleration, and in this case, the effect of the gravitational acceleration means the effect of 9.8 m/s. That is, as a result of the electronic device 100 being placed horizontally with respect to the ground, the effect of the gravitational acceleration (9.8 m/s) directly affects the acceleration sensor.

As a result, the offset 510 shown in FIG. 5A means the effect of the gravitational acceleration (9.8 m/s), and its numerical value is also similar to the gravitational acceleration (9.8 m/s).

Meanwhile, referring to FIG. 5B , when the user taps one of the plurality of pads 110 of the electronic device 100 while the electronic device 100 is placed at an inclination angle with respect to the ground, the touch sensor and acceleration A touch sensor signal and an acceleration sensor signal sensed by the sensor are shown.

Similarly, the processor 140 may calculate the offset by determining the section average and the section standard deviation of the acceleration sensor in a section in which there is no movement, that is, a section in which a user touch is not detected. In FIG. 5B , the calculated offset 520 is is shown.

For example, in a state in which the electronic device 100 is placed at an inclination angle a with respect to the ground, the effect of the gravitational acceleration on the electronic device 100 is the gravitational acceleration*COS(a). Accordingly, the acceleration sensor outputs not only the value by the user's touch but also the value in which the gravitational acceleration*COS(a) is reflected. means to output

As a result, the offset 520 shown in FIG. 5B means the value of gravitational acceleration * COS(a), and since the COS(a) value cannot exceed 1, the offset 520 is a relatively small value compared to FIG. 5A . will have

Also, as the inclination angle increases, the effect of the gravitational acceleration on the acceleration sensor is reduced, and thus the value of the offset is also reduced. In addition, as it is placed closer to the ground in the horizontal direction, that is, as the inclination angle decreases, the effect of the gravitational acceleration on the acceleration sensor increases, so the value of the offset also increases.

In addition, the processor 140 may obtain an acceleration sensor signal in which the offset is compensated by removing the offsets 510 and 520 illustrated in FIGS. 5A and 5B from the actual acceleration sensor signal.

In addition, the processor 140 may perform the above-described process of calculating the offset at a starting stage in which the electronic device 100 is turned on and driven. That is, when the electronic device 100 is turned on according to a user manipulation, the processor 140 calculates a section average and a section standard deviation for the acceleration sensor signal obtained through the acceleration sensor according to the inclination of the electronic device 100 . offset can be calculated. That is, the processor 140 automatically calculates an offset in advance in an initial state in which the electronic device 100 is turned on, and when an acceleration sensor signal by a user touch detected thereafter is obtained in a state in which the offset is determined, the obtained acceleration sensor signal It is possible to reflect a predetermined offset for the.

Alternatively, when a command for performing a setting function or a normalization function is inputted by a user manipulation, the processor 140 calculates a section average and a section standard deviation for the acceleration sensor signal obtained through the acceleration sensor to the electronic device 100 . It is also possible to calculate an offset according to the slope of . That is, the processor 140 may manually calculate the offset when a command to perform a setting function or a normalization function is input according to a user manipulation.

Meanwhile, the processor 140 may detect a user's touch based on a change in a touch value corresponding to the touch sensor signal. Specifically, the processor 140 may determine that the user's touch is sensed with respect to at least one of the plurality of pads 110 only when the touch value changes from off to on. It will be described in detail with reference to FIGS. 6A and 6B.

6A and 6B are diagrams illustrating a change in a touch value according to an embodiment of the present invention.

Referring to FIG. 6A , a touch sensor signal 610 is shown, and it can be seen that the touch sensor signal 610 changes from 0 to approximately 30.

That is, the touch sensor signal 610 is changed from off (interval in which the touch value is 0) to on (interval having a constant value), and in this case, the processor 140 controls at least one of the plurality of pads 110 It may be determined that the user's touch is detected with respect to the pad of the .

In contrast, the processor 140 does not determine that at least one of the plurality of pads 110 has been hit when the touch value remains off or on for more than a predetermined time.

That is, the processor 140 determines that at least one of the plurality of pads 110 is not hit because, naturally, the user's touch is not sensed when the touch value remains off for a predetermined time or more.

In addition, maintaining the touch value on for more than a certain period of time means that the user stays still while touching at least one of the plurality of pads 110 , so the processor 140 determines that the touch value is turned on for more than a certain period of time. In the case of maintaining the state, even if the user's touch is sensed, it may be determined that the corresponding pad is not hit. That is, the processor 140 may determine that the user does not intend to hit when the touch value remains on for a predetermined time or longer.

Referring to FIG. 6B , a touch sensor signal 620 is shown, and it can be seen that the touch value of the touch sensor signal 620 continues to have a constant constant value from beginning to end. Such a touch sensor signal 620 means a case in which the touch value maintains an on state for a certain period of time or more, and in this case, the processor 140 assumes that the corresponding pad is not hit even if the user's touch is sensed. can judge

Meanwhile, FIGS. 7 to 12 are diagrams illustrating the shape of an acceleration sensor and a touch sensor signal for each situation according to various embodiments of the present disclosure.

[If the user has not hit the pad]

7 illustrates the shape of an acceleration sensor signal and a touch sensor signal when no impact is applied to the electronic device 100, for example, when no impact, shaking, or reverberation of the surrounding environment is applied.

That is, if the acceleration value of the acceleration sensor signal does not exceed the preset threshold value whether the user touches the first pad among the plurality of pads 110 , that is, if the acceleration sensor signal changes only below the preset threshold, the processor Reference numeral 140 may determine this change in the acceleration sensor signal as noise generated by the acceleration sensor itself.

Referring to FIG. 7 , a first graph 710 denotes a value from which an offset due to gravitational acceleration is removed from a Z-axis signal of the acceleration sensor, and a second graph 720 denotes a section standard deviation of the Z-axis signal of the acceleration sensor. means

For example, when the size of the first graph 710 is 0.2 or less in a state in which the amount of impact is not detected by the acceleration sensor, the processor 140 determines that this is noise generated by the acceleration sensor itself, and the first pad is hit. It can be judged that this has not been done. Of course, the reference value for determining the noise may be a value other than 0.2, which may be smaller or larger depending on the precision of the acceleration sensor.

As a result, even if the touch value of the touch sensor signal is changed from off to on and the processor 140 detects the user's touch, if the acceleration value of the acceleration sensor signal is smaller than the reference value determined as noise, the processor 140 judges this acceleration value as noise generated by the acceleration sensor itself, and determines that the pad is not hit.

[If the user hits the pad]

When the user hits any one pad, since the acceleration value of the acceleration sensor signal and the touch value of the touch sensor signal change, the processor 140 analyzes the combination of the acceleration value and the touch value to determine which pad was hit, In addition, it is possible to determine how much intensity the blow was made.

Referring to FIG. 8 , the first graph 810 means the Z-axis signal of the acceleration sensor, the second graph 820 means the standard deviation of the section, and the third graph 830 means the touch sensor signal. .

As previously described in FIG. 4, the first graph 810 shown in FIG. 8 may correspond to the actual acceleration sensor signal 430 to which the offset shown in FIG. 4 is reflected, and the third graph shown in FIG. 830 may correspond to the touch sensor signal 410 illustrated in FIG. 4 .

That is, since the third graph 830 is changing from off to on, the processor 140 may detect that a user touches the corresponding pad, and the acceleration value of the first graph 810 is equal to or greater than a preset threshold. If it is detected that the pad is hit, it can be determined that a hit has been made.

Also, the processor 140 may determine the intensity of the user's touch, that is, the hitting intensity, based on the acceleration value of the first graph 810 .

A detailed process for the processor 140 to determine whether a blow has been made to the pad has been previously described with reference to FIG. 4 , and a detailed description thereof will be omitted.

[If the user hits the pad continuously]

9 illustrates an acceleration sensor signal and a touch sensor signal when a user continuously strikes a pad.

Here, the first graph 910 means a touch sensor signal, and the second graph 920 means an acceleration sensor signal. Specifically, the second graph 920 shown in FIG. 9 means an acceleration sensor signal in a state in which an offset due to gravitational acceleration is not removed.

When the user continuously strikes the pad, a section in which the user's touch on the corresponding pad is changed from off to on as shown in the first graph 910 shown in FIG. 9 appears continuously, and accordingly, the processor 140 ) continuously determines whether the user's touch is detected or not.

In addition, the second graph 920 shows that the acceleration value above the preset threshold is continuously displayed, and accordingly, the processor 140 repeatedly repeats the case where the acceleration value is greater than or equal to the preset threshold in the section where the user's touch is sensed. It is possible to determine that the blow to the corresponding pad is continuously being made through the sensed as .

That is, in FIG. 9 , the section in which the user touch is sensed and the section in which the acceleration sensor is equal to or greater than a preset threshold are repeatedly displayed and thus, the processor 140 can determine that continuous hitting is being made to the corresponding pad. , if the section in which the user touch is sensed and the section in which the acceleration sensor is equal to or greater than a preset threshold repeatedly appear without matching with each other, the processor 140 determines that continuous hitting is not made to the corresponding pad.

[In case of hitting or shaking any part other than the pad]

Since the plurality of pads 110 are attached to the electronic device 100 , an impact on the electronic device 100 may be transmitted to an acceleration sensor provided in the plurality of pads. In particular, when the user hits a part other than the pad, the acceleration sensor may output an acceleration sensor signal reflecting the impact on the other part, but in this case, the processor 140 controls the corresponding pad based on the touch value of the touch sensor signal. It can be determined whether it is an acceleration sensor signal generated by tapping. Here, a portion other than the pad may include another pad.

For example, the plurality of pads 110 may include a first pad and a second pad, and when the user taps a second pad other than the first pad, the processor 140 may be provided on the first pad. The acceleration sensor signal output from the first acceleration sensor may be sensed, but the acceleration sensor signal output from the first acceleration sensor is a signal in which an impact caused by tapping the second pad is reflected. At this time, if the touch value of the touch sensor signal is off based on the touch sensor signal output from the first touch sensor provided in the first pad, the processor 140 outputs the current acceleration sensor signal due to tapping on the first pad. It may be determined that the effect of the tapping on the second pad is not reflected.

That is, even if the processor 140 detects the acceleration sensor signal output from the first acceleration sensor provided in the first pad, the touch sensor signal output from the first touch sensor provided in the first pad is in an off state or preset. When the time-on state is maintained, it may be determined that the strike is not made to the first pad but to a pad other than the first pad or to another area of the electronic device 100 . Accordingly, when the processor 140 detects the acceleration sensor signal output from the first acceleration sensor provided in the first pad, and the touch sensor signal output from the first touch sensor provided in the first pad is changed from off to on , it can be determined that the first pad is hit.

Accordingly, the processor 140 may determine exactly which pad is being hit through the combination of the touch sensor signal and the acceleration sensor signal.

Referring to FIG. 10 , a first graph 1010 means a Z-axis signal of an acceleration sensor, a second graph 1020 means a standard deviation of an interval, and a third graph 1030 means a touch sensor signal.

That is, when a blow or shaking occurs in a part other than the corresponding pad, the Z-axis signal of the acceleration sensor as in the first graph 1010 reflects the hitting or shaking occurring in another part, but the third graph 1030 It can be seen that the touch value of is 0.

Accordingly, although the processor 140 indicates that the acceleration value of the first graph 1010 reflects the impact, since the touch value of the third graph 1030 is 0, even the user's touch is not made on the corresponding pad. It can be determined that the pad is not hit, by determining that the pad has not been hit.

Through the above-described determination process, the processor 140 can determine exactly which pad was hit even if the plurality of pads 110 include the first pad, the second pad, and the third pad, and each It may be determined whether the acceleration value of the acceleration sensor signal corresponding to the pad reflects a blow made to each pad or a blow made to another pad.

Meanwhile, FIGS. 11 to 12 show an acceleration sensor signal and a hitting sensor of the first pad detected by the processor 140 when the user taps the second pad among the first and second pads of the plurality of pads 110 . signal is shown.

11 , as described in FIG. 10 , a first graph 1110 indicates a touch sensor signal, a second graph 1120 indicates an acceleration sensor signal, and a second graph 1120 indicates a second pad. The value reflects the influence of the user's tapping. In addition, the first graph 1110 indicates that the touch value due to the user's touch does not change because the user does not tap the first pad.

Accordingly, although the second graph 1120 shows a value corresponding to the tapping, the processor 140 determines the first graph 1110 based on that the touch value does not change at all and maintains a value of 0. It may be determined that the hitting is not made to the pad but is being hit to the second pad.

Meanwhile, referring to FIG. 12 , a first graph 1210 indicates a touch sensor signal, a second graph 1220 indicates an acceleration sensor signal, and the first graph 1210 indicates that the touch value is a constant constant value. It indicates that you have the touch value, indicating that the touch value is on. Also, the second graph 1220 represents an acceleration value in which a user's tapping is reflected.

Here, the touch value of the first graph 1210 does not change from off to on, but continuously maintains an on state, so that the processor 140 strikes the first pad even if the user's touch is sensed. It can be judged that it is not supported. That is, as described with reference to FIG. 6B , maintaining the on state of the touch value for a certain period of time means that the user is still while keeping his or her hand in contact with the first pad. In the case of maintaining , even if the user's touch is sensed, it may be determined that the first pad is not hit.

Accordingly, the processor 140 determines that the user's touch is sensed on the first pad, but no hitting is made, so that the acceleration value reflecting the tapping of the second graph 1220 is due to the hitting on the second pad. be able to

Accordingly, the processor 140 may determine that the first pad is not hit and that the second pad is hit.

Meanwhile, FIG. 13 is a diagram illustrating a touch sensor signal and an acceleration sensor signal of each pad that are sensed when a strike is made through the first pad and the second pad according to an embodiment of the present invention.

Referring to FIG. 13 , a first graph 1310 , a second graph 1330 , a third graph 1350 , and a fourth graph 1370 are acceleration sensor data for the first pad, and a fifth graph 1320 . , the sixth graph 1340 , the seventh graph 1360 , and the eighth graph 1380 are acceleration sensor data for the second pad.

Specifically, the first graph 1310 means an actual acceleration sensor signal of the first pad, the second graph 1330 means an acceleration sensor signal for which the offset of the first pad is compensated, and the third graph 1350 . denotes the absolute value of the acceleration sensor signal for which the offset of the first pad is compensated, and the fourth graph 1370 denotes the interval standard deviation of the actual acceleration sensor of the first pad.

In addition, the fifth graph 1320 means an actual acceleration sensor signal of the second pad, the sixth graph 1340 means an acceleration sensor signal for which the offset of the second pad is compensated, and the seventh graph 1360 is The offset of the second pad means the absolute value of the compensated acceleration sensor signal, and the eighth graph 1380 means the interval standard deviation of the actual acceleration sensor of the second pad.

And, the ninth graph 1390 means a touch sensor signal. Currently, in FIG. 13 , the ninth graph 1390 simultaneously shows the touch sensor signals for the first pad and the second pad, but the touch sensor signals for the first and second pads may be displayed differently. Of course.

Meanwhile, since the touch sensor signal of the ninth graph 1390 has a constant value other than 0, the processor 140 determines that the touch value is changed from off to on, and for the first pad and the second pad, It can detect user touch.

In addition, the first graph 1310 and the fifth graph 1320 are signals in which both the user touch and the effect of the gravitational acceleration are reflected, and accordingly, the processor 140 generates the first graph 1310 and the fifth graph 1320 can calculate the section average and section standard deviation for each preset section, determine the section in which there is no movement, and calculate the offset due to gravitational acceleration based on the section average and section standard deviation within the section.

Here, the fourth graph 1370 and the eighth graph 1380 represent interval deviations for the first graph 1310 and the fifth graph 1320 , respectively.

Accordingly, the processor 140 may calculate the offset due to the gravitational acceleration based on each section deviation of the fourth graph 1370 and the eighth graph 1380 , respectively.

In addition, the processor 140 may compensate the calculated offset by the gravitational acceleration to the first graph 1310 and the fifth graph 1320 , respectively.

That is, the processor 140 may detect the second graph 1330 and the sixth graph 1340 by compensating the offset to the first graph 1310 and the fifth graph 1320 . In addition, the processor 140 may convert the second graph 1330 and the sixth graph 1340 into absolute values to convert them into the third graph 1350 and the seventh graph 1360 , and the converted third graph An acceleration value may be calculated from 1350 and the seventh graph 1360 .

On the other hand, the processor 140 detects the user's touch based on the change in the touch value of the first pad from off to on, and when the acceleration value is greater than or equal to a preset threshold, it is determined that the first pad is hit. can

In addition, the processor 140 detects the user's touch based on the change in the touch value of the second pad from off to on, and when the acceleration value is greater than or equal to a preset threshold, it is determined that the second pad is hit. can

As such, the processor 140 determines whether a blow is made to each of the first and second pads based on a plurality of acceleration sensor signals and touch sensor signals simultaneously input through the first and second pads can be judged

On the other hand, the processor 140 controls the sound output unit 120 to output a type of sound set to correspond to the pad in which the hitting is sensed with a size corresponding to the intensity of the hit, and displays the display to provide a visual feedback corresponding to the hit. The unit 130 may be controlled.

Specifically, when a hit is sensed, the processor 140 may detect the intensity of the user's touch based on the acceleration value, and may convert the detected intensity of the user's touch back to a sound volume level.

In particular, different sounds may be set for each of the plurality of pads 110 . For example, a low-mid beat sound may be set to a first pad among the plurality of pads 110 , and a high-pitched beat sound may be set to a second pad. And, when a hit is sensed against the first pad, the processor 140 may detect the intensity of the user's touch based on the acceleration value, and the detected intensity of the user's touch is converted back to a beat sound volume level of mid-bass, The mid-bass beat sound of the converted volume level may be output through the sound output unit 120 .

In addition, when a hit is sensed against the second pad, the processor 140 may detect the intensity of the user's touch based on the acceleration value, and the detected intensity of the user's touch is converted back into a high-pitched beat sound volume level, The high-pitched beat sound of the converted volume level may be output through the sound output unit 120 .

In particular, when a blow is sensed to the first pad and the second pad at the same time, the processor 140 calculates the intensity of the first user touch and the intensity of the second user touch based on the respective acceleration values of the first pad and the second pad. may be detected, and each of the detected intensity of the first user touch and the intensity of the second user's touch may be converted back to a beat sound volume level of a mid-bass tone and a beat sound volume level of a high pitch. In addition, the processor 140 may output the low-mid beat sound and the high-pitched beat sound of the converted volume level through the sound output unit 120, respectively, or by mixing the mid-bass beat sound and the high-pitched beat sound of the converted volume level It may be output through the sound output unit 120 .

On the other hand, when a blow is sensed to the first pad and the second pad at the same time, various embodiments may exist.

For example, as described above, when a strike is simultaneously sensed with respect to the first pad and the second pad, the processor 140 detects the first user touch based on the respective acceleration values of the first pad and the second pad. The sound set to each of the first pad and the second pad may be independently output through the sound output unit 120 based on the intensity of , and the intensity of the second user's touch, or may be output by mixing. Here, independently outputting the sound set in each of the first pad and the second pad means that the sound set in the first pad and the sound set in the second pad are separately output through different channels according to a plurality of speakers, and , means that the sound set in each of the first pad and the second pad is mixed and output is output by the processor 140 synthesizing the sound set in the first pad and the sound set in the second pad and transmitting it to the speaker through one channel. means to do

In addition, when a blow is sensed to the first pad and the second pad at the same time, the processor 140 prioritizes the sound set in each of the first pad and the second pad, and selectively applies each of the first pad and the second pad. You can also output one of the set sounds.

For example, when a sound set in the first pad is set to be output in preference to a sound set in the second pad according to a user manipulation, the processor 140 may detect a hit to the first pad and the second pad at the same time , only the sound set in the first pad may be output through the sound output unit 120 .

Alternatively, when the processor 140 detects a blow to the first pad and the second pad at the same time, which is not set to output any sound among the sounds set to each of the first pad and the second pad according to a user manipulation, the first pad and comparing the intensity of the first user's touch and the intensity of the second user's touch sensed based on the acceleration value of each of the second pads with each other, and outputting a sound set to a pad having a relatively greater intensity of the touch.

For example, when a blow is sensed to the first pad and the second pad at the same time, the processor 140 compares the intensity of the first user's touch and the intensity of the second user's touch sensed for the first pad and the second pad to each other. As a result of the comparison, if it is determined that the intensity of the first user's touch is greater than the intensity of the second user's touch, only the sound set in the first pad may be output through the sound output unit 120 .

Alternatively, when a strike is sensed to the first pad and the second pad at the same time, the processor 140 applies the sound set to the first pad and the second pad based on the intensity of the first user's touch and the intensity of the second user's touch. You can also mix and output by adjusting the ratio of the set sound.

On the other hand, in determining whether a blow is sensed to the first pad and the second pad at the same time, the processor 140, in theory, when a blow is sensed to the first pad and the second pad at the same time, of course, the first It may be determined that the strike is sensed to the pad and the second pad at the same time, but even when the strike is sequentially sensed to the first pad and the second pad within a preset time, the first pad and the second pad are simultaneously struck It can be judged that this is detected.

That is, in reality, since it is difficult to occur that strikes to the first pad and the second pad are simultaneously sensed at the same time period, the processor 140 sequentially strikes the first pad and the second pad within a preset time. Even in the case of sensing, it may be determined that a blow is simultaneously sensed to the first pad and the second pad.

Meanwhile, the processor 140 may provide a visual feedback corresponding to the blow, and may determine and provide different visual feedback corresponding to the blow based on the strength of the blow.

That is, the processor 140 may provide a visual feedback indicating that the hit has been made. Specifically, the display unit 130 may include an LED unit, and the processor 140 turns on an LED corresponding to a pad in which a hit is detected among the LED units, and at least one of the brightness and color of the LED according to the intensity of the hit. You can adjust one.

14A and 14B are diagrams for explaining a visual feedback corresponding to a hit according to an embodiment of the present invention.

Referring to FIG. 14A , when the electronic device 100 is provided with two pads, when the user hits the left pad, the processor 140 may control the LED 1410 around the left pad to emit light.

Similarly, when the user hits the right pad, the processor 140 may control the LED 1420 around the right pad to emit light.

That is, the processor 140 may turn on an LED corresponding to the hitting pad to indicate whether the hitting has been made and which pad the hitting has been made.

In addition, the processor 140 may adjust at least one of a brightness, a color, and a light emission pattern of the LED 1410 around the left pad according to the intensity of the blow. For example, the processor 140 adjusts the brightness of the LED 1410 around the left pad in response to the intensity of the blow to increase the brightness of the LED 1410 around the left pad as the intensity of the blow increases, and As the intensity decreases, the brightness of the LED 1410 around the left pad may be decreased.

In addition, the processor 140 may change the color of the LED 1410 around the left pad according to the intensity of the blow, and accordingly, as the intensity of the hit increases, the color of the LED 1410 changes to a red color, and the hit As the intensity of the LED 1410 decreases, the color of the LED 1410 may be changed to a green color.

In addition, the processor 140 may adjust the light emission pattern of the LED 1410 around the left pad according to the intensity of the blow. Accordingly, as the intensity of the blow increases, the light emission pattern period of the LED 1410 is shortened for the same time. It is controlled so that more light can be emitted in a relatively large amount, and as the intensity of the blow becomes weaker, the light emission pattern period of the LED 1410 is lengthened so that it can be controlled to emit light relatively less within the same time.

Of course, the above-described example may be equally applied to the right pad.

Referring to FIG. 14B , the display unit 130 includes LEDs 1410 and 1420 around a plurality of pads, as well as a window 1450 for displaying a screen and LEDs 1430 provided in an area of the electronic device 100 , 1440) may also be included.

For example, when the user hits the left pad, the processor 140 adjusts at least one of the brightness, color, and emission pattern of the LED 1410 around the left pad and the LED 1430 corresponding to the direction in which the left pad is located. can

In addition, when the user hits the right pad, the processor 140 may adjust at least one of the brightness, color, and light emission pattern of the LED 1420 around the right pad and the LED 1440 corresponding to the direction in which the right pad is located. .

In addition, the window 1450 for displaying the screen may perform an equalizer function by displaying an image of a preset pattern in response to whether or not a strike is made on the left pad and the right pad and the intensity of the strike.

On the other hand, the processor 140 irrespective of whether the first pad is hit or the second pad is hit, as long as the hit is sensed, the LEDs 1410 and 1420 around the plurality of pads as well as a window displaying a screen All of the LEDs 1430 and 1440 provided in the area 1450 and the electronic device 100 may be turned on.

In addition, as described above, when a blow is sensed to the first pad and the second pad at the same time, the processor 140 displays a window 1450 for displaying a screen as well as the LEDs 1410 and 1420 around the plurality of pads. and LEDs 1430 and 1440 provided in one region of the electronic device 100 may be individually controlled to turn on, but may be simultaneously controlled and turned on collectively.

Meanwhile, although FIG. 14B illustrates that the electronic device 100 includes two pads, the electronic device 100 may include two or more pads, and the structure, shape, number of pads, and LEDs of the electronic device The arrangement structure and the like may be implemented in various forms unless limited to the drawings shown in FIG. 14B .

Meanwhile, FIG. 15 is a block diagram illustrating the configuration of an electronic device according to another embodiment of the present invention.

Referring to FIG. 15 , the electronic device 100 may further include an input unit 150 in addition to the plurality of pads 110 , the sound output unit 120 , the display unit 130 , and the processor 140 .

The input unit 150 may receive sound content from an external source. In addition, the processor 140 may mix and output the input sound content and a sound of a type set to correspond to the pad in which the hit is sensed.

Specifically, the external source may include any device capable of storing or playing sound content such as an external storage medium such as USB, CD player, audio, notebook computer, PDA, TV, and a server connectable through wireless communication or wired communication. , a website, and the like.

The processor 140 may reproduce sound content input from an external source and output it through the sound output unit 120 . In this case, the processor 140 may provide different visual feedbacks based on the inputted information on the acoustic content.

For example, the information on the acoustic content may include metadata about the acoustic frequency, the tempo, etc. of the acoustic content, and the processor 140 reproduces the acoustic content based on the metadata on the acoustic frequency, the beat, and the like of the acoustic content. Accordingly, at least one of the color, brightness, and emission pattern of the LEDs 1410 and 1420 around the pad shown in FIG. 14B and the LEDs 1430 and 1440 provided in one area of the electronic device 100 may be adjusted.

Specifically, when the sound frequency of the sound content is a high band and the beat is a fast beat, the processor 140 is provided in one area of the LEDs 1410 and 1420 around the pad shown in FIG. 14B and the electronic device 100 . The color of the LEDs 1430 and 1440 may be changed to a red color, the brightness may be increased, and the cycle of the emission pattern may be adjusted to be shorter.

In addition, when the sound frequency of the sound content is a low band and the beat is a slow beat, the processor 140 includes the LEDs 1410 and 1420 around the pad shown in FIG. 14B and the LEDs provided in an area of the electronic device 100 . The color of (1430, 1440) may be changed to a green color, the brightness may be decreased, and the period of the emission pattern may be lengthened.

That is, the processor 140 reproduces the sound content based on the metadata about the input sound content regardless of whether the plurality of pads 110 are hit, and the color of the LED based on the sound frequency and beat of the sound content, At least one of brightness and light emission pattern may be adjusted.

Also, the processor 140 may display acoustic content related information through the window 1450 that displays the screen based on the input metadata related to the acoustic content. Here, the sound content related information may include sound content track information, a number of a music file currently being played, information about a previous music file and a next music file, a music file name, and various information about a composer.

On the other hand, the processor 140 may mix and output the input sound content and a sound of a type set to correspond to the pad in which the strike is sensed, and when mixing and outputting, based on the information about the input sound content and the intensity of the strike Thus, different visual feedbacks may be provided.

For example, while the sound content is being reproduced, the LEDs 1410 and 1420 around the pad shown in FIG. 14B and the LEDs 1430 and 1440 provided in one area of the electronic device 100 corresponding to the sound content color; When the user strikes at least one of the plurality of pads 110 in a situation in which at least one of the brightness and the light emission pattern is changed, the processor 140 takes into consideration both the metadata regarding the input sound content and the intensity of the hitting. At least one of the color brightness and light emission pattern of the LEDs 1410 and 1420 around the pad shown in 14b and the LEDs 1430 and 1440 provided in one area of the electronic device 100 may be adjusted.

That is, the color of the LEDs 1410 and 1420 around the pad shown in FIG. 14B and the LEDs 1430 and 1440 provided in an area of the electronic device 100 in correspondence to the reproduced sound content is green, and the brightness is When the user strikes at least one of the plurality of pads 110 in the reduced state, the processor 140 responds to the intensity of the hit by the LEDs 1410 and 1420 and the electronic device 100 around the pad shown in FIG. 14B . ), the color of the LEDs 1430 and 1440 provided in one area may be changed to a red color, and brightness may be increased.

Alternatively, in a state in which the light emission pattern period of the LEDs 1410 and 1420 around the pad shown in FIG. 14B and the LEDs 1430 and 1440 provided in one area of the electronic device 100 is short in response to the reproduced sound content, the user When the stylus strikes at least one of the plurality of pads 110 in rapid succession, the processor 140 displays the LEDs 1410 and 1420 around the pads shown in FIG. 14B and the LEDs provided in one area of the electronic device 100 . The period of the emission pattern of (1430, 1440) may be shortened.

In this way, when the user strikes at least one of the plurality of pads 110 while playing the sound content, the processor 140 provides different visual feedback based on the information about the sound content and the intensity of the strike. can provide

On the other hand, the processor 140 according to a user manipulation, the first mode for mixing and outputting the input sound content and the sound set to correspond to the type of sound set to correspond to the hitting pad, and the sound of the type set to correspond to the hitting pad It may operate in one of the second modes for outputting only the input sound content except for .

For example, when the user wants to use the electronic device 100 for the purpose of only reproducing sound content, when a function key for operating the second mode is pressed, the processor 140 outputs only the input sound content, and a plurality of Even if the user's hitting on the pad 110 is sensed, a sound corresponding to the user's hitting may not be output.

In addition, if the user wants to use the electronic device 100 for mixing and outputting a sound set to correspond to a pad in which a blow is sensed while playing sound content, press a function key for operating the first mode. The processor 140 may mix and output the sound content and the sound set to correspond to the pad in which the hit is sensed, based on the information about the sound content, whether a strike has occurred, and the intensity of the strike.

16 illustrates a function key for selecting a mode according to an embodiment of the present invention.

Referring to FIG. 16 , a first key 1610 , a second key 1620 , and a third key 1630 are illustrated. For example, a function for determining whether to operate in the first mode or the second mode is mapped to the first key 1610 . When the user presses the first key 1610, the processor 140 may operate in the first mode, and when the user presses the first key 1610 again, the processor 140 may operate in the second mode.

In addition, a function for changing a plurality of sounds set for each of the plurality of pads 110 is mapped to the second key 1620 and the third key 1630 . Accordingly, when the user selects one of the second key 1620 and the third key 1630 , the processor 140 may selectively change a plurality of sounds set for each of the plurality of pads 110 .

For example, when the second key 1620 is continuously pressed, the sound is changed in the order of drum sound, drum sound, and cymbal sound. It can be changed in the order of sound.

Meanwhile, FIGS. 17 to 18 are diagrams illustrating examples of utilization of an electronic device according to an embodiment of the present invention.

Referring to FIG. 17 , a first speaker 1710 may be disposed at a lower end of the electronic device 100 . Here, the electronic device 100 may output sound with the first speaker 1710 through a wireless communication method or a wired communication method.

Accordingly, the user may operate the electronic device 100 in a standing state by placing the electronic device 100 on the first speaker 1710 .

Also, the electronic device 100 may output sound by performing wireless communication with the plurality of network speakers 1720 and 1730 .

Specifically, the electronic device 100 may include a communication unit (not shown), and the communication unit (not shown) may perform pairing with a plurality of network speakers 1720 and 1730 to connect a communication session, and may include sound content or A sound of a type set to correspond to the pad in which the hit is sensed may be transmitted to the plurality of network speakers 1720 and 1730 to be output.

Accordingly, the processor 140 sets the type of sound set to correspond to the sound content or the pad in which the hit is sensed through the first speaker 1710 and the plurality of network speakers 1720 and 1730 disposed at the bottom of the electronic device 100 . can be output in surround sound.

Also, the electronic device 100 may perform various functions by performing communication with other external devices.

Referring to FIG. 18 , the electronic device 100 communicates with the projector device 200 to project acoustic content or an image corresponding to a type of sound set to correspond to a pad in which a blow is sensed to be projected. ) can be controlled.

Specifically, the processor 140 communicates with the projector device 200 and communicates with the projector device 200 rather than merely providing visual feedback through the window displaying the LED unit and the screen provided in the electronic device 100 . Functions can also provide visual feedback.

In particular, the processor 140 may control the projector apparatus 200 to perform a visualizer function in which an image is changed in response to information about the sound content and the intensity of a blow. The visualizer technology visualizes the size of particles, the distance between the particles, the geometric pattern, and a preset image in response to the acoustic frequency, and the technology is known, so a detailed description thereof will be omitted.

Meanwhile, although the case where the external device is a projector device is exemplified in FIG. 18 , the external device is not limited to the projector device and may include various electronic devices.

For example, the external device may be implemented as a display device such as a TV, and the processor 140 outputs, through the sound output unit 120, a sound set to correspond to the sound content and the pad in which the hit is sensed, A control signal for generating or changing an image may be transmitted to the TV in response to information about the sound content and the intensity of the blow. Accordingly, the TV may perform a visualizer function of displaying an image in response to the sound content output from the electronic device 100 and the sound set to correspond to the pad in which the hit is sensed based on the received control signal. .

Also, although not shown in the drawings, a remote control device (not shown) for controlling the electronic device 100 may exist. Such a remote control device (not shown) may be stored while being attached to the outside of the electronic device 100, and in some cases, a user may operate the remote control device (not shown) while carrying the remote control device (not shown). to control the electronic device 100 .

Specifically, the remote control device (not shown) has a function for turning on and off the electronic device 100 , a mute function, a function for controlling by connecting an external input (TV, USB, CD, TUNER, AUX, etc.), sound Functions related to content playback (PALY, PUESE, REPEAT, STOP, etc.), volume control function, file search function, timer on/off function, display function, user custom function, sound It includes a plurality of function keys to which a function of determining whether to mix and output (a function of selecting one of the above-described first and second modes) is mapped. Of course, when the remote control device (not shown) includes a touch screen, the above-described functions may be matched to each object such as a menu or icon displayed on the user interface screen.

On the other hand, the pad touched by the user is composed of one channel, so even if the user touches any area of the pad, the processor 140 outputs the sound set on the pad according to the intensity of the user's touch regardless of the position of the area constituting the pad. can do.

However, since the pad is divided into a plurality of regions, each region may include a user touch and a multi-channel capable of sensing the intensity of the user's touch.

19 is a diagram illustrating a multi-channel structure of a pad according to an embodiment of the present invention.

Referring to FIG. 19 , the pad may be divided into a total of eight regions 1910 , 1920 , 1930 , 1940 , 1950 , 1960 , 1970 and 1980 . In addition, the processor 140 may individually detect the user's touch and the intensity of the user's touch for each of the eight divided regions 1910, 1920, 1930, 1940, 1950, 1960, 1970, and 1980. Even if the pad is divided into a plurality of regions, the processor 140 calculates the offset by gravity acceleration for each region as described above, reflects the calculated offset to the acceleration sensor signal obtained for each region, and takes absolute values to calculate A sound may be output by determining a sound volume level for each region based on the obtained acceleration value.

In particular, when the pad is divided into a plurality of areas, the user may perform an operation of dragging while maintaining the user's touch on some of the plurality of areas (herein, referred to as a scratching operation), and the processor ( 140) may be regarded as a plurality of user touches input through different regions even though it is a single user touch, and a corresponding function may be performed.

For example, referring to FIG. 19 , the user starts a touch in the first area 1910 and drags it to the second area 1920 , the third area 1930 , and the fourth area 1940 while maintaining the touch. When performing the scratching operation, the processor 140 performs the scratching operation in the first user touch detected in the first area 1910 , the second user touch detected in the second area 1920 , and the third area 1930 . The sensed third user touch and the fourth user touch detected in the fourth area 1940 can be divided and determined. can judge

And, when it is determined that the scratching operation is input, the processor 140 may output a sound corresponding to the scratching operation. For example, the processor 140 may output a high-pitched staccato-tempo sound for a time corresponding to the scratching operation.

Meanwhile, as shown in FIG. 19 , the user may change the direction of the scratching operation a plurality of times without performing the scratching operation in only one direction.

For example, the user may start a touch in the first area 1910 and drag to the second area 1920 while maintaining the touch, then change the direction again and perform a scratching operation of dragging to the first area, In this case, the processor 140 performs the scratching operation on the first user touch detected in the first area 1910 , the second user touch detected in the second area 1920 , and the first user touch detected in the first area 1910 again. It can be judged by the user's touch.

In addition, the processor 140 corresponds to a sound corresponding to a scratching operation of dragging from the first area 1910 to the second area 1920 and a scratching operation of dragging from the second area 1920 to the first area 1910 . It is also possible to output the sound by changing it differently.

Accordingly, the user may perform an operation for displaying more various musical effects on the pad divided into a plurality of regions.

Meanwhile, FIG. 20 is a block diagram showing the configuration of a hit detection algorithm according to an embodiment of the present invention.

Referring to FIG. 20 , the processor 140 largely performs a sensor initialization operation 2010 , a sensor measurement operation 2020 , a pre-processing operation 2030 , an offset correction operation 2040 , a maximum value detection and a sound level conversion operation 2050 . ) and an event generation operation 2060 may be performed.

Specifically, the processor 140 may initialize by setting pre-input signals to each of the acceleration sensor and the touch sensor to 0 while performing the sensor initialization operation 2010 .

In addition, the processor 140 may acquire an acceleration sensor signal and a hitting sensor signal while performing the sensor measurement operation 2020 . For example, the processor 140 may acquire a touch sensor signal corresponding to the user's touch on the first pad among the plurality of pads 110 and an acceleration sensor signal corresponding to the intensity of the user's touch.

Similarly, the processor 140 may obtain a touch sensor signal corresponding to the user's touch and an acceleration sensor signal corresponding to the intensity of the user's touch with respect to the second pad among the plurality of pads 110 . As such, the processor 140 ) may acquire an acceleration sensor signal and a hitting sensor signal input for each of the plurality of pads 110 .

In addition, here, the input acceleration sensor signal and the hitting sensor signal represent values in which the offset caused by the gravitational acceleration is not removed.

In addition, the processor 140 may perform a pre-processing operation 2030 . Specifically, the processor 140 may convert an acceleration sensor signal and a touch sensor signal, which are digital signals, into an analog signal, and calculate an average and interval standard deviation of the acceleration sensor signal to calculate an offset by gravitational acceleration; processing operations may be performed.

Here, the offset may be an offset according to the inclination of the electronic device 100 or may be an offset to be applied to the Z-axis data of the acceleration sensor signal.

Thereafter, the processor 140 may perform offset compensation by reflecting the calculated offset to the acceleration sensor signal.

Then, the processor 140 may take an absolute value with respect to the offset-compensated acceleration sensor signal, and detect a maximum value within a preset section among absolute values of the offset-compensated acceleration sensor signal.

In particular, the processor 140 determines whether the user hits based on whether the absolute value of the offset-compensated acceleration sensor signal is equal to or greater than a preset threshold and whether the touch value of the touch sensor signal is changed from off to on can do.

And, when it is determined that the pad has been hit, the processor 140 may perform an operation of converting the detected maximum value into a sound level corresponding thereto.

For example, if it is assumed that the maximum value of the acceleration sensor signal has a value of 0 to 1024, the sound level may be matched corresponding to each maximum value having a value of 0 to 1024. Accordingly, the processor 140 ) may output a sound of a converted sound level based on the maximum value of the acceleration sensor signal.

The event generating operation 2060 performed by the processor 140 outputs a sound set for each pad as a converted sound level, and outputs a sound matched to the pad hit, so that the user can select which pad among the plurality of pads by how much. It can provide an auditory feedback as to whether or not it was tapped with the intensity of

Meanwhile, FIGS. 21 to 22 are flowcharts illustrating an operation process according to various embodiments of the present disclosure.

Referring to FIG. 21 , the power of the electronic device 100 is set to on ( S2110 ), and the processor 140 initializes an acceleration sensor and a touch sensor ( S2120 ). Of course, the processor 140 may initialize various sensors other than the acceleration sensor and the touch sensor. For example, a gyro sensor, an illuminance sensor, a motion detection sensor, and the like may be initialized.

On the other hand, the processor 140 may check whether the beat mode is in the ON state (S2130), where the beat mode outputs a type of sound set to correspond to the pad in which the user hit is sensed, and outputs other sound contents, etc. means possible modes.

And, if the bit mode is ON, the processor 140 obtains an acceleration sensor signal through an acceleration sensor provided in each of the plurality of pads (S2140-1), and a touch sensor through a touch sensor provided in each of the plurality of pads A signal may be acquired (S2140-2).

Thereafter, the processor 140 may convert an acceleration sensor signal and a touch sensor signal in a digital signal state into an acceleration sensor signal and a touch sensor signal in an analog signal state, and calculate a section average and a section standard deviation ( S2150 ).

Then, the processor 140 may calculate an offset in consideration of the arrangement state or inclination of the electronic device 100 based on the calculated section average and section standard deviation, and reflect the calculated offset to the acceleration sensor signal (S2160). ).

In addition, the processor 140 may take an absolute value of the acceleration sensor signal to which the offset is reflected, and detect a maximum value within a preset section among absolute values of the acceleration sensor signal for which the offset is compensated.

Thereafter, the processor 140 detects whether the user hits based on whether the offset is equal to or greater than a preset threshold based on the absolute value of the compensated acceleration sensor signal and whether the touch value of the touch sensor signal is changed from off to on And, when it is determined that the pad has been hit, the processor 140 may convert the detected maximum value into a sound level corresponding thereto (S2170).

In addition, the processor 140 may perform an event generation operation ( S2180 ) of outputting a sound set to the corresponding pad hit. Of course, when a plurality of pads are hit, the processor 140 may output sounds set to each of the plurality of pads individually or by mixing them.

And, when the power of the electronic device is set to off according to a user manipulation (S2190), all operations are terminated.

Referring to FIG. 22 , the power of the electronic device 100 is set to on ( S2210 ), and the processor 140 initializes an acceleration sensor and a touch sensor ( S2220 ). Of course, it has been described that the processor 140 may initialize various sensors other than the acceleration sensor and the touch sensor.

Meanwhile, when an external input source is selected according to a user operation ( S2230 ), the processor 140 performs wireless or wired communication with the selected external input source to stream or read and download sound content.

Here, the external input source may be a CD, USB, an external device connectable through Blurtooth, or the like.

Then, the processor 140 may reproduce the audio content that is streamed or read and downloaded (S2240). Here, since it has already been described that the processor 140 may provide different visual feedback based on the reproduced sound content, a detailed description thereof will be omitted.

Then, the processor 140 may check whether the beat mode is in an ON state while playing the sound content (S2250), where the beat mode mixes the input sound content and the type of sound set to correspond to the pad in which the blow is sensed. It means the first mode among the first mode for outputting the sound and the second mode for outputting only the input sound content except for the type of sound set to correspond to the pad in which the hitting is sensed.

Accordingly, when the bit mode is in the ON state, the processor 140 acquires an acceleration sensor signal through the acceleration sensor provided in each of the plurality of pads while playing the sound content (S11-1), and is provided in each of the plurality of pads A touch sensor signal may be acquired through the connected touch sensor (S11-2).

Thereafter, the processor 140 may convert an acceleration sensor signal and a touch sensor signal in a digital signal state into an acceleration sensor signal and a touch sensor signal in an analog signal state, and calculate a section average and a section standard deviation ( S12 ).

Then, the processor 140 may calculate an offset in consideration of the arrangement state or inclination of the electronic device 100 based on the calculated section average and section standard deviation, and reflect the calculated offset to the acceleration sensor signal (S13). ).

In addition, the processor 140 may take an absolute value of the acceleration sensor signal to which the offset is reflected, and detect a maximum value within a preset section among absolute values of the acceleration sensor signal for which the offset is compensated.

Thereafter, the processor 140 determines whether the offset is greater than or equal to a preset threshold based on the absolute value of the compensated acceleration sensor signal and whether the touch value of the touch sensor signal is changed from off to on. If it is detected whether a hit has been made, and it is determined that a hit has been made on the corresponding pad, the processor 140 may convert the detected maximum value into a sound level corresponding thereto (S14).

Then, the processor 140 performs an event generating operation for generating a sound set in the corresponding pad hit (S15), and accordingly, a beat sound is generated (S16).

In addition, the processor 140 may mix and output the sound content downloaded by streaming or reading from an external input source and the generated beat sound (S17).

Then, the processor 140 may determine whether a turn-off command is inputted through the power button of the electronic device 100 ( S2260 ), and may turn off the electronic device 100 when the turn-off command is input ( S2260 ). S2270). Accordingly, all operations of the electronic device 100 are terminated.

On the other hand, the first processing section 10 including a plurality of steps (S11-1, S11-2, S12, S13, S14, S15) performed by the processor in FIG. The second processing section 20 including a plurality of steps (S11-1, S11-2, S12, S13, S14, S15, S16, S17) performed by the processor It is a section in which it is judged whether or not it is made, and a sound set in the hitting pad is generated and mixed.

23 is a block diagram illustrating a specific configuration of the electronic device shown in FIG. 1 .

Referring to FIG. 23 , the electronic device 100 ′ includes a plurality of pads 110 , a sound output unit 120 , a display unit 130 , a processor 140 , an input unit 150 , an audio processing unit 160 , and a communication unit. 170 and a storage unit 180 . A detailed description of the portion overlapping with the configuration shown in FIG. 1 among the configuration shown in FIG. 23 will be omitted.

The processor 140 controls the overall operation of the display apparatus 100 ′.

Specifically, the processor 130 includes the RAM 141 , the ROM 142 , the main CPU 143 , the graphic processing unit 144 , the first to n interfaces 145-1 to 145-n, and the bus 146 . include

The RAM 141 , the ROM 142 , the main CPU 143 , the graphic processing unit 144 , the first to n interfaces 145 - 1 to 145 -n, etc. may be connected to each other through the bus 146 .

The first to n-th interfaces 145-1 to 145-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device through a network.

The main CPU 143 accesses the storage unit 180 and performs booting using the O/S stored in the storage unit 180 . Then, various operations are performed using various programs, contents, data, etc. stored in the storage unit 140 .

The ROM 142 stores an instruction set for system booting and the like. When a turn-on command is input and power is supplied, the main CPU 143 copies the O/S stored in the storage unit 180 to the RAM 141 according to the command stored in the ROM 142, and executes the O/S. Boot the system. When booting is completed, the main CPU 143 copies various application programs stored in the storage unit 180 to the RAM 141 and executes the application programs copied to the RAM 141 to perform various operations.

The graphic processing unit 144 generates a screen including various objects such as icons, images, and texts by using an operation unit (not shown) and a rendering unit (not shown). A calculation unit (not shown) calculates attribute values such as coordinate values, shape, size, color, etc. at which each object is to be displayed according to the layout of the screen based on the received control command. The rendering unit (not shown) generates screens of various layouts including objects based on the attribute values calculated by the calculation unit (not shown). The screen generated by the rendering unit (not shown) may be displayed through the display unit 130 .

Meanwhile, the above-described operation of the processor 140 may be performed by a program stored in the storage unit 180 .

The storage unit 180 stores various data such as an O/S (Operating System) software module for driving the electronic device 100 ′ and various multimedia contents.

In particular, the storage unit 180 detects a user's touch in at least one of the plurality of pads 110 by the touch sensor and detects that the intensity of the user's touch is greater than or equal to a preset threshold by the acceleration sensor. Determining that a blow to the pad has been made, controlling the sound output unit to output a sound of a type set to correspond to the pad in which the blow is sensed at a size corresponding to the intensity of the blow, and providing visual feedback corresponding to the blow Includes software modules. This will be described in detail with reference to FIG. 24 .

Meanwhile, the communication unit 170 may communicate with an external input source, an external device, a remote control device, and the like, and communicate with an external input source, an external device, a remote control device, and the like through at least one of a wireless communication method and a wired communication method. can be done

In particular, the communication unit 170 may communicate with a remote control device (not shown) according to a wireless communication method or an IR method, and the wireless communication method includes RFID, Near Field Communication (NFC), Bluetooth, Zigbee and Wi-Fi may be used.

The audio processing unit 160 may process the audio signal to match the user settings regarding the output range and sound quality of the audio output unit 120 . Specifically, the audio processing unit 160 may process the sound content input through the input unit 150 to match the user settings regarding the output range and sound quality of the sound output unit 120 . Also, the audio processing unit 160 may process a type of sound set to correspond to the pad in which the hitting is sensed to match the user settings regarding the output range and sound quality of the sound output unit 120 .

24 is a diagram of a software module stored in a storage unit according to an embodiment of the present invention.

24 , the storage unit 180 includes a touch value detection module 181 , an acceleration value detection module 182 , a hit determination module 183 , a sound output and mixing module 184 , and a communication module 185 . Such programs may be stored.

Meanwhile, the above-described operation of the processor 140 may be performed by a program stored in the storage unit 180 . Hereinafter, detailed operations of the processor 140 using the program stored in the storage unit 180 will be described in detail.

The touch value detection module 181 may perform a function of detecting whether a touch value has changed from a touch sensor signal obtained through the touch sensor. For example, when the touch value is changed from off to on, a function of detecting that a user's touch has been made may be performed, and when the touch value is changed from on to off, a function of detecting that the user's touch is stopped may be performed.

The acceleration value detection module 182 calculates an offset due to gravitational acceleration from the acceleration sensor signal obtained through the acceleration sensor, reflects the calculated offset to the acceleration sensor signal, and calculates the absolute value of the acceleration sensor signal to which the offset is reflected. A function of detecting an acceleration value may be performed.

The hitting determination module 183 may perform a function of determining whether to hit the corresponding pad based on the touch value detected by the touch value detection module 181 and the acceleration value detected by the acceleration value detection module 182 have.

Specifically, when the touch value is changed from off to on and the user touch on the corresponding pad is sensed, and the intensity of the user's touch corresponding to the acceleration value is greater than or equal to a preset threshold value, the hitting determination module 183 detects that the corresponding pad It is possible to perform a function to determine that a blow has been made against the .

The sound output and mixing module 184 may perform a function of outputting a sound set to the corresponding pad when it is determined that the corresponding pad has been hit by the hitting whether or not determining module 183 . In addition, when it is determined that a blow has been made to the plurality of pads 110 , the sound output and mixing module 184 may perform a function of individually outputting or mixing sounds set for each pad.

The communication module 185 is a module for performing communication with an external device. The communication module 142 includes a device module used for communication with an external device, a messenger program, a short message service (SMS) & multimedia message service (MMS) program, a messaging module such as an email program, and a call information aggregator program. It may include a phone module including a module, a VoIP module, and the like.

Meanwhile, the plurality of pads 110 provided in the electronic device 100 may be implemented as one pad. For example, when the plurality of pads 110 are implemented as one pad, one pad may be divided into a plurality of regions, and different channels may be matched to each region.

Although an embodiment in which one pad is divided into a plurality of regions has been described in FIG. 19 as well, this is for explaining a scratching operation, and even in the case of FIG. 19 , the electronic device 100 may include a plurality of pads.

However, by integrating the plurality of pads themselves into one pad and dividing one pad into a plurality of regions, the structure, size, thickness, etc. of the electronic device 100 may be changed.

Since different channels are matched to each area, a plurality of sounds are set for each area, so that the user can tap each divided area on one pad instead of hitting a plurality of pads individually, and the processor (140) Also, by detecting the user's touch and touch intensity through the acceleration sensor and the touch sensor provided in each area, it is possible to determine whether a hit has been made for each area, and according to the determination result, the sound set in each area They can be output individually or in a mix.

25 is a flowchart illustrating a method of controlling an electronic device according to an embodiment of the present invention.

The control method of an electronic device including a plurality of pads each including a touch sensor and an acceleration sensor, and a sound output unit for outputting a plurality of sounds set for each of the plurality of pads, as shown in FIG. 25 , includes at least one of the plurality of pads. It is possible to detect a user's touch by the touch sensor in (S2510).

Then, the intensity of the user's touch may be detected by the acceleration sensor (S2520).

Here, the detecting of the user's touch includes detecting the user's touch based on a change in the touch value corresponding to the touch sensor signal, and the detecting of the intensity of the user's touch is based on the acceleration value calculated from the acceleration sensor signal. Thus, the intensity of the user's touch can be detected.

In addition, when a user's touch is sensed and the intensity of the user's touch is greater than or equal to a preset threshold, it may be determined that at least one pad has been hit (S2530).

Here, in the determining step, it may be determined that a hit is made to a pad having a touch value ON and an acceleration value equal to or greater than a preset threshold value among the plurality of pads.

In addition, in the determining step, it may be determined that a strike is not performed on a pad having a touch value of OFF or an acceleration value less than a preset threshold value among the plurality of pads.

On the other hand, the plurality of pads includes a first pad and a second pad, and the determining may include: when the first touch value sensed through the first pad is ON and the first acceleration value is greater than or equal to a preset threshold, It is determined that a blow has been made against the user, and the intensity of the user's touch is determined based on the first acceleration value. If the second touch value sensed through the second pad is OFF or the second acceleration value is less than a preset threshold, the It can be judged that no damage has been done.

In addition, the sensing of the intensity of the user's touch may include compensating for an offset due to gravitational acceleration with respect to the acceleration sensor signal, and calculating an acceleration value based on the offset-compensated acceleration sensor signal.

Here, the offset by the gravitational acceleration may be changed according to the inclination of the electronic device.

In addition, a sound of a type set to correspond to the pad in which the hitting is sensed may be output in a size corresponding to the intensity of the hitting, and a visual feedback corresponding to the hitting may be provided (S2540).

Here, in the providing step, based on the strength of the blow, a sound level of a type set to correspond to the pad in which the blow is sensed and a visual feedback corresponding to the blow may be differently determined and provided.

Meanwhile, a non-transitory computer readable medium in which a program for sequentially performing the control method according to the present invention is stored may be provided.

For example, detecting a user's touch by a touch sensor in at least one of the plurality of pads, detecting the intensity of the user's touch by an acceleration sensor, detecting the intensity of the user's touch by an acceleration sensor, the user When a touch is detected and the intensity of the user's touch is detected to be greater than or equal to a preset threshold, determining that a strike has been made to at least one pad and applying a sound of a type set to correspond to the detected pad to the intensity of the strike A non-transitory computer readable medium may be provided in which a program for performing a step of outputting a size to be output and providing a visual feedback corresponding to a blow is stored.

The non-transitory readable medium refers to a medium that stores data semi-permanently, rather than a medium that stores data for a short moment, such as a register, cache, memory, and the like, and can be read by a device. Specifically, the various applications or programs described above may be provided by being stored in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In addition, although a bus is not illustrated in the above-described block diagram of an electronic device, communication between respective components in the electronic device may be performed through a bus. In addition, each device may further include a processor such as a CPU or a microprocessor that performs the various steps described above.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention pertains without departing from the gist of the present invention as claimed in the claims In addition, various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

100: electronic device 110: a plurality of pads
120: sound output unit 130: display unit
140: processor

Claims (20)

a plurality of pads each including a touch sensor and an acceleration sensor; and
a sound output unit for outputting a plurality of sounds set for each of the plurality of pads;
a display unit for providing visual feedback;
When a user's touch is sensed by the touch sensor in at least one of the plurality of pads and the intensity of the user's touch is detected to be greater than or equal to a preset threshold by the acceleration sensor, the at least one pad is hit A processor that determines that
The processor is
detecting the user's touch based on a change in the touch value corresponding to the touch sensor signal, detecting the intensity of the user's touch based on the acceleration value calculated from the acceleration sensor signal,
It is determined that a hit is made to a pad in which the touch value is ON among the plurality of pads and the acceleration value is equal to or greater than the preset threshold value,
Controlling the sound output unit to output a type of sound set to correspond to the pad in which the strike is sensed with a size corresponding to the strength of the strike, and controlling the display unit to provide the visual feedback corresponding to the strike , electronic devices. delete delete According to claim 1,
The processor is
The electronic device of claim 1, wherein it is determined that no hitting is made to a pad having the touch value of OFF or the acceleration value less than the preset threshold value among the plurality of pads. According to claim 1,
The plurality of pads includes a first pad and a second pad,
The processor is
If the first touch value sensed through the first pad is ON and the first acceleration value is greater than or equal to the preset threshold, it is determined that a hit has been made to the first pad, and based on the first acceleration value, the user's touch to judge the strength,
The electronic device of claim 1 , wherein when the second touch value sensed through the second pad is OFF or the second acceleration value is less than the preset threshold, it is determined that the second pad is not hit. According to claim 1,
The processor is
The electronic device of claim 1, wherein an offset caused by gravitational acceleration is compensated for the acceleration sensor signal, and the acceleration value is calculated based on the offset-compensated acceleration sensor signal. 7. The method of claim 6,
The electronic device, characterized in that the offset due to the acceleration of gravity is changed according to the inclination of the electronic device. According to claim 1,
The processor is
The electronic device according to claim 1, wherein a sound level of a type set to correspond to a pad in which the strike is sensed and the visual feedback corresponding to the strike are differently determined and provided based on the intensity of the strike. 9. The method of claim 8,
The display unit includes an LED unit,
The processor is
Turning on an LED corresponding to a pad in which a hit is sensed among the LED units, and adjusting at least one of a brightness and a color of the LED according to the intensity of the hit. According to claim 1,
It further includes; an input unit for receiving sound content from an external source;
The processor is
The electronic device of claim 1, wherein the input sound content and the sound of a type set to correspond to the pad in which the hit is sensed are mixed and output. 11. The method of claim 10,
The processor is
The electronic device of claim 1, wherein the visual feedback is differently provided based on the input information about the sound content and the intensity of the blow. According to claim 1,
It further includes; an input unit for receiving sound content from an external source;
The processor is
According to a user operation, except for the first mode for mixing and outputting the input sound content and the sound set to correspond to the pad in which the strike is sensed, and the sound set to correspond to the pad in which the strike is sensed. An electronic device, characterized in that it operates in one of the second modes for outputting only input sound content. A control method of an electronic device comprising: a plurality of pads each including a touch sensor and an acceleration sensor; and a sound output unit for outputting a plurality of sounds set for each of the plurality of pads, the method comprising:
detecting a user's touch by the touch sensor in at least one of the plurality of pads;
detecting the intensity of the user's touch by the acceleration sensor;
determining that the at least one pad has been hit when the user's touch is sensed and the intensity of the user's touch is greater than or equal to a preset threshold; and
The method of controlling an electronic device comprising: outputting a sound of a type set to correspond to the pad in which the strike is sensed in a size corresponding to the intensity of the strike and providing a visual feedback corresponding to the strike. 14. The method of claim 13,
The step of detecting the user's touch,
Detecting the user's touch based on a change in a touch value corresponding to a touch sensor signal,
The step of detecting the intensity of the user's touch comprises:
The control method of an electronic device, characterized in that the intensity of the user's touch is sensed based on an acceleration value calculated from an acceleration sensor signal. 15. The method of claim 14,
The determining step is
The control method of an electronic device, characterized in that it is determined that a strike is made to a pad having the touch value ON and the acceleration value equal to or greater than the preset threshold value among the plurality of pads. 15. The method of claim 14,
The determining step is
The control method of the electronic device, characterized in that it is determined that a strike is not made to a pad in which the touch value is OFF or the acceleration value is less than the preset threshold value among the plurality of pads. 15. The method of claim 14,
The plurality of pads includes a first pad and a second pad,
The determining step is
If the first touch value sensed through the first pad is ON and the first acceleration value is greater than or equal to the preset threshold, it is determined that a hit has been made to the first pad, and based on the first acceleration value, the user's touch to judge the strength,
When the second touch value sensed through the second pad is OFF or the second acceleration value is less than the preset threshold, it is determined that the second pad is not hit. 15. The method of claim 14,
The step of detecting the intensity of the user's touch comprises:
The control method of an electronic device, comprising: compensating for an offset due to gravitational acceleration with respect to the acceleration sensor signal, and calculating the acceleration value based on the offset-compensated acceleration sensor signal. 19. The method of claim 18,
The method of controlling an electronic device, characterized in that the offset by the gravitational acceleration is changed according to the inclination of the electronic device. 14. The method of claim 13,
The providing step is
The control method of an electronic device, characterized in that, based on the intensity of the hit, a sound level of a type set to correspond to the pad in which the hit is sensed and the visual feedback corresponding to the hit are differently determined and provided.

Images