JP2013054334A - Electronic device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic device in which operability is improved further.SOLUTION: An electronic device 6a comprises an acceleration sensor 50 that detects movement of a housing, a touch sensor 10 for detecting user touch, and a reproduction unit 140 that reproduces specified sound, when the acceleration sensor detects the movement of the housing, performs reproduction by superposing first sound on sound that is being reproduced, and when the touch sensor detects user touch, performs reproduction by superposing second sound on sound that is being reproduced.

Description

  The present invention relates to an electronic device.

  Conventionally, an electronic device including various sensors is known (see, for example, Patent Document 1).

JP 2010-250608 A

  However, in the case of a conventional electronic device, there is room for improvement in user operability. The present invention provides an electronic device with improved operability.

  In order to solve the above problem, an electronic device according to an embodiment of the present invention reproduces a specified sound while an acceleration sensor that detects a movement of a housing, a touch sensor that detects a user's touch, When the movement of the housing is detected by the acceleration sensor, the first sound is superimposed on the sound being played back, and when the user touch is detected by the touch sensor, the second sound is And a reproduction unit that reproduces the sound while being superimposed on the sound being reproduced.

  When the movement of the housing is detected during the reproduction of the music by the reproduction unit, the electronic device causes the reproduction unit to reproduce the first sound effect by superimposing the reproduction on the music being reproduced. A sound superimposing unit and a second sound effect superimposing unit that, when a touch is detected during reproduction of the music by the reproduction unit, causes the reproduction unit to reproduce the second sound effect by superimposing the music on the music being reproduced May be provided.

  In the electronic device, when the movement of the casing is detected during the reproduction of the music by the reproduction unit, the first sound effect superimposing unit causes the reproduction unit to respond to the first movement according to the movement of the casing. When the touch is detected during the reproduction of the music by the reproduction unit, the second sound according to the touch position or the touch method is given to the reproduction unit. You may make it reproduce | regenerate by superimposing on the music in reproduction | regeneration.

  In the electronic apparatus, the first sound effect is any one of a musical performance sound, an environmental sound generated in a natural environment or a living environment, or a human shout, and the second sound effect is Of the performance sound, the environmental sound, or the shout, a sound other than the sound effect according to the movement of the housing may be used.

  When the movement of the housing is detected during sound reproduction by the reproduction unit, the electronic device is configured to superimpose the sound that represents the movement tempo of the housing on the reproduction unit by superimposing the sound on the reproduction. When a touch is detected during playback of the sound after the tempo is added by the playback unit, and when the touch is detected, the playback unit A sound effect adding unit that adds the sound effect to the sound after the tempo being applied may be provided by superimposing the sound after the tempo is applied to reproduce the sound effect.

  The electronic device includes a gripping mode recognition unit that recognizes a gripping mode of a housing by a user, and a recording unit that records the sound being played when the gripping mode recognition unit recognizes a predetermined gripping mode. You may make it prepare.

  In order to solve the above problem, an electronic apparatus according to another embodiment of the present invention includes a motion detection unit that detects a movement of a housing, a touch detection unit that detects a user's touch, and a song that accepts designation of a song. A designated receiving means, a reproducing means for reproducing the designated music, a recording means for recording the sound being reproduced by the reproducing means, and a sound effect corresponding to the movement or touch of the housing is being reproduced on the reproducing means. Sound effect superimposing means for superimposing and reproducing the designated music, and when the reproducing means is reproducing the sound effect superimposed on the designated music, the sound effect is superimposed on the designated music When the recorded sound effect superimposed music is designated by the music designation receiving means, the reproduction means reproduces the music after the sound effect superimposition as the designated music, and the sound effect superimposing means The music after the sound is superimposed During the live, the sound effect according to the movement or touch of the housing is further superimposed on the music after the sound effect being superimposed and reproduced, and the recording means is adapted to reproduce the music after the sound effect is superimposed. Further, when the sound effect is reproduced by superimposing, the sound effect is recorded by further superimposing on the music after the sound effect is superimposed.

  According to the present invention, the operability can be further improved.

It is an external appearance schematic diagram of the electronic device 6a by the 1st Embodiment of this invention. It is an example of the functional block diagram of the electronic device 6a. It is an example of the flowchart which shows the flow of a process of the electronic device 6a. It is an example of a screen displayed on the display screen 12. It is an example of the functional block diagram of the electronic device 6b by the 2nd Embodiment of this invention. It is explanatory drawing regarding provision of tempo and addition of a sound effect. It is an example of the flowchart which shows the flow of a process of the electronic device 6b. It is an example of the flowchart which shows the flow of a process of the electronic device 6b.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a schematic external view of an electronic apparatus 6a according to the first embodiment of the present invention. FIG. 2 is an example of a functional block diagram of the electronic device 6a.

  The electronic device 6a (the same applies to the electronic device 6b according to the second embodiment) has a display screen 12 on the front surface as shown in FIG. As shown in FIG. 2, the electronic device 6a includes a touch sensor (for the side surface portion 16) 20, an acceleration sensor 50, a display unit (touch panel) 100, a gripping state recognition unit 120, a playback unit 140, a voice output unit 150, A storage unit 180, a first sound effect superimposing unit 230, a second sound effect superimposing unit 240, and a recording unit 270 are provided.

  The touch sensor 20 is disposed on each side surface portion 16 of the housing and detects a touch on each side surface portion 16. The acceleration sensor 50 detects acceleration applied to the housing. That is, the acceleration sensor 50 detects the movement of the housing. The display unit 100 includes a display screen 12 and a touch sensor 10. The display screen 12 displays various information. The touch sensor 10 detects a touch on the display screen 12.

  The grip state recognition unit 120 recognizes the grip state of the casing by the user. Specifically, the grip state recognition unit 120 recognizes the grip state based on the touch position of each side surface part 16 (detected value of the touch sensor 20).

  The storage unit 180 stores various information. For example, the storage unit 180 stores music, first sound effects (described later), second sound effects (described later), and music recorded by the recording unit 270 (for example, music after effect sound superimposition). The music after the sound effect is superimposed is a music on which at least one of the first sound effect and the second sound effect is superimposed. In addition, in order to distinguish from the music after a sound effect superimposition, the music in which neither the 1st sound effect nor the 2nd sound effect is superimposed is also called the music before a sound effect superimposition.

  The first sound effect is, for example, one of a musical instrument performance sound, an environmental sound generated in a natural environment or a living environment, or a human shout. The second sound effect is any sound other than the first sound effect among the types (musical instrument performance sound / environmental sound / human voice). Note that examples of musical instrument performance sounds include percussion instrument (eg, drum) sound, stringed instrument (eg, electric guitar) sound, wind instrument (eg, trumpet), and keyboard instrument (eg, piano) sound. Examples of environmental sounds include sounds of birds and beasts, sounds generated by weather phenomena (wind and rain, lightning strikes), applause sounds, cheers, explosion sounds, firing sounds, door knocking sounds, vehicle running sounds, various notification sounds (for example, , Siren), the sound of fireworks. In addition, a person's shout includes not only a phrase (such as “COME ON!”, “HERE WE GO!”, “Check it out”) but also a phrase that does not constitute a phrase such as a strange voice or a cry.

  The first sound effect and the second sound effect are arbitrarily set and stored in the storage unit 180. For each type (musical instrument performance sound / environmental sound / human shout), the first sound effect and the second sound effect are stored. A sound effect and a second sound effect are set. That is, since the setting of the first sound effect and the second sound effect is arbitrary, the first sound effect and the second sound effect are set regardless of the type (for example, one of the performance sounds). Percussion instrument sound may be set as the first sound effect, and stringed instrument sound, which is also one of the performance sounds, may be set as the second sound effect), but for each type, the first sound effect, In addition, it is preferable for the user to easily set the second sound effect (for example, the performance sound is set as the first sound effect and the person's shout is set as the second sound effect). The superimposition of the first sound effect and the superimposition of the second sound effect will be described later.

  The reproduction unit 140 reproduces sound. Specifically, the playback unit 140 plays back the music stored in the storage unit 180 in response to an instruction (playback instruction) received from the user via the touch sensor 10. For example, the playback unit 140 reads and plays the song A from the storage unit 180 in response to a playback instruction for a song (for example, song A) before the sound effect superimposition. Further, for example, the playback unit 140 reads and plays the song A ′ from the storage unit 180 in response to a playback instruction of a song (for example, the song A ′) after the sound effect is superimposed.

In addition, when the movement of the housing is detected by the acceleration sensor 50 during the reproduction of the music (the music before the sound effect superimposition or the music after the sound effect superimposition), the reproduction unit 140, together with the music being reproduced, A first sound effect (for example, a first sound effect corresponding to the movement of the housing) is reproduced. That is, when the user moves the casing during the reproduction of the music related to the reproduction instruction, the reproduction unit 140 reproduces the first sound effect by superimposing it on the music being reproduced.
Note that, under the control of the first sound effect superimposing unit 230, the reproducing unit 140 reproduces the first sound effect by superimposing it on the music being reproduced (details will be described later).

In addition, when the touch sensor 10 detects a touch on the display screen 12 during the reproduction of the music (the music before the sound effect superimposition or the music after the sound effect superimposition), the playback unit 140 plays the music being played back. At the same time, the second sound effect (for example, the second sound effect corresponding to the touch position or the touch method) is reproduced. That is, when the user touches the display screen 12 during the reproduction of the music related to the reproduction instruction, the reproduction unit 140 reproduces the second sound effect by superimposing it on the music being reproduced.
Note that, under the control of the second sound effect superimposing unit 240, the reproducing unit 140 reproduces the second sound effect by superimposing it on the music being reproduced (details will be described later).

  The audio output unit 150 outputs audio according to information output from the reproduction unit 140 (information reproduced by the reproduction unit 140).

The first sound effect superimposing unit 230 causes the playback unit 140 to detect the movement of the casing (for example, a predetermined motion) by the acceleration sensor 50 during playback of the music before the sound effect superimposition by the playback unit 140. The first sound effect is reproduced by being superimposed on the music being reproduced (the music before the sound effect is superimposed).
Specifically, each first sound effect is stored in advance in the storage unit 180 in association with the movement of the housing (for example, the movement direction). When the movement of the housing is detected during the reproduction of the music before the sound effect superimposition, the first sound effect superimposing unit 230 receives the first sound effect according to the movement of the housing from the storage unit 180. Read out and output to the playback unit 140.
In addition, the reproduction | regeneration part 140 reproduces | regenerates the said 1st sound effect with the music before a sound effect superimposition, when a 1st sound effect is acquired during reproduction | regeneration of the music before a sound effect superimposition. That is, the reproducing unit 140 reproduces the first sound effect superimposed on the music before the sound effect superimposition.

Similarly, the first sound effect superimposing unit 230 is effective when the movement of the casing (for example, a predetermined motion) is detected by the acceleration sensor 50 during the reproduction of the music after the sound effect superimposition by the reproducing unit 140. Similar to the case where the movement of the housing is detected during the reproduction of the music before superimposing the sound, the reproduction unit 140 reproduces the first sound effect by superimposing it on the music being reproduced (music after the sound effect is superimposed). .
When the first sound effect is acquired during the reproduction of the music after the sound effect is superimposed, the reproducing unit 140 reproduces the first sound effect together with the music after the sound effect is superimposed. That is, the reproduction unit 140 reproduces the first sound effect by further superimposing it on the music after the sound effect is superimposed.

When the touch sensor 10 detects a touch on the display screen 12 during the reproduction of the music before the sound effect is superimposed by the reproduction unit 140, the second sound effect superimposition unit 240 causes the reproduction unit 140 to play the music being reproduced. The second sound effect is reproduced by superimposing it on (the music before the sound effect superimposition).
Specifically, each second sound effect is stored in advance in the storage unit 180 in association with a touch (for example, a touch position or a touch method). Then, when a touch is detected during the reproduction of the music before the sound effect superimposition, the second sound effect superimposing unit 240 reads the second sound effect corresponding to the touch from the storage unit 180 and reproduces the reproduction unit 140. Output to.
When the second sound effect is acquired during reproduction of the music before the sound effect superimposition, the reproducing unit 140 reproduces the second sound effect together with the music before the sound effect superimposition. That is, the reproduction unit 140 reproduces the second sound effect by superimposing the second sound effect on the music before the sound effect superimposition.

Similarly, the second sound effect superimposing unit 240, when the touch sensor 10 detects a touch on the display screen 12 during the reproduction of the music after the sound effect superimposition by the reproduction unit 140, the music before the sound effect superimposition. In the same manner as when a touch is detected during the reproduction, the reproduction unit 140 reproduces the second sound effect by superimposing it on the music being reproduced (music after the sound effect is superimposed).
When the second sound effect is acquired during the reproduction of the music after the sound effect is superimposed, the reproducing unit 140 reproduces the second sound effect together with the music after the sound effect is superimposed. That is, the reproduction unit 140 reproduces the second sound effect by further superimposing the second sound effect on the music after the sound effect is superimposed.

  Therefore, at a desired timing during the reproduction of the music (the music before the sound effect superimposition or the music after the sound effect superimposition), for example, the user places the casing in the movement direction corresponding to the desired first sound effect. By moving, the desired first sound effect can be superimposed and reproduced at a desired temporal position of the music being reproduced. In addition, the user can select, for example, a position on the display screen 12 corresponding to the desired second sound effect at a desired timing during the reproduction of the music (the music before the sound effect superimposition or the music after the sound effect superimposition). By touching (for example, a button for each second sound effect), a desired second sound effect can be superimposed and reproduced at a desired temporal position of the music being reproduced.

  The recording unit 270 records the sound being reproduced. Specifically, when a predetermined grip mode is recognized by the grip mode recognition unit 120, a sound being played is recorded.

  For example, the recording unit 270 recognizes a predetermined gripping mode when the playback unit 140 plays a sound effect (first sound effect or second sound effect) superimposed on the music before the sound effect is superimposed. If so, the music after the sound effect is superimposed (the sound before being superimposed on the music before the sound effect is superimposed) is recorded. In addition, the recording unit 270 performs a predetermined gripping state when the playback unit 140 plays a sound effect (first sound effect or second sound effect) further superimposed on the music after the sound effect is superimposed. Is recognized, the music after the sound effect is superimposed (a sound effect further superimposed on the music after the sound effect is superimposed) is recorded.

  In addition, when the touch position (detected value of the touch sensor 20) of each side surface portion 16 is a predetermined touch position, the grip state recognition unit 120 determines that the grip state of the housing by the user is the predetermined grip state. recognize.

  FIG. 3 is an example of a flowchart showing a processing flow of the electronic device 6a. The playback unit 140 receives a music playback instruction via the touch sensor 10 (step S500). The playback unit 140 reads the music related to the playback instruction from the storage unit 180 and starts playback (step S502). Note that the playback unit 140 continues to play back the music until it is determined that playback has ended (step S560: No).

  The gripping mode recognition unit 120 determines whether or not the gripping mode of the casing by the user is a predetermined gripping mode (step S504).

  If it is not the predetermined gripping mode (step S504: No), the first sound effect superimposing unit 230 determines whether or not the movement of the housing is detected by the acceleration sensor 50 (step S510).

  When the movement of the housing is detected (step S510: Yes), the first sound effect superimposing unit 230 causes the playback unit 140 to superimpose the music being played back on the first effect according to the motion of the housing. Play the sound. In other words, the reproduction unit 140 reproduces the first sound effect according to the movement of the casing by superimposing it on the music being reproduced (step S512). Note that the first sound effect superimposing unit 230 reproduces the first sound effect while the movement of the housing is detected. That is, the reproduction unit 140 reproduces the first sound effect while the movement of the housing is detected.

  On the other hand, when the movement of the casing is not detected (step S510: No), the process of step S512 is skipped and the process proceeds to step S520.

  Subsequent to step S512 or step S510 (No), the second sound effect superimposing unit 240 determines whether or not a touch on the display screen 12 is detected by the touch sensor 10 (step S520).

  When a touch is detected (step S520: Yes), the second sound effect superimposing unit 240 causes the reproduction unit 140 to reproduce the second sound effect corresponding to the touch by superimposing it on the music being reproduced. In other words, the reproducing unit 140 reproduces the second sound effect corresponding to the touch by superimposing it on the music being reproduced (step S522). Note that the second sound effect superimposing unit 240 reproduces the second sound effect for a predetermined time after the touch (or once when the second sound effect is counted like a phrase). That is, the reproduction unit 140 reproduces the second sound effect for a predetermined time after the touch (or once when the second sound effect is counted like a phrase).

  On the other hand, when no touch is detected (step S520: No), the process of step S522 is skipped and the process proceeds to step S560.

  On the other hand, when it is a predetermined holding | grip aspect (step S504: Yes), the recording part 270 starts the recording of the music in process of reproduction | regeneration (step S530). Note that the recording unit 270 continues recording until it is determined that the gripping state is not the predetermined gripping state (step S504: No). The recording unit 270 records the sound effect reproduced together with the music when the reproducing unit 140 reproduces the first sound effect or the second sound effect during recording of the music.

  Subsequent to step S530, the first sound effect superimposing unit 230 determines whether the movement of the housing is detected by the acceleration sensor 50 (step S540).

  When the movement of the casing is detected (step S540: Yes), as in step S512, the first sound effect superimposing section 230 causes the playback section 140 to superimpose on the music being played and responds to the movement of the casing. The first sound effect is reproduced. Thus, the playback unit 140 plays the first sound effect according to the movement of the casing by superimposing it on the music being played back, and the recording unit 270 superimposes it on the music being played back, A first sound effect corresponding to the movement is recorded (step S522).

  On the other hand, when the movement of the housing is not detected (step S540: No), the process of step S542 is skipped and the process proceeds to step S550.

  Subsequent to step S542 or step S540 (No), the second sound effect superimposing unit 240 determines whether or not a touch on the display screen 12 is detected by the touch sensor 10 (step S550).

  When a touch is detected (step S550: Yes), as in step S522, the second sound effect superimposing unit 240 causes the playback unit 140 to superimpose the second sound effect on the music being played and to respond to the touch. Play. As a result, the playback unit 140 plays the second sound effect corresponding to the touch by superimposing it on the music being played back, and the recording unit 270 superimposes it on the music being played back to the second music sound corresponding to the touch. Is recorded (step S552).

  On the other hand, when no touch is detected (step S550: No), the process of step S552 is skipped and the process proceeds to step S560.

  Following step S522, step S520 (No), step S552, or step S550 (No), it is determined whether or not the reproduction is finished (step S560). For example, the reproduction unit 140 determines that the reproduction is finished when the music is reproduced to the end or when an instruction to end the reproduction is received via the touch sensor 10. If the reproduction is not finished (step S560: No), the process returns to step S504. On the other hand, in the case of the end of reproduction (step S560: Yes), this flowchart ends.

  That is, the electronic device 6a includes a motion detection unit (acceleration sensor 50, a touch detection unit (touch sensor 10) that detects a user touch, and a music specification reception unit (touch) that receives a music specification. Sensor 10), playback means (playback unit 140) for playing back the designated music piece, gripping mode recognition means (holding mode recognition unit 120) for recognizing the gripping mode of the casing by the user, and the gripping mode by the user is a predetermined grip In the case of the aspect, the recording means (recording unit 270) for recording the sound being reproduced by the reproducing means, and the reproducing means are provided with sound effects (first sound effects, first sound effects) corresponding to the movement or touch of the housing. Sound effect superimposing means (a first sound effect superimposing unit 230 and a second sound effect superimposing unit 240) for superimposing and reproducing the sound effect on the designated music being reproduced.

  When the playback means is playing the sound effect superimposed on the designated music, if the user's grip mode is the predetermined grip mode, the recording unit will play the music after the sound effect is superimposed (designated) (Sound with sound effects superimposed on the music). The music after the sound effect is superimposed is stored in the storage unit 180. After that, when the recorded music on which the sound effect is superimposed (that is, the music on which the sound effect is superimposed and stored in the storage unit 180) is designated by the music designation accepting means, the reproducing means has the sound effect as the designated music. Play the superimposed music. During the reproduction of the music after superimposing the sound effect, the sound effect superimposing means further reproduces the sound effect according to the movement or touch of the casing by further superimposing it on the music after the sound effect superimposition being reproduced. In addition, when the reproduction unit reproduces the sound effect by further superimposing it on the music after the sound effect is superimposed, if the user's grip mode is a predetermined grip mode, the recording unit displays the effect being reproduced. The music after the sound superimposition (sound obtained by further superimposing the sound effect on the music after the sound effect superimposition) is recorded. The music after the sound effect is superimposed is stored in the storage unit 180.

FIG. 4 is a screen example displayed on the display screen 12. Specifically, it is an example of a screen displayed when sound effects are superimposed.
For example, as shown in FIGS. 4A and 4B, an indicator is provided on the screen (sound effect superimposition screen) displayed when the sound effect is superimposed. “TRK1”, “TRK2”, “TRK3”, and “TRK4” in the indicator indicate selectable tracks. Each track is assigned a first sound effect and a second sound effect. That is, the storage unit 180 stores the first sound effect and the second sound effect one by one in association with each track.

  The user selects a desired music on the music operation screen (not shown), and selects a track by tapping on the sound effect superimposition screen. In the example of FIGS. 4A and 4B, track 1 is selected. To cancel / clear a track, select the track again.

  When the user shakes (shakes) the case during the reproduction of the music, the first sound effect assigned to the selected track is reproduced. That is, the first sound effect is reproduced while being superimposed on the music. Further, when the user taps (touches) a predetermined area of the display screen 12 (for example, within the broken line frame shown in FIG. 4A) during the reproduction of the music, the second sound effect assigned to the selected track. Is played. That is, the second sound effect is reproduced while being superimposed on the music.

In addition, although it has been described that the first and second sound effects are assigned to each track one by one, two or more first and second sound effects may be assigned to each track. For example, different first sound effects may be assigned depending on the direction of the shake (vertical / horizontal). Further, for example, different second sound effects may be assigned in accordance with the tap positions (for example, within the four-dot chain lines shown in FIG. 4A).
Also, a large number of sound effects may be stored in the library (and may be added to the library at any time) so that the user can select sound effects to be assigned to each track.

  As shown in FIG. 4B, as a predetermined gripping mode, the user is in a recording state (during recording) while touching the upper side surface portion 16. In the recording state, the indicator lights up (for example, lights up in red). In addition, in the recording state, a metronome sound that engraves the tempo may be reproduced by the user's selection as an aid to the user when adding (superimposing) sound effects.

  The playback music and sound effects are controlled so as to have a tempo by automatic quantization. By repeating the operation of performing shake / tap while recording while switching the tracks, the sound effects can be layered over the desired music. Instead of recording the entire song and then playing it again, a certain range (for example, two bars) of the played song may be cut out and automatically repeated (reproduced). As a result, sound effects can be quickly superimposed on a certain range. Also, if the tracks are switched during automatic repeat, many sound effects can be superimposed over a certain range.

  As mentioned above, according to the electronic device 6a, a desired sound effect can be put into a desired music simply and pleasantly. For example, it is possible to perform a solo performance by handling the electronic device 6a such as a tambourine or maraca.

(Second Embodiment)
Subsequently, a second embodiment of the present invention will be described with reference to the drawings. FIG. 5 is an example of a functional block diagram of an electronic device 6b according to the second embodiment of the present invention. FIG. 6 is an explanatory diagram regarding the provision of tempo and the addition of sound effects. The appearance of the electronic device 6b is the same as that of the electronic device 6a according to the first embodiment.

  As shown in FIG. 5, the electronic device 6 b includes a touch sensor (for the side surface portion 16) 20, an acceleration sensor 50, a display unit (touch panel) 100, a grip state recognition unit 120, a playback unit 142, a sound output unit 150, and a storage unit. 190, a tempo assigning unit 250, a sound effect adding unit 260, and a recording unit 270. Note that the touch sensor 20, the acceleration sensor 50, the display unit 100, the grip state recognition unit 120, the audio output unit 150, and the recording unit 270 are the same as those of the electronic device 6a according to the first embodiment. Some or all of them are omitted.

  The storage unit 190 stores various information. For example, the storage unit 190 stores music, sound, tempo-expressing sound, sound effect, and sound recorded by the recording unit 270 (for example, sound after adding a tempo (described later), sound after adding a sound effect (described later)). Remember.

  The reproduction unit 142 reproduces sound. Specifically, the reproduction unit 142 reproduces sounds (sounds such as a piano) stored in the storage unit 190 in response to an instruction (reproduction instruction) received from the user via the touch sensor 10.

In addition, when the movement of the housing is detected by the acceleration sensor 50 during the reproduction of a sound (for example, a sound such as a piano), the reproduction unit 142 represents the tempo of the movement of the housing together with the sound being reproduced. Play sounds (eg, drum sounds). In other words, when the user moves the case during the reproduction of the sound according to the reproduction instruction, the reproduction unit 142 reproduces the sound representing the tempo of the movement of the case by superimposing the sound on the reproduction. Thereby, a tempo is given to the sound being reproduced.
Note that, under the control of the tempo assigning unit 250, the reproducing unit 142 reproduces a sound representing the tempo by superimposing it on the sound being reproduced (details will be described later).

In addition, when the touch sensor 10 detects a touch on the display screen 12 during the reproduction of the sound after the tempo is applied, the playback unit 142 has a sound effect (for example, a touch position or a touch method) together with the sound after the tempo is applied. Sound effects). That is, when the user touches the display screen 12 during the reproduction of the sound after the tempo is applied, the reproduction unit 142 reproduces the sound effect by superimposing the sound on the reproduced sound after the tempo is applied. Thereby, a sound effect is added to the sound after tempo provision.
Note that, under the control of the sound effect adding unit 260, the reproducing unit 142 reproduces the sound effect by superimposing it on the tempo-added sound being reproduced (details will be described later).

  As shown in FIG. 6, the tempo assigning unit 250 adds a tempo based on the tempo of the movement of the housing detected by the acceleration sensor 50 to the sound being reproduced by the reproducing unit 142 (the sound before the tempo is given). Is granted. Specifically, the tempo assigning unit 250 outputs to the playback unit 142 a sound having the same tempo as the tempo of the movement of the housing. Note that the sound before the tempo is given is a piano sound as described above, and a plurality of sounds may be provided for each type of sound. Therefore, the user can add a different tempo for each musical instrument or add the same tempo to the sounds of a plurality of musical instruments as necessary.

  As shown in FIG. 6, the sound effect adding unit 260 adds a sound effect to the sound after the tempo is being reproduced by the reproducing unit 142 based on the touch on the display screen 12. Specifically, the sound effect adding unit 260 adds the sound effect at the timing when the display screen 12 is touched (at the time position when touched). Specifically, the sound effect adding unit 260 outputs the sound effect to the playback unit 142. The sound effect may be the first sound effect or the second sound effect in the electronic apparatus 6a according to the first embodiment. Further, for example, if a button for each sound effect is displayed on the display screen 12, the user can touch the button of the desired sound effect at a desired timing during reproduction and add the sound effect as appropriate.

  The recording unit 270 records the sound being reproduced. For example, the recording unit 270, when the predetermined gripping mode is recognized by the gripping mode recognition unit 120 during the playback by the playback unit 142, the sound after the tempo is applied or the effect to which the tempo is added by the tempo grant unit 250 The sound after adding the sound effect to which the sound effect is added by the sound adding unit 260 is recorded.

  7 and 8 are examples of flowcharts showing the flow of processing of the electronic device 6b. The flowchart in FIG. 7 represents processing related to tempo assignment, and the flowchart in FIG. 8 represents processing related to sound effect addition.

  In FIG. 7, the playback unit 142 receives a playback instruction for a base sound via the touch sensor 10 (step S1500). The playback unit 142 reads out the sound serving as a base related to the playback instruction from the storage unit 190 and starts playback (step S1502). Note that the playback unit 142 continues to play the base sound until it is determined that the playback has ended (step S1560: No).

  The gripping mode recognition unit 120 determines whether or not the gripping mode of the housing by the user is a predetermined gripping mode (step S1504).

  If it is not the predetermined gripping mode (step S1504: No), the tempo providing unit 250 determines whether or not the movement of the housing is detected by the acceleration sensor 50 (step S1510).

  When the movement of the housing is detected (step S1510: Yes), the tempo assigning unit 250 causes the reproduction unit 142 to reproduce the sound that represents the tempo of the movement of the housing by superimposing the sound on the base. In other words, the tempo assigning unit 250 assigns a tempo to the base sound (step S1512).

  On the other hand, when the movement of the housing is not detected (step S1510: No), the process of step S1512 is skipped and the process proceeds to step S1560.

  On the other hand, in the case of the predetermined grip mode (step S1504: Yes), the recording unit 270 starts recording the sound being played back (step S1530). Note that the recording unit 270 continues to record until it is determined that the gripping state is not the predetermined gripping state (step S1504: No). When the tempo assigning unit 250 assigns a tempo during recording of the base sound (when the reproducing unit 142 reproduces a sound expressing the tempo by superimposing it on the base sound) ), And recording the sound that represents the tempo along with the base sound.

  Subsequent to step S1530, the tempo assigning unit 250 determines whether or not the movement of the housing is detected by the acceleration sensor 50 (step S1530).

  When the movement of the housing is detected (step S1540: Yes), the tempo assigning unit 250 assigns a tempo to the base sound (step S1542) as in step S1512. Also, unlike step S1512, the recording unit 270 records the sound after the tempo is added (step S1542).

  On the other hand, when the movement of the housing is not detected (step S1540: No), the process of step S1542 is skipped and the process proceeds to step S1560.

  Following step S1512, step S1510 (No), step S1542, or step S1540 (No), it is determined whether or not the reproduction has ended (step S1560). For example, the playback unit 142 determines that the playback has ended when the base sound is played back to the end or when an instruction to end playback is received via the touch sensor 10. If the reproduction is not finished (step S1560: No), the process returns to step S1504. On the other hand, in the case of the end of reproduction (step S1560: Yes), this flowchart ends.

  In FIG. 8, the playback unit 142 receives a playback instruction for the sound after the tempo is applied via the touch sensor 10 (step S2500). The playback unit 142 reads out the sound after the tempo given according to the playback instruction from the storage unit 190 and starts playback (step S2502). Note that the reproduction unit 142 continues to reproduce the tempo-added sound until it is determined that the reproduction is finished (step S2560: No).

  The grip state recognition unit 120 determines whether or not the grip state of the housing by the user is a predetermined grip state (step S2504).

  If it is not the predetermined grip mode (step S2504: No), the sound effect adding unit 260 determines whether or not the touch sensor 10 detects a touch on the display screen 12 (step S2520).

  When a touch is detected (step S2520: Yes), the sound effect adding unit 260 causes the reproducing unit 142 to reproduce the sound effect corresponding to the touch by superimposing it on the music being reproduced. In other words, the sound effect adding unit 260 adds the sound effect to the sound after the tempo is given (step S2522). Note that the sound effect adding unit 260 reproduces the sound effect for a predetermined time after the touch (or once when the sound effect is counted like a phrase).

  On the other hand, when a touch is not detected (step S2520: No), the process of step S2522 is skipped and the process proceeds to step S2560.

  On the other hand, in the case of the predetermined gripping mode (step S2504: Yes), the recording unit 270 starts recording the sound being played back (step S2530). Note that the recording unit 270 continues to record until it is determined that the gripping state is not the predetermined gripping state (step S2504: No). When the sound effect adding unit 260 adds the sound effect during recording of the sound after the tempo is added (when the playback unit 142 reproduces the sound effect superimposed on the sound after the tempo is applied). ) Record sound effects along with the tempo.

  Subsequent to step S2530, the sound effect adding unit 260 determines whether or not the touch sensor 10 detects a touch on the display screen 12 (step S2550).

  When a touch is detected (step S2550: Yes), as in step S2522, the sound effect adding unit 260 adds a sound effect to the sound after the tempo is applied (step S2552). Further, unlike step S2522, the recording unit 270 records the sound after adding the sound effect (step S2552).

  On the other hand, when a touch is not detected (step S2550: No), the process of step S2552 is skipped and the process proceeds to step S2560.

  Following step S2522, step S2520 (No), step S2552, or step S2550 (No), it is determined whether or not the reproduction is completed (step S2560). For example, the playback unit 142 determines that the playback has ended when the sound after the sound effect addition is played back to the end or when an instruction to end playback is received via the touch sensor 10. When the reproduction is not finished (step S2560: No), the process returns to step S2504. On the other hand, in the case of end of reproduction (step S2560: Yes), this flowchart ends.

  As described above, according to the electronic device 6b, the user first plays the base sound, and shakes the casing while holding the casing in a predetermined gripping mode. Recording with a tempo, and then playing the recorded sound after adding the tempo, touching the display screen 12 while holding the housing in a predetermined holding manner, Furthermore, a sound effect can be added.

  Note that a program for executing processing of the electronic device 6a and the electronic device 6b according to the embodiment of the present invention is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system. By executing, the above-described various processes related to the electronic device 6a and the electronic device 6b according to the embodiment of the present invention may be performed. Here, the “computer system” may include an OS and hardware such as peripheral devices. Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used. The “computer-readable recording medium” refers to a floppy (registered trademark) disk, a magneto-optical disk, an SD card, a writable nonvolatile memory such as a flash memory, a portable medium such as a CD-ROM, and a computer system. A built-in storage device such as a hard disk.

  Further, the “computer-readable recording medium” means a volatile memory (for example, DRAM (Dynamic DRAM) in a computer system that becomes a server or a client when a program is transmitted through a network such as the Internet or a communication line such as a telephone line. Random Access Memory)), etc., which hold programs for a certain period of time. The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, what is called a difference file (difference program) may be sufficient.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes designs and the like that do not depart from the gist of the present invention.

6a, 6b ... Electronic device 10 ... Touch sensor 12 ... Display screen 16 ... Side face part 20 ... Touch sensor (for side face part) 50 ... Acceleration sensor 100 ... Display part 120 ... Grasping state recognition part 140, 142 ... Reproduction part 150 ... Voice Output unit 180, 190 ... storage unit 230 ... first sound effect superimposing unit 240 ... second sound effect superimposing unit 250 ... tempo giving unit 260 ... sound effect adding unit 270 ... recording unit

Claims (7)

An acceleration sensor that detects the movement of the housing;
A touch sensor for detecting a user's touch;
When a specified sound is reproduced and a movement of the housing is detected by the acceleration sensor, the first sound is reproduced while being superimposed on the sound being reproduced, and the touch sensor detects the user's touch. And a playback unit that plays back the second sound by superimposing it on the sound being played. The electronic device according to claim 1,
A first sound effect superimposing unit that causes the reproduction unit to reproduce a first sound effect by superimposing it on the music being reproduced, when movement of the housing is detected during reproduction of the music by the reproduction unit;
A second sound effect superimposing unit that reproduces a second sound effect by superimposing on the music being reproduced when a touch is detected during the reproduction of the music by the reproducing unit. Features electronic equipment. The electronic device according to claim 1 or 2,
The first sound effect superimposing unit is
When movement of the case is detected during the reproduction of the music by the reproduction unit, the reproduction unit causes the first sound effect corresponding to the movement of the case to be superimposed on the music being reproduced and reproduced.
When a touch is detected during the reproduction of the music by the reproduction unit, the reproduction unit causes the second sound effect corresponding to the touch position or the touch method to be superimposed on the music being reproduced and reproduced. Electronic equipment. The electronic device according to claim 2 or claim 3,
The first sound effect is
A musical instrument sound, an environmental sound generated in the natural environment or living environment, or a human shout,
The second sound effect is
An electronic device that is a sound other than a sound effect corresponding to a movement of the casing among the performance sound, the environmental sound, or the shout. The electronic device according to claim 1,
When movement of the housing is detected during sound reproduction by the reproduction unit, the reproduction unit reproduces a sound that represents the tempo of the movement of the housing by superimposing the sound on the reproduction. A tempo giving unit for giving a tempo to the sound being played;
When a touch is detected during the reproduction of the sound after the tempo is given by the reproduction unit, the reproduction unit reproduces the sound effect by superimposing the sound after the tempo addition during the reproduction. An electronic device comprising: a sound effect adding unit that adds a sound effect to the sound after the tempo is given. The electronic device according to any one of claims 1 to 5,
A gripping mode recognition unit for recognizing a gripping mode of a housing by a user;
An electronic apparatus comprising: a recording unit that records the sound being reproduced when a predetermined gripping mode is recognized by the gripping mode recognition unit. Movement detection means for detecting movement of the housing, touch detection means for detecting a user's touch,
According to the movement or touch of the housing, the music designation accepting means for accepting the designation of the music, the reproducing means for reproducing the designated music, the recording means for recording the sound being reproduced by the reproducing means, and the reproducing means Sound effect superimposing means for superimposing the sound effect on the designated music being played and playing it,
The recording means is
If the playback means is playing a sound effect superimposed on the designated music, record the sound effect superimposed on the designated music,
The reproducing means includes
When the recorded music after superimposing the sound effect is designated by the music designation receiving means, the music after superimposing the sound effect is played as the designated music,
The sound effect superimposing means, while reproducing the music after the sound effect superimposition, further reproduces the sound effect according to the movement or touch of the housing and further superimposed on the music after the sound effect superimposition being reproduced,
The recording means is
An electronic device characterized in that, when the reproduction means reproduces a sound effect by further superimposing it on the music after the sound effect is superimposed, the sound effect is further superimposed on the music after the sound effect is superimposed.

Images