TWI497483B - Singing support devices, methods and programs - Google Patents

Description

Singing support device, method and program

The present invention relates to a technique (such as a karaoke apparatus) that supports a user's singing of a piece of music.

Previously, a singing support device that can provide various kinds of fun to users has been proposed. For example, Patent Document 1 discloses a karaoke apparatus that displays a moving image in which a singer's image and a virtual dance are combined and displays the same on a display device.

[Previous Technical Literature] [Patent Document]

[Patent Document 1] Japanese Patent Laid-Open Publication No. 2008-10966

However, in the technique of Patent Document 1, since the singer displays the same moving picture of the accompanying dancer, the display content is tedious and the like. In view of the above, the object of the present invention is to achieve a rich and interesting singing.

In order to solve the above problems, the present invention employs the means. In addition, in order to make the present invention easy to understand, in the following description, the parentheses and the respective elements of the present invention and the elements of the respective embodiments to be described later are dealt with, but the purpose is not to limit the scope of the present invention to the embodiment. Illustrative.

The singing support device of the present invention includes: an accompaniment playback unit (for example, an accompaniment playback unit) 52), the accompaniment sound of the music piece is played; the friendship degree setting unit (for example, the friendliness degree setting unit 56) sets the user's friendliness with the image according to the singing experience of the user; and the playback processing unit (for example, The playback processing unit 60) generates a sound or video of the image corresponding to the user-friendliness degree set by the friendliness setting unit when the user sings. In the above configuration, the friendship with the image is set according to the singing experience of the user, and the sound or image of the image is controlled according to the degree of friendship. Therefore, compared with the technique of Patent Document 1, it is possible to realize a rich and interesting singing (for example, providing the user with a rich and interesting karaoke).

In a preferred aspect of the present invention, the playback processing unit includes a sound processing unit (for example, the sound processing unit 62) that changes the voice according to the user's friendliness with the image, and uses the voice as the image. Generated by sound. In the above aspect, since the singing voice of the music is generated from the image, the user can be given a feeling of singing (for example, a duet) together with the image. Further, since the sound of the image is changed in accordance with the degree of friendliness of the user and the image, there is an advantage that the user can be given the incentive to sing the music (for example, the use of karaoke can be promoted). However, the sound generated by the sound processing unit is not limited to the singing voice of the music. For example, the sound processing unit can also generate a cheering image for the user's singing.

In a preferred aspect of the present invention, the sound processing unit sets the singing voice to a song that is good at singing a song, and the lower the friendliness, the song is set to sing a song. singing.

In a preferred aspect of the present invention, the playback processing unit includes an image processing unit (for example, the image processing unit 64) that generates the image in such a manner that the image is changed according to the user's friendliness with the image. Motion picture. In the above aspect, since a moving image of an image is generated (for example, an image is matched with an image of a music dance), a rich and interesting singing can be realized. Moreover, since the action of changing the image is changed according to the friendliness of the user and the image, there is an advantage that the user can be given the incentive to sing the music (for example, the use of karaoke can be promoted).

A preferred embodiment of the present invention includes a video synthesizing unit (for example, The image synthesizing unit 74) combines an image of the image generated by the image processing unit (for example, the image G3) with an image of the user (for example, the image G1) imaged by the imaging device, and the image processing unit combines the image by the image. The distance between the image of the synthesized image and the image of the user (for example, the distance δ) is generated in accordance with the change in the degree of friendliness. In the above aspect, since the image of the user is combined with the image of the image, the user can be given a singing feeling together with the image. Moreover, since the distance between the image of the image and the image of the user is changed according to the degree of friendliness, there is also an advantage that the user can be given a feeling of gradually changing the intimacy of the image and the user.

In a preferred aspect of the present invention, the friendliness setting unit is based on an evaluation value (for example, an evaluation value EA) corresponding to the type of the music sung by the user, and an evaluation value corresponding to the evaluation result of the user's singing skill (for example, The evaluation value is calculated by evaluating the value EB) and a plurality of evaluation values of at least one of the evaluation values (for example, the evaluation value EC) corresponding to the number of sings of the user. In the above aspect, since the degree of friendship is calculated based on a plurality of evaluation values of the user's related singing experience, there is an advantage that the degree of friendliness can be varied with respect to the singing experience of the user.

A preferred embodiment of the present invention includes a fatigue setting unit (for example, an information management unit 92) that sets a fatigue level indicating the degree of fatigue of the image virtual based on the frequency of the user singing of the specified image. . Fatigue is suitable for control of image processing or parameters. For example, the playback processing unit may generate a sound or an image of the image based on the degree of friendliness between the user and the image set by the friendliness setting unit and the fatigue degree of the image. Further, a configuration may be adopted in which the friendliness setting unit controls the degree of friendliness between the user and the image in accordance with the degree of fatigue of the image, or changes the image selectable by the user in accordance with the degree of fatigue of the image. In each of the above configurations, since the control of the image is changed according to the degree of fatigue set by the fatigue level setting unit, the effect of the singer that is rich in fun is particularly remarkable.

In a preferred aspect of the present invention, the playback processing unit generates a sound or image of the image selected by the user in the plurality of images, and the friendship setting unit selects the image according to the user. In the case of the singing experience, the user-selected image is set to be friendly to the user. In the above aspect, since the friendship with the user-selected image (selected image) is set according to the singing experience when the image is selected, it is possible to realize the composition of only one image. The effect of rich and interesting singing is particularly remarkable.

In a preferred example of the configuration of the image to be selected by the plurality of images, the friendship setting unit is configured to make the first image and the plurality of images in the relationship between the singing experience and the friendliness of the user. 2 The image is different in way, setting the friendliness of each image. In the above aspect, since the relationship between the singing experience and the friendliness of the user (for example, the degree of friendship with respect to the change of the singing experience) is different between the first image and the second image, the rich taste can be realized. The effect of singing is particularly remarkable.

In a preferred aspect of the present invention, the accompaniment playing unit plays the accompaniment sound of the music selected by the user among the plurality of music pieces, and changes the user-selectable music piece according to the friendliness degree set by the friendship degree setting unit. In the above configuration, since the user-selectable music is changed according to the degree of friendship, the effect of making a rich and interesting singing is particularly remarkable.

A preferred embodiment of the present invention includes a project-specific unit (e.g., information management unit 92) that is used by a specific user. The project is suitable for the control of image processing or parameters. For example, the project specific part can be used to control the composition of friendship or fatigue according to the items used by the user. Further, the item specifying unit can change the composition of the image selectable by the user based on the item. Specifically, the selection of images to be selected may be prohibited by the use of the item. In each of the above configurations, since the control of the image is changed according to the item specified by the item specifying unit, the effect of the melody of the rich and interesting taste is particularly remarkable.

In a preferred aspect of the present invention, the friendliness setting unit increases the friendliness according to the singing experience of the user, and on the other hand, reduces the friendliness in a specific case. In the above configuration, since the degree of friendship is reduced in a specific situation, the change in the degree of friendship is only an increase in composition, and the change in the degree of friendship (and thus the change in the sound or image of the image) can be varied. Chemical.

The singing support method of the present invention plays the accompaniment sound of the music; the friend-to-image friendship is set according to the singing experience of the user; and the user's singing is generated corresponding to the user-image friendly relationship that has been set. The sound or image of the image.

The program of the present invention is a computer executable person, and causes the computer to execute the following components: an accompaniment playing unit that plays an accompaniment sound of the music piece; a friendliness setting unit that sets the user and the image according to the singing experience of the user And a playback processing unit that generates a sound or video of the image corresponding to the user-image friendlyness set by the friendship level setting unit when the user sings.

The singing support device of the present invention can be realized by a CPU (Digital Signal Processor) such as a DSP (Digital Signal Processor) dedicated to the user's singing support (for example, karaoke), and can also be implemented by the CPU. A general-purpose arithmetic processing device such as a (Central Processing Unit) is implemented in cooperation with a program. The program of the present invention causes the computer to perform the following processing: accompaniment playback processing, which plays the accompaniment sound of the music piece; the friendliness setting process, which sets the user-image friendlyness according to the singing experience of the user; and the playback processing, When the user sings, a sound or an image of the image corresponding to the degree of friendliness of the user and the image set by the friendliness setting unit is generated. According to the above program, the same effects and effects as those of the singing support device of the present invention can be achieved. Furthermore, the program of the present invention is provided in the form of a storage medium readable by a computer, installed outside the computer, or provided in the form of a communication network, and is installed in a computer.

12‧‧‧Operation processing device

14‧‧‧ memory device

16‧‧‧ Input device

22‧‧‧ Radios

24‧‧‧ camera

30‧‧‧Players

32‧‧‧Function device

34‧‧‧ display device

52‧‧‧Accompaniment Play Department

54‧‧‧ Lyrics Play Department

56‧‧‧Friendship setting department

60‧‧‧Play Processing Department

62‧‧‧Sound Processing Department

64‧‧‧Image Processing Department

72‧‧‧Sound Synthesis Department

74‧‧‧Image Synthesis Department

82‧‧‧Singing Evaluation Department

84‧‧‧Subject detection department

92‧‧‧Information Management Department

100A‧‧‧ Karaoke device

100B‧‧‧ Karaoke device

100C‧‧‧ Karaoke device

100D‧‧‧ Karaoke device

CID‧‧‧ Identification Information

DC‧‧‧Image data

DM‧‧‧Action data

DS1‧‧‧ melody data

DS2‧‧ accompaniment information

DS3‧‧‧ Lyrics

EA‧‧‧Evaluation

EB‧‧‧Evaluation

EC‧‧‧Evaluation

F‧‧‧Friendship

M1‧‧‧Memory Department

M2‧‧‧ Memory Department

M3‧‧‧Memory Department

M4‧‧‧ Memory Department

TA‧‧‧Friendship Form

TB‧‧‧Friendship Form

TC‧‧‧Friendship Form

UID‧‧‧ Identification Information

XA1‧‧‧Audio signal

XA2‧‧‧Audio signal

XA3‧‧‧Audio signal

XB1‧‧‧ image signal

XB2‧‧‧ image signal

XB3‧‧‧ image signal

YA‧‧‧Audio signal

YB‧‧‧ image signal

Fig. 1 is a block diagram showing a karaoke apparatus according to a first embodiment of the present invention.

Fig. 2 is a display example of the display device.

Fig. 3 is a block diagram showing the functional configuration of a karaoke apparatus.

Figure 4 is a schematic diagram of the friendship table.

Fig. 5 is a flow chart showing the processing executed by the arithmetic processing unit.

Fig. 6 is a block diagram showing the functional configuration of a karaoke apparatus of a second embodiment.

Fig. 7 is a schematic view showing a friendship table of the second embodiment.

Fig. 8 is a block diagram showing the functional configuration of a karaoke apparatus of a third embodiment.

Fig. 9 is a block diagram showing the functional configuration of a karaoke apparatus of a fourth embodiment.

Fig. 10 is a schematic view showing a friendship table of the fourth embodiment.

Fig. 11 (a) and (b) show examples of display of the display device of the fourth embodiment.

Fig. 12 is a view showing a display example of a display device according to a modification.

Figure 13 is a block diagram of a singing support device (karaoke device).

<First embodiment>

Fig. 1 is a block diagram showing a karaoke apparatus 100A according to a first embodiment of the present invention. As shown in FIG. 1, the karaoke apparatus 100A is realized by a computer system including the arithmetic processing unit 12, the memory unit 14, and the input unit 16.

The arithmetic processing unit 12 executes various control processing and arithmetic processing by execution of a program stored in the memory device 14. The memory device 14 is a program executed by the memory operation processing device 12 or various materials used by the arithmetic processing device 12. As the recording device 14, a well-known recording medium such as a semiconductor recording medium or a magnetic recording medium, or a combination of a plurality of types of recording media can be arbitrarily used. The input device 16 is configured to receive an operation device from the user's instruction to the karaoke device 100A, and includes, for example, a plurality of operation units operable by the user. As the input device 16, for example, an operation panel provided to the casing of the karaoke apparatus 100A or a remote control device separated from the karaoke apparatus 100A can be employed.

As shown in FIG. 1, the sound pickup device 22, the image pickup device 24, and the playback device 30 are connected to the karaoke device 100A. The sound pickup device 22 supplies the sound signal XA1 of the voice of the user to the karaoke apparatus 100A. In addition, a diagram of an A/D converter that converts the acoustic signal XA1 from analog to digital is omitted for convenience. The imaging device 24 supplies the video signal XB1 of the video of the space in which the user is present to the karaoke device 100A.

The karaoke apparatus 100A of the first embodiment is a signal processing device that generates an acoustic signal YA and a video signal YB. The playback device 30 is configured to execute an element corresponding to the playback operation corresponding to the instruction from the karaoke device 100A, and includes the playback device 32 and the display device 34. The sound emitting device 32 (for example, a speaker or an earphone) plays an audio corresponding to the acoustic signal YA supplied from the karaoke apparatus 100A. In addition, a diagram of an amplifier that converts the acoustic signal YA from digital to analog D/A converter or amplified acoustic signal YA is omitted. The display device 34 (for example, a liquid crystal display panel) displays an image corresponding to the image signal YB supplied from the karaoke device 100A. 2 is a schematic diagram of an image displayed on the display device 34 when the user sings. As shown in FIG. 2, the display device 34 displays the image G1 of the user imaged by the imaging device 24, the image G2 of the background of the user, and the image G3 of the virtual image (a figure symbolizing the virtual creature). And the image G4 of the lyrics of the user singing music.

Fig. 3 is a block diagram showing the functional configuration of the karaoke apparatus 100A of the first embodiment. As shown in FIG. 3, the arithmetic processing unit 12 is a plurality of elements for generating an acoustic signal YA and a video signal YB by executing a program stored in the memory device 14 (accompaniment play unit 52, lyrics playback unit 54, friendship degree). The setting unit 56, the playback processing unit 60, the sound synthesizing unit 72, and the video synthesizing unit 74) function. Furthermore, a configuration may be employed in which the functions of the arithmetic processing unit 12 are shared by a plurality of integrated circuits, or a part of the functions of the arithmetic processing unit 12 is realized by a dedicated electronic circuit (DSP). Each of the memory unit M1, the memory unit M2, and the memory unit M3 illustrated in FIG. 3 is a memory area set in the memory device 14. Furthermore, the memory unit M1, the memory unit M2, and the memory unit M3 may be realized by another recording medium.

The memory unit M1 memorizes the music material DS for each piece of music. The music piece DS of each piece of music includes melody data DS1, accompaniment data DS2, and lyrics data DS3. The melody data DS1 specifies the main melody of the music (singing part), and the accompaniment data DS2 specifies the accompaniment of the music. The lyrics data DS3 specifies the lyrics of the music. Each of the melody data DS1, the accompaniment data DS2, and the lyrics data DS3 is time-series data described by, for example, a MIDI (Musical Instrument Digital Interface) standard format.

The memory unit M2 memorizes the image data DC of the appearance of the designated image for each of the plurality of types of images. The image data DC of the selected image is displayed on the display device 34 based on the image data DC of the image selected by the user (hereinafter referred to as "selected image") in the plurality of image data DCs stored in the memory unit M2. Further, the memory unit M2 is a plurality of pieces of motion data DM that memorize the operation of the designated image. The motion data DM of the first embodiment is time-series data (for example, a file in the VMD format or the PMD format) that defines the motion of the image dance. Specifically, the action data DM specifies the constituent elements of the dance (for example, basic operations such as rotation or advancement) in time series for each beat of the music.

The plurality of motion data DM corresponding to the dance different from the smart one is stored in the memory unit M2. In the first embodiment, the operation of designating a plurality of types of images by the common operation data DM is exemplified, but it is also preferable to separately prepare a plurality of pieces of motion data DM for each image. Further, a plurality of pieces of action data DM may be separately prepared for each piece of music.

The memory unit M3 memorizes the friendship table TA of FIG. The friendliness table TA specifies the user-image friendlyness F for each of a plurality of images for each user. Specifically, as shown in FIG. 4, each of the identification information UID (UID_001, UID_002, ...) given to each user and the identification information CID given to each image inherently are displayed ( The combination of CID_001, CID_002, ...) specifies the degree of friendliness (F1, F2, F3, ...). The friendship degree F is an index value indicating the degree of friendliness (intimacy) between the user and the image.

The accompaniment playback unit 52 of Fig. 3 plays the accompaniment sound of the music. Specifically, the accompaniment playback unit 52 sequentially processes the accompaniment data DS2 of the music material DS of the music piece DS (hereinafter referred to as "selection track") stored in the plurality of pieces of music data DS of the memory device 14 by the user. The acoustic signal XA2 of the accompaniment sound is generated. The lyrics playing unit 54 generates the video signal XB2 by sequentially processing the lyrics data DS3 of the selected music piece data DS. The image signal XB2 indicates the image G4 of the lyrics of the selected song (the image of the time series in which the characters of the lyrics are eliminated). In order to generate the acoustic signal XA2 (playing of the accompaniment sound) by the accompaniment playback unit 52, Alternatively, the lyrics playback unit 54 generates the video signal XB2 (play of lyrics), and any well-known technique can be arbitrarily employed.

The friendliness degree setting unit 56 variably sets the friendship degree F of each user. Specifically, the friendliness degree setting unit 56 variably sets the friendliness degree F of the user based on the user's past experience of singing the music (hereinafter referred to as "singing experience"). In the friendship degree setting unit 56 of the first embodiment, after the user selects the desired image, the friendship degree table TA in the memory unit M3 is set in combination with the user and the image based on the singing experience when the user is singing the music. (The combination of the identification information UID and the identification information CID) corresponds to the friendship degree F. Furthermore, after the user selects an image, the song has not been sung in the past, and the singing experience is set to none (zero).

The playback processing unit 60 of FIG. 3 generates an image of the selected image and the selected image. The playback processing unit 60 of the first embodiment includes a sound processing unit 62 and a video processing unit 64. The sound processing unit 62 simultaneously generates an acoustic signal XA3 indicating the sound (song) of the selected image singing selection song, together with the singing by the user. Specifically, the sound processing unit 62 synthesizes the acoustic signal XA3 by performing sound synthesis processing using the melody data DS1 of the music composition DS of the selected music and the lyrics data DS3. The sound synthesis processing by the sound processing unit 62 can arbitrarily adopt a well-known sound synthesis technique, and it is preferable to adjust the sound unit corresponding to the lyrics sequentially designated by the lyrics data DS3 to the melody data DS1. High-quality, unit-connected sound synthesis processing that is connected to each other on the time axis. A sound unit (for example, a diphone or a triphone) corresponding to the lyrics is prepared in advance for each image and stored in the memory device 14. Further, the sound processing unit 62 may generate an acoustic signal XA3 of a singing voice other than the portion of the user's singing (for example, the other part of the duet or the chorus of the chorus). Further, a configuration may be adopted in which the dedicated data for the acoustic signal XA3 for generating the vocal image of the selected image is prepared separately from the karaoke material used for the melody play or the lyric display, and is used by the sound processing unit 62.

The acoustic signal XA3 generated by the sound processing unit 62 is based on the user and the selected image even if the selection song is common (the melody data DS1 or the lyric data DS3 is common). The friendship F changes. In the first embodiment, the sings indicated by the acoustic signal XA3 are controlled in accordance with the degree of friendship F. That is, the higher the friendliness F between the user and the selected image, the acoustic signal XA3 that is good at singing the song of the song selection is generated, and if the friendship F between the user and the selected image is lower, the generation is lower. Singing the sound signal XA3 of the song of the selection song.

Specifically, the sound processing unit 62 generates the acoustic signal XA3 by controlling the parameters of the sound synthesis processing in accordance with the degree of friendship F. For example, the sound processing unit 62 adds an error Δ corresponding to the friendliness F to the parameter of the standard singing (for example, pitch, volume, or pronunciation point) specified by the melody material DS1 of the selected song, and performs sound synthesis processing. The higher the friendliness F, the error Δ is set to a smaller value. Therefore, the higher the degree of friendship F, the acoustic signal XA3 which is close to the singing voice of the standard singing specified by the melody data DS1 (i.e., good at singing) is generated, and the lower the friendship F is, the deviation from the standard singing specified by the melody data DS1 is generated. The acoustic signal XA3 of the singing voice (ie, singing). Further, parameters such as the depth or period of the vibrato attached to the singing effect of the selected image may be controlled according to the friendliness F.

The video processing unit 64 of FIG. 3 simultaneously generates a video signal XB3 indicating a moving image of the selected image together with the singing of the user. Specifically, the image processing unit 64 generates an image by applying the motion data DM stored in the memory unit M2 and the image processing of the image data DC of the selected image (for example, stereoscopic image processing including modeling or rendering). Signal XB3. Therefore, the video signal XB3 of the motion image of the action (the dance synchronized with the music) designated by the motion data DM is generated as the selected image of the appearance specified by the image data DC.

The image signal XB3 indicates that the action of selecting an image changes in the case where the selected image or the selected image is common, and also changes according to the friendliness F of the user and the selected image. In the first embodiment, the operation (dance) indicated by the video signal XB3 is controlled based on the degree of friendship F. Specifically, the video processing unit 64 selects the plurality of motion data DMs stored in the memory unit M2, and the motion data DM corresponding to the friendship level F is applied to the generation of the video signal XB3. For example, the image processing unit 64 selects the dance action data DM that is good if the friendship F is higher, and selects the dance information DM of the poor dance if the friendship F is lower. Therefore, the user and the selected image The higher the degree of friendship F is, the image signal XB3 of the moving image in which the selected image is good (for example, in a smooth motion) is generated, and the lower the friendliness F between the user and the selected image, the generation of the selection is generated. The image signal XB3 of the moving image of the dance is poor (for example, in a stiff motion).

The sound synthesizing unit 72 of Fig. 3 is an acoustic signal XA1 of the vocal sound of the user supplied from the sound pickup device 22, an acoustic signal XA2 of the accompaniment sound generated by the accompaniment playback unit 52, and a selected image generated by the sound processing unit 62. The acoustic signal XA3 is sung and the acoustic signal YA is generated. The acoustic signal YA generated by the acoustic synthesizing unit 72 is supplied to the sound emitting device 32, thereby playing the user's singing voice, selecting the accompaniment sound of the music, and selecting the singing voice of the image. Further, the video synthesizing unit 74 generates a video signal XB1 supplied from the imaging device 24, a lyric image signal XB2 generated by the lyric playback unit 54, and a video signal XB3 of the image of the selected image generated by the video processing unit 64. Image signal YB. The video signal YB generated by the video synthesizing unit 74 is supplied to the display device 34, whereby the video of FIG. 2 including the user's image G1, the background image G2, the selected image image G3, and the lyric image G4 is displayed. Therefore, the user can sing the selection song with the desired image duet.

FIG. 5 is a flowchart of processing executed by the arithmetic processing unit 12. The processing of FIG. 5 is executed each time the user instructs the karaoke apparatus 100A to perform a duet with the image by the operation of the input device 16. The user instructs the karaoke apparatus 100A to appropriately identify the identification information UID, the desired selection song, and the desired selection image by appropriately operating the input device 16. Upon receiving the above instruction from the user (S10), the arithmetic processing unit 12 functions as the friendliness setting unit 56, and searches for the identification information of the user received in step S10 from the friendship table TA in the memory unit M3. The friendship degree F corresponding to the combination of the UID and the identification information CID of the selected image (S11).

When the performance of the music is started, the arithmetic processing unit 12 functions as a component of FIG. 3 in parallel with the singing of the user's selection song (karaoke processing), thereby generating the acoustic signal YA and the video signal YB (S12). ). That is, the accompaniment playback unit 52 selects a song by The melody data DS1 is processed to generate an accompaniment sound signal XA2, and the lyrics playback unit 54 generates a lyric image signal XB2 by selecting the music lyrics data DS3. The sound processing unit 62 performs sound synthesis processing for applying the parameters corresponding to the friendliness F specified in step S11 to the melody data DS1 and the lyrics data DS3 of the selected music, thereby generating the acoustic sound signal XA3 of the song of the selected image. The image processing unit 64 executes image processing in which the motion data DM corresponding to the friendliness F specified in step S11 is applied, and the image data DC of the selected image indicated in step S10 is applied, thereby generating dynamics of the selected image dancing. Image signal XB3 of the image. Further, the sound synthesizing unit 72 supplies the acoustic signal YA in which the acoustic signal XA1, the acoustic signal XA2, and the acoustic signal XA3 are combined to the sound emitting device 32, and the image combining unit 74 combines the image signal XB1, the image signal XB2, and the image signal XB3. The image signal YB is supplied to the display device 34.

When the karaoke processing of step S12 is completed, the arithmetic processing unit 12 functions as the friendship degree setting unit 56 of FIG. 3, thereby updating the friendship degree table TA stored in the memory unit M3, and The friendship F corresponding to the combination of the identification information UID indicated in step S11 and the identification information CID of the selected image (S13). Specifically, the friendliness degree setting unit 56 adds the variable f to the friendship degree F corresponding to the user and the selected image. The variable f is a specific positive number. Therefore, the more the user specifies the number of times the image is to be sung, the more the degree of friendship F between the user and the image increases. That is, the friendship degree F is variably set according to the singing experience (singing number of times) of the user.

According to the first embodiment described above, the degree of friendship F with the image is set in accordance with the singing experience of the user, and the singer or action (dance) of the selected image is changed according to the degree of friendship F. Therefore, compared with the technique of Patent Document 1 which displays only the monotonous motion picture of the dance, the user can provide the karaoke of interest. Further, in the first embodiment, since the singing or the action of the selected image progresses as the degree of friendship F increases, the user has the effect of growing the image and increasing the intimacy by repeating the singing. As a result, there are also The user can be given the advantage of stimulating the music.

<Second embodiment>

Next, a second embodiment of the present invention will be described. In the following description, the same elements as those of the first embodiment are denoted by the same reference numerals as those in the first embodiment, and the detailed description thereof will be appropriately omitted.

Fig. 6 is a block diagram showing a karaoke apparatus 100B of the second embodiment. As shown in FIG. 6, the arithmetic processing unit 12 of the karaoke apparatus 100B of the second embodiment functions as the singing evaluation unit 82 in the same manner as the arithmetic processing unit 12 of the karaoke apparatus 100A of the first embodiment. The singing evaluation unit 82 evaluates the skill of the user singing. Specifically, the singing evaluation unit 82 compares the melody of the singing portion specified by the melody data DS1 of the selected music piece data DS with the vocal sound represented by the acoustic signal XA1 generated by the sound collecting device 22, and calculates the pitch, the volume, or the rhythm. The degree of difference between the two of the music assessment items corresponds to the score SC. Furthermore, the well-known technique can be arbitrarily adopted by the evaluation of the singing of the singing evaluation section 82. The score SC calculated by the singing evaluation unit 82 is displayed on the display device 34 via the image synthesizing unit 74.

Further, the memory device 14 of the second embodiment is used as the memory unit M4 that stores the type data DJ of the type of the music piece for each image. Specifically, the type data DJ specifies the type of music that matches the impression on the appearance of the image. The situation is as follows: for example, the type of image of the appearance of the kimono is DJ will specify the song, and the appearance of the type of image of the child DJ will specify nursery rhymes.

The memory unit M3 of the second embodiment stores the friendship table TB of FIG. 7 in place of the friendship table TA (FIG. 4) of the first embodiment. As shown in FIG. 7, the friendship degree table TB specifies a plurality of evaluation values E (EA to EC) for the combination of the identification information UID of each user and the identification information CID of the image. Each evaluation value E is a value reflecting the singing experience of the user.

The evaluation value EA (EA1, EA2, ...) is set according to the type of music that the user has selected and sang in the past. Specifically, the higher the degree (or similar) of the type of music that the user sang in the past and the type of the selected image type DJ, the evaluation value EA is set. Set to the larger value. The evaluation value EB (EB1, EB2, ...) is set based on the result (score SC) of the singer evaluation unit 82 for evaluating the user's singing skill. Specifically, the higher the score SC of the user's past singing, the higher the evaluation value EB is set. Further, the evaluation value EC is set based on the number of times the user has designated the image to be sung (the number of times the image is duet). Specifically, the more the number of songs specifying the image, the larger the evaluation value EC is set.

The arithmetic processing unit 12 of the second embodiment executes the same processing (Fig. 5) as in the first embodiment. In step S11, the friendship degree setting unit 56 is based on the plurality of evaluation values E (EA~EC) corresponding to the combination of the user identification information UID and the identification information CID of the selection image in the friendship degree table TB of FIG. ), set the friendliness F. Specifically, the friendship degree setting unit 56 calculates the weighted addition of the plurality of evaluation values E as the friendship degree F so as to be expressed by the following formula (1).

F=αA. EA+αB. EB+αC. EC...(1)

Each weighting value α (αA to αC) of the formula (1) is set to a specific positive number. Further, each weighting value α may be set to be variable according to an instruction from the user to the input device 16.

It can be understood from the above description that the type of music that the user sings in the past is consistent with the type corresponding to the selected image (the larger the evaluation value EA), the higher the evaluation of the user's past singing (the larger the evaluation value EB), or The more the user has specified the image to sing in the past (the evaluation value EC is larger), the friendliness F is set to a larger value. Furthermore, the calculation method of the friendship degree F is not limited to the above examples. For example, a configuration may be employed in which the added value of the plurality of evaluation values E is calculated as the friendship degree F, or the degree of friendship F is calculated by an operation of applying a specific function of the plurality of evaluation values E.

The karaoke processing of step S12 of Fig. 5 includes calculation of the score SC by the singing evaluation unit 82 in addition to the processing exemplified in the first embodiment. Further, in step S13, the friendship degree setting unit 56 updates the evaluation values E (EA to EC) recorded in the friendship degree table TB to reflect the numerical value of the current singing.

In the second embodiment described above, the same effects as those of the first embodiment can be achieved. Further, in the second embodiment, since the user-friendship degree F is set based on the plurality of evaluation values E, the change in the friendship degree F of each image is different from that in the first embodiment. The advantages. As can be understood from the description of the second embodiment, the present invention does not necessarily employ a configuration in which the friendliness F itself is memorized in the memory device 14.

<Third embodiment>

Fig. 8 is a block diagram showing a karaoke apparatus 100C of the third embodiment. As shown in Fig. 8, the arithmetic processing unit 12 of the karaoke apparatus 100C of the third embodiment is the same as the arithmetic processing unit 12 of the karaoke apparatus 100C of the first embodiment, and also functions as the subject detecting unit 84. Features. The subject detecting unit 84 detects the image G1 of the user from the video signal XB1 generated by the imaging device 24. By the detection of the image G1 by the subject detecting unit 84, for example, a well-known moving object detecting technique or a face detecting technique can be arbitrarily used.

The video processing unit 64 of the third embodiment changes the distance δ between the video G1 of the user indicated by the video signal YB generated by the video synthesizing unit 74 and the video G3 of the selected image according to the friendship F (see FIG. 2). In the manner, the position of the selected image is selected to generate the image signal XB3. Specifically, the image processing unit 64 generates the video signal XB3 so that the distance δ between the user's image G1 and the image G3 of the selected image is reduced as the user's degree of friendship F with the selected image is higher.

In the third embodiment, the same effects as those of the first embodiment can be achieved. Further, in the third embodiment, since the distance G of the user's image G1 and the image G3 of the selected image is displayed in accordance with the degree of friendship F, the effect of providing a karaoke with rich interest is particularly remarkable. Specifically, since the distance F is reduced by the user repeatedly selecting the desired image, the distance δ between the two is reduced, so that the user can be intimate with the image along with the image. The feeling of repetition and gradual increase in singing. In the above description, the third embodiment has been described based on the first embodiment, but the third embodiment may be used. The configuration is applied to the second embodiment.

<Fourth embodiment>

As shown in FIG. 9, the arithmetic processing unit 12 of the karaoke apparatus 100D of the fourth embodiment functions as the information management unit 92 in the same manner as the arithmetic processing unit 12 of the karaoke apparatus 100A of the first embodiment. The information management unit 92 variably sets an element (fatigue degree setting unit) that is an index of the degree of fatigue of the display image virtualness, that is, the fatigue degree J. Further, the memory unit M3 of the fourth embodiment stores the friendship table TC of FIG. 10 instead of the friendship table TA (FIG. 4) of the first embodiment. As shown in FIG. 10, the friendship degree table TC specifies the user-to-image friendship degree F and the image fatigue degree J for the combination of the identification information UID of each user and the image identification information CID.

The sound processing unit 62 of the present embodiment controls the parameters of the sound synthesis processing based on both the user's friendship degree F with the selected image and the fatigue degree J of the selected image. In other words, the acoustic signal XA3 generated by the sound processing unit 62 of the present embodiment may be at least one of the friendliness F and the fatigue degree J even when the selection song is common (the melody data DS1 or the lyrics data DS3 are common). And change. Specifically, even if the degree of friendship F is set to a specific value, for example, the lower the fatigue degree J of the selected image, the acoustic signal XA3 is generated, which is close to the singing voice of the standard singing specified by the melody data DS1 ( That is, it is good at singing the song of the selection song); and the higher the fatigue degree J of the selected image, the acoustic signal XA3 is generated, which is the singing voice that deviates from the standard singing specified by the melody data DS1 (ie, sings the singing selection song) The voice of the song). The control of the sound corresponding to the friendliness F is the same as that of the first embodiment. In other words, in the fourth embodiment, the sings indicated by the acoustic signal XA3 are controlled based on the degree of friendship F and the degree of fatigue J.

Further, the video processing unit 64 of the present embodiment controls the operation of selecting an image based on both the degree of friendship F between the user and the selected image and the degree of fatigue J of the selected image. Specifically, even if the friendship degree F is set to a specific value, for example, the lower the fatigue degree J of the selected image, the more the selected image is good for the dance action data DM, and the image is selected. The higher the fatigue degree J, the more the action picture DM of the image poor dance is selected. The control of the image based on the degree of friendship F is the same as that of the first embodiment. That is, in the fourth embodiment, the operation of selecting an image is controlled based on the friendship degree F and the fatigue degree J. Fig. 11 is a schematic view showing an image displayed on the display device 34 when the user sings in the embodiment. The fatigue degree J of the selected image shown in part (a) of Fig. 11 is lower than the fatigue degree J of the selected image shown in part (b) of Fig. 11. As can be understood from Fig. 11, in the present embodiment, the expression or posture of the selected image expressed in the image G3 changes according to the fatigue degree J. Specifically, the higher the degree of fatigue J, the more the selected image is displayed with fatigue. Therefore, the user can intuitively and visually grasp the fatigue degree J of the selected image. Further, a text indicating the fatigue degree J (for example, the value of the fatigue degree J) may be displayed.

In step S11 of FIG. 5, the information management unit 92 of the present embodiment searches for the friendship degree F and the fatigue degree J corresponding to the combination of the user identification information UID and the image identification information CID from the friendship degree table TC. In the karaoke processing of step S12 of FIG. 5, as described above, the sound signal XA3 of the sound processing unit 62 is generated and the image signal XB3 of the image processing unit 64 is generated based on the friendliness F and the fatigue degree J specified in step S11. generate. The information management unit 92 updates the friendship degree F and the fatigue degree J of the selection image recorded in the friendship degree table TC in step S13 of FIG. Specifically, the information management unit 92 adds a specific value to the fatigue degree J of the selected image. That is, each time the image is designated as the selection image (karaoke processing), the fatigue degree J of each image increases. As can be understood from the above description, the fatigue degree J of each image can also be regarded as an index for selecting the image as the frequency of selecting the image (the number of selections per unit time) when the user sings the music.

Further, the information management unit 92 reduces the fatigue degree J of the image recorded in the friendship degree table TC with time. Specifically, the information management unit 92 subtracts a specific value from the fatigue degree J of each image every predetermined time (for example, every one hour). That is, the fatigue degree J of each image is reduced in accordance with the time elapsed after the end of the singing in which the image is designated as the selected image. As can be understood from the above description, the fatigue degree J of each image increases every time the song is sung, and every The specific time decreases with time. Therefore, the fatigue degree J of each image is increased in the case where the user performs the duo with the image at a high frequency (the case where the increase rate of the fatigue degree J is higher than the decrease speed), and the interval of the duet is sufficiently ensured (fatigue degree) The increase rate of J is lower than the case of decreasing speed).

In the fourth embodiment, the same effects as those of the first embodiment can be achieved. Further, in the fourth embodiment, since the sound or image of the image is generated based on the friendship F and the fatigue degree J, the realism of the image is improved, so that the effect of providing the user with the karaoke of interest is particularly remarkable. . Further, in the fourth embodiment, since the user over-executes the same image duet at a high frequency, the fatigue degree J increases, and the singing or the operation of the selected image is deteriorated, so that the user can be suppressed in a short time. Focus on performing a duet with the image. Therefore, the possibility of the user being bored with the duet of the image in a short time can be reduced. In the above description, the fourth embodiment has been described based on the first embodiment, but the configuration of the fourth embodiment may be applied to the second embodiment or the third embodiment.

<Fifth Embodiment>

In the fifth embodiment, the item obtained by the user can be applied to karaoke. The karaoke apparatus 100 of the fifth embodiment is configured similarly to the fourth embodiment, and includes an information management unit 92. The information management unit 92 of the fifth embodiment is an item used by a specific user. For example, the user can input an identification code (for example, a barcode or a QR code (registered trademark)) attached to a specific product purchased in the physical store by the input device 16 such as a reading device, and indicate the same. Use of items corresponding to the product. The information management unit 92 specifies an item to be used by acquiring an identification code input from the input device 16. Moreover, the user can obtain and use the virtual item by appropriately operating the input device 16. For example, the following configuration may be employed: the user is given a specific item on the condition that the settlement process of the virtual currency is established, or the achievement of an activity such as a game provided by the karaoke device (for example, a score higher than a specific value SC) For the target activity, the user is given a specific item. The information management unit 92 is based on the operation of the input device 16, and the specific user is referred to as the object of use. Show the virtual project. As described above, the user can instruct the information management unit 92 to use the various items that it has obtained.

The information management unit 92 controls the friendship degree F or the fatigue degree J of the friendship degree table TC according to the item used by the user. For example, the information management unit 92 controls one of the friendship degree F and the fatigue degree J according to the type of the item used by the user. Specifically, when the user uses the "throat lozenge" item, the fatigue degree J of the selected image is reduced, and the user's use of the "microphone" item increases the friendliness F of the selected image. The variable of the friendliness F or the fatigue degree J may be fixed to a specific value, but the variable of the friendliness F or the fatigue degree J may be variably controlled, for example, according to the kind of the item used by the user.

In the fifth embodiment, the same effects as those of the first embodiment can be achieved. In the fifth embodiment, since the friendliness F or the fatigue degree J is controlled according to the item used by the user, the effect of improving the taste of the karaoke is particularly remarkable. For example, compared with the case where only the friendship F is increased with the duet of the image, the friendship F can be increased in a short time by using the item. Moreover, since the item corresponding to the item can be applied to the karaoke by reading the identification code of the product purchased by the user, there is also an advantage of promoting the sale of the product.

<variation>

Various modifications can be made to the above various aspects, and specific modifications are exemplified below. The pattern of 2 or more arbitrarily selected from the following examples can be combined as appropriate.

(1) The relationship between the singing experience of the user and the friendliness F of the image (change in the degree of friendship F corresponding to the singing experience) may be different for each image. For example, it is possible to individually set the variable f (the increase amount of the friendlyness F) added to the friendship F in the step S13 of the first embodiment for each image. Further, each weighting value α (αA to αC) applied to the calculation-friendliness F in step S12 of the second embodiment can be individually set for each image. According to each of the configurations exemplified above, it is possible to individually control the ease with which the friendship F corresponding to the singing experience is increased for each image. Furthermore, there is no need to make the relationship between the singing experience and the friendship degree F different in all the images. That is, it is preferable to focus on two specific images in a plurality of images (Fig. 1) In the case of the image, the second image, the relationship between the singing experience and the friendliness of the user is different between the first image and the second image.

(2) The relationship between the singing experience of the user and the friendliness F of the image may also be changed according to the attribute information of the user (for example, age or gender). Specifically, each of the plurality of images records the attribute information in advance, and inputs the attribute information of the user before starting the singing, and the relationship between the attribute information of the user and the attribute information of the selected image (for example, the degree of difference). Control the relationship between singing experience and friendship F. For example, it is preferable that the user's age is closer to the age of the selected image, and the degree of friendship F is controlled to be easily increased according to the singing experience (for example, each of the variable f of the first embodiment or the second embodiment) The weighting value α is increased, or the gender of the user is different from the gender of the selected image, and the friendliness F is controlled to be easily increased.

(3) In the above-described embodiments, the parameter applied to the sound synthesis processing is controlled according to the friendliness F. However, the method of generating the acoustic signal XA3 corresponding to the friendliness F is not limited to the above examples. For example, in advance, the memory device 14 maintains a plurality of melody data DS1 specifying different sings for each piece of music, and selects melody data DS1 corresponding to the friendship degree F in the plurality of melody data DS1, which is suitable for the composition of the sound synthesis processing. The acoustic signal XA3 corresponding to the friendliness F can be generated (for example, the higher the friendliness F is, the better the singing acoustic signal XA3).

Further, in each of the above-described embodiments, the motion data DM corresponding to the friendship F is selected from the plurality of motion data DMs prepared in advance, and the video signal XB3 is generated, but the video signal XB3 corresponding to the operation degree F is generated. It is not limited to the above examples. For example, the image processing unit 64 may generate the video signal XB3 by performing image processing in which an error Δ is added to a parameter (for example, a parameter for specifying the amount of movement of each joint of the image) of the operation specified by the motion data DM. For example, the higher the degree of friendship F, the smaller the error Δ is set. Therefore, the higher the degree of friendship F, the image signal XB3 indicating the action close to the standard action (dance) designated by the action data DM is generated.

(4) In each of the above embodiments, a configuration in which one of a plurality of types of images is selected by the user is exemplified, but a configuration in which only one type of image is prepared may be employed. That is, the user's selection of the image can be omitted. Further, in each of the above embodiments, the configuration in which one type of image is selected by the user is exemplified, but the user may select a plurality of images (a plurality of images or the same plurality of images). Each of the plurality of images selected by the user simultaneously performs the same processing as the above-described respective forms, thereby generating the acoustic signal XA3 and the video signal XB3. The acoustic signal XA3 indicates the singing voice (chorus sound) of each of the plurality of images, and the video signal XB3 indicates the motion image of each of the plurality of images (dance). Therefore, the user can be given a singing-like feeling together with a plurality of images.

(5) In each of the above embodiments, the image G1 of the user is combined with the image G3 of the image and displayed on the display device 34. However, the image G3 of the image represented by the image signal XB3 may be separately displayed on the display device. 34. For example, a projection type display device (projector) that projects a video on a projection surface such as a screen is used as the display device 34, and if the image G3 of the image is displayed in a size that is about the size of the user or the like, the image is the same as the above-described form. It can give the user a singing-like presence with the image. As can be understood from the above description, the configuration (image forming unit 74) of synthesizing the image G1 of the user and the image G3 of the image (the image synthesizing unit 74) or the image G1 of the imaging user (the imaging device 24) can be omitted.

(6) In the above embodiments, the sound corresponding to the acoustic signal YA is played by the sound emitting device 32, and the image corresponding to the video signal YB is displayed on the display device 34. However, the acoustic signal YA generated by the sound synthesizing unit 72 may be used. The video signal YB generated by the video synthesizing unit 74 is held as a video file in the memory device 14, and is uploaded to the servo device via a communication network (for example, the Internet), and is shared by a plurality of users.

(7) In the second embodiment, the type of the evaluation value E applied to the setting of the friendliness F is not limited to the above-described examples (EA to EC). The second embodiment is included in a form in which the friendliness F is set based on the plurality of evaluation values E. It is preferable that the configuration is set to be friendly based on a plurality of evaluation values E including at least one of the evaluation values E (EA to EC) described above. Degree F. Can also be used The configuration of one evaluation value E is set based on a plurality of elements. For example, one evaluation value E can be calculated based on the evaluation of the user's past singing (score SC) and the number of times the user has specified the image sing in the past. According to the above configuration, since the type of the evaluation value E is smaller than the type of the factor reflected by the friendliness F, the amount of information stored in the evaluation value E of the friendship table T can be reduced, and the friendship degree F can be determined according to various elements. .

(8) In each of the above embodiments, the sound or image of the selected image is controlled according to the friendliness F, but the control object corresponding to the friendliness F is not limited to the sound or image of the selected image. That is, various elements associated with the user's singing (karaoke) can be controlled according to the friendliness F.

Specifically, the arithmetic processing unit 12 (the accompaniment playing unit 52) can be used to control the configuration of the music that the user can select based on the friendship F. For example, the higher the friendliness F of the accompaniment playback unit 52, the greater the number of music pieces selectable by the user (the degree of freedom of selection). Specifically, each time the user sings a piece of music corresponding to the selected image (for example, a theme song selected for each image), the degree of friendship F increases, giving the user the right to select a piece of music that can be dubbed with the selected image. As a preference for increasing the friendliness F with the selected image (reward music). According to the above configuration, the effect of providing the user with a fun (playing) karaoke effect is particularly remarkable.

Further, according to the above-described configuration of controlling the user-selectable music according to the friendship degree F, it is possible to add the above-described configuration of the sound or the image of the selected image according to the friendliness F, but it is also possible to control the sound of the selected image or The composition of the images is implemented separately (i.e., without presupposing the control of the sound or image of the selected image).

(9) In the fourth embodiment, the sound or image of the selected image is controlled based on the degree of fatigue J. However, the content of the processing of applying the fatigue degree J by the information management unit 92 of the fourth embodiment can be appropriately changed. Specifically, the following processing is exemplified.

[9A] The information management unit 92 controls the degree of friendship F between the image and each user based on the fatigue degree J of each image. Specifically, in the update of the friendship F of step S13 of FIG. 5, The information management unit 92 variably controls the variable f (increase amount) of the friendliness F based on the fatigue degree J of the selected image. For example, the higher the fatigue degree J, the less the increase in the friendliness F (i.e., the friendship F is difficult to increase). According to the configuration of controlling the degree of friendship F according to the fatigue degree J, since the duet can be prevented from being performed on the image at a high frequency, the friendship F is greatly increased in a short time, so that the user can be bored and imaged in a short time. The possibility of the second chorus. Further, as shown in the fourth embodiment, in the configuration of controlling the sound or image of the image based on the fatigue degree J, the variation range of the sound or image of the image is limited to the range in which the fatigue degree J changes. On the other hand, in the configuration of the control variable f according to the fatigue degree J, since the fluctuation of the variable f corresponding to the fatigue degree J has a cumulative effect on the friendship F over time, there is also an image that can be made. The sound or image has long been a wide range of changes.

[9B] The information management unit 92 prohibits selection of an image in which the fatigue degree J is higher than a specific value. If the fatigue degree J is lower than a specific value as time decreases, the user is permitted to select the image. In the above configuration, the user over-executes the duo with the same image at a high frequency, and the image cannot be selected due to the increase in the fatigue degree J. Therefore, it is possible to suppress the user from collectively performing the duet with the image in a short time. Therefore, the possibility of the user being bored with the duet of the image in a short time can be reduced. Further, since it is prohibited to select an image in which the fatigue degree J is higher than a specific value, there is an advantage that the user is given the opportunity to select an image different from the image to be prohibited from being selected. In the above configuration, as in the fifth embodiment, the fatigue degree J is lowered by the use of the item, and the fatigue degree J is lowered by the use of the item, whereby the fatigue degree J can be selected again. An image that rises and is forbidden to be selected.

As can be understood from the above description, the information management unit 92 is included as an element (fatigue setting unit) that is a fatigue degree J of the image reflected by the processing or parameter related to setting the image.

(10) In the fifth embodiment, the degree of friendship F or the degree of fatigue J of the selected image is controlled according to the item used by the user. However, the content of the processing executed by the information management unit 92 of the fifth embodiment is not limited. As exemplified above. For example, as exemplified above, it is prohibited to select a configuration in which an image in which the fatigue degree J is higher than a specific value, and the user uses a specific type. In the case of an item (for example, a "bouquet" item in which an image is selected to give a pleasant impression), the license information management unit 92 selects the image (the condition for widening the image selection). As can be understood from the above description, the information management unit 92 is included as an item specifically used by the user, and controls an image-related processing or parameter element (item-specific unit) according to the item.

(11) In the fourth embodiment, the information management unit 92 is configured to set the fatigue degree J. In the fifth embodiment, the information management unit 92 is configured to execute the processing of the item used by the user, but the information management is performed. The content of the processing executed by the unit 92 can be changed as appropriate. For example, the following processing can be exemplified. Further, in the following description, the control of the friendliness F is exemplified, but the information line portion 92 can control the fatigue degree J in the same manner.

[11A] The information management unit 92 controls the friendship degree F or the fatigue degree J according to the weather (climate). Specifically, the information management unit 92 acquires information indicating weather (weather information), and sets the variable f added to the friendship degree F based on the acquired weather information to be variable. For example, the information management unit 92 sets the variable f to be large when the weather indicated by the acquired weather information is rainy, compared with the case of a sunny day. The method in which the information management unit 92 acquires weather information is arbitrary. For example, the information management unit 92 may acquire the weather information of the setting area of the karaoke apparatus 100 by communicating with a specific servo device, or the clerk of the setting shop of the karaoke apparatus may instruct the karaoke apparatus 100 to indicate the weather. According to the above configuration, it is possible to prevent the decrease in the utilization rate of the karaoke apparatus 100 caused by the weather.

[11B] The information management unit 92 controls the friendship degree F or the fatigue degree J based on the installation area of the karaoke apparatus 100. Specifically, the information management unit 92 acquires information (regional information) indicating the area where the karaoke apparatus 100 is installed, and sets the variable f added based on the acquired area information and the friendship degree F to be variable. Further, the variable f can be determined based on the relationship between the installation area of the karaoke apparatus 100 and the type of the image. For example, in the case of selecting an image associated with the setting area of the karaoke apparatus 100 (for example, an image in which one of the names includes the name of the setting region), the variable f can be increased as compared with the case of selecting an unrelated image. . The method in which the information management unit 92 acquires the regional information is arbitrary. For example, the setting of the karaoke device 100 can be employed. The store clerk instructs the karaoke apparatus 100 to indicate the configuration of the installation area. Further, in the karaoke apparatus 100 (for example, a karaoke apparatus of all stores in a specific area) in a plurality of areas, the user specifies a specific image to sing and the friendship F is also increased. According to the above configuration, the effect of providing the user with a fun (playing) karaoke effect is particularly remarkable. Also, the variable f of the friendliness F can be variably controlled for each weekday or each time slot. If the variable f is increased during the period of the karaoke device (in the morning period) or the working day (weekday), the customer may be attracted to the user during a small period of time or a working day.

[11C] The information management unit 92 controls the friendship degree F or the fatigue degree J according to the date and time. Specifically, the information management unit 92 acquires information (date and time information) indicating the date and time, and sets the variable f which is added based on the date and time information and the friendliness F to be variable. For example, if a birthday is set for each image, and the image in which the date and time indicated by the date and time information is matched with the birthday is selected, the variable f is increased as compared with the case where the image inconsistent with the birthday is selected. In addition, beforehand, each piece of music corresponds to each season of the four seasons, and the case where the music corresponding to the season specified by the date and time information (for example, the date and time information shows that the situation in August is "summer") is selected, compared to the case where the selection is not The season corresponds to the situation of the music, and the variable f is increased. The method of obtaining the date and time information by the information management unit 92 is arbitrary. For example, a configuration obtained by using the date and time specified by the clock function of the karaoke apparatus 100 as date and time information can be employed. According to the above configuration, the effect of providing the user with a fun (playing) karaoke effect is particularly remarkable.

(12) In the above-described embodiments, the variable f of the friendliness F is a positive number, but a configuration in which the variable f of the friendliness F is set to a negative number (that is, a configuration in which the degree of friendship can be reduced) can be employed. For example, the information management unit 92 reduces the degree of friendship F between the image and the user each time a certain time (for example, 7 days) elapses from the last image selection. According to the above configuration, the user's continued use of the karaoke apparatus 100 is promoted, thereby improving the utilization rate. Moreover, the situation in which the friendship F of the image is reduced after a certain period of time can also be adopted by The user uses the specific item to cause the information management unit 92 to add the friendship degree F (restoration friendship degree F) which is reduced by the lapse of a certain time.

(13) In each of the above embodiments, a case where the user selects one image is exemplified, but it is also preferable that the user can select a plurality of images as the selection image at the same time. That is, as illustrated in FIG. 12, the image G3 of each of the plurality of selected images is displayed on the display device 34 together with the image G1 of the user, and each of the plurality of selected images is performed in the same manner as the above-described respective forms. Generate sounds and images. Furthermore, the sound or action of each of the plurality of images may be the same as or different from the case of individually selecting each of the selected images. For example, the motion data DM in the case where each image is individually selected and the motion data DM in the case where a plurality of images are selected may be separately stored in the memory unit M2 and selectively used. According to the above configuration, the display (action) of the selected image can be diversified. Further, the variable f of the friendliness F in the case of selecting a plurality of types of images may be made variable depending on the combination of the selected image types.

(14) As can be understood from the above description, the singing support device of the preferred aspect of the present invention is integrally shown as a device having the following components: the accompaniment playback unit 52, which plays the music. The accompaniment sound (specifically, the acoustic signal XA2 for generating the accompaniment sound); the friendliness setting unit 56 sets the user-friendship degree F according to the singing experience of the user; and the playback processing unit 60, When the user sings, the sound or image of the image corresponding to the user's image-friendliness F is generated (specifically, the acoustic signal XA3 or the video signal XB3 is generated); the presence or absence of other elements or other elements The specific aspect is arbitrary.

(15) The karaoke apparatus (100A, 100B, 100C) is exemplified in each of the above embodiments, but the present invention is also applicable to apparatuses other than the apparatus dedicated to karaoke. For example, the present invention is also applicable to various devices such as a personal computer, a portable information terminal (such as a mobile phone or a smart phone), or a game device. As can be understood from the above examples, the present invention is included in a device for singing a singing device (singing support device), The karaoke apparatus described in each of the modes is an example of a singing support apparatus. Further, in each of the above embodiments, the arithmetic processing unit 12 executes various control processing and arithmetic processing during execution of the program, but the program can also be stored in a CD-ROM (Compact Disk-Read Only Memory). ) Record media for distribution, or use telecommunications lines such as the Internet for distribution.

This application is based on the Japanese Patent Application No. 2012-084148 filed on Apr. 2, 2012, and the Japanese Patent Application No. 2013-043172 filed on March 5, 2013, The contents are incorporated herein by reference.

[Industrial Applicability]

According to the present invention, it is possible to provide the user with an interesting karaoke.

12‧‧‧Operation processing device

14‧‧‧ memory device

16‧‧‧ Input device

22‧‧‧ Radios

24‧‧‧ camera

30‧‧‧Players

32‧‧‧Function device

34‧‧‧ display device

100A‧‧‧ Karaoke device

XA1‧‧‧Audio signal

XB1‧‧‧ image signal

YA‧‧‧Audio signal

YB‧‧‧ image signal

Claims (14)

A singing support device comprising: an accompaniment playing unit that plays an accompaniment sound of a music piece; and a friendliness setting unit that sings a user who indicates an experience that the user has sung in a state in which the user has selected an image The experience is to set the user's friendliness with the image; and the playback processing unit generates a sound or image of the image corresponding to the user's friendship with the image set by the friendliness setting unit. The singing support device according to claim 1, wherein the playback processing unit includes a sound processing unit that generates the voice as the sound of the image in such a manner that the voice is changed according to the user's friendliness with the image. The singing support device of claim 2, wherein the sound processing unit sets the singing voice to a song that is good at singing the song, and the lower the friendliness, the song is set to sing the song. The voice of the song. The singing support device according to any one of claims 1 to 3, wherein the playback processing unit includes an image processing unit that generates the image in such a manner that the image is changed according to the user's degree of friendliness with the image. Motion picture. The singing support device according to claim 4, further comprising: an image synthesizing unit that synthesizes an image of the image generated by the image processing unit with an image of a user imaged by the imaging device, and the image processing unit performs image synthesis The image of the image is generated in such a manner that the distance between the image of the synthesized image and the image of the user changes according to the above-mentioned friendliness. The singing support device according to any one of claims 1 to 3, wherein the friendliness setting unit is based on an evaluation value including a type of a piece of music sung by the user. The above-mentioned friendship degree is calculated by a plurality of evaluation values of at least one of the evaluation value corresponding to the evaluation result of the user's singing and the evaluation value corresponding to the number of singings of the user. The singing support device according to any one of claims 1 to 3, further comprising a fatigue degree setting unit that sets a fatigue degree indicating a degree of fatigue of the image virtuality based on a frequency of a user singing of the designated image, and The playback processing unit generates a sound or video of the image corresponding to the user-image friendlyness set by the friendship degree setting unit and the image fatigue degree. The singing support device according to any one of claims 1 to 3, further comprising a fatigue degree setting unit that sets a fatigue degree of the image based on a frequency of a user singing the specified image, and the friendship degree setting unit The user's friendliness with the image is controlled according to the fatigue of the above image. The singing support device of claim 7, comprising an item specifying unit that controls the degree of friendship or the degree of fatigue according to an item used by the user. The singing support device according to claim 8, comprising an item specifying unit that controls the degree of friendship or the degree of fatigue according to an item used by the user. The singing support device according to any one of claims 1 to 3, wherein the accompaniment playback unit plays the accompaniment sound of the music selected by the user in the plurality of first music pieces, and changes the user according to the friendship degree set by the friendship degree setting unit. Optional music. The singing support device according to claim 1, wherein the generation of the sound or video of the image based on the friendliness in the playback processing unit is performed when the user sings. a singing support method for playing an accompaniment sound of a music piece; setting a user's friendship with the image according to a singing experience of a user indicating that the user has sung in a state in which the user has selected an image; generating The figure corresponding to the friend-friendliness of the above-mentioned image that has been set Like a sound or an image. A program that is a computer executable and executes the following components: an accompaniment playback portion that plays an accompaniment sound of a music piece; a friendliness setting portion that indicates that the user has sung according to a state in which the user has selected an image a user's singing experience of the experience, setting the user's friendliness with the image; and a playback processing unit that generates the map corresponding to the user's friendship with the image set by the friendliness setting unit Like a sound or an image.