JP7330634B2 - mobile terminal, program - Google Patents

Description

The present invention relates to mobile terminals and programs.

2. Description of the Related Art In recent years, karaoke systems that display images stored in mobile terminals on a monitor during a karaoke performance have become widespread. A karaoke system has also been proposed that generates a background image using image data uploaded from a mobile terminal to a server, and provides a wide variety of background images during a karaoke performance (see, for example, Patent Document 1). The karaoke system described in Patent Literature 1 extracts a plurality of image data from a large number of image data uploaded to a server according to music selected by a user, and combines the plurality of image data. generates a background image.

Japanese Unexamined Patent Application Publication No. 2011-075701

In the karaoke system described in Patent Document 1, a plurality of images are sequentially displayed on the monitor as background images. However, images prepared by the user can be displayed on the monitor as background images at desired timing during karaoke performance. can't.

SUMMARY OF THE INVENTION An object of the present invention is to provide a mobile terminal and a program capable of displaying images prepared by the user in accordance with various timings of music as background images during karaoke performance.

The main invention for achieving the above object is a portable terminal capable of karaoke performance of a musical piece, wherein when an image is shot by a photographing means during the karaoke performance of a musical piece, the image data output from the photographing means is a correlating unit that associates music identification information of the music with performance position information corresponding to shooting timing; and storage means for storing image data captured by the photography means and music identification information and performance position information associated with the image data. and an extraction unit for extracting image data corresponding to the music identification information of the song and performance position information from the storage means when an image is displayed on the display means during the karaoke performance of the song, and a display control unit that causes the display means to display an image based on the image data and the performance position information in accordance with the progression of the performance positions of the music during the karaoke performance.

According to the present invention, the image data is stored in the storage means together with the performance position information according to the shooting timing by the user taking an image during the karaoke performance of the song. When the karaoke performance of a song is started when the image data is stored in the storage means, when the performance position of the song during the karaoke performance progresses to the performance position indicated by the performance position information, the display means is displayed based on the image data. An image is displayed. In this way, images prepared by the user in accordance with various timings of music can be displayed on the display means as background images during karaoke performance.

2 is a functional block diagram of the mobile terminal of the first embodiment; FIG. 4 is a flow chart showing processing operations in a shooting mode of the first embodiment; 4 is a diagram showing an example of performance position information according to the first embodiment; FIG. 4 is a flowchart showing processing operations in a display mode according to the first embodiment; FIG. 10 is a diagram showing another example of performance position information according to the first embodiment; FIG. FIG. 10 is a diagram showing another example of performance position information according to the first embodiment; FIG. 8 is a functional block diagram of a mobile terminal according to a second embodiment; FIG. 9 is a flowchart showing processing operations in a shooting mode of the second embodiment; FIG. 11 is a diagram showing an example of performance position information according to the second embodiment; FIG. FIG. 11 is a functional block diagram of a mobile terminal according to a third embodiment; 11 is a flow chart showing processing operations in a display mode according to the third embodiment;

<First embodiment>
The mobile terminal 10 of the first embodiment will be described below. FIG. 1 is a functional block diagram of the mobile terminal 10 of the first embodiment. For convenience of explanation, the functional block diagram of FIG. 1 mainly shows functional blocks related to the function of generating a background image during a karaoke performance.

As shown in FIG. 1, the mobile terminal 10 is a so-called smart phone, and not only functions as a mobile phone, but also enables taking pictures, viewing websites, viewing videos, and various applications can be freely added. is possible. A karaoke application program for performing a karaoke performance is installed in the portable terminal 10 of the present embodiment. This karaoke application includes various functions such as music reservation, music search, karaoke performance, and song scoring, as well as a background image generation function that uses an image prepared by the user U as a background image during the karaoke performance. .

The mobile terminal 10 includes, as hardware, display means 11 such as a display, photographing means 12 such as a camera, storage means 13 such as a memory, karaoke performance means 14 such as a MIDI sound source, sound collection means 15 such as a built-in microphone, external A sound emitting means 16 such as an attached earphone is provided. A karaoke performance is performed by the karaoke performance means 14 based on the music data, the performance signal of the karaoke performance and the singing voice signal input from the sound collection means 15 are mixed, and the mixed signal is emitted from the sound emission means 16. . Thus, when the user U sings along with the karaoke performance, the singing voice is emitted from the sound emitting means 16 together with the performance sound.

Further, the mobile terminal 10 is provided with a mode selection unit 21, an association unit 22, a storage control unit 23, an extraction unit 24, and a display control unit 25 in order to realize a background image generation function. The mode selection unit 21 selects a shooting mode or a display mode as the operation mode of the mobile terminal 10 . The photographing mode is an operation mode in which an image is photographed by the photographing means 12 during the karaoke performance of a musical piece, and the display mode is an operational mode in which an image is displayed on the display means 11 during the karaoke performance of a musical piece. For example, the operation mode is selected by the mode selection unit 21 by tapping the shooting mode button and the display mode button on the mode selection screen displayed on the display unit 11 .

The associating unit 22 associates the image data output from the photographing means 12 during the karaoke performance of the music in the photographing mode with the music identification information of the music and performance position information corresponding to the photographing timing. In this case, in synchronism with the photographing timing of the photographing means 12, the correlating part 22 acquires the music identification information of the music piece and the performance position information indicating the performance position of the karaoke performance from the karaoke performance means 14. FIG. Then, the music identification information and performance position information are associated with the image data acquired from the photographing means 12 . The performance position information is position information based on the number of measures, and is information indicating the performance position (playback position) in the music data by the karaoke performance means 14 by the measure number.

The storage control unit 23 causes the storage unit 13 to store the music identification information and performance position information associated with the image data together with the image data in the shooting mode. Note that the storage control unit 23 can also delete the image data stored in the storage unit 13 together with the associated music identification information and performance position information in response to an instruction from the user U. The extraction unit 24 extracts image data and performance position information corresponding to the music identification information from the storage unit 13 in the display mode. In this case, the extraction unit 24 acquires the music identification information from the karaoke performance means 14 during the karaoke performance of the music, and extracts a set of image data and performance position information from the storage means 13 using the music identification information as a search key. .

The display control unit 25 causes the display unit 11 to display an image based on the image data and the performance position information in accordance with the progression of the performance positions of the music being played in the display mode. In this case, the display control section 25 acquires a set of image data and performance position information from the extraction section 24 . Then, at the timing when the playing position of the musical piece becomes the playing position indicated by the playing position information, an image is formed from the image data associated with the playing position information and displayed on the display means 11. - 特許庁The image prepared by the user U is used as a background image during the karaoke performance by switching the display of the display means 11 as the karaoke performance of the music progresses.

Also, the display control unit 25 causes the display unit 11 to display a title image based on the title image data and the title information of the music at the start of the karaoke performance of the music. In this case, the display control section 25 acquires the title information of the music data from the karaoke performance means 14 via the extraction section 24 . Then, the title information is combined with the title image data acquired from the storage means 13 via the extraction part 24 and the title image is displayed on the display means 11 . In this manner, the association unit 22 and the storage control unit 23 function in the shooting mode to store the image data for the background image in the storage unit 13, and the extraction unit 24 and the display control unit 25 function in the display mode. , the image for the background image is displayed at a desired timing during the karaoke performance.

Further, the processing of each unit of the mobile terminal 10 may be implemented by software using a processor, or may be implemented by a logic circuit (hardware) formed in an integrated circuit or the like. When a processor is used, various processes are performed by the processor reading and executing programs stored in the memory. For example, a CPU (Central Processing Unit) is used as the processor. In addition, the memory is composed of one or a plurality of storage media such as ROM (Read Only Memory), RAM (Random Access Memory), etc., depending on the application.

Next, processing operations of the mobile terminal 10 will be described. FIG. 2 is a flow chart showing processing operations in a shooting mode according to the first embodiment. FIG. 3 is a diagram showing an example of performance position information according to the first embodiment. FIG. 4 is a flow chart showing processing operations in the display mode of the first embodiment. The flowcharts shown in FIGS. 2 and 4 are examples, and the processing operation of the mobile terminal 10 is not limited to these flowcharts. Further, in FIGS. 2 and 4, the reference numerals in FIG. 1 are appropriately used for description.

As shown in FIG. 2, the karaoke application is operated by the user U, and the operation mode of the portable terminal 10 is set to the shooting mode by the mode selection unit 21 (step S01). Next, the music X is selected by the user U on the music selection screen, and the music data indicated by the music identification information ID**** of the music X is read by the karaoke performance means 14 (step S02). In the photography mode, the user U does not sing karaoke but only listens to the karaoke performance. Therefore, the guide vocal is set to ON so that the user U can easily grasp the performance position during the karaoke performance from the lyrics. preferably.

Next, the karaoke application is operated by the user U, the music data of the music piece X is reproduced by the karaoke performance means 14, and the karaoke performance is started (step S03). The music data may be stored in the storage means 13 of the mobile terminal 10 or distributed from a server (not shown) communicably connected to the mobile terminal 10 . The music data includes bar number information for indicating the performance position of the music as the performance position information. Instead of including bar number information in the music data, the bar number information may be generated from the music data by the karaoke performance means 14 using known techniques such as beat detection.

Next, when a still image is captured by the user U along with the karaoke performance of the song X, image data of the still image is output from the capturing means 12 to the association unit 22 (Yes in step S04). In synchronization with the shooting timing, the performance position information indicating the bar number is acquired by the associating section 22 (step S05). Next, the image data, the music identification information ID****, and the performance position information are stored in the storage means 13 in a state of being associated with each other by the storage control unit 23 (step S06). The processing of steps S04-S06 is repeated until the karaoke performance ends (step S07).

For example, as shown in FIG. 3, eight still images are shot by the shooting means 12 in time with the karaoke performance of the song X by the user U. At this time, when a still image is captured at the 9th bar of music X (1st A melody, A melody 1), image data V01 of this still image is composed of music identification information ID**** and performance position information. is stored in the storage means 13 in association with the bar number M=9. When a still image is captured at the 25th measure (chorus of No. 1, chorus 1) of music X, image data V02 of this still image is associated with music identification information ID**** and measure number M=25. and stored in the storage means 13.

When a still image is captured at the 33rd bar of music X (A melody of No. 2, A melody 2), image data V03 of this still image is converted to music identification information ID**** and bar number M=33. They are stored in the storage means 13 in association with each other. When a still image is captured at the 49th measure (2nd chorus, chorus 2) of the song X, the image data V04 of this still image is associated with the song identification information ID**** and the measure number M=49. and stored in the storage means 13. When a still image is shot at bar 57 (interlude) of music X, image data V05 of this still image is associated with music identification information ID**** and bar number M=57 and stored in storage means 13. remembered.

When a still image is captured at the 73rd bar of music X (A melody of No. 3, A melody 3), image data V06 of this still image is converted to music identification information ID**** and bar number M=73. They are stored in the storage means 13 in association with each other. When a still image is captured at the 81st bar (3rd B melody, B melody 3) of the song X, the image data V07 of this still image is set to the song identification information ID**** and the bar number M=81. They are stored in the storage means 13 in association with each other. When a still image is captured at the 89th measure (3rd chorus, chorus 3) of the song X, the image data V08 of this still image is associated with the song identification information ID**** and the measure number M=89. and stored in the storage means 13.

As shown in FIG. 4, the karaoke application is operated by the user U, and the operation mode of the mobile terminal 10 is switched from the shooting mode to the display mode by the mode selection unit 21 (step S11). Next, the music X is selected by the user U on the music selection screen, and the music data indicated by the music identification information ID**** of the music X is read by the karaoke performance means 14 (step S12). Next, the karaoke application is operated by the user U, the music data of the music piece X is reproduced by the karaoke performance means 14, and the karaoke performance is started (step S13).

Next, the extraction unit 24 extracts the image data and performance position information associated with the music identification information ID**** from the storage unit 13 (step S14). Further, when the performance of the music piece X is started, the title image is displayed on the display means 11 based on the title information and the title image data by the display control section 25 (step S15). Next, when the karaoke singing is started by the user U, and the performance position of the music piece X during the karaoke performance reaches the bar number (M bar) indicated in the performance position information (Yes in step S16), the performance position information corresponds to the performance position information. A still image is displayed on the display means 11 (step S17). The processing of steps S16-S17 is repeated until the karaoke performance ends (step S18).

For example, as shown in FIG. 3, while the user U is singing karaoke, eight still images are sequentially displayed on the display means 11 as background images as the karaoke performance of the song X progresses. When the performance position of the music piece X reaches the ninth bar and the performance interval shifts from the prelude to the first A melody, the display of the display means 11 is switched from the title image to the image based on the image data V01. When the performance position of the music piece X reaches the 25th bar and the performance interval shifts from the first B melody to the first chorus, the display of the display means 11 is switched from the image based on the image data V01 to the image based on the image data V02. .

When the performance position of the music piece X reaches the 33rd bar and the performance section shifts from the chorus of No. 1 to the A melody of No. 2, the display of the display means 11 is switched from the image based on the image data V02 to the image based on the image data V03. . When the performance position of the music piece X reaches the 49th bar and the performance interval shifts from the 2nd B melody to the 2nd chorus, the display of the display means 11 switches from the image based on the image data V03 to the image based on the image data V04. . When the performance position of the music piece X reaches the 57th bar and the performance interval shifts from the chorus of No. 2 to the interlude, the display of the display means 11 is switched from the image based on the image data V04 to the image based on the image data V05.

When the performance position of the music piece X reaches the 73rd bar and the performance interval shifts from the interlude to the third A melody, the display of the display means 11 is switched from the image based on the image data V05 to the image based on the image data V06. When the performance position of the music piece X reaches the 81st measure and the performance interval shifts from the 3rd A melody to the 3rd B melody, the display of the display means 11 changes from the image based on the image data V06 to the image based on the image data V07. switch. When the performance position of the music piece X reaches the 89th bar and the performance interval shifts from the 3rd B melody to the 3rd chorus, the display of the display means 11 is switched from the image based on the image data V07 to the image based on the image data V08. .

As described above, according to the first embodiment, the image data is stored in the storage unit 13 together with the performance position information according to the shooting timing when the user U shoots an image during the karaoke performance of a song. When the karaoke performance of the music is started when the image data is stored in the storage means, the image is displayed on the display means 11 based on the image data when the performance position of the music advances to the performance position indicated by the performance position information. be done. In this manner, images prepared by the user U in accordance with various timings of music can be displayed on the display means 11 as background images during karaoke performance.

Further, since the performance position information is position information based on the number of bars, even if the karaoke performance is performed at a tempo different from that at the time of shooting, the image prepared by the user U can be displayed on the display screen at an appropriate timing. can.

As shown in FIG. 5, performance section information P may be used instead of measure number M as performance position information. In the storage means 13, image data V is stored in association with performance section information P as performance position information. For example, the image data V01 of the image taken in the first A melody of the song X is stored in the storage means 13 in association with the song identification information ID**** and the performance interval information P=02. As a result, the display of the display means 11 is switched from the title image to the image based on the image data V01 when the performance section reaches the first A melody. Note that the music data may include performance segment information P for indicating performance segments.

Also, as shown in FIG. 6, instead of the bar number M, the elapsed time T from the start of the performance may be used as the performance position information. The storage means 13 stores the image data V associated with the elapsed time T as performance position information. For example, image data V01 of an image shot in the first A melody of song X is stored in storage means 13 in association with song identification information ID**** and elapsed time T=16. As a result, the display on the display means 11 switches from the title image to the image based on the image data V01 when 16 seconds have passed since the start of the performance. The time signature of the music piece X is 4/4 time signature, and the tempo of the music piece X is BPM=120. Also, the elapsed time T from the start of the performance may be measured by the karaoke performance means 14 .

<Second embodiment>
A mobile terminal 30 according to the second embodiment will be described. FIG. 7 is a functional block diagram of the mobile terminal 30 of the second embodiment. It should be noted that the mobile terminal 30 of the second embodiment differs from the first embodiment in that a first shooting mode (first mode) and a second shooting mode (second mode) can be selected as shooting modes. do. Therefore, for the second embodiment, the description of the configuration similar to that of the first embodiment will be omitted.

As shown in FIG. 7, the mobile terminal 30 of the second embodiment has substantially the same configuration as the mobile terminal 10 (see FIG. 1) of the first embodiment, and a karaoke application is installed. The portable terminal 30 is provided with display means 31, photographing means 32, storage means 33, karaoke performance means 34, sound collecting means 35, and sound emitting means 36 as hardware. In addition, the mobile terminal 30 includes a mode selection unit 41, an association unit 42, a storage control unit 43, an extraction A unit 44 and a display control unit 45 are provided.

The mode selection unit 41 selects a first shooting mode, a second shooting mode, and a display mode as operation modes of the mobile terminal 30 . The first photographing mode is an operation mode in which images are photographed by the photographing means 32 during the karaoke performance of a musical piece, and is an operational mode for re-photographing images of already photographed musical pieces. The second photographing mode is an operation mode in which images are photographed by the photographing means 32 during karaoke performance of a musical piece, and is an operational mode in which images are additionally photographed for already photographed musical pieces. The display mode is an operation mode in which an image is displayed on the display means 31 during karaoke performance of music.

In the first photographing mode, when the storage control unit 43 stores new image data in the storage unit 33, the image data associated with the same music identification information as the new image data is deleted from the storage unit 33. In the second photographing mode, when the storage control section 43 stores new image data in the storage means 33, the image data associated with the same music identification information as the new image data is left in the storage means 33. The first shooting mode and the second shooting mode can be selected according to the shooting situation of the image for the music, and the re-shooting of the image and the additional shooting of the image can be properly used.

Next, processing operations of the mobile terminal 30 will be described. FIG. 8 is a flow chart showing processing operations in the shooting mode of the second embodiment. FIG. 9 is a diagram showing an example of performance position information according to the second embodiment. The processing operation in the display mode of the second embodiment is the same as the processing operation in the display mode of the first embodiment, so the explanation is omitted. Note that the flowchart shown in FIG. 8 is an example, and the processing operation of the mobile terminal 30 is not limited to this flowchart. Further, in FIG. 8, the reference numerals in FIG. 7 are used as appropriate for description. Further, in the storage means 33, image data associated with music identification information ID**** of music X is stored in advance.

As shown in FIG. 8, the karaoke application is operated by the user U, and the operation mode of the portable terminal 30 is set to the first shooting mode or the second shooting mode by the mode selection unit 41 (step S21). Next, the music X is selected by the user U on the music selection screen, and the music data indicated by the music identification information ID**** of the music X is read by the karaoke performance means 34 (step S22). In addition, in the first shooting mode and the second shooting mode, it is preferable that the guide vocal is set to ON so that the user U can easily grasp the performance position during the karaoke performance from the lyrics.

Next, the karaoke application is operated by the user U, the music data of the music piece X is reproduced by the karaoke performance means 34, and the karaoke performance is started (step S23). When the karaoke performance is started, it is determined whether or not the operation mode of the mobile terminal 30 is the first shooting mode (step S24). When the operation mode of the portable terminal 30 is the first shooting mode (Yes in step S24), the image data associated with the music identification information ID**** is deleted from the storage means 33 by the storage control unit 43. (Step S25). That is, when the image data is stored during the karaoke performance of the song X, the image data associated with the song identification information ID**** stored before the karaoke performance is deleted.

On the other hand, if the operation mode of the mobile terminal 30 is not the first shooting mode (No in step S24), the operation mode of the mobile terminal 30 is the second shooting mode, and the image data is not deleted from the storage means 33. The process proceeds to step S26. That is, when image data is stored during the karaoke performance of the song X, the image data associated with the song identification information ID**** stored before the karaoke performance is not deleted. In this manner, the previous image data is deleted for re-shooting in the first shooting mode, and the previous image data is left for additional shooting in the second shooting mode.

Next, when a still image is photographed by the user U along with the karaoke performance of the song X, the image data of the still image is output from the photographing means 32 to the association unit 42 (Yes in step S26). In synchronization with the shooting timing, the performance position information indicating the bar number is acquired by the associating section 42 (step S27). Next, the image data, the music identification information ID****, and the performance position information are stored in the storage means 33 in a state of being associated with each other by the storage control unit 43 (step S28). The processing of steps S26-S28 is repeated until the karaoke performance ends (step S29).

For example, the user U shoots eight new still images in the first shooting mode in time with the karaoke performance of the song X. At this time, the image data V01-V08 (see FIG. 3) associated with the song identification information ID**** of the song X are deleted from the storage means 33. FIG. Then, the new image data is stored in the storage means 33 in correspondence with the music identification information ID**** and performance position information.

Further, as shown in FIG. 9, the user U additionally shoots two still images in the second shooting mode in time with the karaoke performance of the song X. FIG. At this time, when a still image is additionally captured at the 17th bar of music X (B melody of No. 1, B melody 1), the image data V09 of this still image is combined with the music identification information ID **** and the performance position. It is stored in the storage means 33 in association with the bar number M=17 as information. When a still image is additionally shot at the 41st bar of music X (2nd B melody, B melody 2), the image data V10 of this still image has the music identification information ID**** and the bar number M=41. is stored in the storage means 33 in association with the .

As a result, the first A melody, chorus, the second A melody, the chorus, the interlude, the third A melody, B melody, and the chorus of the song X are shot in the city, etc., and the first B melody, For the second B melody, an image can be taken on the beach or the like. During the karaoke performance of the music piece X, images shot at different locations are displayed, and an image more suited to the performance position (contents of the lyrics) can be prepared.

As described above, according to the second embodiment, as in the first embodiment, images prepared by the user U in accordance with various timings of music can be displayed on the display means 31 as background images during karaoke performance. can. Further, in the first shooting mode, it is possible to re-shoot images for already-shot songs, and in the second shooting mode, it is possible to additionally shoot images for already-shot songs.

<Third Embodiment>
A mobile terminal 50 according to the third embodiment will be described. FIG. 10 is a functional block diagram of the mobile terminal 50 of the third embodiment. The mobile terminal 50 of the third embodiment differs from the first and second embodiments in that an image prepared by the user U is displayed on the monitor (display means) of the karaoke machine 60 . Therefore, in the third embodiment, descriptions of the configurations similar to those of the first and second embodiments will be omitted.

As shown in FIG. 10, the portable terminal 50 of the third embodiment is communicably connected to a karaoke device 60, and a karaoke application is installed in substantially the same manner as the portable terminal 10 of the first embodiment (see FIG. 1). It is The portable terminal 50 is provided with display means 51, photographing means 52, storage means 53, karaoke playing means 54, sound collecting means 55, and sound emitting means 56 as hardware. In addition, the mobile terminal 50 includes a mode selection unit 61, an association unit 62, a storage control unit 63, an extraction A unit 64, an acquisition unit 65, and a transmission unit 66 are provided.

The mode selection unit 61 selects a shooting mode or a display mode as the operation mode of the mobile terminal 50 . The photographing mode is an operation mode in which an image is photographed by the photographing means 52 during karaoke performance of a musical piece, and the display mode is an operation mode in which an image is displayed on the monitor of the karaoke device 60 while the karaoke musical piece is being played by the karaoke device 60.例文帳に追加A display mode may be set in the mobile terminal 50 as a standard operating mode. In this case, the operation mode of the mobile terminal 50 may be temporarily changed from the display mode to the shooting mode only while the shooting mode is selected by operating the karaoke application.

The acquisition unit 65 acquires the music identification information from the karaoke device 60 when the music is selected by the karaoke device 60 in the display mode. The extraction unit 64 extracts from the storage unit 53 image data and performance position information associated with the music identification information acquired from the karaoke device 60 in the display mode. The transmission unit 66 transmits the image data and performance position information extracted by the extraction unit 64 to the karaoke device 60 in the display mode. Then, the karaoke device 60 performs control equivalent to the display control units 25 and 45 of the first embodiment or the second embodiment, and performs image data and performance position information in accordance with the progress of the performance position of the song being played karaoke. An image is displayed on a monitor (not shown) as a background image based on the above.

Next, processing operations of the mobile terminal 50 will be described. FIG. 11 is a flow chart showing processing operations in the display mode of the third embodiment. The processing operation in the shooting mode of the third embodiment is the same as the processing operation in the shooting mode of the first embodiment, so the explanation is omitted. Note that the flowchart shown in FIG. 11 is an example, and the processing operation of the mobile terminal 50 is not limited to this flowchart. Further, in FIG. 11, the reference numerals in FIG. 10 are appropriately used for description.

As shown in FIG. 11, when a song X is selected by the user U on the karaoke device 60, the karaoke device 60 reads the song data indicated by the song identification information ID**** of the song X (step S31). . Next, the music identification information ID**** of the music piece X is transmitted from the karaoke device 60 to the mobile terminal 50, and the music identification information ID**** is acquired by the acquisition unit 65 of the mobile terminal 50 (step S32). Next, the extracting unit 64 extracts the image data and performance position information associated with the music identification information ID**** from the storage unit 53 (step S33). And performance position information is transmitted (step S34).

Next, when the karaoke performance of the song X is started by the user U on the karaoke device 60 (step S35), the title image is displayed on the monitor of the karaoke device 60 based on the title information and the title image data (step S36). ). Next, when the karaoke singing is started by the user U and the performance position of the music piece X during the karaoke performance reaches the bar number indicated by the performance position information (Yes in step S37), the still image corresponding to the performance position information is displayed on the karaoke device. 60 is displayed on the monitor (step S38). The processing of steps S37 and S38 is repeated until the karaoke performance ends (step S39).

As described above, according to the third embodiment, even in the karaoke apparatus, images prepared by the user U can be displayed on the display means (monitor) as background images during karaoke performance in accordance with various timings of music.

In the first and second embodiments, the display control unit displays the title image on the display unit based on the title image data and the title information of the song X, but the present invention is not limited to this configuration. The display control section may cause the display means to display the title image based on the image data whose performance position information is closest to the performance start, or cause the display means to display the title image based on this image data and the title information. good too.

In each of the above embodiments, a still image is used as an image for the background video. good. Even when a moving image is used as a background image instead of a still image, the image data of the moving image output from the photographing means in the photographing mode is associated with music identification information and performance position information corresponding to photographing (starting) timing. While karaoke is being sung in the display mode, moving images are displayed on the display means based on the image data and the performance position information in accordance with the progression of the performance positions of the music.

In addition, in the first embodiment, a photographing mode and a display mode are provided and settable, and in the second embodiment, a first photographing mode, a second photographing mode, and a display mode are provided and settable. is not limited. A configuration in which no particular mode is provided may be used. The storage control unit stores the music identification information and the performance position information associated with the image data together with the image data photographed by the photographing means in the storage means, and the extraction unit stores the music When an image is displayed on the display means during the karaoke performance, the image data and the performance position information corresponding to the music identification information of the song are extracted from the storage means, and the display control unit performs the performance of the song during the karaoke performance An image may be displayed on the display means based on the image data and the performance position information as the position advances.

More specifically, when image data associated with music identification information ID **** of music X is not stored in advance in the storage means, the display control unit causes the display means to display When an image taken by the user U is displayed on a monitor, and image data associated with the music identification information ID **** of the music X is stored in advance in the storage means, the image is displayed during the karaoke performance of the music X. The control unit divides the display area into two areas, displays an image photographed by the user U in one area of the display means, and displays the performance position of the music piece X and pre-stored image data and image data in the other area. An image based on the performance position information may be displayed as a background image. As a result, when adding an image as in the second shooting mode in the second embodiment, it is possible to shoot the image to be added while checking the already shot image.

Further, in each of the above-described embodiments, the display control unit is configured to display an image on the display unit based on the image data, but the configuration is not limited to this. The display control section may cause the display means to display the image with the lyric telop based on the image data and the lyric telop data. In this case, the song data may include lyrics telop data.

Also, in each of the above embodiments, the user takes an image in time with the karaoke performance of a song, but the configuration is not limited to this. The karaoke performance means has a function of pausing (temporarily stopping) the karaoke performance of a musical piece, and the user may pause the karaoke performance at any performance position and take an image. That is, karaoke is being performed until the karaoke performance processing by the karaoke performance means is completely completed. "Capturing an image with the photographing means at the same time" includes photographing an image with the photographing means while posing during karaoke performance.

Further, in each of the above embodiments, arbitrary image data may be manually deleted from the storage means, or performance position information associated with arbitrary image data may be edited.

In each of the above-described embodiments, a mobile phone is used as the mobile terminal, but the mobile terminal may be a terminal such as a tablet terminal, a notebook personal computer, or a remote controller on which a karaoke application can be installed.

Also, the programs of the above embodiments may be stored in a storage medium. The storage medium is not particularly limited, but may be a non-transitory storage medium such as an optical disk, a magneto-optical disk, or a flash memory.

Also, although the present embodiment has been described, other embodiments may be obtained by combining the above-described embodiments and modifications in whole or in part.

Moreover, the technology of the present invention is not limited to the above-described embodiments, and may be variously changed, replaced, and modified without departing from the spirit of the technical idea. Furthermore, if the technical idea can be realized in another way due to advances in technology or another derived technology, the method may be used for implementation. Therefore, the claims cover all implementations that may fall within the scope of the technical concept.

10, 30, 50: mobile terminals 11, 31, 51: display means 12, 32, 52: photographing means 13, 33, 53: storage means 22, 42, 62: association units 23, 43, 63: storage control units 24, 44, 64: extraction units 25, 45: display control unit 60: karaoke device 65: acquisition unit 66: transmission unit

Claims (6)

A mobile terminal capable of karaoke performance of music,
an associating unit that associates music identification information of a song with performance position information corresponding to shooting timing with image data output from the shooting means when an image is shot by a shooting means during karaoke performance of a song;
a storage control unit for storing, in a storage means, music identification information and performance position information associated with the image data photographed by the photographing means;
an extraction unit for extracting image data and performance position information corresponding to music identification information of a song from the storage means when an image is displayed on the display means during karaoke performance of the song;
and a display control unit for displaying an image on the display means based on the image data and the performance position information in accordance with the progression of the performance positions of the music during the karaoke performance. 2. The portable terminal according to claim 1, wherein the performance position information is position information based on the number of bars. 3. The apparatus according to claim 1, wherein the display control unit causes the display means to display a title image based on predetermined image data and title information of the song at the start of karaoke performance of the song. Mobile device as described. comprising a first mode and a second mode;
In the first mode, when storing new image data in the storage means, the storage control unit deletes image data associated with the same music identification information as the new image data from the storage means. 4. The method according to any one of claims 1 to 3, wherein in the second mode, image data associated with the same music identification information as the new image data is left in the storage means. mobile terminal. an acquisition unit that acquires music identification information from a karaoke device communicably connected to its own terminal;
a transmitting unit that transmits the image data and performance position information extracted by the extracting unit to the karaoke device,
The extraction unit extracts image data and performance position information associated with the music identification information acquired from the karaoke device from the storage means,
5. The karaoke device according to any one of claims 1 to 4, wherein the karaoke device causes the display means to display an image based on the image data and the performance position information in accordance with the progression of the performance position of the music during the karaoke performance. 1. The portable terminal according to item 1. A program for a mobile terminal capable of karaoke performance of music,
a step of associating the image data outputted from the photographing means with the music identification information of the musical piece and performance position information corresponding to the photographing timing when an image is photographed by the photographing means during karaoke performance of the musical piece;
a step of storing in a storage means together with the image data photographed by the photographing means, music identification information and performance position information associated with the image data;
a step of extracting image data and performance position information corresponding to the music identification information of the song from the storage means when an image is displayed on the display means during karaoke performance of the song;
and causing the portable terminal to execute a step of displaying an image on the display means based on the image data and the performance position information in accordance with the progress of the performance positions of the music during the karaoke performance.

Images