JP5429495B2 - Recording apparatus and recording program - Google Patents

Description

  The present invention relates to a recording apparatus and a recording program capable of displaying a pre-recorded video and recording a new video in accordance with the displayed video.

  Conventionally, in karaoke that enjoys singing along with automatic performances, a duet that allows two people to sing together can be performed. Usually, singing with the person who actually attended the meeting will be performed, but in the karaoke system described in Patent Document 1 and Patent Document 2, the other party's singing voice is recorded in advance and played back on the spot. It is disclosed that even those who are not present enjoy a duet together.

Japanese Patent Laid-Open No. 2001-42878 JP 2006-208961 A

  However, in the karaoke system described in Patent Literature 1 and Patent Literature 2, the information handled for the duet is only singing voice. It feels unsatisfactory in a duet where singing while watching the other person's facial expression is one of the factors of enjoyment. In the case of music accompanied by choreography, the joy of singing can be further expanded by performing choreography with a duet partner.

  Therefore, not only singing voice but also a karaoke system using video information (moving image) taken by a camera has been proposed and realized. By presenting the recorded singing voice and video information to the singing partner, the enjoyment of karaoke is even wider than that of the singing voice. However, no particular consideration has been given to the method of presenting video information to the singer and the method of shooting with the camera, and depending on the way of presentation and shooting, the video may be uncomfortable. It is regarded as a problem.

  The present invention proposes a recording apparatus and a recording program in consideration of the shooting situation of a karaoke duet. Specifically, it is possible to display a pre-recorded video and to suppress the uncomfortable feeling of the presented video and the recorded video as much as possible when recording a new video according to the displayed video. A recording apparatus and a recording program are proposed.

In order to solve the above problems, a recording apparatus according to the present invention includes control means for simultaneously executing video playback processing, audio playback processing, and recording processing, and the video playback processing is provided in the first area of the display means. The first video information recorded in advance is displayed, and the second video information input from the camera is displayed on the second area located on the left side or the right side of the first area, and the audio reproduction is performed. The process reproduces the first audio information recorded in synchronization with the first video information and the second audio information input from the microphone, and the recording process includes the second video information and the second audio information. In the recording means, and the video reproduction process detects the left or right direction associated with the first video information, and the first video so that the detected direction faces the second area. Flip information left or right Is characterized in that display is not mirror-reversed.

In addition, the recording apparatus according to the present invention includes a control unit that simultaneously executes a video reproduction process, an audio reproduction process, and a recording process,
In the video reproduction process, the first video information recorded in advance is displayed in the first area of the display means, and the second area input to the second area located on the left or right side of the first area is input from the camera. The video information is displayed horizontally reversed,
The audio reproduction process reproduces first audio information recorded in synchronization with the first video information and second audio information input from a microphone,
The recording process records the second video information and the second audio information in a recording unit,
The video reproduction process detects the left or right direction associated with the first video information, and arranges the first area and the second area so that the second area is positioned in the detected direction. It is characterized by doing.

The recording apparatus according to the present invention further includes a control unit capable of executing a video playback process, an audio playback process, and a recording process at the same time, and performing a viewing process. The video playback process is a first display unit. The first video information recorded in advance in the area is displayed and the left side of the first area or
In the second area located on the right side, the second video information input from the camera is displayed horizontally reversed, and the audio reproduction processing includes the first audio information recorded in synchronization with the first video information, Second audio information input from a microphone is reproduced, the recording process records the second video information and the second audio information in a recording means, and the viewing process is the first video information in the video reproduction process. The left and right positions of the area and the second area are changed, and the first video information and the second video information recorded in the recording means are reproduced while being reversed horizontally from the display state of the video reproduction process. In addition, the first audio information and the second audio information recorded in the recording means are reproduced.

Furthermore, in the video recording apparatus according to the present invention, the video reproduction process is characterized in that the first video information is displayed horizontally reversed.

Furthermore, in the recording apparatus according to the present invention, the control means can execute an upload process in which the second video information and the second audio information recorded in the recording means are transmitted by a communication means.

Also, the recording program according to the present invention displays the first video information recorded in advance in the first area of the display means, and inputs it from the camera to the second area located on the left or right side of the first area. Reproduction processing for displaying the second video information to be reversed left and right, first audio information recorded in synchronization with the first video information, and audio reproduction for reproducing the second audio information input from the microphone Processing, and recording processing for recording the second video information and the second audio information in the recording means are simultaneously executed by a computer, and the video reproduction processing is performed on either the left or right side associated with the first video information. One direction is detected, and the first video information is displayed without being horizontally reversed or horizontally reversed so that the detected direction faces the second region.

Also, the recording program according to the present invention displays the first video information recorded in advance in the first area of the display means, and inputs it from the camera to the second area located on the left or right side of the first area. Reproduction processing for displaying the second video information to be reversed left and right, first audio information recorded in synchronization with the first video information, and audio reproduction for reproducing the second audio information input from the microphone Processing, and recording processing for recording the second video information and the second audio information in the recording means are simultaneously executed by a computer, and the video reproduction processing is performed on either the left or right side associated with the first video information. This direction is detected, and the first region and the second region are arranged so that the second region is positioned in the detected direction.
Also, the recording program according to the present invention displays the first video information recorded in advance in the first area of the display means, and inputs it from the camera to the second area located on the left or right side of the first area. Reproduction processing for displaying the second video information to be reversed left and right, first audio information recorded in synchronization with the first video information, and audio reproduction for reproducing the second audio information input from the microphone And a recording process for recording the second video information and the second audio information in the recording unit at the same time, and causing the computer to execute both the first area and the second area in the video reproduction process. The position is changed, and the first video information and the second video information recorded in the recording means are reproduced while being reversed from the display state of the video reproduction process. A first audio information, the viewing process for reproducing the second audio information recorded in the recording means, is characterized by causing a computer to execute.

  According to the present invention, the second video information input from the camera, that is, the video to be monitored is horizontally reversed and displayed on the screen, so that the singer who is the subject of the camera is on the screen. The user can confirm his / her own video in the same state as that in the mirror (mirror image). As a result, the subject is not discomforted.

  Further, the second video information input from the camera is displayed in a second area located on the left or right side of the first area where the first video information recorded in advance is displayed. Therefore, the singer who has become the subject of the camera sings in the direction of the first video information naturally when viewing the other party's video on the screen. In particular, when the first video information, that is, the previously recorded video of the other party faces the second area, it is possible to display the videos facing each other.

  Further, by recording the second video information in such a format, it is possible to reproduce videos in a state of facing each other even when the first video information and the second video information are simultaneously reproduced. During playback, the left and right positions of the first area and the second area are interchanged, and both the first video information and the second video information are displayed in a horizontally reversed manner from the display mode at the time of recording. It is possible to play while maintaining the state of facing each other. In particular, since the second video information captured by the camera is a mirror image of the display form at the time of recording, it can be displayed as a normal image without left-right reversal at the time of playback, thereby suppressing a sense of incongruity on the video. It becomes possible.

Further, in the present invention, when recording the second video information, the first video information recorded in advance is displayed by being horizontally reversed. According to this configuration, not only the second video information but also the first video information can be reproduced as a normal image, and a sense of discomfort on the video can be further suppressed.

  In the present invention, either the left or right direction associated with the first video information is detected, and the first video information is not horizontally reversed or horizontally reversed so that the detected direction faces the second region. It is supposed to be displayed. According to this configuration, it is possible to display the subject in the first video information with the subject facing the second region, and it is possible to suppress a sense of incongruity for the subject who is photographed by the camera. Furthermore, it is possible to display and record in a state of facing each other.

  In the present invention, the left and right directions associated with the first video information are detected, and the first area and the second area are arranged so that the second area is located in the detected direction. According to such a configuration, according to this configuration, it is possible to display the subject in the first video information with the subject facing the second region, and suppress a sense of incongruity for the subject photographed by the camera. It becomes possible. Furthermore, it is possible to display and record in a state of facing each other.

  In the present invention, the viewing process for reproducing the first video information and the second video information can be executed. According to this viewing process, it is possible to confirm the second video information captured by the camera together with the first video information. Further, in this viewing process, the left and right positions of the first area and the second area are changed, and the first video information and the second video information are displayed in a horizontally reversed manner with respect to the display state of the video reproduction process. . By adopting such a display form in the viewing process, it becomes possible to make the subjects of the first video information and the second video information face each other, and the second video information is not horizontally reversed. It can be displayed as a normal image. In addition, when the first video information is displayed with the left and right reversed in the video reproduction process, the first video information can also be displayed as a normal image.

  Further, in the present invention, it is possible to execute an upload process in which the recorded second video information and second audio information are transmitted by the communication means. By adopting such processing, it is possible to enjoy the recorded video and audio not only at the recording location but also at a remote location.

  Furthermore, the recording program of the present invention allows a computer to execute the same function as the above-described recording device, and can add the same function to a computer device or an existing audio device. Become.

The figure explaining the outline | summary of the karaoke contribution which concerns on embodiment of this invention. The figure which shows the structure of the karaoke system which concerns on embodiment of this invention. The flow figure explaining the flow of contribution concerning the embodiment of the present invention. The flowchart which shows the reproduction | regeneration recording processing (Example 1) which concerns on embodiment of this invention. The flowchart which shows the viewing-and-listening process (Example 1) which concerns on embodiment of this invention. The figure which shows the display screen (Example 1) which concerns on embodiment of this invention. The figure which shows the upload information which concerns on embodiment of this invention. The figure which shows the 1st contribution image | video from which the direction of a face differs. The flowchart which shows the reproduction | regeneration recording processing (Example 2) which concerns on embodiment of this invention. The flowchart which shows the viewing-and-listening process (Example 2) which concerns on embodiment of this invention. The figure explaining a display screen (Example 2) to embodiment of this invention. The figure explaining a display screen (Example 2) to embodiment of this invention. The flowchart which shows the reproduction | regeneration recording processing (Example 3) which concerns on embodiment of this invention. The flowchart which shows the viewing-and-listening process (Example 3) which concerns on embodiment of this invention. The figure explaining a display screen (Example 3) in embodiment of this invention. The figure explaining a display screen (Example 3) in embodiment of this invention.

  The recording apparatus and the recording program of the present embodiment are supposed to be used in a karaoke posting system that allows users to enjoy duets, choruses, and the like in karaoke. FIG. 1 is a diagram for explaining the outline of this karaoke posting system. The flow of karaoke posting will be briefly described using this figure. Here, a case where singing voice is recorded will be described, but in reality, video recorded by a camera is accompanied.

  First, the singer performs singing according to the performance at a place where the karaoke system is installed, such as a karaoke box, and the singing voice is recorded (a). The karaoke system includes a commander (a karaoke device), a lyric image output from the commander, a monitor on which a background image is displayed, and a remote control device that transmits an operation from the operator to the commander. The singing voice is recorded as first posting data in a recording means such as a hard disk built in the commander.

  The singer can also reproduce the first posted data in order to confirm the recorded singing voice (b). If the singer wishes, the first post data is uploaded on the server and can be disclosed via the Internet (c). The published first post data is downloaded by the singer who wants to sing along with this singer by the karaoke system (d).

  The content of the downloaded first posted data can be confirmed by playing it along with the music (e). The downloaded first song data is reproduced by the commander together with the music, and the singer can enjoy a duet with the first song data recorded in advance. Further, the singing voice of the singer sung together is recorded in the commander as the second posting data (f). The recorded second posted data can be reproduced in synchronization with the first posted data and the music, and the singer can check his / her song in a duet format (g).

  The singer can upload the second post data to the server as a new post. The second posted data can be reproduced as a duet format together with the first posted data. However, since the first posted data is stored in the server, only the second posted data is transmitted. The second posting data is given identification information of the second posting data in order to be associated with the first posting data (h).

  The first posting data and the second posting data stored in the server are downloaded to a PC (personal computer) or a karaoke system according to a request from the user, and the first posting data, the second posting data, and the music are synchronized. By playing it, it becomes possible to enjoy collaboration by a plurality of singers (i).

  As described above, in the karaoke posting system of this embodiment, duet and choral can be enjoyed with a partner who is not present on the spot. Here, only the singing voice has been described, but when applied to the present invention, shooting with a camera and recording of video information are performed by the commander together with the singing voice.

Now, an embodiment of a karaoke system that enables photographing with a camera together with recording of a song will be described with reference to FIG. The karaoke system in the present embodiment is composed of a commander 2 (karaoke device) and a remote control device 1, which are connected to the LAN 100.
Are connected to each other wirelessly and wiredly. The recording device referred to in the present invention refers to the karaoke device 2 that includes a configuration related to the processing of the present invention. The recording program is a program that executes the processing of the present invention by being installed in the karaoke device 2 or a computer device.

  The commander 2 mainly functions as a control unit 30 that performs overall control, and can perform performance processing, video reproduction processing, music selection processing, and the like as main functions. The performance process is a process in which music information corresponding to a designated music is played by a user using the operation unit 21 or the remote control device 1 using a sound source unit such as the MIDI sound source 26 and emitted from the speaker 42. At this time, the sound input from the microphone 43 is also emitted from the speaker 42. The video playback process is a process in which the video playback unit 29 plays back background video, lyrics information, and the like, and provides visual information to the user via the monitor 41.

  The music selection process is a process for selecting music based on designation from the user. In the present embodiment, it is executed in cooperation with the remote control device 1. A user command input from the operation unit 17 of the remote control device 1 is transmitted to the commander 2 via the infrared communication units 19 and 23 or the LAN 100. The processing result of the commander 2 is displayed on the display unit 11 on the remote control device 1 side, and the user can visually recognize various information for music selection.

  The commander 2 is connected with a camera 44 as an external device for performing photographing. The installation position of the camera 44 is preferably arranged around the monitor 41 such as the upper part of the monitor 41. By placing the singer around the monitor 41 and photographing the singer singing while checking the screen of the monitor 41, the singer's appearance monitored on the screen can be displayed in the direction of the singing partner. It becomes easier to face.

  Camera video from the camera 44 (“second video information” of the present invention) can be recorded on the hard disk 32 as recording means or displayed on the monitor 41 via the video control unit 41 responsible for video input / output. Is possible. Furthermore, together with the video information from the camera 44, the first posted video of the singing partner recorded in advance (“first video information” of the present invention) can be displayed on the monitor 41. These two images can be simultaneously displayed in a first area and a second area provided side by side in one screen. The first posted video may be either a playback format that is once downloaded from the server to the hard disk 22 and played back, or a playback format that is streamed from the server.

  FIG. 3 is a flowchart showing processing for posting in the commander according to the embodiment of the present invention. The user of the karaoke system can designate the desired music using the remote control device 1 (normal reservation). Moreover, in this embodiment, in order to perform a duet or a chorus, it is possible to designate a reservation (collaboration reservation) for the first post data recorded in advance. In this collaboration reservation, by designating the first post data, a duet, a partner who desires to sing, and a song are designated. The designated reservation is sequentially written in the reservation list on the commander 2 side.

  The commander 2 checks the reservation list as needed, and determines the type of reservation to be executed next (S102). On the reservation list, when the next reservation type is normal reservation, normal music reproduction (S108) is executed to cause the MIDI sound source 26 to reproduce the music information corresponding to the designated music identifier. The reproduced musical sound is emitted from the speaker 42 together with the singing voice input from the microphone 43.

On the other hand, if the next reservation type is a collaboration reservation on the reservation list, it is first determined whether or not the first posted data specified in the collaboration reservation has been downloaded to the commander 2 (S103). If not downloaded, the first posted data is downloaded from the server (S104). The first posted data of the present embodiment includes a pre-recorded video of the singer (first video information), a singing voice synchronized with the video (first audio information), a music identifier, singer identification information, and the like. Is included. In addition, by including pitch change information and speed change information at the time of recording, it is possible to deal with other than the reference pitch and reference speed at the time of music reproduction. In the present embodiment, the download format is adopted as the acquisition method of the first post data, but streaming playback may be performed as the acquisition method. In streaming playback, playback can be started without downloading all of the first posted data.

  When the commander 2 completes the download of the first posted data, the playback recording process (S200) is executed. FIG. 4 shows a flowchart of the playback recording process according to the present embodiment. When the recording / playback process is started, the music playback (S202a), the video playback process (S203a), the audio playback process (S204a), and the recording process (S205a) are started almost simultaneously and continue until the music playback ends.

  The music reproduction (S202a) is a process of reading music information corresponding to the music identifier included in the first post data from the hard disk 22 and causing the MIDI sound source 26 to reproduce it. The music generation, the playback of the first posted audio in the audio playback process (S204a), and the playback of the first posted video in the video playback process (S203a) are executed in synchronization, and the video at the time of recording the first posted data, The sound is reproduced.

  In the video reproduction process (S203a), the first posted video (first video information of the present invention) and the camera video (second video information of the present invention) taken by the camera 44 are displayed on the screen of the same monitor 41. It is a process to display. The state of the display screen at this time is shown in FIG. FIG. 6A shows the first posted video and the camera video, respectively. In order to clarify the horizontally reversed video, the letter “a” in Hiragana is written in the lower left of the first posted video, and the letter “I” in Hiragana is written in the lower left of the camera video.

  FIG. 6B shows a screen of the monitor 41 in the video reproduction process. In the present embodiment, a first area is provided on the right side of the screen and a second area is provided on the left side of the screen, and the first posted video and camera video are displayed in the respective areas. A display method for simultaneously displaying a plurality of videos is performed by a known method such as picture-in-picture. In the video playback process, a lyrics video is displayed at the bottom of the screen for a new singer. This lyric video is displayed based on the lyric information included in the music information.

  In the present embodiment, the camera image displayed in the second area is displayed in a horizontally reversed state. For this reason, the singer can confirm his / her appearance as a mirror image in a state reflected in the mirror, and can suppress a sense of incongruity at the time of shooting. Furthermore, the first area where the first posted video is displayed and the second area where the camera video is monitored in real time are provided adjacent to each other on the left and right. According to such an arrangement, in particular, when the singer projected as the first posted video is facing the second area, the singer monitored by the camera video is naturally in the direction of the first area. Thus, it becomes possible to create a video with no sense of incongruity in which the first posted video and the singers of the camera video face each other at the time of shooting. FIG. 6B shows a screen state in which the singer projected in the second area faces the right side, that is, the direction of the first area as a result.

Since the camera image is monitored as a mirror image that is reversed left and right, it is preferable to display the camera image (second posted image) once recorded as a normal image that is not reversed left and right. In addition, it is preferable that the first posted video and the second posted video are played while maintaining the state in which the singers face each other. For this reason, in the video reproduction process of the present embodiment, the first posted video is also displayed in a state where it is horizontally reversed. The simultaneous reproduction (viewing process) of the first posted video and the second posted video will be described later.

  In the sound reproduction process (S204a), the first posted sound (first sound information) included in the first posted data is reproduced by the sound control unit 25, the singing sound input from the microphone 43, and the MIDI sound source 26. The sound is emitted from the speaker 42 together with the music information to be reproduced.

  In the recording process (S205a), the camera video shot by the camera 44 is recorded as the second posted video (both are second video information), and the singing voice input from the microphone 43 is the second posted voice (second Audio information) is recorded on the hard disk 32 as recording means.

  In the reproduction recording process described above, the video reproduction process (S203a), the audio reproduction process (S204a), and the recording process (S205a) are continued until the reproduction of the music is completed. Based on this, while enjoying a duet or chorus with other singers, it is possible to record own voice and video as the second post data.

  Returning to FIG. 3, when the playback recording process is completed, the singer (user) selects replay for the purpose of confirming the recorded video of himself / herself or watching the collaboration with the first posted data. (S105). If replay is selected, the next viewing process (S300) is executed.

  FIG. 5 is a flowchart showing the viewing process. When the viewing process is started, music playback (S302a), video playback processing (S303a), and audio playback processing (S304a) are executed. In the music playback, the music information corresponding to the music identifier used in the playback recording process is played on the MIDI sound source 26. In the sound reproduction process (S304a), the first posted sound included in the first posted data and the second posted sound recorded in the reproduction recording process are reproduced by the sound control unit 25, and the reproduced music information is included. Sound is emitted from the speaker 42.

  On the other hand, in the video reproduction process (S303a), the first posted video included in the first posted data and the second posted video recorded by the camera 44 are displayed on the monitor 41. FIG. 6C shows the state of the display screen in this video reproduction process (S303a). In this figure, the first posted video and the second posted video (camera video) are in the state shown in FIG.

  In this video playback process, the shooting (playback recording process (S200)) is a state in which the arrangement of the first area and the second area is changed, and each video is horizontally reversed from the time of the playback recording process, that is, normal It is supposed to be displayed as an image. By changing the arrangement of the first area and the second area, when the singers face each other at the time of shooting, the state can be maintained. By reversing left and right at the time of playback recording processing, the second posted video displayed as a mirror image can be viewed as a normal image without left-right reversal. Further, the first posted video can also be viewed as a normal image by being reversed left and right during the playback recording process.

Returning to FIG. 3, in addition to the viewing process (S300), the user uploads the recorded second posted video and second posted audio to the server as second posted data and selects the upload process (S107) to be widely released. (S106). The second posted data released in the upload process can be viewed in combination with the first posted data, and further, the second posted data is used as new first posted data, thereby creating a new collaboration. Can also be realized.

  FIG. 7 shows the second post data as information to be uploaded. The second posted data includes the second posted video (second video information) and the second posted audio (second audio information) recorded in synchronization. Furthermore, a music ID as a music identifier and a first post ID for identifying the first post data are also included, and can be associated with the first post data used on the server.

  As described above, in the present embodiment, the captured camera video is monitored as a mirror image, and the first area where the first posted video is displayed and the second area where the camera video is displayed are adjacent to each other on the left and right. By displaying, it is possible to realize display and recording without a sense of incongruity.

  Next, another embodiment (Example 2 and Example 3) of the reproduction recording process (S200) and the viewing process (S300) in FIG. 3 will be described. As shown in FIG. 8, the singer projected in the first posted video changes depending on the environment and situation at the time of shooting, such as a state facing right (a-1) and a state facing left (a-2). There is a case. Furthermore, it is conceivable that the direction in which the singer faces changes during a series of shootings. In the embodiment described below, it is possible to cope with the case where the direction in which the singer is facing cannot be predicted.

  FIG. 9 to FIG. 12 are diagrams for explaining the playback and recording process (S200), the viewing process (S300), and the screen display in the second embodiment. In FIG. 9, the music reproduction (S202b), the audio reproduction process (S203b), and the recording process (S204b) are the same processes as those in the first embodiment, and thus description thereof is omitted here. In the present embodiment, in the video playback process, either the left or right direction associated with the first posted video is detected, and based on the detected direction, the first posted video is reversed left and right or displayed. The detected direction is directed to the second area, that is, the area where the camera video is displayed.

  In S205b, the direction of the first posted video is detected. This process uses image recognition processing to recognize the position of facial parts such as eyes and mouth, and to detect whether the face is facing left or right relative to the face outline, It is conceivable to detect whether the singer's body is facing in the left or right direction based on the positional relationship. The image recognition processing for the first posted video is not limited to being performed in real time by the commander, but may be executed in advance on the server side and embedded as a tag in the first posted video. In addition, instead of the image recognition process, a tag may be embedded in the first posted video manually viewed by a person.

  It is detected whether the first posted video is in the left or right direction. If the first posted video is not in the left direction, the video reproduction process shown in S207b is executed. In the present embodiment, the first area where the first posted video is displayed is displayed on the right side of the screen, and the second area where the camera video is displayed is displayed on the left side of the screen. Further, the first posted video is displayed in a state where the left and right are reversed, so that the direction of the detected first posted video faces the second region. FIG. 11B-1 shows the state of the screen in this video reproduction process. As described above, the direction of the first posted video faces the second region, so that the singer monitored in the second region can easily face the direction of the first posted video and create videos facing each other. It becomes possible. Note that the camera image displayed in the second region is displayed as a mirror image that is reversed left and right, as in the above-described embodiment, to suppress the uncomfortable feeling of the singer who monitors.

On the other hand, when it is detected in S205b that it is facing left, the video reproduction process shown in S206b is executed. Here, by displaying the first posted video as a normal image that is not horizontally reversed, the detected first posted video faces the second region. FIG. 11B-2 shows the state of the screen in this video reproduction process. In the present embodiment, the direction detection of the first posted video (S205b) is performed every time the performance has passed for a predetermined number of seconds (S209b), so that the direction of the first posted video changes during playback. It is possible to do. It should be noted that when switching the video playback processing of S206b and S207b, it is preferable to realize a natural transition by applying video effects such as fade processing.

  Now, a viewing process for playing back the second posted video recorded in such a playback recording process will be described. FIG. 10 is a flowchart of the viewing process corresponding to the playback recording process described with reference to FIG. The music reproduction (S302b) and the audio reproduction process (S303b) are the same as those in the first embodiment, and thus the description thereof is omitted here.

  If the direction of the first posted video is detected in S304b and it is detected that the direction is not facing left, the video playback process in S306b is executed. Here, the first posted video is displayed as a normal image without left-right inversion on the left side of the screen, and the second posted video is displayed as a normal image on the right side of the screen. FIG. 12C-1 shows the state of the screen in this video playback process. On the other hand, when it is detected that it is facing left, the video reproduction process of S305b is executed. Here, as shown in FIG. 12 (c-2), the first posted video is displayed horizontally reversed on the left side of the screen, and the second posted video is displayed as a normal image on the right side of the screen. The direction detection of the first posted video in this viewing process is also performed every predetermined number of seconds (S308b), and it is possible to follow the change in direction of the first posted video. It should be noted that, when switching the video reproduction processing of S305b and S306b, it is preferable to provide a natural video transition by applying a video effect such as a fade processing.

  When the video playback process (S305b, 306b) in the viewing process is described in association with the playback recording process, the left and right positions of the first area and the second area are exchanged with those during the playback recording process, and the first posted video, It is equivalent to displaying the second posted video in a state reversed left and right with the display state at the time of the reproduction recording process.

  As described above, in the second embodiment, in the playback recording process, the direction of the first posted video is detected, and the first posted video is displayed with the left-right reversed or the left-right reversed according to the detected direction. It becomes possible to provide a 2nd area | region in the direction which 1 posting image | video faces, and it becomes possible to suppress the discomfort with respect to the singer who sings while monitoring a screen.

  In the second embodiment, as shown in FIG. 12C-2, the first posted video may be reversed left and right in the video that is finally viewed. In Example 3 to be described next, the arrangement of the first area and the second area is controlled based on the detected direction so that the finally viewed video is a normal image without left-right inversion. .

  FIGS. 13 to 16 are diagrams for explaining the playback and recording process (S200), the viewing process (S300), and the screen display in the third embodiment. In FIG. 13, the music reproduction (S202c), the audio reproduction process (S203c), and the recording process (S204c) are the same processes as those in the first embodiment, and thus description thereof is omitted here. In the present embodiment, in the video reproduction process, either the left or right direction associated with the first posted video is detected, and the first area in which the first posted video is displayed based on the detected direction, and the camera video Is controlled so that the detected direction faces the second area, that is, the area where the camera video is displayed.

In S205c, the direction of the first posted video is detected. This direction detection process can be performed by various methods described in the second embodiment. It is detected whether the first posted video is in the left or right direction, and if it is not in the left direction, the video reproduction process of S207c is executed. FIG. 15B-1 shows the state of the display screen in this video reproduction process. As shown in the figure, the first posted video is displayed on the right side of the screen in a horizontally reversed state, and the camera video is displayed on the left side of the screen in a horizontally reversed state. In this way, the first posted video faces the second area, so that the singer monitored in the second area can easily turn the direction of the first posted video, and can create videos facing each other. Become.

  On the other hand, when it is detected in S205c that the direction of the first posted video is leftward, the video reproduction process shown in S206c is executed. FIG. 15B-2 shows the state of the display screen in this video reproduction process. As shown in the drawing, the first posted video is displayed on the left side of the screen in a horizontally reversed state, and the camera video is displayed on the right side of the screen in a horizontally reversed state. In the present embodiment, the direction detection of the first posted video (S304b) is performed every time the performance has passed for a predetermined number of seconds (S308b), so that the direction of the first posted video changes during the performance. It is possible to follow. It should be noted that when switching the video reproduction processing of S206c and S207c, it is preferable to realize a natural transition by applying a video effect such as fade processing.

  Now, a viewing process for playing back the second posted video recorded in such a playback recording process will be described. FIG. 14 is a flowchart of the viewing process corresponding to the playback recording process described with reference to FIG. The music reproduction (S302c) and the audio reproduction process (S303c) are the same as those in the first embodiment, and thus description thereof is omitted here.

  When the direction of the first posted video is detected in S304c and it is detected that the direction is not facing left, the video reproduction process in S306c is executed. Here, the first posted video is displayed on the left side of the screen and the second posted video is displayed on the right side of the screen as a normal image without left-right inversion. FIG. 15C-1 shows the state of the screen in this video reproduction process. On the other hand, when it is detected that it is facing leftward, the video reproduction process of S305c is executed. Here, as shown in FIG. 15 (c-2), the first posted video is displayed on the right side of the screen and the second posted video is displayed on the left side of the screen as a normal image without left-right inversion. The direction detection of the first posted video in this viewing process is also performed every predetermined number of seconds (S308c), and it is possible to follow the change in direction of the first posted video. It should be noted that, when switching between the video playback processes of S305c and S306c, it is preferable to provide natural video transitions by applying video effects such as fade processing and animation processing for exchanging the first area and the second area.

  As described above, in the third embodiment, in the playback recording process, the direction of the first posted video is detected, the positions of the first area and the second area are controlled according to the detected direction, and the first posted video faces in the direction. It becomes possible to provide two areas, and it becomes possible to suppress a sense of incongruity for a singer who sings while monitoring the screen. Furthermore, in the viewing process, the first posted video can always be displayed as a normal image without left-right reversal, and a sense of discomfort during viewing can be suppressed.

  Note that the present invention is not limited to these embodiments, and embodiments configured by appropriately combining the configurations of the respective embodiments also fall within the scope of the present invention.

DESCRIPTION OF SYMBOLS 1 ... Remote control apparatus, 11 ... Display part, 12 ... Video RAM, 13 ... Image | video control part, 14 ... Memory, 15 ... Control part, 16 ... Wireless LAN communication part, 17 ... Operation part, 18 ... Operation processing part, 19 ... Infrared communication unit, 2 ... Commander (karaoke device), 21 ... Operation unit, 22 ... Operation processing unit, 23 ... Infrared communication unit, 24 ... Interface unit, 25 ... Voice control unit, 26 ... MIDI sound source, 27 ... Memory, 28 ... Video RAM, 29 ... Video playback unit, 30 ... Control unit, 31 ... Video control unit, 32 ... Hard disk, 41 ... Monitor, 42 ... Speaker, 43 ... Microphone, 44 ... Camera, 100 ... LAN, 110 ... Access point, 120 ... Router

Claims (8)

A control means for simultaneously executing a video reproduction process, an audio reproduction process, and a recording process;
In the video reproduction process, the first video information recorded in advance is displayed in the first area of the display means, and the second area input to the second area located on the left or right side of the first area is input from the camera. The video information is displayed horizontally reversed,
The audio reproduction process reproduces first audio information recorded in synchronization with the first video information and second audio information input from a microphone,
The recording process records the second video information and the second audio information in a recording unit,
The video reproduction process detects either the left or right direction associated with the first video information, and the first video information is reversed left or right so that the detected direction faces the second region. A recording device characterized by being displayed without being inverted . A control means for simultaneously executing a video reproduction process, an audio reproduction process, and a recording process;
In the video reproduction process, the first video information recorded in advance is displayed in the first area of the display means, and the second area input to the second area located on the left or right side of the first area is input from the camera. The video information is displayed horizontally reversed,
The audio reproduction process reproduces first audio information recorded in synchronization with the first video information and second audio information input from a microphone,
The recording process records the second video information and the second audio information in a recording unit,
The video reproduction process detects the left or right direction associated with the first video information, and arranges the first area and the second area so that the second area is positioned in the detected direction. A recording apparatus characterized by: The video playback process, the audio playback process, and the recording process are executed at the same time, and a control means capable of executing the viewing process is provided.
In the video reproduction process, the first video information recorded in advance is displayed in the first area of the display means, and the second area input to the second area located on the left or right side of the first area is input from the camera. The video information is displayed horizontally reversed,
The audio reproduction process reproduces first audio information recorded in synchronization with the first video information and second audio information input from a microphone,
The recording process records the second video information and the second audio information in a recording unit,
The viewing process changes the left and right positions of the first area and the second area in the video reproduction process, and the first video information and the second video information recorded in the recording unit are A video recording apparatus , wherein the display state of the video playback process is reversed right and left for playback, and the first audio information and the second audio information recorded in the recording means are played back . 4. The recording apparatus according to claim 2 , wherein in the video reproduction process, the first video information is displayed in a horizontally reversed manner. 5.
Said control means, said recorded in the recording means second image information and said second audio information, any one of the preceding claims 1 to be executed the upload process of transmitting by the communication unit The recording device described in 1. The first video information recorded in advance is displayed in the first area of the display means, and the second video information input from the camera is horizontally reversed in the second area located on the left or right side of the first area. Video playback processing to be displayed,
Audio reproduction processing for reproducing first audio information recorded in synchronization with the first video information and second audio information input from a microphone;
Causing the computer to simultaneously perform recording processing for recording the second video information and the second audio information in a recording unit ;
The video reproduction process detects either the left or right direction associated with the first video information, and the first video information is reversed left or right so that the detected direction faces the second region. A recording program characterized by being displayed without being inverted . The first video information recorded in advance is displayed in the first area of the display means, and the second video information input from the camera is horizontally reversed in the second area located on the left or right side of the first area. Video playback processing to be displayed,
Audio reproduction processing for reproducing first audio information recorded in synchronization with the first video information and second audio information input from a microphone;
Causing the computer to simultaneously perform recording processing for recording the second video information and the second audio information in a recording unit;
The video reproduction process detects the left or right direction associated with the first video information, and arranges the first area and the second area so that the second area is positioned in the detected direction. It is characterized by
Recording program. The first video information recorded in advance is displayed in the first area of the display means, and the second video information input from the camera is horizontally reversed in the second area located on the left or right side of the first area. Video playback processing to be displayed,
Audio reproduction processing for reproducing first audio information recorded in synchronization with the first video information and second audio information input from a microphone;
A recording process for recording the second video information and the second audio information in a recording unit at the same time;
The left and right positions of the first area and the second area in the video reproduction process are changed, and the first video information and the second video information recorded in the recording unit are displayed in the video reproduction process. The state is reproduced while being reversed left and right, and the first audio information and the recording hand
A computer is caused to execute a viewing process for reproducing the second audio information recorded in the stage.
Recording program.

Images