JP2002290901A - Viewer video recording and reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily prepare a composite picture in the case of composing the video of viewers, etc., viewing an original video to the original video. SOLUTION: A reproducing circuit 109 photographs the viewers while reproducing a medium 105 in which video and voice signals are recorded in advance, and an encoder 102 encodes the video and voice signals from a microphone 106 and a camera 101. When a sound pressure judging circuit 107 detects the cheer of the viewers, a recording circuit 104 records the video of the cheering viewers in the medium 105 and records information expressing a part the video of the viewers are to be inserted in the medium 105 under the control of a controller 108. When reproducing the video and voice signals recorded in the medium 105, the video of the cheering viewers is inserted and reproduced.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a viewer video recording / reproducing which enables a viewer watching a video recorded on a medium to cheer on the same media. Related to the device.

[0002]

2. Description of the Related Art Conventionally, to insert a cheering video of a viewer into an original video, first, a shooting device is prepared separately from a reproducing device, and it is necessary to take a picture of a viewer watching. did not become. Then, in order to insert the captured video of the viewer into the original video, a video in which the viewer cheers is searched for, and then the necessary portions of the original video and the viewer video are appropriately combined, and the video editing device is used. In addition, it is necessary to edit a video using an audio mixing device and perform an audio mixing operation.

[0003] When a viewer image is synthesized as a small screen, a small screen combining circuit is required. Then, it is necessary to search for a video in which the viewer is cheering, generate a sub-screen insertion video, and edit the video and audio.

[0004] When only the cheering of the viewer is inserted into the original image, an audio mixing device is required. Then, it was necessary to search for an image in which the viewer was cheering and to perform audio mixing work.

[0005] In addition, a thumbnail image creation device is required to insert a thumbnail image of an original video in which a viewer cheers. Then, it is necessary to search for the original video in which the viewer is cheering, create a thumbnail image using the thumbnail image creation device, and edit the image.

In order to record an enlarged image of a cheering viewer, an enlarged image clipping device is required. It is necessary to find the cheering video, identify the cheering viewer, create an enlarged video using an image cropping device, edit the video, and perform audio mixing work. Was. When such an enlarged image is generated, it is not possible to record the entire cheering audience and automatically enlarge the cheering audience during reproduction.

In addition, when a cheering is inserted and recorded as a telop, a telop creating device for creating a telop and a telop synthesizing device for synthesizing the telop with a video are required. Then, it is necessary to search for a video in which the viewer is cheering, create a telop from the content of the cheering, create a composite video, edit the video, and perform audio mixing work.

When a cheer is recorded as character information and combined with a reproduced image as a telop at the time of reproduction, a character information input device, a character information recording / reproducing device, a telop creating device, and a telop synthesizing device are required. . Then, it was necessary to find a cheering video, convert the content of the cheering into character information, and record the telop on a medium using a character information input device and a character information recording device.

[0009]

As described above, when an attempt is made to insert a video of a viewer who is watching the video into the original video by using the conventional technique, the reproduction device Separately, a recording device for photographing the viewer is required. In addition, in order to find a part where the viewer cheered, it was necessary to confirm the contents of the video and audio. In this case, it is necessary to grasp the relationship between the original video and the viewer-recorded video in order to identify in which portion of the original video the cheer was raised, and the dry operation was complicated.

[0010] Further, in order to create various composite screens, a complicated composite operation is required. In other words, in order to create a child screen, it is necessary to use a child screen synthesis circuit to insert a child screen of a cheering viewer image. It is necessary to perform a mixing operation between the original video and the cheers using a mixing device. Work to create an image is necessary, and in order to enlarge the image, it is necessary to use a magnifying and cropping device for the image to create an enlarged video of the cheering viewer, and insert a telop In order to do so, an operation for creating and synthesizing a cheering telop using a telop creating device and a telop synthesizing device was required. Further, it is not possible to record an image of the entire viewer and information indicating a position of the cheering viewer in the video, and enlarge and display the cheering viewer during reproduction.

[0011] The present invention has been proposed in view of the above-described circumstances, and can easily create a composite screen when a viewer image or the like viewing the video is synthesized with an original video. It is an object of the present invention to provide a simple viewer video recording and reproducing apparatus.

[0012]

The viewer video recording / reproducing apparatus of the present invention has the following features in order to achieve the above-mentioned object.

That is, the viewer video recording / reproducing apparatus of the present invention comprises video input means for inputting video, audio input means for inputting audio, and sound for detecting the sound pressure level of an audio signal. Pressure level detecting means, encoding means for encoding the input video and audio signals, encoded signal holding means for temporarily holding the encoded signal, and encoding the encoded signal. A medium for storing, a signal recording / reproducing means for recording a signal on the medium and reproducing the signal recorded on the medium, and a reproduced signal for temporarily holding the reproduced signal Holding means, audio and video signal generating means for decoding the reproduced signal to generate video and audio signals, and position information for inserting a viewer image when reproducing the video and audio signals. And a position information recording and reproducing means for recording and reproducing, by the signal reproducing means,
A viewer is photographed while reproducing a medium in which video and audio signals are recorded in advance, and the encoding means encodes the video and audio signals from the video input means and audio input means, and The level detecting means detects the cheering of the viewer, and when the cheering of the viewer is detected, the signal recording / reproducing means records an image of the cheering viewer on the medium, and The information recording / reproducing means records information representing a part where a viewer image is to be inserted in the medium, and inserts an image in which the viewer cheers when reproducing the image and audio signal recorded in the medium. It is characterized by being reproduced.

[0014] The viewer video recording / reproducing apparatus further comprises a sub-screen insertion unit for inserting another video as a sub-screen into a part of the video, and an audio mixing unit for mixing audio. When playing back the video and audio signals recorded on the media, the child screen insertion means inserts the reproduced video of the cheering viewer as a child screen into the previously recorded reproduced video, It is possible to mix and output the respective sounds by the sound mixing means.

The viewer video recording / reproducing apparatus further comprises an audio mixing means for mixing audio, and when reproducing the video and audio signals recorded on the medium, the audio mixing means pre-records the audio and video signals. It is possible to mix and output the sound of the reproduced video and the reproduced sound of the cheering viewer.

In the viewer video recording / reproducing apparatus, a thumbnail generating means for reducing a plurality of videos and generating one video as a thumbnail image, and recording information representing a video position on the medium. Video position recording / reproducing means for reproduction, wherein the thumbnail video generated by the thumbnail generating means at a part where the viewer cheers is recorded on the medium, and the thumbnail is generated by the video position recording / reproducing means. It is possible to record information indicating the position of the original video corresponding to the video on the media, and to play back the video and the audio signal by calling up the cheered video.

In the viewer video recording / reproducing apparatus, a cheering occurrence location detecting means for detecting a cheering occurrence location in the video based on the input audio signal;
Image enlarging means for cutting out and enlarging a part of the image, and when cheers are detected by the cheering occurrence location detecting means, the viewer who has generated cheers by the image enlarging means is magnified and photographed. An enlarged image can be recorded on the medium.

[0018] In the viewer video recording / reproducing apparatus, a cheering occurrence location detecting means for detecting a cheering occurrence location in the video based on the input audio signal;
A cheering occurrence position information recording unit for recording position information on a cheering occurrence location detected by the cheering occurrence location detecting unit on the medium, and an image enlarging unit for cutting out and enlarging a part of an image, The signal recording / reproducing means records an image of the entire viewer on the medium, and the cheering occurrence position information recording means records position information in the image of the viewer who generated the cheering on the medium, When playing audio signals,
The video enlarging means can cut out and magnify a part of the reproduced video based on the position information of the cheering occurrence location, and enlarge and display the cheering viewer.

Further, in the viewer video recording / reproducing apparatus, character information generating means for generating character information by performing voice recognition from the input audio signal, and converting the character information generated by the character information generating means into a telop. And a telop image synthesizing unit for synthesizing the image as a video, wherein the character information generating unit converts cheers raised by a viewer into character information, and the telop image synthesizing unit converts the character information into a video as a telop. They can be combined and recorded on the media.

In the viewer video recording / reproducing apparatus, character information generating means for generating character information by performing voice recognition from the input audio signal, and recording the character information generated by the character information generating means. Character information recording means for reproducing the character information recorded in the character information recording means, and combining the character information reproduced by the character information reproduction means with a video as a telop. When reproducing audio and video signals, the telop video synthesizing unit can synthesize cheers as a telop into a video.

[0021]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of a viewer video recording / reproducing apparatus according to the present invention will be described below based on a specific embodiment shown in the drawings.

<Embodiment 1> FIG. 1 is a block diagram showing a configuration of a viewer video recording / reproducing apparatus according to Embodiment 1 of the present invention. FIG. 2 is an explanatory diagram illustrating the structure of playback data recorded on a medium used in the viewer video recording and playback apparatus according to the first embodiment.

In FIG. 1, reference numeral 101 denotes a camera for capturing and inputting video, 102 denotes an encoder for coding the input video and audio, 103 denotes a buffer for temporarily holding coded data, 104 Is a recording circuit for recording encoded data on a medium, 105 is a medium for storing encoded data, 106 is a microphone for inputting audio, and 107 is a device for determining the sound pressure level of the input audio. , A controller (CTL) for controlling recording and reproducing operations based on the determination result from the sound pressure determining circuit; 109, a reproducing circuit for reading an encoded signal from the medium;
0 is a buffer for temporarily holding the encoded data reproduced from the medium, 111 is a decoder for decoding the reproduced encoded data to generate video and audio, and 112 is a reproduced video output (monitor). Output) and 113 are reproduced audio outputs (speaker outputs).

Next, the operation of the viewer video recording / reproducing apparatus according to the first embodiment will be described. As shown in FIG. 2, videos 1 to 10 are recorded in advance on the medium 105 as reproduction data. In the viewer video recording / reproducing device according to the first embodiment, the controller 108 reads a signal from the medium 105 using the reproducing circuit 109. The read signal passes through a buffer 110, is decoded by a decoder 111, and outputs a monitor output 112 and a speaker output 113.
Becomes

As shown in FIG.
, And cheers in the video sections 4-6 and 8-9. At this time, the controller 108
1 and the microphone 106, the viewer watching the reproduced video is photographed, the sound pressure level of the audio signal from the microphone 106 is detected by the sound pressure determination circuit 107, and the sound pressure level is set in advance. The range exceeding the value is determined as cheering of the viewer, and the video and audio in the range are encoded as the viewer video using the encoder 102.

The coded signal passes through a buffer 103,
The recording circuit 104 records the additional recording data 11 to 15 on the medium 105. Also, by rearranging the playback data according to the playback procedure list,
10, additional recording data 11 to 15 are inserted. Here, the transfer rate output from the buffer 103 to the recording circuit 104 and the medium 105 is faster than the transfer rate input from the encoder 102 to the buffer 103,
The transfer rate output from the buffer 110 to the decoder 111 is lower than the transfer rate input from the buffer 110 to the buffer 110. Therefore, recording and reproduction of video and audio can be performed alternately without interruption.

In the reproducing operation after the above operation is completed, the controller 108 reads the signal from the medium 105 using the reproducing circuit 109 according to the reproducing procedure list, stores the signal in the buffer 110, and decodes the signal in the decoder 111. Monitor output 112 and speaker output 113
Output as

By the above operation, as shown in FIG. 2, the video and the audio 11 to 1 of the viewer who are watching the video and cheering for the video 1 to 10 recorded in advance.
5 is reproduced in a state where it is appropriately inserted. Here, the additionally recorded viewer images 11 to 15 are the image 1 in FIG.
0 does not need to be recorded continuously immediately after media 1
There is no problem even if the data is discretely recorded at a position distant on 05.

Embodiment 2 Next, a viewer video recording / reproducing apparatus according to Embodiment 2 of the present invention will be described. FIG.
FIG. 4 is a block diagram illustrating a configuration of a viewer video recording / reproducing device according to a second embodiment of the present invention. FIG. 3 is an explanatory diagram illustrating a structure of reproduction data recorded on a medium used in the viewer video recording and reproducing apparatus according to the second embodiment.

The viewer video recording / reproducing apparatus according to the second embodiment has substantially the same configuration as that of the viewer video recording / reproducing apparatus according to the above-described first embodiment. Only parts different from the recording / reproducing apparatus will be described. Note that parts having substantially the same functions as those of the viewer video recording / reproducing apparatus according to the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted.

In FIG. 3, reference numeral 114 denotes a buffer for temporarily holding an original video signal decoded at the time of reproduction,
Reference numeral 115 denotes a buffer for temporarily holding the original audio signal decoded at the time of reproduction, 116 denotes a buffer for temporarily holding the viewer video signal decoded at the time of reproduction, and 117 denotes a buffer at the time of reproduction. A buffer for temporarily holding the viewer audio signal, and a sub-screen synthesis circuit (Pi) for inserting the viewer video into the sub-screen in the original video.
nP) 119 is an audio mixing circuit (Mix) for mixing the original audio signal and the viewer audio.

In the medium 105, as shown in FIG.
Videos 1 to 9 are recorded in advance as reproduction data.
In the viewer video recording / reproducing device according to the second embodiment, the controller 108
The signal is read from 05. The read signal passes through the buffer 110, is decoded by the decoder 111, and passes through the buffers 114 and 115. further,
This signal becomes a monitor output 112 and a speaker output 113 without insertion of a child screen and audio mixing in the child screen synthesis circuit 118 and the audio mixing circuit 119.

As shown in FIG. 4, it is assumed that the viewer cheers in sections 4 to 6 while watching videos 1 to 9. At this time, the controller 108 uses the camera 101 and the microphone 106 to photograph the viewer watching the reproduced video, detects the sound pressure level of the audio signal from the microphone 106 with the sound pressure determination circuit 107, and A range in which the pressure level exceeds a preset value is determined as cheering of the viewer, and an image in the range is encoded using the encoder 102 as a viewer image.

The coded signal passes through a buffer 103,
The recording circuit 104 records the additional recording data 10 to 12 on the medium 105. Also, by rearranging the playback data according to the playback procedure list,
9, additional recording data 10 to 12 are inserted. The media 105 has additional recording data 10 to 10.
Information indicating that the image 12 is a viewer image is recorded.

Here, the buffer 102 from the encoder 102
03, the transfer rate output from the buffer 103 to the recording circuit 104 and the medium 105 is higher than the transfer rate input to the medium 105 and the reproduction circuit 10.
9. The transfer speed output from the buffers 114 to 117 to the small picture synthesizing circuit 118 and the audio mixing circuit 119 is higher than the transfer speed input from the buffer 110 and the decoder 111 to the buffers 114 to 117. Therefore, recording and reproduction of video and audio can be performed alternately without interruption.

In the reproducing operation after the above operation is completed, the controller 108 reads out the signal from the medium 105 by using the reproducing circuit 109 according to the reproducing procedure list, stores the signal in the buffer 110, and decodes the signal in the decoder 111. The information indicating the viewer video is read. And
Based on the information, the original video is stored in the buffer 114, the original audio is stored in the buffer 115, the viewer video is stored in the buffer 116, and the viewer audio is stored in the buffer 117. Then, the viewer image is inserted into the original image as a child screen by the child screen synthesis circuit 118 and output as the monitor output 112. In addition, the audio mixing circuit 119 mixes the original audio and the viewer audio, and outputs the result as a speaker output 113.

By the above operation, as shown in FIG. 4, the images 10 to 12 of the viewer who is watching the image and cheering are compared with the images 1 to 9 recorded in advance as child screens. It is inserted and played back as appropriate. The original sound and the viewer sound are output in a mixed state. here,
The viewer videos 10 to 12 to be additionally recorded do not need to be continuously recorded immediately after the video 9 in FIG. 4, and there is no problem even if they are discretely recorded at distant positions on the medium 105.

Third Embodiment Next, a viewer video recording / reproducing apparatus according to a third embodiment of the present invention will be described. FIG.
FIG. 9 is a block diagram illustrating a configuration of a viewer video recording / reproducing device according to a third embodiment of the present invention. FIG. 6 is an explanatory diagram illustrating the structure of playback data recorded on a medium used in the viewer video recording and playback apparatus according to the third embodiment.

The viewer video recording / reproducing apparatus according to the third embodiment has substantially the same configuration as the viewer video recording / reproducing apparatus according to the first and second embodiments described above. Only parts different from the viewer video recording / reproducing apparatus according to the second embodiment will be described. Note that parts having substantially the same functions as those of the viewer video recording / reproducing apparatuses according to the first and second embodiments are denoted by the same reference numerals, and detailed description thereof will be omitted.

In the medium 105, as shown in FIG.
Videos 1 to 9 are recorded in advance as reproduction data.
In the viewer video recording / reproducing device according to the third embodiment, the additional recording operation of the viewer video is almost the same as the viewer video recording / reproducing device according to the first embodiment.

In the reproducing operation after the additional recording of the viewer image, the controller 108 reads out the signal from the medium 105 by using the reproducing circuit 109 according to the reproducing procedure list, holds the signal in the buffer 110,
The decryption process is performed in step S1. Then, the original sound is held in the buffer 115, the viewer sound is held in the buffer 117, and the sound mixing circuit 119 mixes the original sound and the viewer sound, and outputs the result as the speaker output 113.

By the above operation, as shown in FIG. 6, the voices 10 to 12 of the viewer who appreciates the video and cheers with respect to the video 1 to 9 recorded in advance become the original voices. Output in a mixed state. Here, the viewer videos 10 to 12 to be additionally recorded need not be continuously recorded immediately after the video 9 in FIG.
There is no problem even if the data is discretely recorded at a remote position above.

<Embodiment 4> Next, a viewer video recording / reproducing apparatus according to Embodiment 4 of the present invention will be described. FIG.
FIG. 11 is a block diagram illustrating a configuration of a viewer video recording / reproducing device according to a fourth embodiment of the present invention. FIG. 8 is an explanatory diagram illustrating the structure of playback data recorded on a medium used in the viewer video recording and playback apparatus according to the fourth embodiment.

The viewer video recording / reproducing apparatus according to the fourth embodiment has substantially the same configuration as the viewer video recording / reproducing apparatus according to the above-described first embodiment. Only parts different from the recording / reproducing apparatus will be described. Note that parts having substantially the same functions as those of the viewer video recording / reproducing apparatus according to the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

In FIG. 7, reference numeral 120 denotes a thumbnail video generation circuit for reducing a plurality of videos and generating one video as a thumbnail image. In the media 105,
As shown in FIG. 8, videos 1 to 10 are recorded in advance as reproduction data.

In the viewer video recording / reproducing apparatus according to the fourth embodiment, the controller 108 reads a signal from the medium 105 using the reproducing circuit 109. The read signal passes through the buffer 110, is decoded by the decoder 111, and becomes a monitor output 112 and a speaker output 113.

As shown in FIG.
Suppose you cheered in sections 4-6 and 8-9 while watching 10. At this time, the controller 108
1 and the microphone 106, the viewer watching the reproduced video is photographed, the sound pressure level of the audio signal from the microphone 106 is detected by the sound pressure determination circuit 107, and the sound pressure level is set in advance. The range exceeding the value is determined as the cheering of the viewer, and the video in the range is determined as the viewer video by the encoder 10.
2 is encoded.

The coded signal passes through the buffer 103,
The recording circuit 104 records the additional recording data 11 to 15 on the medium 105. When the cheering is detected, the original image 3 and the image 7 are transmitted from the decoder 111 to the thumbnail creation circuit 120 to generate a thumbnail image.

The thumbnail image is reproduced by the recording circuit 104 after reproducing the video 10 which is the final video of the reproduced data.
Subsequent to the additional recording data 15, it is recorded on the medium 105 together with information indicating the positions of the original video 3 and the original video 7 on which the thumbnail images are based on the medium. Further, by rearranging the reproduction data according to the reproduction procedure list, the additional recording data 11 to 15 are inserted between the videos 1 to 10.

Here, the buffer 102 from the encoder 102
03 is higher than the transfer rate input from the buffer 103 to the recording circuit 104 and the medium 105, and is higher than the transfer rate input from the medium 105 and the reproduction circuit 109 to the buffer 110. The transfer rate output from the buffer 110 to the decoder 111 is lower. Therefore, recording and reproduction of video and audio can be performed alternately without interruption. In the playback operation after the above operation is completed,
The controller 108 reads a signal from the medium 105 by using the reproduction circuit 109 according to the reproduction procedure list,
After being held in the buffer 110, the data is decoded by the decoder 111 and output as the monitor output 112 and the speaker output 113.

By the above operation, as shown in FIG. 8, with respect to the previously recorded original images 1 to 10, the images and sounds 11 to 10 of the viewers watching the image and cheering are displayed.
15 is appropriately inserted and reproduced. At this time, the viewer can refer to the thumbnail image which is the index of the part where the viewer cheered. Controller 1
08 is the video 3 contained in the thumbnail image 16,
By reading the position information of the image 7 on the media,
The video 3 and the video 7 can be directly reproduced.

Here, the additionally recorded viewer images 11 to 11
15 and the thumbnail image 16 correspond to the video 1 in FIG.
0 does not need to be recorded continuously immediately after media 1
There is no problem even if the data is discretely recorded at a position distant on 05.

Embodiment 5 Next, a viewer video recording / reproducing apparatus according to Embodiment 5 of the present invention will be described. FIG.
FIG. 13 is a block diagram illustrating a configuration of a viewer video recording / reproducing device according to Embodiment 5 of the present invention. FIG. 10 is an explanatory diagram showing the structure of playback data recorded on a medium used in the viewer video recording / playback apparatus according to the fifth embodiment.

The viewer video recording / reproducing apparatus according to the fifth embodiment has almost the same configuration as the viewer video recording / reproducing apparatus according to the above-described first embodiment. Only parts different from the recording / reproducing apparatus will be described. Note that parts having substantially the same functions as those of the viewer video recording / reproducing apparatus according to the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted.

In FIG. 9, reference numeral 121 denotes a position where a sound pressure level is high in an image taken by the camera 101 and generates position information based on a ratio of left and right sounds of the sound signal input from the microphone 16. Sound source determination circuit for
Reference numeral 122 denotes an image cutout circuit for cutting out and enlarging a part of the video input from the camera 101 based on the position information from the sound source determination circuit 121. Media 105
As shown in FIG. 10, video 1
To 10 are recorded in advance.

In the viewer video recording / reproducing apparatus according to the fifth embodiment, the controller 108 reads a signal from the medium 105 using the reproducing circuit 109. The read signal passes through the buffer 110, is decoded by the decoder 111, and becomes a monitor output 112 and a speaker output 113.

As shown in FIG.
Suppose that cheers were made in sections 4-6 and 8-9 while watching -10. At this time, the controller 108
01 and the microphone 106, a viewer watching the reproduced video is photographed, the sound pressure level of the audio signal from the microphone 106 is detected by the sound pressure determination circuit 107, and the sound pressure level is set in advance. The range exceeding the value is determined as the cheering of the viewer.

Then, the sound source determination circuit 121 detects a place where the sound pressure level is high in the screen where the viewer is photographed,
Generate position information representing the place. Here, as a method for detecting a place where the sound pressure level is high, a microphone 16 is used.
For example, a method according to the ratio of the left and right sound pressure levels is used for the stereo sound input to the. Then, using the image clipping circuit 122, a portion having a high sound pressure level in the screen is cut out and enlarged, and the encoder 1 is used as a viewer image.
02 is encoded.

The coded signal passes through the buffer 103,
The recording circuit 104 records the additional recording data 11 to 15 on the medium 105. Also, by rearranging the playback data according to the playback procedure list,
10, additional recording data 11 to 15 are inserted.

Here, the buffer 102 from the encoder 102
03 is higher than the transfer rate input from the buffer 103 to the recording circuit 104 and the medium 105, and is higher than the transfer rate input from the medium 105 and the reproduction circuit 109 to the buffer 110. The transfer rate output from the buffer 110 to the decoder 111 is lower. Therefore, recording and reproduction of video and audio can be performed alternately without interruption.

In the reproduction operation after the above operation is completed, the controller 108 reads the signal from the medium 105 using the reproduction circuit 109 according to the reproduction procedure list, stores the signal in the buffer 110, and decodes the signal in the decoder 111. Monitor output 112 and speaker output 113
Output as

By the above operation, as shown in FIG.
Enlarged video and audio 1 of a viewer watching and cheering for the previously recorded video 1 to 10
1 to 15 are appropriately inserted and reproduced. Here, the viewer videos 11 to 15 to be additionally recorded do not need to be continuously recorded immediately after the video 10 in FIG. 10, and there is no problem even if they are discretely recorded at distant positions on the medium 105. There is no.

Embodiment 6 Next, a viewer video recording / reproducing apparatus according to Embodiment 6 of the present invention will be described. FIG.
FIG. 14 is a block diagram showing a configuration of a viewer video recording / reproducing apparatus according to Embodiment 6 of the present invention. FIG. 12 is an explanatory diagram illustrating the structure of playback data recorded on a medium used in the viewer video recording and playback apparatus according to the sixth embodiment.

The viewer video recording / reproducing apparatus according to the sixth embodiment has substantially the same configuration as the viewer video recording / reproducing apparatuses according to the first and fifth embodiments. Only parts different from the viewer video recording / reproducing apparatus according to the fifth embodiment will be described. The portions having substantially the same functions as those of the viewer video recording / reproducing apparatuses according to the first and fifth embodiments are denoted by the same reference numerals, and detailed description thereof will be omitted.

In the viewer video recording and reproducing apparatus according to the sixth embodiment, the controller 108 uses the recording circuit 104 and the reproducing circuit 109 to record and reproduce the position information from the sound source determining circuit 121. In the media 105,
As shown in FIG. 12, as reproduction data, videos 1 to 10
Are recorded in advance. In the viewer video recording / reproducing apparatus according to the sixth embodiment, the controller 108 controls the reproduction circuit 1
09 to read a signal from the medium 105. The read signal passes through the buffer 110 and is output to the decoder 11.
1 to provide a monitor output 112 and a speaker output 113.

As shown in FIG. 12, when the viewer
Suppose that while watching 0, cheers were raised in sections 4-6 and 8-9. At this time, the controller 108
And a viewer watching the reproduced video using the microphone 106, and the sound pressure level of the audio signal from the microphone 106 is detected by the sound pressure determination circuit 107, and the sound pressure level is set to a preset value. Is judged as a viewer's cheer.

Then, the sound source determination circuit 121 detects a place where the sound pressure level is high in the screen where the viewer is photographed,
Generate position information representing the place. Here, as a method for detecting a place where the sound pressure level is high, a microphone 16 is used.
For example, a method according to the ratio of the left and right sound pressure levels is used for the stereo sound input to the. Thereafter, encoding is performed using the encoder 102 as a viewer image. The encoded signal and the position information indicating the location where the sound pressure level is high pass through the buffer 103 and are recorded on the medium 1 by using the recording circuit 104.
05 is recorded as additional recording data 11-15. In addition, by rearranging the reproduction data according to the reproduction procedure list, additional recording data 11 to 15 can be recorded between the videos 1 to 10.
Is inserted.

Here, the buffer 102 from the encoder 102
03 is higher than the transfer rate input from the buffer 103 to the recording circuit 104 and the medium 105, and is higher than the transfer rate input from the medium 105 and the reproduction circuit 109 to the buffer 110. The transfer rate output from the buffer 110 to the decoder 111 is lower. Therefore, recording and reproduction of video and audio can be performed alternately without interruption.

In the reproduction operation after the above operation is completed, the controller 108 reads out the signal from the medium 105 using the reproduction circuit 109 according to the reproduction procedure list, stores the signal in the buffer 110, and decodes the signal in the decoder 111. Monitor output 112 and speaker output 113
Output as At this time, the position information recorded on the medium 105 is read from the viewer image, and a portion having a high sound pressure level in the screen is cut out and enlarged and output using the image cutout circuit 122.

By the above operation, as shown in FIG.
Enlarged images and sounds 11 to 11 of viewers who are watching and cheering on the previously recorded images 1 to 10
15 is appropriately inserted and reproduced. Here, the additionally recorded viewer images 11 to 15 are the image 1 in FIG.
0 does not need to be recorded continuously immediately after media 1
There is no problem even if the data is discretely recorded at a position distant on 05.

Embodiment 7 Next, a viewer video recording / reproducing apparatus according to Embodiment 7 of the present invention will be described. FIG.
FIG. 14 is a block diagram showing a configuration of a viewer video recording / reproducing apparatus according to Embodiment 7 of the present invention. FIG. 14 is an explanatory diagram showing the structure of playback data recorded on a medium used in the viewer video recording / playback apparatus according to the seventh embodiment.

The viewer video recording / reproducing apparatus according to the seventh embodiment has almost the same configuration as the viewer video recording / reproducing apparatus according to the first and fifth embodiments. Only parts different from the viewer video recording / reproducing apparatus according to the fifth embodiment will be described. The portions having substantially the same functions as those of the viewer video recording / reproducing apparatuses according to the first and fifth embodiments are denoted by the same reference numerals, and detailed description thereof will be omitted.

In FIG. 13, reference numeral 123 denotes a voice recognition circuit for voice-recognizing a voice signal input from the microphone 16 to generate character information, and 124 denotes a character information from the voice recognition circuit 123 and an input from the camera 101. This is a telop insertion circuit for synthesizing a video as a telop.
As shown in FIG. 14, videos 1 to 10 are recorded in advance on the medium 105 as reproduction data.

In the viewer video recording / reproducing apparatus according to the seventh embodiment, the controller 108 reads out a signal from the medium 105 by using the reproducing circuit 109. The read signal passes through the buffer 110, is decoded by the decoder 111, and becomes a monitor output 112 and a speaker output 113.

As shown in FIG. 14, when the viewer
Suppose that while watching 0, cheers were raised in sections 4-6 and 8-9. At this time, the controller 108
And a viewer watching the reproduced video using the microphone 106, and the sound pressure level of the audio signal from the microphone 106 is detected by the sound pressure determination circuit 107, and the sound pressure level is set to a preset value. Is judged as a viewer's cheer. Then, the voice recognition circuit 123
The character information is generated based on the voice from. Subsequently, the telop insertion circuit 124 combines the character information with the viewer video as a telop, and then encodes the viewer video using the encoder 102.

The coded signal and the position information in the range where the sound pressure level is high pass through the buffer 103 and are stored in the recording circuit 104.
Are recorded as additional recording data 11 to 15 on the medium 105 by using. Further, by rearranging the reproduction data according to the reproduction procedure list, the additional recording data 11 to 15 are inserted between the videos 1 to 10.

Here, the buffer 102 from the encoder 102
03 is higher than the transfer rate input from the buffer 103 to the recording circuit 104 and the medium 105, and is higher than the transfer rate input from the medium 105 and the reproduction circuit 109 to the buffer 110. The transfer rate output from the buffer 110 to the decoder 111 is lower. Therefore, recording and reproduction of video and audio can be performed alternately without interruption. In the playback operation after the above operation is completed,
The controller 108 reads a signal from the medium 105 by using the reproduction circuit 109 according to the reproduction procedure list,
After being held in the buffer 110, the data is decoded by the decoder 111 and output as the monitor output 112 and the speaker output 113.

With the above operation, as shown in FIG.
Video and audio 11 to 1 in which the cheers of the viewer are synthesized as a telop with respect to the video 1 to 10 recorded in advance.
5 is appropriately inserted and reproduced. Here, the additionally recorded viewer images 11 to 15 correspond to the image 10 in FIG.
Need not be recorded continuously immediately after the
There is no problem even if the data is discretely recorded at a remote position on the line 5.

<Eighth Embodiment> Next, a viewer video recording / reproducing apparatus according to an eighth embodiment of the present invention will be described. FIG.
FIG. 14 is a block diagram illustrating a configuration of a viewer video recording / reproducing apparatus according to Embodiment 8 of the present invention. FIG. 16 is an explanatory diagram showing the structure of reproduction data recorded on a medium used in the viewer video recording and reproducing apparatus according to the eighth embodiment.

The viewer video recording / reproducing apparatus according to the eighth embodiment has almost the same configuration as the viewer video recording / reproducing apparatus according to the first and seventh embodiments. Only parts different from the viewer video recording / reproducing apparatus according to the seventh embodiment will be described. The portions having substantially the same functions as those of the viewer video recording / reproducing apparatuses according to the first and seventh embodiments are denoted by the same reference numerals, and detailed description is omitted.

In the viewer video recording / reproducing apparatus according to the seventh embodiment, the controller 108 uses the recording circuit 104 and the reproducing circuit 109 to record and reproduce the character information from the voice recognition circuit 123. In the media 105,
As shown in FIG. 16, as reproduction data, videos 1 to 10
Are recorded in advance.

In the viewer video recording / reproducing apparatus according to the seventh embodiment, the controller 108 reads out a signal from the medium 105 by using the reproducing circuit 109. The read signal passes through the buffer 110, is decoded by the decoder 105, and becomes a monitor output 112 and a speaker output 113.

As shown in FIG. 16, when the viewer
Suppose that while watching 0, cheers were raised in sections 4-6 and 8-9. At this time, the controller 108
And the microphone 106 is used to photograph a viewer who is watching the reproduced video, the sound pressure level is detected by the sound pressure determination circuit 107, and the range in which the sound pressure level exceeds a preset value Is determined to be a cheer. Then, the voice recognition circuit 12
3, character information is generated based on the sound from the microphone 106, and encoded using the encoder 102 as a viewer image.

The encoded signal and character information are stored in buffer 1
03 and the medium 105 using the recording circuit 104.
Are recorded as additional recording data 11 to 15. Also,
By rearranging the playback data according to the playback procedure list, the additional recording data 11 to 15 are inserted between the videos 1 to 10.

Here, from the encoder 102 to the buffer 1
03 is higher than the transfer rate input from the buffer 103 to the recording circuit 104 and the medium 105, and is higher than the transfer rate input from the medium 105 and the reproduction circuit 109 to the buffer 110. The transfer rate output from the buffer 110 to the decoder 111 is lower. Therefore, recording and reproduction of video and audio can be performed alternately without interruption.

In the reproducing operation after the above operation is completed, the controller 108 reads out the signal from the medium 105 by using the reproducing circuit 109 according to the reproducing procedure list, stores the signal in the buffer 110, and decodes the signal in the decoder 111. Monitor output 112 and speaker output 113
Output as At this time, with respect to the viewer image, character information recorded on the medium 105 is read, and the telop insertion circuit 124 combines the character information with the viewer image as a telop and outputs the telop.

With the above operation, as shown in FIG.
Video and audio 11 to 1 in which the cheers of the viewer are synthesized as a telop with respect to the video 1 to 10 recorded in advance.
5 is appropriately inserted and reproduced. Here, the additionally recorded viewer images 11 to 15 are the image 10 in FIG.
Need not be recorded continuously immediately after the
There is no problem even if the data is discretely recorded at a remote position on the line 5.

[0088]

The viewer video recording / reproducing apparatus according to the present invention has the above-described configuration, and therefore has the following effects.

According to the viewer video recording / reproducing apparatus of the present invention, the viewer is photographed while reproducing the medium on which the video and audio signals are recorded in advance, and the input video and audio signals are encoded. When the cheering of the viewer is detected, the image of the cheering viewer is recorded on the medium, and the information indicating the portion where the viewer image is inserted is recorded on the medium. Then, when reproducing the video and the audio signal recorded on the medium, it is possible to insert and reproduce the video in which the viewer cheers. Therefore, for example, it is possible to automatically record a scene in which a parent, grandparent, relative or the like who is watching a video of a baby or a child cheerfully cheers and insert and reproduce the scene at the time of reproduction.

Further, according to the viewer video recording / reproducing apparatus of the present invention, when reproducing the video and the audio signal recorded on the medium, the viewer can cheer up the reproduced video recorded in advance. The reproduced video of the user can be inserted as a sub-screen, and the respective sounds can be mixed and output. Therefore, for example, a scene in which parents, grandparents, relatives, and the like who are watching videos of a baby and a child cheerfully cheers can be automatically recorded as a child screen and inserted and reproduced at the time of reproduction.

Further, according to the viewer video recording / reproducing apparatus of the present invention, when reproducing the video and the audio signal recorded on the medium, the pre-recorded reproduced video sound and the cheerful viewing / listening are reproduced. Can be mixed with the reproduced sound of the user and output. Therefore, for example, it is possible to automatically record a scene in which a parent, a grandparent, a relative or the like who is watching a video of a baby or a child cheerfully cheers and mix and reproduce the sound during reproduction.

Further, according to the viewer video recording / reproducing apparatus of the present invention, the thumbnail video of the part where the viewer cheers is recorded on the medium, and the position of the original video corresponding to the thumbnail video on the medium is determined. Record the information you represent,
When reproducing a video and an audio signal, it is possible to call and reproduce a cheered video. Therefore, for example, it is possible to automatically record a scene in which a parent, grandparent, relative or the like who is watching a video of a baby or a child cheerfully cheers and insert and reproduce the scene at the time of reproduction. Furthermore, it is possible to save the image of the cheering part of the baby or child as a thumbnail image and directly call that scene.

Further, according to the viewer video recording / reproducing apparatus of the present invention, when a cheering is detected, the viewer who generated the cheering can be photographed in an enlarged manner and the enlarged image can be recorded on a medium. Therefore, for example, in a scene where parents, grandparents, relatives, and the like watching a video of a baby or child cheering, the person who cheers is automatically enlarged and recorded, and inserted and played back during playback. It becomes possible.

Further, according to the viewer video recording / reproducing apparatus of the present invention, the video of the entire viewer is recorded on the medium, and the position information in the video of the cheering viewer is recorded on the medium. When an audio signal is reproduced, a part of the reproduced image is cut out and enlarged based on the position information of the cheering occurrence location, and the viewer who cheers can be displayed in an enlarged manner. Thus, for example, parents, grandparents, watching videos of babies, children,
It is possible to automatically record a scene in which a relative or the like cheers, and enlarge and insert and reproduce the cheering person during reproduction. Furthermore, it is possible to insert and reproduce the video of the entire parent, grandparent, and relatives without enlarging a part of the video.

Further, according to the viewer video recording / reproducing apparatus of the present invention, it is possible to convert cheers raised by the viewer into text information, synthesize the text information as a telop with the video, and record it on a medium. Therefore, for example, when a parent watching a video of a baby or a child, a grandparent, a relative, etc. cheers, a cheer is automatically inserted and recorded as a telop and inserted and played back during playback. It becomes possible.

Further, according to the viewer video recording / reproducing apparatus of the present invention, when reproducing the audio and the video signal, the cheers can be synthesized as the telop into the video. Therefore, for example, in a scene where parents, grandparents, relatives, and the like watching a video of a baby or child cheering, a cheer is automatically recorded as telop information, and a video in which the telop is synthesized at the time of reproduction is automatically recorded. Insertion reproduction can be performed.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a viewer video recording / reproducing apparatus according to a first embodiment of the present invention.

FIG. 2 is an explanatory diagram showing a structure of reproduction data recorded on a medium used in the viewer video recording / reproducing device according to the first embodiment of the present invention.

FIG. 3 is a block diagram showing a configuration of a viewer video recording / reproducing apparatus according to Embodiment 2 of the present invention.

FIG. 4 is an explanatory diagram showing a structure of playback data recorded on a medium used in a viewer video recording / playback apparatus according to Embodiment 2 of the present invention.

FIG. 5 is a block diagram illustrating a configuration of a viewer video recording and reproducing apparatus according to a third embodiment of the present invention.

FIG. 6 is an explanatory diagram showing the structure of playback data recorded on a medium used in a viewer video recording / playback apparatus according to Embodiment 3 of the present invention.

FIG. 7 is a block diagram illustrating a configuration of a viewer video recording / reproducing apparatus according to a fourth embodiment of the present invention.

FIG. 8 is an explanatory diagram showing the structure of playback data recorded on a medium used in a viewer video recording / playback apparatus according to Embodiment 4 of the present invention.

FIG. 9 is a block diagram illustrating a configuration of a viewer video recording / reproducing apparatus according to Embodiment 5 of the present invention.

FIG. 10 is an explanatory diagram showing a structure of reproduction data recorded on a medium used in a viewer video recording / reproducing apparatus according to Embodiment 5 of the present invention.

FIG. 11 is a block diagram illustrating a configuration of a viewer video recording / reproducing apparatus according to Embodiment 6 of the present invention.

FIG. 12 is an explanatory diagram showing a structure of playback data recorded on a medium used in a viewer video recording / playback apparatus according to Embodiment 6 of the present invention.

FIG. 13 is a block diagram illustrating a configuration of a viewer video recording / reproducing apparatus according to Embodiment 7 of the present invention.

FIG. 14 is an explanatory diagram showing the structure of playback data recorded on a medium used in a viewer video recording / playback apparatus according to Embodiment 7 of the present invention.

FIG. 15 is a block diagram illustrating a configuration of a viewer video recording / reproducing apparatus according to Embodiment 8 of the present invention.

FIG. 16 is an explanatory diagram showing a structure of playback data recorded on a medium used in a viewer video recording / playback apparatus according to Embodiment 8 of the present invention.

[Explanation of symbols]

 101 Camera 102 Encoder 103 Buffer 104 Recording Circuit 105 Media 106 Microphone 107 Sound Pressure Judgment Circuit 108 Controller (CTL) 109 Reproduction Circuit 110 Buffer 111 Decoder 112 Monitor Output 113 Speaker Output 114-117 Buffer 118 Child Screen Synthesis Circuit (PinP) 119 Audio Mixing circuit (Mix) 120 Thumbnail creation circuit 121 Sound source determination circuit 122 Image cutout circuit 123 Voice recognition circuit 124 Telop insertion circuit

Continued on the front page F-term (reference)

Claims (8)

[Claims] 1. An image input means for inputting an image, an audio input means for inputting a sound, a sound pressure level detecting means for detecting a sound pressure level of an audio signal, Encoding means for encoding the audio signal; encoded signal holding means for temporarily holding the encoded signal; medium for storing the encoded signal; Signal recording and reproducing means for reproducing the signal recorded on the medium, reproducing signal holding means for temporarily retaining the reproduced signal, and decoding the reproduced signal. Audio and video signal generating means for generating video and audio signals, and position information recording and reproducing information for recording and reproducing position information for inserting a viewer image when reproducing the video and audio signals. The signal recording / reproducing means captures a viewer while reproducing a medium in which a video and an audio signal are recorded in advance, and the encoding means outputs the video from the video input means and the audio input Video and audio signals are encoded. The sound pressure level detecting means detects the cheering of the viewer. When the cheering of the viewer is detected, the signal recording / reproducing means makes the viewer cheer. When the video of the viewer is recorded on the medium, and the position information recording / reproducing means records information representing a portion where a viewer video is to be inserted on the medium, and reproduces the video and audio signals recorded on the medium. A video recording / reproducing apparatus which inserts and reproduces a video in which the viewer cheers. 2. A video and audio signal recorded on the medium, comprising: a sub-screen insertion unit for inserting another video as a sub-screen into a part of the video; and an audio mixing unit for mixing audio. When playing back, the reproduced picture of the cheering viewer is inserted as a sub-screen into the reproduced video recorded in advance by the sub-screen inserting means, and each audio is reproduced by the audio mixing means. 2. The viewer video recording / reproducing apparatus according to claim 1, wherein the viewer video recording / reproducing apparatus mixes and outputs. 3. An audio mixing means for mixing audio, wherein when reproducing the video and the audio signal recorded on the medium, the audio mixing means reproduces the audio of the reproduced video recorded in advance, 2. The viewer video recording / reproducing apparatus according to claim 1, wherein the viewer video recording / reproducing apparatus mixes and outputs the reproduced voice of the cheering viewer. 4. A thumbnail generating unit for reducing a plurality of videos to generate one video as a thumbnail image, and a video position recording and reproducing unit for recording and reproducing information indicating a video position on the medium. And recording the thumbnail image of the part where the viewer cheered by the thumbnail generating means on the medium, and the image position recording / reproducing means on the medium of the original image corresponding to the thumbnail image. 4. A method according to claim 1, further comprising the step of: recording information representing the position of the image, and calling and reproducing a cheered image when reproducing the image and the audio signal.
The viewer video recording / reproducing device according to any one of the above items. 5. A cheering occurrence location detecting means for detecting a cheering occurrence location in a video based on an input audio signal, and a video enlarging means for cutting out and enlarging a part of the video, When cheers are detected by the cheering occurrence location detecting means,
The viewer image recording / reproduction according to any one of claims 1 to 4, wherein the viewer who cheers by the image enlarging means is photographed in an enlarged manner, and the enlarged image is recorded on the medium. apparatus. 6. A cheering occurrence location detecting means for detecting a location of a cheering occurrence in a video based on an input audio signal, and positional information on a cheering occurrence location detected by said cheering occurrence location detecting means is provided. A cheering occurrence position information recording unit for recording on a medium; and an image enlarging unit for cutting out and enlarging a part of an image, wherein the signal recording and reproducing unit records an image of the entire viewer on the medium. At the same time, the cheering occurrence position information recording means records the position information in the image of the viewer who generated the cheering on the medium, and reproduces the video and the audio signal. A part of the reproduced video is cut out and enlarged based on the position information, and the viewer who cheers is enlarged and displayed. Viewer video recording and reproducing apparatus according to any one of the. 7. A character information generating unit for performing character recognition by performing voice recognition from an input audio signal, and a telop image for combining the character information generated by the character information generating unit into a video as a telop. A synthesizing unit, wherein the character information generating unit converts cheers raised by the viewer into character information, and the telop image synthesizing unit synthesizes the character information as a telop into a video and records it on the medium. The viewer video recording / reproducing apparatus according to any one of claims 1 to 6, wherein: 8. A character information generating means for performing character recognition from input voice signals to generate character information, a character information recording means for recording character information generated by the character information generating means, Character information reproducing means for reproducing the character information recorded in the character information recording means, and a telop video synthesizing means for synthesizing the character information reproduced by the character information reproducing means into a video as a telop, The viewer video recording / reproducing apparatus according to any one of claims 1 to 6, wherein, when reproducing an audio signal and a video signal, the telop video synthesizing means synthesizes cheers as a telop with the video. .