JP2008228005A - Video/audio processing apparatus, video/audio playback system, video/audio processing method, and video/audio processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce the burden, on a viewer, caused by unexpected high volume, without changing the volume during playback. <P>SOLUTION: A video/audio processing apparatus 3 comprises: a video buffer section 10 which stores inputted video data signals Da1 for a fixed playback time Ta and sequentially outputs them; an audio buffer section 11 which stores inputted audio data signals Db for the fixed playback time Ta and sequentially outputs them; a volume detection section 12 for detecting a volume level indicative of the volume of the audio data signals Db outputted from the audio buffer section 11 after the lapse of the playback time Ta; a warning display data generation section 13 for generating warning display data giving a warning of high-volume output in accordance with the volume level detected by the volume detection section 12; and a video combination section 14 which combines the warning display data with the video data signals Da1 outputted from the video buffer section 10 and outputs them prior to outputting the audio data signals Db that are the basis of generation of the warning display data, from the audio buffer section 11. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

The present invention relates to a video / audio processing apparatus, a video / audio reproduction system, a video / audio processing method, and a video / audio processing program for processing video and audio signals output from, for example, a TV tuner, an HDD recorder, a DVD player, and the like.

In general, for DVD and digital broadcast content, particularly content such as movies, a technique is used in which the volume is greatly varied to express the power of video.
However, sudden increase in sound volume has a great impact on the viewer, both mentally and physically. If the viewer is suffering from a heart disease, for example, the viewer may be adversely affected. is there.

On the other hand, various techniques for preventing sudden large volume output have been studied. As this type of technology, for example, a volume level is monitored by volume monitoring means, and if it exceeds a predetermined volume level, an audio signal is automatically cut off to prevent an excessive volume from being output from a speaker (
For example, refer to Patent Document 1), and for example, a preset maximum volume value is compared with a set volume value by volume operation, and if the set volume value by volume operation is larger than the maximum volume value, the volume is maximized. There is a technique (for example, refer to Patent Document 2) that prevents sudden loud output during volume operation by limiting the volume value.
JP-A-7-226630 JP 2001-196959 A

However, if the above-described technology is used to prevent sudden loud sound output during content viewing / playback, there is a problem in that the force of the content video is lost or a sense of incongruity occurs. Further, if the audio signal level is automatically lowered as a whole to prevent a loud sound, there is a problem that it is difficult to hear the sound in a scene where the audio signal level is originally low.

The present invention has been made in view of the above circumstances, and a video / audio processing device, a video / audio reproduction system, and a video / audio reproduction system that can reduce a burden on a viewer due to a sudden loud volume without changing the volume during reproduction, It is an object to provide a video / audio processing method and a video / audio processing program.

[Mode 1] In order to achieve the above object, the video / audio processing apparatus according to mode 1 stores the input video data for a predetermined reproduction time and sequentially outputs the video data, and inputs the video data in synchronization with the video data. An audio buffer unit for accumulating the audio data for the predetermined reproduction time and sequentially outputting the audio data; and a volume of the audio data input to the audio buffer unit and output from the audio buffer unit after the predetermined reproduction time has elapsed. A volume detection unit that detects a certain volume level, a warning display data acquisition unit that acquires warning display data of a warning display that warns a high volume output according to the volume level detected by the volume detection unit, and the warning The warning display data acquired by the display data acquisition unit is output from the voice buffer unit as the voice data from which the warning display data is acquired. And a video synthesis unit for synthesizing the video data output from the video buffer unit.

According to such a configuration, the volume level of the audio data to be played back is detected, and a warning display that warns of the volume output according to the volume level is displayed before the volume is actually output. The Thereby, the high volume output is notified to the viewer through vision in advance, and it is possible to relieve the viewer's mental and physical pain and impact and reduce the burden.
Further, since the volume at the time of reproduction is not changed, the force of the content is not impaired.

[Mode 2] The video / audio processing device according to mode 2 is the video / audio processing device according to mode 1, wherein the warning display data acquisition unit is based on the volume level detected by the volume detection unit.
A volume level fluctuation amount that is a fluctuation amount per predetermined time of the volume level is calculated, and the warning display data is acquired when the volume level fluctuation amount is a predetermined threshold value or more.

According to such a configuration, the warning display is displayed based on the amount of temporal fluctuation of the volume, not the absolute value (fixed value) of the volume.
In general, even when a certain volume level is large, when the volume level changes from a small volume level to a relatively long time and the volume changes relatively slowly, even if the volume level is output, the viewer will not be surprised.
Therefore, in the configuration that determines the presence or absence of warning display based on the absolute value of the volume,
Since a warning display is always performed at the time of outputting a large volume, as described above, a useless warning display is performed regardless of a situation in which the viewer is not surprised, which impairs the viewing of a moving image.
On the other hand, since the warning display is performed only when the volume suddenly increases by determining the presence or absence of the warning display based on the temporal fluctuation amount of the volume, the viewing of the video may be harmed. Absent.

[Mode 3] The video / audio processing device according to mode 3 is the video / audio processing device according to mode 2, wherein the warning display data acquisition unit acquires the warning display data capable of identifying the magnitude of the volume level fluctuation amount. It is characterized by.
According to such a configuration, the viewer can detect in advance how much sound volume is output as well as outputting a large sound volume.

[Mode 4] The video / audio processing device according to mode 4 is the video / audio processing device according to any one of modes 1 to 3, wherein the volume detection unit performs Fourier transform on the audio data output from the audio buffer unit, A Fourier transformer that converts the sound volume level data for each band, a frequency characteristic table that holds frequency characteristic values in human hearing, and a multiplier that multiplies the frequency characteristic values for each of the sound volume level data for each frequency band. And an adder for calculating the sum of the sound volume level data by adding the calculation results by the multiplier, and a low pass for removing high frequency components of the fluctuation amount of the sound volume level per predetermined time from the calculation results by the adder And a filter.
According to such a configuration, a volume level reflecting frequency characteristics in general human hearing is detected, and a warning display can be issued based on the volume level that the viewer actually feels as a high volume.

[Mode 5] In order to achieve the above object, a video / audio reproduction system according to mode 5 includes a data output device that outputs video data and audio data, a display device that displays video based on the video data, and the audio. A video / audio reproduction system having an audio output device for outputting audio based on data, wherein the video data output from the data output device is accumulated for a predetermined reproduction time and sequentially output; The audio data output from the data output device in synchronism with the video data is accumulated for the predetermined reproduction time and sequentially output, and the audio buffer unit is input to the audio buffer unit, and after the predetermined reproduction time has elapsed A volume detection unit that detects a volume level that is a volume of the audio data output from the audio buffer unit;
According to the volume level detected by the volume detection unit, a warning display data generation unit that generates warning display data for warning display that warns a high volume output, and the warning display generated by the warning display data generation unit A video synthesizing unit that synthesizes data with the video data output from the video buffer unit before the audio data from which the warning display data is generated is output from the audio buffer unit; A video output unit that outputs the video data output from the video synthesis unit to the display device; and an audio output unit that outputs the audio data output from the audio buffer unit to the audio output device. Features.

According to such a configuration, the volume level of the audio data to be played back is detected, and a warning display that warns of the volume output according to the volume level is displayed before the volume is actually output. Is displayed. As a result, a large volume output is notified to the viewer in advance through vision,
Relieve viewers' mental and physical distress and shock, and reduce the burden.
Further, since the volume at the time of reproduction is not changed, the force of the content is not impaired.

[Mode 6] In order to achieve the above object, the video / audio processing method according to mode 6 uses a video / audio processing apparatus including a video buffer unit, an audio buffer unit, a volume detection unit, a warning display data acquisition unit, and a video synthesis unit. A first process in which the video buffer unit accumulates input video data for a predetermined reproduction time and sequentially outputs the data, and the audio buffer unit inputs in synchronization with the video data. A second process of accumulating the audio data for the predetermined reproduction time and sequentially outputting the audio data, and the audio detection unit is input to the audio buffer unit in the second process, and the audio buffer after the elapse of the predetermined reproduction time A third step of detecting a volume level that is a volume of the audio data output from the unit, and the warning display data acquisition unit responds to the volume level detected by the third step. Next, a fourth process of acquiring warning display data of a warning display that warns of a high volume output, and the video composition unit acquires the warning display data acquired by the fourth process, as the acquisition of the warning display data. And a fifth step of synthesizing the original audio data with the video data output from the video buffer unit before the audio data is output from the audio buffer unit.
According to this video / audio processing method, an effect equivalent to that of the video / audio processing apparatus of aspect 1 can be obtained.

[Mode 7] In order to achieve the above object, the video / audio processing program according to mode 7 stores the input video data for a certain reproduction time and sequentially outputs it, and inputs the video data in synchronization with the video data. A computer having an audio buffer unit that accumulates the audio data for the predetermined reproduction time and sequentially outputs the computer, is input to the audio buffer unit, and is output from the audio buffer unit after the elapse of the predetermined reproduction time Volume detection means for detecting a volume level that is the volume of audio data, and warning display data acquisition means for acquiring warning display warning display data for warning a high volume output according to the volume level detected by the volume detection means And the warning display data acquired by the warning display data acquisition means is the sound from which the warning display data was acquired. The voice data is made to function as a video synthesizing unit that synthesizes the video data output from the video buffer unit before the voice data is output from the audio buffer unit.
According to this video / audio processing program, when the program is read by the computer and the computer executes processing in accordance with the read program, the same operations and effects as those of the video / audio processing device of mode 1 can be obtained.

[Embodiment 8] In order to achieve the above object, the recording medium of Embodiment 8 has a video buffer unit that stores input video data for a certain reproduction time and sequentially outputs it, and is input in synchronization with the video data. The audio data that is input to the audio buffer unit and is output from the audio buffer unit after the elapse of the predetermined reproduction time, with a computer having an audio buffer unit that accumulates the audio data for the predetermined reproduction time and sequentially outputs the computer Volume detection means for detecting a volume level that is a volume of the sound, warning display data acquisition means for acquiring warning display data for warning display that warns a high volume output according to the volume level detected by the volume detection means, and , The warning display data acquired by the warning display data acquisition means is the voice data from which the warning display data is acquired is A computer-readable recording medium storing a video / audio processing program that functions as a video synthesizing unit that synthesizes the video data output from the video buffer unit before being output from the audio buffer unit. To do.
According to this recording medium, the program is read from the recording medium by the computer,
When the computer executes the process according to the read program, the same operation and effect as those of the video / audio processing apparatus of mode 1 can be obtained.
Here, the recording medium is a semiconductor recording medium such as RAM or ROM, a magnetic storage type recording medium such as FD or HD, an optical reading type recording medium such as CD, CDV, LD, or DVD, or a magnetic recording type such as MO. / Optical reading type recording medium, and any recording medium can be used as long as it can be read by a computer regardless of electronic, magnetic, optical, etc. .

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a functional configuration of a video / audio reproduction system 1 according to the present embodiment.
The video / audio reproduction system 1 reproduces various video contents including video and audio, such as a program broadcast by a television broadcast, a movie or a live video recorded on a recording medium such as a DVD or a video tape. 1 and includes a content data output device 2, a video / audio processing device 3, a display device 4, and an audio output device 5, as shown in FIG.

The content data output device 2 outputs the video data signal Da1 of the content and the audio data signal Db reproduced in synchronization with the video data signal Da1 to the video / audio processing device 3, for example, digital / analog Receiving content data recorded on a recording medium such as a TV broadcast receiving tuner device, a computer that receives multimedia data distributed over a network, or a recording medium such as a video player or a DVD player, and playing it back It is comprised with the apparatus which performs.

The video / audio processing device 3 displays a warning display warning the sudden high volume output on the display device 4 in advance when the volume greatly fluctuates during the reproduction of the content, and the video data including the warning display The signal Da2 is output to the display device 4, and the audio data signal Db to be reproduced in synchronization with the video data signal Da2 is output to the audio output device 5. The detailed configuration of the video / audio processing device 3 will be described later.

The display device 4 is a device that displays content video based on the video data signal Da2. For example, any device such as a projection device or a television monitor can be used.
The audio output device 5 outputs audio based on the audio data signal Db. For example, an amplifier device that outputs an analog audio signal by changing the audio signal level of the audio data signal Db, and an output from this amplifier device And a speaker device that outputs sound according to the analog audio signal.
The display device 4 and the audio output device 5 may be configured as a general television monitor device with a speaker device.

The configuration of the video / audio processing device 3 will be described in detail. The video / audio processing device 3 includes a video buffer unit 10, an audio buffer unit 11, a sound volume detection unit 12, a warning display data generation unit 13, and a video synthesis unit 14. A video output unit 15 and an audio output unit 16.
The video buffer unit 10 has a buffer memory, and temporarily buffers (accumulates) the video data signal Da1 input from the content data output device 2 for a predetermined playback time Ta (for example, 0.5 seconds). Then, the data is sequentially output to the video composition unit 14, and by this buffering operation, a delay of a certain reproduction time Ta is provided between the input timing of the video data signal Da1 and the output timing to the display device 4. It is generated.

The audio buffer unit 11 has a buffer memory and temporarily buffers the audio data signal Db input from the content data output device 2 in synchronization with the video data signal Da1 for the predetermined reproduction time Ta. In the same manner as the video buffer unit 10, the buffering operation causes the audio data signal Db to be input between the input timing of the audio data signal Db and the output timing to the audio output device 5. A delay of a certain reproduction time Ta is generated.
The sound volume detector 12 detects a sound volume level indicating a sound volume index at the time of sound output based on the sound data signal Db, and outputs a sound volume level detection signal E to the warning display data generator 13. The specific configuration will be described in detail later.

Here, when the audio data signal Db is buffered, the audio buffer unit 11 also outputs the audio data signal Db to the sound volume detection unit 12, and the predetermined audio data signal Db is buffered. During the reproduction time Ta, the volume detection unit 12 detects the volume level of the audio data signal Db, and the volume level detection signal E is output to the warning display data generation unit 13. In general, the sound volume output from the speaker device is obtained by multiplying the sound volume level by the signal amplification factor of the amplifier device. Therefore, the sound volume level indicates an index of sound volume when outputting sound.

The warning display data generation unit 13 generates warning display data of a warning display G (see FIG. 4) that warns of a high volume output according to the volume level detection signal E output from the volume detection unit 12, and a video synthesis unit 14 for output.
More specifically, a volume level detection signal E is input to the warning display data generation unit 13 from the volume detection unit 12 every predetermined unit time (for example, about 100 ms). Each time the volume level detection signal E is input, the warning display data generation unit 13 subtracts the volume level of the volume level detection signal E input once before from the volume level of the volume level detection signal E input this time. Thus, a sound volume level fluctuation amount ΔA, which is a time volume fluctuation amount per predetermined time (unit time), is calculated. The volume level fluctuation amount ΔA indicates how much the output volume increases or decreases.
Further, after calculating the volume level fluctuation amount ΔA, the warning display data generation unit 13 compares the volume level fluctuation amount ΔA with a predetermined volume level fluctuation amount threshold value ΔAth. When the volume level fluctuation amount ΔA is equal to or greater than the volume level fluctuation amount threshold value ΔAth, the warning display data generation unit 13 generates warning display data that is the warning display data and outputs the warning display data to the video composition unit 14.

Here, in the present embodiment, the volume level variation threshold ΔAth is not set to one value, but three volume level variation thresholds ΔAth1 to ΔAth3 are set. These volume level fluctuation amount threshold values ΔAth1 to ΔAth3 are set so that the values thereof are ΔAth1 <ΔAth2 <ΔAth3. The minimum volume level fluctuation amount threshold value ΔAth1, which is the minimum value, is the minimum volume level fluctuation amount that can give a mental or physical burden to the viewer, and is obtained in advance through experiments or the like.

The warning display data generation unit 13 includes the volume level fluctuation amount ΔA and the volume level fluctuation amount threshold value ΔA.
th1 to ΔAth3 are compared to specify a volume level fluctuation amount threshold value ΔAth that exceeds the volume level fluctuation amount ΔA, and first to third warnings having different display modes according to the specified volume level fluctuation amount threshold value ΔAth. Warning display data for the displays G1 to G3 (see FIG. 4) is generated.
Specifically, the warning display data generation unit 13 generates warning display warning display data indicating the magnitude of the fluctuation amount as the volume level fluctuation amount ΔA increases. This warning display can notify the viewer of how loud the volume is.

The warning display data generation unit 13 does not generate the warning display data in real time, but stores warning display data in association with each of the volume level variation thresholds ΔAth1 to ΔAth3 in advance. The warning display data corresponding to the volume level fluctuation amount threshold value ΔAth specified by the comparison with the volume level fluctuation amount ΔA is acquired, and the warning display data is output to the video composition unit 14.
Further, the number of volume level fluctuation amount threshold values ΔAth can be set to an arbitrary number as long as it is one or more.

The video composition unit 14 receives the video data signal D currently output from the video buffer unit 10.
a1 is combined with the warning display data to generate the video data signal Da2 including the warning display,
The video is output to the video output unit 15. The output of the video data signal Da2 including this warning display is continued at least until the audio data signal Db that is the basis for generating the warning display is output, that is, until the time when the loud sound is output.

Here, the warning display data synthesized by the video synthesizing unit 14 with the video data signal Da1 is for the audio data signal Db output from the audio buffer unit 11 after the predetermined reproduction time Ta has elapsed, and this warning display data is Since it is combined with the video data signal Da1 output from the video buffer unit 10 at the present time and output, the maximum reproduction time Ta is the maximum with respect to the timing of suddenly outputting a large volume. The video data signal Da2 including the warning display is output at an early timing.
Therefore, by increasing the reproduction time (data amount) of the data buffered by the video buffer unit 10 and the audio buffer unit 11, the timing for outputting the warning display based on the viewer's visibility or the like is further advanced. Can be adjusted.
When the volume level fluctuation amount ΔA is less than the volume level fluctuation amount threshold value ΔAth1,
Since warning display data is not output from the warning display data generation unit 13, the video data signal Da2 output from the video synthesis unit 14 is the same as the video data signal Da1.

The video output unit 15 outputs a video data signal Da2 to the display device 4, and
It functions as a connection interface with the display device 4.
The audio output unit 16 outputs an audio data signal Db reproduced in synchronization with the video data signal Da2 to the audio output device 5 and functions as a connection interface with the audio output device 5.

The video / audio processing device 3 includes a CPU as a calculation execution unit and a ROM as a storage unit.
By having a RAM functioning as a work area for the CPU, a connection interface for each of the content data output device 2, the display device 4, and the audio output device 5, etc., and executing a video / audio processing program stored in the ROM, It is good also as a structure by which the function of each part mentioned above is implement | achieved, and you may comprise each part with exclusive hardware.

FIG. 2 is a diagram showing a functional configuration of the sound volume detector 12.
The sound volume detection unit 12 includes a Fourier transformer 20, a frequency characteristic table 21, a multiplier 22, an adder 23, and a low-pass filter 24.
The Fourier transformer 20 performs Fourier transform on the audio data signal Db input from the audio buffer unit 11, converts it into volume level data for each frequency band per unit time (for example, 100 ms), and outputs it to the multiplier 22.
The frequency characteristic table 21 is table data that holds frequency characteristic values in general human hearing, and outputs the frequency characteristic values to the multiplier 22.
The multiplier 22 multiplies each of the volume level data for each frequency band output from the Fourier transformer 20 by the frequency characteristic value output from the frequency characteristic table 21 and outputs the result to the adder 23.
In this way, by calculating the volume level reflecting the frequency characteristics of general human hearing for the audio data signal Db of the content, the volume level actually felt by the viewer when viewing the content is accurately calculated. be able to.

The adder 23 adds the volume level data for each frequency band output from the multiplier 22, calculates the sum of the volume levels, and outputs the sum to the low-pass filter 24. As described above, since the Fourier transformer 20 outputs volume level data per unit time (for example, 100 ms),
Similarly, the adder 23 outputs a volume level calculation result to the low-pass filter 24 every unit time (for example, 100 ms).
The low-pass filter 24 removes a high-frequency component of the volume fluctuation in order to prevent a warning display from being erroneously displayed due to a very short (spike-like) volume fluctuation or noise that should not be detected as a high volume, The sound volume level detection signal E is output to the warning display data generation unit 13.

Next, as the operation of the present embodiment, the operation of the video / audio processing apparatus 3 when reproducing the video and audio of the content will be described.
As described above, when the video data signal Da1 and the audio data signal Db synchronized with the video data signal Da1 are input from the content data output device 2, the video / audio processing device 3 receives the video data signal Da1 as the video buffer unit 10. And the audio data signal Db is buffered in the audio buffer unit 11.

When the buffering of the audio data signal Db to the audio buffer unit 11 is started, the video / audio processing device 3 has a volume for displaying a warning display in advance when the volume suddenly increases during the reproduction of the content. Advance warning processing starts.
FIG. 3 is a flowchart of the volume advance warning process.
In this volume pre-warning process, the volume detection unit 12 detects the volume level per unit time (for example, 100 ms) based on the audio data signal Db input to the video / audio processing device 3, and the volume level detection signal E Is output to the warning display data generation unit 13 (step S1).
).

Next, each time the volume level detection signal E is input from the volume detection unit 12, the warning display data generation unit 13 and the volume level of the volume level detection signal E input this time and the volume level input once before are displayed. A volume level fluctuation amount ΔA, which is a difference from the volume level of the detection signal E, is calculated (
Step S2).
Then, the warning display data generation unit 13 determines whether or not the volume level variation amount ΔA is a variation amount that requires a warning display, and the volume level variation amount thresholds ΔAth1 to ΔAth3.
It is determined whether or not the volume level fluctuation amount ΔA is smaller than the volume level fluctuation amount threshold value ΔAth1 which is the smallest value (step S3). If it is smaller (step S3: Yes), no warning display is required. If the warning display is already displayed, the warning display is deleted (step S4), and then the process is repeated from step S1 to monitor the volume level fluctuation.

On the other hand, when the volume level fluctuation amount ΔA is equal to or larger than the volume level fluctuation amount threshold value ΔAth1 (step S3: No), the warning display data generation unit 13 determines that the volume level fluctuation amount ΔA is the volume level in order to specify the degree of increase in volume. It is determined whether or not it is smaller than the variation amount threshold value ΔAth2 (step S5). If it is smaller (step S5: Yes), warning display data corresponding to the volume level variation amount ΔAth1 is acquired and output to the video composition unit 14, 1 warning display G1 is displayed (step S6).
Further, the volume level fluctuation amount ΔA is equal to or larger than the volume level fluctuation amount threshold value ΔAth2 (step S
5: No), and if it is smaller than the volume level fluctuation amount threshold value ΔAth3 (step S7: Yes), the warning display data corresponding to the volume level fluctuation amount ΔAth2 is acquired and output to the video composition unit 14, and the second A warning display G2 is displayed (step S8), and the volume level fluctuation amount Δ
If A is greater than or equal to the volume level fluctuation amount threshold ΔAth3 (step S7: No), warning display data corresponding to the volume level fluctuation amount ΔAth3 is acquired and output to the video composition unit 14,
A third warning display G3 is displayed (step S9).

With the above processing, when the output volume fluctuation amount is equal to or larger than the volume level fluctuation threshold ΔAth1 during content playback, the output volume greatly fluctuates before suddenly high volume is output. As shown in FIGS. 4A to 4C, warning displays G1 to G3 corresponding to the amount of change in volume are displayed on the display screen 4A of the display device 4.

As described above, according to the present embodiment, a certain reproduction time T is input to the audio buffer unit 11.
The volume detector 12 detects the volume level indicating the volume of the audio data signal Db output from the audio buffer unit 11 after e has elapsed, and the volume level is detected according to the volume level detection signal E detected by the volume detector 12. The warning display data generation unit 13 that generates warning display data of the warning display G that warns the output, and the warning display data generated by the warning display data generation unit 13 are used as the voice that generated the warning display data. The video signal synthesizing unit 14 is configured to synthesize the video data signal Da1 output from the video buffer unit 10 before the data signal Db is output from the audio buffer unit 11 and output the video data signal Da2.

With this configuration, the volume level of the audio data signal Db to be reproduced is detected, and a warning display G that warns of a high volume output according to the volume level is displayed before the actual high volume is output. Therefore, the loud sound output is notified to the viewer in advance through vision,
Relieve physical pain and shock and reduce the burden. In addition, since the volume at the time of reproduction is not changed, the force of the content is not impaired, and the content can be appreciated with peace of mind without worrying about suddenly large volume generation.

Further, according to the present embodiment, the warning display data generation unit 13 calculates the volume level fluctuation amount ΔA indicating the fluctuation amount of the volume level per predetermined time based on the volume level detected by the volume detection unit 12. The volume level fluctuation amount ΔA is a predetermined volume level fluctuation amount threshold value ΔAth1.
In such a case, the warning display data is generated.
According to this configuration, the warning display G is displayed based not on the absolute value (fixed value) of the sound volume but on the temporal fluctuation amount of the sound volume.
That is, in general, even when the sound volume is high to a certain level, if the time from the low sound volume to the high sound volume is long and the sound volume changes relatively slowly, even if the sound volume is output, the viewer will not be surprised. Therefore, in the configuration in which the presence / absence of the warning display G is determined based on the absolute value of the volume, the warning display G is always performed at the time of outputting a large volume, so that the viewer is not surprised as described above. Nevertheless, useless warning display G is performed, which impairs the viewing of moving images.
On the other hand, according to the present embodiment, the warning display is performed only when the volume suddenly increases by determining the presence or absence of the warning display G based on the temporal fluctuation amount of the volume. Watching videos is not harmed.

Further, according to the present embodiment, the warning display data generation unit 13 generates warning display data of warning displays G1 to G3 that can identify the magnitude of the volume level fluctuation amount ΔA based on the volume level fluctuation amount ΔA. did. According to such a configuration, the viewer can know in advance how much sound volume is output as well as outputting a large sound volume by viewing the warning displays G1 to G3.

Further, according to the present embodiment, the volume detector 12 detects the volume level of the audio data signal Db based on the frequency component of the audio data signal Db and the auditory frequency characteristic data indicating the frequency characteristic of human hearing. Due to the configuration, a volume level reflecting frequency characteristics in general human hearing is detected, and a warning display G is displayed based on the volume level that the viewer actually feels as a high volume.
1 to G3 can be issued.

The above-described embodiment is merely an aspect of the present invention, and can be arbitrarily modified and applied within the scope of the present invention.
(Modification 1)
For example, in the embodiment described above, the warning displays G1 to G3 that can recognize the magnitude of the volume level fluctuation amount ΔA are displayed according to the magnitude of the volume level fluctuation amount ΔA. As the level fluctuation amount ΔA increases, for example, FIGS.
As shown in the diagram, the display is increased in the order of the warning display G1, the warning display G2, and the warning display G3, or the display portion is moved to the center side of the display screen 4A to improve the visibility. The person may be surely aware of the warning display G.

(Modification 2)
For example, in the embodiment described above, the video / audio processing device 3 outputs the video data signal Da2 and the audio data signal Db to the display device 4 and the audio output device 5, respectively, and reproduces the content in real time. Although 1 was illustrated, it is not restricted to this.
That is, the video / audio processing device 3 converts the video data signal Da2 and the audio data signal Db into the video data signal Da2 and the audio data signal Db of, for example, a hard disk / DVD recording device, a video recording device, or a personal computer. The content data that is output to a recordable device and the video with the warning display G is stored by these devices, and then the content is reproduced by the display device 4 and the audio output device 5. Also good.

(Modification 3)
Further, for example, in the above-described embodiment, the video / audio reproduction system 1 in which the video / audio processing device 3 is separated from the content data output device 2 is illustrated, but the present invention is not limited thereto, and the content data output device 2 and the video / audio processing device are used. 3 can be configured as an integrated device, and the video / audio processing device 3 and the display device 4 and / or the audio output device 5 can also be configured as an integrated device.

The figure which shows the functional structure of a video / audio processing apparatus with the structure of the video / audio reproduction system which concerns on embodiment of this invention. The figure which shows the functional structure of a volume detection part. The flowchart of a volume warning process. The figure which shows the aspect of a warning display. The figure which shows the other aspect of a warning display.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Video / audio reproduction system, 2 ... Content data output device, 3 ... Video / audio processing device,
4 ... display device, 5 ... audio output device, Da1, Da2 ... video data signal, G, G1-G3 ...
Warning display, ΔAth, ΔAth1 to ΔAth3 ... Volume level fluctuation threshold, 10 ... Video buffer unit, 11 ... Audio buffer unit, 12 ... Volume detection unit, 13 ... Warning display data generation unit, 14
... Video synthesis unit, 15 ... Video output unit, 16 ... Audio output unit, 21 ... Frequency characteristic table, 24
... Low-pass filter, E ... Volume level detection signal, Ta ... Constant playback time.

Claims (7)

A video buffer unit that accumulates the input video data for a certain playback time and sequentially outputs it,
An audio buffer unit that accumulates the audio data input in synchronization with the video data for the predetermined reproduction time and sequentially outputs the audio data;
A volume detection unit that detects a volume level that is a volume of the audio data that is input to the audio buffer unit and is output from the audio buffer unit after the predetermined reproduction time has elapsed;
A warning display data acquisition unit that acquires warning display data of a warning display that warns a high volume output according to the volume level detected by the volume detection unit;
The warning display data acquired by the warning display data acquisition unit is output from the video buffer unit before the audio data from which the warning display data is acquired is output from the audio buffer unit. A video synthesizing unit that synthesizes the video data. The video / audio processing apparatus according to claim 1,
The warning display data acquisition unit calculates a volume level variation amount that is a variation amount per predetermined time of the volume level based on the volume level detected by the volume detection unit, and the volume level variation amount is predetermined. The video / audio processing apparatus is characterized in that the warning display data is acquired when the threshold value is equal to or greater than a threshold value. The video / audio processing apparatus according to claim 2,
The video / audio processing apparatus, wherein the warning display data acquisition unit acquires the warning display data capable of identifying the magnitude of the volume level fluctuation amount. The video and audio processing apparatus according to any one of claims 1 to 3,
The sound volume detection unit performs a Fourier transform on the sound data output from the sound buffer unit, and converts the sound data into sound volume level data for each frequency band; and
A frequency characteristic table that holds frequency characteristic values in human hearing;
For each of the volume level data for each frequency band, a multiplier that multiplies the frequency characteristic value;
An adder that adds the calculation results by the multiplier and calculates the sum of the volume level data;
A low-pass filter that removes a high-frequency component of a fluctuation amount per predetermined time of the volume level from a calculation result by the adder;
A video / audio processing apparatus comprising: A video / audio reproduction system comprising: a data output device that outputs video data and audio data; a display device that displays video based on the video data; and an audio output device that outputs audio based on the audio data. And
A video buffer unit for accumulating the video data output from the data output device for a predetermined playback time and sequentially outputting the video data;
An audio buffer unit for accumulating the audio data output in synchronization with the video data from the data output device for the predetermined reproduction time and sequentially outputting the audio data;
A volume detection unit that detects a volume level that is a volume of the audio data that is input to the audio buffer unit and is output from the audio buffer unit after the predetermined reproduction time has elapsed;
A warning display data generation unit that generates warning display warning display data for warning a high volume output according to the volume level detected by the volume detection unit;
The warning display data generated by the warning display data generation unit is output from the video buffer unit before the audio data from which the warning display data is generated is output from the audio buffer unit. A video composition unit for compositing the video data;
A video output unit for outputting the video data output from the video synthesis unit to the display device;
An audio / video reproduction system comprising: an audio output unit that outputs the audio data output from the audio buffer unit to the audio output device. A video / audio processing method using a video / audio processing apparatus including a video buffer unit, an audio buffer unit, a volume detection unit, a warning display data acquisition unit, and a video synthesis unit,
A first process in which the video buffer unit accumulates input video data for a predetermined playback time and sequentially outputs the data;
A second process in which the audio buffer unit accumulates and sequentially outputs the audio data input in synchronization with the video data for the predetermined reproduction time;
A third step in which the voice detection unit detects a volume level that is a volume of the voice data that is input to the voice buffer unit in the second step and is output from the voice buffer unit after the predetermined reproduction time has elapsed; ,
A fourth process in which the warning display data acquisition unit acquires warning display data of a warning display that warns a high volume output according to the volume level detected in the third process;
The video synthesis unit uses the video buffer before the audio data from which the audio display data from which the warning display data is acquired is output from the audio buffer unit. And a fifth step of synthesizing the video data output from the unit. A video buffer unit that stores input video data for a predetermined playback time and sequentially outputs the data, and an audio buffer unit that stores audio data input in synchronization with the video data for the predetermined playback time and sequentially outputs the data. Computer with
Volume detection means for detecting a volume level that is input to the audio buffer unit and output from the audio buffer unit after the certain playback time has elapsed,
Warning display data acquisition means for acquiring warning display data for warning display for warning a high volume output according to the volume level detected by the volume detection means; and
The warning display data acquired by the warning display data acquisition means is output from the video buffer unit before the audio data from which the warning display data is acquired is output from the audio buffer unit. A video / audio processing program that functions as video synthesizing means for synthesizing the video data.

Images