JP2006148870A - Signal processing apparatus, signal processing method, signal processing program, program reproducing apparatus, image display apparatus and image display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a signal processing apparatus and a program reproducing apparatus capable of dealing with epoch-making novel programs. <P>SOLUTION: A signal processing apparatus comprises: an audio signal detection circuit which detects a specific audio signal from a broadcasting program including an image signal and an audio signal; and a control unit which controls an image processing processor, wherein the audio signal detection circuit generates a control signal for controlling the control unit when the audio signal detection circuit detects the specific audio signal, and the control unit controls the image processing processor according to the control signal so as to display a specific image and/or text by synthesizing the specific image and/or text corresponding to the specific audio signal and an image of the broadcasting program displayed according to the image signal. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a digital broadcasting system and a technique used for a receiver in the system, and more particularly to a signal processing technique for controlling a receiver or a device connected to the receiver according to an audio signal included in a broadcast wave.

  Digitalization of television broadcasting such as BS digital broadcasting and terrestrial digital broadcasting is in full swing. Among these digital broadcasting services, there is data broadcasting that enables interactive services with receiving users. This data broadcasting is described in “Standards of Data Broadcast Coding and Transmission System in Digital Broadcasting” and the like, which are standard specifications by the Radio Industries Association (ARIB).

  In the data broadcasting described above, there is an event message transmission method, in which message information is sent from a broadcasting station to an application operating on the receiving device, and the receiving device designates the message information as a trigger. Will perform the specified action. For example, in synchronism with a broadcast program, a graphic is displayed on a program image displayed on a display screen connected to a receiving device, or a D-VHS, a hard disk recorder, a DVC (Digital Video Camera), etc. It is possible to control the data recording device, record program content, control the printer, and print control of the program content.

  Hereinafter, with reference to FIG. 11 and FIG. 12, a description will be given mainly of a data reception and reconstruction part on the transmission side system and reception side in the conventional digital broadcasting.

  An AV (audio visual) content encoding apparatus 1001 reads data from a VTR device in which video content data and audio content data are recorded, performs compression and encoding such as MPEG2, and converts the encoded video and audio. The included elementary stream (hereinafter referred to as ES) is generated and output to the AV content generation / transmission apparatus 1002.

  The AV content generation / transmission apparatus 1002 synchronizes the video and audio ESs output from the AV content encoding apparatus 1001 and outputs them to the multiplexing apparatus 1009.

  The data content generation device 1003 produces data broadcasting content including monomedia data such as BML data, PNG, and JPEG data, converts it into section data, and outputs the data to the data content transmission device 1004.

  The data content transmission device 1004 is a device that carousels the data from the data content generation device 1003 according to a predetermined transmission schedule and transmits the data to the multiplexing device 1009.

  The event message generator 1005 creates stream descriptors including general event message descriptors and NPT (Normal Play Time) reference descriptors, converts them into section data, and outputs them to the event message transmitter 1006.

  The event message transmission device 1006 outputs the data from the event message generation device 1005 to the multiplexing device 1009 according to a predetermined transmission schedule or an arbitrary timing of the device operator.

The program information generation apparatus 1007 converts information related to the schedule of a broadcast program including EIT (Event Information Table) into section data and outputs the section data to the program information transmission apparatus 1008.

  The program information transmission apparatus 1008 outputs the data from the program information generation apparatus 1007 to the multiplexing apparatus 1009 at a predetermined transmission timing.

  The multiplexing device 1009 packetizes and multiplexes the streams and data from the AV content generation / transmission device 1002, the data content transmission device 1004, and the event message transmission device 1006 to generate a transport stream (hereinafter TS), which is not shown. Output to the subsequent digital modulator.

  FIG. 12 is an explanatory diagram in the case where video data, audio data, and data broadcast data are extracted by a demultiplexer 1110 from a TS received and demodulated via an antenna and a tuner (not shown) in a conventional digital broadcast receiver.

  In FIG. 12, reference numeral 1101 denotes a TS in which video data, audio data, SI data constituting an electronic program guide (EPG), and data broadcast data are time-division multiplexed.

The TS is configured in units of a fixed size packet (TS packet), and a PID (Packet Identifier) that is an identifier for identifying a data type included in the TS packet is assigned to the header part 1102 of each TS packet. Yes. Also, the payload portion 11 of the TS packet
Different Table IDs are assigned to PSI (Program Specific Information) data 1107, SI (Service Information) data 1109, and data broadcast data 1108 divided into 03, depending on the type of the data. Based on the Table ID, the section filter 1112 separates the data of the PSI data 1107, the SI data 1109, and the data broadcast data 1108 and sends them to the data stream processing unit 1106.

  When extracting video data and audio data, the demultiplexer 1110 first uses the PID filter 1111 and the section filter 1112 to extract the PSI data 1107 in the payload portion 1103 of a predetermined TS packet, and the data stream processing unit 1106 To send. PSI 1107 defines the entire contents of TS1101. After analyzing the PSI data 1107, the demultiplexer 1110 uses these pieces of information to extract video data and audio data and output them to the video decoder 1104 and the audio decoder 1105, respectively.

Hereinafter, the data broadcast data 1108 will be described. The data broadcast data 1108 includes (1) DII (Download Info Indication) transmitted by the data carousel transmission method, (2) DDB (Download Data Block), and (3) event message (stream) transmitted by the event message transmission method. Descriptors).

  (1) DII is section data describing transmission parameters and attribute information of each data broadcasting content module including BML data and monomedia data such as PNG and JPEG.

  (2) DDB is section data obtained by dividing a module into blocks of a certain size.

  (3) The event message (stream descriptor) is combined with DII and DDB transmitted by the data carousel transmission method, and is used for synchronous and asynchronous message notification to the receiving device application. Section data including a message descriptor and an NPT reference descriptor.

  While receiving and displaying the data broadcasting service in the receiving apparatus, a plurality of event messages designated by BML contents and broadcasting stations are simultaneously received at the same time using the PID filter 1011 and the section filter 1112, and the types of event messages separated. Thus, a predetermined control operation is executed.

  Japanese Laid-Open Patent Publication No. 63-190438 discloses a configuration in which a low frequency control signal is mixed with an audio signal and transmitted so as not to record a commercial in the VTR.

Further, a V chip is known as a method for preventing a minor from showing a harmful image (see Japanese Patent Application Laid-Open No. 11-317913). In this method, a dedicated V-chip mounted on a TV or the like reads the rating data (attribute information such as “for adults” and “it is better to watch with parents”) attached to the content, and the content is read. It is to decide whether or not to display.
JP-A-63-190438 JP 11-317913 A

  An object of at least a part of the inventions related to the present application is to realize a signal processing device, a signal processing method, a signal processing program, and a program reproduction device that can deal with a novel program that has not been heretofore known.

  An object of at least some of the inventions related to the present application is to provide an image display apparatus and method capable of appropriately controlling output of undesirable content even when attribute information is not added to the content. There is.

  The signal processing device of the present invention includes an audio signal detection circuit that detects a specific audio signal from a broadcast program including a video signal and an audio signal, and a control unit that controls an image processor, and the audio signal detection circuit When a specific audio signal is detected, the audio signal detection circuit generates a control signal for controlling the control unit, and the control unit is displayed according to a specific image and / or text and video signal corresponding to the specific audio signal. The image processor is controlled in accordance with the control signal so as to display a specific image and / or text by combining the images of the broadcast program.

  According to another aspect of the present invention, there is provided a program reproducing apparatus including the signal processing apparatus and a speaker that reproduces and outputs the audio signal.

  The signal processing apparatus of the present invention includes an audio signal detection circuit that detects a plurality of audio signals, and a control unit that controls an interface of the peripheral device, and the audio signal detection circuit is within a predetermined time. When a plurality of specific audio signals are detected, the audio signal detection circuit generates a control signal for controlling the control unit, and the control unit selectively executes predetermined control of the peripheral device according to the plurality of specific audio signals. It is characterized by that.

  The signal processing method of the present invention includes an audio signal detection step for detecting a specific audio signal from a broadcast program including a video signal and an audio signal, and a control step for controlling the image processor. In the detection step, when a specific audio signal is detected, the audio signal detection circuit generates a control signal for controlling the control unit. In the control step, a specific image and / or text and video signal corresponding to the specific audio signal are generated. The image processor is controlled in accordance with the control signal so as to display a specific image and / or text by synthesizing the images of the broadcast program displayed according to the above.

  The signal processing method of the present invention includes an audio signal detection step for detecting a plurality of audio signals and a control step for controlling the interface of the peripheral device. In the audio signal detection step, a predetermined time When a plurality of specific audio signals are detected, the audio signal detection circuit generates a control signal for controlling the control unit. In the control step, predetermined control of the peripheral device is selectively performed according to the plurality of specific audio signals. It is characterized by performing.

  The signal processing program of the present invention is a signal processing program for executing an audio signal detection step for detecting a specific audio signal from a broadcast program including a video signal and an audio signal, and a control step for controlling the image processor. In the audio signal detection step, when a specific audio signal is detected, the audio signal detection circuit generates a control signal for controlling the control unit. In the control step, a specific image and / or text corresponding to the specific audio signal is generated. The image processor is controlled according to the control signal so as to display a specific image and / or text by combining the images of the broadcast program displayed according to the video signal.

The signal processing program of the present invention is a signal processing program for causing a computer to execute an audio signal detection step for detecting a plurality of audio signals and a control step for controlling an interface of a peripheral device. In the step, when a plurality of specific audio signals are detected within a predetermined time, the audio signal detection circuit generates a control signal for controlling the control unit. In the control step, a predetermined signal of the peripheral device is determined according to the plurality of specific audio signals. The control is selectively executed.

  The image display apparatus according to the present invention is executed in association with the registered pattern, output means for outputting an image and sound, pattern registration means for registering a pattern consisting of an image or sound or a combination thereof, and the like. Action specifying means for allowing the user to specify an action, determination means for determining whether or not the pattern is included in the input image signal or sound signal, and stored image signal and sound signal if the pattern is not included And a control means for causing the output means to execute the designated action when the pattern is included.

  In this image display device, it is possible to suitably adopt a configuration in which the action is to output a predesignated image or sound instead of the stored image signal and sound signal.

  In addition, it is preferable that the apparatus further includes an input unit that receives an input from the user, and the action is a unit that receives an input from the user by the input unit after temporarily stopping the output of the image signal and the audio signal. Can be adopted. Further, in this configuration, the pattern is for determining whether or not an image of a product sales price is included in the image signal, and the action receives an input of a desired price from the user by the input means. Thereafter, a configuration in which the inputted desired price is displayed side by side with the product sales price of the image signal can be suitably employed.

Also, it is determined whether or not a pre-registered pattern is included in the input image signal and / or audio signal, and if the pattern is included, an output that outputs a pre-specified action image and / or audio is output. The present application includes a method invention characterized in that the method is executed.

  According to the present invention, it is possible to realize a signal processing apparatus, a signal processing method, a signal processing program, a program reproduction apparatus, and a program reproduction apparatus that can deal with a novel program that has not been conventionally available.

  DETAILED DESCRIPTION Exemplary embodiments of the present invention will be described in detail below with reference to the drawings. However, the dimensions, materials, shapes, relative arrangements, and the like of the components described in this embodiment are not intended to limit the scope of the present invention only to those unless otherwise specified. Absent.

(First embodiment)
As an example of a broadcast program to which the present embodiment is applied, a live broadcast quiz program is assumed. Specifically, a specific audible sound (hereinafter referred to as a voice keyword) applied to the program by the program producer side, for example, a quiz correct answer or a word close to the quiz correct answer is determined in advance. Then, the broadcasting station transmits the voice keyword to the receiving device using a conventional mechanism for transmitting data broadcasting data. The receiving device detects that the voice keyword is issued by a performer of the quiz program. Here, “detection” refers to detecting that an audio signal includes an audio keyword when an audio signal of a broadcast program is reproduced by a receiving device and an audible sound is output. At the detection timing, a graphic (image) as indicated by 1202 and / or a text of FIG. 2 (b) as indicated by 1203 is displayed on the image display unit of the receiving device indicated by 1201 in FIG. It is.

  FIG. 1 is a block diagram showing a configuration of a digital television receiver for realizing the above-described control and its surrounding environment. A digital television broadcast receiving apparatus is an example of an audio processing apparatus.

  In FIG. 1, the reference numerals indicate an antenna 101, a tuner module 102, a demultiplexer 103, a video decoder 104, an audio decoder 105, a display synthesis unit 106, a DAC 107, a display control unit 108, an audio control unit 109, an image display unit 110, An audio output unit 111, a control bus 112, a recording medium 115, a CPU 116, a keyword database unit 117, a keyword extraction unit 118, an audio conversion unit 119, a light receiving unit 121, and a remote control 122. The image display unit 110 corresponds to the image display unit 1201 in FIG.

  In FIG. 1, a signal received by the antenna 101 is input to the tuner module 102. The tuner module 102 performs processing such as demodulation and error correction on the input signal, forms a TS, and outputs the TS to the demultiplexer 103.

  The demultiplexer 103 time-divides data broadcast data including video data, audio data, SI data constituting the EPG, and the above-described audio keywords and graphic data (image data) 12021102 input from the tuner module 102. Data extraction control is performed from among the multiplexed TSs.

  The video data extracted by the demultiplexer 103 is output to the video decoder 104, and after decoding processing such as MPEG2, is transmitted to the display composition unit 106.

  The audio data extracted by the demultiplexer 103 is output to the audio decoder 105, and after decoding processing such as MPEG 1 and 2, the audio data is transmitted to the DAC 107.

  SI data and data broadcast data extracted by the demultiplexer 103 are temporarily stored in the recording medium 115 via the control bus 112. The data is read by the CPU 116 as necessary, and the data is decoded to form display data. The voice keyword and graphic data 1202 included in the data broadcast data are extracted by the demultiplexer 103 and then registered in the keyword database unit 117 in association with the voice keyword and graphic data 1202.

  When the graphic data 1202 is not included in the data broadcast data, a keyword registered in advance in the keyword database unit 117 and image data may be associated and registered. At this time, the voice keyword included in the data broadcast data and the pre-registered image data may be associated and registered in the keyword database unit 117.

  The video data decoded by the video decoder 104 is sent to the display control unit 108 via the display synthesis unit 106, and display data and display timing suitable for the image display unit 110 are formed. (Image) display. The display combining unit 106 can combine the EPG display data and data broadcast display data decoded and formed by the CPU 116 with video data.

  The audio data decoded by the audio decoder 105 is output to the DAC 107 and the audio conversion unit 119, subjected to digital-analog conversion in the DAC 107, and output to the audio control unit 109. The audio control unit 109 includes a surround output function, an equalizer function, an output amplifier, and the like, performs output control for each audio channel (for example, left (Right) channel), and an audio output unit 111 corresponding to a speaker. Audio output is performed via

  Hereinafter, a method for extracting a specific keyword from audio data output from the audio decoder 105, which is a point of the present invention, and controlling a function provided in the receiving apparatus at the timing will be described.

  In the acoustic characteristic extraction unit 201, the acoustic data such as frequency is extracted from the audio data input from the audio decoder 105.

  The acoustic database management unit 203 and the language database management unit 204 are loaded with a language database in which words that can be identified by the voice conversion unit 119 are registered and an acoustic database in which acoustic characteristic data of words is registered. These databases are stored in the recording medium 115.

  The voice identification decoder 202 uses the language database management unit 204 in which identifiable words are registered, and estimates and selects a plurality of word candidates that are considered to be correct. Furthermore, the acoustic database management unit 203 in which the acoustic characteristic data of the word is registered is used to estimate the probability evaluation as described above, select the most probable word from the plurality of selected word candidates, and Convert data to text data.

  The text data converted as described above is output to the keyword extraction unit 118.

  The keyword extraction unit 118 removes the so-called “tenihaha” particles from the converted text data, extracts words that become “keywords” for device control, and outputs the extracted words to the keyword database unit 117.

  The keyword database unit 117 compares the word output from the keyword extraction unit 118 with the registered speech keyword data. As a result of the comparison, when the word output from the keyword extraction unit 118 matches the registered voice keyword, the keyword database unit 117 sends a control instruction (control signal) to the CPU 116. In accordance with the control instruction, the CPU 116 reads and decodes the graphic data 1202 of FIG. 2 temporarily stored in the recording medium 115, and combines the graphic data 1202 with the video data in the display combining unit 106 (image processing processor). The image as shown in 2 is displayed.

  As described above, when the voice keyword such as the correct answer of the quiz or the word close to the correct answer of the quiz that is transmitted in advance from the broadcasting station matches the word that becomes the “keyword” included in the answer of the performer or the like, the CPU 116 Is displayed in advance.

  The keyword database 117, the keyword detection unit 118, and the voice conversion unit 119 described above may be mounted on a single integrated circuit as rewritable hardware such as an FPGA as a single integrated circuit. It may be mounted on an integrated circuit. It can also be implemented as a software program executed by the CPU 116.

  As described above, a specific audible sound (voice keyword) is detected from the input voice data, and predetermined device control is executed according to the timing at which the voice keyword is detected. Compared to the conventional event message by digital broadcasting system and device control by control signal multiplexing by the technology of Patent Document 1, the function control of the receiving device can be performed at the timing that the broadcasting station side does not intend in the live broadcast program etc. Flexibility is improved. Further, since the control timing is determined by the audio data, it is possible to eliminate a device for multiplexing the control signal in real time on the transmission side such as a broadcasting station.

(Second Embodiment)
A second embodiment of the present invention will be described. FIG. 4 is a block diagram showing the overall configuration of the digital broadcast receiving apparatus according to the present embodiment and its surrounding environment.

  In FIG. 4, an antenna 101, a tuner module 102, a demultiplexer 103, a video decoder 104, an audio decoder 105, a display synthesis unit 106, a DAC 107, a display control unit 108, an audio control unit 109, an image display unit 110, an audio output unit 111, Control bus 112, Internet 1213, Internet connection control unit 1214, recording medium 115, CPU 116, keyword database unit 1217, keyword extraction unit 118, voice conversion unit 119, external connection device control unit 1220, light receiving unit 121, remote control 122, external connection Device 1223.

  In the present embodiment, an operation for extracting a plurality of audio keywords from audio data in a broadcast program to be broadcast and performing function control of the device will be described. Since basic operations such as reception and display of broadcast programs are the same as those in the first embodiment, they are omitted.

  The keyword extraction unit 118 removes the particle which is so-called “Teniha” from the text data converted by the same operation as in the first embodiment, and becomes a “keyword” for device control described later. Is extracted and output to the keyword database unit 1217.

  FIG. 5 shows an example of a control flow in the keyword database unit 1217 for performing peripheral device control and function control using a combination of “keywords” extracted by the keyword extraction unit 118.

  6 is stored in the recording medium 115 of FIG. 4 and used in the control of FIG. 5, and the ones shown in FIGS. 7 to 10 are stored in the recording medium 115 of FIG. These are “second keyword table 1” to “second keyword table 4” which are stored and used in the control of FIG.

  In S301 of FIG. 5, the keyword database unit 1217 of FIG. 4 waits for input of keyword data extracted from the keyword extraction unit 118. If keyword data has been input, a check is made in S302 as to whether or not the "second keyword waiting" state is set. The transition to the “wait for second keyword” state will be described later in the operation explanation section in S306. In S302, if the “second keyword waiting” state is not established, the process proceeds to S303, and if the “second keyword waiting” state is established, the process proceeds to S307.

  In S303, a comparison is made as to whether or not the “keyword” input from the keyword extraction unit 118 in FIG. 4 is registered in the “first keyword table” shown in FIG.

  If the “keyword” input from the keyword extraction unit 118 in FIG. 4 is not registered in the “first keyword table” shown in FIG. 6 in S304, the process proceeds to S311. On the other hand, if the “keyword” input from the keyword extraction unit 118 in FIG. 4 is registered in the “first keyword table” shown in FIG. 6, the process proceeds to S305.

  As a specific example in S304, if the “keyword” input from the keyword extraction unit 118 in FIG. 4 is the keyword “provided”, the “first keyword table” shown in FIG. Since the keyword “provide” is registered in index 0, the process proceeds to S305.

  In S305, when the first keyword is registered, one of the “second keyword tables” shown in FIG. 7 to FIG. 10 is compared for the second keyword comparison described in the processing after S307. 4 from the recording medium 115.

  The “second keyword table” read in S305 is determined based on the processing result in S304. For example, if the keyword input from the keyword extraction unit 118 in FIG. 4 is the keyword “provide”, as described in “reference destination” of the first keyword table shown in FIG. “Keyword table 1” is read. If the keyword input from the keyword extraction unit 118 in FIG. 4 is the keyword “program”, the “second keyword table 4” is written as “reference destination” in the first keyword table. Is read.

  In S306, the counter for counting the input time interval between the first keyword and the second keyword in S301 is started, and a flag indicating that the state is “waiting for second keyword” is set. Return and wait for the next keyword input. As the maximum count time in the counter, the “maximum count value” described in the “first keyword table” shown in FIG. 6 is used.

  In S307, as described above, since it is determined in S302 that the state is the “second keyword waiting” state, the “keyword” input from the keyword extraction unit 118 in FIG. It is compared whether or not it is registered in any of the “second keyword tables” shown. The “second keyword table” used here is the one already read in S305.

In S308, if the “keyword” input from the keyword extraction unit 118 in FIG. 4 is registered in the “second keyword table” read as described above as a result of the comparison processing in S307, the process proceeds to S309. On the other hand, if it is not registered, the process proceeds to S312, and it is checked whether or not the input time interval between the first keyword and the second keyword started in S306 described above exceeds a predetermined count value. . If the count value exceeds the predetermined count value, the process proceeds to S311 and the counter value started counting in S306 and the flag indicating the “second keyword waiting” state are dropped to enter the “first keyword waiting” state. In step S301, input of a new keyword is awaited. If the predetermined count value has not been exceeded, the input of a new keyword is awaited in S301 in the “second keyword waiting” state.

  In S309, the device control method is determined in accordance with the “control method” described in each of the second keyword tables 1 to 4 in accordance with the “second keyword” match result in S308.

  For example, the “first keyword” input from the keyword extraction unit 118 in FIG. 4 is the keyword “provide” and the second keyword is “ABC” (in this case, for example, a company name). In this case, Internet connection control is performed, and connection to the Internet 1213 is performed via the Internet connection control unit 1214 of FIG.

  If the “first keyword” input from the keyword extraction unit 118 in FIG. 4 is the keyword “destination” and the second keyword is “zip code”, the printer is controlled. Accordingly, the video frame data is extracted from the display control unit 108 in FIG. 4, and the printer connected to the external device control unit 1220 (corresponding to the external connection device 1223) is controlled. Print.

  Also, the “first keyword” input from the keyword extraction unit 118 in FIG. 4 is the keyword “program” and the second keyword is “drama 3” (in this case, for example, an example of the name of the broadcast program) ), The recording device (for example, D-VHS device or the like) is controlled, and a desired program data stream is taken out from the demultiplexer 103 in FIG. The connected recording device (corresponding to the external connection device 1223) is controlled, and the extracted stream data is recorded. Here, the recording device (corresponding to the external connection device 1223) connected via the external device control unit 1220 is controlled. However, the recording medium 115 shown in FIG. It may be recorded.

  As described above, the external device control unit 1220 connects a plurality of types of external connection devices 1223 to a plurality of ports (interfaces). Then, the CPU 116 controls the interface of the peripheral device according to a plurality of keywords (specific audio signals), and selectively executes predetermined control of the selected peripheral device. When the connection between the external device control unit 1220 and the plurality of external connection devices 1223 is connected by wire, an output terminal is provided as an output unit for device control signals, and a wireless signal output control circuit is provided when connected wirelessly. It ’s fine.

  After the device control and function control as described above in S310, the process proceeds to S311. The count started in S306 is stopped, the counter value is cleared, and the flag indicating that the “second keyword waiting” state is set. Then, the process returns to S301 as the “first keyword waiting” state.

The keywords registered in the keyword table described above can be registered and updated in the keyword table by the CPU 116 extracting the keywords from the SI data given to the program being viewed. In this case, as described above, the CPU 116 reads SI data related to the program being viewed and temporarily stored in the recording medium 115, and the program name information, program content description information, and performer information fields described in the SI data. As in the function in the keyword extraction unit 118 described above, the particles are removed, and a word that becomes a “keyword” for device control and function control described later is extracted and output to the keyword database unit 1217. Thereafter, the keyword database unit 1217 registers and updates the keyword input from the CPU 116 in the “second keyword table” as shown in FIGS. 7 to 10 and saves it in the recording medium 115. Furthermore, it is good also as a structure registered and updated to a keyword table | surface by the user's operation of the receiver using the remote control 122.

  As described above, a specific voice keyword is detected from input voice data, and predetermined control determined by the voice keyword is executed according to the detection of the specific voice keyword. Not only control that seems to be beneficial to many users receiving events such as event messages, but also various controls that allow individual controls to be executed according to the user's own preferences. it can.

  Further, since the input is only audio data, a control signal is not generated separately from other signals on the transmission side such as a broadcasting station, and an apparatus for generating or transmitting a control signal on the transmission side is not necessary.

(Third embodiment)
A third embodiment of the present invention will be described. FIG. 4 is a block diagram showing the overall configuration of the digital television broadcast receiving apparatus according to the present embodiment and its surrounding environment, as in the second embodiment described above.

  In the present embodiment, keyword data stored in the recording medium 115 and registered in a keyword table used in the keyword database unit 1217, and a language database in which identifiable words used in the voice conversion unit 119 are registered. The acoustic database data in which the acoustic characteristic data of the word is registered is registered and updated by downloading from a server (not shown) existing on the Internet via the Internet connection control unit 1214.

  Further, the keyword data, the language database, and the acoustic database can be changed according to the genre information to which the program being viewed obtained from the SI data decoded by the CPU 116 in FIG. 4 belongs and the channel number designated by the user via the remote controller 122. To be configured.

  According to the above, it is possible to more flexibly change the combination of keywords that trigger peripheral devices and receiver functions and the difference in acoustic characteristics of different audio data for each program. It becomes possible to improve.

(Fourth embodiment)
A fourth embodiment of the present invention will be described. FIG. 4 is a block diagram showing the overall configuration of the digital television broadcast receiving apparatus according to the present embodiment and its surrounding environment, as in the second embodiment described above.

  In the receiving apparatus of FIG. 4, even when a data stream including audio data is received from a device capable of recording / reproducing a program data stream such as a D-VHS device (for example, equivalent to the externally connected device 1223) and reproduced. As in the second embodiment, it is possible to control peripheral devices connected to the receiving device and control functions of the receiving device by combining keywords extracted from audio data.

  Further, at this time, if a configuration in which some control functions are made inoperable, when the program data recorded on the D-VHS device or the like is reproduced and viewed later, “record on the D-VHS device” or the like is used. It is possible to prevent malfunctions in device control when a combination of keywords is included.

  In the above embodiment, the audio signal data input means for extracting the keyword is a TV broadcast wave via the tuner module 102 or a recordable / reproducible device such as a D-VHS device. The input means is connected to the receiving device of FIG. 12, and keywords are extracted from the user's voice input via the microphone, and peripheral devices connected to the receiving device are controlled, and functions of the receiving device are controlled. It is also possible to adopt a configuration to do so.

  In the above embodiment, the configuration is such that the peripheral device connected to the receiving apparatus is controlled and the functions of the receiving apparatus are controlled by the combination of keywords extracted by the keyword extracting unit 118 of FIG. By changing the control flow, changing or adding the keyword tables in FIGS. 6 to 10, the same control as in the above embodiment may be performed using only one keyword or a combination of three or more keywords. Is possible.

  In addition, the program described in the description of the above embodiment includes a commercial message (so-called CM), and uses voice keywords as company names and product names, and detects voice keywords to obtain product information from the Internet. It may be taken out and stored in the recording medium 115 of FIGS. 1 and 4 or printed by a printer. At this time, the search is executed via the Internet using the detected voice keyword as a search keyword.

  Furthermore, in the above embodiment, the present invention has been described as the receiving device shown in FIGS. 1 and 4. However, the present invention is not limited to the receiving device as long as it is a device that performs audio processing. The invention of the method performed according to the procedure shown, the invention of a program for causing a device such as a receiving apparatus to execute the method, and the invention of a recording medium recording the program are also established.

  According to the present invention, it is possible to realize a signal processing apparatus, a signal processing method, a signal processing program, a program reproduction apparatus, and a program reproduction apparatus that can deal with a novel program that has not been conventionally available.

  Although the configurations of the plurality of embodiments have been described above, various configurations other than the above configurations can be employed. In the above configuration, a configuration for detecting a voice keyword is employed, but a configuration for detecting a specific image can also be employed. In addition, a configuration in which the detection target is specified on the receiver side instead of the configuration on the sender side (broadcasting body such as a broadcasting station or program producer) can be adopted. In the following, some examples of embodiments will be described.

(Fifth embodiment)
FIG. 13 shows a configuration of a television apparatus according to the embodiment described below.

  The television apparatus includes a tuner 131, an A / D converter 132, a buffer memory 133, a comparator 134, a feature pattern input unit 135, a feature pattern storage unit 136, an action designation unit 137, a message data creation unit 138, a controller 139, and an output. A control unit 1310 and a display 1311 are provided.

  The tuner 131 receives television signals such as wireless broadcasting, cable broadcasting, and video broadcasting via the Internet. The tuner 131 generates an analog video signal (image signal) and an analog audio signal (audio signal) from the television signal.

  The A / D converter 132 converts the image signal and audio signal input from the tuner 131 into digital signals. The buffer memory 133 is a storage unit that temporarily stores the image signal and the audio signal after digital conversion. This buffer memory 133 is accessed by FIFO (first in first out).

  The feature pattern input unit 135 is a function that allows a user to input a feature pattern (hereinafter simply referred to as a “pattern”) composed of an image, sound, or a combination thereof. For example, a plurality of patterns prepared in advance may be displayed on the display 1311 and the user may select from them. Alternatively, the user may freely input a pattern. The pattern input here is registered in the feature pattern storage unit 136. That is, in the present embodiment, the feature pattern input unit 5 and the feature pattern storage unit 136 correspond to the pattern registration unit of the present invention.

  The pattern is input using the controller 139. The controller 139 is input means for receiving input from the user. A numeric keypad type as shown in FIG. 13 or a keyboard or pointing device may be used. Further, it may be used also as a remote control of the television apparatus, or when the display 11 is a touch panel, a GUI displayed on the screen may be used.

  The action specifying unit 137 is a function (action specifying unit) that allows the user to specify an action to be executed in association with the pattern registered in the feature pattern input unit 135. An action is a process executed by the apparatus or the display 1311. For example, from a simple action such as hiding the screen, turning off the sound, or pausing the screen, the action is changed to the original image signal and sound signal. Instead, a predetermined image or sound is output, or an output from the image signal and the sound signal is paused, and an input from the user is received by the controller 139. The message data creation unit 8 is a function for creating a message (image) to be displayed on the display 1311 when this action is executed.

  The comparator 134 is a function (determination unit) that determines whether the image signal or the audio signal temporarily stored in the buffer memory 133 includes a pattern registered in the feature pattern storage unit 136. This determination process may use techniques such as image recognition, voice recognition, and pattern matching. Since these technologies can use existing technologies, a detailed description is omitted here. The determination result (comparison result) in the comparator 134 is passed to the output control unit 1310.

  The output control unit 1310 is a function (control unit) that controls the image and sound to be output to the display 1311 according to the determination result received from the comparator 134. Specifically, the output control unit 1310 causes the display 1311 to output the image signal and the audio signal when the determination result is “false” (that is, when the image signal or the audio signal does not include a pattern). Conversely, when the determination result is “true” (that is, when a pattern is included), the display 1311 is caused to execute an action associated with the pattern.

  According to the above configuration, if a pattern that can be included in undesirable content is registered in advance on the user side, the television apparatus automatically determines content corresponding to the pattern and appropriately restricts output of the content. . Therefore, the content supplier does not need to add attribute information such as rating data to the content.

Note that the television device may be configured to incorporate the tuner 131, or may be configured by a combination of an external device having a tuner function such as an STB (set top box) or VTR and an image display device.

(Specific configuration example 1 in this embodiment)
In the configuration example 1, a so-called television shopping program (a program that introduces products and carries out mail order) is given as an example of content, and a specific operation of the television device will be described.
FIG. 14 is a flowchart showing the flow of processing in Configuration Example 1. In the figure, the underlined portion is the user's operation, and the others are the operation of this apparatus.

  First, the apparatus is turned on to start watching a TV program (step S201).

  When the TV shopping program starts, the user inputs a pattern through the feature pattern input unit 5 (step S202). Specifically, the user presses the “*” button of the controller 139 to activate the feature pattern input function. Then, the feature pattern input unit 135 displays a list of patterns prepared in advance on the display 1311. The user operates a numeric button of the controller 139 to select a desired pattern from the pattern list. Here, it is assumed that two patterns of “circle” and “¥” are selected. “Yen” and “¥” are patterns for determining whether or not an image signal includes an image of a product sales price. The selected pattern is registered in the feature pattern storage unit 136.

  When the pattern selection is completed, the process proceeds to action designation processing. The action specifying unit 137 displays a list of actions prepared in advance on the display 1311. This action list is displayed according to the pattern selected in step S202. The user operates a numeric button of the controller 139 to select a desired action from the action list. Here, when “Yen” or “¥” appears, the display is hidden, and the user is prompted to input the desired price. The value is displayed superimposed on the screen showing the product price. ”Is selected.

  When the pattern and action are designated in this way, the apparatus performs A / D conversion on the image signal input from the tuner 131 and stores the image data of each frame in the buffer memory 133 (step S203). The same applies to the audio signal.

  Then, the comparator 134 reads out the image from the buffer memory 133 by the FIFO method (step S204), and determines whether the image includes the pattern “circle” or “¥” by the image recognition process (step S204). S205).

  If the pattern is not included (step S206; NO), the image is displayed as it is on the display 1311 (step S207). At the same time, audio is output.

  If a pattern is included (step S206; YES), that is, if a product sales price is included in the image, display and audio output are temporarily stopped. However, the A / D converted image and sound storage processing is continued.

  Then, the message data creation unit 138 generates an image “Please input the desired price”, and the output control unit 1310 displays the generated image on the display 1311 (step S208). The user can input a desired price by operating the number buttons of the controller 139 (step S209).

When the input of the desired price is completed, the output control unit 1310 converts the desired price into an image, and synthesizes the image of the desired price with the image including the pattern (including the product sales price). At this time, the composition process is performed so that the product sales price and the desired price do not overlap. Output control unit 1
310 displays the composite image on the display 1311 (step 210). The user can compare the actual product sales price with his / her desired price by looking at the composite image. After this display is performed for several seconds, the comparator 134 and the output control unit 1310 read the continuation from the buffer memory 133 and continue the determination process.

In this configuration example, there is an advantage that it is possible not only to passively watch so-called TV shopping but also to take time to judge the value of the product by himself and to make a purchase judgment calmly.
(Configuration example 2)
15A and 15B are flowcharts showing the flow of processing in the configuration example 2.

  First, the user operates the controller 139 to register a pattern and an action (step S301). Here, it is assumed that an image pattern of “circle” and “¥” and a sound pattern of “applause” are registered. Also, as an action related to the image pattern, “If“ Yen ”or“ ¥ ”appears, the display is hidden and the user is prompted to enter the desired price. The content “display the comparison result on the screen” is designated. As the action related to the voice pattern, the content “turn off the voice while applause is occurring” is designated.

  When the registration of the pattern and action is completed, the apparatus sets the operation mode to “normal mode” and starts displaying the input program (step S302).

  In the “normal mode”, the input image signal and audio signal are A / D converted, stored in the buffer memory 133, sequentially read out by the FIFO method, and output to the display 1311 in almost real time. At this time, the comparator 134 performs pattern recognition processing on the image every 10 frames, and automatically determines whether or not the image signal belongs to a television shopping program (steps S303 and S304). For example, when a character such as “teleshop” or “television shopping” is included in an image and the area of the character is 20% or more of the image size, the image signal is a television shopping program. judge.

  When the start of the TV shopping program is detected, the apparatus sets the operation mode to “delay mode” (step S305). Thereafter, the image signal and sound signal for 5 seconds are buffered, and the image and sound delayed by 5 seconds are output.

  Then, the comparator 4 performs pattern recognition processing on the image every 10 frames, and determines whether or not the image pattern “circle” or “¥” is included in the image (steps S306 and S307). For example, if an image includes a number + “circle” or “¥” + number, and the area of the character is 10% or more of the image size, it may be determined that the pattern is included. . At the same time, the comparator 4 checks whether or not “applause” is included in the speech signal by speech recognition processing. When applause is detected, the audio output is temporarily stopped (S308).

  If a pattern is included (step S306; YES), display and audio output are temporarily stopped. However, image and audio buffering is continuously performed (step S309).

Then, the product sales price is extracted from the image including the pattern by the character recognition process, and the price is stored in the memory (step S310). Subsequently, as in Configuration Example 1, the image “Please enter the desired price” generated by the message data creation unit 138 is displayed (step S311), and the input of the desired price is received from the user (step S312).

  When the desired price is input, the output control unit 1310 compares the desired price with the product sales price extracted from the image, and checks whether there is a difference of 50% or more between the two prices (step S313). ). If the difference is 50% or more, the message data creation unit 8 generates a message to that effect and displays it on the display 1311 (step S314). Thereafter, the buffering is released (step S315), and the process returns to step S306.

  According to the processing of this configuration example, (1) the apparatus automatically detects the start of a television shopping program, and (2) whether or not a pattern is included is determined for each of a plurality of frames, not for each frame. (3) Patterns and actions are input in advance. (4) Audio information as well as images can be registered as patterns.

  The above configuration example is merely an example of the present invention. The scope of the present invention is not limited to the above embodiment, and various modifications can be made within the scope of the technical idea.

  For example, in the above configuration example, a television shopping program is illustrated, but the present invention is preferably applicable to other contents. When restricting display of content including violent scenes and destruction scenes, violent sounds and destruction sounds may be registered as patterns, and when restricting display of content that induces photosensitivity epilepsy, as patterns What is necessary is just to register the image which repeats high-intensity blinking.

  Also, you can register voices such as “Correct answer” and “Answer” as a pattern, and pause the screen immediately before the answer is announced in the quiz program, and perform actions such as allowing the user to input the answer It is also possible to do. That is, the present invention also has an advantage of making non-interactive content pseudo-interactive.

  As described in detail above, according to each embodiment of the present invention, in short, it is determined whether or not a pre-registered pattern is included in the input image signal and / or audio signal, and the pattern is included. By causing the output means for outputting an image and / or sound to execute an action designated in advance, it is not necessary to add attribute information to the content, and output of undesirable content can be appropriately restricted. Further, the method of the present invention may be distributed in the form of a computer program that is installed and executed in an image display device or the like.

The block diagram which shows the whole structure of the digital television broadcast receiver which concerns on embodiment of invention, and its surrounding environment. The figure which shows an example of the screen displayed when the receiving apparatus detects the specific audible sound which concerns on embodiment of invention. The block diagram which shows the structure of an audio | voice conversion part. The block diagram which shows the whole structure of the digital television broadcast receiver which concerns on embodiment of invention, and its surrounding environment. An example of the control flow in a keyword database part. The first keyword table used in the keyword database section. Second keyword table 1 used in the keyword database section. Second keyword table 2 used in the keyword database section. Second keyword table 3 used in the keyword database section. Second keyword table 4 used in the keyword database section. The block diagram which shows the structure of the digital broadcast transmission system which concerns on a prior art example. Explanatory drawing in the case of taking out image | video, audio | voice data, data broadcast data, etc. in the digital broadcast receiver concerning a prior art example. 1 is a diagram showing a configuration of a television device according to an embodiment of the present invention. The flowchart which shows the flow of the process in one Embodiment. The flowchart which shows the flow of the process in one Embodiment. The flowchart which shows the flow of the process in one Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Antenna 102 Tuner module 103 Demultiplexer 104 Video decoder 105 Audio decoder 106 Display composition part 107 Display control part 108 Audio control part 109 Image display part 110 Audio output part 111 Control bus 115 Recording medium 117, 1217 Keyword database part 118 Keyword extraction part 119 Audio conversion unit 121 Light receiving unit 122 Remote control 201 Acoustic characteristic extraction unit 202 Audio identification decoder 203 Acoustic database management unit 204 Language database management unit 1213 Internet 1214 Internet connection control unit 1220 External connection device control unit 1223 External connection device 131 Tuner (signal circuit) )
132 A / D converter 133 Buffer memory (storage means)
134 Comparator (determination means)
135 Feature pattern input unit (pattern registration means)
136 Feature pattern storage unit (pattern registration means)
137 Action designation part (action designation means)
138 Message data creation unit 139 Controller (input means)
1310 Output control unit (control means)
1311 Display (output means)

Claims (13)

An audio signal detection circuit for detecting a specific audio signal from a broadcast program including a video signal and an audio signal;
A control unit for controlling the image processor,
When the audio signal detection circuit detects the specific audio signal, the audio signal detection circuit generates a control signal for controlling the control unit,
The control unit is configured to display a specific image and / or text by combining a specific image and / or text corresponding to the specific audio signal and an image of a broadcast program displayed according to the video signal. A signal processing device for controlling the image processor according to a signal. An audio signal detection circuit for detecting a plurality of audio signals;
A control unit for controlling the interface of the peripheral device,
When the audio signal detection circuit detects the plurality of specific audio signals within a predetermined time, the audio signal detection circuit generates a control signal for controlling the control unit;
The control unit is a signal processing device that selectively executes predetermined control of a peripheral device in accordance with the plurality of specific audio signals.   The signal processing apparatus according to claim 1, wherein the specific audio signal is an audio signal representing a specific keyword. A program playback device,
A signal processing device according to claim 1;
A speaker for reproducing and outputting the audio signal;
A program playback apparatus having An audio signal detection step of detecting a specific audio signal from a broadcast program including a video signal and an audio signal;
A control step for controlling the image processor,
In the audio signal detection step, when detecting the specific audio signal, the audio signal detection circuit generates a control signal for controlling the control unit,
In the controlling step, the specific image and / or text corresponding to the specific audio signal and the image of the broadcast program displayed according to the video signal are combined to display the specific image and / or text. A signal processing method for controlling the image processor according to a control signal. An audio signal detection step for detecting a plurality of audio signals;
A control step for controlling the interface of the peripheral device,
In the sound signal detection step, when the plurality of specific sound signals are detected within a predetermined time, the sound signal detection circuit generates a control signal for controlling the control unit,
In the control step, a signal processing method for selectively executing predetermined control of a peripheral device according to the plurality of specific audio signals. On the computer,
An audio signal detection step of detecting a specific audio signal from a broadcast program including a video signal and an audio signal;
A signal processing program for executing a control step for controlling the image processor;
In the audio signal detection step, when detecting the specific audio signal, the audio signal detection circuit generates a control signal for controlling the control unit,
In the controlling step, the specific image and / or text corresponding to the specific audio signal and the image of the broadcast program displayed according to the video signal are combined to display the specific image and / or text. A signal processing program for controlling the image processor in accordance with a control signal. On the computer,
An audio signal detection step for detecting a plurality of audio signals;
A signal processing program for executing a control step for controlling an interface of a peripheral device,
In the sound signal detection step, when the plurality of specific sound signals are detected within a predetermined time, the sound signal detection circuit generates a control signal for controlling the control unit,
In the control step, a signal processing program that selectively executes predetermined control of the peripheral device according to the plurality of specific audio signals. Output means for outputting images and sounds;
Pattern registration means for allowing a user to register a pattern consisting of an image or sound or a combination thereof;
An action specifying means for allowing the user to specify an action to be executed in relation to the registered pattern;
Determination means for determining whether or not the pattern is included in the input image signal or audio signal;
Control means for outputting the stored image signal and audio signal to the output means when the pattern is not included, and causing the output means to execute the designated action when the pattern is included;
An image display device comprising:   The image display device according to claim 9, wherein the action is to output a predetermined image or sound in place of the stored image signal and sound signal. It further has an input means for receiving input from the user,
The image display device according to claim 9, wherein the action is to temporarily stop output of the image signal and the audio signal and then receive an input from a user by the input unit. The pattern is for determining whether an image of a product sales price is included in the image signal,
12. The image display device according to claim 11, wherein the action is to display the inputted desired price along with the product sales price of the image signal after receiving an input of a desired price from the user by the input means. It is determined whether or not a pre-registered pattern is included in the input image signal and / or audio signal, and if the pattern is included, a predesignated action is output to the output means for outputting the image and / or audio. The image display method to be executed.

Images