JP2010219923A - Reception controller, method of displaying video, and video display/processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a reception controller that allows continuous viewing of the video of a program that has been viewed on a display, on a display means of the reception controller while answering a phone call without connecting the reception controller and the display separate from the reception controller for communication. <P>SOLUTION: A display is a separate device from a display means and receives broadcast signals of a plurality of programs and displays the picture of at least one of those programs. The sound output from a speaker of the display is obtined as a speaker sound signal. When at least the termination of a call from a telephone device via a telephone line and/or the reception of a visitor notification signal indicating the presence of a visitor from a reception device for dealing with visitors is detected, a program wherein the sound identical to that output from the speaker is broadcast is identified on the basis of the speaker sound signal and sound signals contained in the broadcast signals. Then, the picture of the identified program is displayed on the display means on the basis of a video signal of the program contained in the broadcast signals. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a technical field of a reception control apparatus, a video display method, and a video display processing program capable of displaying a broadcast program video.

  2. Description of the Related Art Conventionally, a telephone that receives a television broadcast and displays an image of a television program on a built-in display is known. In such a telephone set, the program video display is switched to the telephone by an incoming call or the like while watching a TV program. Therefore, a device is required so as not to miss a portion broadcast during a call.

  For example, Patent Document 1 discloses a technique for recording a program that was being viewed during a call, and fast-forwarding the recorded program after the call ends. Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for combining and displaying information on a call partner on a television broadcast screen during a call. Further, in Patent Document 3, when a call is received while watching a television broadcast, a broadcast image is displayed, and depending on the setting, a sound obtained by mixing a call sound and a broadcast sound is output, or a call is made. A technique is disclosed in which the sound is muted and only the broadcast sound is output, or the broadcast sound is muted and only the call sound is output.

JP 2006-25206 A Japanese Patent Laid-Open No. 7-30872 JP 2006-197183 A

  However, even if it is possible to view a program with a single phone, it is common for a house to have a dedicated TV receiver in addition to the telephone. Is to watch. However, in the above-described technique, such an aspect has not been considered. In addition, in order to continuously view a program being viewed on a dedicated television receiver on the telephone display while making a telephone call by an incoming call from an outside line, it is necessary to acquire information on the program being viewed. Therefore, it is necessary to connect the telephone and the television receiver with a cable and communicate with each other.

  Therefore, the present invention has been made in view of the above points, and the user can watch on the display device without connecting the response control device and a display device separate from the response control device for communication. It is an object of the present invention to provide a reception control device, a video display method, and a video display processing program capable of continuously watching a video of a program displayed on a display unit of the reception control device during a telephone correspondence.

  In order to solve the above-mentioned problem, the invention described in claim 1 is a reception control device for controlling communication with at least one of a telephone device or a response device for responding to a visitor, comprising: display means; The receiving means for receiving broadcast signals of a plurality of programs broadcast as video and sound, and the display means are separate display devices, and the display device displays the video of at least one program among the plurality of programs. Acquisition means for acquiring the sound output from the speaker as a speaker sound signal, receiving an incoming call via the telephone line from the telephone device, and receiving a visit notification signal for notifying the visitor of the visitor from the reception device Detecting means for detecting at least one of the sound and the sound output from the speaker when the detection means detects reception of the incoming call or the visit notification signal. Identifying means for identifying the program on which the sound is broadcast based on the speaker sound signal and the sound signal included in the broadcast signal, and the video of the identified program included in the broadcast signal Display control means for displaying on the display means based on a video signal of a program.

  According to a second aspect of the present invention, in the response control apparatus according to the first aspect, the other party priority storage means for storing the identification information and priority of the other party to be associated with each other, and the telephone line. By comparing the identification information of the caller transmitted in this way or the identification information of the visitor transmitted from the reception device with the identification information stored in the other party priority storage means, the caller Or whether to display the video of the specified program based on the partner specifying means for specifying the visitor and the priority corresponding to the specified caller or visitor, or Determining means for determining at least one of display modes, wherein the display control means controls display of the video of the specified program based on the determination by the determining means. To.

  According to a third aspect of the present invention, in the reception control device according to the second aspect, the determining means simultaneously receives the video of the specified program and the partner information about the specified caller or visitor. In addition to determining to display, the lower the priority corresponding to the specified partner, the larger the display area of the specified program video by the display means.

  According to a fourth aspect of the present invention, in the response control apparatus according to the second or third aspect, the determination unit is configured to perform the determination when the priority corresponding to the specified opponent is lower than a predetermined priority. Is configured to display video of the specified program and to display subtitles based on the subtitle information of the program included in the broadcast signal.

  According to a fifth aspect of the present invention, in the response control device according to the first aspect, the program priority storage means for storing the identification information of the program or the type of the program and the priority in association with each other; A decision to determine whether or not to display a video of the program or a display mode of the video based on the priority corresponding to the identification information of the specified program or the type of the program And the display control means controls display of the video of the specified program based on the determination by the determination means.

  According to a sixth aspect of the present invention, in the response control apparatus according to the fifth aspect, the determination means displays the video of the specified program and the partner information about the caller or the visitor at the same time. And determining that the display area of the video of the specified program by the display unit is larger as the priority corresponding to the identification information of the specified program or the type of the program is higher. Features.

  According to a seventh aspect of the present invention, in the response control apparatus according to the fifth or sixth aspect, the determination means has a predetermined priority corresponding to the identification information of the identified program or the type of the program. If the priority is higher than the priority, the video of the specified program is displayed, and the subtitle is determined to be displayed based on the subtitle information of the program included in the broadcast signal.

  According to an eighth aspect of the present invention, in the reception control device according to the first aspect, the partner priority storage means for storing the identification information of the partner to talk with and the first priority in association with each other, and the program Alternatively, the program priority storage means for storing the identification information of the type of the program and the second priority in association with each other, and the identification information of the caller transmitted via the telephone line or the reception device The identification information of the visitor that has been transmitted and the identification information stored in the opponent priority storage means are collated to identify the sender or the visitor specifying means, and the specified identification information. Comparing means for comparing the first priority corresponding to the sender or visitor and the second priority corresponding to the identified information of the specified program or the type of the program; Results of comparison by means When the first priority is higher than the second priority, at least the partner information among the partner information about the specified caller or visitor and the video of the specified program is displayed. And when the first priority is lower than the second priority, a determination means for determining to display at least the video of the program among the partner information and the video of the program; The display control means controls to display either the partner information or the video of the program based on the determination by the determination means.

  According to a ninth aspect of the present invention, in the response control apparatus according to the eighth aspect, the determination means, when the first priority and the second priority are equal, The other party information is displayed in the video of the program, and it is determined to display the subtitle based on the subtitle information of the program included in the broadcast signal.

  According to a tenth aspect of the present invention, in the response control apparatus according to the eighth aspect, the determining means includes the first priority that is lower than the second priority, and the first priority. And the second priority are equal to or greater than a predetermined value, the video of the program is displayed among the partner information and the video of the program, and the caption information of the program included in the broadcast signal Based on the above, it is determined to display subtitles.

  The invention according to claim 11 is the response control apparatus according to any one of claims 2 to 4 and claims 8 to 10, wherein the reception with the caller or visitor specified by the partner specifying means is performed. Call history information storage means for storing call history information indicating a call history using the control device, and opponent priority for setting the priority stored in the opponent priority storage means based on the stored call history information And a degree setting means.

  According to a twelfth aspect of the present invention, in the response control device according to any one of the fifth to tenth aspects, the specifying unit may be configured in a case other than when the incoming call or the reception notification signal is detected. A viewing history that identifies the program on which the same sound as the sound output from the speaker is broadcast, and stores a specific history of the program by the identifying means as viewing history information indicating a viewing history of the program by the user It further comprises information storage means and program priority setting means for setting the priority stored in the program priority storage means based on the stored viewing history information.

  According to a thirteenth aspect of the present invention, in the response control apparatus according to any one of the first to twelfth aspects, the specifying unit is received by the speaker sound signal acquired by the acquiring unit and the receiving unit. The frequency characteristics of the sound are extracted from the sound signal included in the broadcast signal, the information obtained by extracting the frequency characteristics of the sound from the speaker sound signal, and the sound from the sound signal included in the broadcast signal. The identification is performed by collating information obtained by extracting frequency characteristics.

  A fourteenth aspect of the present invention is the response control device according to any one of the first to thirteenth aspects, wherein the acquisition means is a microphone that converts a sound outside the response control device into an external sound signal. The specifying means specifies whether the sound of any of the programs is included in the external sound, based on the external sound signal and a sound signal included in the broadcast signal. .

  The invention according to claim 15 is a video display method in a reception control device comprising a display means, wherein the receiving step for receiving broadcast signals of a plurality of programs broadcast as video and sound is separate from the display means. An acquisition step of acquiring a sound output from a speaker of a display device that displays video of at least one of the plurality of programs as a speaker sound signal; and a telephone line from another telephone device. A detection step of detecting at least one of an incoming call via the user and a reception notification signal for notifying the visitor of the visitor from the reception device for responding to the visitor, and the incoming call in the detection step Alternatively, when the reception of the visit notification signal is detected, the program on which the same sound as the sound output from the speaker is broadcast is transmitted to the speaker sound signal and the broadcast transmission. A specifying step for specifying based on the sound signal included in the display, and a display control step for causing the display means to display the video of the specified program based on the video signal of the program included in the broadcast signal. It is characterized by having.

  According to a sixteenth aspect of the present invention, a computer is caused to function as the response control device according to any one of the first to fifteenth aspects.

  According to the invention described in claim 1, 15 or 16, the sound of the program output from the speaker of the display device while the display device displays the video of the program is acquired as the speaker sound signal, and the acquired speaker sound signal And a sound signal included in the received broadcast signal, a program in which the same sound as the sound output from the speaker is broadcast is specified, and an image of the specified program is displayed on the display means. Therefore, the program on which the display device is displaying the video can be specified without connecting the reception control device and the display device with a communication cable or the like. In addition, when the user is watching a program on the display device, the video of the program can be continuously viewed on the display means of the response control device when answering the telephone.

  According to the second aspect of the present invention, it is possible to perform display according to the display priority of the video of the program based on the priority of response to the caller or visitor.

  According to the invention described in claim 3, since the video of the program is displayed larger as the priority of the response to the caller or the visitor becomes lower, when responding to the caller or the visitor having a lower priority, This makes it easier for the user to view the program.

  According to the invention of claim 4, since the subtitles of the program are displayed by lowering the priority of the telephone response to the caller or the visitor, when responding to the caller or the visitor having a low priority This makes it easier for the user to understand the contents of the program.

  According to the fifth aspect of the present invention, it is possible to perform display according to the priority of display of the video of the program.

  According to the sixth aspect of the present invention, the display area of the video of the program is increased in accordance with the priority with respect to the program or the type of program, so that the user can easily understand the program.

  According to the seventh aspect of the present invention, it is possible to display the subtitles of the program in response to the necessity for the user to understand the content of the program more due to the higher priority for viewing the video of the program. it can.

  According to the invention described in claim 8, priority is given to the higher priority by comparing the priority of displaying information about the caller or visitor with the priority of displaying the video of the program. Can be displayed.

  According to the ninth aspect of the present invention, when the priorities are equal, by displaying both the partner information and the caption of the program, the information about the sender or the visitor and the information about the program are of the same level. Can be displayed.

  According to the invention described in claim 10, the priority of displaying the video of the program is somewhat higher than the priority of displaying the information about the caller or the visitor, and the contents of the program are displayed to the user. The subtitles of the program can be displayed in response to the necessity of more understanding of the program.

  According to the eleventh aspect of the present invention, it is possible to save time and effort for setting the priority by the user, and it is possible to appropriately set the priority based on the call history.

  According to the twelfth aspect of the present invention, it is possible to save time and effort for setting the priority by the user, and it is possible to appropriately set the priority based on the viewing history of the program on the display device by the user.

  According to the thirteenth aspect of the present invention, it is possible to identify a program that broadcasts the same sound as the sound output from the speaker of the display device, based on the frequency characteristics of the sound.

  According to the invention described in claim 14, the sound output from the speaker can be acquired by the microphone.

It is a figure showing the example of outline composition of the reception system concerning one embodiment. (A) is a figure which shows an example of the content of the information registered into a program table, (b) is a figure which shows an example of the content of the information registered into a personal information table, (c), It is a figure which shows an example of the content of the information registered into a priority table. In one embodiment, it is a figure showing an example of a screen display in each screen display pattern. It is a flowchart which shows an example of the process performed by the control part 22 in the main | base station 2 which concerns on one Embodiment. It is a flowchart which shows an example of the process performed by the control part 22 in the main | base station 2 which concerns on one Embodiment.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, the best embodiment of the invention will be described with reference to the drawings. The embodiment described below is an embodiment when the present invention is applied to a reception system having a telephone function, an intercom function, and a television program display function.

[1. Response System Configuration and Functions]
First, with reference to FIG. 1 etc., the structure and function of the reception system concerning this embodiment are demonstrated.

  FIG. 1 is a diagram illustrating a schematic configuration example of a reception system according to the present embodiment.

  As shown in FIG. 1, the response system S includes, for example, an entrance slave unit 1 (an example of a response device) installed outside the entrance (entrance / exit) of a building (house or office), and a master unit 2 ( An example of a response control device) and an indoor cordless handset 3 that can communicate with the base phone 2 wirelessly. Further, the entrance slave unit 1 and the master unit 2 are connected by a communication cable K, for example.

  The base unit 2 is connected to a public telephone network via a telephone line C and can communicate with the telephone device 4. Examples of the telephone device 4 include a stationary telephone, a mobile phone, and a personal computer having an IP telephone function. In addition, a television receiver 6 (an example of a display device) is installed in the room. The television receiver 6 receives the terrestrial digital television broadcast and outputs the sound of the television program selected by the user through the speaker 7 while displaying the video of the television program on the monitor.

  The entrance cordless handset 1 includes an illumination unit 10, a microphone 11, a speaker 12, a call control unit 13, a camera 14, a camera control unit 15, an image signal control unit 16, a human sensor 17, a call button 18, a communication I / F 19, and the like. It has.

  The call control unit 13 communicates with the parent device 2 via the communication I / F 19 and the communication cable K. That is, the call control unit 13 takes in a visitor's voice collected by the microphone 11 and transmits the voice signal to the base unit 2 via the communication I / F 19 and the communication cable K. Also, the call control unit 13 Receives the voice signal transmitted from the base unit 2 via the communication cable K (the voice signal of the resident) via the communication I / F 19 and outputs the voice signal to the speaker 12.

  For example, when a visitor is detected by the human sensor 17, the camera control unit 15 activates the camera 14. At this time, the illumination unit 10 is turned on.

  The image signal control unit 16 captures an image of a visitor captured by the camera 14 and transmits the image signal to the parent device 2 via the communication I / F 19 and the communication cable K.

  When the call button 18 is pressed by a visitor, a call signal (an example of a visit notification signal) is transmitted to the parent device 2 via the communication I / F 19 and the communication cable K.

  On the other hand, the master unit 2 enables a call with the entrance slave unit 1, the indoor slave unit 3, the telephone device 4, and the like, and displays a video image of the television program on the screen. In addition, the master device 2 is a program that the user is watching on the television receiver 6 when the user receives a call from the front door device 1 or an incoming call from the telephone device 4 while watching the television program on the television receiver 6. The program that has been viewed is specified so that the user can continue to watch the program on the master unit 2 while calling. This program is specified by acquiring and analyzing the sound of the television program output from the speaker 7 of the television receiver 6. In addition, the main unit 2 determines the display mode of the actual screen during the call (whether or not to display the video of the TV program that was being viewed), the importance of the other party who is talking to the user, and the importance of the TV program. And decide based on.

  In order to realize such a function, the base unit 2 includes the transmitting microphone 20, the receiving speaker 21, the control unit 22, the telephone communication I / F 23, the intercom communication I / F 24, the wireless communication I / F 25, and the personal verification processing unit 26. (An example of partner identification means), a ring tone generator 27, a monitor 28 made of a liquid crystal panel or the like (an example of display means), a display control part 29, a recording control part 30, a storage part 31 made up of a nonvolatile semiconductor memory, a hard disk or the like. And an operation unit 32 having a plurality of operation buttons, a built-in microphone 33 (an example of an acquisition unit), a built-in speaker 34, a TV tuner 35 (an example of a reception unit), and the like. The transmitting microphone 20 and the receiving speaker 21 are provided in a handset (not shown), and the built-in microphone 33 and the built-in speaker 34 are provided in the main unit 2 body.

  When the ring tone generator 27 receives a call signal transmitted via the public telephone network and the telephone line C by dialing from the telephone device 4 or a call signal transmitted from the entrance terminal 1, the controller 22 , A ringing sound (in the case of a calling signal from the telephone device 4, a telephone bell sound, in the case of a calling signal from the front door 1, an interphone chime sound) is generated from the built-in speaker 34.

  The display control unit 29 controls display on the monitor 28 based on an instruction from the control unit 22.

  In response to an instruction from the control unit 22, the recording control unit 30 receives a voice signal and an image signal of the visiting party transmitted from the front cordless handset 1 via the intercom communication I / F 24 and records them in the storage unit 31 ( Or the voice signal of the telephone partner transmitted from the telephone device 4 is received via the telephone communication I / F 23 and recorded (recorded) in the storage unit 31.

  The personal collation processing unit 26 identifies the telephone partner by collating the telephone number notified from the telephone device 4 of the telephone partner when receiving a call with the telephone number registered in the personal information table.

  In addition, the personal verification processing unit 26 recognizes the face image of the visiting partner from the image signal transmitted from the entrance cordless handset 1, and compares the face image with an image (face image) registered in the personal information table. To identify the person to visit. For example, the personal collation processing unit 26 collates the recognized face image with a face image registered in the personal information table to determine whether there is similarity, and a registrant corresponding to the similar face image. Is identified as a visitor.

  Here, a method for determining the presence / absence of similarity is well known and will not be described in detail. For example, facial feature points (for example, eyes, nose, mouth, etc.) that well represent facial features from the recognized face image. Are extracted, and a face graph connecting these feature points is created. Then, the ratio of the degree of coincidence between the created face graph and the face graph created in the same manner as described above based on the face image registered in the personal information table described later is calculated, and the ratio is equal to or greater than a predetermined value. In this case, it is determined that there is similarity.

  Note that if the orientation of the extracted face image and the registered face image is different, not only will the similarity be lost, but there will also be a problem that face feature points cannot be detected well. Estimate the orientation of the face (for example, estimate the orientation of the face from the shape of a triangle with the right eye, left eye, and mouth as vertices), and convert the face graph according to the orientation to solve the problem be able to.

  Further, as another example of specifying the visiting party, the IC card reader (reader) provided in the entrance handset 1 is read from, for example, an IC card held by the visitor (the IC card is read by the IC card reader). The visitor may be specified by the ID of the visitor (by being deceived by the user). In this case, the ID read by the IC card reader is transmitted to the parent device 2, and the personal verification processing unit 26 compares the ID with the personal identification ID registered in the personal information table to visit the other party. Is identified.

  Moreover, you may comprise so that a visiting party may be specified by the visitor's fingerprint read by the fingerprint reader with which the front door 1 was equipped. In this case, the fingerprint data read by the fingerprint reader is transmitted to the base unit 2, and the personal verification processing unit 26 compares the fingerprint data with the fingerprint data registered in the personal information table. Identify who you are visiting.

  The TV tuner 35 is a one-segment tuner that receives a terrestrial digital television broadcast signal via the TV antenna 5 and receives a one-segment broadcast (one-segment broadcast) video signal, audio signal, caption data, and EPG (Electric Program Guide). Data and the like are output to the control unit 22. Specifically, the TV tuner 35 tunes to the broadcast signal of the channel specified by the channel selection signal from the control unit 22 among the broadcast signals received by the antenna 4, and performs band limitation and amplification on the broadcast signal. The IF signal is generated by performing frequency conversion or the like. Further, the TV tuner 35 generates a transport stream by performing A / D conversion, orthogonal demodulation processing, fast Fourier transform, carrier demodulation, Viterbi decoding, transport stream reproduction, Reed-Solomon decoding, and the like on the generated IF signal. Then, a transport stream for one segment broadcasting is extracted from the transport stream. Then, the TV tuner 35 generates a video signal, an audio signal, caption data, and EPG data from the one-segment broadcast transport stream.

  In the storage unit 31, a program table in which information on TV programs is registered, a personal information table for registering information on a person (registrant) who is expected to visit the user's house or a user's telephone partner, In addition, a priority table for determining a screen display at the time of incoming call and visit by a visitor is stored.

  FIG. 2A is a diagram illustrating an example of the content of information registered in the program table. As shown in FIG. 2A, in the program table, for each TV program, the program name, the category to which the program belongs (for example, drama, news, sports, education, movies, etc.) and the program importance (first) Is registered in association with each other. Among these, a program name and a category are generated by being extracted from EPG data, for example.

  The program importance level is information indicating the degree of importance of displaying the video of the program for the user when receiving a call or calling from the front door 1. There are three levels of program importance, 1, 2 and 3, with 1 being the least important and 3 being the most important. This program importance may be set by the user operating the operation unit 32, for example. Further, the program importance level may be set based on the viewing history of the program. For example, the control unit 22 (a program specifying unit 22b described later) specifies a TV program that the user is viewing on the television receiver 6 by a method described later, and information on the specified program is stored as viewing history information in the storage unit 31. To record. And since the control part 22 can specify what day each program is broadcasted from the EPG data supplied from the TV tuner 35, program importance is calculated from the ratio of the number of viewing times to the number of times the program is broadcast. calculate. At this time, the higher the ratio of the number of viewing times to the number of broadcasts, the higher the program importance level is set. The importance may be registered not for each program but for each category. The importance at this time may also be set by the user or may be set based on the viewing history.

  FIG. 2B is a diagram showing an example of the contents of information registered in the personal information table. As shown in FIG. 2B, in the personal information table, for each registrant, a registration ID as identification information, a registrant's telephone number, a registrant name, a registered image ID, registrant importance, and other information (Eg, address, e-mail, profile, etc.) are registered in association with each other. In the personal information table, one record is assigned to unregistered persons for convenience. For this unregistered person, for example, only the registration ID and the registrant importance level are registered. The registered image ID is data identification information of an image registered in association with the registrant (hereinafter referred to as “registered image”). Although any image data can be registered, it is usually registrant face image data.

  Also, the registrant importance is the information regarding the registrant (hereinafter referred to as “sender / visitor information”) for the user when a call is made from the registrant or when the registrant receives a call from the front door 1. Is the information indicating the degree of importance of displaying or the importance of responding to the registrant. There are three levels of registrant importance: 1, 2 and 3, with 1 being the least important and 3 being the most important. This registrant importance may be set by the user operating the operation unit 32, for example. Also, the registrant importance may be set based on the call history (except for unregistered users). For example, every time a call is made using the parent device 2 or the indoor child device 3, the control unit 22 records a history such as which registrant the user has called in the storage unit 31 as call history information. Then, the control unit 22 refers to the call history information and calculates the registrant importance based on the number of calls and the call time. At this time, the greater the number of calls or the longer the call time, the higher the registrant importance is set. In addition, 1 is set as the registrant importance of the unregistered person.

  FIG. 2C is a diagram illustrating an example of the content of information registered in the priority table. FIG. 3 is a diagram illustrating an example of a screen display in each screen display pattern. As shown in FIG. 2C, in the priority table, a combination of program importance and registrant importance is defined, and a screen display pattern is defined by the number for each combination. There are four screen display patterns from pattern 1 to pattern 4.

  In pattern 1, only caller / visitor information is displayed. Specifically, as shown in FIG. 3 (1), the name of the caller or visitor (registrant name) 51, the registered image 52, the telephone number 53, and other information about the caller or visitor are displayed on the screen. Displayed on the entire screen.

  In the pattern 2, the sender / visitor information is displayed and the subtitles of the program being viewed on the television receiver 6 are displayed. Specifically, as shown in FIG. 3 (2), when the caller or visitor's name 51, registered image 52, telephone number 53, and other information about the caller or visitor are as shown in FIG. 3 (1) For example, the caption 55 is displayed at the lower end of the screen.

  In pattern 3, the video of the program being viewed on the television receiver 6 is displayed, and the sender / visitor information is displayed. Specifically, as shown in FIG. 3 (3), the program video 56 is displayed on the entire screen, and the name 51 and registered image 52 of the caller or visitor are displayed in a small portion on the screen. .

  In pattern 4, the video of the program being viewed on the television receiver 6 is displayed and the subtitles are displayed. Specifically, as shown in FIG. 3 (3), the program video 56 is displayed on the entire screen, and for example, the caption 55 is displayed at the lower end of the screen.

  In the priority table, pattern 1 is defined as a screen display pattern for 1 and 2, 1 and 3, and 2 and 3 as a set of program importance and registrant importance. In addition, as a set of program importance and registrant importance, pattern 2 is defined as a screen display pattern for 1, 1, 2, and 2, and 3 and 3. Further, as a set of program importance and registrant importance, pattern 3 is defined as a screen display pattern for 2 and 1 and 3 and 2. As a set of program importance and registrant importance, pattern 4 is defined as a screen display pattern for 3 and 1. That is, when the program importance level is lower than the registrant importance level, the pattern 1 is set. When the program importance level is equal to the registrant importance level, the pattern 2 is set. The program importance level is higher by one than the registrant importance level. In this case, pattern 3 is set, and in the case where the program importance level is two higher than the registrant importance level, pattern 4 is set. Overall, the higher the program importance, the higher the pattern number, and the higher the registrant importance, the lower the pattern number. Note that the audio of the TV program is not output in any screen display pattern.

  The storage unit 21 stores various data such as image data and EPG data, programs, and the like.

  The control unit 22 is formed of, for example, a microcomputer, and a predetermined program (including the video display processing program of the present invention) is executed by the computer, whereby the communication unit 22a (an example of a detection unit) and the program specifying unit 22b. (An example of a specifying unit), a screen display pattern determination unit 22c (comparison unit, determination unit), a television output control unit 22d (an example of display control unit), and the like. The predetermined program may be recorded on a recording medium such as a memory card and read via a memory card I / F or the like, or from a server device on the Internet via a telephone line C. It may be downloaded.

  The communication unit 22a performs communication with the telephone device 4 of the telephone partner via the telephone communication I / F 23 and the telephone line C. For example, when an incoming call is received, the communication unit 22 a outputs a ringing tone to the built-in speaker 34 when receiving a call signal via the telephone communication I / F 23. Here, when receiving the other party's outgoing telephone number before the call signal, the communication unit 22a stores the outgoing telephone number in a RAM (Random Access Memory) inside the control unit. Then, when the user lifts the handset (off hook), the communication unit 22a transmits a response signal via the telephone communication I / F 23, and shifts to a call state. In the call state, the communication unit 22a captures the user's voice collected by the transmission microphone 20, and transmits the voice signal to the telephone device 4 via the telephone communication I / F 23 and the telephone line C. The voice signal transmitted from the device 4 via the telephone line C (the voice signal of the telephone partner) is received via the telephone communication I / F 23, and the voice signal is output to the reception speaker 21. As a result, the user can talk with the other party.

  In addition, the communication unit 22a performs communication with the entrance terminal 1 via the intercom communication I / F 24 and the communication cable K. For example, when the communication unit 22a receives a call signal via the interphone communication I / F 24, the communication unit 22a outputs a chime sound to the built-in speaker 34. And if a user lifts a handset, the communication part 22a will transmit a response signal via the intercom communication I / F24, and will transfer to a call state. In a call state, the communication unit 22a communicates with the front door unit 1 via the intercom communication I / F 24 and the communication cable K. For example, the communication unit 22a takes in the voice of the home-acquired person collected by the transmission microphone 20, and transmits the voice signal to the front cordless handset 1 via the intercom communication I / F 24 and the communication cable K. The unit 22a receives the audio signal (visitor's audio signal) transmitted from the front cordless handset 1 via the communication cable K via the intercom communication I / F 24, and outputs the audio signal to the reception speaker 21. . As a result, the person at home can make a call with the visiting party.

  It should be noted that when the user performs a hands-free operation, it is also possible to perform transmission and reception using the built-in microphone 33 and the built-in speaker 34 instead of the transmission microphone 20 and the reception speaker 21.

  Furthermore, the communication part 22a communicates with the indoor subunit | mobile_unit 3 via radio | wireless communication I / F25. As a result, it is possible to make an extension call between the master unit 2 and the indoor cordless handset 3, and to make a call between the indoor cordless handset 3 and the entrance cordless handset 1 via the master set 2, A telephone call between the machine 3 and the telephone device 4 is possible.

  The program identification unit 22b detects the audio signal output from the TV tuner 35 (hereinafter referred to as “program audio signal”) and the audio input from the built-in microphone 33 when the communication unit 22a detects the reception of the calling signal. Based on the signal (hereinafter referred to as “input audio signal”), the television program that the user is viewing on the television receiver 6 is specified. Specifically, for example, the program specifying unit 22b performs discrete Fourier transform using fast Fourier transform on the input sound signal, and generates spectrum information of the sound collected by the built-in microphone 33. Moreover, the program specific | specification part 22b produces | generates spectrum information similarly about the program audio | voice signal of each channel. Then, the program specifying unit 22b calculates the similarity for each channel by comparing the spectrum information of the sound collected by the built-in microphone 33 with the spectrum information of the sound of each channel. And the program specific | specification part 22b specifies the channel with the highest similarity among the channels whose similarity is higher than the preset threshold value as a channel which the user is viewing.

  For example, when the user is watching a television program on the television receiver 6, the sound collected by the built-in microphone 33 on the condition that the parent device 2 is installed in an appropriate place is the television The sound output from the speaker 7 of the receiver 6 should be included. Therefore, the similarity of any channel is higher than the threshold value. However, since the sound collected by the built-in microphone 33 may contain noise, a threshold value that takes this into consideration is set. When the power of the television receiver 6 is OFF (the user is not watching a television program), the sound collected by the built-in microphone 33 is naturally from the speaker 7 of the television receiver 6. The output sound is not included. Therefore, the similarity of any channel is lower than the threshold value.

  Depending on the configuration of the TV tuner 35, it may not be possible to select a plurality of channels simultaneously. Further, if the TV tuner 35 is configured to select all channels, the TV tuner 35 becomes expensive and the load on the control unit 22 increases. Therefore, the program specifying unit 22b, for example, generates spectrum information for each channel in a time division manner while switching channels every predetermined time (outputting channel selection signals with different channels to the TV tuner 35 one after another). You may perform similarity calculation each time. At this time, the program specifying unit 22b may end the process when the calculated similarity exceeds a threshold value, and may specify the program of the channel at that time as the program being viewed by the user.

  The program specifying unit 22b performs voice recognition processing, and compares the utterance contents obtained from the spectrum information of the voice collected by the built-in microphone 33 with the utterance contents obtained from the spectrum information of the voice of each channel. The similarity may be calculated by

  The screen display pattern determination unit 22c determines a screen display pattern at the time of ringing tone output and a call when the TV program being viewed by the user is specified by the program specifying unit 22b. Specifically, the screen display pattern determination unit 22c refers to the EPG data, acquires the program name of the program being viewed by the user based on the channel specified by the program specification unit 22b and the current time, and further displays the program name. The program importance corresponding to the acquired program name is acquired with reference to the table. Further, the screen display pattern determination unit 22c refers to the personal information table and acquires the registrant importance of the caller or visitor specified by the personal verification processing unit 26. At this time, when the individual verification processing unit 26 cannot identify the sender and the visitor, the registrant importance of the unregistered person is acquired. Then, the screen display pattern determination unit 22c refers to the priority table, and acquires the screen display pattern number corresponding to the set of the acquired program importance and registrant importance.

  The television output control unit 22d controls video display and audio output of a television program. Specifically, the television output control unit 22d outputs a channel selection signal indicating the channel selected by the user by the operation of the operation unit 32 to the TV tuner 35, and the video signal output from the TV tuner 35 in response thereto, Acquire audio signals and caption data. Then, the television output control unit 22d outputs the video signal to the display control unit 29, thereby causing the monitor 28 to display the video corresponding to the video signal. Further, the television output control unit 22 d outputs a sound signal corresponding to the sound signal by the built-in speaker 34 by outputting the sound signal to the built-in speaker 34. In addition, when the display of subtitles is instructed by the user, the control unit 22 generates a subtitle image based on the text included in the subtitle data, and outputs this to the display control unit 29. Then, the subtitle is displayed at a predetermined position on the screen of the monitor 28 so as to be superimposed on the video of the television program by the combining function of the display control unit 29.

  Further, the television output control unit 22d controls the display control unit 29 so as to perform screen display corresponding to the screen display pattern determined by the screen display pattern determination unit 22c. Specifically, when the screen display pattern is pattern 1, 2, or 3, the TV output control unit 22d transmits information on the caller or visitor specified by the personal verification processing unit 26 from the personal information table. As visitor / visitor information. When the screen display pattern is pattern 2, 3, or 4, the TV output control unit 22d outputs a channel selection signal indicating the channel specified by the program specifying unit 22b to the TV tuner 35, and according to this. The video signal, audio signal, and caption data output from the TV tuner 35 are acquired. Then, the television output control unit 22d generates a control signal based on the acquired information, and outputs the control signal to the display control unit 29, thereby causing the monitor 28 to display (1), (2), ( A screen as shown in 3) or (4) is displayed. At this time, the television output control unit 22d does not output the audio signal to the internal speaker 34 (does not output the audio of the TV program).

[2. Response system operation]
Next, with reference to FIG.4 and FIG.5, operation | movement of the reception system S which concerns on this embodiment is demonstrated.

  4 and 5 are flowcharts illustrating an example of processing executed by the control unit 22 in the parent device 2 according to the present embodiment.

  The process shown in FIG. 4 is started, for example, when the power of the parent device 2 is turned on. First, the control unit 22 performs various initial settings for operating as the base unit 2 (step S1).

  Next, the program specifying unit 22b generates spectrum information of the sound collected by the built-in microphone 33 and, based on the sound signal of each channel included in the received digital television broadcast signal, the program of each channel. Generate generation of speech spectrum information (step S2). Next, the program specifying unit 22b calculates the similarity for each channel by comparing the spectrum information, and specifies the program that the user is viewing based on the similarity (step S3).

  Next, the control unit 22 determines whether or not the program being viewed has been identified (step S4). At this time, if the program being viewed can be identified (step S4: YES), the control unit 22 updates the information such as the number of viewing times of the identified program and stores it in the storage unit 31. The viewing history information is updated, and the program importance of the identified program is updated (changed) based on the updated viewing history information (step S5).

  When the program being viewed cannot be identified (step S4: NO), or when the process of step S5 is completed, the control unit 22 transmits the program from the public telephone network via the telephone line C. It is determined whether the communication unit 22a has detected reception of the incoming call signal or the incoming call signal transmitted from the front cordless handset 1 via the cable K (step S6). At this time, when reception of the calling signal is not detected (step S6: NO), the control unit 22 proceeds to step S2.

  On the other hand, when reception of the calling signal is detected (step S6: YES), the control unit 22 controls the personal verification processing unit 26 to specify the caller or visitor as shown in FIG. (Step S7). If the information of the sender or visitor is not registered in the personal information table (the sender or visitor cannot be specified), the sender or visitor is unregistered.

  Next, the program specifying unit 22b performs the same processing as steps S2 and S3, thereby specifying the program being viewed at the time of an incoming call or a visit (when reception of a ringing signal is detected) (steps S8 and S9). ).

  Next, the control unit 22 determines whether or not the program being viewed has been identified (step S10). At this time, when the program being viewed cannot be identified (step S10: NO), the television output control unit 22d controls the display control unit 29 to monitor the caller / visitor information 28. (Step S11). In this case, the screen display as shown in FIG.

  On the other hand, when the program being viewed can be identified (step S10: YES), the screen display pattern determination unit 22c refers to the priority table and identifies the program importance level and the identified program. The screen display pattern is determined based on the registrant importance of the caller or visitor made (step S12). Next, the television output control unit 22d controls the display control unit 29 to perform screen display corresponding to the determined screen display pattern (step S13). In this case, the screen display as shown in any one of FIGS. 3A to 3D is performed depending on the screen display pattern.

  When the process of step S11 or S13 ends, the communication unit 22a determines whether or not the line is disconnected (the call is ended) (step S14). That is, the communication unit 22a determines whether an on-hook by the user is detected or whether a disconnection signal is received through the telephone line C. At this time, if the line is not disconnected (step S14: NO), the communication unit 22a continues to monitor the line disconnection (step S14).

  On the other hand, when the line is disconnected (step S14: YES), the control unit 22 is stored in the storage unit 31 by updating the number of calls, the call time, etc. for the specified caller or visitor. The call history information is updated, and the registrant importance of the identified caller or visitor is updated (changed) based on the updated call history information (step S15). Next, the television output control unit 22d ends the screen display so far, shifts the operation state of the parent device 2 to the standby state (step S16), and shifts to step S2.

  As described above, according to the present embodiment, the communication unit 22a transmits a call signal transmitted from the public telephone network via the telephone line C, or transmitted from the entrance terminal 1 via the cable K. When the calling signal is received, the program specifying unit 22b outputs from the speaker 7 of the television receiver 6 based on the input audio signal output from the built-in microphone 33 and the program audio signal output from the TV tuner 35. A television program that broadcasts the same audio as the recorded audio is identified, and the television output control unit 22d determines the video of the identified television program based on the video signal of the television program included in the television broadcast signal. It is displayed on the monitor 28. Therefore, since the video of the TV program that the user was watching is specified based on the sound output from the speaker 7 of the TV receiver 6, the response system S and the TV receiver 6 are connected by a communication cable or the like. Even if it is not, the video of the TV program that the user was watching can be continuously viewed on the monitor 28 of the parent device 2 while the parent device 2 is answering the telephone.

  Further, the personal verification processing unit 26 compares the telephone number notified from the telephone device 4 with the telephone number registered in the personal information table, or is recognized from the image signal transmitted from the entrance terminal 1. By comparing the face image and the image registered in the personal information table, the sender or visitor is identified, and the screen display pattern determination unit 22c determines the importance of the identified sender or visitor registrant. Is compared with the program importance of the specified TV program, and if the result of the comparison shows that the registrant importance is higher than the program importance, the sender / visit information of the sender / visitor information and the program video If the program information is higher than the registrant importance, it is determined to display at least the program video from the sender / visitor information and the program video. Therefore, when the user is answering the telephone, it is possible to preferentially display the information on the other party and the video of the program with higher importance.

  Further, when the registrant importance level and the program importance level are equal, the screen display pattern determination unit 22c displays the sender / visitor information among the sender / visitor information and the program video, and the program subtitles. Is determined to be displayed. Therefore, when the importance level of the registrant and the importance level of the program are about the same, both the information about the registrant and the content that is currently being viewed can be presented to the user.

  When the importance of the program is two higher than the importance of the registrant, the screen display pattern determination unit 22c displays only the program video out of the sender / visitor information and the program video, and also displays the program Decide to display subtitles. Therefore, when the importance level of the program is somewhat higher than the importance level of the registrant, and there is a need for the user to understand the content of the program, the subtitles of the program as the content of the program currently in progress Can be displayed.

  Further, if the control unit 22 sets the registrant importance level based on the call history, it is possible to save the user from setting the registrant importance level and to appropriately set the registrant importance level. be able to.

  In addition to the case where the call signal is received, if the control unit 22 sets the program importance based on the viewing history updated by the program specifying unit 22b always specifying the TV program, the user can be set. It is possible to save the trouble of setting the program importance level by, and to appropriately set the program importance level.

  Note that the display size of the sender / visitor information and the display size of the program video may be changed according to the comparison result between the registrant importance level and the program importance level. For example, when the registrant importance level and the program importance level are equal, the display size of the sender / visitor information and the display size of the program video are set to the same level. If the registrant importance is higher than the program importance, the display size of the sender / visitor information is made larger than the display size of the program video. If the program importance level is higher than the registrant importance level, the display size of the program video is made larger than the display size of the sender / visitor information. That is, the display size with the higher importance is increased.

  Further, based on only one of the importance level of the registrant and the importance level of the program, whether or not to display the program video or the display mode when displaying the program video may be determined. .

  For example, when the registrant importance is a certain value or more, only the sender / visitor information may be displayed without displaying the program video. Further, the lower the registrant importance level, the larger the display size of the program video and the smaller the display size of the sender / visitor information. When the registrant importance is below a certain value, the program video may be displayed and the subtitles of the program may be displayed. In other words, since the importance of displaying the caller / visitor information or the importance of displaying the program video according to the importance of answering the call to the caller or visitor changes relatively, Display according to this change is performed.

  If the program importance is below a certain value, only the sender / visitor information may be displayed without displaying the program video. Further, the higher the program importance level, the larger the display size of the program video and the smaller the display size of the sender / visitor information. Further, when the program importance level is a certain value or more, the program video may be displayed and the subtitles of the program may be displayed.

  In the above embodiment, the present invention is applied to a response system having both a telephone function and an intercom function. However, the present invention may be applied to a system having only one of the functions. . Further, the present invention may be applied to a terminal device for a video conference system.

  Further, in the above embodiment, the program importance level and the registrant importance level are each in three stages, but it is not necessary to limit to three stages.

DESCRIPTION OF SYMBOLS 1 Entrance child machine 2 Parent machine 3 Indoor child machine 4 Telephone apparatus 5 TV antenna 6 Television receiver 7 Speaker 20 Transmission microphone 21 Reception speaker 22 Control part 22a Communication part 22b Program specific part 22c Screen display pattern determination part 22d Television output control Part 23 Telephone communication I / F
24 Intercom communication I / F
25 Wireless communication I / F
26 Personal verification processing unit 27 Ringing tone generation unit 28 Monitor 29 Display control unit 30 Recording control unit 31 Storage unit 32 Operation unit 33 Built-in microphone 34 Built-in speaker 35 TV tuner S Response system

Claims (16)

A response control device for controlling communication with at least one of a telephone device or a response device for responding to a visitor,
Display means;
Receiving means for receiving broadcast signals of a plurality of programs broadcast as video and sound;
An acquisition unit that is a display device separate from the display unit, and that acquires a sound output from a speaker of a display device that displays video of at least one of the plurality of programs as a speaker sound signal;
Detecting means for detecting at least one of an incoming call from the telephone device via a telephone line and reception of a visit notification signal for notifying the visit of the visitor from the reception device;
When the detection means detects reception of the incoming call or the visit notification signal, the speaker sound signal and the broadcast signal include the program in which the same sound as the sound output from the speaker is broadcast. Identifying means based on the sound signal to be
Display control means for displaying the video of the specified program on the display means based on the video signal of the program included in the broadcast signal;
A response control device comprising: The response control apparatus according to claim 1,
The other party priority storage means for storing the identification information of the other party to call and the priority in association with each other;
Collating the identification information of the caller transmitted via the telephone line or the identification information of the visitor transmitted from the reception device with the identification information stored in the partner priority storage means By means of identifying the caller or the visitor,
A decision to determine whether or not to display a video of the specified program or a display mode of the video based on the priority corresponding to the specified caller or visitor Means further comprising:
The response control apparatus, wherein the display control means controls display of the video of the specified program based on the determination by the determination means. In the reception control device according to claim 2,
The determining means determines to simultaneously display the video of the specified program and the partner information regarding the specified sender or visitor, and the priority corresponding to the specified partner is determined. The response control apparatus, wherein the lower the value, the larger the display area of the specified program video by the display means. In the reception control device according to claim 2 or claim 3,
When the priority corresponding to the specified partner is lower than a predetermined priority, the determining means displays the video of the specified program and includes the subtitle of the program included in the broadcast signal A response control device that determines to display subtitles based on information. The response control apparatus according to claim 1,
Program priority storage means for storing the identification information of the program or the program type and the priority in association with each other;
Based on the priority corresponding to the identification information of the specified program or the type of the program, at least one of whether to display the video of the program or the display mode of the video is determined. And a determination means,
The response control apparatus, wherein the display control means controls display of the video of the specified program based on the determination by the determination means. In the response control apparatus according to claim 5,
The determination means determines to simultaneously display the video of the specified program and the partner information regarding the caller or visitor, and corresponds to identification information of the specified program or the type of the program The response control apparatus, wherein the higher the priority, the larger the display area of the specified program video by the display means is determined. In the reception control device according to claim 5 or 6,
The determining means displays the video of the specified program when the priority corresponding to the identification information of the specified program or the type of the program is higher than a predetermined priority, and the broadcast A response control apparatus, characterized in that it determines to display a caption based on caption information of the program included in the signal. The response control apparatus according to claim 1,
Partner priority storage means for storing the identification information of the other party to call and the first priority in association with each other;
Program priority storage means for storing the program or the identification information of the type of the program and the second priority in association with each other;
Collating the identification information of the caller transmitted via the telephone line or the identification information of the visitor transmitted from the reception device with the identification information stored in the partner priority storage means By means of identifying the caller or the visitor,
Comparison means for comparing the first priority corresponding to the specified caller or visitor and the second priority corresponding to identification information of the specified program or the type of the program. ,
As a result of the comparison by the comparison means, if the first priority is higher than the second priority, among the partner information about the specified caller or visitor and the video of the specified program If at least the partner information is determined to be displayed, and the first priority is lower than the second priority, at least the program video is displayed among the partner information and the program video. And determining means for determining
The response control apparatus, wherein the display control means controls to display either the partner information or the video of the program based on the determination by the determination means. The response control apparatus according to claim 8, wherein
When the first priority and the second priority are equal, the determining means displays the partner information among the partner information and the video of the program, and includes the partner information included in the broadcast signal. A response control apparatus, characterized in that it determines to display subtitles based on subtitle information of a program. The response control apparatus according to claim 8, wherein
In the case where the first priority is lower than the second priority and the difference between the first priority and the second priority is equal to or greater than a predetermined value, The reception control apparatus, wherein the video of the program is displayed among the partner information and the video of the program, and the subtitle is determined to be displayed based on the subtitle information of the program included in the broadcast signal. In the reception control device according to any one of claims 2 to 4 and claims 8 to 10,
Call history information storage means for storing call history information indicating a call history using the reception control device with the caller or visitor identified by the partner identification means;
Partner priority setting means for setting the priority stored in the partner priority storage means based on the stored call history information;
A response control device further comprising: In the reception control apparatus according to any one of claims 5 to 10,
The specifying means specifies the program on which the same sound as the sound output from the speaker is broadcast, except when the incoming call or the reception of the visit notification signal is detected,
Viewing history information storage means for storing a specific history of the program by the specifying means as viewing history information indicating a viewing history of the program by the user;
Program priority setting means for setting a priority stored in the program priority storage means based on the stored viewing history information;
A response control device further comprising: In the reception control device according to any one of claims 1 to 12,
The specifying unit extracts a frequency characteristic of sound from the sound signal included in the speaker sound signal acquired by the acquiring unit and the broadcast signal received by the receiving unit, and the frequency of the sound is extracted from the speaker sound signal. The response is characterized in that the information obtained by extracting the characteristics and the information obtained by extracting the frequency characteristics of the sound from the sound signal included in the broadcast signal are identified. Control device. In the reception control device according to any one of claims 1 to 13,
The acquisition means is a microphone that converts an external sound of the reception control device into an external sound signal,
The specifying means specifies whether the sound of any of the programs is included in the external sound based on the external sound signal and a sound signal included in the broadcast signal. Control device. A video display method in a reception control device comprising a display means,
A receiving process for receiving broadcast signals of a plurality of programs broadcast as video and sound;
An acquisition step of obtaining a sound output from a speaker of a display device that displays a video of at least one of the plurality of programs as a speaker sound signal;
A detection step of detecting at least one of an incoming call from the telephone device via a telephone line and a reception notification signal for notifying the visitor of the visitor from the reception device for responding to the visitor; ,
In the detection step, when the incoming call or the reception of the visit notification signal is detected, the program in which the same sound as the sound output from the speaker is broadcast is included in the speaker sound signal and the broadcast signal. Specific process based on the sound signal to be generated,
A display control step of causing the display means to display the video of the specified program based on the video signal of the program included in the broadcast signal;
A video display method characterized by comprising: Computer
16. A video display processing program that functions as the reception control device according to claim 1.

Images