JP4602027B2 - Display control apparatus and method, display apparatus, and display system - Google Patents

Description

  The present invention relates to a display control device and method, a display device, and a display system, and more particularly, for example, a display control device and method, a display device, and a display that enable effective use of an existing television receiver. About the system.

  For example, in a conventional television receiver, a television broadcast signal is received, an image as a television broadcast program is displayed, and sound accompanying the image is output.

  By the way, for example, it is difficult to constantly monitor an infant or an elderly person in a home with an infant or an elderly person. In general, a human being or other caregiver at home regularly checks the state of an infant or an elderly person. I will go to see irregularly.

  However, in this case, the burden on the caregiver is considerable, and therefore, some means for reducing the burden on the caregiver is required.

  Therefore, for example, there is a surveillance camera system that takes pictures of infants and elderly people in a room and projects the images on a monitor in another room.

  However, in the conventional surveillance camera system, the video from the camera has to be confirmed constantly, regularly or irregularly, and although the burden on the caregiver is somewhat reduced, it is still large.

  In addition, there are many television receivers in the home, but if a monitor of the surveillance camera system must be installed in addition to the television receiver, the corresponding housing space will be affected. Become.

  Therefore, there is a method of projecting an image from the camera of the surveillance camera system on a television receiver at home.

  However, if the image from the camera of the surveillance camera system is displayed on the television receiver, the caregiver cannot view the television broadcast program on the television receiver.

  Therefore, in the television receiver, there is a method in which a caregiver switches between the television broadcast program and the video from the camera of the surveillance camera system. However, there is a method of switching between the television broadcast program and the video from the camera of the surveillance camera system. It is troublesome to perform the switching operation, and furthermore, a caregiver may forget to perform the switching operation, and in the worst case, an emergency situation may not be noticed.

  The present invention has been made in view of such a situation, and an existing television receiver is provided by allowing a user to easily recognize an emergency situation using an existing television receiver or the like. It is intended to enable effective use of the machine.

The display control device of the present invention includes a display control means for controlling display and sound output of an image input from the first input system and an image input from the second input system to the display device, and a second input. Detection means for detecting feature amounts of image and sound information input from the system at predetermined time intervals, analysis means for analyzing temporal variations in feature amounts of image and sound, and time of feature amounts of image and sound A display device comprising: storage means for storing abnormal conditions to be satisfied by the dynamic fluctuation component; and determination means for determining whether temporal fluctuations in the feature quantities of the images and sounds analyzed by the analysis means satisfy the abnormal conditions Is one of a plurality of display devices arranged at positions that can be observed at the same time, and the display control means determines when the image input from the first input system is displayed on the display device. By image and sound When symptoms of temporal variation is determined to meet the abnormal conditions, the image of the information input from the second input system, displayed instead of the inputted image from the first input line device And a predetermined warning sound replacing the voice of the information inputted from the second input system is output .

Setting means for setting an abnormal condition can be further provided.

The display control method of the present invention includes a display control step for controlling display and audio output of an image input from a first input system and an image input from a second input system to a display device, and a second input. A detection step for detecting feature amounts of image and sound information input from the system at predetermined time intervals, an analysis step for analyzing temporal variations in image and sound feature amounts, and a time period for image and sound feature amounts A storage step for storing an abnormal condition to be satisfied by the dynamic variation component, and a determination step for determining whether temporal variation of the feature amount of the image and the sound analyzed in the analysis step process satisfies the abnormal condition, display, at the same time are arranged on observable position is one of a plurality of display devices, in the processing of the display control step, of displaying a first image input from the input system to the display device If it is, when the temporal variation of the image and sound of the feature is determined to meet the abnormal conditions in the process of determining step, an image of the information input from the second input lines, first Instead of an image input from the input system, a predetermined warning sound is output instead of the voice of the information input from the second input system .

In the display control apparatus and method of the present invention, the display and sound output of the image input from the first input system and the image input from the second input system to the display device are controlled, and the second input system is controlled. The feature values of the image and sound information input from are detected every predetermined time, the temporal variation of the image and sound feature amounts are analyzed, and the temporal variation component of the image and sound feature amounts should be satisfied When the conditions are stored, it is determined whether the temporal variation of the analyzed image and audio feature amount satisfies the abnormal condition, and the image input from the first input system is displayed on the display device, When it is determined that the temporal variation of the feature amount of the image and the sound satisfies the abnormal condition, the image of the information input from the second input system is changed to the image input from the first input system. It is displayed on the display device in place With a predetermined alarm sound alternative to voice of the information input from the second input line is outputted.

The display system of the present invention configured by connecting a plurality of display control devices having a plurality of input systems, each of the plurality of display control devices is input from a display device that displays an image and a first input system Display control means for controlling display and sound output on the display device of images and images input from the second input system, and feature quantities of image and sound information input from the second input system for a predetermined time Detection means for detecting each time, analysis means for analyzing temporal fluctuations of image and sound feature quantities, storage means for storing abnormal conditions to be satisfied by temporal fluctuation components of image and voice feature quantities, and analysis means Determining means for determining whether temporal fluctuations in the feature quantities of the image and sound analyzed in accordance with the abnormal condition are satisfied, and the display device is a plurality of display devices arranged at positions that can be observed simultaneously One of There, the display control means, when the first image input from the input line is displayed, the temporal variation of the characteristic quantity of image and sound by determining means is determined to satisfy the abnormal condition on the display device Rutoki, an image of the information input from the second input line, and displays on the display device in place of the inputted image from the first input line, the information input from the second input system A predetermined warning sound is output in place of the voice .

In the display system configured by connecting a plurality of display control devices having a plurality of input systems according to the present invention, an image input from the first input system and a second input system in each of the plurality of display control devices. Display on the display device is controlled, and feature amounts of image and audio information input from the second input system are detected at predetermined intervals, and temporal features of the image and audio feature amounts are detected. The fluctuation is analyzed, the abnormal condition to be satisfied by the temporal fluctuation component of the feature quantity of the image and the sound is stored, it is determined whether or not the temporal fluctuation of the analyzed feature quantity of the image and the voice satisfies the abnormal condition, when the first image input from the input system on a display device when being displayed, time variation of the characteristic quantity of image and sound is determined to meet the abnormal conditions, input from the second input line Information Image among the found is displayed on the display device in place of the inputted image from the first input line, a predetermined alarm sound alternative to voice of the information input from the second input system is output The

The display apparatus according to the present invention includes a display unit that displays an image, and a display control that controls display on the display unit and an audio output of an image input from the first input system and an image input from the second input system. Means, detecting means for detecting feature quantities of image and sound information inputted from the second input system at predetermined time intervals, analyzing means for analyzing temporal variations of image and sound feature quantities, and image And storage means for storing abnormal conditions to be satisfied by temporal variation components of voice feature values, and determination for determining whether temporal fluctuations of image and voice feature values analyzed by the analysis means satisfy abnormal conditions And the display means is one of a plurality of display means arranged at a position that can be observed at the same time, and the display control means displays an image input from the first input system on the display means. If it is, the decision hand When the time variation of the characteristic quantity of image and sound is determined to meet the abnormal conditions, the image of the information input from the second input system, input from the first input system image Instead of displaying on the display means, it is possible to output a predetermined warning sound instead of the voice of the information inputted from the second input system .

In the display device of the present invention, the display and sound output to the display means of the image input from the first input system and the image input from the second input system are controlled and input from the second input system. Image and audio information feature quantities are detected at predetermined time intervals, temporal variations in image and audio feature quantities are analyzed, and abnormal conditions to be satisfied by temporal variation components in image and audio feature quantities are stored. If it is determined whether the temporal variation of the analyzed image and sound feature amount satisfies the abnormal condition, and the image input from the first input system is displayed on the display means, the image and sound When it is determined that the temporal variation of the feature amount satisfies the abnormal condition, the image of the information input from the second input system is displayed instead of the image input from the first input system It is displayed on the means, Predetermined alarm sound alternative to voice of the information input from the second input line is outputted.

  According to the present invention, a user can easily recognize an abnormality (emergency) with an existing television receiver or the like, and as a result, the existing television receiver can be effectively used. Become.

  FIG. 1 shows a scalable TV (Television) system to which the present invention is applied (a system is a logical collection of a plurality of devices, regardless of whether or not the devices of each configuration are in the same casing. 1 is a perspective view showing a configuration example of an embodiment.

In the embodiment of Figure 1A, the scalable TV system, nine of the television receiver 1, and 2 _11, 2 _12, 2 _13, 2 _21, 2 _23, 2 _31, 2 ₃₂ consists of two ₃₃ Yes. In the embodiment of FIG. 1B, the scalable TV system includes 25 television receivers 1 and 2 ₁₁ , 2 ₁₂ , 2 ₁₃ , 2 ₁₄ , 2 ₁₅ , 2 ₂₁ , 2 ₂₂ , 2 ₂₃ , 2 ₂₄ , 2 ₂₅ , 2 ₃₁ , 2 ₃₂ , 2 ₃₄ , 2 ₃₅ , 2 ₄₁ , 2 ₄₂ , 2 ₄₃ , 2 ₄₄ , 2 ₄₅ , 2 ₅₁ , 2 ₅₂ , 2 ₅₃ , 2 ₅₄ , 2 ₅₅ Yes.

  Here, the number of television receivers constituting the scalable TV system is not limited to nine or 25. In other words, the scalable TV system can be configured by an arbitrary plurality of television receivers. Further, as shown in FIG. 1, the arrangement of the television receivers constituting the scalable TV system is not limited to 3 × 3 or 5 × 5. That is, the arrangement of the television receivers constituting the scalable TV system can be, for example, horizontal × vertical 1 × 2, 2 × 1, 2 × 3, or the like. Further, the arrangement shape of the television receivers constituting the scalable TV system is not limited to a lattice shape (matrix shape) as shown in FIG. 1, and may be a pyramid shape, for example.

  In this way, the scalable TV system can be said to be a “scalable” system because an arbitrary number of television receivers can be arranged and arranged in an arbitrary number in the horizontal and vertical directions. .

  The television receiver constituting the scalable TV system is controlled by a parent television receiver that can control other television receivers (hereinafter referred to as “parent device” as appropriate) and other television receivers. However, there are two types of child television receivers (hereinafter referred to as slave units as appropriate) that cannot control other television receivers.

  Further, in the scalable TV system, as will be described later, it is possible to perform full-screen display for displaying images over the entire display screens of all television receivers constituting the scalable TV system.

  However, in order for the scalable TV system to perform full-screen display, the television receiver constituting the scalable TV system is compatible with the scalable TV system (hereinafter referred to as a scalable compatible machine as appropriate), and It is a condition that at least one of the devices is a parent device. For this reason, in the embodiment of FIG. 1A and FIG. 1B, among the television receivers constituting the scalable TV system, for example, the television receiver disposed at the center is the master unit 1.

  From the above, when there is a television receiver that is not a scalable compatible device among the television receivers constituting the scalable TV system, full-screen display cannot be performed. Furthermore, even if the television receivers constituting the scalable TV system are scalable compatible devices, if all of them are slave units, it is still impossible to perform full screen display.

  Therefore, in order to enjoy the full-screen display function of the scalable TV system, the user needs to purchase at least one master unit, or one master unit and one or more slave units.

  Note that the master unit also has the function of a slave unit, and therefore, a plurality of master units may exist in the television receiver constituting the scalable TV system.

In the embodiment of FIG. 1A, among the 3 × 3 television receivers, the television receiver 1 arranged at the center (second from the left and second from the top) is the master unit. other eight television receiver 2 _11, 2 _12, 2 _13, 2 _21, 2 _23, 2 _31, 2 _32, 2 ₃₃ is in the slave unit. In the embodiment of FIG. 1B, among the 5 × 5 television receivers, the television receiver 1 arranged at the center (third from the left and third from the top) is the master unit. The other 24 units 2 ₁₁ , 2 ₁₂ , 2 ₁₃ , 2 ₁₄ , 2 ₁₅ , 2 ₂₁ , 2 ₂₂ , 2 ₂₃ , 2 ₂₄ , 2 ₂₅ , 2 ₃₁ , 2 ₃₂ , 2 ₃₄ , 2 ₃₅ , 2 ₄₁ , 2 ₄₂ , 2 ₄₃ , 2 ₄₄ , 2 ₄₅ , 2 ₅₁ , 2 ₅₂ , 2 ₅₃ , 2 ₅₄ , and 2 ₅₅ are slave units.

  Therefore, in the embodiment of FIG. 1, the master unit 1 is arranged at the center of the television receiver that constitutes the scalable TV system, but the position of the master unit 1 is the television receiver that constitutes the scalable TV system. The base unit 1 is not limited to the center of the machine, and can be placed at any position, such as upper left, lower right, or the like.

  Here, in the following, for the sake of simplicity, the scalable TV system is assumed to be composed of 3 × 3 television receivers as shown in FIG. 1A. It is assumed that it is arranged at the center of a television receiver that constitutes a scalable TV system.

Incidentally, suffixes ij handset 2 _ij constituting the scalable TV system, the handset 2 _ij is the scalable TV system, (from the top of the i-th row, j-th column from the left) the i-th column j th row disposed It represents what is being done.

Further, hereinafter, the slave unit 2 _ij will be described as the slave unit 2 unless it is necessary to particularly distinguish the slave unit 2 _ij .

  Next, FIG. 2 is a perspective view illustrating a configuration example of a television receiver that is the parent device 1.

  The base unit 1 is a television receiver having a display screen size of, for example, 14 inches or 15 inches, and a CRT (Cathode Ray Tube) 11 for displaying an image is provided at the front center portion. In addition, speaker units 12L and 12R for outputting sound are provided at the left and right ends of the front, respectively.

  Then, an image of a television broadcast signal received by an antenna (not shown) is displayed on the CRT 11, and audio L (Left) and R (Right) channels associated with the image are connected to the speaker units 12L and 12R. Are output respectively.

  The base unit 1 is accompanied by a remote commander (hereinafter referred to as a remote controller) 15 for emitting infrared IR (Infrared Ray), and the user operates the remote controller 15 to change the reception channel and volume. Various other commands can be given to the main unit 1.

  The remote controller 15 is not limited to the one that performs infrared communication, and for example, a device that performs wireless communication such as BlueTooth (trademark) can be adopted.

  In addition, the remote controller 15 can control not only the parent device 1 but also the child device 2.

  Next, FIG. 3 is a six-sided view illustrating a configuration example of the base unit 1 of FIG.

  3A is a front view of base unit 1, FIG. 3B is a top view of base unit 1, FIG. 3C is a bottom view of base unit 1, FIG. 3D is a left side view of base unit 1, and FIG. FIG. 3F shows the back of the base unit 1.

  A fixing mechanism is provided on the upper surface (FIG. 3B), the bottom surface (FIG. 3C), the left side surface (FIG. 3D), and the right side surface (FIG. 3E) of the base unit 1. As will be described later, the same fixing mechanism is provided on the top, bottom, left side, and right side of the television receiver that is the slave unit 2, and the top side, bottom side, and left side of the base unit 1 are provided. When the handset 2 or another base unit is arranged on the side or the right side, the fixing mechanism provided on the top surface, bottom surface, left side, or right side of the base unit 1, the handset 2 or other The fixing mechanism provided on the opposing surface of the parent device is fitted, for example, so that the parent device 1, the child device 2, and other parent devices are fixed so as not to be easily separated. As a result, misalignment of the television receiver constituting the scalable TV system is prevented.

  The fixing mechanism can be configured by a mechanical mechanism, or can be configured by, for example, a magnet.

  As shown in FIG. 3F, a terminal panel 21, an antenna terminal 22, an input terminal 23, and an output terminal 24 are provided on the back surface of the base unit 1.

The terminal panel 21 includes a master unit 1 and eight slave units 2 ₁₁ , 2 ₁₂ , 2 ₁₃ , 2 ₂₁ , 2 ₂₃ , 2 ₃₁ , 2 ₃₂ , and 2 ₃₃ that constitute the scalable TV system of FIG. Eight IEEE (Institute of Electrical and Electronics Engineers) 1394 terminals 21 ₁₁ , 21 ₁₂ , 21 ₁₃ , 21 ₂₁ , 21 ₂₃ , 21 ₃₁ , 21 ₃₂ , and 21 ₃₃ are provided.

Here, in the embodiment of FIG. 3F, since the master unit 1 grasps the position of the slave unit 2 _ij in the scalable TV system of FIG. 1A, the terminal panel 21 allows the user to select the scalable TV system. when viewed from the rear side, at a position corresponding to the position of the slave unit 2 _ij the scalable TV system of FIG. 1A, IEEE1394 terminal 21 _ij is provided which is connected to the handset 2 _ij.

Thus, in the scalable TV system of FIG. 1A, the child device 2 ₁₁ IEEE1394 terminal 21 _11, the handset 2 ₁₂ IEEE1394 terminal 21 _12, the handset 2 ₁₃ IEEE1394 terminal 21 _13, handset 2 ₂₁ IEEE1394 The terminal 21 ₂₁ , the slave unit 2 ₂₃ is the IEEE1394 terminal 21 ₂₃ , the slave unit 2 ₃₁ is the IEEE1394 terminal 21 ₃₁ , the slave unit 2 ₃₂ is the IEEE1394 terminal 21 ₃₂ , and the slave unit 2 ₃₃ is the IEEE1394 terminal 21 ₃₃ , respectively. Via, the user is connected so as to be connected to the base unit 1.

In the scalable TV system shown in FIG. 1A, which IEEE1394 terminal of the terminal panel 21 is connected to the child device _ij is not particularly limited. However, when the slave unit _ij is connected to an IEEE1394 terminal other than the IEEE1394 terminal 21 _ij , the slave unit _ij is arranged in the i-th column and j-th row of the scalable TV system of FIG. 1A. , It is necessary to set the master unit 1 (the user needs to set it).

Further, in the embodiment of FIG. 3F, the terminal panel 21 is provided with eight IEEE1394 terminals 21 ₁₁ to 21 _33, the master unit 1, and each eight handset 2 ₁₁ to 2 _33, connected in parallel and so, but the master unit 1, the eight handset 2 ₁₁ to 2 _33, it is also possible to connect in series. That is, the slave unit 2 _ij can be connected to the master unit 1 via the other slave unit 2 _{i′j ′} . However, also in this case, it is necessary to set the master unit 1 that the slave unit _ij is arranged in the i-th column and the j-th row of the scalable TV system of FIG. 1A. Therefore, the number of IEEE1394 terminals provided on the terminal panel 21 is not limited to eight.

  Furthermore, the electrical connection between the television receivers constituting the scalable TV system is not limited to IEEE1394, and for example, a LAN (IEEE802) can be adopted. Further, the electrical connection between television receivers constituting the scalable TV system can be performed wirelessly instead of wired.

  A cable connected to an antenna (not shown) is connected to the antenna terminal 22, whereby a television broadcast signal received by the antenna is input to the parent device 1. For example, image data and audio data output from a VTR (Video Tape Recorder) or the like are input to the input terminal 23. From the output terminal 24, for example, image data and audio data as a television broadcast signal received by the master unit 1 are output.

  Next, FIG. 4 is a perspective view showing a configuration example of a television receiver as the slave unit 2.

  The subunit | mobile_unit 2 is a television receiver of the same display screen size as the main | base station 1 of FIG. 2, The CRT (Cathode Ray Tube) 31 which displays an image is provided in the front center part, Speaker units 32L and 32R for outputting sound are provided at the left and right ends of the front, respectively. It should be noted that different display screen sizes can be adopted for the parent device 1 and the child device 2.

  Then, an image of a television broadcast signal received by an antenna (not shown) is displayed on the CRT 31, and the audio L (Left) and R (Right) channels associated with the image are connected to the speaker units 32L and 32R. Are output respectively.

  Similarly to the master unit 1, the slave unit 2 also has a remote controller 35 that emits infrared IR. By operating the remote controller 35, the user can change the reception channel, the volume, and other various commands. , Can be given to the slave unit 2.

  The remote controller 35 can control not only the child device 2 but also the parent device 1.

In order to configure the scalable TV system of FIG. 1A, the user needs to purchase one master unit 1 and eight slave units 2 _{11 to} 2 _{33. In} this case, the master unit 1 remote control 15 is associated with, than the remote controller 35 is associated to each eight handset 2 ₁₁ to 2 _33, the user becomes a owning a nine remote control, the management becomes complicated.

  Therefore, the remote control 35 of the slave unit 2 can be sold separately as an option of the slave unit 2. In addition, the remote controller 15 of the master unit 1 can be sold separately as an option of the master unit 1.

  Here, as described above, the remote controllers 15 and 35 can control both the parent device 1 and the child device 2, and therefore, only one of the remote controller 15 or 35 is owned. In addition, it is possible to control all of the master unit 1 and the slave unit 2.

  Next, FIG. 5 is a 6-side view showing an example of the configuration of the handset 2 of FIG.

  5A is a front view of the child device 2, FIG. 5B is a top surface of the child device 2, FIG. 5C is a bottom surface of the child device 2, FIG. 5D is a left side surface of the child device 2, and FIG. FIG. 5F shows the rear surface of the slave unit 2.

  The top surface (FIG. 5B), bottom surface (FIG. 5C), left side surface (FIG. 5D), and right side surface (FIG. 5E) of the slave unit 2 are provided with fixing mechanisms. When the master unit 1 and other slave units are arranged on the left side or right side, a fixing mechanism provided on the top, bottom, left side, or right side of the slave unit 2 and the master unit 1 And the fixing mechanism provided in the surface which the other subunit | mobile_unit opposes fits, and the subunit | mobile_unit 2 and another subunit | mobile_unit and the main | base station 1 are fixed so that it may not separate easily.

  As shown in FIG. 5F, a terminal panel 41, an antenna terminal 42, an input terminal 43, and an output terminal 44 are provided on the back surface of the slave unit 2.

The terminal panel 41 is provided with _one IEEE1394 terminal 41 ₁ for electrically connecting the parent device 1 and the child device 2. Handset 2, in the case of the scalable TV system in FIG. 1A, for example, a handset 2 ₁₁ disposed at the upper left, the IEEE1394 terminal 41 ₁ of the terminal panel 41 via the IEEE1394 cable (not shown), Fig. 3F It is connected to the IEEE1394 terminal 21 ₁₁ of the terminal panel 21 at.

  The number of IEEE1394 terminals provided on the terminal panel 41 is not limited to one.

  A cable connected to an antenna (not shown) is connected to the antenna terminal 42, whereby a television broadcast signal received by the antenna is input to the handset 2. For example, image data and audio data output from a VTR or the like are input to the input terminal 43. From the output terminal 44, for example, image data and audio data as a television broadcast signal received by the slave unit 2 are output.

Above one of the main unit 1 and the eight handset 2 ₁₁ to 2 ₃₃ Total nine television receivers configured is, in the horizontal and vertical direction, they are arranged one by three respectively Thus, the scalable TV system of FIG. 1A is configured.

  Note that the scalable TV system of FIG. 1A is configured by directly arranging other television receivers on the top, bottom, left, or right of the television receiver as a master unit or a slave unit. It is also possible to arrange the television receiver in a rack dedicated to the scalable TV system shown in FIG. When the dedicated rack is used in this way, it is possible to prevent the displacement of the television receiver constituting the scalable TV system more firmly.

Here, when a scalable TV system is configured by directly arranging another television receiver on the top, bottom, left, or right of a television receiver as a master unit or a slave unit, for example, The machine 1 cannot be arranged in the second row and the second column as shown in FIG. 1A unless at least the child machine 2 ₃₂ exists. On the other hand, when the rack dedicated to the scalable TV system shown in FIG. 6 is used, the parent device 1 can be arranged in the second row and second column even if the child device 2 ₃₂ does not exist.

  Next, FIG. 7 is a plan view showing a configuration example of the remote controller 15.

The select button switch 51 can be operated (direction operation) in a total of eight directions including four directions in the vertical and horizontal directions and four oblique directions in the middle thereof. Furthermore, the select button switch 51 can be pressed (select operation) in a direction perpendicular to the upper surface of the remote controller 15. In the menu button switch 54, various settings (for example, the above-mentioned slave unit _ij is arranged in the i-th column and the j-th row of the scalable TV system) on the CRT 11 of the master unit 1 (or the CRT 31 of the slave unit 2). It is operated when displaying a menu screen for inputting a command for instructing to perform a predetermined process).

  Here, when the menu screen is displayed, a cursor that indicates an item or the like on the menu screen is displayed on the CRT 11. This cursor moves in the direction corresponding to the operation by operating the select button switch 51 in the direction. If the select button switch 51 is selected when the cursor is at a position on a predetermined item, the selection of the item is confirmed. In the present embodiment, as will be described later, there are icons in the items displayed on the menu, and the select button switch 51 is selected even when the icon is clicked.

  The exit button switch 55 is operated when returning from the menu screen to the original normal screen.

  The volume button switch 52 is operated when the volume is raised or lowered. The channel up / down button switch 53 is operated to increase or decrease the number of a broadcast channel to be received.

  A numeric button (ten-key) switch 58 on which numbers 0 to 9 are displayed is operated when a displayed number is input. When the operation of the numeric button switch 58 is completed, the enter button switch 57 is operated subsequent to the end of the numeric input. When the channel is switched, the OSD (On Screen Display) is displayed on the CRT 11 of the master unit 1 (or the CRT 31 of the slave unit 2) such as a new channel number for a predetermined time. The display button 56 is operated to turn on / off the OSD display such as the number of the currently selected channel and the current volume.

  The TV / video switching button switch 59 is used to input the master unit 1 (or the slave unit 2) into a built-in tuner 121 in FIG. 10 (or a tuner 141 in FIG. 11 to be described later) or an input terminal 23 in FIG. Alternatively, it is operated when switching to the input from the input terminal 43) of FIG. The TV / DSS switch button switch 60 is operated when the tuner 121 selects a television mode for receiving broadcasts by terrestrial waves or a DSS (Digital Satellite System (trademark of Hughes Communications)) mode for receiving satellite broadcasts. . When the channel is switched by operating the numeric button switch 58, the channel before switching is stored, and the jump button switch 61 is operated when returning to the original channel before switching.

  The language button 62 is operated when a predetermined language is selected when broadcasting is performed in two or more languages. The guide button switch 63 is operated when a channel transmitting EPG (Electronic Program Guide) data is selected and displayed on the CRT 11. The favorite button switch 64 is operated when a user's favorite channel set in advance is selected.

  The cable button switch 65, the television switch 66, and the DSS button switch 67 are button switches for switching the device category of the command code corresponding to the infrared ray emitted from the remote controller 15. That is, the remote controller 15 (same as the remote controller 35) can remotely control STB and IRD (not shown) in addition to the television receiver as the master unit 1 and the slave unit 2, and the cable button switch. 65 is operated when the remote controller 15 controls an STB (Set Top Box) that receives a signal transmitted via the CATV network. After the operation of the cable button switch 65, the remote controller 15 emits infrared rays corresponding to the command code of the device category assigned to the STB. Similarly, the television button switch 66 is operated when the parent device 1 (or the child device 1) is controlled by the remote controller 15. The DSS button switch 67 is operated when an IRD (Integrated Receiver and Decoder) that receives a signal transmitted via a satellite is controlled by the remote controller 15.

  LEDs (Light Emitting Diodes) 68, 69, and 70 are lit when the cable button switch 65, the TV button switch 66, or the DSS button switch 67 is turned on, respectively. The user is shown whether the device is controllable. The LEDs 68, 69, and 70 are turned off when the cable button switch 65, the television button switch 66, or the DSS button switch 67 is turned off, respectively.

  The cable power button switch 71, the television power button switch 72, and the DSS power button switch 73 are operated when turning on / off the STB, the parent device 1 (or the child device 2), or the IRD.

  The muting button switch 74 is operated when setting or canceling the muting state of the parent device 1 (or the child device 2). The sleep button switch 75 is operated when setting or canceling the sleep mode in which the power is automatically turned off when a predetermined time is reached or when a predetermined time has elapsed.

  When the remote controller 15 is operated, the light emitting unit 76 emits infrared rays corresponding to the operation.

  Next, FIG. 8 is a plan view showing a configuration example of the remote controller 35 of the slave unit 2.

  The remote controller 35 includes the select button switch 81 to the light emitting unit 106 configured in the same manner as the select button switch 51 to the light emitting unit 76 in the remote controller 15 of FIG.

  Next, FIG. 9 is a plan view showing another configuration example of the remote controller 15 of the parent device 1.

  In the embodiment of FIG. 9, instead of the select button switch 51 that can be operated in eight directions in FIG. 7, four direction button switches 111, 112, 113, and 114 in the up, down, left, and right directions, and buttons for performing a select operation. A switch 110 is provided. Furthermore, in the embodiment of FIG. 9, the cable button switch 65, the TV button switch 66, and the DSS button switch 67 are internally illuminated, and the LEDs 68 to 70 in FIG. 7 are omitted. However, LEDs (not shown) are arranged on the back side of the button switches 65 to 67. When the button switches 65 to 67 are operated, the LEDs arranged on the back side are respectively corresponding to the operation. Turns on or off.

  The other button switches are basically the same as those shown in FIG. 7 although their arrangement positions are different.

  Note that the remote controller 35 of the slave unit 2 can also be configured in the same manner as in FIG.

  In addition, the remote controller 15 can incorporate a gyro for detecting the movement. In this case, the remote controller 15 detects the moving direction and moving amount of the remote controller 15 with the built-in gyro, and moves the cursor displayed on the menu screen in accordance with the moving direction and moving amount. Is possible. As described above, when the gyro is built in the remote controller 15, in the embodiment shown in FIG. 7, it is not necessary to configure the select button switch 51 so that it can be moved in eight directions. In this embodiment, there is no need to provide the direction button switches 111 to 114. Similarly, it is possible to incorporate a gyro in the remote control 35 as well.

  Next, FIG. 10 shows an example of the electrical configuration of the base unit 1.

  A television broadcast signal received by an antenna (not shown) is supplied to the tuner 121, and is detected and demodulated under the control of the CPU 129. The output of the tuner 121 is supplied to a QPSK (Quadrature Phase Shift Keying) demodulating circuit 122 and QPSK demodulated under the control of the CPU 129. The output of the QPSK demodulating circuit 122 is supplied to the error correction circuit 123, and an error is detected and corrected under the control of the CPU 129 and supplied to the demultiplexer 124.

  Under the control of the CPU 129, the demultiplexer 124 descrambles the output of the error correction circuit 123 as necessary, and further extracts a TS (Transport Stream) packet of a predetermined channel. The demultiplexer 124 supplies the TS packet of the image data (video data) to the MPEG (Moving Picture Experts Group) video decoder 125 and supplies the TS packet of the audio data (audio data) to the MPEG audio decoder 126. To do. Further, the demultiplexer 124 supplies the TS packet included in the output of the error correction circuit 123 to the CPU 129 as necessary. Further, the demultiplexer 124 receives image data or audio data (including those in the form of TS packets) supplied from the CPU 129 and supplies it to the MPEG video decoder 125 or the MPEG audio decoder 126.

  The MPEG video decoder 125 MPEG-decodes the TS packet of the image data supplied from the demultiplexer 124 and supplies it to the selector 127. The MPEG audio decoder 126 MPEG-decodes the TS packet of audio data supplied from the demultiplexer 124. The L channel and R channel audio data obtained by the decoding by the MPEG audio decoder 126 is supplied to the selector 127.

  Under the control of the CPU 129, the selector 127 selects image data output from the MPEG video decoder 125, image data supplied from the CPU 129, or image data supplied from the security system unit 137, and NTSC (National Television System Committee). This is supplied to the encoder 128. The NTSC encoder 128 converts the image data supplied from the selector 127 into NTSC image data, and supplies the image data to the CRT 11 for display. The selector 127 selects audio data of the L and R channels from the MPEG audio decoder 126, audio data supplied from the CPU 129, or audio data supplied from the security system unit 137 under the control of the CPU 129, and an amplifier 138.

  The CPU 129 executes various processes in accordance with programs stored in an EEPROM (Electrically Erasable Programmable Read Only Memory) 130 and a ROM (Read Only Memory) 131, and thereby, for example, a tuner 121, a QPSK demodulation circuit 122, It controls the error correction circuit 123, the demultiplexer 124, the selector 127, the IEEE1394 interface 133, the modem 136, and the security system unit 137. Further, the CPU 129 supplies data supplied from the demultiplexer 124 to the IEEE1394 interface 133, and supplies data supplied from the IEEE1394 interface 133 to the demultiplexer 124 and the selector 127. Further, the CPU 129 executes processing corresponding to commands supplied from the front panel 134 or the IR receiver 135. Further, the CPU 129 controls the modem 136 to access a server (not shown) through a telephone line, and obtains an upgraded program and necessary data.

  The EEPROM 130 stores data and programs that should be retained even after the power is turned off. The ROM 131 stores, for example, an IPL (Initial Program Loader) program. The data and programs stored in the EEPROM 130 can be upgraded by overwriting the data and programs.

  The RAM 132 temporarily stores data and programs necessary for the operation of the CPU 129.

IEEE1394 interface 133, the terminal panel 21 (the IEEE1394 terminal 21 ₁₁ to 21 ₃₃ (FIG. 3)) are connected to, and functions as an interface for performing communication compliant with the IEEE1394 standard. Thereby, the IEEE1394 interface 133 transmits data supplied from the CPU 129 to the outside in conformity with the IEEE1394 standard, while receiving data transmitted from the outside in conformity with the IEEE1394 standard, to the CPU129. Supply.

  Although not shown in FIGS. 2 and 3, front panel 134 is provided on a part of the front surface of base unit 1. And the front panel 134 has a part of button switch provided in the remote control 15 (FIG. 7, FIG. 9), and when the button switch of the front panel 134 is operated, it respond | corresponds to the operation. An operation signal is supplied to the CPU 129. In this case, the CPU 129 performs processing corresponding to the operation signal from the front panel 134.

  The IR receiver 135 receives (receives) infrared rays transmitted from the remote controller 15 in response to the operation of the remote controller 15. Further, the IR receiver 135 photoelectrically converts the received infrared light and supplies a signal obtained as a result to the CPU 129. In this case, the CPU 129 performs processing corresponding to the signal from the IR receiver 135, that is, processing corresponding to the operation of the remote controller 15.

  The modem 136 performs communication control via a telephone line, thereby transmitting data supplied from the CPU 129 via the telephone line and receiving data transmitted via the telephone line. To supply.

  The security system unit 137 includes a security controller 137A, a wireless interface 137B, a data processing unit 137C, and a warning processing unit 137D, and warns the user of the occurrence of an emergency (abnormality) under the control of the CPU 129. Each process to be described later is performed.

  That is, the security controller 137A controls the wireless interface 137B, the data processing unit 137C, and the warning processing unit 137D under the control of the CPU 129.

  The wireless interface 137B functions as an interface for performing wireless communication, receives image (moving image) data and audio data transmitted from a camera 162 (FIG. 23), which will be described later, and sends them to the selector 127 and the data processing unit 137. Supply. Here, as the wireless interface 137B, for example, a network interface card (NIC) that performs communication by so-called wireless LAN defined in IEEE802.11 can be employed.

  As the wireless interface 137B, a device that performs wireless communication according to a standard other than IEEE802.11 can be employed. However, it is desirable that the wireless interface 137B conforms to a standard having a transmission band sufficient for transmitting and receiving moving image data.

  The data processing unit 137C detects the feature amount of the image data or audio data supplied from the wireless interface 137B every predetermined time, and supplies it to the warning processing unit 137D.

  The warning processing unit 137D analyzes temporal variations in the feature amount of the image data or the audio data supplied from the data processing unit 137C. Further, the warning processing unit 137D determines whether or not the temporal variation of the feature amount of the image data or the sound data satisfies a predetermined condition, and based on the determination result, the security controller 137A determines that the user should be warned. To request.

  The amplifier 138 amplifies the audio data supplied from the selector 127 as necessary, and supplies the amplified audio data to the speaker units 12L and 12R. The amplifier 138 has a built-in D / A (Digital / Analog) converter 138, and audio data supplied thereto is D / A converted as necessary and output.

  In the base unit 1 configured as described above, an image and sound as a television broadcast program are output as follows (images are displayed and sound is output).

  That is, a transport stream as a television broadcast signal received by the antenna is supplied to the demultiplexer 124 via the tuner 121, the QPSK demodulation circuit 122, and the error correction circuit 123. The demultiplexer 124 extracts TS packets of a predetermined program from the transport stream, supplies the TS packets of image data to the MPEG video decoder 125, and supplies the TS packets of audio data to the MPEG audio decoder 126. .

  In the MPEG video data coder 125, the TS packet from the demultiplexer 124 is MPEG decoded. The resulting image data is supplied from the MPEG video decoder 125 to the CRT 11 via the selector 127 and NTSC encoder 128 and displayed.

  On the other hand, in the MPEG audio decoder 126, the TS packet from the demultiplexer 124 is MPEG decoded. The resulting audio data is supplied from the MPEG audio decoder 126 to the speaker units 12L and 12R via the selector 127 and the amplifier 138 and output.

  In the base unit 1, the IEEE1394 interface 133 receives TS packets from other devices supplied thereto. Of the TS packets, the TS packet of image data and the TS packet of audio data are supplied to the MPEG video decoder 125 and the MPEG audio decoder 126 via the CPU 129 and the demultiplexer 124, respectively. It is output (displayed) as in the case of image data and audio data of a broadcast signal.

  Further, in the base unit 1, the image data and the audio data supplied thereto are received by the wireless interface 137B of the security system unit 137. The image data received by the wireless interface 137B is supplied to the CRT 11 via the selector 127 and the NTSC encoder 128 and displayed. On the other hand, the audio data received by the wireless interface 137B is supplied to and output from the speaker units 12L and 12R via the selector 127 and the amplifier 138.

  Therefore, in the form of FIG. 10, base unit 1 has three input systems of tuner 121, IEEE1394 interface 133, and wireless interface 137 </ b> B as input systems for inputting image data and audio data. However, although the base unit 1 is not shown in FIG. 10, it has an input terminal 23 as shown in FIG. 3F. Therefore, if the base unit 1 includes this input terminal 23, 4 Has one input system.

  In addition, the number of the input systems provided in the main | base station 1 is not specifically limited.

  Next, FIG. 11 shows an example of the electrical configuration of the slave unit 2.

  The subunit | mobile_unit 2 is comprised from the tuner 141 thru | or amplifier 158 respectively comprised similarly to the tuner 121 thru | or amplifier 138 of FIG. 10, Therefore The description is abbreviate | omitted.

  Note that, as shown in FIGS. 3F and 5F, the master unit 1 and the slave unit 2 have the antenna terminals 22 and 42, respectively, so that they can be used as the television receivers constituting the scalable TV system of FIG. An antenna (cable from) can be connected to each of the master unit 1 and the slave unit 2. However, when an antenna is connected to each of the master unit 1 and the slave unit 2, wiring may be complicated. Therefore, in a scalable TV system, an antenna is connected to any one of the television receivers constituting the scalable TV system, and a television broadcast signal received by the television receiver is converted into, for example, IEEE1394. It is possible to distribute to other television receivers by communication.

Next, in the present embodiment, the IEEE1394 terminal 21 _ij (FIG. 3) of the terminal panel 21 of the base unit 1 and the IEEE1394 terminal 41 ₁ (FIG. 5) of the terminal panel 41 of the handset 2 _ij are connected by an IEEE1394 cable. By being connected, the master unit 1 and the slave unit 2 are electrically connected, so that IEEE1394 communication (communication conforming to the IEEE1394 standard) is performed between the master unit 1 and the slave unit 2. Various data are exchanged.

  Therefore, the IEEE1394 communication will be briefly described with reference to FIGS.

  IEEE1394 is one of the serial bus standards, and IEEE1394 communication is suitable for transferring data that needs to be reproduced in real time, such as images and sounds, because it can perform isochronous transfer of data.

  In other words, isochronous transfer of data between devices having an IEEE1394 interface (IEEE1394 devices) using a transmission bandwidth of 100 μs at maximum with a period of 125 μs (microseconds) (although it is called a bandwidth). It can be performed. In addition, isochronous transfer can be performed with a plurality of channels as long as the transmission bandwidth is within the above-described range.

  FIG. 12 shows the layer structure of the IEEE1394 communication protocol.

  The IEEE1394 protocol has a three-layered structure including a transaction layer, a link layer, and a physical layer. Each layer communicates with each other, and each layer communicates with serial bus management. Furthermore, the transaction layer and the link layer also communicate with higher-order applications. There are four types of transmission / reception messages used for this communication: request, indication (indication), response (response), and confirmation (confirmation), and the arrows in FIG. 12 indicate this communication.

Note that communication with “.req” at the end of the arrow name indicates a request, and “.ind” indicates an instruction. “.Resp” indicates a response, and “.conf” indicates confirmation. For example, TR_CONT.req is a request communication sent from the serial bus management to the transaction layer.

  The transaction layer provides an asynchronous transmission service for data communication with other IEEE1394 devices (devices having an IEEE1394 interface) in response to a request from an application, and a request response protocol (required by ISO / IEC13213) Request Response Protocol) is realized. That is, as a data transfer method based on the IEEE1394 standard, there is asynchronous transmission in addition to the above-described isochronous transmission, and the transaction layer performs asynchronous transmission processing. Data transmitted by asynchronous transmission is made up of IEEE1394 equipment by three types of transactions: read transaction, write transaction, and lock transaction, which are units of processing required for the protocol of the transaction layer. Transmitted between them.

  The link layer performs processing such as data transmission service using acknowledge, address processing, data error confirmation, and data framing. One packet transmission performed by the link layer is called a subaction, and there are two types of subactions, an asynchronous subaction and an isochronous subaction.

  The asynchronous subaction is performed by designating a physical ID (Physical Identification) that identifies a node (a unit that can be accessed in IEEE1394) and an address in the node, and the node that has received the data returns an acknowledge. However, in the asynchronous broadcast subaction that sends data to all nodes in the IEEE1394 serial bus, the node that received the data does not return an acknowledge.

  On the other hand, in the isochronous subaction, data is transmitted by designating a channel number at a constant cycle (125 μs as described above). In the isochronous subaction, the acknowledge is not returned.

  The physical layer converts logical symbols used in the link layer into electrical signals. In addition, the physical layer performs processing for arbitration requests from the link layer (arbitration when a node that performs IEEE1394 communication competes), or reconfigures the IEEE1394 serial bus in response to a bus reset. Or perform automatic assignment.

  Serious bus management provides basic bus control functions and ISO / IEC13212 CSR (Control & Status Register Architecture). The serial bus management has functions of a node controller, an isochronous resource manager, and a bus manager. The node controller controls the node state, physical ID, and the like, and also controls the transaction layer, link layer, and physical layer. The isochronous resource manager provides the usage status of resources used for isochronous communication. In order to perform isochronous communication, at least one of the devices connected to the IEEE1394 serial bus has the function of the isochronous resource manager. IEEE1394 equipment is required. The bus manager has the highest function among the functions, and aims to optimize the use of the IEEE1394 serial bus. Note that the presence of the isochronous resource manager and the bus manager is arbitrary.

  IEEE 1394 devices can be connected in either node branch or node daisy chain, but when an IEEE 1394 device is newly connected, a bus reset is performed, and tree identification, root node, physical ID, isochronous resource manager The cycle master and bus manager are determined.

  Here, in the tree identification, a parent-child relationship between nodes as an IEEE1394 device is determined. In addition, the root node designates a node that has acquired the right to use the IEEE1394 serial bus by arbitration. The physical ID is determined by transferring a packet called a self-ID packet to each node. The self-ID packet includes information such as the data transfer rate of the node and whether the node can become an isochronous resource manager.

  As described above, the isochronous resource manager is a node that provides a usage status of resources used for isochronous communication, and has a bandwidth register (BANDWIDTH_AVAILABLE register) and a channel number register (CHANNELS_AVAILABLE register) described later. Further, the isochronous resource manager also has a register indicating a physical ID of a node that becomes a bus manager. Note that if there is no bus manager in a node as an IEEE1394 device connected by an IEEE1394 serial bus, the isochronous resource manager functions as a simple bus manager.

  The cycle master transmits a cycle start packet on the IEEE1394 serial bus every 125 μs that is the period of isochronous transmission. For this reason, the cycle master has a cycle time register (CYCLE_TIME register) for counting the period (125 μs). Note that the root node becomes a cycle master, but if the root node does not have a function as a cycle master, the bus manager changes the root node.

  The bus manager manages power on the IEEE1394 serial bus, changes the root node described above, and the like.

  If the determination of the isochronous resource manager or the like as described above is performed after the bus reset, data transmission via the IEEE1394 serial bus is possible.

  In isochronous transmission, which is one of the IEEE1394 data transmission systems, a transmission band and a transmission channel are secured, and then a packet (isochronous packet) in which data is arranged is transmitted.

  That is, in isochronous transmission, the cycle master broadcasts a cycle start packet on the IEEE1394 serial bus at a period of 125 μs. When the cycle start packet is broadcast, an isochronous packet can be transmitted.

  In order to perform isochronous transmission, it is necessary to declare the reservation of resources for isochronous transmission by rewriting the bandwidth register for securing the transmission band provided by the isochronous resource manager and the channel number register for securing the channel.

  Here, the bandwidth register and the channel number register are allocated as one of CSRs (Control & Status Registers) described later having a 64-bit address space defined by ISO / IEC13213.

  The bandwidth register is a 32-bit register, the upper 19 bits are reserved, and the lower 13 bits represent a transmission band (bw_remaining) that can be used at present.

  That is, the initial value of the bandwidth register is 00000000000000000001001100110011B (B indicates that the previous value is a binary number) (= 4915). This is due to the following reason. That is, in IEEE1394, the time required for transmission of 32 bits at 1572.864 Mbps (bit per second) is defined as 1, and the above 125 μs corresponds to 00000000000000000001100000000000B (= 6144). However, IEEE 1394 specifies that the transmission band that can be used for isochronous transmission is 80% of 125 μs, which is one cycle. Therefore, the maximum transmission band that can be used for isochronous transmission is 100 μs, and 100 μs is 00000000000000000001001100110011B (= 4915) as described above.

  The remaining 25 μs transmission band, which is the maximum transmission band used in isochronous transmission from 125 μs except for 100 μs, is used in asynchronous transmission. Asynchronous transmission is used when reading the stored value of the bandwidth register or channel number register.

  In order to start isochronous transmission, it is necessary to secure a transmission band for that purpose. That is, for example, when isochronous transmission is performed using a transmission band of 10 μs out of one cycle of 125 μs, it is necessary to secure the transmission band of 10 μs. This transmission band is secured by rewriting the value of the bandwidth register. That is, as described above, when a transmission band of 10 μs is secured, 492, which is a value corresponding to 10 μs, is subtracted from the value of the bandwidth register, and the subtraction value is set in the bandwidth register. Therefore, for example, when the value of the bandwidth register is now 4915 (when isochronous transmission is not performed at all), when a transmission bandwidth of 10 μs is secured, the value of the bandwidth register is 4915 (= 00000000000000000001000101000111B) is rewritten from 4915 by subtracting 492 corresponding to 10 μs from 4915.

  If the value obtained by subtracting the transmission band to be secured (used) from the value of the bandwidth register is smaller than 0, the transmission band cannot be secured, and therefore the value of the bandwidth register is rewritten. In addition, isochronous transmission cannot be performed.

  In order to perform isochronous transmission, it is necessary to secure a transmission channel in addition to securing the transmission band as described above. The transmission channel is secured by rewriting the channel number register.

  The channel number register is a 64-bit register, and each bit corresponds to each channel. That is, when the value of the nth bit (the nth bit from the least significant bit) is 1, this indicates that the n−1th channel is not in use, and when it is 0, the n−th bit. Indicates that one channel is in use. Therefore, when no channel is used, the channel number register is 1111111111111111111111111111111111111111111111111111111111111111B. For example, when the first channel is secured, the channel number register is rewritten to 1111111111111111111111111111111111111111111111111111111111111101B.

  Since the channel number register is 64 bits as described above, it is possible to secure 64 channels from the 0th to the 63rd channels at the maximum by isochronous transmission, but the 63rd channel broadcasts isochronous packets. Used when

  As described above, since isochronous transmission is performed after securing the transmission band and transmission channel, it is possible to perform data transmission with a guaranteed transmission rate, and as described above, playback in real time such as images and audio is possible. It is particularly suitable for data transmission that needs to be done.

  Next, the IEEE1394 communication conforms to the CSR architecture having a 64-bit address space defined by ISO / IEC13213 as described above.

  FIG. 13 shows the address space of the CSR architecture.

  The upper 16 bits of the CSR are a node ID indicating each node, and the remaining 48 bits are used for designating an address space given to each node. The upper 16 bits are further divided into 10 bits of bus ID and 6 bits of physical ID (node ID in a narrow sense). Since a value in which all bits are 1 is used for a special purpose, 1023 buses and 63 nodes can be designated.

  Of the 256 terabyte address space defined by the lower 48 bits of CSR, the space defined by the upper 20 bits is an initial register space (Initial space used for 2048-byte CSR-specific registers and IEEE1394-specific registers). Register space), private space (private space), initial memory space (initial memory space), etc., and the space defined by the lower 28 bits is the space defined by the upper 20 bits is the initial register space In some cases, it is used as a configuration ROM (Configuration ROM), an initial unit space (Initial Unit Space) used for a node-specific purpose, a plug control register (PCRs), or the like.

  Here, FIG. 14 shows offset addresses, names, and functions of main CSRs.

  In FIG. 14, an “offset” column indicates an offset address from the address FFFFF0000000h (h indicates that the previous value is a hexadecimal number) where the initial register space starts. As described above, the bandwidth register having the offset 220h indicates a band that can be allocated to isochronous communication, and only the value of the node operating as the isochronous resource manager is valid. That is, each node has the CSR in FIG. 13, but only the bandwidth register of the isochronous resource manager is valid. Thus, the bandwidth register is essentially only an isochronous resource manager.

  As described above, in the channel number register of offsets 224h to 228h, each bit corresponds to each of channel numbers 0 to 63, and when the bit is 0, the channel is already assigned. Is shown. The channel number register is valid only for the node operating as an isochronous resource manager.

  Returning to FIG. 13, a configuration ROM based on the general ROM format is arranged at addresses 400h to 800h in the initial register space.

  Here, FIG. 15 shows a general ROM format.

  A node that is a unit of access on IEEE1394 can have a plurality of units that operate independently while using an address space in common. The unit directories can indicate the software version and location for this unit. The positions of the bus info block and the root directory are fixed, but the positions of other blocks are specified by offset addresses.

  Here, FIG. 16 shows details of the bus info block, the root directory, and the unit directory.

  The Company ID in the bus info block stores an ID number indicating the manufacturer of the device. The Chip ID stores a unique ID unique to the device in the world that does not overlap with other devices. Also, according to the IEC1833 standard, 00h is written in the first octet, A0h is written in the second octet, and 2Dh is written in the third octet of the unit spec ID (unit spec id) of the unit directory of the equipment that satisfies IEC1883. . Further, 01h is written in the first octet of the unit switch version (unit sw version), and 1 is written in the LSB (Least Significant Bit) of the third octet.

  The node has a PCR (Plug Control Register) defined in IEC1883 at addresses 900h to 9FFh in the initial register space of FIG. This materializes the concept of a plug in order to logically form a signal path similar to an analog interface.

  Here, FIG. 17 shows the structure of PCR.

  The PCR has an oPCR (output Plug Control Register) representing an output plug and an iPCR (input Plug Control Register) representing an input plug. The PCR also has registers oMPR (output Master Plug Register) and iMPR (input Master Plug Register) indicating information of output plugs or input plugs specific to each device. An IEEE1394 device does not have a plurality of oMPRs and iMPRs, but can have a plurality of oPCRs and iPCRs corresponding to individual plugs depending on the capabilities of the IEEE1394 devices. The PCR shown in FIG. 17 has 31 oPCR # 0 to # 30 and iPCR # 0 to # 30, respectively. The flow of isochronous data is controlled by manipulating the registers corresponding to these plugs.

  FIG. 18 shows the configuration of oMPR, oPCR, iMPR, and iPCR.

  18A shows the oMPR configuration, FIG. 18B shows the oPCR configuration, FIG. 18C shows the iMPR configuration, and FIG. 18D shows the iPCR configuration.

  The 2-bit data rate capability on the MSB side of oMPR and iMPR stores a code indicating the maximum transmission rate of isochronous data that can be transmitted or received by the device. The oMPR broadcast channel base specifies the number of the channel used for broadcast output.

  The 5-bit number of output plugs on the LSB side of the oMPR stores a value indicating the number of output plugs that the device has, that is, the number of oPCRs. The 5-bit number of input plugs on the LSB side of iMPR stores a value indicating the number of input plugs that the device has, that is, the number of iPCRs. The non-persistent extension field and the persistent extension field are areas defined for future extension.

  The on-line of the oPCR and iPCR MSB indicates the usage status of the plug. That is, if the value is 1, the plug is ON-LINE, and if it is 0, it indicates OFF-LINE. The value of the broadcast connection counter of oPCR and iPCR represents the presence (1) or absence (0) of a broadcast connection. The value of a point-to-point connection counter having a 6-bit width of oPCR and iPCR represents the number of point-to-point connections that the plug has.

  The value of the channel number having a 6-bit width of oPCR and iPCR indicates the number of an isochronous channel to which the plug is connected. The value of the data rate having a 2-bit width of the oPCR indicates the actual transmission rate of the isochronous data packet output from the plug. A code stored in an overhead ID having a 4-bit width of oPCR indicates an over bandwidth of isochronous communication. The value of payload having a 10-bit width of oPCR represents the maximum value of data included in an isochronous packet that can be handled by the plug.

  Next, an AV / C command set is defined as a command for controlling the IEEE1394 equipment that performs the IEEE1394 communication as described above. Therefore, also in the present embodiment, the master unit 1 and the slave unit 2 can control each other using this AV / C command set. However, when controlling the master unit 1 or the slave unit 2, a unique command system other than the AV / C command set can be used.

  Here, the AV / C command set will be briefly described.

  FIG. 19 shows the data structure of an AV / C command set packet transmitted in the asynchronous transfer mode.

  The AV / C command set is a command set for controlling an AV (Audio Visual) device. In a control system using the AV / C command set, an AV / C command frame and a response frame are FCP ( They are exchanged using Function Control Protocol. In order not to put a burden on the bus and AV equipment, the response to the command is performed within 100 ms.

  As shown in FIG. 19, the data of the asynchronous packet is composed of 32 bits (= 1 quadlet) in the horizontal direction. The upper part of the figure shows a packet header, and the lower part of the figure shows a data block. destination_ID indicates the destination.

  CTS indicates the ID of the command set. In the AV / C command set, CTS = “0000”. ctype / response indicates the function classification of the command when the packet is a command, and indicates the processing result of the command when the packet is a response. Commands can be broadly classified as follows: (1) Command to control functions from the outside (CONTROL), (2) Command to inquire about the status from outside (STATUS), and (3) Command to inquire from the outside about support of control commands (GENERAL INQUIRY (4) (4) A command (NOTIFY) requesting to notify the outside of a change in state is defined. (OPCODE support / non-support) and SPECIFIC INQUIRY (OPCODE / operands support / not supported))

  Responses are returned according to the type of command. Responses to the CONTROL command include NOT INPLEMENTED (not implemented), ACCEPTED, REJECTED, and INTERIM. Responses to the STATUS command include NOT INPLEMENTED, REJECTED, IN TRANSITION (transition), and STABLE (stable). Responses to GENERAL INQUIRY and SPECIFIC INQUIRY commands include IMPLEMENTED (implemented) and NOT IMPLEMENTED. Responses to NOTIFY commands include NOT IMPLEMENTED, REJECTED, INTERIM, and CHANGED.

  The subunit type is provided to specify the function in the device, and for example, tape recorder / player, tuner, etc. are assigned. In order to determine when there are a plurality of subunits of the same type, addressing is performed with a subunit id (arranged after the subunit type) as a discrimination number. The opcode represents a command, and the operand represents a command parameter. Additional operands is a field in which additional operands are arranged. Padding is a field in which dummy data is arranged to set the packet length to a predetermined number of bits. A data CRC (Cyclic Redundancy Check) is a CRC used for an error check during data transmission.

  Next, FIG. 20 shows a specific example of the AV / C command.

  FIG. 20A shows a specific example of ctype / response. The upper part of the figure represents a command, and the lower part of the figure represents a response. “0000” is assigned CONTROL, “0001” is assigned STATUS, “0010” is assigned SPECIFIC INQUIRY, “0011” is assigned NOTIFY, and “0100” is assigned GENERAL INQUIRY. “0101 to 0111” are reserved for future specifications. “1000” is NOT INPLEMENTED, “1001” is ACCEPTED, “1010” is REJECTED, “1011” is IN TRANSITION, “1100” is IMPLEMENTED / STABLE, “1101” is CHNGED, “1111” ”Is assigned INTERIM. “1110” is reserved for future specifications.

  FIG. 20B shows a specific example of the subunit type. “00000” is a Video Monitor, “00011” is a Disk recorder / Player, “00100” is a Tape recorder / Player, “00101” is a Tuner, “00111” is a Video Camera, “11100” is a Vendor unique. “11110” is assigned subunit type extended to next byte. Note that “11111” is assigned a unit, but this is used when it is sent to the device itself, for example, turning on / off the power.

  FIG. 20C shows a specific example of opcode. There is an opcode table for each subunit type. Here, the opcode is shown when the subunit type is Tape recorder / Player. An operand is defined for each opcode. Here, “00h” is VENDOR-DEPENDENT, “50h” is SEACH MODE, “51h” is TIMECODE, “52h” is ATN, “60h” is OPEN MIC, “61h” is READ MIC, "62h" is assigned WRITE MIC, "C1h" is assigned LOAD MEDIUM, "C2h" is assigned RECORD, "C3h" is assigned PLAY, and "C4h" is assigned WIND.

  FIG. 21 shows specific examples of AV / C commands and responses.

  For example, when a playback instruction is given to a playback device as a target (consumer) (controlled side), the controller (controlling side) sends a command as shown in FIG. 21A to the target. Since this command uses the AV / C command set, CTS = “0000”. The ctype is “0000” because a command (CONTROL) for controlling the device from the outside is used (FIG. 20A). The subunit type is “00100” because it is a tape recorder / player (FIG. 20B). id indicates the case of ID # 0 and is 000. The opcode is “C3h” meaning reproduction (FIG. 20C). The operand is “75h” meaning FORWARD. Then, when played back, the target returns a response as shown in FIG. 21B to the controller. Here, accepted, which means acceptance, is arranged in response, and response is “1001” (see FIG. 20A). Except for response, the rest is the same as FIG.

  In the scalable TV system, various controls are performed between the parent device 1 and the child device 2 using the AV / C command set as described above. However, in the present embodiment, new commands and responses are defined for those controls that can not be dealt with by the default command and response among the controls performed between the master unit 1 and the slave unit 2. Various controls are performed using simple commands and responses.

  The details of the above IEEE1394 communication and AV / C command set are described in “WHITE SERISE No.181 IEEE1394 Multimedia Interface” published by Trikes Co., Ltd.

  Next, FIG. 22 shows a configuration example of a security system using the scalable TV system of FIG.

In the embodiment of FIG. 22, the security system includes a scalable TV system 161 composed of a plurality of television receivers, and three cameras (video cameras) 162 ₁ , 162 ₂ , and 162 ₃ .

  The scalable TV system 161 is configured similarly to the scalable TV system of FIG. 1A, for example.

Each of the cameras 162 _{1 to} 162 ₃ is, for example, a digital video camera. The camera 162 _{1 to} 162 ₃ captures images and collects sound. The image data and sound data obtained as a result are wirelessly set in a predetermined manner that configures the scalable TV system 161. To the TV receiver.

Note that the security system in the embodiment of FIG. 22 is configured by providing _three cameras 162 _{1 to} 162 ₃ , but the number of cameras constituting the security system is not limited to three. The security system can be provided with one or more arbitrary number of cameras.

  In the security system, the maximum number of television receivers that can receive image data and audio data from the camera 162 is equal to the maximum number of television receivers that constitute the scalable TV system 161. Therefore, in the security system, when the number of cameras 162 exceeding the number of television receivers constituting the scalable TV system 161 is installed, the image data from the cameras 162 exceeding the number of the television receivers is installed. The audio data cannot be received by the scalable TV system 161. However, in each television receiver of the scalable TV system 161, it is possible to switch the camera that receives image data and audio data.

Here, the cameras 162 _{1 to} 162 ₃ will be referred to as cameras 162 unless otherwise specifically required.

  Next, FIG. 23 shows a configuration example of the camera 162 of FIG.

  Light from the subject enters an optical system 171 including a lens, a mechanism for adjusting a focus, a mechanism for adjusting a diaphragm, and the like, and is collected on a light receiving surface of a CCD (Charge Coupled Device) 172. The CCD 172 photoelectrically converts the light from the optical system 171 and supplies it to the amplifier 173 as image data as an electrical signal. The amplifier 173 amplifies the image data from the CCD 172 and supplies it to an A / D (Analog / Digital) conversion unit 174. The A / D conversion unit 174 converts the image data as an analog signal supplied from the amplifier 173 into image data as a digital signal by sampling and quantizing (A / D conversion), and the memory 175 A memory 175 for supplying image data temporarily stores image data from the A / D conversion unit 174.

  On the other hand, in the microphone 176, sound as ambient air vibration is converted into sound data as an electric signal and supplied to the amplifier 177. The amplifier 177 amplifies the audio data from the microphone 176 and supplies it to the A / D converter 178. The A / D conversion unit 178 converts the audio data as an analog signal from the amplifier 177 into A / D conversion, and supplies it to the memory 179 as digital audio data. The memory 179 temporarily stores the audio data from the A / D conversion unit 178.

  The wireless interface 180 is the same interface as the wireless interface 137B described with reference to FIG. 10, and image data and audio data stored in the memories 175 and 179, respectively, are wirelessly received by a predetermined television receiver constituting the scalable TV system 161. To the machine.

For wireless communication between the wireless interfaces 137B and 180, for example, TCP / IP (Transmission Control Protocol / Internet Protocol) can be employed. In this case, each of the cameras 162 _{1 to} 162 ₃ can designate the television receiver that constitutes the scalable TV system 161 to transmit image data and audio data by the IP address.

  The camera 162 can be a portable camera. In this case, the user can easily install the camera 162 so that a desired place can be photographed.

  Further, the camera 162 can encode and transmit image data and audio data by MPEG or other methods.

  Next, with reference to the flowchart of FIG. 24, the process of the main | base station 1 (FIG. 10) as a television receiver which comprises the scalable TV system 161 of FIG. 22 is demonstrated.

  First, in step S41, the CPU 129 determines whether any device has been connected to the terminal panel 21 or an event has occurred in which some command has been supplied from the IEEE1394 interface 133 or the IR receiver 135. If it is determined that no event has occurred, the process returns to step S41.

  If it is determined in step S41 that an event has occurred in which a device is connected to the terminal panel 21, the process proceeds to step S42, and the CPU 129 performs an authentication process shown in FIG. 25 described later, and returns to step S41.

  Here, in order to determine whether or not a device is connected to the terminal panel 21, it is necessary to detect that a device is connected to the terminal panel 21. This detection is performed, for example, as follows. .

That is, when a device is connected (via an IEEE1394 cable) to the IEEE1394 terminal 21 _ij provided on the terminal panel 21 (FIG. 3), the terminal voltage of the IEEE1394 terminal 21 _ij changes. The IEEE1394 interface 133 reports the change in the terminal voltage to the CPU 129. The CPU 129 receives a report on the change in the terminal voltage from the IEEE1394 interface 133, so that a new device is connected to the terminal panel 21. It is detected that Note that the CPU 129 recognizes that the device has been disconnected from the terminal panel 21 by the same method, for example.

  On the other hand, if it is determined in step S41 that an event has occurred in which any command is supplied from the IEEE1394 interface 133 or the IR receiver 135, the process proceeds to step S43, and the base unit 1 performs processing corresponding to the command. Return to step S41.

  Next, with reference to the flowchart of FIG. 25, the authentication process which the main | base station 1 performs by step S42 of FIG. 24 is demonstrated.

  In the authentication process of the base unit 1, authentication as to whether or not a device newly connected to the terminal panel 21 (hereinafter referred to as a connected device as appropriate) is a valid IEEE 1394 device, and the IEEE 1394 device is Two types of authentication are performed as to whether or not the television receiver (scalable compatible device) is a child device.

  That is, in the authentication process of the base unit 1, first, in step S51, the CPU 129 controls the IEEE1394 interface 133 to transmit an authentication request command for requesting mutual authentication to the connected device. The process proceeds to step S52.

  In step S52, the CPU 129 determines whether a response corresponding to the authentication request command is returned from the connected device. If it is determined in step S52 that the response corresponding to the authentication request command has not been returned from the connected device, the process proceeds to step S53, and the CPU 129 transmits an authentication request command to determine whether the time is over. It is determined whether or not a predetermined time has passed.

  If it is determined in step S53 that the time is over, that is, a response corresponding to the authentication request command is transmitted from the connected device even if a predetermined time has elapsed since the authentication request command was transmitted to the connected device. If the message does not return, the process proceeds to step S54, and the CPU 129 does not exchange any data with the connected device, assuming that the connected device is not a valid IEEE1394 device and authentication has failed. Set to single mode, which is the mode, and return.

  Accordingly, the base unit 1 thereafter does not exchange any data with the connected device that is not a legitimate IEEE 1394 device as well as the IEEE 1394 communication.

  On the other hand, if it is determined in step S53 that the time is not over, the process returns to step S52, and thereafter the same processing is repeated.

  If it is determined in step S52 that a response corresponding to the authentication request command is returned from the connected device, that is, if a response from the connected device is received by the IEEE1394 interface 133 and supplied to the CPU 129, step In step S55, the CPU 129 generates a random number (pseudorandom number) R1 according to a predetermined algorithm, and transmits the random number (pseudorandom number) R1 to the connected device via the IEEE1394 interface 133.

  Thereafter, the process proceeds to step S56, and the CPU 129 converts the random number R1 from the random number R1 transmitted in step S55 to a predetermined encryption algorithm (for example, DES (Data Encryption Standard), FEAL (Fast data Encipherment Algorithm), It is determined whether or not an encrypted random number E ′ (R1) encrypted by a secret key encryption method such as RC5 has been transmitted from the connected device.

  If it is determined in step S56 that the encrypted random number E ′ (R1) has not been transmitted from the connected device, the process proceeds to step S57, in which the CPU 129 transmits the random number R1. It is determined whether or not a predetermined time has passed.

  If it is determined in step S57 that the time is over, that is, the random number R1 is transmitted from the connected device to the encrypted random number E ′ (R1) even if a predetermined time elapses after being transmitted to the connected device. Is not transmitted, the process proceeds to step S54, and as described above, the CPU 129 sets the operation mode to the single mode and returns, assuming that the connected device is not a valid IEEE1394 device.

  On the other hand, if it is determined in step S57 that the time is not over, the process returns to step S56, and thereafter the same processing is repeated.

  If it is determined in step S56 that the encrypted random number E ′ (R1) has been transmitted from the connected device, that is, the encrypted random number E ′ (R1) from the connected device is received by the IEEE1394 interface 133, When supplied to the CPU 129, the process proceeds to step S58, where the CPU 129 encrypts the random number R1 generated in step S55 with a predetermined encryption algorithm to generate an encrypted random number E (R1), and then proceeds to step S59.

  In step S59, the CPU 129 determines whether or not the encrypted random number E ′ (R1) transmitted from the connected device is equal to the encrypted random number E (R1) generated by itself in step S58.

  If it is determined in step S59 that the encrypted random numbers E ′ (R1) and E (R1) are not equal, that is, the encryption algorithm employed in the connected device (used for encryption if necessary). (Including the secret key) is different from the encryption algorithm employed by the CPU 129, the process proceeds to step S54, and the CPU 129 sets the operation mode as a single unit, assuming that the connected device is not a valid IEEE 1394 device as described above. Set to mode and return.

  If it is determined in step S59 that the encrypted random numbers E ′ (R1) and E (R1) are equal, that is, the encryption algorithm employed by the connected device is the encryption employed by the CPU 129. When it is equal to the algorithm, the process proceeds to step S60, and the CPU 129 determines whether or not a random number R2 for the connection device to authenticate the parent device 1 has been transmitted from the connection device.

  If it is determined in step S60 that the random number R2 has not been transmitted, the process proceeds to step S61, and the CPU 129 determines whether or not the time is over, that is, for example, the encrypted random number E ′ (R1) and E in step S59. It is determined whether or not a predetermined time has elapsed since it was determined that (R1) is equal.

  If it is determined in step S61 that the time is over, that is, if the random number R2 is not transmitted from the connected device even if a considerable time has elapsed, the process proceeds to step S54, and the CPU 129 is as described above. If the connected device is not a valid IEEE1394 device, the operation mode is set to the single mode and the process returns.

  On the other hand, if it is determined in step S61 that the time is not over, the process returns to step S60, and thereafter the same processing is repeated.

  If it is determined in step S60 that the random number R2 has been transmitted from the connected device, that is, if the random number R2 from the connected device is received by the IEEE1394 interface 133 and supplied to the CPU 129, the process proceeds to step S62. The CPU 129 encrypts the random number R2 with a predetermined encryption algorithm, generates an encrypted random number E (R1), and transmits it to the connected device via the IEEE1394 interface 133.

  Here, at step S60, when the random number R2 is transmitted from the connected device, authentication that the connected device is a valid IEEE1394 device is successful.

  Thereafter, the process proceeds to step S63, and the CPU 129 controls the IEEE1394 interface 133 to transmit the device ID and the function information of itself together with the function information request command for requesting the device ID and the function information of the connected device to the connected device. .

  Here, the device ID is a unique ID that identifies the television receiver that becomes the parent device 1 or the child device 2.

  The function information is information related to its own function. For example, the type of command received from the outside (for example, any of commands for controlling power on / off, volume adjustment, channel, brightness, sharpness, etc. from the outside). Information such as whether or not tube display (OSD display) is possible, whether or not a mute state can be entered, and whether or not a sleep mode can be entered. Further, the function information includes information indicating whether the device itself has a function as a parent device or a function as a child device.

  In the base unit 1, the device ID and the function information can be stored in, for example, the EEPROM 130 or the vendor_dependent_information of the configuration ROM shown in FIG.

  Thereafter, the process proceeds to step S64, and the CPU 129 waits for the connected device to transmit the device ID and the function information in response to the function information request command transmitted to the connected device in step S63. And the function information are received via the IEEE1394 interface 133, stored in the EEPROM 130, and the process proceeds to step S65.

  In step S65, the CPU 129 determines whether the connected device is a slave device by referring to the function information stored in the EEPROM 130. If it is determined in step S65 that the connected device is a slave device, that is, if the authentication that the connected device is a slave device is successful, steps S66 and S67 are skipped, and the process proceeds to step S68. Then, the operation mode is set to a full screen display enable mode enabling full screen display, and the process returns.

  On the other hand, if it is determined in step S65 that the connected device is not a child device, the process proceeds to step S66, and the CPU 129 determines whether the connected device is a parent device by referring to the function information stored in the EEPROM 130. To do. If it is determined in step S66 that the connected device is the parent device, that is, if the authentication that the connected device is the parent device is successful, the process proceeds to step S67, and the CPU 129 determines whether the connected device is the parent device. A parent-child adjustment process is performed between them.

  In other words, in this case, since another parent device is connected to the parent device 1, there are two television receivers that function as the parent device in the scalable TV system. Become. In the present embodiment, it is necessary for the scalable TV system to have only one master unit. For this reason, in step S67, between the master unit 1 and the master unit as the connected device, which is the master unit. A parent-child adjustment process for determining whether to function as a television receiver is performed.

  More specifically, for example, the parent device that has constituted the scalable TV system earlier, that is, in the present embodiment, the parent device 1 is determined to function as a television receiver as the parent device. Is done. Note that the other parent device that has not been determined to function as the parent device functions as the child device.

  After the parent-child adjustment process is performed in step S67, the process proceeds to step S68, and as described above, the CPU 129 sets the operation mode to the full screen displayable mode and returns.

  On the other hand, when it is determined in step S66 that the connected device is not the parent device, that is, the connected device is neither the parent device nor the child device, and therefore, the authentication that the connected device is the parent device or the child device has failed. If YES in step S69, the CPU 129 can exchange the default AV / C command set with the connected device in the operation mode, but cannot exchange control commands for performing full-screen display. Set to normal function command reception / provision mode and return.

  That is, in this case, since the connected device is neither a parent device nor a child device, even if such a connected device is connected to the parent device 1, the full screen display function is not provided. However, in this case, since the connected device is a legitimate IEEE 1394 device, the exchange of a predetermined AV / C command set between the parent device 1 and the connected device is permitted. Therefore, in this case, the parent device 1 and the connected device can be controlled from the other (or another IEEE1394 device connected to the parent device 1) using a predetermined AV / C command set.

  Next, with reference to the flowchart of FIG. 26, the process of the subunit | mobile_unit 2 (FIG. 11) as a television receiver which comprises the scalable TV system of FIG. 22 is demonstrated.

  First, in step S71, the CPU 149 determines whether any device is connected to the terminal panel 41, or whether an event that some command is supplied from the IEEE1394 interface 153 or the IR receiver 155 has occurred. If it is determined that no event has occurred, the process returns to step S71.

  If it is determined in step S71 that an event for connecting a device to the terminal panel 41 has occurred, the process proceeds to step S72, and the CPU 149 performs an authentication process of FIG. 27 described later, and returns to step S71.

  Here, in order to determine whether or not a device is connected to the terminal panel 41, it is necessary to detect that a device is connected to the terminal panel 41. This detection is described in, for example, step S41 in FIG. This is done in the same way as

  On the other hand, if it is determined in step S71 that an event has occurred in which any command is supplied from the IEEE1394 interface 153 or the IR receiver 155, the process proceeds to step S73, and the slave unit 2 performs processing corresponding to the command. Return to step S71.

  Next, with reference to the flowchart of FIG. 27, the authentication process which the subunit | mobile_unit 2 performs by step S72 of FIG. 26 is demonstrated.

  In the authentication process of the slave unit 2, authentication as to whether or not the device (connection device) newly connected to the terminal panel 41 is a valid IEEE 1394 device, and whether or not the IEEE 1394 device is a master unit. Two types of authentication are performed.

  That is, in the authentication process of the slave unit 2, first, in step S81, the CPU 149 determines whether or not an authentication request command for requesting mutual authentication is transmitted from the connected device. If it is determined that there is not, the process proceeds to step S82.

  In step S82, the CPU 149 determines whether the time is over, that is, whether a predetermined time has elapsed since the start of the authentication process.

  If it is determined in step S82 that the time is over, that is, if an authentication request command is not transmitted from the connected device even after a predetermined time has elapsed since the start of the authentication process, the process proceeds to step S83. The CPU 149 sets the operation mode to a single mode that is a mode in which no data is exchanged with the connected device, assuming that the connected device is not a valid IEEE1394 device and authentication has failed. To return.

  Therefore, as with the base unit 1, the handset 2 does not exchange any data with the connection device that is not a legitimate IEEE 1394 device as well as the IEEE1394 communication.

  On the other hand, if it is determined in step S82 that the time is not over, the process returns to step S81, and thereafter the same processing is repeated.

  If it is determined in step S81 that the authentication request command has been transmitted from the connected device, that is, the authentication request command transmitted from the parent device 1 as the connected device in step S51 in FIG. If it is received at 153 and supplied to the CPU 149, the process proceeds to step S84, where the CPU 149 controls the IEEE1394 interface 153 to transmit a response to the authentication request command to the connected device.

  Here, in the present embodiment, the processing in steps S51 to S53 in FIG. 25 is performed in the master unit 1, and the processing in steps S81, S82, and S84 in FIG. The processing in steps S51 to S53 in FIG. 25 can be performed by the slave unit 2, and the processing in steps S81, S82, and S84 in FIG.

  Thereafter, the process proceeds to step S85, and the CPU 149 determines whether or not the random number R1 has been transmitted from the connected device. If it is determined that the random number R1 has not been transmitted, the CPU 149 proceeds to step S86.

  In step S86, the CPU 149 determines whether the time is over, that is, whether a predetermined time has elapsed since the response to the authentication request command was transmitted in step S84.

  If it is determined in step S86 that the time is over, that is, if the random number R1 is not transmitted from the connected device even after a predetermined time has elapsed since the response to the authentication command was transmitted, step S83 is performed. Then, as described above, the CPU 149 sets the operation mode to the single mode, which is a mode in which no data is exchanged with the connected device, assuming that the connected device is not a valid IEEE1394 device. To return.

  On the other hand, if it is determined in step S86 that the time is not over, the process returns to step S85, and thereafter the same processing is repeated.

  If it is determined in step S85 that the random number R1 has been transmitted from the connected device, that is, the random number R1 transmitted from the parent device 1 as the connected device in step S55 in FIG. 25 is received by the IEEE1394 interface 153. If it is supplied to the CPU 149, the process proceeds to step S87, where the CPU 149 encrypts the random number R1 with a predetermined encryption algorithm to generate an encrypted random number E ′ (R1). Furthermore, in step S87, the CPU 149 controls the IEEE1394 interface 153 to transmit the encrypted random number E ′ (R1) to the connected device, and proceeds to step S89.

  In step S89, the CPU 149 generates a random number (pseudo-random number) R2, controls the IEEE1394 interface 153 to transmit the random number R2 to the connected device, and proceeds to step S90.

  In step S90, the CPU 149 determines whether or not the encrypted random number E (R2) obtained by encrypting the random number R2 generated by the parent device 1 as the connected device in step S62 in FIG. 25 is transmitted from the connected device. .

  If it is determined in step S90 that the encrypted random number E (R2) has not been transmitted from the connected device, the process proceeds to step S91, and the CPU 149 determines whether the time has expired, that is, after transmitting the random number R2. It is determined whether a predetermined time has elapsed.

  If it is determined in step S91 that the time is over, that is, even if a predetermined time has elapsed after the random number R2 is transmitted to the connected device, the encrypted random number E (R2) is received from the connected device. If it has not been transmitted, the process proceeds to step S83, and the CPU 149 sets the operation mode to the single mode and returns, as described above, assuming that the connected device is not a valid IEEE1394 device.

  On the other hand, if it is determined in step S91 that the time is not over, the process returns to step S90, and thereafter the same processing is repeated.

  If it is determined in step S90 that the encrypted random number E (R2) has been transmitted from the connected device, that is, the encrypted random number E (R2) from the connected device is received by the IEEE1394 interface 153 and is sent to the CPU 149. If supplied, the process proceeds to step S92, and the CPU 149 encrypts the random number R2 generated in step S89 with a predetermined encryption algorithm, generates an encrypted random number E ′ (R2), and then proceeds to step S93.

  In step S93, the CPU 149 determines whether the encrypted random number E (R2) transmitted from the connected device is equal to the encrypted random number E ′ (R2) generated by itself in step S92.

  If it is determined in step S93 that the encrypted random numbers E (R2) and E ′ (R2) are not equal, that is, the encryption algorithm employed in the connected device (used for encryption if necessary). If the encryption algorithm employed by the CPU 149 is different from the encryption algorithm adopted by the CPU 149, the process proceeds to step S83, and the CPU 149 determines that the connected device is not a valid IEEE 1394 device as described above and sets the operation mode alone. Set to mode and return.

  If it is determined in step S93 that the encrypted random numbers E (R2) and E ′ (R2) are equal, that is, the encryption algorithm employed by the connected device is the encryption employed by the CPU 149. If the authentication that the connected device is a valid IEEE 1394 device is successful, the process proceeds to step S94, and the CPU 149 determines that the parent device 1 as the connected device is in step S63 of FIG. The device ID and the function information transmitted together with the function information request command are received via the IEEE1394 interface 153 and stored in the EEPROM 150.

  In step S95, the CPU 149 controls the IEEE1394 interface 153 to transmit its own device ID and function information to the connected device in response to the function information request command from the connected device received in step S94. Then, the process proceeds to step S96.

  Here, in the slave unit 2, the function ID and the function information are stored in the EEPROM 150, the vendor_dependent_information of the configuration ROM shown in FIG. 15, etc., as in the case of the master unit 1 described in FIG. Can do.

  In step S96, the CPU 149 refers to the function information stored in the EEPROM 150 to determine whether the connected device is a parent device. If it is determined in step S96 that the connected device is the parent device, that is, if the connection device is successfully authenticated as the parent device, the process proceeds to step S97, and the CPU 149 changes the operation mode to the step in FIG. Set to the full screen displayable mode described in S68 and return.

  On the other hand, if it is determined in step S96 that the connected device is not the parent device, that is, if the authentication that the connected device is the parent device fails, the process proceeds to step S98, and the CPU 149 changes the operation mode to the connected device. The default AV / C command set can be exchanged between them, but the control command for full screen display cannot be exchanged. The normal function command reception / provision mode is set, and the process returns.

  That is, in this case, since the connected device is not the parent device, even if such a connected device is connected to the child device 2, the full screen display function is not provided. Therefore, the function of full screen display is not provided only by connecting the other handset to the handset 2. However, in this case, since the connected device is a legitimate IEEE 1394 device, exchange of a predetermined AV / C command set between the handset 2 and the connected device is permitted. Therefore, in this case, the slave unit 2 and the connected devices (including other slave units) can be controlled from the other side by a predetermined AV / C command set.

  Next, in the master unit 1 and the slave unit 2 as the television receivers constituting the scalable TV system 161 of FIG. 22, the authentication processing described in FIG. 25 and FIG. However, when the operation mode is set to the full screen displayable mode, the scalable TV system 161 can display the full screen as shown in FIG.

  That is, for example, as shown in FIG. 28A, when image data is displayed on the master unit 1, if the full-screen display is instructed by operating the remote controller 15 (or 35), the scalable operation is possible. In the TV system 161, as shown in FIG. 28B, the image data displayed on the master unit 1 is displayed over the entire display screen of the television receiver that constitutes the scalable TV system 161.

  Specifically, when the master device 1 outputs, for example, an image and sound of a certain program (image is displayed and sound is output), the user can control the remote controller 15 (FIG. 7). ) Menu button switch 54 is turned on, the remote controller 15 emits infrared rays corresponding to the user's operation. This infrared ray is received by the IR receiver 135 of the parent device 1 (FIG. 10), and a menu screen is displayed on the CRT 11 of the parent device 1. On this menu screen, for example, an icon representing full screen display (hereinafter referred to as a full screen display icon as appropriate) is displayed, and the user operates the remote control 15 with the full screen display icon. By clicking the button, full screen display is performed in each of the parent device 1 and the child device 2.

That is, in this case, the CPU 129 of the parent device 1 (FIG. 10), among the image data regions displayed on the CRT 11, the image data region to be displayed by itself and the image data to be displayed by each child device _2ij. Find the area. Furthermore, CPU 129 of base unit 1, by controlling the IEEE1394 interface 133, with respect to each child device 2 _ij, the image data to be displayed on the child device 2 _ij, along with the full-screen display command for commanding full screen Send. Then, the CPU 129 of the base unit 1 converts the image data of the area to be displayed by itself into image data having a size displayed on the entire CRT 11 by, for example, interpolation, and the selector 128 and the NTSC encoder 128 are converted. To be supplied to the CRT 11 for display. In each slave unit 2 _ij , the same processing as that in the master unit 1 is performed according to the full screen display command from the master unit 1, thereby displaying the image data from the master unit 1 on the entire CRT 31. .

  As described above, in the television receiver constituting the scalable TV system 161, as shown in FIG. 28B, the image data is displayed over the entire display screen.

  Here, if the image data displayed over the entire display screen of the television receiver that constitutes the scalable TV system 161 is referred to as full-screen image data, the scalable TV system 161 uses the full-screen image data. Is not displayed. That is, in the scalable TV system 161, since there is actually a casing of the television receiver that constitutes the scalable TV system 161, the adjacent portion between the adjacent television receivers is a casing. In that portion, no image is displayed. That is, in FIG. 28, the casing portion that exists between adjacent television receivers is omitted for the sake of simplification, but in actuality, between adjacent television receivers is omitted. However, there is a problem that the full-screen image data is not displayed on the casing part of the television receiver but is divided in other words.

  However, in human vision, even if a part of an image has a line with a very small width that hinders viewing, there is an interpolation action that interpolates an image of a portion hidden by the line from the surrounding image. For this reason, the above-described problems are not so serious problems when viewing the full-screen image data.

In addition, after the full-screen image data is displayed as described above, for example, the user operates the remote controller 15 (FIG. 7) to display the menu screen on the CRT 11 and further displays all the menu screen data. The screen display icon is clicked again, and as a result, the infrared of the full screen display end command for instructing the end of the full screen display as a command corresponding to the operation of the remote controller 15 is emitted from the remote controller 15 and is received by the IR receiver 135. When received and supplied to the CPU 129, the display of the base unit 1 returns to the normal size display as shown in FIG. 28A. Further, in this case, a full screen display end command is transmitted from the parent device 1 to each child device 2 _ij via the IEEE1394 interface 133, whereby the display of each child device 2 _ij is also restored.

  Here, in the present embodiment, the full screen display function is provided only when the authentication described with reference to FIGS. 25 and 27 is successful. However, even if the authentication fails, the full screen is displayed. It is possible to provide a display function.

  Next, a process performed by the security system unit 137 (FIG. 10) of the base unit 1 to warn the user of the occurrence of an emergency will be described.

  Note that the security system unit 157 (FIG. 11) of the slave unit 2 also performs a process for alerting the user to the occurrence of an emergency, but the process is the same as that in the security system unit 137 of the master unit 1. Therefore, the description thereof is omitted.

  In addition, the process performed to warn the user of the occurrence of an emergency situation can be performed by the television receiver alone as the master unit 1 or the slave unit 2, but provides a full-screen display function. Similarly to the above, it is also possible to perform only when the authentication described with reference to FIGS. 25 and 27 is successful.

  First, FIG. 29 shows a configuration example of the data processing unit 137C of the security system unit 137 in FIG.

  In the security system unit 137, the image data and audio data from the camera 162 received by the wireless interface 137B are supplied to the image processing unit 191 and the audio processing unit 192, respectively.

  The image processing unit 191 detects the feature amount of the image data supplied from the wireless interface 137B, for example, for each frame or field, and supplies it to the fluctuation calculation unit 194.

  In other words, the image processing unit 191 includes a frame memory 201, a difference calculation unit 202, and a difference memory 203. The frame memory 201 temporarily stores the image data supplied from the wireless interface 137B under the control of the memory controller 193. The difference calculation unit 202 sequentially sets the time-series frames of the image data stored in the frame memory 201 as the attention frame, the attention frame, and a frame one frame before the attention frame (hereinafter referred to as a previous frame as appropriate). ) Is calculated, and difference image data composed of the difference values is supplied to the difference memory 203. The difference memory 203 temporarily stores difference image data in units of frames supplied from the difference calculation unit 202.

  The voice processing unit 192 detects the feature amount of the voice data supplied from the wireless interface 137B for each predetermined frame, and supplies the detected feature amount to the fluctuation calculation unit 194.

  That is, the audio processing unit 192 includes a ring buffer 206, an integration calculation unit 207, and an integration memory 208. The ring buffer 206 temporarily stores audio data supplied from the wireless interface 137B under the control of the memory controller 193. The integration calculation unit 207 sequentially integrates (adds) the audio data samples constituting the target frame, using a frame including a predetermined number of samples of the time-series audio data stored in the ring buffer 206 as the target frame. ), And supplies the integration value to the integration memory 208. The integration memory 208 temporarily stores an integration value of audio data in units of frames supplied from the integration calculation unit 207.

  In addition, the integration calculation unit 207 can calculate the integration value of the audio data for each frame, and can extract a predetermined one sample of the audio data constituting the frame, for example.

  The memory controller 193 controls write addresses and read addresses in the frame memory 201 of the image processing unit 191 and the ring buffer 206 of the audio processing unit 192.

  The fluctuation calculation unit 194 reads the difference image data for each frame from the difference memory 203 of the image processing unit 191 as the feature amount of the image data of the frame, and also integrates the integration for each frame from the integration memory 208 of the sound processing unit 192. The value is read as the feature value of the audio data of the frame. Further, the fluctuation calculation unit 194 obtains a fluctuation component of the feature amount of the image data and a fluctuation component of the feature amount of the audio data, and supplies these to the warning processing unit 137D (FIG. 10) at the subsequent stage as fluctuation information. .

  In the data processing unit 137C configured as described above, image data processing and audio data processing for processing image data and audio data supplied from the wireless interface 137B are performed.

  Therefore, the image data processing and audio data processing performed by the data processing unit 137C will be described with reference to the flowchart of FIG.

  First, image data processing will be described with reference to the flowchart of FIG. 30A.

  In the image data processing, first, in step S101, the frame memory 201 stores one frame of image data supplied from the wireless interface 137B, and the process proceeds to step S102. In step S102, the difference calculation unit 202 reads out the image data of the frame of interest using the frame of the image data stored in the frame memory 201 in the process of immediately preceding step S101 as the frame of interest, and in the process of the previous step S101. The image data of the previous frame stored in the frame memory 201 is read out. Further, in step S102, the difference calculation unit 202 subtracts the pixel value of the corresponding pixel constituting the image data of the previous frame from the pixel value of each pixel constituting the image data of the frame of interest, and further subtracts the subtraction value. By taking the absolute value of, difference image data having the absolute value as the pixel value is generated. The difference image data of the frame of interest is supplied to and stored in the difference memory 203.

  Thereafter, the process proceeds to step S103, and the fluctuation calculation unit 194 reads the difference image data of the frame of interest from the difference memory 203 and binarizes it. That is, the fluctuation calculating unit 194 compares the pixel value of each pixel constituting the difference image data with a predetermined threshold value. Furthermore, when the pixel value is larger (or higher) than the predetermined threshold, the fluctuation calculating unit 194 sets the pixel value to 1, for example, and the pixel value is equal to or lower than the predetermined threshold (or lower). The pixel value is set to 0, for example, and the process proceeds to step S104.

  In step S104, the fluctuation calculating unit 194 counts a predetermined number of pixels in the image data having the pixel values of 0 and 1 as described above (hereinafter referred to as binarized image data as appropriate) for the frame of interest. That is, the fluctuation calculation unit 194 counts the number of pixels having a pixel value of, for example, 1 among 0 and 1 in the binarized image data, and uses this as fluctuation information of the image data of the frame of interest as warning processing Output to the unit 237D.

  Then, after waiting for the next frame of image data to be supplied from the wireless interface 137B, the process returns to step S101, and the same processing is repeated thereafter.

  Next, audio data processing will be described with reference to the flowchart of FIG. 30B.

  In the audio data processing, first, in step S111, the ring buffer 206 stores one frame of audio data supplied from the wireless interface 137B, and the process proceeds to step S112. In step S112, the integration operation unit 207 reads out the audio data of the frame of interest using the frame of audio data stored in the ring buffer 206 in the process of the previous step S111 as the frame of interest, and samples the audio data of the frame of interest. Is calculated, that is, the integral value is calculated. The integrated value of the audio data is supplied to and stored in the integration memory 208.

  Thereafter, the process proceeds to step S113, and the fluctuation calculation unit 194 reads the integration value of the audio data of the frame of interest and the frame one frame before (the previous frame) from the integration memory 208, and obtains the difference between them. Then, the fluctuation calculation unit 194 outputs the difference value to the warning processing unit 237D as the fluctuation information of the audio data of the frame of interest.

  Thereafter, after the audio data of the next frame is supplied from the wireless interface 137B, the process returns to step S111, and the same processing is repeated thereafter.

  Next, FIG. 31 shows a configuration example of the warning processing unit 137D of FIG.

  The variation information storage unit 211 temporarily stores variation information of image data and audio data supplied from the data processing unit 137C as described with reference to FIGS.

  The fluctuation information analysis unit 212 analyzes the fluctuation information of the image data and the audio data stored in the fluctuation information storage unit 211, thereby obtaining the temporal fluctuation component of the feature amount of the image data and the voice data, and the abnormality determination unit 213 is supplied.

  The abnormality determination unit 213 determines whether the temporal variation component of the feature amount of the image data or audio data supplied from the variation information analysis unit 212 satisfies the abnormality condition stored in the abnormality condition storage unit 214, and The determination result is supplied to the warning process request unit 215.

  Based on the determination result from the abnormality determination unit 213, the warning process request unit 215 requests the security controller 137 (FIG. 10) to perform a warning process for warning the occurrence of an emergency (abnormality) to the user.

  The abnormal condition storage unit 214 stores an abnormal condition that the temporal variation component of the feature amount of the image data or audio data should satisfy in order for the abnormality determination unit 213 to determine that an abnormality has occurred.

  The abnormal condition storage unit 214 can set the abnormal condition in advance, and can also store the abnormal condition set by the user. That is, the user can input an abnormal condition by operating the remote controller 15, for example, and the abnormal condition input by operating the remote controller 15 includes the IR receiver 135, the CPU 129, and the security controller. Via 137A, the abnormal condition storage unit 214 of the warning processing unit 137D is supplied and stored.

  The warning processing unit 137D configured as described above determines whether an abnormality has occurred based on the fluctuation information of the image data or the audio data, and if an abnormality has occurred, warns the user. An abnormality determination / warning process is performed.

  Therefore, the abnormality determination / warning process performed by the warning processing unit 137D will be described with reference to the flowchart of FIG.

  The fluctuation information storage unit 211 is sequentially supplied with fluctuation information of image data and audio data output from the preceding data processing unit 137C, and the fluctuation information storage unit 211 temporarily stores the fluctuation information.

  Then, in step S121, the fluctuation information analysis unit 212 analyzes the fluctuation information of the image data and the audio data stored in the fluctuation information storage unit 212, and thereby the temporal fluctuation component of the feature amount of the image data and the voice data. Is supplied to the abnormality determination unit 213, and the process proceeds to step S122.

  In step S122, the abnormality determination unit 213 determines whether or not the temporal variation component of the feature amount of the image data or audio data supplied from the variation information analysis unit 212 satisfies the abnormality condition stored in the abnormality condition storage unit 214. judge.

  In step S122, when it is determined that the temporal variation component of the feature amount of the image data or audio data supplied from the variation information analysis unit 212 does not satisfy the abnormal condition, the variation information of the next image data and audio data is After being stored in the fluctuation information storage unit 211, the process returns to step S121.

  In step S122, when it is determined that the temporal variation component of the feature amount of the image data or the sound data supplied from the variation information analysis unit 212 satisfies the abnormal condition, the abnormality determination unit 213 satisfies the abnormal condition. The determination result is supplied to the warning processing request unit 215, and the process proceeds to step S123.

  In step S123, the warning processing request unit 215 performs security processing to warn the user of the occurrence of an emergency in response to the determination result from the abnormality determination unit 213 that the abnormal condition is satisfied. Request to controller 137 (FIG. 10). Then, after waiting for the fluctuation information of the next image data and audio data to be stored in the fluctuation information storage unit 211, the process returns to step S121.

  Next, with reference to FIG. 33 and FIG. 34, the process of the abnormality determination part 213 is further demonstrated.

  The abnormality determination unit 213 determines that the abnormal condition is satisfied, for example, when the fluctuation information of the image data or the sound data changes with a tendency different from the conventional one.

  That is, for example, the fluctuation information analysis unit 212 determines that an abnormality occurs when the fluctuation information that has not changed so much suddenly changes greatly, or when the fluctuation information that has changed to some extent does not suddenly change. It is determined that the condition is satisfied.

  Here, for example, whether or not the fluctuation information that has not changed so much has suddenly changed greatly, the fluctuation information analysis unit 212 differentiates the fluctuation information (adjacent to the fluctuation information that is continuous in time series). It is possible to calculate the difference between them and determine whether the absolute value of the differential value is equal to or greater than a predetermined threshold in the abnormality determination unit 213. In this case, a predetermined threshold value is stored in the abnormal condition storage unit 214 as an abnormal condition.

  Also, whether or not the fluctuation information that has fluctuated to some extent has suddenly changed is determined, for example, by whether or not the time when the fluctuation information is a value close to 0 has continued for a predetermined time or more in the abnormality determination unit 213 This can be done by determining. In this case, the predetermined time is stored in the abnormal condition storage unit 214 as an abnormal condition.

  FIG. 33 shows an example of image data photographed by the camera 162 and variation information of the image data.

  For example, as shown in FIG. 33A, when the elderly person is walking in the room and is photographed by the camera 162, the fluctuation information of the image data fluctuates gently as shown in FIG. 33B. . And, for example, as shown in FIG. 33C, when an elderly person walking in the room suddenly falls down and is photographed by the camera 162, the fluctuation information of the image data is large as shown in FIG. 33D. Change and then almost zero.

  Therefore, an elderly person can have an abnormal condition that the fluctuation information of the image data has suddenly exceeded a predetermined threshold value, that is, the differential value of the fluctuation information of the image data has exceeded the predetermined threshold value. It is possible to detect an abnormal state that the user has fallen. By warning the user of such an abnormal state, it becomes possible to quickly provide care (rescue) for a fallen elderly person.

  As shown in FIG. 33C, when a person suddenly falls, the fluctuation information of the image data suddenly exceeds a predetermined threshold, and immediately after that, becomes a value close to 0. Therefore, it is abnormal that the differential value of the fluctuation information of the image data is equal to or greater than a predetermined threshold value, and thereafter, the fluctuation information of the image data becomes a value close to 0 and the value close to 0 continues for a predetermined time or more. Also by using the condition, it is possible to detect an abnormal state that a person has fallen.

  Next, FIG. 34 shows an example of image data and audio data photographed by the camera 162 and variation information of the image data and audio data.

For example, as shown in FIG. 34A, when an infant is scooping through a room and is photographed by the camera 162, variation information of image data and audio data is shown in FIGS. 34B and 34C, respectively. Thus, it will fluctuate slowly. Then, for example, as shown in FIG. 34 D, how the infants were crawling in the room was asleep is, when taken by the camera 162, variation information of the image data and audio data, FIG. 34E As shown in FIG. 34F and FIG. 34F, the values are almost close to 0 and hardly change.

  Therefore, in this case, the abnormal information that the fluctuation information of the image data and the sound data becomes a value close to 0 and that the value close to 0 continues for a predetermined time or more is set as an abnormal condition. The state can be detected. By warning the user of such an abnormal state, it is possible to quickly take measures such as putting a blanket on the baby.

  Also, as shown in FIG. 34G, when a sleeping infant suddenly wakes up and crying, the fluctuation information of the image data and audio data captured by the camera 162 is as shown in FIGS. 34H and 34I, respectively. It will be something.

  That is, in this case, the crying infant moves more than when sleeping, but does not move more than when crawling, so the fluctuation information of the image data changes so greatly as shown in FIG. 34H. do not do.

  However, when the sleeping infant starts crying, the crying sound is intermittently generated, so that the fluctuation information of the voice data suddenly becomes a large value as shown in FIG. Continues for a predetermined time.

  Therefore, in this case, the fluctuation information of the audio data suddenly changes to a large value, and the condition that the large value continues for a predetermined time is regarded as an abnormal condition, so that the infant wakes up and crying. It is possible to detect an abnormal state of having been issued. By warning the user of such an abnormal state, it is possible to promptly notify that an infant has occurred.

  Next, as described with reference to FIG. 31 and FIG. 32, the warning processing unit 137D performs warning processing that warns the user of the occurrence of an emergency when an abnormal condition that satisfies the abnormal condition occurs. The security controller 137A (FIG. 10) requests the warning processing performed by the security controller 137A when this warning processing request (warning processing request) is received, with reference to FIG. 35 and FIG.

  When the security controller 137A receives the warning processing request, for example, the security controller 137A requests the CPU 129 to cause the selector 127 to select image data and audio data output from the wireless interface 137A.

  As a result, the selector 127 selects the image data and audio data output from the wireless interface 137A and supplies them to the NTSC encoder 128 and the amplifier 138, respectively. The image data supplied to the NTSC encoder 128 is supplied to the CRT 11 for display, and the audio data supplied to the amplifier 138 is supplied to the speaker units 12L and 12R and output.

  As a result, the CRT 11 displays the image data from the camera 162 received by the wireless interface 137B, and the audio data from the camera 162 received by the wireless interface 137B is output from the speakers 12L and 12R.

That is, for example, as shown in FIG. 35A, image data and audio data as a television broadcast program of a predetermined channel are output from the master unit 1 and each slave unit 2 _ij constituting the scalable TV system 161. If the warning processing request is output from the warning processing 157D of the slave unit 2 ₁₃ to the security controller 157A, the display of the CRT 31 of the slave unit 2 ₁₃ is received there as shown in FIG. 35B. from the image data of the television broadcast program was switched to the image data from the camera 162 which transmits image data and voice data to the handset 2 _13. Here, in the embodiment of FIG. 35, the display of CRT31 handset 2 _13, the image data as a television broadcast program, from the camera 162, the image data displaying the state of a person lying It has been switched.

Furthermore, in this case, the handset 2 _13, the audio data from the camera 162 is output from the speaker units 32L and 32R (Figure 11).

In this case, the user can also be view television broadcast programs, the handset 2 _13, in an environment that is captured by the camera 162 which transmits image data and sound data, that some abnormality occurs Recognize instantly.

  In addition, instead of the audio data from the camera 162, it is possible to output a predetermined warning sound (beep and so on) from the speaker units 32L and 32R as shown in FIG. 35B.

Further, in the above case, the display of CRT31 handset 2 _13, as shown in FIG. 35B, where the image data as a television broadcast program that has been received, to switch the image data from the camera 162 However, for example, when the power of the handset 2 ₁₃ is turned off, the power of the handset 2 ₁₃ is turned on, and the image data from the camera 162 is displayed on the CRT 31. It is possible to

  Furthermore, in the scalable TV system 161, the image data from the camera 162 is displayed on the television receiver that receives the image data and audio data from the camera 162 that is shooting in an abnormal environment. 36, the image data from the camera 162 can be displayed on the full screen.

That is, for example, as shown in FIG. 36A, image data and audio data as a television broadcast program of a predetermined channel are output from the master unit 1 and each slave unit 2 _ij constituting the scalable TV system 161. When a warning processing request is output from any television receiver that constitutes the scalable TV system 161, the display of all the television receivers that constitute the scalable TV system 161 is switched. As shown in 36B, the image data from the camera 162 received by the television receiver to which the warning processing request is output can be displayed on the full screen.

  Also in this case, the user can immediately recognize that some abnormality has occurred.

  In addition, when full screen display is performed, since it is not known in which environment the imaging is performed by which camera 162, the camera 162 that captures the environment where the abnormality has occurred. In the television receiver of the scalable TV system 161 that receives image data and audio data from the TV, a message or the like indicating that an abnormality has occurred is displayed on a part or all of the display screen. Is desirable.

  Further, the full screen display can be performed, for example, when an abnormality with a high degree of urgency occurs. That is, when an abnormality that does not have a high degree of urgency occurs, as described with reference to FIG. 35, a television that receives image data and audio data from the camera 162 that is photographing the environment in which the abnormality has occurred. Only the display of the television receiver is switched, and when an abnormality with a high degree of urgency occurs, the display of all the television receivers constituting the scalable TV system 161 is switched and a full screen display is performed as shown in FIG. It is possible to do so. In the full screen display, the image is displayed in a large size, so that the user can recognize that an abnormality with a high degree of urgency has occurred.

  In addition, the size of image data (hereinafter, referred to as emergency image data as appropriate) displayed on the scalable TV system 161 from the camera 162 that captures the environment in which the abnormality has occurred is changed depending on the urgency of the abnormality. Is possible. That is, when the urgency level is low, the size of the display screen of one television receiver constituting the scalable TV system 161, and when the urgency level is medium, the adjacent 2 × 2 television image reception is set. When the urgent level is high due to the size of the display screen of the machine, the emergency image data can be displayed with the size of the display screen of the adjacent 3 × 3 television receiver.

  Here, the level of urgency can be stored together with the abnormal condition in the abnormal condition storage unit 214 (FIG. 31). In this case, the level of urgency can be recognized based on the satisfied abnormal condition. It becomes possible.

  Next, FIG. 37 illustrates another configuration example of a television receiver as the parent device 1 that configures the scalable TV system 161. In the figure, portions corresponding to those in FIG. 10 are denoted by the same reference numerals, and description thereof will be omitted below as appropriate. That is, the base unit 1 in FIG. 37 is configured in the same manner as in FIG. 10 except that a warning display unit 139 is newly provided.

  The warning display unit 139 is turned on or blinks under the control of the CPU 129.

  In addition, the television receiver as the subunit | mobile_unit 2 shown in FIG. 11 can also be provided and provided with a warning display part similarly to the case in the main | base station 1 shown in FIG.

  When the master unit 1 is provided with a warning display unit 139 and the slave unit 2 is also provided with a warning display unit to constitute the scalable TV system 161, as shown in FIG. The display portion 139 can be turned on or blinked.

That is, for example, as shown in FIG. 38A, image data and audio data as a television broadcast program of a predetermined channel are output from the master unit 1 and each slave unit 2 _ij constituting the scalable TV system 161. If a warning process request is output from the warning process 137D of the master unit 1 to the security controller 137A, the display on the CRT 11 of the master unit 1 is received as shown in FIG. 38B. The image data as the John broadcast program is switched to the image data (emergency image data) from the camera 162 that is transmitting the image data and audio data to the master unit 1.

  Further, the security controller 137A requests the CPU 129 to turn on or blink the warning display unit 139, whereby the warning display unit 139 that is normally turned off is turned on or blinked as shown in FIG. 38B.

  In this case as well, even if the user is watching a television broadcast program, it can be said that some abnormality has occurred in the environment where the camera 162 that is transmitting image data and audio data to the master unit 1 is captured. Recognize instantly.

  When the degree of urgency is low, it is possible to turn on or blink only the warning display unit 139 or to output only an alarm sound without switching the display to the emergency image data. It is.

  Next, FIG. 39 shows another configuration example of the television receiver as the parent device 1 constituting the scalable TV system 161. In the figure, portions corresponding to those in FIG. 10 are denoted by the same reference numerals, and description thereof will be omitted below as appropriate.

  That is, the master unit 1 in FIG. 10 is a television receiver that receives a digital broadcast, whereas the master unit 1 in FIG. 39 is a television receiver that receives an analog broadcast.

  The tuner 221 detects and demodulates a predetermined channel of the analog television broadcast signal. Then, the tuner 221 supplies the image data obtained by demodulation to the Y / C separation unit 222 and supplies the audio data to the selector 127.

  The Y / C separation unit 222 separates the luminance signal Y and the color difference signal C from the output of the tuner 221 and supplies them to the selector 127.

  The matrix circuit 223 converts the color space of the image data supplied from the selector 127 as necessary, and supplies it to the CRT 11.

  Even a television receiver configured as described above that receives an analog broadcast can configure the scalable TV system 161.

  Note that the television receiver as the slave unit 2 can also be configured as a television receiver that receives an analog broadcast, as in the case of the television receiver as the master unit 1 shown in FIG. .

  Next, the series of processes described above can be performed by hardware or software. When a series of processing is performed by software, a program constituting the software is installed in a general-purpose computer or the like.

  Therefore, FIG. 40 shows a configuration example of an embodiment of a computer in which a program for executing the series of processes described above is installed.

  The program can be recorded in advance on a hard disk 305 or a ROM 303 as a recording medium built in the computer.

  Alternatively, the program is stored temporarily on a removable recording medium 311 such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, or a semiconductor memory. It can be stored permanently (recorded). Such a removable recording medium 311 can be provided as so-called package software.

The program is installed in the computer from the removable recording medium 311 as described above, or transferred from the download site to the computer wirelessly via a digital satellite broadcasting artificial satellite, or a LAN (Local Area Network), The program can be transferred to a computer via a network such as the Internet. The computer can receive the program transferred in this way by the communication unit 308 and install it in the built-in hard disk 305.

The computer includes a CPU (Central Processing Unit) 302. An input / output interface 310 is connected to the CPU 302 via the bus 301, and the CPU 302 is operated by an input unit 307 including a keyboard, a mouse, a microphone, and the like by the user via the input / output interface 310. When a command is input by the equalization, a program stored in a ROM (Read Only Memory) 303 is executed accordingly. Alternatively, the CPU 302 can also read from a program stored in the hard disk 305, a program transferred from a satellite or a network, received by the communication unit 308 and installed in the hard disk 305, or a removable recording medium 311 attached to the drive 309. The program read and installed in the hard disk 305 is loaded into a RAM (Random Access Memory) 304 and executed. Thereby, the CPU 302 performs processing according to the above-described flowchart or processing performed by the configuration of the above-described block diagram. Then, the CPU 302 outputs the processing result from the output unit 306 configured with an LCD (Liquid Crystal Display), a speaker, or the like, for example, via the input / output interface 310 as necessary, or the communication unit 3
The data is transmitted from 08 and further recorded on the hard disk 305.

  Here, in the present specification, the processing steps for describing a program for causing the computer to perform various processes do not necessarily have to be processed in time series in the order described in the flowcharts, but in parallel or individually. This includes processing to be executed (for example, parallel processing or processing by an object).

  Further, the program may be processed by one computer or may be distributedly processed by a plurality of computers. Furthermore, the program may be transferred to a remote computer and executed.

  Note that the television receiver that constitutes the scalable TV system depends on, for example, whether the television receiver is a parent device or a child device, and, if it is a child device, the number of child devices. It is possible to make a difference in the selling price.

  That is, in the scalable TV system, as described above, if the parent device does not exist, the full-screen display function is not provided. Therefore, the value of the parent device is high, and therefore the selling price may be set high. it can.

  In addition, after the purchase of the master unit, the user is expected to purchase additional slave units as needed, but the first few slave units are, for example, less expensive than the master unit. It is possible to set a selling price that is higher than that of a general television receiver. And about the subunit | mobile_unit purchased after that, a further low selling price can be set.

  Note that a television receiver serving as a parent device constituting a scalable TV system can be obtained by, for example, adding a security system unit 137 to a general digital television receiver and changing a program executed by the CPU 129. It is possible to configure. Accordingly, a television receiver serving as a parent device constituting the scalable TV system can be manufactured relatively easily using a general digital television receiver, and therefore, the scalable TV system provides. Considering the full-screen display function and the warning function as described above, it can be said that the cost merit (cost performance) is high. The same applies to a television receiver as a slave unit.

  The present invention can also be applied to a television receiver that is a display device incorporating a tuner and a display device that outputs images and sounds from the outside without incorporating a tuner.

  Further, in the security system in FIG. 22, the transmission of image data and audio data from the camera 162 to the television receiver constituting the scalable TV system 161 is not wireless, but wired (for example, IEEE1394 or USB (Universal Serial Bus) ), Etc.).

  As the camera 162, for example, a so-called door phone camera or a monitoring camera that is already set can be adopted in addition to those prepared for the security system.

  In addition to monitoring infants and the elderly, the security system can be used to monitor hot water in a bath, hot water in a kettle that rings when it boils, and the like.

  In the present embodiment, processing is performed on image data captured by a general camera 162. In addition, for example, a camera that senses heat is used as the camera 162, and the processing is obtained from the camera. It is also possible to perform processing on image data representing the temperature distribution to be obtained.

  Furthermore, it is possible to detect infrared rays, monitor temperature changes, and issue a warning.

It is a perspective view which shows the structural example of one Embodiment of the scalable TV system to which this invention is applied. 2 is a perspective view showing an example of an external configuration of a base unit 1. FIG. FIG. 6 is a six-side view illustrating an example of an external configuration of the parent device 1. It is a perspective view which shows the example of an external appearance structure of the subunit | mobile_unit 2. FIG. FIG. 6 is a six-side view illustrating an example of an external configuration of the slave unit 2. It is a perspective view which shows the example of an external appearance structure of the exclusive rack which accommodates the main | base station 1 and the subunit | mobile_unit 2 which comprise a scalable TV system. 3 is a plan view showing an external configuration example of a remote controller 15. FIG. 3 is a plan view showing an external configuration example of a remote control 35. FIG. 12 is a plan view showing another example of the external configuration of the remote controller 15. FIG. 2 is a block diagram illustrating an example of an electrical configuration of a parent device 1. FIG. It is a block diagram which shows the electrical structural example of the subunit | mobile_unit 2. FIG. It is a figure which shows the layer structure of IEEE1394 communication protocol. It is a figure which shows the address space of CSR architecture. It is a figure which shows the offset address of CSR, a name, and a function. It is a figure which shows the general ROM format. It is a figure which shows the detail of a bus infoblock, a root directory, and a unit directory. It is a figure which shows the structure of PCR. It is a figure which shows the structure of oMPR, oPCR, iMPR, and iPCR. It is a figure which shows the data structure of the packet transmitted by the asynchronous transfer mode of AV / C command. It is a figure which shows the specific example of an AV / C command. It is a figure which shows the specific example of an AV / C command and a response. It is a block diagram which shows the structural example of one Embodiment of the security system to which this invention is applied. 2 is a block diagram illustrating a configuration example of a camera 162. FIG. 3 is a flowchart for explaining processing of a master unit 1; 5 is a flowchart for explaining authentication processing by a base unit 1; It is a flowchart explaining the process of the subunit | mobile_unit 2. FIG. It is a flowchart explaining the authentication process by the subunit | mobile_unit 2. FIG. It is a figure which shows the example of a display of the full screen display by the scalable TV system 161. FIG. It is a block diagram which shows the structural example of 137C of data processing parts. It is a flowchart explaining the image data processing and audio | voice data processing by 137C of data processing parts. It is a block diagram which shows the structural example of warning process part 137D. It is a flowchart explaining abnormality determination / warning processing by the warning processing unit 137D. It is a figure for demonstrating the process of the abnormality determination part. It is a figure for demonstrating the process of the abnormality determination part. It is a figure for demonstrating the warning process by 137A of security controllers. It is a figure for demonstrating the warning process by 137A of security controllers. 6 is a block diagram illustrating another example of the electrical configuration of the parent device 1. FIG. It is a figure for demonstrating the warning process by 137A of security controllers. FIG. 10 is a block diagram showing still another example of the electrical configuration of base unit 1. It is a block diagram which shows the structural example of one Embodiment of the computer to which this invention is applied.

Explanation of symbols

1 Base unit 2, 2 ₁₁ , 2 ₁₂ , 2 ₁₃ , 2 ₁₄ , 2 ₁₅ , 2 ₂₁ , 2 ₂₂ , 2 ₂₃ , 2 ₂₄ , 2 ₂₅ , 2 ₃₁ , 2 ₃₂ , 2 ₃₃ , 2 ₃₄ , 2 ₃₅ , 2 ₄₁ , 2 ₄₂ , 2 ₄₃ , 2 ₄₄ , 2 ₄₅ , 2 ₅₁ , 2 ₅₂ , 2 ₅₃ , 2 ₅₄ , ₂₅₅ slave unit, 11 CRT, 12L, 12R speaker unit, 15 remote controller, 21 terminal panel, 21 ₁₁ , 21 ₁₂ , 21 ₁₃ , 21 ₂₁ , 21 ₂₃ , 21 ₃₁ , 21 ₃₂ , 21 ₃₃ IEEE1394 terminal, 22 antenna terminal, 23 input terminal, 24 output terminal, 31 CRT, 32L, 32R speaker unit, 35 remote control, 41 Terminal panel, 41 ₁ IEEE1394 terminal, 42 Antenna terminal, 43 Input terminal, 44 Output terminal, 51 Select button switch, 52 Volume button switch, 53 Channel up / down button switch, 54 Menu button switch H, 55 Exit button switch, 56 Display button, 57 Enter button switch, 58 Numeric button (numeric keypad) switch, 59 TV / video switch button switch, 60 TV / DSS switch button switch, 61 Jump button switch, 62 Language button, 63 Guide button switch, 64 Favorite button switch, 65 Cable button switch, 66 TV switch, 67 DSS button switch, 68 to 70 LED, 71 Cable power button switch, 72 TV power button switch, 73 DSS power button switch, 74 Muting button Switch, 75 sleep button switch, 76 light-emitting section, 81 select button switch, 82 volume button switch, 83 channels Up / Down Button Switch, 84 Menu Button Switch, 85 Exit Button Switch, 86 Display Button, 87 Enter Button Switch, 88 Numeric Button (Numeric Keypad) Switch, 89 TV / Video Switch Button Switch, 90 TV / DSS Switch Button Switch, 91 Jump Button switch, 92 Language button, 93 Guide button switch, 94 Favorite button switch, 95 Cable button switch, 96 TV switch, 97 DSS button switch, 98 to 100 LED, 101 Cable power button switch, 102 TV power button switch, 103 DSS Power button switch, 104 muting button switch, 105 sleep button switch, 106 light emitting unit, 110 Button switch, 111 to 114 direction button switch, 121 tuner, 122 QPSK demodulation circuit, 123 error correction circuit, 124 demultiplexer, 125 MPEG video decoder, 126 MPEG audio decoder, 127 frame memory, 128 NTSC encoder, 129 CPU, 130 EEPROM , 131 ROM, 132 RAM, 133 IEEE1394 interface, 134 front panel, 135 IR receiver, 135A, 135B light receiving unit, 136 modem, 137 security system unit, 137A security controller, 137B wireless interface, 137C data processing unit, 137D warning processing Part, 138 amplifier, 139 warning display part, 141 tuner, 142 QPSK demodulation circuit, 14 3 error correction circuit, 144 demultiplexer, 145 MPEG video decoder, 146 MPEG audio decoder, 147 frame memory, 148 NTSC encoder, 149 CPU, 150 EEPROM, 151 ROM, 152 RAM, 153 IEEE1394 interface, 154 front panel, 155 IR reception Unit, 156 modem, 157 security system unit, 157A security controller, 157B wireless interface, 157C data processing unit, 157D warning processing unit, 158 amplifier, 161 scalable TV system, 162 _{1 to} 162 ₃ camera, 171 optical system, 172 CCD, 173 amplifier, 174 A / D converter, 175 memory, 176 microphone, 177 amplifier, 178 A / D converter, 179 memory, 180 wireless interface, 191 image processing unit, 192 audio processing unit, 193 memory controller, 194 fluctuation calculation unit, 201 frame memory, 202 difference calculation unit, 203 difference memory, 206 ring buffer, 207 integration calculation unit, 208 integration Memory, 211 Fluctuation information storage unit, 212 Fluctuation information analysis unit, 213 Abnormality determination unit, 214 Abnormal condition storage unit, 215 Warning processing request unit, 301 Bus, 302 CPU, 303 ROM, 304 RAM, 305 Hard disk, 306 Output unit, 307 input unit, 308 communication unit, 309 drive, 310 input / output interface, 311 removable recording medium

Claims (5)

A display control device having a plurality of input systems,
Display control means for controlling display and sound output of the image input from the first input system and the image input from the second input system on the display device;
Detecting means for detecting feature quantities of image and audio information input from the second input system at predetermined intervals;
Analyzing means for analyzing temporal variations in the feature quantities of the image and sound;
Storage means for storing abnormal conditions to be satisfied by temporal variation components of image and audio feature quantities;
Determination means for determining whether temporal variation of the feature amount of the image and the sound analyzed by the analysis means satisfies the abnormal condition; and
The display device is one of a plurality of display devices arranged at positions that can be observed simultaneously,
The display control means, when an image input from the first input system is displayed on the display device, the temporal variation of the feature amount of the image and the sound satisfies the abnormal condition by the determination means. When it is determined that the image is input , the image of the information input from the second input system is displayed on the display device instead of the image input from the first input system , and the second A display control device that outputs a predetermined warning sound in place of the voice of the information inputted from the input system. The display control apparatus according to claim 1, further comprising setting means for setting the abnormal condition. A display control method having a plurality of input systems,
A display control step for controlling display and audio output of the image input from the first input system and the image input from the second input system to the display device;
A detection step of detecting feature amounts of image and audio information input from the second input system at predetermined intervals;
An analysis step of analyzing temporal variation of the feature amount of the image and the sound;
A storage step for storing abnormal conditions to be satisfied by temporal variation components of image and audio feature values;
A determination step of determining whether temporal variation in the feature amount of the image and the sound analyzed in the processing of the analysis step satisfies the abnormal condition;
The display device is one of a plurality of display devices arranged at positions that can be observed simultaneously,
In the process of the display control step , when the image input from the first input system is displayed on the display device, the temporal variation of the feature amount of the image and the sound is determined in the process of the determination step. when it is determined that meets the abnormal condition, the image of the information input from the second input line, and displays on the display device in place of the inputted image from the first input line A display control method for outputting a predetermined warning sound in place of the voice of the information inputted from the second input system . In a display system configured by connecting a plurality of display control devices having a plurality of input systems,
Each of the plurality of display control devices
A display device for displaying an image;
Display control means for controlling display and audio output of the image input from the first input system and the image input from the second input system to the display device;
Detecting means for detecting feature quantities of image and audio information input from the second input system at predetermined intervals;
Analyzing means for analyzing temporal variations in the feature quantities of the image and sound;
Storage means for storing abnormal conditions to be satisfied by temporal variation components of image and audio feature quantities;
Determination means for determining whether temporal variation of the feature amount of the image and the sound analyzed by the analysis means satisfies the abnormal condition; and
The display device is one of a plurality of display devices arranged at positions that can be observed simultaneously,
The display control means, when an image input from the first input system is displayed on the display device, the temporal variation of the feature amount of the image and the sound satisfies the abnormal condition by the determination means. When it is determined that the image is input , the image of the information input from the second input system is displayed on the display device instead of the image input from the first input system , and the second A display system that outputs a predetermined warning sound instead of the voice of the information inputted from the input system. A display device having a plurality of input systems,
Display means for displaying an image;
Display control means for controlling display and sound output of the image input from the first input system and the image input from the second input system to the display means;
Detecting means for detecting feature quantities of image and audio information input from the second input system at predetermined intervals;
Analyzing means for analyzing temporal variations in the feature quantities of the image and sound;
Storage means for storing abnormal conditions to be satisfied by temporal variation components of image and audio feature quantities;
Determination means for determining whether temporal variation of the feature amount of the image and the sound analyzed by the analysis means satisfies the abnormal condition; and
The display means is one of a plurality of display means arranged at a position where observation is possible at the same time,
The display control means, when an image input from the first input system is displayed on the display means, the temporal variation of the feature amount of the image and the sound satisfies the abnormal condition by the determination means. When it is determined that the image is input , the image of the information input from the second input system is displayed on the display means instead of the image input from the first input system , and the second A display device that outputs a predetermined warning sound instead of the voice of the information inputted from the input system.

Images