JP2010004355A - Audio/video information notification system and control method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain an audio/video information notification system which can effectively provide information such as advertisements to a viewer, and is also effective in the viewpoint of saving energy consumption. <P>SOLUTION: A peripheral situation in front of a display screen of a large-sized monitor display device is imaged and when the number of persons being present in front of the display screen of the large-sized monitor display device exceeds a preset first predetermined value, as first content information, at least audio information is generated from a sounding part, the audio information calling attention to the display screen of the large-sized monitor display device. When the number of front faces of viewers watching the display screen of the large-sized monitor display device exceeds a preset second predetermined value thereafter, as second content information, at least video data of main information is projected on the display screen of the large-sized monitor display device. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an audio / video information notification system that uses, for example, a large thin liquid crystal monitor device to notify content such as advertisements using audio information and video information, and a control method thereof.

  Recently, a large and thin monitor device (hereinafter referred to as a large monitor display device) has been reduced in cost. As a result, the large monitor display device is installed in a public place, and content such as advertisements is reproduced and displayed on the large monitor display device. Many new usage methods for informing users of content such as advertisements can be seen.

  In such notification of content such as advertisements, even if content such as advertisements is reproduced and displayed in the absence of a viewer in the peripheral area of the large monitor display device, it is not effective in terms of notification of content such as advertisements. In addition, constantly reproducing and displaying content such as advertisements is not desirable from the viewpoint of energy saving because it has a small impact on the viewer and always consumes power.

For example, Patent Literature 1 discloses a technology for informing such content as advertisements. This patent document 1 captures the front of advertising media with a camera, detects the face direction of a person present in the captured image data acquired by this imaging, and counts the number of people viewing the advertising media. Disclose technology. By applying such technology, it is possible to effectively provide information such as advertisements to a large number of viewers by reproducing the advertising content on a large monitor display device when there are many viewers.
JP 2000-181070 A

  However, in Patent Document 1, advertisement content is reproduced when there are many viewers viewing the display screen of the large monitor display device in front of the large monitor display device. If you do not wait until you see the display screen of the device, you will not be able to see the advertising content. In a situation where there are not many viewers watching the display screen of the large monitor display device and the reproduction of the advertising content is stopped for energy saving, the viewer rarely watches the display screen of the large monitor display device. . However, it is not a good idea to wait until a large number of viewers view the display screen of the large monitor display device.

  An object of the present invention is to provide an audio / video information notification system and a control method thereof that can effectively provide information such as advertisements to viewers and are also effective from the viewpoint of energy saving.

  An audio / video information notification system according to a main aspect of the present invention includes an audio output device that outputs audio information and a display device that displays video information, and an imaging unit that images a peripheral area of the display device; First counting means for analyzing the image data acquired by imaging by the imaging means and counting the number of objects to be notified that receive notification of information existing in the peripheral area of the display device, and acquired by imaging by the imaging means The second counting means for analyzing the image data and counting the number of notified objects facing in the direction of the display device, the sound output device and the display device are respectively driven and controlled, and the count value of the first counting means Control means for reproducing the first content information when the value exceeds a first predetermined value, and then reproducing the second content information when the count value of the second counting means exceeds the second predetermined value. It has.

  The control method of the audio / video information notification system according to the main aspect of the present invention drives and controls the audio output device that outputs audio information and the display device that displays the video information to notify the audio information and the video information. In the control method of the audio / video information notification system, the number of notification targets for receiving notification of information existing in the peripheral area of the display device by imaging the peripheral area of the display device and analyzing the image data acquired by the imaging is determined. Counting, controlling driving of at least one of the audio output device and the display device, reproducing the first content information when the count value exceeds the first predetermined value, and analyzing the image data acquired by imaging The number of objects to be notified facing in the direction of the display device is counted, at least one of the audio output device and the display device is driven and controlled, and if the count value exceeds a second predetermined value, the second content information Play.

  ADVANTAGE OF THE INVENTION According to this invention, information, such as an advertisement, can be effectively provided with respect to a viewer, and the audio | video information alerting | reporting system effective from a viewpoint of energy saving, and its control method can be provided.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram of an audio / video information notification system. A lens system 1 as an imaging unit and an imaging unit 2 are provided. The lens system 1 and the imaging unit 2 constitute an imaging device 3. For example, as shown in FIG. 2, the imaging device 3 is provided in a peripheral portion, for example, an upper portion of the large monitor display device 4. This imaging device 3 is installed with the direction of the imaging field of view so as to face the notification target that is gazing at the display screen 4 a of the large monitor display device 4, that is, the face of the viewer 5. That is, the imaging field of view of the imaging device 3 is directed in a direction that enables imaging of the face of the viewer 5 who is looking at the display screen 4a in front of the display screen 4a of the large monitor display device 4, for example. Yes. The imaging unit 2 photoelectrically converts the optical image of the surrounding situation in front of the large monitor display device 4 formed by the lens system 1 and outputs an image signal. The imaging unit 2 is formed by, for example, a CCD or a CMOS. Further, the imaging device 3 may capture the surrounding situation in front of the large monitor display device 4 as a moving image, or may capture a single image at predetermined intervals.

The image processing unit 6 receives an image signal output from the imaging device 3, digitally converts the image signal, and performs various image processing to obtain image data.
The head / front face determination unit 7 receives the image data acquired by the image processing unit 6 and analyzes the image data to recognize the head and front face of the viewer 5 included in the image data. That is, a head data storage unit 8 and a front face data storage unit 9 are connected to the head / front face determination unit 7. Among these, the head data storage unit 8 stores a plurality of reference head data for recognizing the head of the viewer 5 in advance. There are a plurality of these reference head data depending on, for example, the shape of the viewer's 5 head, the size of a child or an adult, various hairstyles, and the like. The front face data storage unit 9 stores a plurality of reference front face data for recognizing the front face of the viewer 5 in advance. A plurality of these reference front face data are provided according to the shape, size, position, etc. of the viewer's 5 eyes, nose and mouth, for example.

However, the head / front face determination unit 7 performs matching processing on the image data acquired by the image processing unit 6 using a plurality of reference head data stored in the head data storage unit 8, A region in the image data having a preset matching rate is recognized as the head of the viewer 5.
The head / front face determination unit 7 performs a matching process on the image data acquired by the image processing unit 6 using a plurality of reference front face data stored in the front face data storage unit 9. A region in the image data having a preset matching rate is recognized as the front face of the viewer 5.

The evaluation unit 10 acquires the number of the heads of the viewers 5 and the number of front faces of the viewers 5 present in the image data acquired by the imaging of the imaging device 3. The first counting unit 11 and the second counting unit 12. Among these, the first counting unit 11 receives information on the head of the viewer 5 recognized in the image data by the head / front face determination unit 7, and stores the information on the region of the head of the viewer 5 in the image data. Count the number.
The second counting unit 12 receives information on the front face of the viewer 5 recognized by the head / front face determination unit 7 and counts the number of front face regions of the viewer 5 in the image data. The second counting unit 12 counts the number of regions on the front face of the viewer 5 after the first counting unit 11 counts the number of regions on the head of the viewer 5.
Note that the head / front face determination unit 7 and the evaluation unit 10 analyze the image data acquired by the imaging device 3 to count the number of viewers present in the peripheral area of the large monitor display device 4. 1 counting means and a second counting means for analyzing the image data and counting the number of viewers facing the large monitor display device 4.

The control unit 13 stores in advance an audio / video information notification program in accordance with the audio / video information notification flowchart shown in FIG. 3 and executes the audio / video information notification program as an audio output device through the notification unit 14. When the sound generation unit 15 and the large monitor display device 4 as the video display unit are respectively driven and controlled, and the count value of the first count unit 11 exceeds a preset first predetermined value n, the first content information is obtained. After that, when the count value of the second counting unit 12 exceeds a preset second predetermined value m, the second content information is reproduced. And the control part 13 will stop reproduction | regeneration of 2nd content information, if the count value of the 2nd counting part 12 becomes below the 3rd predetermined value p set beforehand.
The notification unit 14 drives the large monitor display device 4 and the utterance unit 15 according to the control of the control unit 13, and includes an audio data storage unit 16 and a video content storage unit 17. Among these, the audio data storage unit 16 has at least audio for urging the viewer 5 existing in the peripheral area of the large monitor display device 4 to gaze at the display screen 4a of the large monitor display device 4 as the first content information. Data is stored. This voice data is, for example, “Come to the customer.” It can be changed to various data contents.
The audio data storage unit 16 stores audio data included in the main information to be notified to the viewer 5 existing in the peripheral area of the large monitor display device 4 as the second content information. The audio data included in this main information is, for example, “Our new product. Please see.” And can be changed to various data contents.

In the video content storage unit 17, video data to be displayed on the display screen 4 a of the large monitor display device 4 is stored as the first content information together with the audio data such as “customer welcome”. This video data has a content that shows, for example, a female guide who generates “customer welcome”. This video data can be changed to various video contents.
The video content storage unit 17 also displays the audio data included in the main information as the second content information, for example, “Our new product. Video data to be displayed on the screen 4a is stored. This video data has products that are guided by, for example, “Our new product. Please see.” This video data can be changed to various video contents.

  The sound generation unit 15 is a speaker, for example. The sound generation unit 15 is provided on the upper left side of the large monitor display device 4, for example, toward the large monitor display device 4. The sound generation unit 15 may output monaural sound, binaural sound, or multi-channel stereo sound.

Next, the audio / video information notification operation by the system configured as described above will be described with reference to the audio / video information notification flowchart shown in FIG.
In step S <b> 1, the imaging device 3 images the surrounding situation in front of the display screen 4 a of the large monitor display device 4 and outputs the image signal. This image signal is sent to the image processing unit 6. Note that the imaging device 3 may capture the surrounding situation in front of the large monitor display device 4 as a moving image, or may capture a single image at predetermined intervals.
The image processing unit 6 receives an image signal output from the imaging device 3, digitally converts the image signal, and performs various image processing to obtain image data. Note that the image data is stored in an image memory or the like.

  Next, the head / front face determination unit 7 receives the image data acquired by the image processing unit 6, analyzes the image data, and determines the head and front face of the viewer 5 included in the image data. recognize. That is, the head / front face determination unit 7 receives the image data acquired by the image processing unit 6, reads a plurality of reference head data from the head data storage unit 8, and reads the image data and the plurality of reference heads. A matching process is performed on each of the data, and an area in the image data having a preset matching rate is recognized as the head of the viewer 5. In this matching process, there are a plurality of reference head data according to, for example, the shape of the viewer 5's head, the size of a child or an adult, various hairstyles, and the like. Is recognized as the head of the viewer 5.

Next, the first counting unit 11 in the evaluation unit 10 receives information on the head of the viewer 5 recognized in the image data by the head / frontal face determination unit 7 and receives the information on the viewer 5 in the image data. Count the number of head regions.
Next, in step S2, the control unit 13 determines whether or not the count value of the first counting unit 11 exceeds a preset first predetermined value n. That is, the control unit 13 recognizes the number of head regions of the viewer 5 counted by the first counting unit 11 as the number of viewers existing in front of the display screen 4a of the large monitor display device 4. Then, it is determined whether or not the number of viewers exceeds a preset first predetermined value n (for example, n = 4). In this determination, even when the number of viewers reaches a preset first predetermined value n (for example, n = 4), the number of viewers is also set to a first predetermined value n (for example, n = 4). Judgment exceeding the person).

  For example, as shown in FIG. 4, there are two viewers 5A and 5B around the front of the display screen 4a of the large monitor display device 4, and only one viewer 5A among them is the imaging field of view of the imaging device 3. If the situation is within 3a, the image data Da acquired by imaging by the imaging device 3 is, for example, only one viewer 5A as shown in FIG. Note that the arrow “←” attached to each viewer 5A, 5B in FIG. 4 indicates the moving direction of each viewer 5A, 5B.

  Accordingly, the head / frontal face determination unit 7 performs matching processing between the image data Da and the plurality of reference head data, respectively, and selects the area Ea in the image data having a preset matching rate as the viewer 5A. Recognize as the head. Then, the first counting unit 11 counts the number “1” of the area Ea of the head of the viewer 5 </ b> A recognized in the image data Da. The control unit 13 uses the number “1” of the head area of the viewer 5A counted by the first counting unit 11 as the number of viewers 5A existing in front of the display screen 4a of the large monitor display device 4. 1 ”, it is determined whether or not the number of viewers“ 1 ”of the viewer 5A exceeds a preset first predetermined value n (for example, n = 4). As a result of this determination, the number of viewers 5A “1” does not exceed a preset first predetermined value n (for example, n = 4), so the control unit 13 repeats steps S1 and S2, The state waits for the number of viewers 5 to exceed a preset first predetermined value n (for example, n = 4).

  Next, for example, as shown in FIG. 6, there are four viewers 5 </ b> A to 5 </ b> C around the front of the display screen 4 a of the large monitor display device 4, and these four viewers 5 </ b> A to 5 </ b> C If the situation is within the imaging field of view 3a, the image data Db acquired by the imaging of the imaging device 3 is, for example, four viewers 5A to 5C as shown in FIG.

  Therefore, similarly to the above, the head / frontal face determination unit 7 performs matching processing between the image data Db and the plurality of reference head data, respectively, and the region Ea in the image data having a preset matching rate. -Ed are recognized as the heads of four viewers 5A-5D, respectively. Then, the first counting unit 11 counts the number “4” of the head regions Ea to Ed of the four viewers 5A to 5D recognized in the image data Db. The control unit 13 sets the number “4” of the head regions Ea to Ed of the four viewers 5A to 5D counted by the first counting unit 11 in front of the display screen 4a of the large monitor display device 4. The number of viewers present is recognized as “4”, and it is determined whether the number of viewers “4” exceeds a preset first predetermined value n (for example, n = 4).

  As a result of this determination, since the number of viewers “4” exceeds a preset first predetermined value n (for example, n = 4), the control unit 13 proceeds to step S3, and the first content A command for reproducing information is issued to the notification unit 14. As a result, the notification unit 14 displays the large-scale monitor as the first content information stored in the audio data storage unit 16 for the four viewers 5A to 5D existing in the peripheral area of the large-sized monitor display device 4. At least audio data that prompts the user to gaze on the display screen 4a of the apparatus 4, for example, “customer welcome” is read out. At the same time, the notification unit 14 displays the audio data, for example, “customer welcome” as the first content information stored in the video content storage unit 17, and the display screen 4 a of the large monitor display device 4. Video data to be displayed is read out, for example, video data showing a female guide who generates a greeting of “customer welcome”.

  Then, the notification unit 14 drives the large monitor display device 4 and the utterance unit 15 in accordance with the control of the control unit 13, and for example, as shown in FIG. At the same time, the video data showing the female W of the guide who generates the greeting of “customer welcome” is displayed on the display screen 4 a of the large monitor display device 4. At this time, for example, it is possible to cancel the projection of the video data of the female lady W of the guide by using only the words of greetings such as “Come to you”. Thereby, all four viewers 5A to 5D existing in front of the display screen 4a of the large monitor display device 4 can face the display screen 4a of the large monitor display device 4.

Next, in step S4, the imaging device 3 images the surrounding situation in front of the display screen 4a of the large monitor display device 4 and outputs the image signal. The image processing unit 6 receives an image signal output from the imaging device 3, digitally converts the image signal, and performs various image processing to obtain image data.
Next, the head / frontal face determination unit 7 performs matching processing between the image data and the plurality of reference frontal face data, and the region in the image data having a preset matching rate is determined by the viewer 5. Recognize as a front face. For example, as shown in FIG. 9, there are three viewers 5B to 5C around the front of the display screen 4a of the large monitor display device 4, and these three viewers 5B to 5C are captured by the imaging field 3a of the imaging device 3. If the situation is within, the image data Dc acquired by the imaging of the imaging device 3 is, for example, as shown in FIG. 10 in which three viewers 5B to 5C are captured.

Accordingly, the head / front face determination unit 7 receives the image data Dc acquired by the image processing unit 6, reads a plurality of reference front face data from the front face data storage unit 9, and the image data Dc and the plurality of pieces of image data Dc. Matching processing is performed with respect to the reference front face data, and the areas Fb to Fd in the image data Dc having a preset matching rate are recognized as the front faces of the three viewers 5B to 5C. In this matching process, for example, there are a plurality of reference front face data according to, for example, the shape, size, position, etc. of the viewer's 5 eyes, nose, mouth, and so on. All of the areas Fb to Fd are recognized as front faces of the three viewers 5B to 5C.
Next, the second counting unit 12 in the evaluation unit 10 receives the information of the front face of the viewer 5 recognized by the head / front face determination unit 7, and the three viewers 5B to 5C in the image data. The number “3” of the respective areas Fb to Fd of the front face is counted.

  Next, in step S5, the control unit 13 determines whether or not the count value “3” of the second counting unit 12 exceeds a preset second predetermined value m. That is, the control unit 13 displays each area Fb to Fd of the front face area of the viewers 5B to 5C counted by the second counting unit 12 in front of the display screen 4a of the large monitor display device 4. It is recognized as the front face of the three viewers 5B to 5C who are looking at the display screen 4a of the display device 4, and the number “3” of the front faces of these viewers 5B to 5C is set in advance as a second predetermined value. It is determined whether or not m (for example, m = 3) is exceeded. In this determination, when the number of viewers 'front faces reaches a preset second predetermined value m (for example, m = 3), the number of viewers' front faces is preset to a second predetermined value. Judgment exceeds m (for example, m = 3).

  Note that the second predetermined value m set in advance is preferably set to a value smaller than the first predetermined value n. That is, the determination using the first predetermined value n is the number of viewers existing in front of the viewer's head, that is, the display screen 4a of the large monitor display device 4, and the second predetermined value m is It is determined by the number of viewers facing the front face of the viewer, that is, the display screen 4a of the large monitor display device 4. Accordingly, since the probability that all the viewers existing in front of the display screen 4a of the large monitor display device 4 are facing the display screen 4a of the large monitor display device 4 is small, the second predetermined value m is the first predetermined value m. It is preferable to set a value smaller than the predetermined value n.

  As a result of the determination, since the number of front faces “3” of the viewers 5B to 5C exceeds a preset second predetermined value m (for example, m = 3), the control unit 13 proceeds to step S6. Then, a command for reproducing the second content information is issued to the notification unit 14. As a result, the notification unit 14 reads out the audio data included in the main information as the second content information stored in the audio data storage unit 16, for example “Our new product. Please see”. At the same time, the notification unit 14 displays the above-mentioned audio data as the second content information stored in the video content storage unit 17, for example, a large monitor display together with the audio output of “Our new product. Please see.” Video data to be displayed on the display screen 4a of the apparatus 4 is read out, for example, video data showing a new product H guided as “Our new product. Please see”.

  Then, the notification unit 14 drives the large monitor display device 4 and the utterance unit 15 according to the control of the control unit 13, and for example, from the utterance unit 15 as shown in FIG. 11, for example, “Our new product. And the video data for projecting the product H to be guided, such as “Our new product. Please see.” Are displayed on the display screen 4a of the large monitor display device 4.

Next, in step S <b> 7, the imaging device 3 images the surrounding situation in front of the display screen 4 a of the large monitor display device 4 and outputs the image signal. The image processing unit 6 receives an image signal output from the imaging device 3, digitally converts the image signal, and performs various image processing to obtain image data.
Next, similarly to the above, the head / front face determination unit 7 performs matching processing between the image data and the plurality of reference front face data, and determines regions in the image data having a preset matching rate. It is recognized as the front face of the viewer 5.
Next, the second counting unit 12 in the evaluation unit 10 receives the information on the front face of the viewer 5 recognized by the head / front face determination unit 7, and the area of the front face of the viewer in the image data is received. Count the number of people.

Next, in step S8, the control unit 13 sets a third predetermined value p (here, p = 0) in which the number of viewers' front face areas counted by the second counting unit 12 is set in advance. It is determined whether or not.
If the number of the front faces of the viewer is not “0” as a result of this determination, the notification unit 14 drives the large monitor display device 4 and the utterance unit 15 according to the control of the control unit 13, for example, as shown in FIG. As shown in the drawing, the speech unit 15 generates a greeting such as “Our new product. Please see.” And also displays on the display screen 4a of the large monitor display device 4, for example, “Our new product. Please continue to project the video data that shows the product H to be guided.
Note that the control unit 13 may display, for example, video data of the new product H as the second content information immediately after the sound of “customer welcome” is reproduced as the first content information, for example.

  On the other hand, if the number of viewers' front faces becomes “0” and it is determined that no one is looking at the display screen, the control unit 13 proceeds to step S9 and stops the reproduction of the second content information. In other words, the voice generation unit 15 generates a greeting such as “Our new product. Please see”, and the display screen 4a of the large monitor display 4 shows, for example, “Our new product. Stop projecting the video data that projects the product H to be guided.

  As described above, according to the above-described embodiment, the surrounding situation in front of the display screen 4a of the large monitor display device 4 is imaged and recognized as the number of viewers existing in front of the display screen 4a of the large monitor display device 4. If the number of viewers exceeds a preset first predetermined value n (for example, n = 4), the first content information is at least a voice message from the utterance unit 15 such as “Come to you”. After that, the number “3” of the front faces of the three viewers 5B to 5C who are viewing the display screen 4a of the large monitor display device 4 is set to a second predetermined value m (for example, m = 3), the second content information is displayed on the display screen 4a of at least the large monitor display device 4, for example, a product H that is guided as “Our new product. Please see.” Mirror the data.

  Thereby, advertisement information such as a new product can be effectively provided to viewers, for example, three viewers 5B to 5C. That is, there is no need to wait until the number of viewers watching the display screen 4a of the large monitor display device 4 increases, and the number of viewers existing in front of the display screen 4a of the large monitor display device 4 is, for example, the first. If the predetermined value n is larger than the predetermined value n (for example, n = 4), even if these viewers are not viewing the display screen 4a of the large monitor display device 4, the voice content is sent from the utterance unit 15 as the first content information, for example. By generating a greeting word “No.”, a viewer existing in front of the display screen 4 a of the large monitor display device 4 can be watched on the display screen 4 a of the large monitor display device 4. For example, all viewers and the like existing in front of the display screen 4 a of the large monitor display device 4 can be directed to the display screen 4 a of the large monitor display device 4.

Then, at least the display screen of the large monitor display device 4 as the second content information in a state where the viewer existing in front of the display screen 4a of the large monitor display device 4 is focused on the display screen 4a of the large monitor display device 4. For example, since the video data that projects the product H that is guided as “Our new product. Please see.” Is displayed on 4a, the product is displayed to the viewer existing in front of the display screen 4a of the large monitor display device 4. Second content information such as H can be viewed.
Here, for example, the timing of the playback of the second content information such as “Our new product. Please take a look.” Is right after the end of the playback of the first content information such as “Customer welcome.” It is effective to reproduce when the viewer is gazing at the display screen 4 a of the large monitor display device 4.

The first content information is not limited to “customer welcome”, for example, but may be any content as long as it is a content such as “Is it okay?” There may be.
Also, as the second content information, for example, the video data of the product H guided as “Our new product. Please see” is not displayed on the display screen 4a of the large monitor display device 4, but the viewer. Since the reproduction of the second content information is stopped when the number of front faces of the user becomes “0”, the reproduction of the second content information is stopped if there is no viewer in front of the large monitor display device 4. Therefore, useless power is not consumed, which is effective from the viewpoint of energy saving.

  Further, since it is determined whether or not the number of front faces of the viewer watching the display screen 4a of the large monitor display device 4 has exceeded a preset second predetermined value m, the display of the large monitor display device 4 is performed. Even if there are more viewers than the third predetermined value in front of the screen 4a, if these viewers are not facing the display screen 4a of the large monitor display device 4, for example, video data of the product H is displayed. In this case as well, energy saving can be realized.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

1 is a configuration diagram showing an embodiment of an audio / video information notification system according to the present invention. The figure which shows sound generating parts, such as a large sized monitor display apparatus and a speaker, in the apparatus. The audio | video information alerting | reporting flowchart in the same apparatus. The figure which shows the case where one viewer exists in the front periphery of the display screen of the large sized monitor display apparatus in the same apparatus. FIG. 4 is a schematic diagram of image data when one viewer is present around the front of the display screen of the large monitor display device in the same apparatus. The figure which shows the case where four viewers exist in the front periphery of the display screen of the large sized monitor display apparatus in the same apparatus. FIG. 4 is a schematic diagram of image data when there are four viewers around the front of the display screen of the large monitor display device in the same device. The figure which shows the image | video which displays the words of the greetings and the woman of the guide which are uttered from the utterance part by the notification part in the apparatus. FIG. 4 is a schematic diagram of image data when there are three viewers around the front of the display screen of the large monitor display device in the apparatus. FIG. 4 is a schematic diagram of image data when there are three viewers around the front of the display screen of the large monitor display device in the apparatus. The figure which shows the image | video of the product displayed on a large sized monitor display apparatus by the notification part in the apparatus.

Explanation of symbols

  1: lens system, 2: imaging unit, 3: imaging device, 4: large monitor display device, 4a: display screen of large monitor display device, 5: viewer, 6: image processing unit, 7: head / front face Determination unit, 8: head data storage unit, 9: front face data storage unit, 10: evaluation unit, 11: first counting unit, 12: second counting unit, 13: control unit, 14: notification unit, 15: Sound generator, 16: Audio data storage, 17: Video content storage.

Claims (9)

In an audio / video information notification system having an audio output device that outputs audio information and a display device that displays video information,
Imaging means for imaging a peripheral area of the display device;
First counting means for analyzing the image data acquired by imaging of the imaging means and counting the number of notified objects that receive notification of information existing in the peripheral area of the display device;
Second counting means for analyzing the image data acquired by imaging of the imaging means and counting the number of the notified objects facing in the direction of the display device;
The audio output device and the display device are respectively driven and controlled, and when the count value of the first counting means exceeds a first predetermined value, the first content information is reproduced, and thereafter the second content information is reproduced. Control means for reproducing the second content information when the count value of the counting means exceeds a second predetermined value;
An audio / video information notification system comprising:   2. The first content information includes at least audio information that prompts a user to gaze on a display screen of the display device with respect to the notification target existing in a peripheral area of the display device. Audio / video information notification system.   The audio / video information notification system according to claim 1, wherein the second content information includes main information to be notified to the notification target existing in a peripheral area of the display device.   The said 2nd counting means analyzes the image data acquired by the imaging of the said imaging means, recognizes the face of the said notification target, and counts the number of the said faces. Audio / video information notification system.   2. The audio / video information notification system according to claim 1, wherein the control means reproduces the second content information immediately after reproducing the first content information.   2. The audio / video information according to claim 1, wherein the control means stops the reproduction of the second content information when the count value of the first counting means becomes equal to or smaller than a third predetermined value. Notification system.   2. The audio / video information notification system according to claim 1, wherein the control means can set the second predetermined value to a value smaller than the first predetermined value.   The imaging means is provided in a peripheral portion of the display device, and is installed in a direction of an imaging field of vision facing the face of the notification target that is gazing at a display screen of the display device. Item 6. The audio / video information notification system according to item 1. In the control method of the audio / video information notification system for driving and controlling the audio output device that outputs the audio information and the display device that displays the video information to notify the audio information and the video information,
Imaging the peripheral area of the display device,
Analyzing the image data acquired by the imaging, and counting the number of notification targets to be notified of information existing in the peripheral area of the display device,
Driving control of at least one of the audio output device and the display device, and playing back the first content information when the count value exceeds a first predetermined value,
Analyzing the image data acquired by the imaging, counting the number of the notification target facing the direction of the display device,
Driving control of at least one of the audio output device and the display device, and reproducing the second content information when the count value exceeds a second predetermined value;
A control method for an audio / video information notification system.

Images