JP4859876B2 - Information processing device - Google Patents

Description

  The present invention relates to an information processing apparatus, and more particularly to an information processing apparatus for providing advertisement information and the like to a person around an output device such as a display or a speaker using the output device.

  In recent years, devices that present information using a display device, a speaker, or the like have become widespread.

In addition, devices that detect people nearby using human sensors and cameras, etc., and operate according to the detection status when people are nearby are also being used. (For example, refer nonpatent literature 1).
(URL: http: //www.microsoft.com/presspass/press/2008/feb08/02-05AdLabsDemoPR.mspx> Microsoft adCenter Labpress release

  However, even if the technology for detecting the presence of a person in the perception of an object with the above-described prior art is applied to the advertisement output at the time of detection, the moving speed of the person viewing the advertisement and the distance from the display device or the speaker are reduced. Because it is not taken into account, it may provide an unacceptable amount of information to a person who moves in a hurry, or may not provide detailed information to a person who stops and watches.

  In addition, since the distance from the output device to the subject is not taken into consideration, a character that cannot be read by a person far from the display device or the like may be presented, or a sound that cannot be heard from the speaker may be output.

  On the other hand, too close to a display device, etc., a letter that is too large may be missed, and the opportunity to provide further information may be missed, or too much noise may be output, causing the target person to leave quickly. There is.

  Thus, if the technique of Non-Patent Document 1 is applied to the output of an advertisement as it is, there is a problem that the opportunity of providing an advertisement cannot be effectively used.

  The present invention has been made in view of the above points, and is based on the distance between the output device and the information provision target, the direction of movement of the information provision target, and the like when outputting advertisement information such as images and sounds. An object of the present invention is to provide an information processing apparatus that can optimize the amount of information that can be displayed.

  FIG. 1 is a principle configuration diagram of the present invention.

The present invention (Claim 1) is an information processing apparatus for providing information to a person who is an object of providing information from an output unit including a display and a speaker based on a detection result of a sensor ,
The detection result obtained from the sensor 110 is analyzed , the position and moving direction of an object (hereinafter referred to as “ information provider ” ) around the sensor 110 is analyzed, and the sensor identifier is assigned to the sensor. Sensor result processing means 122 for outputting an analysis result ;
Based on the sensor analysis result, obtains the distance from the information providing subject to display, when it is detected that the information providing subject is approaching, based on the distance, the information providing subject The volume that can be heard by the information provider is controlled so that the volume does not decrease below the volume obtained by adding a predetermined volume to the volume that was previously heard by the information provider. Output control means 250 for outputting
Storage means for recording the volume heard by the information provider;
Consists of.

  Thereby, based on the number and positions of the sensor analysis results from the sensor means, it is possible to output video and audio from the output means 260 (display or speaker) to the information providing target person.

Further, the present invention (Claim 2 ) is characterized in that in the output control means 250 of Claim 1 ,
A means for controlling the volume of sound heard by the information providing target person so as not to exceed a separately determined maximum value based on the distance from the information providing target person to the display is included.

  As described above, according to the present invention, the result measured by the sensor is analyzed, the analysis result and the operation rule are collated, the appropriate content to be output to the output means (display) is selected, and according to the distance. The amount of information to be displayed can be optimized by changing the display size. In addition, a display method and sound reproduction that are most effective for the information providing target, such as adjusting the volume of sound output to the speaker in accordance with the distance to the viewer, can be realized.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 2 shows a system configuration in an embodiment of the present invention.

  In the system shown in the figure, a plurality of sensor units 100 and a display unit 200 are connected via a network 500.

  The sensor unit 100 includes one or more sensors 110, a CPU 120, a sensor position information storage unit 130, and a measurement result memory 131. The sensor position information storage unit 130 is a storage medium such as a memory or a hard disk.

  If a camera is used as the sensor 110, the still image / moving image and the shooting time taken by the camera are unique, and if a human sensor is used, the measurement result and measurement time are uniquely assigned to each sensor. The given sensor identifier is assigned and output to the CPU 120.

  The sensor position information storage unit 130 is a storage medium such as a memory or a hard disk, and displays the position and orientation of a display for displaying information, the sensor identifier for each sensor, and the position and orientation of the sensor unit 110 in the entire apparatus. Stored as coordinates. In addition, when the sensor part 100 and the display part 200 are in the same housing, any one positional information may be sufficient.

  The CPU 120 includes a sensor result acquisition unit 121, a sensor result processing unit 122, and a calculation result output unit 123.

  The sensor result acquisition unit 121 acquires a still image / moving image acquired from the sensor 110A (camera) or a detection result acquired from the sensor 110B (human sensor), and temporarily stores it in the measurement result memory 131 together with a sensor identifier for each sensor. Store.

  The sensor result processing unit 122 analyzes the detection result stored in the measurement result memory 131, searches the sensor position information storage unit 130 based on the sensor identifier included in the detection result, and acquires the sensor position information. Then, the position, moving speed and moving direction of the surrounding person are obtained from the position information and the contents of the detection result. In addition, it calculates how many people are in the total.

  Here, as an analysis method, for example, a still image or a moving image obtained by continuously capturing images with a camera is acquired from the measurement result memory 131, and a moving direction of up / down / left / right from a difference for each image in time series, or , a method of obtaining the moving speed in advance where to examine how to move when there are people, may be stored in a memory (not shown), can be determined by comparing its image . An example is shown in FIG. The field of view from the camera is divided and managed in a matrix, and changes in movement and distance are calculated from changes in the size of the person on the time axis. For the distance, the distance from the sensor position is calculated with reference to the sensor position information storage unit 130 based on the sensor identifier. Further, the moving direction or moving speed of the camera's line-of-sight direction is obtained using enlargement / reduction in the field of view of the camera. Also, a certain person is identified within the camera field of view, and the time during which there is no movement (dwell) is obtained.

  Since the measurement result of the sensor 110 is a relative position with respect to the position and orientation of the sensor 110, information on the sensor position information storage unit 130 in which the measurement result, where the sensor 110 is located, and in what direction is recorded. Can be converted into a coordinate system for the entire configuration rather than relative to each sensor.

  When the sensor is the human sensor 110B, the position where the human sensor 110B is arranged and the sensitivity of the sensor 110B are acquired and analyzed.

  The sensor analysis result obtained as described above is output to the calculation result output unit 123.

  The calculation result output unit 123 outputs the sensor analysis result obtained by the sensor result processing unit 122 to the display unit 200 via the network 500.

  The display unit 200 includes a calculation result acquisition unit 210, an analysis result memory 211, an operation rule storage unit 230, a video / audio data storage unit 240, an output control unit 250, and an output unit 260 such as a display or a speaker. The operation rule storage unit 230 and the video / audio data storage unit 240 are storage media such as a memory and a hard disk.

  The operation rule storage unit 230 includes a display rule that is a rule for displaying moving images, still images, characters, and the like on a display, and an audio reproduction rule that is a rule for reproducing audio.

  A display rule is shown in FIG. As shown in the figure, the display rules are the direction of movement (people coming from the left and people coming from the right), multiple people who are approaching or moving away from the display device and stay in a certain place for a predetermined time. It is set to be able to determine the action to be taken by combining these conditions.

  The sound rule is set with a volume for each distance, a maximum output of the speaker, an output regulated by law, and the like. Also, the audio information playback speed is set for each distance between the speaker and the information providing target person. By referring to the voice reproduction rule, it is possible to slightly increase the volume when the information providing target approaches the speaker with interest.

  The video / audio data storage unit 240 stores video data for display, audio data for output from a speaker, and instruction information for video / audio output. For example, instruction information such as MPEG video and audio or SMIL is stored. As the instruction information, there are video instruction information for controlling display of video data and voice instruction information for controlling reproduction of audio data. For example, in the video instruction information, when the moving direction of the line of sight is approaching the display, the display size of moving images / still images, characters, etc. is reduced, and the display is increased when moving away from the display direction. . In addition, when the distance of the sensor analysis result acquired from the sensor unit 100 is equal to or less than a predetermined distance, a setting is made so as not to decrease from the size displayed so far.

  As the voice instruction information, when the moving direction of the line-of-sight direction is approaching the speaker, as a corresponding operation, the reproduction volume is decreased and is increased when the movement is away. In addition, when the distance of the sensor analysis result acquired from the sensor unit 100 is equal to or less than a predetermined distance, instruction information such as fixing the volume is set so as not to be equal to or lower than the volume that has been reproduced so far. .

  The calculation result acquisition unit 210 is located in the viewable range of the output unit (display) 260 from one or more sensor units 100 via the network 500, and in which direction and at what speed. The sensor analysis results such as are acquired.

  The output control unit 250 collates the acquired sensor analysis result with the display rules stored in the operation rule storage unit 230 illustrated in FIG. 4 and determines an operation to be performed on the output unit (display) 260. When the display rule shown in FIG. 4 is referred to, for example, when the detection result is “a person has come from the left” or “stops for 3 seconds or more”, “action A” is selected as the action to be taken. When the operation relates to display, the video data is acquired from the video / audio data storage unit 230, and the video data is output based on the display instruction information of the video / audio data storage unit 240 corresponding to the video data. Display) 260. If the selected operation is related to reproduction of audio data, the audio data is read from the video / audio data storage unit 230 to the output unit (speaker) 260 and reproduced based on the audio instruction information.

  If there is no operation to be selected in the operation rule storage unit 230, a predetermined operation is performed. As the operation, nothing is presented, landscape video or background music is reproduced, advertisements stored in the video / audio data storage unit 230 are randomly displayed, or a combination thereof is output. It is possible.

  When there are a plurality of operations to be selected as a result of referring to the operation rule storage unit 230, one of them is selected. As a selection method, you may select at random, select an item with a large or small number of presentations, select an item other than the content displayed immediately before, or a combination thereof.

  In addition, when the position, movement direction, and movement speed of the information providing target change while the operation selected above is presented on the display or speaker, the information is sequentially acquired from the sensor and the operation is switched. Is possible.

  The measurement of the sensor unit 100 is used to select an advertisement in accordance with the situation on the display unit 200. Therefore, the accuracy is not strictly required, but it is desirable to use a device with sufficiently high sensor detection / response speed. This is because, if there is an error in the measurement result, a non-optimal advertisement may be displayed, but even in that case, since some advertisement is presented, the advertising effect is not zero. However, if the measurement is slow, there is a possibility that the information provision target person will leave and present an advertisement.

  The operation in the above configuration will be described.

  First, an example in which the display content is changed according to the distance will be described.

  FIG. 5 is a flowchart in the case where the display content is changed according to the distance according to the embodiment of the present invention.

  Step 101) The information providing person is photographed by the sensor 110A (camera) of the sensor unit 100, and the moving image or the still image is output to the sensor result acquisition unit 121. The sensor result acquisition unit 121 stores a moving image or a still image at a time within a predetermined threshold in the measurement result memory 131 together with a sensor identifier.

Step 102) The sensor result processing unit 122 reads data from the measurement result memory 131, refers to the sensor position information storage unit 130 based on the sensor identifier, acquires the position information of the sensor 110A, and acquires the position information and the measurement result memory. Using the measurement result 131, the distance from the position of the sensor 110 </ b> A to the position of the information providing target person is calculated and sent to the calculation result output unit 123. At this time, if the size of the information provision target is gradually increasing, it indicates that the person is approaching the sensor 110A, and if it is decreasing, it indicates that the person is moving away. With respect to the position of the provision target person, respective distances within a certain time threshold value (t,..., T _n− 1, t _n ) are obtained and used as sensor analysis results. Thereby, the calculation result output unit 123 sends the sensor diffraction result (n distance data to the information providing target person) to the display unit 20 via the network 500.

  Step 103) The calculation result acquisition unit 210 of the display unit 20 acquires the sensor analysis result from the sensor unit 100, and in the output control unit 250, the distance to the information provider of the sensor analysis result and a memory (not shown) in advance. ), The lower limit value of the drawing size of characters and figures is calculated from the minimum value of the viewing angle that can be viewed.

  Step 104) Further, the output control unit 250 refers to the function information of the display stored in advance in a memory (not shown), obtains the upper and lower limits of drawing on the display, and sets the lower limit of drawing. A condition for the amount of information that can be displayed is calculated from the size of the output unit (display) 260.

Step 105) The output control unit 250 refers to the display rule of the operation rule storage unit 230 in FIG. 3 and determines an operation to be taken. When the sensor 110 detects that the information providing target is approaching the position of the sensor (when the distance data decreases in the time (t,..., T _n− 1, t _n ) range. ) Goes to Step 106, and if not (if the distance data increases in the range of time (t,..., T _n− 1, t _n )), goes to Step 107.

  Step 106) The output control unit 250 refers to the instruction information in the video / audio data storage unit 240, is an advertisement with an information amount equal to or less than the upper limit of the information amount calculated in Step 104, and displays characters and graphics. An advertisement (video data / audio data) whose minimum drawing size is not smaller than the currently presented advertisement is selected and displayed on the output unit (display) 260, and the process ends. As described above, when the distance to the information providing target is short, a large amount of information can be presented by reducing the characters.

  Step 107) When the information provision target is away, the output control unit 250 selects an advertisement whose information amount is equal to or less than the upper limit of the information amount calculated in Step 104 from the video / audio data storage unit 240, and outputs it. Displayed on the unit (display) 260, and the process ends. As described above, when the distance to the information providing target is increased, it is possible to recognize the advertisement information even if the user is far away by presenting a large advertisement that is easy to see.

  Next, a case where the display position is changed according to the position will be described.

  FIG. 6 is a flowchart for changing the display position in accordance with the position according to the embodiment of the present invention.

  Step 201) The information target person is photographed by the sensor 110A (camera) of the sensor unit 100, and is output to the sensor result acquisition unit 121 together with the moving image or the still image and the identifier of the sensor. The sensor result acquisition unit 121 stores an image at a time within a predetermined threshold in the measurement result memory 131.

  Step 202) The sensor result processing unit 122 obtains the movement direction of the information providing target person from the image within the predetermined time from the measurement result memory 131 by the method shown in FIG. 3, and obtains the position of the information providing target person.

  Step 203) The sensor result processing unit 122 refers to the sensor position information storage unit 130 based on the sensor identifier, and displays based on the acquired position information of the display and the position of the information providing target obtained in Step 202. The position is calculated and the position is converted into coordinates. Specifically, as shown in FIG. 7, the positions of the three vertices are determined from the position of the information providing target person and the position information of the display stored in the sensor position information storage unit 130, and the angle of the information providing target person position is determined. The bisector is calculated as a place where a point where the bisector intersects the position of the display is displayed, and this is output from the calculation result output unit 123 as a sensor analysis result.

  Step 204) When the calculation result acquisition unit 210 of the display unit 200 acquires the display location on the output unit (display) 260 determined by the sensor unit 100, the output control unit 250 displays the video data and instruction information storage unit 240. Then, an advertisement is selected and displayed on the display position of the display 260, and the process is terminated.

  Next, a case where the volume or the sound for reproducing the video is changed according to the distance will be described.

  FIG. 8 is a flowchart (part 1) in the case where the volume or the sound to be reproduced is changed according to the distance in the embodiment of the present invention.

  Step 301) Same as step 101 in FIG.

  Step 302) The same as step 102 in FIG.

  Step 303) The calculation result acquisition unit 210 of the display unit 20 acquires the sensor analysis result from the sensor unit 100, and the output control unit 250 presets the distance to the information providing target person of the sensor analysis result and the operation rule. Based on the sound volume for each distance of the sound reproduction rule in the storage unit 230, the minimum value of the sound volume necessary for the information providing target person to hear the sound is calculated.

  Step 304) Further, the output control unit 250 refers to speaker capability information stored in advance in a memory (not shown), and the minimum value of the volume necessary to hear the sound exceeds the speaker capability. Whether or not the size is legally not permitted is determined by referring to the audio reproduction rule in the operation rule storage unit 230. If it is either, the process proceeds to step 305, and if not, the process proceeds to step 307.

  Step 305) The output control unit 250 determines the upper limit of the information presentation speed that can be understood by the information providing target person from the maximum volume that can be reproduced and the distance to the information providing target person.

  Step 306) The output control unit 250 selects an advertisement (audio data) that is equal to or less than the audio information reproduction speed determined from the video / audio data storage unit 240, and based on the audio instruction information corresponding to the advertisement, It outputs to the output part 260 (speaker), and complete | finishes a process.

  Step 307) In step 304, if the capacity of the speaker is not exceeded and is within the scope of the law, it is determined whether the information providing subject is approaching. The determination method is the same as step 106 in FIG. If it is approaching, the process proceeds to step 308, and if it is moving away, the process proceeds to step 309.

  Step 308) The output control unit 250 selects an advertisement (audio data) to be output from the video / audio data storage unit 240, and outputs the advertisement (audio data) from the speaker 260 at a volume that is higher than the volume calculated in step 303 by a predetermined volume. Exit.

  In this process, since the information providing target who is approaching the speaker is considered to be difficult to hear the sound, the information is output at a predetermined volume.

  Step 309) If the information providing target is away, select the content to be output from the video / audio data storage unit 240, output it from the output unit (speaker) 260 at the volume calculated in Step 303, and terminate the process. To do.

  In the above, an example is shown in which the volume that can be heard by the information providing target person approaching the speaker 260 is controlled so as not to decrease, but in the following, the volume that is output to the information provider does not exceed the maximum value. An example of control will be described.

  FIG. 9 is a flowchart (part 2) when the volume or the sound to be reproduced is changed according to the distance according to the embodiment of the present invention. The same steps as those in the flowchart of FIG. 8 are given the same step numbers, and descriptions thereof are omitted.

  Step 401) Based on the distance calculated in Step 302, the output control unit 250 determines the volume necessary for the information providing target person to hear the sound and the information providing target person when the advertisement sound is reproduced at the sound volume. Calculate the audible volume.

  Step 402) In Step 307, when the information providing target is approaching, the volume that is larger than the volume heard by the previous information providing target by a predetermined volume (0 in the case of the first advertisement reproduction) is the step. It is determined whether it is larger than the volume that can be heard by the information providing target calculated in 401. If it is larger, the process proceeds to step 404. If it is smaller, the process proceeds to step 403. In addition, the above-mentioned “volume heard by the previous information providing target” means the volume stored in the storage means (not shown) after outputting the previously output volume (0 in the first time). Point to.

  Step 403) The advertisement sound is reproduced by the speaker 260 at the volume calculated in Step 401, and the process proceeds to Step 405.

  Step 404) The advertisement sound is reproduced at a volume (0 in the case of the first advertisement reproduction) that is higher than the volume heard by the information provision target last time by a predetermined volume.

  Step 405) The sound volume heard by the information providing subject is recorded in a storage means (not shown).

  By performing the process shown in FIG. 9, it is possible to avoid discomfort at an excessively loud volume for the information providing target person who has approached to view the advertisement sound.

  In the above embodiment, an example is shown in which a camera is used as a sensor, but a human sensor may be used. Even if a human sensor is used, it is possible to obtain sensor analysis results such as the distance between the sensor and the information providing target, the moving direction, and the moving speed. Therefore, the display unit 200 performs the same processing as described above. be able to.

  In the above embodiment, the sensor unit 100 and the display unit 200 have been described as being connected via the network 50. However, the present invention is not limited to this example, and the sensor unit 100 and the display unit 200 are combined into one casing. It is also possible to provide it.

  Further, the operation of the components of the sensor unit 100 and the display unit 200 shown in FIG. 2 is constructed as a program, and is installed and executed on a computer used as a device that combines the sensor unit, the display unit, and both. Or can be distributed via a network.

  Further, the constructed program can be stored in a portable storage medium such as a hard disk, a flexible disk, or a CD-ROM, and can be installed or distributed in a computer.

  The present invention is not limited to the above-described embodiment, and various modifications and applications can be made within the scope of the claims.

  The present invention can be applied to a technology for outputting a display advertisement, a sound advertisement, or various contents.

It is a principle block diagram of this invention. 1 is a system configuration diagram according to an embodiment of the present invention. It is a figure for demonstrating the sensor part in one embodiment of this invention. It is an example of the display rule in one embodiment of this invention. It is a flowchart of the example which changes a display content according to the distance in one embodiment of this invention. It is an example which changes a display position according to the position in one embodiment of the present invention. It is a figure which shows the method of determining a display position from the position of the viewer in one embodiment of this invention. It is a flowchart (the 1) in the case of changing a sound volume or the audio | voice to reproduce | regenerate according to the distance in one embodiment of this invention. It is a flowchart (the 2) in the case of changing a sound volume or the audio | voice to reproduce | regenerate according to the distance in one embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Sensor means, sensor part 110 Sensor 110A Sensor (camera)
110B sensor (human sensor)
120 CPU
121 sensor result acquisition unit 122 sensor result processing unit, sensor result processing unit 123 calculation result output unit 130 sensor position information storage unit 131 measurement result memory 200 display unit, display unit 210 sensor analysis result acquisition unit 211 analysis result memory 230 rule storage unit , Operation rule storage unit 240 video / audio data storage unit 250 output control unit, output control unit 260 output unit, output unit

Claims (2)

An information processing apparatus for providing information to a person who provides information from an output unit including a display and a speaker based on a detection result of a sensor ,
Analyzing the detection result obtained from the previous SL sensor, objects present around the sensor (hereinafter, referred to as "information providing subject") by analyzing the position and direction of movement of, and imparts an identifier of the sensor sensor Sensor result processing means for outputting an analysis result ;
Based on the sensor analysis result, we obtain the distance from the information provider subject to the display, when it is detected that the information providing subject is approaching, based on the distance, providing the information Calculating the volume that can be heard by the target person, controlling the volume that can be heard by the information providing target so that the volume does not decrease below the volume obtained by adding a predetermined volume to the volume that was previously heard by the information provider, and the output Output control means for outputting information from the means;
Storage means for recording the volume heard by the information provider;
An information processing apparatus comprising: The output control means includes
The information processing apparatus of claim 1 further comprising means for controlling so as not to exceed the maximum volume has been determined separately audible to the information providing subject based on the distance from the information provider subject to the display.

Images