JP2020086845A - Information processor, control method thereof, program, and storage medium - Google Patents

Abstract

To provide an information processor that effectively furnishes contents, when contents are provided to an object existing near a predetermined display region, even when the contents are crowded, in a signage system.SOLUTION: An information processor detects objects (401 to 405) existing near a predetermined display region, acquires congestion status near the display region due to the plurality of detected objects, and displays, in the predetermined display region, contents (406 to 408) on a basis of an attribute of the objects specified according to the congestion status, among a plurality of contents.SELECTED DRAWING: Figure 4

Description

The present invention relates to a technique for providing contents for the purpose of attracting the interest of objects existing in a predetermined area.

In recent years, signboards and large displays have been arranged as a method of transmitting information such as advertisements and guidance to people who are moving. There is also a device that projects an image on a large display area using a projector to perform advertisement or guidance. Under such a background, there is a technique for displaying contents such as advertisements according to the attributes of individual objects for each of a plurality of objects existing in the vicinity of a region where contents such as advertisements and guidance are displayed. For example, in Patent Document 1, contents are individually displayed in association with each of a plurality of pedestrians existing near the display area. As a result, it is possible to effectively display the content corresponding to the moving object such as a pedestrian or an escalator passenger.

Japanese Patent No. 3784796

In Patent Document 1, when the vicinity of a predetermined display area such as a large display area is congested, there is too much information to be displayed as a whole, so that it is difficult to recognize individual contents. Was not considered.

Therefore, it is an object of the present invention to effectively provide content even in a crowded state when providing content according to an attribute of an object to an object existing near a predetermined display area.

In order to solve the above problems, an information processing apparatus according to the present invention is a detection unit that detects an object existing near a predetermined display area, and a congestion situation near the predetermined display area due to a plurality of detected objects. And display control means for displaying, in the predetermined display area, the content based on the attribute of the object specified according to the acquired congestion status among the plurality of objects.

ADVANTAGE OF THE INVENTION According to this invention, when providing the content according to the attribute of an object with respect to the object which exists in the vicinity of a predetermined display area, even if it is crowded, a content can be provided effectively.

Diagram showing an example of a signage system including an information processing device The figure showing an example of the hardware constitutions of an information processing apparatus. Diagram illustrating an example of a functional configuration of an information processing device Diagram showing an example of the operation of the information processing device A diagram showing information held in the storage unit of the information processing device Flowchart showing an example of processing of the information processing apparatus Diagram showing an example of a functional configuration of the information processing apparatus Diagram showing an example of the operation of the information processing device Flowchart showing an example of processing of the information processing apparatus

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. However, the constituent elements described in this embodiment are merely examples, and are not intended to limit the scope of the present invention thereto.

<First Embodiment>
In the present embodiment, an example of a signage system that presents an advertisement to each of an unspecified number of persons who exist near a predetermined display area or pass near the display area will be described. In particular, in the present embodiment, when the vicinity of the display area is congested, the person presenting the advertisement is changed to a person who is in a state where it is easy to pay attention to the presented advertisement so that the advertisement can be shown more effectively. limit.

FIG. 1 shows an example of the configuration of a signage system adopting this embodiment. In FIG. 1, the display area 100 is a screen onto which an image is projected from the projector 101 of this embodiment. The projector 101, the camera 102, and the distance sensor 103 are wired or wirelessly connected to the PC 104. The camera 102 and the distance sensor 103 are devices for detecting a situation near the display area. The PC 104 controls various connected devices 101 to 104. Further, in FIG. 1, the object 105 is a pedestrian or a person standing still near the display area. Hereinafter, people and things existing near the display area are called objects. The content 106 is an advertisement displayed in association with an individual object. In the present embodiment, the content 106 is displayed so as to move along with the movement of the object 105. For example, when the object 105 appears in front of the display area 100, the content 106 is displayed in the display area according to the position of the object 105. That is, when the object 105 moves, the content 106 also moves following the movement of the object 105. Although the projector 101, the camera 102, the distance sensor 103, and the PC 104 are separate devices in this embodiment, the invention is not limited to this. An integrated device in which one or more of the projector 101, the camera 102, the distance sensor 103, and the PC 104 are combined may be used. However, the present embodiment can be applied without being limited to the signage system using projection.

FIG. 2 is a hardware configuration diagram of the information processing device 200 according to the present embodiment. The information processing apparatus 200 described below corresponds to the PC 104 in the example of the signage system in FIG. The CPU 201 is a CPU (Central Processing Unit), performs calculations and logical judgments for various types of processing, and controls each component connected to the system bus 208. The information processing device 200 is equipped with a memory including a program memory and a data memory. A ROM (Read-Only Memory) 202 is a program memory and stores a program for control by the CPU including various processing procedures described later. A RAM (Random Access Memory) 203 is a data memory, and has a work area for the program of the CPU 201, a data save area for error processing, a load area for the control program, and the like. The program memory may be realized by loading the program into the RAM 203 from an external storage device or the like connected to the information processing device 200. The HDD 204 is a hard disk for storing a plurality of electronic data and programs according to this embodiment. An external storage device may be used to play the same role. Here, the external storage device can be realized by, for example, a medium (recording medium) and an external storage drive for realizing access to the medium. As such a medium, for example, a flexible disk (FD), a CD-ROM, a DVD, a USB memory, an MO, a flash memory and the like are known. Further, the external storage device may be a server device or the like connected via a network. The input I/F 205 acquires various signals from the camera 102, the distance sensor 103, etc. and inputs them to the information processing apparatus 200 via the bus 208. The output I/F 206 outputs the output signal generated by the CPU 201 to the projector 101 which is the output device of this embodiment.

FIG. 3 is a block diagram showing an example of the functional configuration of the information processing apparatus 200 according to this embodiment. The information processing device 200 includes an object detection unit 301, an attribute information detection unit 302, a congestion status acquisition unit 303, an object identification unit 304, a content determination unit 305, and a display control unit 306. Each of these functional units is realized by the CPU 201 expanding a program stored in the ROM 202 into the RAM 203 and executing processing according to each of the flowcharts described later. The storage unit 307 is a functional unit of the ROM 202 or the HDD 204. Each element will be described below.

The object detection unit 301 exists in a predetermined range within the angle of view of the camera (hereinafter, simply referred to as “near the display area”) near the display area, using the captured image acquired from the camera that is the input device. Detects the number of objects and object position information. The congestion status acquisition unit 303 detects the congestion degree near the display area using the position information detected by the object detection unit 301. For example, the density of objects in a range defined near the display area is acquired as the congestion degree. In the present embodiment, the density of objects in the length of the display area (one-dimensional range) is calculated.

The object identifying unit 304 presents an advertisement to at least some of the detected objects based on the detected moving speed, facing direction, and distance information from the display area to the objects. Specify as the target. In this embodiment, the moving speed of the object, the direction in which the object is facing, and the distance information from the display area to the object are detected and used by using the captured image acquired from the camera and the distance information acquired from the distance sensor. .. The attribute information detection unit 302 detects the attribute of the object using the captured image acquired from the camera. In the present embodiment, the attributes are, specifically, age, age group, sex, race, hair color, body type, clothing color, presence/absence of hat, presence/absence of beard, presence/absence of eyeglasses, accompanying pets. It includes at least one of information indicating presence/absence and presence/absence of a parent/child. However, it is not limited to these. For example, information about animals or inanimate objects may be detected as attributes such as whether a dog or a balloon. In this embodiment, the attribute information detection unit 302 detects attribute information for each of at least some of the objects identified by the object identification unit 304.

The content determination unit 305 determines the content to be presented to each object based on the attribute of the object detected by the attribute information detection unit 302. In the present embodiment, the content presented to each object is selected from among a plurality of patterns of advertisement in which the attributes of the target person are defined in advance, according to the attributes of the individual objects. The display control unit 306 is a functional unit that generates and outputs a display image to be displayed on the projector 101. In this embodiment, the display position of the content is determined based on the position information of the object detected by the object detection unit 301, and the content is controlled to be displayed at that position.

The storage unit 307 stores the position information of the object, the attribute information of the object, the situation information including the orientation of the object and the distance from the display area to the object, the content presented to the object, and the like. Further, the position information of the immediately preceding object and the history of the position information may be stored. Further, the relationship between the congestion degree and each determination criterion may be stored in advance by the time the system is activated. The storage unit 307 included in the information processing apparatus 200 according to the present embodiment is a functional unit of the RAM 203. Further, the present invention can be similarly realized by an information processing device that realizes these functional units by hardware.

Next, the operation of the signage system according to the present embodiment will be specifically described with reference to FIGS. 4 to 6. First, FIGS. 4A and 4B show one mode of an operation example of the signage system shown in FIG. FIG. 4B shows the state after Δt time in FIG. The same components as those described with reference to FIG. 1 are designated by the same reference numerals and the description thereof will be omitted. Objects 401 to 405 are persons detected near the display area. Further, the content 406 is displayed so as to correspond to the object 401, the content 407 is displayed so as to correspond to the object 403, and the content 408 is displayed so as to correspond to the object 405. In this embodiment, whether or not to provide individual contents according to attributes to each object is switched according to the congestion situation near a predetermined display area. For example, in the situation where the number of objects is 3 as shown in FIG. 1, it is determined that the congestion situation does not exceed the standard, and the content is individually provided to each of the objects. On the other hand, in the situation where the number of objects shown in FIGS. 4(a) and 4(b) is 5, it is determined that the object is too crowded to exceed the standard, and attention is focused on the content of the 5 objects. Providing content to objects that are in a good state. For example, the congestion status is acquired as a value of the density of objects near the display area (hereinafter, referred to as congestion degree), and such switching is performed by threshold processing. Further, in the present embodiment, the fact that the moving speed of the object is slow to some extent, that the orientation of the object's face is in a direction in which the display area is easily visible, and that the object is not too far from the display area It is treated as a condition of "easy to perform". For example, if all the objects are considered to be in a state where it is easier to pay attention to the content even in a situation where the objects are overcrowded, the present embodiment provides individual objects to all the objects. To be done.

FIG. 5A and FIG. 5B show an example of information stored in the storage unit 307 for the processing of specifying an object that provides content when the content is crowded. FIG. 5A is a table showing an example of information stored in the storage unit 307 regarding one or more objects detected by the object detection unit 301. ID_1 is an object 401, ID_2 is an object 402, ID_3 is an object 403, ID_4 is an object 404, and ID_5 is an ID uniquely indicating an object 405. In the table of FIG. 5A, the ID of each object is associated with the current position information, the past position information, the orientation, the distance from the display area, the attribute, and the information indicating the content provided for each content. Stored.

FIG. 5B is a table showing an example of a correspondence relationship between the gradual congestion degree and the gradual determination criteria for specifying the object providing the content. The contents of the table in FIG. 5B are defined at the time of system design, installation, maintenance, etc., and are stored in the storage unit 307. As shown in FIG. 5B, in the present embodiment, when the congestion degree is less than 1.0 and there is not much congestion, all objects including objects such as people jogging and people moving by bicycle are also included. The moving speed determination criterion is set so as to be an object for which information is presented. If the congestion level is 1.0 or more and less than 2.5 and slightly congested, move so as to present information to objects such as people standing still, people walking slowly, people walking fast etc. Set the speed judgment standard. When the degree of congestion is 2.5 or more and it is congested, the moving speed determination standard is set so as to present information to an object such as a person standing still or a person walking slowly. In addition, the criteria for determining the orientation of an object and the distance from the display area to the object to be presented are such that the more crowded the object is, the more the display area faces in a certain direction or the objects existing near the display area are targeted. Is provided. Note that the relationship between the congestion degree and each criterion is not limited to this.

FIG. 6 is a flowchart showing an example of processing executed by the information processing device. Hereinafter, each process (step) will be described by adding S to the head of the reference numerals. A flow of main processing executed by the information processing apparatus will be described with reference to FIG. After starting the information processing apparatus, this processing is repeatedly executed. For example, when a camera as an input device acquires an image at 30 fps, this process is repeatedly executed every 1/30 seconds. The present invention is not limited to this, and for example, this processing may be repeatedly executed at predetermined time intervals regardless of the image acquisition interval of the camera.

In step S601, the object detection unit 301 detects the position information (x, y) of the object using the captured image acquired from the camera 102. Specifically, one of the face position, head position, and eye position is detected using the captured image. Note that the origin of the coordinate system is the apex that hits the lower left corner toward the display area 100, the x-axis is set to the right direction along the wall, and the y-axis is set to the height direction. For example, in the scene shown in FIG. 4B, the position (103, 150) of the object 401, the position (259, 150) of the object 402, and the position (400, 180) of the object 403 are detected. Further, the position (254, 102) of the object 404 and the position (51, 150) of the object 405 are detected. Then, the information stored in the storage unit 307 is updated. In the case of FIG. 4B, since the position information detected in the scene of FIG. 4A corresponding to Δt seconds before is previously stored as the “current position information”, it is stored as the current position information. The position information of each object is stored again as past position information. For example, the position of the object 401 (100, 150), the position of the object 402 (250, 150) as the current position information in the state of FIG. 4A that is Δt=1/30 seconds before in FIG. 4B, The position (400, 180) of the object 403 is stored. Further, the position (250, 100) of the object 404 and the position (50, 150) of the object 405 are stored. The storage unit 307 stores the positional information as past positional information as shown in FIG. In the present embodiment, the movement from the position (100, 150) to the position (103, 150) indicates that the movement is 3 cm in the x-axis direction and 0 cm in the y-axis direction. Next, the storage unit 307 stores the position information detected by the object detection unit 301 as the current position information, as shown in FIG. In step S602, the attribute detection unit detects an attribute using the captured image acquired from the camera 102. For example, any one of four age groups of Baby, Youth, Middle-age, and Senior is detected as an attribute. Here, as shown in FIG. 5A, the object 401 and the object 402 are detected as Youth, the object 403 is Middle-age, and the objects 404 and 405 are detected as Senior. In step S603, the congestion status acquisition unit 303 acquires the congestion status.

In the present embodiment, the number of objects detected by the object detection unit 301 and the size of the display area are used to calculate the density of objects with respect to the display area as a congestion degree that is an index of the congestion situation. When the width of the display area 100, which is a display area, is 3 m and the number of objects is 5, the congestion degree=(the number of objects)/(the size of the display area)=5/3. In step S604, the congestion status acquisition unit 303 determines whether the congestion status exceeds the predetermined criterion. Specifically, if the congestion degree is equal to or higher than a predetermined threshold value, it is determined that the congestion is present (S604: Yes). If it is less than the reference value, it is determined that there is no congestion (S604: No). When it is determined in S604 that the traffic is congested (S604: Yes), the process proceeds to S605 and the presentation target is determined. The threshold value of the congestion degree is, for example, 1.5. In this case, if the number of objects shown in FIG. 1 is 3 and the degree of congestion=(the number of objects)/(size of the display area)=3/3, the congestion status does not exceed the standard. Content is provided for each of the objects. On the other hand, in the situation where the number of objects shown in FIGS. 4A and 4B is 5 and the degree of congestion is 5/3, the congestion is so high as to exceed the standard. The number is narrowed down to less than five.

Here, FIG. 6B is a flowchart showing an example of the process of identifying (the object of) the presentation target, which is executed in S605. In step S611, the object identifying unit 304 acquires the moving speed of the object, the direction of the object, and the distance from the display area to the object. For example, the object specifying unit 304 calculates the moving speed using the current position information and the past position information stored in the storage unit 307. Specifically, when the object 401 moves from the position (100, 150) to the position (103, 150) in 1/30 seconds, the moving speed is calculated to be 3.2 km/h. Similarly, it is detected that the object 402 is 9.7 km/h, the object 403 is 0 km/h, the object 404 is 4.8 km/h, and the object 405 is 1.1 km/h. Next, the object specifying unit 304 detects the orientation of the object using the captured image acquired from the camera 102. Specifically, for example, the orientation of the face or head of a person detected as an object is detected by image processing. In addition, a visual camera or an infrared camera may be used to detect the line-of-sight direction based on the positional relationship between the inner corners of the eyes, corneal reflections, and pupils of the object. In the present embodiment, when the display area is in the north direction with respect to the object, the direction is defined as 0 degree when the object faces north, and the direction is 180 degrees when the object faces south. However, it is not limited to this. In FIG. 4B, it is detected that the object 401 is 80 degrees, the object 402 is 90 degrees, the object 403 is 180 degrees, the object 404 is 90 degrees, and the object 405 is 5 degrees. Then, the object specifying unit 304 acquires the distance from the display area to the object. Specifically, the distance from the display area to the object is acquired using the distance image acquired from the distance sensor 103. In FIG. 4B, the object 401 is 80 cm, the object 402 is 100 cm, the objects 403 and 405 are 50 cm, and the object 404 is 300 cm. The object specifying unit 304 stores the acquired moving speed and direction of each object, and the distance from the display area to the object in the storage unit 307. In step S612, the object identification unit 304 determines, according to the congestion degree acquired by the congestion status acquisition unit 303, a moving speed determination criterion, an orientation determination criterion, and a distance from the display area to the object used to determine the presentation target. Determine the criteria.

Specifically, for example, as shown in FIG. 5B, the determination is made based on the relationship between the congestion degree and each determination criterion stored in advance in the storage unit 307. In this embodiment, since the congestion degree is 5/3, the moving speed determination criterion is 6 km/hour or less, the orientation determination criterion is −120° or more and 120° or less, and the distance from the display area to the object is 200 cm. Determined to be less than. Here, the criterion for determining the moving speed is set so that an object whose moving speed is considered to be slow enough to pay attention to an advertisement is determined as a presentation target. In addition, the orientation determination criterion is set such that an object that is considered to be looking in the direction toward the display area is determined as a presentation target. The criterion for determining the distance from the display area to the object is set so that the object that is considered to be close to the display area to the extent that the content of the advertisement can be visually recognized is determined as the presentation target.

In S613, the object identifying unit 304 determines whether or not all objects have been processed. Since the processing has not been completed for the object 401, object 402, object 403, object 404, and object 405 (S613: No), the process proceeds to S614. In step S<b>614, the object identification unit 304 selects an object that has not been processed, here, the object 401. In S615, the object specifying unit 304 determines whether or not the moving speed of the selected object satisfies the determination criterion. Since the moving speed of the object 401, 3.2 km/h, is 6 km/h or less, the criterion is satisfied (S615: Yes). In S616, the object identifying unit 304 determines whether or not the orientation of the selected object satisfies the criterion. Since the orientation 80 degrees of the object 401 is −120 degrees or more and 120 degrees or less, the determination criterion is satisfied (S616: Yes). In S617, the object specifying unit 304 determines whether or not the distance of the selected object from the display area satisfies the criterion. Since the distance 80 cm of the object 401 is less than 200 cm, the criterion is satisfied (S617: Yes). Therefore, in S618, the object specifying unit 304 determines the selected object, that is, the object 401 as the presentation target.

Subsequently, in S613, the object identification unit 304 determines whether or not all objects have been processed, and determines whether or not the objects 402, 403, 404, and 405 are also presentation targets. Go When the object identifying unit 304 selects the object 402 in S614, it is determined in S615 that the determination criterion is not satisfied because the speed 9.7 km/h of the object 402 is not 6 km/h or less (S615: No). Therefore, in S619, it is determined that it is not a presentation target. Subsequently, when the object specifying unit 304 selects the object 403 in S614, it is determined in S615 that the determination criterion is satisfied because the 0 km/h of the object 402 is 6 km/h or less (S615: Yes). However, the orientation 180 degrees of the object 403 is not −120 degrees or more and 120 degrees or less in S616, so the determination criterion is not satisfied (S616: No). Therefore, in S619, it is determined that the object is not the presentation target.

Subsequently, when the object specifying unit 304 selects the object 404 in S614, it is determined in S615 that the judgment criterion is satisfied because the speed 4.8 km/h of the object 404 is 6 km/h or less (S615: Yes). Further, in S616, the orientation 90 degrees of the object 404 is not less than -120 degrees and not more than 120 degrees, so the determination criterion is satisfied (S616: Yes). However, in S617, the distance 300 cm of the object 404 is not less than 200 cm, so the determination criterion is not satisfied (S617: No). Therefore, in S619, it is determined that it is not a presentation target. Subsequently, in S614, when the object specifying unit 304 selects the object 405, the determination criteria are satisfied in S615, S616, and S617 as in the case of the object 401, and thus it is determined to be a presentation target in S618. In this way, the object identifying unit 304 identifies at least a part of the objects for which the content is to be presented among the plurality of detected objects.

When the processing is completed for the object 401, the object 402, the object 403, the object 404, and the object 405 (S613: Yes), the process proceeds to S607a in FIG. In step S<b>607, the content determination unit 305 determines content for the object that is the presentation target determined by the object identification unit 304. Specifically, for example, the content is determined according to the attribute of the object to be presented. In FIG. 4B, the content determination unit 305 determines to present the advertisement A of the theme park for young people based on the attribute “Youth” stored in the storage unit 307 in the object 401. Since the attribute stored in the storage unit 307 of the object 405 is “Senior”, the content determination unit 305 determines to present the resort advertisement B for seniors. In step S<b>608, the display control unit 306 determines the display position for displaying the content for each object according to the position information of the object stored in the storage unit 307. For example, in FIG. 4B, the current position information (103, 150) of the object 401 stored in the storage unit 307 is displayed at a position (133, 150) 30 cm ahead so that the object can easily see it. Then decide. Similarly, the object 405 is determined to be displayed at the position (81, 150) based on the current position information (51, 150). In step S609, the display control unit 306 displays the content. In FIG. 4B, the advertisement A is displayed at the position (133, 150) for the object 401, and the advertisement B is displayed at the position (81, 150) for the object 405. The above is the flow of processing when it is determined in S604 that the traffic is congested.

Next, the flow of processing when it is determined in S604 that the traffic is not congested will be described. When it is determined that the objects are not crowded, the object identifying unit 304 determines that all the objects are presentation targets in S606. In step S<b>607, the content determination unit 305 determines content for all objects to be presented according to the attributes of each object stored in the storage unit 307. In step S<b>608, the display control unit 306 determines the display position for displaying the content for each object according to the position information of the object stored in the storage unit 307. In step S609, the display control unit 306 displays the content for each object according to the display position.

<Modification>
In the first embodiment, the signage system that displays the advertisement that follows the object using the projection has been described, but this is merely an example. For example, the present embodiment can be applied to a system that provides contents such as advertisements according to the attribute of an object detected nearby, such as a bulletin board equipped with a large-sized display, a signboard in a store, or a vending machine.

Although the attribute detection unit detects the age group as an attribute in the present embodiment, the present invention is not limited to this. For example, one or more of age, age group, gender, race, hair color, body type, clothing color, presence of hat, presence of beard, presence of glasses, presence of pet, presence or absence of parent and child is detected. You may. As for the presence/absence of a pet, for example, an animal such as a dog may be detected by image processing, and the attribute of an object within a predetermined range of the object that is an animal may be a pet presence. For example, if an object whose age group is Baby or Youth and an object that is Middle-age exist in a position within a predetermined range, it may be determined whether or not the object is a parent and child. ..

In addition, in the present embodiment, the content determination unit 305 determines the content according to the age group that is the attribute, but the content determination unit 305 is not limited to this. For example, using one or more of age, age group, gender, race, hair color, body type, clothing color, presence of hat, presence of beard, presence of glasses, presence of pet, parent and child content May be determined. Further, environmental information such as weather, temperature and humidity, date and time information may be detected using a temperature sensor, a humidity sensor, and a clock, and the content may be determined according to the environmental information. The environment information may be acquired via a network or a cloud server. Alternatively, the content may be determined by communicating with a network such as a cloud server to acquire event information, weather information, disaster information, and the like, and determining the content according to the acquired information. The content may be determined according to the physical information of the object, such as detecting the body temperature of the object using a camera or the like that can detect the temperature of the subject. You may acquire the preference information of the object, the purchase history information of the product, and the like stored in the device owned by the object, such as a smartphone or a tablet, and determine the content according to the acquired information.

Further, the content may be determined by combining one or more of the attribute of the object and environment information, information acquired by network communication, physical information of the object, information acquired from the device owned by the object, and the like. For example, the content determination unit 305 detects, as the environmental information, information indicating a midsummer day such as a sunny weather and a temperature of 30 degrees, and when the body temperature of the object is high, an advertisement for a drink or a restaurant, a warning for heat stroke, etc. Present an advertisement. In this way, it is possible to present information according to the environmental information.

Further, for example, when any one of Asian, Caucasian, African, and Indian is detected as an attribute, the language of the advertisement is set according to the detected race, the news of the relevant area is presented, or Information may be presented according to the species. Further, for example, when the attribute is detected as having a pet, presentation of information according to the presence or absence of a pet, such as advertisement of a restaurant that can accompany animals, advertisement of pet care products, etc. May be determined. Further, the presentation of information according to the type of the object such as presenting the content related to the animal may be determined for the animal that is the object. In addition, according to the clothes color or hair color detected as an attribute (for example, any one of Black, Black, Brown, and Gray is detected), an advertisement of clothes or ornaments of a color similar to the color is presented, etc. The presentation of information according to the color detected from the object may be determined. Further, for example, when it is detected that a hat is present as an attribute, it may be decided to present information according to the ornament of the object, such as presenting an advertisement of a hat store.

In addition, for example, when it is midsummer day as environmental information and when hatless is detected as an attribute, an advertisement of attention against heat stroke and an advertisement regarding heatstroke countermeasure products such as hats are presented, and environmental information and attributes It may be determined that the information is presented in combination with. In addition, for example, when the attribute is detected to be a parent and child, the advertisement of the event for the parent and child is presented according to the date and time information, the attribute and the environmental information, the event information, and the like according to the information acquired from the network. May be determined. Further, for example, any of Mustache, Beard, and 5 o'clock shadow is detected as an attribute indicating the presence or absence of a beard. In this case, if the time is in the evening and the attribute is 5 o'clock shadow, an advertisement corresponding to the time and the attribute may be presented, such as an advertisement for shaving equipment. For example, the purchase history information may be acquired from the device owned by the object, and the coupon of a shop with a high purchase frequency may be presented, or the content may be determined according to the information acquired from the device owned by the object.

Further, in the present embodiment, the content determination unit 305 determines the content according to the attribute, but the history information about the past may be stored in the storage unit 307 and the content may be determined according to the history information. Specifically, for example, when the content determination unit 305 determines the content to be presented to the object A, the content determination unit 305 stores information about the content in the storage unit 307 in association with the object A. When the content determination unit 305 determines the content for the object A in the next frame and the information about the content is stored in the storage unit, it is determined to present the stored content. This allows the object to continue to view the same content even when the attribute detection accuracy of the object is low and different attributes are detected for each frame.

Although the display control unit 306 determines the display position of the content according to the current position information of the object in the present embodiment, the present invention is not limited to this. For example, the display position of the content is determined using one or more of the position information of the object, the moving speed of the object, the moving direction of the object, the direction of the object, the distance from the display area to the object, and the external shape information such as the height of the object. You may. For example, when the moving speed of the object is slow, the content may be displayed near the object, and when the moving speed of the object is fast, the content may be displayed at a position slightly away from the object. Further, for example, when the object is stationary, such as when the moving speed of the object is close to 0, even if the object is moving, the display position of the content is the same as the display position in the past, for example, one frame before. May be displayed in. Further, for example, when the moving speed of the object is close to 0 and is directed to the display area, it is considered that the advertisement is being viewed, and even if the object is moving, the display position of the content is For example, it may be displayed at the same position as the display position one frame before.

In addition, the display control unit 306 may determine the height of the display position of the content according to, for example, the height of the object. Further, the display control unit 306 may determine the display position so that the content is displayed at the destination of the object movement based on, for example, the orientation or the moving direction of the object. The display control unit 306 may reduce the display size of the contents so that they do not overlap when the display positions of the plurality of contents overlap, for example, when objects pass each other. Further, the height of the display position may be determined so that the contents do not overlap. Further, for example, the object existing closer to the display area or the object further facing the display area may be prioritized to display the content. In that case, while the objects pass each other, only the content for the priority object is displayed, but when the objects are separated from each other, the content for each object is displayed again.

In the present embodiment, the object detection unit 301 detects the position and the attribute of the object by performing image processing on the captured image acquired from the camera 102, but the present invention is not limited to this. For example, the position information of the object may be acquired by communicating with a device owned by the object. Specifically, the position information of the object is detected using GPS, an acceleration sensor, a geomagnetic sensor, a gyro sensor, etc. mounted on a smartphone, a tablet, or the like. Alternatively, the position information may be detected using a Wi-Fi access point, a carrier base station, a beacon, or the like.

In the present embodiment, the attribute information detection unit 302 detects the position or attribute of the object by performing image processing on the captured image acquired from the camera 102, but the present invention is not limited to this. For example, the attribute information registered in advance by the object may be acquired from the application installed in the device by communicating with the device owned by the object.

In the present embodiment, the object specifying unit 304 detects the moving speed and direction of the object and the distance from the display area to the object by performing image processing on the captured image acquired from the camera 102 or the distance sensor 103. It is not limited to this. For example, the moving speed and direction of the object and the distance from the display area to the object may be acquired by communicating with the device owned by the object. Specifically, the position information and the orientation of the object are detected by using various sensors such as a GPS, an acceleration sensor, a geomagnetic sensor, and a gyro sensor mounted on a smartphone or a tablet. As described in this embodiment, the moving speed is detected from the position information. Further, the position information of the display area is stored in advance in the storage unit 307, and the distance from the display area to the object is detected based on the position information of the display area and the position information of the object. The position information may be detected using a Wi-Fi access point, a carrier base station, a beacon, or the like.

As described above, in the device that individually displays the provided information associated with each object, the visibility of the content can be improved by presenting the information according to the situation of the object and its surroundings even when the device is crowded. You can Although the distance sensor 103 acquires the distance image in the present embodiment, the present invention is not limited to this. For example, the distance information may be acquired using a sensor or the like that measures a distance with infrared rays or ultrasonic waves.

As described above, according to the first embodiment and the modification, when the vicinity of a predetermined display area is congested, an object presenting content individually is changed to an object in a state in which it is easy to pay attention to the content. Narrow down. As a result, it is possible to prevent the number of contents on the finite display area from increasing too much (the density being too high) to make it difficult to recognize the contents of each content. As a result, contents corresponding to individual objects can be effectively provided even when the vicinity is crowded.

<Second Embodiment>
In the second embodiment, when the vicinity of a predetermined display area is congested, objects existing near the display area are grouped, and one content is presented to one group to be displayed in the display area. Control so that the number of contents does not increase too much. Furthermore, the display size of the content is increased or the display position is set to a high position. As a result, in the second embodiment, it becomes easier to pay attention to an object that is moving at a high speed or that is far from the display area, and it is possible to effectively provide the content even when it is crowded. Become. Hereinafter, as with the first embodiment, the second embodiment will be described by taking the signage system shown in FIG. 1 as an example.

FIG. 7 is a block diagram showing an example of the functional configuration of the information processing apparatus 200 according to this embodiment. However, the same numbers are given to the same functional units as those in the functional configuration of FIG. 3, and detailed description will be omitted. The grouping unit 701 is a functional unit such as the CPU 201, and groups at least one object among objects existing near the display area into one group. Also in the second embodiment, the storage unit 307 presents the position information of the object, the attribute information of the object, the situation information including the orientation of the object and the distance from the display area to the object, and the object. Contents and the like are stored. Further, information on the group to which the object belongs, the position of each group and the number of members belonging to the group are stored. Further, the storage unit 307 may store the position information of the immediately preceding object and the history of the position information. Further, the relationship between the congestion degree and the group size may be stored in advance by the time the system is started.

FIG. 8 shows one mode of an operation example of the signage system shown in FIG. Objects 801 to 807 are objects detected near the display area 100. The content 809 is the content presented to the object 807. The content 810 is the content presented to the group of the object 801 and the object 802. The content 811 is the content presented to the group of the object 803, the object 804, and the object 805. Content 812 is content presented to a group of objects 806.

The flow of the main processing executed by the information processing apparatus 200 in the second embodiment is the same as the processing shown in the flowchart of FIG. 6A described in the first embodiment, so description thereof will be omitted. However, in the second embodiment, the content of the process of identifying the object to be presented, which is executed in S605, is different. FIG. 9 is a flowchart showing an example of the processing executed in S605 in the second embodiment. The steps having the same contents as those described in the flowchart of FIG. 6B are given the same cases, and the description thereof will be omitted.

In step S<b>901, the grouping unit 701 determines the group scale according to the congestion status (congestion degree) acquired by the congestion status acquisition unit 303. The group size is, for example, the maximum number of members belonging to the group. Here, the congestion degree acquired by the congestion status acquisition unit 303 in S603 is the congestion degree=(the number of objects)/(the size of the display area) when the width of the display area 100, which is the display area, is 3 m and the number of objects is 7. )=7/3. For example, when the congestion degree is 7/3, the maximum number of members belonging to the group is set to 3 as the size of the group.

In step S902, the grouping unit 701 determines whether all objects have been processed. Since no processing has been performed on any of the objects, the determination is No and the process proceeds to S903. In step S903, the object specifying unit 304 selects the object 807. In step S904, the grouping unit 701 determines whether the object is moving. Specifically, for example, it is determined whether or not the moving speed of the object is equal to or higher than a predetermined value. The moving speed of the object is calculated based on the current position information of the object stored in the storage unit 307 and the past position information. Here, the moving speed used for the determination is 1.0 km/h, and the moving speed of the object 807 is 0.3 h/hour. In this case, the grouping unit 701 determines that the object 807 has not moved. In step S913, the object identification unit 304 determines the object 807 as a presentation target. As a result, objects that have not moved are not grouped, so that the same content can be continuously viewed at the same location regardless of the movement of other objects.

Subsequently, in S903, the object specifying unit 304 selects the object 801. Here, the moving speed of the object 801 is 3.0 km/h. In step S904, the grouping unit 701 determines that the object 801 is moving because it is 1.0 km/h or more. In step S905, the grouping unit 701 acquires group information from the storage unit 307 and determines whether the group exists. Here, since the group has not been created, it is determined that the group does not exist (S905: No). In step S912, the grouping unit 701 creates a new group and sets the selected object as a member of the group. That is, the grouping unit 701 creates the group A and makes the object 801 a member of the group A. The storage unit 307 stores a group and the object 801 as a member of the group. In step S911, the grouping unit 701 determines the position of the group. Specifically, for example, the center position of each object is calculated based on the current position information of each object that is a member of the group, and the center position is determined as the position of the group. Here, the current position information of the object 801 is (103, 150). Since the object of the group A is only the object 801, the position of the group A is (103, 150).

Then, in step S903, the object specifying unit 304 selects the object 802. Here, the moving speed of the object 802 is 3.0 km/h. In step S904, the grouping unit 701 determines that the object 802 is moving because it is 1.0 km/h or more. In S905, the grouping unit 701 determines that the group exists because the storage unit 307 has the information of the group A (S905: Yes). In step S906, the grouping unit 701 determines whether all groups have been processed. Here, since the processing is not performed on the group A, the process proceeds to S907. In step S907, the grouping unit 701 selects group A. In step S908, the grouping unit 701 determines whether the number of objects belonging to the group is equal to or larger than the maximum value of the number of members of the group determined in step S901. The maximum value of the number of members of the group is 3, and the number of members of the group A is 1 because the object 801 is the only member. Therefore, it is determined that the number of members belonging to the group A is less than the maximum value of the number of members of the group (S908: No). In step S909, the grouping unit 701 determines whether the selected object exists within the predetermined range of the position of the selected group. If the current position information of the object 802 is (105, 170) and the predetermined range of the position of the group is within a radius of 1 m, the object 802 is within a radius of 1 m from the position of the group A (103, 150). (S909: Yes). In step S910, the grouping unit 701 sets the selected object as a member of the selected group. That is, the object 802 is a member of group A. In step S911, the grouping unit 701 calculates the position of the group A based on the current position information of the objects 801 and 802 that are members of the group A. Specifically, the average value of the positions (103, 150) of the object 801 and the positions (105, 170) of the object 802 is calculated. Therefore, the position of group A is (104, 160).

Subsequently, in S903, the object specifying unit 304 selects the object 803. The grouping unit 701 determines in step S904 that the object 803 is moving. Further, since the grouping unit 701 has not processed the group A in step S905, the process advances to step S907 to select the group A. In S908, the grouping unit 701 determines that the number of members 2 belonging to the group A is not greater than or equal to the maximum value 3 of the members of the group (S908: No). Here, the current position information of the object 803 is (205, 170). In that case, in S909, the grouping unit 701 determines that the object 803 does not exist within the radius 1 m of the position (104, 160) of the group A. In step S906, the grouping unit 701 acquires from the storage unit 307 that only the group A exists. Since the group A has been processed, it is determined that all groups have been processed (S906: Yes). In step S912, the grouping unit 701 creates a new group B and makes the object 803 a member of the group B. In step S911, the grouping unit 701 sets the position of the group B as the current position information of the object 803 because the member of the group B is only the object 803. Subsequently, the object 804 and the object 805 also perform the same processing as described above, and become a member of the group B.

Next, in S903, the object specifying unit 304 selects the object 806. Since processing is not performed on the group A and the group B, it is determined as No in S906 (S906: No). When the grouping unit 701 selects the group A in step S907, the number of members in the group A is 2, and the maximum value of the number of members in the group is 3, so that a determination of No is made in step S908 (S908: No). Here, the current position information of the object 806 is (270, 150). Since the position of the group A is (104, 160), in S909, the grouping unit 701 determines that the object 806 does not exist within the radius of 1 m of the group A (S909: No). Next, when the grouping unit 701 selects the group B in S907, the number of members in the group B is 3, and the maximum value of the number of members in the group is 3, which is determined as Yes in S908 (S908: Yes). ). Since the group A and the group B have been processed, the grouping unit 701 determines that all groups have been processed in S906 (S906: Yes). In step S912, the grouping unit 701 creates a new group C and makes the object 806 a member of the group C. In step S911, the grouping unit 701 sets the position of the group C as the current position information of the object 806 because the member of the group C is only the object 806.

Subsequently, in S902, since all the objects have been processed, the process proceeds to S914 (S902: Yes). In S914, the object identifying unit 304 determines that all groups, that is, the group A, the group B, and the group C, are the presentation targets. In step S607, the content determination unit 305 determines content for each of the group A, the group B, the group C, and the object 807. For example, for the object 807, the content is determined according to the attribute of the object 807. The content for the group is determined according to the attribute of the member. For example, it is assumed that the attributes of the objects 803 and 804 are Youth and the attribute of the object 805 is Middle-age. In that case, the content common to more objects is prioritized to determine the content. Since the group B has more objects of Youth than the objects of Middle-age, the attribute of the group is set to Youth and the advertisement for Youth is determined as the content. In step S608, the display control unit 306 determines the display position of the content for each of the presentation targets according to the position information of the presentation target. Specifically, for example, the display position of the content with respect to the object 807 is determined according to the current position information of the object 807. Further, the display position of the content with respect to the group A is determined according to the position of the group A. In step S609, the display control unit 306 displays the content for each of the group A, the group B, the group C, and the object 807.

However, the determination based on the moving speed in S904 of the second embodiment is merely an example. The object to be provided with individual content and the object to be grouped may be determined based on the information on the state of other objects such as the orientation of the face of the object and the distance from the display area. Further, in the second embodiment, depending on the state of the detected object, not all objects may be targets for providing individual contents in the processing of S904, but may be targets for grouping. That is, the case where all the objects are classified into one group and one content according to the attribute common to more objects in the group is provided is also included in the second embodiment. Further, if the state of one or more objects among the plurality of grouped objects changes and changes to a target for presenting individual content, new content may be provided from that point. For example, in the case where the direction of the object's face is not facing the display area, if the object is grouped, if the object that turned its back to the display area turns around and the advertisement can be viewed, it will be excluded from the grouping target. It is a target for presenting individual content. At this time, if the advertisement that has already been displayed corresponds to the individual attribute of the object, it is possible to further refine the content of the advertisement or bring it closer to the object. Also, if the advertisement that is already displayed does not correspond to the individual attribute of the object, it is possible to provide more appropriate content such as advertisement according to the attribute of the object and make it interesting.

<Modification>
Although the content determination unit 305 determines the content according to the attribute of the object or the group, the content determined by the content determination unit 305 is stored in the storage unit 307, and the content presented immediately before is determined to be presented. May be. Also, when an object that has been a member of the group until just before, such as when the object stops to view the content, does not move, it is removed from the members of the group and the object individual becomes the presentation target. In that case, the content determination unit 305 stores the content when it belonged to the group in the storage unit 307, and even if the object individual is removed from the members of the group, the content determination unit 305 belongs to the group regardless of the attribute of the object. You may present the content when it was on.

In addition, the display control unit 306 may determine the display position and the display size of the content for the group according to the number of members of the group. For example, the content display size of the group having the number of members of 2 is made larger than that of the group having the number of members of 1 is 1.

Although the grouping unit 701 determines the maximum value of the number of members belonging to the group as the size of the group, the present invention is not limited to this. For example, the minimum value of the number of members belonging to the group may be determined as the scale of the group, or both the minimum value and the maximum value of the number of members may be determined as the scale of the group. Further, the range of the area of the group may be limited instead of limiting the number of members of the group according to the congestion degree. Specifically, when grouping all the objects within a certain range from the center centering on the location information of an arbitrary place or an arbitrary object into one group, the range of the group is set as the congestion degree. May be determined according to

Further, in the present embodiment, the grouping unit 701 groups the objects existing in the vicinity as one group based on the position information of the objects, but the present invention is not limited to this. For example, grouping may be performed by combining at least one of the position information of the object, the direction, the moving direction, and the moving speed of the object. Specifically, when the objects are close to each other and the moving directions and the directions of the objects are the same or similar, the objects are grouped into one group. Further, objects that are close to each other and have similar moving speeds may be grouped as one group.

The grouping unit 701 may also perform grouping based on the attributes of objects. For example, when a plurality of objects having an attribute of female are grouped within a certain range, the plurality of objects are grouped as one group.

Further, the grouping unit 701 may perform grouping based on the movement trajectory of the object. In general, when the pedestrian A has an accompanying person B, it can be said that the moving loci of the pedestrian A and the accompanying person B are similar. Therefore, objects having similar movement loci may be grouped as one group.

As described above, according to the second embodiment and the modified example, when content is provided to objects near a predetermined display area, the content of each group is displayed on some objects, resulting in congestion. It is possible to provide information without impairing the effect even at times.

<Other embodiments>
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. It can also be realized by the processing. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions. Further, the output method may be modified such that the user is informed by voice or the like, instead of being displayed on the display unit to be presented to the user.

301 Object Detecting Section 302 Attribute Information Detecting Section 303 Congestion Status Acquiring Section 304 Object Identifying Section 305 Content Determining Section 306 Display Control Section

Claims (17)

Detection means for detecting an object existing near a predetermined display area,
An acquisition unit that acquires a congestion situation near the predetermined display area due to a plurality of detected objects;
An information processing apparatus, comprising: display control means for displaying, in the predetermined display area, content based on an attribute of an object specified according to the acquired congestion status among the plurality of objects. Further comprising a specifying unit that specifies a target for displaying the content among the plurality of objects according to the congestion situation,
The specifying unit specifies all of the plurality of objects as the target in a situation where the vicinity of the display area is not crowded by a plurality of objects and exceeds a reference,
In a situation where the vicinity of the display area is crowded by the plurality of objects so as to exceed the reference, at least a part of objects among the plurality of objects based on a state of each object is specified as the target. The information processing apparatus according to claim 1. 3. The state includes at least one of a moving speed of the object, a direction in which the object is facing, and a distance from the predetermined display area to the object. The information processing device described in 1. In a situation where the vicinity of the predetermined display area is congested by the plurality of objects so as to exceed the reference, the specifying unit specifies, as the target, an object whose moving speed is smaller than a predetermined determination reference among the plurality of objects. The information processing apparatus according to claim 2, wherein the information processing apparatus comprises: When the congestion situation is such that the congestion exceeds the reference, the specifying unit sets the object, from among the plurality of objects, whose distance from the predetermined display area to the object is smaller than a predetermined determination criterion as the target. The information processing device according to claim 2, wherein the information processing device is specified. When the congestion situation is so crowded as to exceed the reference, the specifying unit specifies, as the target, an object that is considered to have a direction toward the predetermined display area among the plurality of objects. The information processing apparatus according to any one of claims 2 to 5, characterized in that. The acquisition unit acquires a congestion degree, which is a density of a plurality of objects detected by the detection unit, in a range defined near the predetermined display area,
The information processing apparatus according to claim 2, wherein the reference is a threshold value of the congestion degree. The identifying unit identifies the target object among the plurality of objects based on a plurality of determination criteria that differ stepwise according to the congestion degree and respective states of the plurality of objects. Item 7. The information processing device according to item 7. 9. The display control means causes each of the specified objects to display individual content based on the attribute of each of the specified objects. The information processing device described. Further comprising grouping means for grouping one or more objects of the plurality of objects based on respective states of the plurality of objects,
The display control means,
In a situation where the vicinity of the predetermined display area is congested by the plurality of objects so as to exceed the reference, the one or more objects are further grouped with respect to one or more objects grouped into one group by the grouping unit. The information processing apparatus according to claim 9, wherein one content determined based on an attribute common to more objects among the attributes that the information processing apparatus has is displayed. In a situation where the vicinity of the predetermined display area is crowded by the plurality of objects so that the plurality of objects exceeds the reference, the grouping unit determines the position information of each of the plurality of objects whose moving speed is larger than a predetermined determination reference. Grouped into one or more groups based on
The display control means,
Among the plurality of objects, the object whose moving speed is smaller than a predetermined criterion is displayed with the content corresponding to each object,
For one or more objects grouped into one group by the grouping unit, one content determined based on an attribute common to more objects among attributes of the one or more objects is displayed. The information processing apparatus according to claim 10, wherein: The attributes of the object include age, age group, sex, race, hair color, body type, clothing color, presence/absence of hat, presence/absence of beard, presence/absence of glasses, presence/absence of pets to be accompanied, parents and children accompanying them. The information processing apparatus according to claim 1, further comprising at least one of information indicating whether or not the information is present. Detection means for detecting an object existing near a predetermined display area,
Grouping means for grouping one or more objects among the plurality of objects based on the detected states of the plurality of objects;
For one or more objects grouped into one group by the grouping means, one content determined based on an attribute common to more objects among attributes of the one or more objects is given as the predetermined content. Display control means for displaying in the display area of
An information processing apparatus comprising: A step of detecting an object existing near a predetermined display area by the detecting means;
A step of acquiring the congestion status near the display area by the plurality of detected objects by the acquisition means;
Displaying the content based on the attribute of the object specified according to the acquired congestion status among the plurality of objects in the predetermined display area by the display control means. Device control method. A step of detecting an object existing near a predetermined display area by the detecting means;
Grouping one or more objects of the plurality of objects based on the detected states of the plurality of objects by grouping means;
With respect to one or more objects grouped into one group, one content determined based on an attribute common to more objects among attributes of the one or more objects is displayed by the display control means. A step of displaying in a predetermined display area,
A method of controlling an information processing apparatus, comprising: A program that causes a computer to function as the information processing apparatus according to claim 1, when the program is read and executed by a computer. A computer-readable storage medium storing the program according to claim 16.

Images