WO2023079600A1 - 興味関心度計測システムおよびシミュレーションシステム - Google Patents
興味関心度計測システムおよびシミュレーションシステム Download PDFInfo
- Publication number
- WO2023079600A1 WO2023079600A1 PCT/JP2021/040434 JP2021040434W WO2023079600A1 WO 2023079600 A1 WO2023079600 A1 WO 2023079600A1 JP 2021040434 W JP2021040434 W JP 2021040434W WO 2023079600 A1 WO2023079600 A1 WO 2023079600A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user
- interest
- unit
- information
- floor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/53—Recognition of crowd images, e.g. recognition of crowd congestion
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0283—Price estimation or determination
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/16—Real estate
Definitions
- the present disclosure relates to an interest level measurement system and a simulation system.
- Patent Document 1 discloses an example of an interest level analysis system.
- the interest level analysis system analyzes the user's level of interest in the object based on the user's movement trajectory and movement speed in the effective range of the object.
- the present disclosure relates to solving such problems.
- the present disclosure provides an interest degree measurement system that can obtain information on the user's interest in a building even for a user who does not possess a pre-registered mobile device, and a simulation system that can simulate changes in the information. do.
- the interest level measurement system includes an attribute storage unit that stores attributes for each area on each of a plurality of floors of a building, and an image captured by at least one of a plurality of cameras provided in the building. based on the user identification unit that identifies the user in the building, and the user identified by the user identification unit using one or more lifting equipment provided in the building a floor determination unit that determines the arrival floor of the user based on an image captured by at least one of the plurality of cameras when the user moves from the departure floor to the arrival floor among the plurality of floors; For the user identified by the user identification unit, action information representing the behavior of the user on the arrival floor determined by the floor determination unit is acquired based on the image captured by at least one of the plurality of cameras.
- an interest information acquisition unit that acquires interest information representing the interest level of the user for each attribute, and interest information that stores the interest information acquired by the interest information acquisition unit for each user, including time and place information a storage unit, and a visualization processing unit that uses the information stored in the interest information storage unit to generate an interest level map that visualizes the distribution of the level of interest of users of the building on at least one of the plurality of floors. And prepare.
- a degree-of-interest measuring system includes a first attribute storage unit that stores attributes for each area for each of a plurality of floors of a first building, and a plurality of first cameras provided in the first building.
- a first user identification unit that identifies a user in the first building based on an image captured by at least one of; and a user identified by the first user identification unit is provided in the first building
- At least one of the plurality of first cameras captures images when moving from the departure floor to the arrival floor among the plurality of floors of the first building using any one of the one or more elevator equipment provided.
- a floor determination unit that determines the arrival floor of the user based on the image that is displayed; a behavior information acquisition unit that acquires behavior information representing behavior based on images captured by at least one of the plurality of first cameras; and a floor determination for the user identified by the first user identification unit.
- an interest information acquisition unit that acquires interest information representing the degree of interest of the user for each attribute based on the arrangement and attributes of the areas on the arrival floor determined by the unit and the relationship between the behavior information acquired by the behavior information acquisition unit; , an interest information storage unit that stores the interest information acquired by the interest information acquisition unit for each user, including time and place information; At least one of the plurality of floors of the second building using a second attribute storage unit, attribute information stored in the second attribute storage unit, and information stored in the interest information storage unit and a visualization processing unit that generates an interest level map that visualizes the distribution of the user's level of interest in the second building.
- the interest level measurement system includes an attribute storage unit that stores attributes for each area for each of a plurality of floors of a first building, and at least a plurality of first cameras provided in the first building.
- a first user identification unit that identifies a user in the first building based on an image taken by any one, and a user identified by the first user identification unit are provided in the first building.
- a floor determination unit that determines the arrival floor of the user based on the user's behavior on the arrival floor determined by the floor determination unit for the user specified by the first user identification unit a behavior information acquisition unit that acquires behavior information based on images captured by at least one of the plurality of first cameras; and the floor determination unit for the user identified by the first user identification unit.
- an interest information acquisition unit that acquires interest information representing a degree of interest of the user for each attribute based on the relationship between the location and attributes of the areas on the determined arrival floor and the behavior information acquired by the behavior information acquisition unit;
- An interest information storage unit that stores the interest information acquired by the interest information acquisition unit for each user, including time and place information, and an external system that stores images of users of the third building to the third building.
- a receiving unit that receives from, a third user specifying unit that specifies a user based on the image received by the receiving unit, and the interest information storage unit for the user specified by the third user specifying unit Using information stored as information of interest and attribute information for each area of at least one of the plurality of floors of the third building determined based on the image received by the receiving unit, the third a visualization processing unit that generates an interest level map that visualizes the distribution of the level of interest of the users of the third building on the floor for which attribute information has been determined among the plurality of floors of the building.
- the interest level measurement system includes an attribute storage unit that stores attributes for each area for each of a plurality of floors of a first building, and at least a plurality of first cameras provided in the first building.
- a first user identification unit that identifies a user in the first building based on an image taken by any one, and a user identified by the first user identification unit are provided in the first building.
- a floor determination unit that determines the arrival floor of the user based on the user's behavior on the arrival floor determined by the floor determination unit for the user specified by the first user identification unit a behavior information acquisition unit that acquires behavior information based on images captured by at least one of the plurality of first cameras; and the floor determination unit for the user identified by the first user identification unit.
- an interest information acquisition unit that acquires interest information representing a degree of interest of the user for each attribute based on the relationship between the location and attributes of the areas on the determined arrival floor and the behavior information acquired by the behavior information acquisition unit; Start using either the interest information storage unit that stores the interest information acquired by the interest information acquisition unit for each user, including time and place information, or one or more elevators installed in the third building a receiving unit for receiving from an external system an image of a user who performs the For the user, the interest information storage unit includes a transmission unit for transmitting information on destination candidates with a high degree of interest of the user to the external system.
- the simulation system sets simulation conditions based on the interest level measurement system and the existing conditions stored in the interest information storage unit, and changes from the existing conditions acquired by the interest information acquisition unit. and a simulation processing unit for simulating a change in the information of interest based on the new conditions set.
- the degree-of-interest measurement system or simulation system it is possible to obtain information on the user's interest in the building even for a user who does not have a pre-registered mobile device, and to detect changes in the information. be able to simulate.
- FIG. 1 is a configuration diagram of a simulation system according to Embodiment 1;
- FIG. FIG. 2 is a diagram showing an example of a car operating panel according to Embodiment 1;
- FIG. 4 is a diagram showing an example of areas on a floor according to Embodiment 1.
- FIG. 2 is a diagram showing an example of camera arrangement according to Embodiment 1.
- FIG. 2 is a diagram showing an example of camera arrangement according to Embodiment 1.
- FIG. 2 is a diagram showing an example of camera arrangement according to Embodiment 1.
- FIG. 4 is a diagram showing an example of behavior information acquired by a behavior information acquisition unit according to Embodiment 1;
- FIG. 4 is a diagram showing an example of behavior information acquired by a behavior information acquisition unit according to Embodiment 1;
- FIG. 4 is a diagram showing an example of behavior information acquired by a behavior information acquisition unit according to Embodiment 1;
- FIG. 4 is a diagram showing an example of behavior information acquired by a behavior information
- FIG. 4 is a diagram showing an example of behavior information acquired by a behavior information acquisition unit according to Embodiment 1;
- FIG. 4 is a diagram showing an example of behavior information acquired by a behavior information acquisition unit according to Embodiment 1;
- FIG. 4 is a diagram showing an example of behavior information acquired by a behavior information acquisition unit according to Embodiment 1;
- FIG. 4 is a table showing an example of determination by a floor determination unit according to Embodiment 1;
- FIG. 4 is a diagram showing an example of determination by a floor determination unit according to Embodiment 1;
- FIG. 4 is a diagram showing an example of determination by a floor determination unit according to Embodiment 1;
- FIG. 4 is a diagram showing an example of determination by a floor determination unit according to Embodiment 1;
- FIG. 4 is a diagram showing an example of determination by a floor determination unit according to Embodiment 1;
- FIG. 4 is a diagram showing an example of determination by a floor determination unit according to Em
- FIG. 4 is a diagram showing an example of determination by a floor determination unit according to Embodiment 1;
- FIG. 4 is a diagram showing an example of determination by a floor determination unit according to Embodiment 1;
- FIG. 4 is a diagram showing an example of determination by a floor determination unit according to Embodiment 1;
- FIG. 4 is a diagram showing an example of behavior information acquisition by the interest degree measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of behavior information acquisition by the interest degree measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of behavior information acquisition by the interest degree measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of acquisition of interest information by the interest degree measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of acquisition of interest information by the interest degree measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of acquisition of interest information by the interest
- FIG. 4 is a diagram showing an example of acquisition of interest information by the interest degree measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of acquisition of interest information by the interest degree measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of acquisition of interest information by the interest degree measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of presentation of a destination by the degree-of-interest measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of presentation of a destination by the degree-of-interest measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of presentation of a destination by the degree-of-interest measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of presentation of a destination by the degree-of-interest measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of presentation of a destination by the degree-of
- FIG. 4 is a diagram showing an example of presentation of a destination by the degree-of-interest measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of an interest level map by the interest level measuring system according to Embodiment 1;
- FIG. FIG. 4 is a diagram showing an example of an interest level map by the interest level measuring system according to Embodiment 1;
- FIG. FIG. 4 is a diagram showing an example of an interest level map by the interest level measuring system according to Embodiment 1;
- FIG. FIG. 4 is a diagram showing an example of an interest level map by the interest level measuring system according to Embodiment 1;
- FIG. FIG. 4 is a diagram showing an example of an interest level map by the interest level measuring system according to Embodiment 1;
- FIG. FIG. 4 is a diagram showing an example of an interest level map by the interest level measuring system according to Embodiment 1;
- FIG. FIG. FIG. 4 is a diagram showing an example of an interest level map by the interest level
- FIG. 4 is a diagram showing an example of an interest level map by the interest level measuring system according to Embodiment 1;
- FIG. FIG. 4 is a diagram showing an example of an interest level map by the interest level measuring system according to Embodiment 1;
- FIG. 4 is a diagram showing an example of setting simulation conditions in the simulation system according to the first embodiment;
- FIG. FIG. 5 is a diagram showing an example of simulation results by the simulation system according to Embodiment 1;
- FIG. FIG. 5 is a diagram showing an example of simulation results by the simulation system according to Embodiment 1;
- FIG. FIG. 4 is a diagram showing an example of an interest level map by the interest level measuring system according to Embodiment 1;
- FIG. FIG. 4 is a diagram showing an example of an interest level map by the interest level measuring system according to Embodiment 1;
- FIG. 5 is a diagram showing an example of simulation results by the simulation system according to Embodiment 1;
- FIG. 2 is a diagram showing an example of a building layout according to Embodiment 1;
- FIG. 5 is a diagram showing an example of simulation results by the simulation system according to Embodiment 1;
- FIG. 5 is a diagram showing an example of simulation results by the simulation system according to Embodiment 1;
- FIG. FIG. 1 is a hardware configuration diagram of main parts of the interest degree measuring system and the simulation system according to Embodiment 1.
- FIG. 10 is a diagram showing an example of presentation of a destination by the degree-of-interest measuring system according to Embodiment 2;
- FIG. 10 is a diagram showing an example of presentation of a destination by the degree-of-interest measuring system according to Embodiment 2;
- FIG. 10 is a diagram showing an example of presentation of a destination by the degree-of-interest measuring system according to Embodiment 2;
- FIG. 10 is a diagram showing an example of presentation of a destination by the degree-of-interest measuring system according to Embodiment 2;
- FIG. 10 is a diagram showing an example of presentation of a destination by the degree-of-interest measuring system according to Embodiment 2;
- FIG. 11 is a configuration diagram of an interest degree measuring system according to Embodiment 3;
- FIG. 13 is a diagram showing an example of presentation of a destination by the degree-of-interest measuring system according to Embodiment 3;
- FIG. 12 is a configuration diagram of an interest degree measuring system according to Embodiment 4;
- FIG. 14 is a diagram showing an example of disclosing an interest level map or a simulation result of changes in interest information by the interest level measuring system according to Embodiment 4;
- FIG. 1 is a configuration diagram of a simulation system 50 according to Embodiment 1. As shown in FIG. 1
- the simulation system 50 includes the degree-of-interest measurement system 1 .
- An interest degree measuring system 1 is applied to a building 2 having a plurality of floors.
- the degree-of-interest measuring system 1 is a system that allows the owner of the building 2, for example, to visualize an area in which the user of the building 2 has a high degree of interest.
- the users of the building 2 include, for example, visitors who visit the building 2, employees who work in the building 2, and the like.
- Elevator equipment is equipment used by users of the building 2 to move between floors.
- the lifting equipment is, for example, an elevator 3, an escalator 4, or a staircase 5 or the like.
- Each floor of the building 2 is provided with an entrance for stairs 5 .
- a user who moves from the departure floor to the arrival floor using the stairs 5 starts using the stairs 5 from the entrance on the departure floor. After that, the user completes the use of the stairs 5 at the boarding gate of the arrival floor.
- the stairs 5 may be a slope that allows oblique movement between floors.
- each elevator 3 is a transport device that transports users between floors.
- a hoistway 6 for the elevator 3 is provided.
- the hoistway 6 is a space spanning multiple floors.
- a landing for an elevator 3 is provided on each floor of the building 2 .
- a landing for the elevator 3 is a space adjacent to the hoistway 6 .
- Each elevator 3 has a car 7 , a control panel 8 and a hall operating panel 9 .
- the car 7 is a device for transporting users inside the car between a plurality of floors by traveling up and down the hoistway 6 .
- the car 7 has a car operating panel 10 .
- the car operating panel 10 is a device that accepts a user's operation to specify the destination floor of the car 7 .
- the control panel 8 is a device that controls the running of the car 7 in response to a call registered in the elevator 3, for example.
- the hall operating panel 9 is a device that receives an operation of a user who registers a call to the elevator 3 .
- the hall operating panel 9 is provided, for example, in the hall of each floor.
- the hall operating panel 9 may be shared among the plurality of elevators 3 .
- a user who moves from the departure floor to the arrival floor using the elevator 3 registers a call by operating the hall operating panel 9 at the hall of the departure floor, for example.
- a group control device 11 is provided for managing operations such as allocating calls to a plurality of elevators 3 .
- equipment that replaces the group management apparatus as independent equipment, or equipment that has software installed with the functions of the group management apparatus as independent equipment, or the like may be provided.
- a part or all of information processing functions such as operation management may be mounted on the control panel 8 .
- a part or all of the information processing functions such as operation management may be installed in a server device or the like that can communicate with each elevator 3 .
- the server device may be placed either inside or outside the building 2 .
- a part or all of the functions of information processing for operation management and the like may be installed in a virtual machine or the like on a cloud service capable of communicating with each elevator 3 .
- Some or all of the information processing functions such as operation management may be realized by dedicated hardware, may be realized by software, or may be realized by using dedicated hardware and software together.
- each of the above-exemplified means for performing information processing regarding operation management and the like will be referred to as a group control device 11 regardless of its configuration.
- the escalator 4 spans between the upper and lower floors.
- the escalator 4 is a transport device that transports users between upper and lower floors.
- Each floor of the building 2 is provided with an entrance for an escalator 4 .
- a user moving from a departure floor to an arrival floor using one or more escalators 4 starts using the escalator 4 from the boarding gate of the departure floor.
- a plurality of cameras 12 are provided in the building 2 .
- Each camera 12 is a device that takes an image of the place where it is provided. Images captured by each camera 12 include, for example, still images or moving images.
- the format of the image captured by each camera 12 may be a compressed image format such as Motion JPEG, AVC, HEVC, or the like. Alternatively, the format of the images captured by each camera 12 may be an uncompressed image format.
- Each camera 12 has a function of outputting a captured image to an external device. In this example, each camera 12 is synchronized with each other so that images taken at the same time can be acquired as images at the same time.
- the plurality of cameras 12 includes cameras 12 provided on each floor.
- the plurality of cameras 12 includes cameras 12 provided inside the car 7 of the elevator 3 .
- the multiple cameras 12 include the camera 12 provided at the entrance/exit of the escalator 4 .
- the multiple cameras 12 include the camera 12 provided at the entrance/exit of the stairs 5 .
- the plurality of cameras 12 may include cameras 12 installed outdoors such as at the entrance, perimeter, or courtyard of the building 2, as well as cameras 12 installed on each floor.
- the plurality of cameras 12 may include the cameras 12 provided at the landings of the elevator 3 as well as the cameras 12 provided at each floor.
- the plurality of cameras 12 may include the camera 12 provided in front of the escalator 4 entrance/exit, similar to the camera 12 installed at the entrance/exit of the escalator 4 .
- the plurality of cameras 12 may include the cameras 12 provided in front of the entrance of the stairs 5 as well as the cameras 12 installed at the entrance of the stairs 5 .
- the interest level measurement system 1 may include some or all of the multiple cameras 12 . Alternatively, some or all of the cameras 12 may be devices external to the degree-of-interest measurement system 1 .
- the degree-of-interest measuring system 1 provides guidance by information processing based on images acquired from each camera 12 .
- the interest level measurement system 1 includes an attribute storage unit 13, a user identification unit 14, an action information acquisition unit 15, an action information storage unit 16, and an elevator equipment determination unit 17 as parts responsible for information processing.
- a processing unit 18 , a floor determination unit 19 , an interest information acquisition unit 20 , an interest information storage unit 21 , a destination presentation unit 22 , a call registration unit 23 , and a visualization processing unit 27 are provided.
- the attribute storage unit 13, the user identification unit 14, the behavior information acquisition unit 15, the behavior information storage unit 16, the elevator equipment determination unit 17, the matching processing unit 18, and the floor determination unit 19 of the interest level measurement system 1 , interest information acquisition unit 20 , interest information storage unit 21 , destination presentation unit 22 , and call registration unit 23 are mounted on group control device 11 .
- part or all of the part responsible for information processing in the interest/interest degree measuring system 1 may be installed in an external server device or the like that can communicate with the group management device 11 .
- part or all of the part responsible for information processing in the degree-of-interest measurement system 1 may be installed in an external server device or the like that can communicate with the server device provided in the building 2 .
- part or all of the information processing part of the interest level measuring system 1 may be implemented by processing or storage resources on a cloud service.
- the attribute storage unit 13 is a part that stores information.
- attributes for each area of each floor of the building 2 are stored.
- the area of each floor is a portion that occupies part or all of the floor.
- the area of each floor is, for example, the part where the tenants of the floor concerned move in.
- the area of each floor may be, for example, a portion of a shop or the like that operates on that floor.
- the attribute storage unit 13 stores information specifying an area, for example, a range of coordinates on each floor.
- the area is not limited to a two-dimensional plane, and may be a high-dimensional space such as a three-dimensional space.
- the attributes of an area represent one or more things, things, people, and the like.
- the attribute of the area is the type of store, or the type of goods or services handled in the store.
- the attribute of the area may be the name of the store, or the name of the goods or services handled by the store.
- the attribute of the area may be the person in the office. That is, the attribute of an area is the user's goal.
- Each area may have multiple attributes.
- One or more attributes of each area may be assigned by a person or may be assigned using AI (Artificial Intelligence).
- the user identification unit 14 has a function of identifying users of the building 2 based on images captured by at least one of the cameras 12.
- the user identification unit 14 identifies the user by, for example, collating the user's face information extracted from the image with existing information, if any, by two-dimensional face authentication. Determine.
- the user identification unit 14 may newly register the user's face information extracted from the image when there is no existing information such as a first-time user.
- features such as the nose, ears, eyes, mouth, cheeks, chin, and neck of the face are used as the face information.
- the user identification unit 14 may acquire information such as the iris or pupil of the eye.
- the user identification unit 14 When the pupil of the eye is uneven rather than circular or elliptical, or when the iris information is determined to be abnormal, the user identification unit 14 has the risk of acquiring fake face information created by AI or the like. Alternatively, the risk of obtaining face information while wearing black sunglasses that shield the iris may be detected and an alert may be sent.
- the behavior information acquisition unit 15 has a function of acquiring the behavior information of the user identified by the user identification unit 14 .
- User behavior information is, for example, time-series data of information representing the location of the user.
- the behavior information is not limited to three-dimensional information that combines a two-dimensional plane and a time axis, and may be, for example, higher-dimensional information that combines a high-dimensional space such as three dimensions and a time axis.
- the location of the user includes information such as the floor on which the user is located, the coordinates of the user on the floor, and the orientation of the user.
- the location of the user may include information identifying the elevator facility if the user is using one of the elevator facilities.
- the behavior information as time-series data includes, for example, information on the arrangement of users acquired at preset time intervals.
- the behavior information acquisition unit 15 acquires user behavior information based on images captured by at least one of the cameras 12 .
- the behavior information acquisition unit 15 continuously updates the behavior information of the user, for example, at preset time intervals.
- the behavior information storage unit 16 is a part that stores information.
- the behavior information storage unit 16 stores the behavior information acquired by the behavior information acquisition unit 15 for each user identified by the user identification unit 14 .
- the behavior information storage unit 16 stores identification information unique to the user necessary for identification by the user identification unit 14, behavior information of the user, and information on the time and place when the behavior information was acquired. Store in association.
- the elevator equipment determination unit 17 has a function of determining the elevator equipment used by the user identified by the user identification unit 14 .
- the elevator facility determination unit 17 determines the elevator facility to be used based on the image captured by at least one of the cameras 12 . For example, when a user starts using one of the elevator facilities on the departure floor, the elevator facility determination unit 17 determines the elevator facility as the elevator facility to be used by the user.
- the matching processing unit 18 is equipped with a function for matching between the identification of the user by the user identification unit 14 and the determination of the elevator equipment used by the user by the elevator equipment determination unit 17 .
- the matching process is performed, for example, as follows.
- the user identification unit 14 may mistakenly identify different users as the same user.
- the elevator equipment determination unit 17 may determine two or more elevator equipment at the same time as the elevator equipment used by the user identified by the user identification unit 14 as the same user. be. Since the same person cannot use two or more lifting facilities at the same time, the matching processing section 18 requests the user identification section 14 to correct the identification of the user. At this time, the user identification unit 14 identifies users that have been erroneously identified as the same user as different users.
- the user specifying unit 14 extracts the difference in the feature amount of the users from the acquired images when specifying different users, thereby improving the accuracy of specifying the users and identifying the different users. re-identify the The user identification unit 14 may make adjustments such as narrowing the range of feature amounts for determining the same user according to the difference in the extracted feature amounts, for example. The user specifying unit 14 may improve the certainty of specifying the user based on the difference in feature quantity extracted by other methods.
- the floor determination unit 19 has a function of determining the arrival floor of the user identified by the user identification unit 14 .
- the arrival floor of the user is the floor on which the user using the lifting equipment has finished using the lifting equipment. For example, when the user is using the elevator 3, the arrival floor of the user is the floor from which the user gets off the elevator 3.
- the floor determination unit 19 determines the arrival floor based on the images captured by at least one of the cameras 12 . For example, when a user completes using the lifting equipment on any floor, the floor determination unit 19 determines that floor as the user's arrival floor.
- the interest information acquisition unit 20 has a function of acquiring interest information about the user identified by the user identification unit 14 .
- the user's interest information is information representing the interest level of the user for each attribute attached to the area.
- Interest information acquisition unit 20 acquires interest information based on the user's behavior on the arrival floor.
- the behavior of the user includes information such as the length of stay of the user at the arrival floor and the direction of interest, which is the direction in which the user shows interest at the arrival floor.
- the interest information acquisition unit 20 uses the information stored by the attribute storage unit 13 and the behavior information acquired by the behavior information acquisition unit 15 or the behavior information stored by the behavior information storage unit 16 to Get interest information based on behavior.
- One of the interest information indicates the presence or absence of interest, and the other indicates the degree of interest.
- the degree of interest is analyzed using either or both of the period during which the user showed interest in the attribute attached to the area in the direction of interest of the user and the length of stay.
- the interest information acquisition unit 20 adds information each time information from each floor is added to each user.
- the interest information acquisition unit 20 sorts the degree of interest in the results of analysis based on the updated information in order of priority each time.
- the interest information storage unit 21 is a part that stores information. Interest information is stored for each user in the interest information storage unit 21 .
- the interest information storage unit 21 associates and stores identification information unique to the user, interest information of the user, and information on the time and place at which the interest information was acquired.
- the destination presentation unit 22 has a function of presenting a destination to the user based on the interest information stored in the interest information storage unit 21 .
- the destination presenting unit 22 presents to the user, for example, an area having an attribute of high interest to the user as a destination.
- the destination information presented by the destination presentation unit 22 includes, for example, attributes of the destination, a destination floor that is a floor including the destination, or a route from the user's current position to the destination.
- the destination presenting unit 22 presents to the user, for example, a video.
- the video displayed by the destination presentation unit 22 includes, for example, characters, still images, or images.
- the image may be, for example, a two-dimensional image displayed by a display device such as a display or a projection device such as a projector.
- the image may be a three-dimensionally displayed spatial image.
- the image is displayed, for example, inside the car 7 of the elevator 3, at the platform of the elevator 3, at the entrance/exit of the escalator 4, or at the entrance/exit of the stairs 5, or the like.
- the display device may be, for example, a light indicating a destination, a liquid crystal display, an organic EL display (organic EL: Organic Electro-Luminescence), a luminescent film, an LED display (LED: Light Emitting Diode), a projector, or a stereoscopic (3D) display. It may be a machine or the like.
- the destination presenting unit 22 may present the destination to the user by voice, for example.
- a device that emits sound, such as a speaker is placed, for example, inside the car 7 of the elevator 3, at the landing of the elevator 3, at the entrance/exit of the escalator 4, or at the entrance/exit of the stairs 5, or the like.
- the call registration unit 23 has a function of registering the call to the destination floor presented by the destination presentation unit 22 in the elevator 3 that the user starts using.
- the call registration unit 23 determines whether or not the call to the destination floor presented to the user is registered, based on the behavior of the user in response to the presentation, that is, the length of stay, the presence or absence of interest, and a portion of the level of interest. Alternatively, determination may be made according to the order of priority analyzed using all elements.
- the call registration unit 23 registers the call to the elevator 3 in which the user has boarded the car 7, for example.
- the call registration unit 23 may input control information for registering the call to the group control device 11 .
- the visualization processing unit 27 is a part equipped with a function to generate an interest level map.
- the interest level map is information that visualizes the distribution of interest levels of users of the building 2, for example.
- the visualization processing unit 27 uses the information stored in the interest information storage unit 21 to generate an interest level map.
- the visualization processing unit 27 visualizes, for example, the distribution of interest levels on any floor of the building 2 as an interest level map.
- the interest distribution is visualized by information such as a table, graph, or diagram.
- the visualization processing unit 27 may generate an interest level map including information stored in the behavior information storage unit 16 .
- the visualization processing unit 27 may generate the interest level map including information on the destination actually presented to the user by the destination presentation unit 22 .
- the visualization processing unit 27 may generate an interest level map including classification information such as the user's sex, age, or both, or information other than these.
- the generated interest level map is not limited to a three-dimensional map centered on the level of interest in the two-dimensional bird's-eye view map. For example, higher-dimensional information such as stereoscopic moving images may be used.
- the interest level measurement system 1 includes an operation display section 28 .
- the operation display unit 28 has a function of displaying information processed in the degree-of-interest measurement system 1 to, for example, the owner of the building 2 .
- the display functionality is implemented by, for example, a monitor, projector, LED display, smart phone, smart glasses, VR display, AR display, MR display, or stereoscopic (3D) display.
- the operation display unit 28 has a function of outputting a sound as necessary to assist display or substitute display.
- the operation display unit 28 has a function of receiving an operation by the owner of the building 2, for example.
- the operation function is implemented by, for example, a button, keyboard, touch panel, eye tracking, sensor, voice recognition, or the like.
- the operation display unit 28 may be a device external to the interest level measurement system 1 .
- the operation display unit 28 may be a separate device from the visualization processing unit 27 and the like of the interest level measurement system 1 .
- the operation display unit 28 may be a device integrated with the visualization processing unit 27 and the like of the interest level measurement system 1 .
- the operation display unit 28 displays information such as an interest level map generated in the interest level measuring system 1, for example.
- the operation display unit 28 receives, for example, an operation for generating an interest level map in the interest level measuring system 1 .
- the operation display unit 28 is operated by the owner (corporation or person) of the building 2, the manager (corporation or person) of the tenant of the building 2, or their agent (corporation or person), or the manufacturer of the degree of interest measuring system 1 ( (corporation or person), or maintainer (corporation or person), or AI or robot that substitutes for these corporations or people, as long as it is possible to display, if it is possible to display it, what kind of display method is used to display good too. Further, the operation display unit 28 may give sound or voice as an alternative or supplement to the display.
- the operation display unit 28 is operated by the owner (corporation or person) of the building 2, the manager (corporation or person) of the tenant of the building 2, or their agent (corporation or person), or the manufacturer of the degree of interest measuring system 1 ( (corporation or person), maintenance personnel (corporation or person), or AI, robots, software, hardware, etc. that substitute for these corporations or people, can operate, and what kind of mechanism will accept the operation? good too.
- the subjects of these operations may be called "owners, etc.”.
- An operation such as generation of the interest degree map is performed by the owner of the building 2, for example.
- the operation display unit 28 may also receive, for example, an operation for inputting conditions for generating an interest level map.
- the owner of the building 2 or the like causes the interest level measurement system 1 to automatically calculate, for example, the tenant fee of the building 2 according to the market price based on the information such as the interest level map displayed by the operation display unit 28 .
- the market price of the tenant fee is, for example, the correspondence between the degree of interest and the tenant fee, which is set according to the location of the building.
- the owner of the building 2 may, for example, use the calculated tenant fees as an aid in making decisions about the management of the building 2 and the like.
- the owner of the building 2 uses the information such as the interest level map as a decision material for improving the value of the building 2, for example.
- the owner of the building 2 may use the information such as the interest level map displayed by the operation display unit 28 to avoid risks such as theft or accidents by directing attention to users exhibiting suspicious behavior. good. This can improve the safety of the building 2 and the like.
- the simulation system 50 includes a simulation processing section 29 as a part responsible for information processing.
- the simulation processing unit 29 has a function of setting simulation conditions and simulating changes in interest information acquired by the interest information acquisition unit 20 in the building 2 .
- the simulation processing unit 29 is installed in a server device or the like that can communicate with devices of the degree-of-interest measuring system 1 such as the group management device 11 .
- Part or all of the part responsible for information processing in the simulation system 50 may be installed in a device of the degree-of-interest measuring system 1 such as the group control device 11 .
- part or all of the part responsible for information processing in the simulation system 50 may be a device separate from the operation display unit 28 of the degree-of-interest measuring system 1 or the like.
- part or all of the part responsible for information processing in the simulation system 50 may be a device integrated with the operation display unit 28 of the degree-of-interest measurement system 1 or the like. Also, part or all of the part responsible for information processing in the simulation system 50 may be installed in an external server device or the like capable of communicating with the server device provided in the building 2 . Also, part or all of the part responsible for information processing in the simulation system 50 may be implemented by processing or storage resources on a cloud service.
- the operation display unit 28 displays the results of simulation in the simulation system 50, for example.
- the results of the simulation represent changes in, for example, interest level maps.
- the simulation result may also include information on tenant fees calculated according to the market price, for example, from the changed interest map information.
- the operation display unit 28 receives, for example, an operation for setting simulation conditions and starting a simulation in the simulation system 50 .
- the operation is performed by the owner of the building 2, for example.
- the results of the simulation performed by the simulation system 50 can be used as more accurate judgment material for improving the value of the building 2 .
- FIG. 2 is a diagram showing an example of the car operating panel 10 according to the first embodiment.
- the car operating panel 10 includes a display panel 10a and a plurality of destination buttons 10b.
- the display panel 10a is a display device that displays information to the user riding inside the car 7 .
- the display panel 10a displays, for example, the running direction of the car 7 and the current floor.
- Each destination button 10b corresponds to one of floors.
- Each destination button 10b is a button that accepts an operation to designate a corresponding floor as a destination floor.
- Each destination button 10b has a light-emitting device (not shown) that lights up when operated by the user, for example.
- the light-emitting device is a device in which the brightness of light emission, color tone, presence/absence of blinking, speed of blinking, etc. are variable.
- FIG. 3 is a diagram showing an example of areas on a floor according to Embodiment 1.
- FIG. 3 a floor map on any floor is shown.
- the floor shown in FIG. 3 includes multiple areas, each of which is a store.
- One of the areas is a store P that carries item P1 and item P2.
- One of the areas is a Q store that carries item Q1 and item Q2.
- One of the areas is an R store that provides service R1 and service R2.
- the attribute storage unit 13 stores, for example, the store name "P store” and product names “P1" and “P2" as attributes of the P store area.
- the attribute storage unit 13 stores, for example, the store type "grocery store” and the goods type “grocery store” as the attributes of the area. ” may be stored.
- FIG. 4A to 4C are diagrams showing examples of the arrangement of the cameras 12 according to Embodiment 1.
- FIG. 4A to 4C are diagrams showing examples of the arrangement of the cameras 12 according to Embodiment 1.
- one of the cameras 12 is placed inside the car 7 of the elevator 3.
- the camera 12 is attached, for example, to the top of a wall or ceiling.
- the camera 12 is arranged at a position capable of photographing the face of the user who gets into the car 7, for example.
- one of the cameras 12 is arranged at the landing of the elevator 3 .
- the camera 12 is attached, for example, to the top of a wall or ceiling.
- one of the cameras 12 is placed at the entrance/exit of the escalator 4.
- one of the cameras 12 may be placed on the wall surface of the inclined portion in front of the entrance of the escalator 4 or the like.
- the camera 12 is attached, for example, to the top of a wall or ceiling.
- the camera 12 may be attached to a pole or the like provided at the entrance/exit.
- one of the cameras 12 is placed at the entrance/exit of the stairs 5.
- one of the cameras 12 may be arranged on the wall surface of the inclined portion in front of the entrance of the stairs 5, or the like.
- the camera 12 is attached, for example, to the top of a wall or ceiling.
- the camera 12 may be attached to a pole or the like provided at the entrance/exit.
- FIG. 5A to 5E are diagrams showing examples of behavior information acquired by the behavior information acquisition unit 15 according to Embodiment 1.
- FIG. 5A to 5E are diagrams showing examples of behavior information acquired by the behavior information acquisition unit 15 according to Embodiment 1.
- the behavior information acquisition unit 15 extracts the feature amount of the user, for example, from the image used by the user identification unit 14 to identify the user.
- the behavior information acquisition unit 15 may use the feature amount extracted by the user identification unit 14 .
- the feature amount of the user includes, for example, information about the positions of feature points such as the nose, ears, eyes, mouth, cheeks, chin, neck, and both shoulders of the face.
- the behavior information acquisition unit 15 acquires user behavior information based on the extracted feature amount.
- the behavior information acquisition unit 15 acquires information including direction of interest information as information on the location of the user included in the behavior information of the user.
- the behavior information acquisition unit 15 continuously acquires the behavior information of the user by tracking the user identified by the user identification unit 14 .
- the behavior information acquisition unit 15 may track the specified position of the user, for example, by a technique such as moving body tracking. By tracking the user, the behavior information acquisition unit 15 may continue to acquire the behavior information of the user who has moved and has disappeared from the image.
- the direction of interest information is an example of direction information that indicates the user's interest.
- the direction-of-interest information is information expressed using at least three feature amounts of the user's shoulders and nose.
- the direction-of-interest information may be expressed using other feature amounts as necessary.
- the user's direction of interest is expressed as the direction from the midpoint of the line connecting the positions of both shoulders to the position of the nose.
- the user's nose as a feature quantity used for the direction-of-interest information is whether or not the user's nose is covered with a mask or the like, that is, whether or not the user's bare nose itself is shown in the image. It suffices if the feature amount of the nose is captured.
- the user's shoulders as a feature quantity used for the direction-of-interest information are independent of whether or not the user's shoulders are covered with clothing, that is, whether or not the user's bare shoulders themselves are shown in the image. It suffices if the feature quantity of is captured.
- other feature amounts for organs such as ears, eyes, mouth, cheeks, chin, and neck, regardless of whether or not the user's naked organs themselves are shown in the image, are the features of the organs. It is sufficient if the quantity is captured.
- the direction-of-interest information may be expressed using, for example, feature amounts of both shoulders and nose obtained using the user's skeleton information.
- the direction-of-interest information may be expressed using other feature amounts obtained using the skeleton information.
- FIG. 5A shows an example of a user's image viewed from above. In this way, the direction in which the user is interested is represented by the direction-of-interest information acquired based on the image of the user.
- FIG. 5B shows an example of an image when the orientation of the face and the orientation of the body do not match. In this way, the direction in which the user is interested is on the extended line in the direction from the midpoint of the line segment connecting the positions of the user's shoulders to the nose.
- FIG. 5C an example image of the user viewed from behind is shown. When the user's nose is not shown in the image, the behavior information acquisition unit 15 may compensate for the nose by performing image interpolation from acquired image information.
- the behavior information acquisition unit 15 may estimate the position of the nose based on other feature points.
- the behavior information acquisition unit 15 may identify the position of the nose by synthesizing images captured by a plurality of cameras 12 .
- the behavior information acquisition unit 15 identifies the position of the nose by any one of these multiple methods or a combination of these multiple methods.
- the direction of interest of the user is represented as an extension of the direction from the midpoint of the line connecting the positions of both shoulders to the position of the nose.
- FIG. 5D an example image of a user viewed from the side is shown.
- the behavior information acquisition unit 15 may supplement the other shoulder by performing image interpolation from the already acquired image information.
- the behavior information acquisition unit 15 may estimate the position of the shoulder that is not shown in the image based on other feature points.
- the behavior information acquisition unit 15 may identify the positions of both shoulders by synthesizing images captured by a plurality of cameras 12 .
- the behavior information acquisition unit 15 identifies the positions of both shoulders by any one of these multiple methods or a combination of these multiple methods. In this way, the direction of interest of the user is represented as an extension of the direction from the midpoint of the line connecting the positions of both shoulders to the position of the nose.
- the information about the orientation of the user's interest may be extracted, for example, by image processing by the AI installed in the behavior information acquisition unit 15, or the like.
- Image processing by AI is, for example, processing by a machine learning method using an image as an input.
- Machine learning techniques train a model that derives behavioral information from user images.
- the action information acquisition unit 15 acquires action information from the user's image based on the learned model.
- the behavior information acquisition unit 15 may perform supervised learning using, for example, a set of a user's image and direction-of-interest information obtained from the image as teacher data.
- the direction-of-interest information obtained from the image may be, for example, the direction-of-interest information obtained from the positions of both shoulders and the nose.
- the behavior information acquisition unit 15 receives the image of the user as an input and outputs direction-of-interest information based on the result of the learning.
- the behavior information acquisition unit 15 may extract the feature amount of the image by deep learning or the like. In FIG. 5E, an example of the degree of importance of the feature amount of the image is indicated by color densities.
- the behavior information acquisition unit 15 may extract from the image the information about the orientation that indicates the user's interest by using unsupervised learning or other machine learning techniques such as reinforcement learning.
- FIG. 6 is a table showing an example of determination by the floor determining unit 19 according to the first embodiment.
- FIG. 6 shows an example of determination of the arrival floor of the user using the elevator 3 that ascends from the first floor.
- the elevator 3 descends to the first floor and then starts ascending from the first floor. It should be noted that the arrival floor is determined in the same manner in the case of ascending operation from other floors and in the case of descending operation.
- User A moving from the 1st floor to the 4th floor registers a call to the elevator 3 by operating the hall control panel 9 on the 1st floor. After that, the user A gets on the car 7 of the elevator 3 that has arrived at the first floor. A user A who has boarded the car 7 designates the fourth floor as the destination floor by operating the car operating panel 10 .
- the user identification part 14 identifies the user riding inside the car 7 based on the image captured by the camera 12 inside the car 7. . In this example, only user A is in car 7 . At this time, the user identification unit 14 identifies the user A as the user riding inside the car 7 .
- the elevator facility determination unit 17 determines that the elevator facility used by the user A is the elevator 3 .
- the floor determination unit 19 determines whether the user was in the car 7 when he left the last floor and the user was in the car 7 when he left the first floor. to determine the passenger's departure and arrival floors. At this time, the floor on which the car 7 stopped immediately before is any floor above the first floor on which it stopped during the descending operation. The floor determination unit 19 determines the first floor as the departure floor of user A who did not board the car 7 when departing from the immediately preceding stopped floor and was in the car 7 when it departed from the first floor. I judge.
- the matching processing unit 18 performs matching processing for matching user A. For example, when the elevator facility determination unit 17 determines that user A has already used another elevator facility redundantly at the same time, the matching processing unit 18 erroneously identifies the user as the same user.
- the user specifying unit 14 specifies a plurality of users who have been using the system as different users. The user specifying unit 14 extracts the difference in the feature amount of the users from the acquired images when specifying different users, thereby improving the accuracy of specifying the users and identifying the different users. re-identify the The matching processing unit 18 similarly performs matching processing for other users.
- User B who moves from the 2nd floor to the 5th floor, registers a call to the elevator 3 by operating the hall control panel 9 on the 2nd floor. After that, the user B gets on the car 7 of the elevator 3 that has arrived at the second floor. A user B who has boarded the car 7 designates the fifth floor as the destination floor by operating the car operating panel 10 . A user C who moves from the second floor to the fourth floor arrives at the landing on the second floor of the elevator 3 . Since the call has already been registered from the hall operation panel 9 on the second floor by the user B, the user C arriving at the hall does not operate the hall operation panel 9 to register the destination floor.
- User C may not have a mobile terminal such as a smart phone, card, or tag that accepts the operation of registering a destination floor. After that, the user C gets on the car 7 of the elevator 3 that has arrived at the second floor. Since the fourth floor has already been designated as the destination floor by the user A, the user C who has boarded the car 7 does not perform the operation of registering the destination floor on the car operating panel 10 .
- a mobile terminal such as a smart phone, card, or tag that accepts the operation of registering a destination floor.
- the user identifying part 14 identifies the user riding inside the car 7 based on the image captured by the camera 12 inside the car 7. .
- user A, user B, and user C are in car 7 .
- the user identifying unit 14 identifies user A, user B, and user C as users who are riding inside the car 7 .
- the elevator facility determination unit 17 determines that the elevator facility used by the user B is the elevator 3 .
- the floor determination unit 19 determines whether the user was inside the car 7 when he left the first floor, which is the floor on which he stopped just before, and who was inside the car 7 when he left the second floor. to determine the passenger's departure and arrival floors.
- the floor determination unit 19 determines the departure floors of the user B and the user C, who did not board the car 7 when it departed from the first floor but who were in the car 7 when it departed from the second floor, as the second floor. I judge.
- User D moving from the 3rd floor to the 6th floor registers a call to the elevator 3 by operating the hall control panel 9 on the 3rd floor. After that, the user A gets on the car 7 of the elevator 3 that has arrived at the third floor. A user D who has boarded the car 7 designates the sixth floor as the destination floor by operating the car operating panel 10 .
- the user identification part 14 identifies the user riding inside the car 7 based on the image captured by the camera 12 inside the car 7. .
- user A, user B, user C, and user D are in car 7 .
- the user identification unit 14 identifies user A, user B, user C, and user D as users who are riding inside the car 7 .
- the elevator facility determination unit 17 determines that the elevator facility used by the user D is the elevator 3 .
- the floor determination unit 19 determines whether the user was inside the car 7 when departing from the second floor, which is the floor on which the user stopped immediately before, and the user inside the car 7 when departing from the third floor. to determine the passenger's departure and arrival floors.
- the floor determining unit 19 determines that the departure floor of the user D who did not board the car when the car 7 departed from the second floor but was in the car when the car 7 departed from the third floor is the third floor.
- the user identifying part 14 identifies the user riding inside the car 7 based on the image captured by the camera 12 inside the car 7. .
- user B and user D are in car 7 .
- the user identification unit 14 identifies the user B and the user D as the users riding inside the car 7 .
- the floor determination unit 19 determines whether the user is inside the car 7 when departing from the 3rd floor, which is the floor on which the user stopped just before, and the user is inside the car 7 when departing from the 4th floor. to determine the passenger's departure and arrival floors.
- the floor determination unit 19 determines the arrival floor of the user A and the user C, who were boarding when the car 7 departed from the 3rd floor and did not board when the car 7 departed from the 4th floor, to the 4th floor. I judge. In this way, even for user C who has not performed an operation to register a destination floor on the hall operating panel 9, the car operating panel 10, and a mobile terminal such as a smartphone, card, or tag, the interest level measurement system 1 , the information of the departure floor and the arrival floor can be obtained based on the images captured by the camera 12 inside the car 7 .
- the user identification unit 14 identifies the user riding inside the car 7 based on the image captured by the camera 12 inside the car 7. .
- the user identification unit 14 identifies only the user D as a user riding inside the car 7 .
- the floor determination unit 19 determines whether the user was inside the car 7 when departing from the 4th floor, which is the floor on which the user stopped just before, and the user inside the car 7 when departing from the 5th floor. to determine the passenger's departure and arrival floors.
- the floor determination unit 19 determines that the arrival floor of the user B, who was in the car when the car 7 departed from the 4th floor and was not in the car when the car 7 departed from the 5th floor, is the 5th floor.
- the user identification unit 14 identifies the user riding inside the car 7 based on the image captured by the camera 12 inside the car 7. . In this example, no user is on the car 7 . At this time, the user identifying unit 14 does not identify any user as the user who is riding inside the car 7 .
- the floor determination unit 19 determines whether the user is inside the car 7 when departing from the 5th floor, which is the floor on which the user stopped just before, and the user is inside the car 7 when departing from the 6th floor. to determine the passenger's departure and arrival floors. The floor determination unit 19 determines that the arrival floor of the user D, who was on board when the car 7 departed from the 5th floor and did not board when the car 7 departed from the 6th floor, is the 6th floor.
- FIG. 7A to 7F are diagrams showing examples of determination by the floor determining unit 19 according to Embodiment 1.
- FIG. FIG. 7 shows an example of determining the arrival floor of a user who transits and uses a plurality of escalators 4 that are ascending. It should be noted that the arrival floor is similarly determined when one escalator 4 for ascending operation is used and when one or more escalators 4 for descending operation are used. Also when the stairs 5 are used, the arrival floor is similarly determined.
- the user identification unit 14 identifies the user A based on the image captured by the camera 12 .
- the elevator facility determination unit 17 determines that the elevator facility used by the user A is the escalator 4 .
- the floor determination unit 19 determines that the departure floor of the user A is the first floor where the entrance of the escalator 4 is provided.
- user A transfers to the escalator 4 that ascends between the 2nd and 3rd floors on the 2nd floor.
- a user B moving from the second floor to the fifth floor rides on an escalator 4 that ascends between the second floor and the third floor from the second floor.
- a user C who moves from the second floor to the fourth floor rides an escalator 4 that ascends between the second floor and the third floor from the second floor.
- the user identification unit 14 identifies User A based on the image captured by the camera 12 . After the user A is identified by the camera 12 provided at the exit on the second floor, the user A is identified by the camera 12 provided at the exit on the third floor before a preset time elapses. Sometimes, the floor determination unit 19 determines that the user A has changed the escalator 4 on the second floor.
- the user identification unit 14 identifies User B based on the image captured by the camera 12 .
- the elevator facility determination unit 17 determines that the elevator facility used by the user B is the escalator 4 .
- the floor determination unit 19 determines that the departure floor of the user B is the second floor where the entrance of the escalator 4 is provided.
- the user identification unit 14 identifies User C based on the image captured by the camera 12 .
- the elevator facility determination unit 17 determines that the elevator facility used by the user C is the escalator 4 .
- the floor determination unit 19 determines that the departure floor of the user C is the second floor where the entrance of the escalator 4 is provided.
- user A transfers to the escalator 4 that ascends between the 3rd and 4th floors on the 3rd floor.
- the user B transfers to the escalator 4 which ascends between the 3rd and 4th floors at the 3rd floor.
- the user C moves to the escalator 4 which ascends between the 3rd and 4th floors by transferring at the 3rd floor.
- a user D moving from the 3rd floor to the 6th floor rides an escalator 4 that ascends between the 3rd floor and the 4th floor from the 3rd floor.
- the user identification unit 14 identifies User A based on the image captured by the camera 12 . After the user A is identified by the camera 12 provided at the exit on the third floor, the user A is identified by the camera 12 provided at the exit on the fourth floor before a preset time elapses. Sometimes, the floor determination unit 19 determines that the user A has changed the escalator 4 on the third floor.
- the user identification unit 14 identifies User B based on the image captured by the camera 12 . After the user B is identified by the camera 12 provided at the exit on the third floor, the user B is identified by the camera 12 provided at the exit on the fourth floor before a preset time elapses. Sometimes, the floor determination unit 19 determines that the user B has changed the escalator 4 on the third floor.
- the user identification unit 14 identifies User C based on the image captured by the camera 12 . After the user C is identified by the camera 12 provided at the exit on the third floor, the user C is identified by the camera 12 provided at the exit on the fourth floor before a preset time elapses. Sometimes, the floor determination unit 19 determines that the user C has changed the escalator 4 on the third floor.
- the user identification unit 14 identifies the user D based on the image captured by the camera 12 .
- the elevator facility determination unit 17 determines that the elevator facility used by the user D is the escalator 4 .
- the floor determination unit 19 determines that the departure floor of the user D is the third floor where the entrance of the escalator 4 is provided.
- User A gets off the escalator 4 from the exit on the 4th floor.
- the user B transfers to the escalator 4 which ascends between the 4th and 5th floors on the 4th floor.
- User C gets off the escalator 4 from the exit on the fourth floor.
- the user D transfers to the escalator 4 which ascends between the 4th and 5th floors on the 4th floor.
- the floor determination unit 19 determines that the arrival floor of the user A is the 4th floor.
- the user identification unit 14 identifies User B based on the image captured by the camera 12 . After the user B is identified by the camera 12 provided at the exit on the 4th floor, the user B is identified by the camera 12 provided at the exit on the 5th floor before a preset time elapses. Sometimes, the floor determination unit 19 determines that the user A has changed the escalator 4 on the 4th floor.
- the floor determination unit 19 determines that the arrival floor of the user C is the 4th floor.
- the user identification unit 14 identifies the user D based on the image captured by the camera 12 . After the user D is identified by the camera 12 provided at the exit on the 4th floor, the user D is identified by the camera 12 provided at the exit on the 5th floor before a preset time elapses. Sometimes, the floor determination unit 19 determines that the user D has changed the escalator 4 on the 4th floor.
- user B gets off the escalator 4 from the exit on the 5th floor.
- the user D transfers to the escalator 4 which ascends between the 5th and 6th floors at the 5th floor.
- the floor determination unit 19 determines that the arrival floor of the user B is the 6th floor.
- the user identification unit 14 identifies User D based on the image captured by the camera 12 . After the user D is identified by the camera 12 provided at the exit on the fifth floor, the user D is identified by the camera 12 provided at the exit on the sixth floor before a preset time elapses. Sometimes, the floor determination unit 19 determines that the user D has changed the escalator 4 on the 5th floor.
- user D gets off the escalator 4 from the exit on the 6th floor.
- the floor determination unit 19 determines that the arrival floor of the user B is the 6th floor.
- the floor determination unit 19 manages information on the getting on and off status for each user.
- FIG. 1 An example of determining the arrival floor of the user of the escalator 4 has been described using FIG. The difference is that users of the escalator 4 can move between floors without walking, but users of the stairs 5 move between floors by walking.
- user identification by the user identification unit 14 user exclusion processing by the matching processing unit 18, and usage start floor and usage end floor of the elevator equipment by the camera 12 Determination of is performed in the same way including the flow of processing.
- FIGS. 8 and 9A, and 9B are diagrams showing an example of behavior information acquisition by the interest degree measuring system 1 according to the first embodiment.
- FIGS. 10A to 10C are diagrams showing an example of acquisition of interest information by the interest degree measuring system 1 according to Embodiment 1.
- FIG. 10A to 10C are diagrams showing an example of acquisition of interest information by the interest degree measuring system 1 according to Embodiment 1.
- the bird's-eye view maps of the arrival floor shown in FIGS. 8, 9, and 10 are generated, for example, based on images captured by a plurality of cameras 12 provided on the arrival floor.
- a bird's-eye view map is an image obtained by, for example, pasting together a plurality of images of arrival floors taken at the same time on a plane and synthesizing them so that there is no contradiction in the peripheral portion of the overlapping images.
- the bird's-eye view map may include an invisible area.
- An invisible area is an area that cannot be captured by any camera 12 .
- the invisible area is, for example, the inside of the hoistway after the car 7 of the elevator 3 has moved from the arrival floor, the toilet provided on the arrival floor, or the range that is known not to be used by the user.
- a bird's-eye view map is generated in advance based on an image acquired during a time when no user is present, such as at night or early in the morning.
- the bird's-eye view map may be updated, for example, once a day, or may be updated as appropriate. Since the images used to generate the bird's-eye view map may include the user in the image, it is desirable that the images are captured at the same time by a plurality of cameras 12 on the arrival floor. It does not have to be generated.
- the bird's-eye view map may be generated from a plurality of images shot at different times in which the user is not reflected.
- FIG. 8 an example of a user arriving at the arrival floor using the elevator 3 is shown.
- the action information acquisition unit 15 starts acquiring action information, for example, when the user arrives at the arrival floor. For example, when the floor determination unit 19 determines the arrival floor of any user, the behavior information acquisition unit 15 determines that the user has arrived at the arrival floor. The action information acquisition unit 15 acquires the bird's-eye view map of the arrival floor when the user arrives at the arrival floor.
- the behavior information acquisition unit 15 arranges information represented by using at least three feature amounts of the user's shoulders and nose acquired based on the image on the bird's-eye view map. As a result, the coordinates on the bird's-eye view map of the user at the arrival floor are acquired. The behavior information acquisition unit 15 adds the information acquired in this way to the behavior information as time-series data as information representing the arrangement of users.
- the behavior information acquisition unit 15 After that, after a preset time interval has elapsed, the behavior information acquisition unit 15 newly acquires information representing the user's arrangement. The behavior information acquisition unit 15 adds the newly acquired information to the behavior information as time-series data. In this way, the behavior information acquisition unit 15 continuously updates the behavior information of the user.
- the action information acquisition unit 15 starts counting the elapsed time after the user frames out. During this time, the behavior information acquisition unit 15 suspends acquisition of behavior information about the user. After that, as shown in FIG. 9B, when the user frames in from the invisible region before a preset time elapses after frame out, the behavior information acquiring unit 15 acquires the behavior information of the user. continue to acquire
- the behavior information acquisition unit 15 detects the camera 12 inside the car 7 of the elevator 3, the camera 12 of the escalator 4, the camera 12 of the stairs 5, and the other cameras. Movement of the user is specified in cooperation with a plurality of cameras 12 on the floor.
- the action information acquisition unit 15 finally goes out of the frame, for example. record the time and place of At this time, the behavior information acquiring unit 15 may display the location on the bird's-eye view map and alert the user with an alarm or the like, if necessary.
- the behavior information storage unit 16 stores the behavior information acquired by the behavior information acquisition unit 15 for each user.
- the behavior information storage unit 16 accumulates and stores a plurality of pieces of behavior information about the same user.
- the interest information acquisition unit 20 acquires the user's interest information each time the behavior information acquisition unit 15 completes acquisition of the user's behavior information on the arrival floor.
- the interest information acquisition unit 20 superimposes the information representing the location of the users included in the behavior information of the arrival floor on the bird's-eye view map of the arrival floor.
- the information-of-interest acquisition unit 20 acquires a triangle consisting of three coordinate points of at least three feature values of both shoulders and nose, and a line segment The direction from the midpoint to the nose is superimposed on the bird's-eye view map of the arrival floor.
- interest information acquiring unit 20 acquires an area on an extension line in the direction from the midpoint of the line connecting two shoulders to the nose, which is included in the behavior information as time-series data, and Identify and retrieve attributes.
- the interest information acquisition unit 20 extends the orientation of the user indicated in each piece of interest direction information to the front of the user.
- the information-of-interest acquisition unit 20 detects intersections of a plurality of half-lines extending forward of the user.
- the interest information acquisition unit 20 identifies areas and attributes in which the intersection points are concentrated as ranges of high interest of the user.
- the interest information acquiring unit 20 may include, in the interest information of the user, information about the degree of interest of the user according to the density of intersections, for example.
- the interest information acquisition unit 20 reads from the attribute storage unit 13 the attribute of the area specified as the range in which the user's degree of interest is high.
- the interest information acquisition unit 20 includes the read attribute in the interest information as an attribute with a high degree of interest of the user. At this time, the interest information acquisition unit 20 associates the read attributes with information on the degree of interest of the user and acquires them.
- the interest information acquisition unit 20 generates the trajectory of the user by connecting interest direction information on the bird's-eye view map.
- the information-of-interest acquisition unit superimposes the time at which the user was at that position on each point of the trajectory of the user on the bird's-eye view map.
- places where time points are dense Such a place corresponds to the place where the staying time is long.
- the interest information acquisition unit 20 may include the place where the user stays for a long time as an element of the interest information of the user.
- the interest information storage unit 21 stores the interest information acquired by the interest information acquisition unit 20 for each user.
- the interest information storage unit 21 may update the stored interest information when the interest information acquisition unit 20 acquires interest information about a user whose interest information is already stored. For example, the interest information storage unit 21 may add the information on the level of interest for each attribute calculated by the information on interest acquisition unit 20 to the stored information on the level of interest for each attribute. By sequentially updating the interest information for each user, the accuracy of the interest information recorded by the interest information storage unit 21 is further enhanced.
- FIG. 11 is a diagram showing an example of interest information acquisition by the interest degree measuring system 1 according to the first embodiment.
- the interest information acquisition unit 20 may acquire interest of a certain user in another user as interest information.
- Interest information among users is acquired, for example, when the users are employees of the building 2 .
- Interest information between users corresponds to, for example, a quantity such as frequency or time of communication between users.
- the interest information acquisition unit 20 calculates interest information between users based on contact time between users.
- the contact information is the length of time the user stays in the same area continuously.
- each user's trajectory is displayed on a three-dimensional space-time spanned by two-dimensional spatial coordinates representing positions on the bird's-eye view map and a time axis in the direction perpendicular to the bird's-eye view map.
- user A is staying in an area of building 2 .
- user B enters the area.
- User B exits the area after interacting with user A in the area.
- the interest information acquiring unit 20 calculates the contact time of the user A and the user B as the time from the time when the user B entered the area to the time when the user B left the area.
- the interest information acquisition unit 20 acquires interest information such that the longer the contact time is, the higher the degree of mutual interest of the user A and the user B is.
- FIG. FIGS. 12A and 12B, and FIGS. 13A and 13B are diagrams showing an example of presentation of a destination by the degree-of-interest measuring system 1 according to the first embodiment.
- FIG. 12 shows an example of a building 2 to which the interest level measurement system 1 is applied.
- FIG. 12A building 2 is shown on a certain day.
- a store P that handles items P1 and P2 is opened in the area on the 4th floor.
- a store Q that handles items Q1 and Q2 is opened in the area on the third floor.
- an R store that provides service R1 and service R2 is opened in the area on the second floor.
- the interest information storage unit 21 stores the item P1 as the attribute with the highest degree of interest for the user A.
- the interest information storage unit 21 stores Q shop as the attribute with the highest degree of interest for user B.
- the interest information storage unit 21 stores service R2 as an attribute of user C with the highest degree of interest.
- the destination presentation unit 22 reads interest information about the user A from the interest information storage unit 21 .
- the destination presenting unit 22 in this example presents the area of the attribute with the highest degree of interest to the user as the destination. That is, areas with attributes of the highest degree of interest are preferentially presented. Therefore, the destination presentation unit 22 acquires the item P1 as the attribute of which the user A has the highest degree of interest.
- the destination presentation unit 22 extracts areas having the item P1 as an attribute from the attribute storage unit 13 . In this example, the destination presentation unit 22 extracts the area on the second floor where the P store after the relocation is located. The destination presentation unit 22 presents the extracted area to the user A as a destination.
- the destination presentation unit 22 presents the area on the third floor where Q store is open as a destination based on the interest information.
- the user C who used the building 2 again on this day has a plurality of cameras 12 provided on the first floor, or a camera 12 of the stairs 5 taken before arriving at the arrival floor after starting to use the stairs 5. is identified by the user identification unit 14 based on the image taken by .
- the destination presentation unit 22 presents the fourth floor area where the S shop that provides the service R2 is located based on the interest information as the destination.
- the destination presentation unit 22 presents the destination floor including the destination area and the route to the destination area by video or audio, for example.
- the destination presenting unit 22 may also present to the user the attribute with the highest degree of interest of the user used for extracting the user's destination.
- the destination presenting unit 22 may present information such as "Store Q is on the left side of the exit on the 3rd floor" to User B, for example.
- the destination presenting unit 22 may present information to the user C such as "the S store that provides the service R2 is in front of the exit on the 4th floor". As a result, the destination can be presented to the user without using personal information such as the user's name.
- FIG. 12 an example of destination presentation through the car operating panel 10 is shown.
- the second floor is presented as the destination floor to the user A who has boarded the car 7 .
- FIG. 12 shows an example of using the car operating panel 10.
- a portable terminal such as a smartphone carried by a user can directly or indirectly communicate with the elevator 3, the car operating panel 10 User alerts, call registration, guidance, and the like may be performed through the mobile terminal, as is the case.
- the destination presentation unit 22 blinks the light-emitting device of the destination button 10b corresponding to the second floor, thereby alerting the user A to guidance before registering the second floor as the destination floor.
- the destination presenting unit 22 may cause the display device such as the display panel 10a to display an image such as "The store P that handles the item P1 is on the second floor.”
- the destination presenting unit 22 may cause a built-in speaker of a display device such as the display panel 10a to present voice guidance together.
- the call registration unit 23 receives a call with the presented floor as the destination floor.
- the destination presenting unit 22 ends presenting the destination floor guidance by blinking the light-emitting device of the destination button 10b corresponding to the second floor. Further, for example, immediately after the destination button 10b is operated and the call is registered, the destination presenting unit 22 ends the presentation of the destination floor guidance by blinking the light-emitting device of the destination button 10b corresponding to the second floor.
- the light-emitting device of the destination button 10b corresponding to the floor designated as the destination floor lights up.
- the registration of the call is confirmed.
- the destination presentation unit 22 may say, "Store P will move the elevator 3 to this floor.
- a video or audio guide may be presented showing information such as "get off at the bus stop and it's on the right side.”
- the destination presentation unit 22 may continue presenting the destination when the destination button 10b corresponding to a floor other than the presented destination floor is operated. Alternatively, for example, in the case where there is only one user riding in the car 7, the destination presenting unit 22 displays the destination when the destination button 10b corresponding to a floor other than the presented destination floor is operated. may be terminated.
- the destination presentation unit 22 may present the destination floor without blinking the light-emitting device of the destination button 10b.
- the destination presentation unit 22 may present the destination floor to the user, for example, by changing the brightness of the light-emitting device of the destination button 10b corresponding to the destination floor, or by changing the color tone of the light-emitting device.
- the destination information actually presented to the user by the destination presentation unit 22 is associated with the user's behavior information or interest information, or information such as the location or time at which the destination is presented, and is associated with the behavior information. It is stored in the storage unit 16, the interest information storage unit 21, or the like.
- FIG. 14A to 14E are diagrams showing examples of interest level maps by the interest level measuring system 1 according to Embodiment 1.
- FIG. 14A to 14E are diagrams showing examples of interest level maps by the interest level measuring system 1 according to Embodiment 1.
- the visualization processing unit 27 integrates interest information for each user of the building 2 to generate an interest level map, as shown in FIG. 14A, for example.
- the first time and the second time are times specified in the generation conditions.
- the first time and the second time may be different times on the same day, or may be times on different dates.
- the visualization processing unit 27 causes the interest information storage unit 21 to store all the users of the floor of the building 2 between the first time and the second time specified in the generation condition, including the time and place information. Read the interest information you have.
- the visualization processing unit 27 integrates the interest information by, for example, totaling the degree of interest of each user in the read interest information for each location of the floor, that is, for each area and attribute. For example, when the level of interest is obtained for each attribute, the visualization processing unit 27 may total the sum of the levels of interest for each attribute for each area of the floor.
- the interest level map is generated, for example, as a diagram in which a three-dimensional graph of the level of interest level is superimposed on the bird's-eye view map of the floor.
- the generated interest degree map is displayed on the operation display unit 28 to the owner of the building 2 or the like.
- the visualization processing unit 27 generates an interest level map for each user of the building 2, as shown in FIG. 14B, for example.
- the generation conditions of the degree-of-interest map determined by the owner of the building 2 or the like by operating the operation display unit 28 a specific use from the first time to the second time on any floor of the building 2 is performed.
- the generation of interest maps for persons is specified. For example, a specific user A is specified in the generation conditions.
- the visualization processing unit 27 reads user A's interest information stored by the interest information storage unit 21, including time and place information, between the first time and the second time specified in the generation condition.
- the visualization processing unit 27 generates a degree-of-interest map, for example, as a diagram in which a three-dimensional graph of the degree of interest of the user A is superimposed on a bird's-eye view map of the floor.
- the generated interest degree map is displayed on the operation display unit 28 to the owner of the building 2 or the like.
- the visualization processing unit 27 selects one of the floors of the building 2 from the generation conditions of the degree-of-interest map determined by the operation display unit 28 by the owner of the building 2 or the like. generation of an interest level map including behavior information about user A from a first time to a second time in .
- the visualization processing unit 27 may generate an interest level map including user behavior information.
- the visualization processing unit 27 from the generation conditions of the degree-of-interest map determined by the owner of the building 2 or the like by operating the operation display unit 28, determines the , generation of an interest level map containing behavior information about users who apply to certain classification information is specified.
- the visualization processing unit 27 may generate an interest level map including action information of a plurality of users.
- the visualization processing unit 27 reads user A's interest information stored by the interest information storage unit 21, including time and place information, between the first time and the second time specified in the generation condition. In addition, the visualization processing unit 27 converts the behavior information of the user A stored by the behavior information storage unit 16, including the time and place information, between the first time and the second time specified in the generation condition. load. The visualization processing unit 27 generates a degree-of-interest map, for example, by superimposing a three-dimensional graph of the degree of interest of user A and the trajectory of user A on a bird's-eye view map of the floor. When user A uses the floor multiple times, the interest level map may include multiple trajectories of user A.
- the visualization processing unit 27 generates an interest degree map including areas in which the user A has a high degree of interest.
- the area in which the user A has a high degree of interest is, for example, the store P that handles the product P1.
- the generated interest degree map is displayed on the operation display unit 28 to the owner of the building 2 or the like.
- the interest level map may also display user A's classification information.
- the user A's classification information includes, for example, user A's frequency of use of the building 2, gender, age group, use time zone, day of the week, and weather at the time of use.
- the interest level map may display only one of user A's trajectory or classification information.
- the visualization processing unit 27 may generate an interest level map including action information or interest information of a plurality of users, as shown in FIG. 14D, for example.
- the plurality of users may be some or all of the users of the building 2 who satisfy certain conditions specified in the conditions for generating the interest level map. For example, from the generation conditions of the degree-of-interest map determined by the owner of the building 2 or the like by operating the operation display unit 28, the users from the first time to the second time on any floor of the building 2 can be identified. It specifies the generation of an interest map for users who have expressed an interest in the attributes of In the production conditions, for example, the product P1 is specified as a specific attribute.
- the visualization processing unit 27 stores the interest information storage unit 21 and the behavior information storage unit 16 in time and place for all users of the floor of the building 2 between the first time and the second time specified in the generation condition. Read the stored interest information and behavior information including the information of Based on the read interest information, the visualization processing unit 27 extracts users whose degree of interest in the item P1 is higher than a certain threshold determined by operation on the operation display unit 28 . In this example, five users, user A, user B, user C, user D, and user E, are extracted. The visualization processing unit 27 generates a degree-of-interest map, for example, by superimposing the extracted trajectory of each user on a bird's-eye view map of the floor, based on the behavior information that has been read. In this example, an interest level map is generated as a diagram in which each user's trajectory is superimposed on a plurality of overhead maps of the same floor.
- the visualization processing unit 27 may generate an interest level map by extracting users whose actions deviate from the main user's tendency among a plurality of users. good. For example, from the generation conditions of the interest level map determined by the owner of the building 2 by operating the operation display unit 28, among the users on one floor of the building 2, the tendency of the main users is deviated. The generation of interest maps for behavioral users is specified.
- the visualization processing unit 27 collects interest information and action information stored by the interest information storage unit 21 and the action information storage unit 16, including time and place information, for all users on the floor specified in the generation condition. load.
- the visualization processing unit 27 extracts users whose behavior deviates from the tendency of main users based on the read interest information.
- the extraction conditions may be specified in the interest level map generation conditions.
- the extraction condition is, for example, a condition based on a distribution that represents the usage trend of main users.
- the distribution is, for example, the time zone used by the users.
- the degree of matching with the distribution is determined, for example, based on how far the usage pattern of each user differs from the average value of the distribution in units of standard deviation ⁇ .
- the visualization processing unit 27 extracts users who use the service at a time separated by 3 ⁇ or more from the average time of the distribution of the user's usage time zone. At this time, the visualization processing unit 27 extracts, for example, users in the late-night hours. Regardless of the averages and standard deviations shown in this example, various statistical methods may be used to extract users whose behavior deviates from the main user's tendency.
- each store in Building 2 is closed during midnight hours.
- the user J behaves regularly inside the building 2 with high frequency and does not show a high degree of interest biased toward a specific area.
- User J can be presumed to be a security guard patrolling the inside of building 2 .
- the owner of the building 2 can confirm whether or not the user J is a security guard by inquiring about the time when the user J acts and the work status of the security guard.
- the user K uses the building 2 with a low frequency and shows a biased degree of interest in a specific area.
- the trajectory of user K indicates irregular and suspicious behavior. At this time, the user K may be a suspicious person who has entered the building 2 .
- the owner of building 2 or the like can grasp the intrusion of a suspicious person.
- the visualization processing unit 27 may detect users whose behavior deviates from the main users' tendencies at any time without depending on the operation of the owner of the building 2 or the like.
- the operation display unit 28 may notify the owner of the building 2 or the like. As a result, damage such as theft in the building 2 can be suppressed in advance.
- FIG. 15A and 15B are diagrams showing examples of interest level maps by the interest level measuring system 1 according to Embodiment 1.
- FIG. 15C is a diagram showing an example of setting simulation conditions in the simulation system 50 according to the first embodiment.
- 15D and 15E are diagrams showing examples of simulation results by simulation system 50 according to the first embodiment.
- the owner of building 2 refers to the interest level map generated by the visualization processing unit 27 as shown in FIG. 15A using the operation display unit 28.
- the interest level map is generated by integrating interest information of all users on a specific day specified by the owner of building 2 or the like.
- the first time is set to the opening time of building 2 on the particular day
- the second time is set to the closing time of building 2 on the particular day.
- An interest map is generated for the second floor as a specific floor of building 2 .
- S store and T store are opened.
- the level of interest in S store and T store is low. In other words, S store and T store have low ability to attract customers. In this case, if the degree of interest of the S store and the T store can be increased, the value of the building 2 may be increased.
- the owner of building 2 refers to the trajectory of the user in building 2 indicated by the interest level map, as shown in FIG. 15B.
- the trajectories of user A, user B, and user C are visualized.
- the interest degree measuring system 1 has acquired the interest information of the user A, the user B, and the user C.
- the interest information storage unit 21 stores an item P1 as an attribute of user A with a high interest level.
- the interest information storage unit 21 stores Q store as an attribute of user B with a high degree of interest.
- the interest information storage unit 21 stores service R1 as an attribute of user C with a high degree of interest.
- user A has been to store P that deals with item P1.
- the user B goes to the Q store and is acting in the vicinity of the article Q1.
- the user C is going to the R store that handles the service R1.
- the owner of the building 2 considers a layout that further enhances the value of the building 2 based on information such as the degree of interest and trajectory of users grasped by the interest degree map.
- the owner of building 2 uses the simulation by the simulation system 50 to study the layout.
- the owner of the building 2 or the like sets the simulation conditions through the operation display unit 28, for example.
- the owner of building 2 or the like edits the layout of the second floor of building 2 as a simulation condition, for example, as shown in FIG. 15C.
- a one-way passage is set for the aisle adjacent to the T store.
- the positions of the Q store and the S store are exchanged.
- the owner of the building 2 or the like causes the simulation system 50 to start the simulation through the operation display section 28 or the like.
- the simulation processing unit 29 performs a simulation as follows, for example.
- the simulation processing unit 29 sets users to be simulated.
- the simulation processing unit 29, for example, simulates all or some of the users specified by the interest level map generation conditions.
- the simulation processing unit 29 subjects user A, user B, and user C to the simulation.
- the simulation processing unit 29 may add, for example, a virtual user who is highly interested in the attributes of the specific area to the target of the simulation.
- the simulation processing unit 29 may add one or more virtual users to the simulation target.
- classification information such as age and sex may be assigned to each virtual user.
- the virtual users to be added and their classification information and interest information are specified, for example, in the simulation conditions.
- conditions outside the building 2 such as weather, may be specified.
- the conditions outside the building 2 are used, for example, for selecting users to be simulated and adding virtual users.
- the simulation processing unit 29 sets the destination area of the building 2 for each user to be simulated. For example, for a user who actually acted on the second floor of the building 2, the simulation processing unit 29 sets the area where the user actually went on the second floor as the destination area.
- the area visited by the user has, for example, attributes of the destination area in which the degree of interest of each user is high.
- the destination area may include lift equipment as the start or end of the trajectory on the second floor.
- the destination area may include non-visible areas such as restrooms.
- the simulation processing unit 29 sets the order of the destination areas. The order may be set, for example, in descending order of the degree of interest, or may be set so that the travel distance on the second floor is short.
- the simulation processing unit 29 simulates behavior information on the second floor for each user to be simulated. For example, for a user who was actually acting on the second floor of the building 2, if there is no place where the layout has been edited on the trajectory of the user, the simulation processing unit 29 performs the actual behavior of the user on the second floor. Based on the trajectory, simulated behavior information is generated in the same manner as the processing in the behavior information acquisition unit 15 . Alternatively, the simulation processing unit 29 sets the trajectories of the users in the order in which the destination areas are set for each user. At this time, the simulation processing unit 29 sets the trajectory of the user, for example, assuming that the user moves between one or more destination areas without detouring. The simulation processing unit 29 may disturb the trajectory of the user using random numbers or the like.
- the simulation processing unit 29 may set the trajectory of the user by using a known technique such as crowd simulation.
- the simulation processing unit 29 generates simulated behavior information based on the set trajectory in the same manner as the processing in the behavior information acquisition unit 15 .
- the simulation processing unit 29 generates simulated behavior information, for example, assuming that the direction-of-interest information of the user is forward of the trajectory set for the user regardless of left or right.
- the simulation processing unit 29 simulates interest information in the same way as the processing in the interest information acquisition unit 20 based on simulated behavior information for each of the users to be simulated.
- the simulation processing unit 29 generates the result of the simulation as an interest degree map in the same manner as the processing in the visualization processing unit 27 based on the simulated behavior information and interest information.
- the simulation processing unit 29 calculates the difference between the simulation result and the information stored in the interest information storage unit 21 .
- the simulation processing unit 29 calculates the difference by, for example, taking the difference in the distribution of the level of interest between the simulation result and the actually acquired interest information.
- FIG. 15D is a diagram showing an example of a trajectory for each user as a result of simulation.
- the simulated trajectories of user A and user C are the same as the actual trajectories.
- the trajectory of the user B is set to reach the Q store through the passage adjacent to the T store.
- the trajectory of user B is set so that the outbound route to the Q store and the return route from the Q store pass through different passages.
- the direction of interest of the user B who is moving on the second floor is directed to the S store and the T store. In this case, the degree of interest in the S store and the T store is heightened.
- FIG. 15E is a diagram showing the distribution of the degree of interest on the second floor as a result of the simulation.
- the interest level map that visualizes changes in interest information enables the owner of the building 2 to grasp the influence of layout editing on the interest level.
- FIG. 16A is a diagram showing an example of a degree-of-interest map by the degree-of-interest measuring system 1 according to Embodiment 1.
- FIG. 16B is a diagram showing an example of simulation results by the simulation system 50 according to the first embodiment.
- Elevators 3a and 3b and stairs 5 are provided as lifting equipment that users of the building 2 use to move between floors from the first floor to the fourth floor.
- An escalator 4 is provided as a lift facility for users of the building 2 to move between floors from the first floor to the third floor.
- the trajectories of each user including user A, user B, and user C, are stored in the behavior information storage unit 16 as behavior information.
- user A moves from the first floor to the second floor using elevator 3a. After that, the user A shows an interest in the item Qa1 at the Qa store on the second floor. After that, the user A uses the escalator 4 to move from the second floor to the third floor. After that, User A stops at the restroom on the third floor. After that, the user A shows an interest in the item Ra1 at the Ra shop on the 3rd floor. After that, the user A moves from the third floor to the first floor using the elevator 3b. After that, the user A leaves the building 2 through the doorway.
- user B uses elevator 3b to move from the 1st floor to the 3rd floor. After that, User B stops at the restroom on the third floor. After that, the user B shows an interest in the item Rb1 at the Rb store on the 3rd floor. After that, the user B moves from the third floor to the second floor using the elevator 3b. After that, the user B shows an interest in the item Qb1 at the Qb store on the second floor. After that, the user B moves from the second floor to the first floor using the elevator 3b. After that, the user B leaves the building 2 through the doorway.
- user C is interested in item Pc1 at the PC store on the first floor.
- the user C uses the escalator 4 to move from the first floor to the second floor.
- the user C shows an interest in the item Qc1 at the Qc store on the second floor.
- the user C moves from the second floor to the first floor using the elevator 3a.
- the user C leaves the building 2 through the doorway.
- FIG. 16A By superimposing such user trajectories on the bird's-eye view map of each floor, sparse areas where the density of user trajectories is low are visualized.
- the sparse area is indicated by a dashed-dotted frame.
- FIG. 16A in building 2, there is room for improvement in that the vicinity of the entrance is crowded, that escalator 4 is used less than elevator 3, and that there are many sparse areas on each floor. Recognize. The owner of the building 2 or the like considers the layout of each floor of the building 2 so that these points can be addressed.
- the owner of building 2 uses the simulation by the simulation system 50 to study the layout.
- the owner of the building 2 or the like sets the simulation conditions through the operation display unit 28, for example.
- the owner of building 2 or the like edits the layout of the first to third floors of building 2 as simulation conditions, for example, as shown in FIG. 16B.
- the 4th floor which is the office floor, and the users of the 4th floor are excluded from the simulation.
- one-way traffic is set for each entrance and exit.
- a panel or the like is provided to guide the user from the entrance to the Pa store that was in the sparse area.
- the Pe store is placed adjacent to the Pa store in the sparse area.
- Pb stores, Pd stores, and Pf stores that were in the sparse area are arranged intensively at locations adjacent to the Pe point.
- rest areas are arranged at locations facing Pb, Pd, and Pf stores that were in the sparse area.
- the escalator 4 is limited to going up.
- elevator 3a and elevator 3b are limited to descending operation.
- the Qc store, Qd store, Qe store, and Qf store that were in the sparse area are concentrated in the vicinity of the escalator 4 .
- an entrance leading to the Qf store and an exit leading to the Qc store are provided. These are the via entrance and exit settings in the second floor layout.
- the Rc store, Rd store, and Re store that were in the sparse area are concentrated.
- an entrance leading to the Re store is provided, and an exit leading to the Rc store is provided. These are the entrance and exit settings for the 3rd floor layout.
- the elevator 3a and the elevator 3b are not limited to descending operations for users on the fourth floor, which is the office floor.
- the owner of the building 2 or the like causes the simulation system 50 to start the simulation through the operation display unit 28, for example.
- the simulation processing unit 29 performs simulations over multiple floors in the same manner as simulations for a single floor.
- the simulation processing unit 29 sets users to be simulated. For example, the simulation processing unit 29 sets a plurality of users, including user A, user B, and user C, but excluding the user on the fourth floor, as objects of the simulation.
- the simulation processing unit 29 sets attributes of high interest within the building 2 for each user to be simulated.
- the simulation processing unit 29 simulates behavior information on the first floor, the second floor, and the third floor for each user to be simulated.
- the simulation processing unit 29 simulates interest information similarly to the processing in the interest information acquisition unit 20 based on simulated behavior information for each user to be simulated.
- the effect of alleviating congestion near the entrance/exit by making the entrance/exit one-way is simulated.
- by concentrating and arranging the stores that were in the sparse area it becomes easier for the user's interest to be directed to each store.
- by guiding the movement route of the user to the store located in the sparse area the direction of interest of the user is likely to be directed to the store.
- by arranging rest areas in locations facing stores that were in the sparse area it becomes easier for users to direct their interest toward each store.
- the simulation system 50 simulates the effect of increasing the degree of interest in the sparse area due to such a change.
- the effect of equalizing the utilization rate of each lifting equipment such as the elevator 3 and the escalator 4 due to restrictions on the movement direction of the user is simulated.
- the interest level measurement system 1 may be used for managing the work environment of employees in the building 2, and the like.
- the simulation system 50 may be used, for example, to improve the working environment of workers in the building 2 .
- FIG. 17A is a diagram showing an example layout of the building 2 according to Embodiment 1.
- FIG. 17B is a diagram showing an example of simulation results by the simulation system 50 according to the first embodiment.
- the first, second, and third floors are store floors.
- the fourth floor is an office floor where employees work.
- a management office a store staff room, a warehouse, and a common area are provided on the 4th floor.
- a corridor with walls is provided between the administration office and the shop staff room.
- desks are arranged for users W and Y to perform clerical work.
- a user W and a user Y are employees who are engaged in management work for the building 2 .
- desks are arranged for user X and user Z to do clerical work.
- a user X is an employee who is involved in the business of the store P opened in the building 2 .
- a user Z is an employee engaged in the business of the Q store opened in the building 2 .
- goods P1 and the like are stocked in the stock management area of store P.
- a common area is a place that is used regardless of the user's affiliation.
- the common area is, for example, a hot water supply room, a rest room, or the like.
- the interest information acquisition unit 20 acquires the user's interest information based on the user's behavior information.
- the interest information acquisition unit 20 acquires interest information among users based on, for example, contact time in an area included in the common area.
- the interest information storage unit 21 stores user X and user Y as targets of high interest for user W.
- the interest information storage unit 21 stores the item P1 in the inventory management area of the store P and the user Z as attributes of high interest for the user X.
- the interest information storage unit 21 stores user Y's desk in the management office and user W as highly interested attributes of user Y.
- the interest information storage unit 21 stores user Z's desk in the store staff room and user X as highly interested attributes of user Z.
- the owner of the building 2 By referring to the interest level map generated by the visualization processing unit 27 through the operation display unit 28, the owner of the building 2, etc. can see the flow line of the employees, the work efficiency of the employees, the status of interaction between the employees, etc. Grasp.
- the owner of the building 2 or the like considers a layout that further enhances the working environment of the employees based on the situation grasped by the interest level map.
- the owner of building 2 uses the simulation by the simulation system 50 to study the layout.
- the owner of the building 2 or the like sets the simulation conditions through the operation display unit 28, for example.
- the owner of building 2 or the like edits the layout of the fourth floor of building 2 as a simulation condition, for example, as shown in FIG. 17B.
- the 1st, 2nd, and 3rd floors, which are store floors, are excluded from the simulation target.
- an inventory management area containing items P1 of store P is placed on the store staff room side of the warehouse.
- the corridor walls have been removed to allow movement between the administration office and the store staff room.
- the desk of the user X is arranged so as to be close to the inventory management area containing the item P1 of the store P that has a high degree of interest.
- the desk of user W is arranged so as to be close to the desk of user X who has a high degree of interest.
- the desk of user Y is arranged so as to be close to the desk of user W, who has a high degree of interest.
- the desk of user Z is arranged so as to be close to the desk of user X who has a high degree of interest.
- the desks of users who are highly interested in each other are spaced apart from each other within a range in which they can interact with each other. This makes it possible to avoid crowding of users without interfering with user interaction.
- the simulation processing unit 29 performs a simulation over multiple floors in the same way as the simulation for users on the store floor.
- the simulation processing unit 29 sets users to be simulated. For example, the simulation processing unit 29 sets a plurality of users including user W, user X, user Y, and user Z as simulation targets.
- the simulation processing unit 29 sets attributes of high interest within the building 2 for each user to be simulated.
- the simulation processing unit 29 simulates behavior information on the fourth floor for each user to be simulated.
- the simulation processing unit 29 simulates, for example, the user's staying time at each location such as a desk according to the frequency distribution acquired based on the user's behavior information.
- the simulation processing unit 29 simulates, for example, moving to a range where interaction with the other user is possible.
- the simulation processing unit 29 simulates interest information similarly to the processing in the interest information acquisition unit 20 based on simulated behavior information for each user to be simulated.
- the simulation system 50 simulates the effects of these changes in improving work efficiency.
- the interest level measurement system 1 may be used for attendance management of employees in the building 2, for example.
- the interest level measurement system 1 includes an attendance management unit (not shown).
- the attendance management unit of the interest level measurement system 1 determines that the day on which the user who is an employee uses any of the lifting facilities is the day on which the user comes to work.
- the attendance management unit of the interest level measurement system 1 determines the first time that the user arrives at the fourth floor using the elevator on the working day as the working time of the user on the working day.
- the attendance management unit of the interest level measurement system 1 determines the last time when the user left the fourth floor using the elevator on the working day as the user's leaving time on the working day.
- the attendance management unit of the degree-of-interest measurement system 1 performs these determination processes based on the behavior information stored in the behavior information storage unit 16, for example.
- FIG. 18, 19, 20A and 20B, and 21 are flowcharts showing an example of the operation of the degree-of-interest measuring system 1 according to the first embodiment.
- FIG. 18 shows an example of the operation of the degree-of-interest measurement system 1 for determining the arrival floor when the user uses the elevator 3 .
- step S101 the user identification unit 14 identifies a user who enters the car 7 of the elevator 3 when the door of the car 7 is open. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S102.
- step S102 when the car 7 of the elevator 3 departs from any floor, the processing of the degree-of-interest measurement system 1 starts.
- the car 7 departs from any floor it is, for example, when the door of the car 7 is closed at that floor.
- the operation of the degree-of-interest measurement system 1 proceeds to step S103.
- step S103 the user identification unit 14 confirms the identification of the user riding inside the car 7 of the elevator 3. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S104.
- step S104 the user identification unit 14 determines whether there is a user inside the car 7. If the determination result is Yes, the operation of the degree-of-interest measurement system 1 proceeds to step S105. If the determination result is No, the user identification unit 14 determines that no user is inside the car 7, and the operation of the interest level measurement system 1 proceeds to step S107.
- step S ⁇ b>105 the elevator facility determination unit 17 determines that the elevator 3 is the elevator facility used by the user identified by the user identification unit 14 in the car 7 of the elevator 3 . After that, the operation of the degree-of-interest measurement system 1 proceeds to step S106.
- step S106 the matching processing unit 18 performs matching processing for the user identified by the user identifying unit 14. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S107.
- step S107 the floor determination unit 19 stores the boarding status of the car 7 of the elevator 3 based on the result of identification by the user identification unit 14.
- the boarding status of the car 7 includes, for example, whether or not a user has boarded the car 7, and information identifying the user if the user is on board. Thereafter, the operation of the degree-of-interest measurement system 1 proceeds to step S108.
- step S108 the floor determination unit 19 determines the user's departure floor and arrival floor based on the boarding situation stored in step S107 and the boarding situation stored immediately before that. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S109.
- step S109 After the car 7 of the elevator 3 stops on any floor in step S109, the operation of the degree-of-interest measurement system 1 proceeds to step S101.
- FIG. 19 shows an example of the operation of the degree-of-interest measurement system 1 related to the determination of the arrival floor when the user uses the escalator 4 .
- step S201 the processing of the degree-of-interest measurement system 1 starts when the user frames in the camera 12 provided at the exit of any escalator 4. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S202.
- step S202 the user identification unit 14 identifies the user who is on the escalator 4, and confirms the identification of the user. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S203.
- step S203 the user identification unit 14 determines whether there is a user on the escalator 4. If the determination result is Yes, the operation of the degree-of-interest measurement system 1 proceeds to step S204. If the determination result is No, the operation of the degree-of-interest measurement system 1 proceeds to step S201.
- step S ⁇ b>204 the floor determination unit 19 determines whether the identified user is a user who has changed the escalator 4 . For example, the floor determination unit 19 determines whether the user exits the escalator 4 when a preset time has not passed since the user has gone out of the frame from the camera 12 arranged at the exit of the other elevator 3. It is determined that the user is a transfer user. If the determination result is No, the operation of the interest level measurement system 1 proceeds to step S205. If the determination result is Yes, the operation of the degree-of-interest measurement system 1 proceeds to step S208.
- step S205 the elevator facility determination unit 17 determines that the escalator 4 is the elevator facility used by the user identified by the user identification unit 14 on the escalator 4 . After that, the operation of the degree-of-interest measurement system 1 proceeds to step S206.
- step S206 the matching processing unit 18 performs matching processing for the user identified by the user identifying unit 14. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S207.
- step S207 the floor determination unit 19 determines the floor on which the entrance of the escalator 4 is provided as the user's departure floor. After that, the operation of the degree-of-interest measurement system 1 proceeds to step 208 .
- step S208 when the user frames out from the camera 12 provided at the exit of the escalator 4, the floor determination unit 19 starts timing the time after the user frames out. After that, the operation of the degree-of-interest measuring system 1 proceeds to step 209 .
- step S209 the floor determination unit 19 timed out, that is, after the user framed out, there was no frame-in to the camera 12 of the next escalator 4, and a preset time has passed. determine whether If the determination result is No, the operation of the degree-of-interest measurement system 1 proceeds to step S209 again. On the other hand, when the determination result is Yes, the operation of the degree-of-interest measurement system 1 proceeds to step 210 . Note that if the user frames the cameras 12 of other floors to get off other than the next escalator 4 before the timeout expires, the operation of the interest level measurement system 1 may proceed to step S210.
- step S210 the floor determination unit 19 determines the floor where the exit of the escalator 4 is provided as the arrival floor of the user. After that, the operation of the degree-of-interest measuring system 1 proceeds to step 201 .
- the interest level measurement system 1 performs similar processing to determine the arrival floor and the like.
- FIG. 20 shows an example of the operation of the interest level measurement system 1 related to acquisition of behavior information and interest information on the user's arrival floor.
- step S301 of FIG. 20A when the user's arrival floor is determined, the processing of the interest level measurement system 1 is started. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S302.
- step S302 the user identification unit 14 determines whether there is a bird's-eye view map of the arrival floor. If the determination result is No, the operation of the degree-of-interest measurement system 1 proceeds to step S303. If the determination result is Yes, the operation of the degree-of-interest measurement system 1 proceeds to step S305.
- step S303 the action information acquisition unit 15 starts acquiring images from the camera 12 placed on the arrival floor. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S304.
- step S304 the action information acquisition unit 15 generates a bird's-eye view map from the acquired image. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S305.
- step S305 the user identification unit 14 determines whether the user who has arrived at the arrival floor has been identified on the bird's-eye view map. If the determination result is No, the operation of the degree-of-interest measurement system 1 proceeds to step S301. If the determination result is Yes, the operation of the degree-of-interest measurement system 1 proceeds to step S306.
- step S306 the interest level measurement system 1 acquires behavior information and interest information for the user identified in step S305.
- the interest level measurement system 1 may acquire behavior information and interest information in parallel for the plurality of users. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S301.
- FIG. 20B shows an example of the contents of the processing in step S306 of FIG. 20A.
- step S401 the behavior information acquisition unit 15 acquires information on the placement of the identified users.
- the behavior information acquisition unit 15 acquires coordinate information of at least three feature amounts of the user's shoulders and nose.
- the behavior information acquisition unit 15 may acquire information on the coordinates of other feature amounts of the user.
- step S402 the action information acquisition unit 15 determines whether the user has entered the elevator facility. It should be noted that frame-in to the lifting equipment is frame-out when viewed from the floor where the user was. If the determination result is No, the operation of the degree-of-interest measurement system 1 proceeds to step S403. If the determination result is Yes, the operation of the degree-of-interest measurement system 1 proceeds to step S405.
- step S403 the action information acquisition unit 15 determines whether the user has stepped out of the invisible area or the doorway of the building 2 to the outside. If the determination result is No, the operation of the degree-of-interest measurement system 1 proceeds to step S401. If the determination result is Yes, the operation of the degree-of-interest measurement system 1 proceeds to step S404.
- step S404 the action information acquisition unit 15 determines whether a timeout has occurred, that is, whether a preset time has elapsed since the user left the invisible area or the doorway of the building 2 to the outside. If the determination result is No, the operation of the degree-of-interest measurement system 1 proceeds to step S401. If the determination result is Yes, the operation of the degree-of-interest measurement system 1 proceeds to step S405.
- step S405 the action information acquisition unit 15 completes acquisition of action information.
- the action information storage unit 16 stores the acquired action information as time-series data for each user. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S406.
- the interest information acquisition unit 20 extracts areas of high interest for the user based on the user's behavior information. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S407.
- the interest information acquisition unit 20 refers to the attribute of the area of which the user is highly interested from the attribute storage unit 13.
- the interest information acquisition unit 20 acquires interest information based on the information on the interest level of the user and the information on the attribute referred to.
- the interest information storage unit 21 stores the acquired interest information for each user. At this time, the interest information storage unit 21 may update the interest information for each user with the acquired interest information. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S408.
- step S408 the interest level measurement system 1 outputs a warning sound or an alert as necessary.
- a warning sound or alert is output, for example, when the user's frame-in and frame-out do not match.
- the case where the frame-in and frame-out of the user do not match is, for example, the case where the frame-out of the user who has entered the frame is not determined, or the case where the frame-out of the user who has not entered the frame is determined.
- the process of step S408 may be omitted if output such as a warning sound or an alert is not required.
- FIG. 21 shows an example of the operation of the degree-of-interest measurement system 1 related to the visualization of the user's interests that have already been measured.
- step S501 the visualization processing unit 27 receives an input of conditions for generating the degree-of-interest map through the operation display unit 28, for example. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S502.
- step S502 the visualization processing unit 27 reads interest information and action information from the interest information storage unit 21 and the action information storage unit 16 for users of the building 2 at the time designated by the generation condition. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S503.
- step S503 the visualization processing unit 27 narrows down the users whose interest information and action information are read based on the conditions specified in the generation conditions. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S504.
- step S504 the visualization processing unit 27 performs calculations for visualizing the interest information based on the user's interest information and action information narrowed down based on the generation conditions.
- Calculations for visualization include, for example, calculations such as digitization for visualizing interest information by graphs.
- the computation includes, for example, a computation of totaling the degree of interest of a plurality of users for each location. After that, the operation of the degree-of-interest measurement system 1 proceeds to step S505.
- step S505 the visualization processing unit 27 uses the result of the computation for visualization to generate an interest level map.
- the interest level map generation process includes, for example, superimposing a graph representing interest information and a bird's-eye view map. After that, the operation of the degree-of-interest measuring system 1 ends.
- FIG. 22 is a flow chart showing an example of the operation of the simulation system 50 according to the first embodiment. The processing in FIG. 22 is started after the processing in FIG. 21 is performed, for example.
- step S601 the simulation processing unit 29 receives an input of simulation conditions through the operation display unit 28, for example.
- existing conditions in FIG. 21 are used in inputting the simulation conditions.
- a new condition different from the condition in FIG. 21 is input. This clarifies the differences in the inputs of the simulation conditions. Operation of the simulation system 50 then proceeds to step S602.
- the simulation processing unit 29 reads interest information and action information from the interest information storage unit 21 and the action information storage unit 16 according to the input simulation conditions, for example, similar to the conditions in FIG.
- New conditions that differ from the conditions in FIG. 21 include, for example, layout corrections, changes, additions, or deletions of panels or entrances and exits on the movement route that guide destination locations or actions.
- New conditions different from the conditions in FIG. 21 also include, for example, rearrangement of the store or inner walls. Repositioning also moves accompanying areas and their attributes. At this time, the rearrangement is not limited to the movement of each store, and may be the movement of a part of the area of the store and its attributes.
- step S601 determines that the conditions input in step S601 are all satisfactory for simulation. If there is a problem with the simulation conditions, operation of simulation system 50 proceeds to step S601 so that the conditions may be reset. On the other hand, if there is no problem with the simulation conditions, the simulation system 50 confirms the input conditions and proceeds to the operation of step S603.
- step S603 the simulation processing unit 29 simulates behavior information in the building 2 for each user. Operation of the simulation system 50 then proceeds to step S604.
- step S604 the simulation processing unit 29 simulates interest information for each of the users for whom behavior information has been simulated. Operation of the simulation system 50 then proceeds to step S605.
- step S605 the simulation processing unit 29 sends the simulation result to the visualization processing unit 27 based on the simulated behavior information and interest information. Operation of the simulation system 50 then proceeds to step S606.
- step S606 the visualization processing unit 27 uses the result of calculation using the existing conditions and the result of calculation by the simulation processing unit 29 under new conditions different from the conditions in FIG. generate two interest maps.
- the interest level map generation process includes, for example, superimposing a graph representing interest information and a bird's-eye view map.
- the visualization processing unit 27 sends two degree-of-interest maps of existing conditions and new conditions to the simulation processing unit 29 . Operation of the simulation system 50 then proceeds to step S607.
- step S607 the simulation processing unit 29 calculates the difference between the two degree-of-interest maps of the existing condition and the new condition, and sends it to the visualization processing unit 27 again. As a result, the degree-of-interest maps and differences of some or all of the existing conditions and new conditions are visualized. After that, the operation of the simulation system 50 ends.
- the simulation processing unit 29 is not limited to two interest level maps and their differences, and a plurality of interest level maps and its difference can also be calculated. Therefore, various new conditions can be examined and optimum conditions can be derived.
- the simulation processing unit 29 automatically calculates the tenant fee under the new conditions according to the market price, based on the degree-of-interest map as the simulation result of the new conditions.
- the tenant fee under the new conditions is the tenant fee of each tenant existing under the new conditions.
- the calculated tenant fee is used, for example, to examine the optimum conditions among various new conditions.
- the interest level measurement system 1 includes the attribute storage unit 13, the user identification unit 14, the floor determination unit 19, the behavior information acquisition unit 15, the interest information An acquisition unit 20 , an interest information storage unit 21 , and a visualization processing unit 27 are provided.
- the attribute storage unit 13 stores attributes for each area of each floor of the building 2 .
- the user identification unit 14 identifies a user in the building 2 based on images captured by at least one of the cameras 12 provided in the building 2 .
- the floor determination unit 19 detects at least the camera 12 inside the car 7 of the elevator 3 and the exit of the escalator 4.
- the arrival floor of the user is determined based on an image captured by any one of the cameras 12 including the camera 12 on the floor and the camera 12 on the floor after using the stairs 5.
- the behavior information acquisition unit 15 acquires behavior information representing the behavior of the specified user at the determined arrival floor based on the image captured by at least one of the cameras 12 .
- the interest information acquiring unit 20 obtains interest information indicating the degree of interest of the identified user for each attribute, based on the determined arrangement of areas on the arrival floor, the attributes of the areas, and the relationship between the behavior information. Get information.
- the interest information storage unit 21 stores the interest information acquired by the interest information acquisition unit 20 for each user, including time and place information.
- the visualization processing unit 27 uses the information stored in the interest information storage unit 21 to generate an interest level map that visualizes the distribution of interest levels of users of the building 2 on at least one floor.
- the identification of the user, the determination of the arrival floor, and the acquisition of the action information are performed based on the image captured by the camera 12 provided in the building 2, so that the user who does not operate the equipment of the elevator equipment , the behavior information on the arrival floor is also acquired. Also, interest information is acquired based on the user's behavior information. For this reason, interest information is acquired as information on the user's interest even for a user of the building 2 who does not possess a pre-registered mobile device. Interest information is also obtained for users who do not operate the devices of the lifting equipment.
- the interest level measurement system 1 integrates these as elevator equipment and manages the boarding/alighting history, so that the user's interest information can be more reliably obtained. is obtained.
- interest information can be obtained over a plurality of floors in the building 2 .
- the interest information acquired in this way is visualized by the degree of interest map generated by the visualization processing unit 27, so that the owner of the building 2, etc., can expect an increase in the value of the building 2 or an unfavorable event to occur in the building 2. It is possible to obtain judgment materials for risk avoidance.
- the visualization processing unit 27 may generate an interest level map for each user of the building 2 .
- the visualization processing unit 27 may integrate interest information for each user of the building 2 to generate an interest level map.
- the visualization processing unit 27 may generate an interest degree map including behavior information for each user of the building 2 .
- the interest level map is generated with the necessary detail according to the purpose, such as the owner of building 2. Therefore, the owner of the building 2 or the like can more efficiently obtain information for making decisions such as improving the value of the building 2 or avoiding risks in the building 2 .
- the interest level measurement system 1 also includes a destination presentation unit 22 .
- the destination presenting unit 22 gives priority to an area having an attribute with a higher degree of interest as a destination for the user.
- the presentation of the destination by the device destination presentation unit is performed based on the interest information about the user stored in the interest information storage unit 21 and the attribute information stored in the attribute storage unit 13 .
- the visualization processing unit 27 may generate the interest level map including the destination information actually presented by the destination presentation unit 22 .
- the destination information is displayed superimposed on information such as the trajectory of the user.
- the owner of the building 2 can grasp the influence of the destination presented by the destination presentation unit 22 on the user's interest. Therefore, the owner of the building 2 or the like can more efficiently obtain information for making decisions such as improving the value of the building 2 or avoiding risks in the building 2 .
- the interest level measurement system 1 includes an elevator facility determination unit 17 and a matching processing unit 18.
- the elevator facility determination unit 17 determines whether the user uses the elevator facility based on the image captured by at least one of the cameras 12. Elevating equipment to be used.
- the lifting equipment determination unit 17 may simultaneously determine two or more lifting equipments as the equipment used by the user identified by the user identification unit 14 as the same user.
- the matching processing unit 18 causes the user identification unit 14 to identify the users who use the two or more lifting facilities as different users.
- the user specifying unit 14 extracts the difference in the feature amount of the users from the acquired images when specifying different users, thereby improving the accuracy of specifying the users and identifying the different users. re-identify the
- the interest level measurement system 1 also includes a call registration unit 23 .
- the call registration unit 23 registers a call to the destination floor including the destination presented by the destination presentation unit 22 in the elevator 3, which is a lift facility.
- the interest information acquisition unit 20 acquires the user's interest information each time the behavior information acquisition unit 15 completes acquisition of the user's behavior information on the arrival floor.
- the interest information reflects the user's behavior on the arrival floor in real time. Therefore, the interest level measurement system 1 can provide guidance that quickly reflects the interest of the user.
- the interest level measurement system 1 includes a behavior information storage unit 16 .
- the behavior information storage unit 16 stores the behavior information acquired by the behavior information acquisition unit 15 for each user.
- the interest information acquisition unit 20 may read the behavior information for each user from the behavior information storage unit 16 at a preset timing.
- the interest information acquisition unit 20 acquires interest information of the user based on the read behavior information.
- the preset timing is, for example, a preset time during a time period when there are few users in the building 2, such as at night. Since processing such as acquisition of interest information is performed in a time period when there are few users, the processing load in the degree-of-interest measuring system 1 is distributed temporally.
- the behavior information to the interest information acquisition unit 20 or the interest information storage unit 21 is performed during a time period when the communication load on the network is light. Therefore, even when the communication capacity of the network is poor, the communication load of the network can be suppressed.
- the user identification unit 14 when the user has a portable information terminal or the like equipped with a wireless communication function, the user identification unit 14 supplementarily uses identification information obtained from the information terminal through wireless communication.
- the information terminal owned by the user may be, for example, a smart phone.
- electromagnetic waves from the outside are shielded inside the car 7 of the elevator 3 .
- the user identification unit 14 can improve the accuracy of user identification.
- the destination presentation unit 22 may present the destination by transmitting information to be displayed on the information terminal.
- the destination presenting unit 22 may transmit information without specifying the recipient, for example, by means of broadcast communication of a radio beacon provided at the hall of the elevator 3 or the like.
- the simulation system 50 includes the degree-of-interest measurement system 1 and the simulation processing section 29 .
- the simulation processing unit 29 receives the input of the existing conditions and the new conditions and determines that there is no problem in performing the simulation.
- the simulation processing unit 29 also simulates user behavior information and simulates interest information.
- the simulation processing unit 29 sends the result of the simulated behavior information and the interest information to the visualization processing unit 27, and generates two interest degree maps of existing conditions and new conditions. These interest degree maps are sent to the visualization processing unit 27 .
- the simulation processing unit 29 calculates the difference and sends the result to the visualization processing unit 27 . In this way, two degree-of-interest maps of existing conditions and new conditions and their differences can be visualized.
- FIG. 23 is a hardware configuration diagram of main parts of the interest degree measuring system 1 and the simulation system 50 according to the first embodiment.
- the processing circuitry comprises at least one processor 100a and at least one memory 100b.
- the processing circuitry may include at least one piece of dedicated hardware 200 in conjunction with, or as an alternative to, processor 100a and memory 100b.
- each function of the degree-of-interest measurement system 1 and the simulation system 50 is realized by software, firmware, or a combination of software and firmware. At least one of software and firmware is written as a program.
- the program is stored in memory 100b.
- the processor 100a realizes each function of the interest level measuring system 1 and the simulation system 50 by reading and executing the programs stored in the memory 100b.
- the processor 100a is also called a CPU (Central Processing Unit), a processing device, an arithmetic device, a microprocessor, a microcomputer, or a DSP.
- the memory 100b is composed of, for example, nonvolatile or volatile semiconductor memory such as RAM, ROM, flash memory, EPROM, and EEPROM.
- processor 100a and memory 100b may or may not be separated.
- processor 100a may include memory 100b.
- a device in which the processor 100a and the memory 100b are merged may also be used.
- processing circuitry comprises dedicated hardware 200
- the processing circuitry may be, for example, a single circuit, multiple circuits, programmed processors, parallel programmed processors, ASICs, FPGAs, or combinations thereof, or the like. It is implemented by a circuit that can
- Each function of the degree-of-interest measurement system 1 and the simulation system 50 can be implemented by a processing circuit.
- each function of the degree-of-interest measuring system 1 and the simulation system 50 can be collectively realized by a processing circuit.
- a part of each function of the degree-of-interest measuring system 1 and the simulation system 50 may be realized by dedicated hardware 200 and the other part may be realized by software or firmware.
- the processing circuit implements each function of the degree-of-interest measuring system 1 and the simulation system 50 with dedicated hardware 200, software, firmware, or a combination thereof.
- Embodiment 2 In the interest degree measuring system 1 of this example, guidance is provided according to the degree of interest included in the interest information.
- the destination information presented by the destination presentation unit 22 as guidance at this time may be included in the interest level map generated by the visualization processing unit 27 .
- FIGS. 24A to 24C, and FIGS. 25A and 25B are diagrams showing examples of presentation of destinations by the degree-of-interest measuring system 1 according to the second embodiment.
- FIG. 24 shows an example of a building 2 to which the degree-of-interest measurement system 1 is applied.
- FIG. 24A building 2 is shown on a certain day.
- a store P that handles goods P1 and a store S that provides service S1 are located in the area on the fourth floor.
- the Q store that handles the item Q1 and the T store that handles the item T1 are located in the area on the third floor.
- Store R, which provides service R1, and store U, which handles goods U1, are located in the area on the second floor.
- the interest information storage unit 21 stores the item P1 as the attribute with the highest degree of interest and the service S1 as the attribute with the second highest degree of interest for the user A.
- the interest information storage unit 21 stores store Q as an attribute of user B with the highest degree of interest and store T as an attribute with the second highest degree of interest.
- the interest information storage unit 21 stores service R1 as the attribute with the highest degree of interest for user C, and store U as the attribute with the second highest degree of interest.
- FIG. 24B The same building 2 at a later date is shown in FIG. 24B.
- store P which handles item P1
- R store has withdrawn.
- V store that provides the service R1 has opened in the area on the 4th floor.
- the destination presentation unit 22 reads interest information about the user A from the interest information storage unit 21 .
- the destination presenting unit 22 in this example preferentially presents an area with a higher interest attribute as a destination to the user. Therefore, the destination presentation unit 22 acquires the product P1 as the attribute of which the user A has the highest degree of interest, and the service S1 as the attribute of which the user A has the second highest degree of interest.
- the destination presentation unit 22 extracts areas having the item P1 as an attribute from the attribute storage unit 13 .
- the destination presenting unit 22 extracts the area on the second floor where the relocated store P is located as the destination with the highest priority. Further, the destination presenting unit 22 extracts areas having service S1 as an attribute from the attribute storage unit 13 . In this example, the destination presentation unit 22 extracts the fourth floor area where the S store is located as the destination with the next highest priority. The destination presentation unit 22 presents the extracted area to the user A as a destination.
- the destination presentation unit 22 reads interest information about each of the user B and the user C from the interest information storage unit 21 .
- the destination presenting unit 22 presents the area of the attribute with the highest degree of interest of each user as the destination. For this reason, the destination presentation unit 22 acquires the Q store as the attribute of which the user B has the highest degree of interest.
- the destination presentation unit 22 extracts the area of the Q store from the attribute storage unit 13 as an attribute.
- the destination presentation unit 22 extracts the area on the third floor where the Q store is located as a destination to be presented to the user B.
- the destination presenting unit 22 acquires service R1 as the attribute of user C's highest degree of interest.
- the destination presentation unit 22 extracts from the attribute storage unit 13 the area of the V store that provides the service R1 as an attribute.
- the destination presenting unit 22 extracts the 4th floor area where the V store is located as a destination to be presented to the user C.
- FIG. 25 an example of destination presentation through the car operating panel 10 is shown.
- the third and fourth floors are presented as destination floors to user B and user C who boarded car 7 .
- the destination presentation unit 22 flashes the light-emitting devices of the destination buttons 10b corresponding to the 3rd and 4th floors to inform the user B and the user C of the 3rd and 4th floors. Present a reminder of guidance before registering.
- the destination presentation unit 22 may also display an image such as "Store Q is on the 3rd floor, and Store V that provides service R1 is on the 4th floor" on the display device such as the display panel 10a.
- the destination presenting unit 22 may cause a built-in speaker of a display device such as the display panel 10a to present voice guidance together.
- the destination presenting unit 22 presses the destination buttons 10b corresponding to the third and fourth floors. end the presentation of the guidance for the destination floor by blinking the light-emitting device. Further, for example, immediately after the destination button 10b is operated and the call is registered, the destination presenting unit 22 ends the presentation of the destination floor guidance by blinking the light-emitting devices of the destination buttons 10b corresponding to the third and fourth floors. .
- the destination presentation unit 22 presents the destination floor by blinking the light-emitting device of the destination button 10b corresponding to the 4th floor. may continue.
- the call registration unit 23 sends a call to the elevator 3 on which the user C is boarding, with the destination floor being the fourth floor. Register automatically. Immediately after the call to the fourth floor is automatically registered, the light-emitting device of the destination button 10b corresponding to the fourth floor lights up.
- user B or user C cancels the destination button 10b of the automatically registered destination floor.
- the alighting floor for the user B and the user C is determined. As a result, for the user B and the user C, it becomes possible to acquire behavior information and interest information on the floor where they got off.
- the destination presenting unit 22 blinks a plurality of destination buttons 10b corresponding to destination floors such as the second floor and the fourth floor. may be presented. At this time, the destination presenting unit 22 may cause the destination button 10b to adjust blinking, color tone, or luminance of the light-emitting device, or the speed of change thereof, according to the priority of the destination.
- the call registration unit 23 presents the destination floor with the highest priority.
- a call with the second floor as the destination floor is automatically registered in the elevator 3 on which the user A is boarding. If the floor desired by the user A is not the automatically registered destination floor, the user A cancels the destination button 10b of the automatically registered destination floor to register another destination floor. good too.
- Embodiment 3 In the interest degree measuring system 1 of this example, acquisition of interest degree information and guidance to users are performed over a plurality of buildings 2 .
- FIG. 26 is a configuration diagram of the degree-of-interest measuring system 1 according to the third embodiment.
- an attribute storage unit 13 a user identification unit 14, an action information acquisition unit 15, an action information storage unit 16, an elevator equipment determination unit 17, a floor A floor determination unit 19 , an interest information acquisition unit 20 , a destination presentation unit 22 , and a call registration unit 23 are applied to each building 2 .
- These parts perform operations such as identification of users, acquisition of behavioral and interest information, presentation of destinations, and registration of calls in each building 2 .
- the interest level measurement system 1 includes a central management device 24 .
- the central management device 24 is a device that integrates and manages information such as interest information acquired in a plurality of buildings 2 .
- the central management device 24 is, for example, one or more server devices. Part or all of the central management device 24 may be installed in a virtual machine or the like on a cloud service.
- the central management device 24 includes a matching processing section 18 , an interest information storage section 21 and a visualization processing section 27 .
- the operation display unit 28 is an information processing terminal or the like that can communicate with the central management device 24 .
- the simulation processing unit 29 of the simulation system 50 is installed in the central management device 24.
- the simulation processing unit 29 may be one or more server devices that can communicate with the central management device 24, or the like.
- part or all of the simulation processing unit 29 may be a virtual machine or the like on a cloud service.
- the matching processing unit 18 is equipped with a function for matching the user identification by the user identification unit 14 applied to each building 2 .
- the matching process is performed, for example, as follows.
- the user identification unit 14 applied to each building 2 may erroneously identify different users as the same user.
- the user identifying units 14 applied to different buildings 2 may identify the same user at the same time. Since the same person cannot exist in two or more buildings 2 at the same time, the matching processing unit 18 requests the user identification unit 14 applied to each building 2 to correct the user identification. At this time, the user identification unit 14 applied to each building 2 identifies users that were erroneously identified as the same user as different users.
- the user specifying unit 14 extracts the difference in the feature amount of the users from the acquired images when specifying different users, thereby improving the accuracy of specifying the users and identifying the different users. re-identify the For each building 2, the matching processing unit 18 also performs a process of matching between identification of the user by the user identification unit 14 and determination of the elevator equipment used by the user by the elevator equipment determination unit 17. You can go together.
- the interest information storage unit 21 integrates the interest information acquired in each building 2 and stores it for each user.
- the interest information storage unit 21 associates and stores, for example, identification information unique to the user, interest information of the user, and information on the time and place at which the interest information was acquired.
- the visualization processing unit 27 has a function of generating an interest level map for each building 2 .
- the visualization processing unit 27 uses the information stored in the interest information storage unit 21 to generate an interest level map. For example, when the interest information storage unit 21 stores user interest information acquired in one of the buildings 2, the visualization processing unit 27 stores interest map may be generated. At this time, as the interest information of the user, for example, the degree of interest is acquired for each attribute.
- the visualization processing unit 27, for example, assigns the level of interest for each attribute of the user to each area of the floor for which the interest level map is generated, according to the attribute of the area of the floor. Note that the visualization processing unit 27 may generate an interest degree map for the building 2 that the user has used.
- the visualization processing unit 27 may generate an interest level map for one of the buildings 2 using the interest information acquired for the plurality of buildings 2 .
- the visualization processing unit 27 may generate an interest level map including information stored in the behavior information storage unit 16 of each building 2 .
- the visualization processing unit 27 may generate the interest degree map including the information of the destination actually presented to the user by the destination presentation unit 22 of each building 2 .
- the visualization processing unit 27 may generate an interest level map including classification information such as the user's sex, age, or both, or information other than these.
- the simulation processing unit 29 has a function of setting simulation conditions and simulating changes in interest information acquired by the interest information acquisition unit 20 in each building 2 .
- the simulation processing unit 29 performs simulation using the information stored in the interest information storage unit 21 .
- the interest information storage unit 21 stores user interest information acquired in one of the buildings 2, the simulation processing unit 29 stores may be simulated.
- the simulation processing unit 29 sets users in the building 2 to be simulated and users in other buildings 2, for example, based on the simulation conditions.
- the simulation processing unit 29 acquires from the interest information storage unit 21 information on the high interest in the attributes of the specific area for each user of the other building 2 to be simulated, and sets the entrance and start time.
- the simulation processing unit 29 simulates behavior information in the building 2 for each user.
- the simulation processing unit 29 simulates interest information for each of the users for whom the behavior information has been simulated.
- the simulation processing unit 29 generates a simulation result as an interest degree map for the building 2 based on the simulated behavior information and interest information.
- the simulation processing unit 29 may use interest information acquired in a plurality of buildings 2 to perform a simulation in any one of the buildings 2 or in a plurality of buildings 2 at the same time.
- FIG. 27 is a diagram showing an example of destination presentation by the degree-of-interest measuring system 1 according to the third embodiment.
- FIG. 27 shows an example of multiple buildings 2 to which the degree-of-interest measurement system 1 is applied.
- multiple buildings 2 are shown on a certain day.
- User A has used one building 2a multiple times until this date.
- User A uses the other building 2b for the first time on this day.
- the P store which is a supermarket
- a Q store which is a supermarket, is located on the second floor of the building 2b.
- the interest degree measurement system 1 has acquired the interest information of user A who used the building 2a.
- the building 2a from which user interest information and the like are acquired is an example of the first building.
- the first camera is the camera 12 placed in the first building.
- the first attribute storage section is the attribute storage section 13 applied to the first building.
- the first user identification unit is the user identification unit 14 applied to the first building.
- the interest information acquisition unit 20 of the building 2 a transmits the acquired interest information to the interest information storage unit 21 of the central management device 24 .
- the interest information storage unit 21 integrates the interest information received from the interest information acquisition unit 20 of the building 2a and stores it for each user.
- the interest information storage unit 21 may integrate and store the interest information received from the interest information acquisition unit 20 applied to the buildings 2 other than the building 2a and the building 2b.
- the interest information storage unit 21 stores the supermarket as an attribute with the highest degree of interest for the user A who used the building 2a.
- the destination presentation unit 22 of the building 2b reads interest information about the user A from the interest information storage unit 21.
- FIG. The destination presenting unit 22 in this example presents the area of the attribute with the highest degree of interest to the user as the destination. For this reason, the destination presentation unit 22 acquires the supermarket as the attribute of which the user A has the highest degree of interest.
- the destination presentation unit 22 extracts an area having a supermarket as an attribute from the attribute storage unit 13 of the building 2b. In this example, the destination presentation unit 22 extracts the area on the second floor of the building 2b where the Q store is located.
- the destination presentation unit 22 presents the extracted area to the user A as a destination.
- the call registration unit 23 of the building 2b registers a call to the destination floor to the elevator 3 when, for example, a user getting on the car 7 of the elevator 3 of the building 2b does not operate the car operating panel 10.
- the building 2b in which the destination is presented to the user is an example of the second building.
- a second camera is the camera 12 located in the second building.
- the second user identification unit is the user identification unit 14 applied to the second building.
- the second attribute storage section is the attribute storage section 13 applied to the second building. Note that the second building does not have to be the building that the user A uses for the first time. In the second building, user's interest information and the like may be acquired in the past.
- the interest level measurement system 1 includes the attribute storage unit 13 and the user identification unit 14 corresponding to each building 2, the floor determination unit 19, and the behavior information acquisition unit.
- a section 15 an interest information acquisition section 20 , an interest information storage section 21 , a destination presentation section 22 , and a visualization processing section 27 .
- Each attribute storage unit 13 stores an attribute for each area of each floor of the corresponding building 2 .
- Each user identification unit 14 identifies a user in the corresponding building 2 based on images captured by at least one of the cameras 12 provided in the corresponding building 2 .
- the floor determination unit 19 is an image captured by at least one of the cameras 12 when the user specified in one of the buildings 2 moves from the departure floor to the arrival floor using the lifting equipment of the building 2.
- the arrival floor of the user is determined based on.
- the behavior information acquisition unit 15 acquires behavior information representing the behavior of the user identified in one of the buildings 2 on the determined arrival floor based on the image captured by at least one of the cameras 12. get.
- the interest information storage unit 21 stores the interest information acquired by the interest information acquisition unit 20 for each user, including time and place information.
- the visualization processing unit 27 uses the attribute information stored in the attribute storage unit 13 corresponding to one of the buildings 2 and the information stored in the interest information storage unit 21 to generate an interest level map.
- the interest level map generated here visualizes the distribution of the interest levels of the users of the building 2 on at least one floor of the building 2 .
- the identification of the user, the determination of the arrival floor, and the acquisition of the action information are performed based on the images captured by the cameras 12 provided in each building 2, so the equipment of the elevator equipment is not operated. Behavior information on the arrival floor is also acquired for the user. Also, interest information is acquired based on the user's behavior information. For this reason, interest information is acquired as information on the user's interest even for a user of the building 2 who does not possess a pre-registered mobile device. Interest information is also acquired for users who do not operate the devices of the lifting equipment.
- the interest level measurement system 1 integrates these as elevator equipment and manages the boarding/alighting history, so that the user's interest information can be more reliably obtained. is obtained.
- the interest information acquired in this way is visualized by the degree of interest map generated by the visualization processing unit 27, so that the owner of the building 2, etc., can expect an increase in the value of the building 2 or an unfavorable event to occur in the building 2. It is possible to obtain judgment materials for risk avoidance.
- the interest level measurement system 1 can generate an interest level map even for buildings 2 that the user has never used.
- an attribute storage unit 13 is provided for each building 2 .
- the attribute storage unit 13 that stores information about each building 2 can be stored in a single attribute storage unit 13 or the number of buildings 2. It may be integrated into a smaller attribute storage unit 13 .
- a user identification unit 14 is provided for each building 2 .
- the user identification unit 14 that stores information about each building 2 may be a single user identification unit 14 or building 2 may be integrated into the user identification units 14 whose number is less than the number of .
- functional units such as the floor determination unit 19, the behavior information acquisition unit 15, the behavior information storage unit 16, the interest information acquisition unit 20, the interest information storage unit 21, and the visualization processing unit 27 are also partially Alternatively, the functional units for each building 2 may be integrated into a single functional unit or fewer functional units than the number of buildings 2, such as when all functional units are implemented on a server device or cloud service. .
- Embodiment 4 In the interest degree measuring system 1 of this example, cooperation with an external system 99 is performed.
- the owner of the first building to which the degree-of-interest measurement system 1 is applied is different from the owner of the third building to which the external system 99 is applied.
- FIG. 28 is a configuration diagram of the degree-of-interest measuring system 1 according to the fourth embodiment.
- the external system 99 is a system external to the degree-of-interest measurement system 1 .
- the external system 99 is applied to the building 2 to which the degree-of-interest measurement system 1 is not applied.
- a plurality of cameras 12 for photographing users are arranged in the building 2 to which the external system 99 is applied.
- the external system 99 has a storage unit 99a.
- the storage unit 99a daily records and updates images of each area of the building 2 to which the external system 99 is applied.
- the external system 99 transmits to the degree-of-interest measurement system 1 an image without people, for example, an updated image of each area of each floor acquired at midnight.
- the external system 99 continuously transmits images captured by the cameras 12 of the building 2 to which the external system 99 is applied to the degree-of-interest measurement system 1 from morning to night, for example.
- the image transmitted here does not need to be processed in particular.
- the external system 99 receives guidance information such as destination candidates without specifying the user from the interest level measurement system 1 that identifies the user by receiving the image transmission. Based on the information received from the degree-of-interest measurement system 1, the external system 99 performs guidance processing such as presenting a destination.
- the central management device 24 includes a receiving unit 25, a transmitting unit 26, a user specifying unit 14, a matching processing unit 18, an interest information storage unit 21, and a visualization processing unit 27.
- the receiving unit 25 and the transmitting unit 26 are parts that communicate with the external system 99 .
- Central management device 24 thereby provides an interface to external system 99 .
- the operation display unit 28 is an information processing terminal or the like that can communicate with the central management device 24 .
- the simulation processing unit 29 of the simulation system 50 is installed in the central management device 24.
- the simulation processing unit 29 may be one or more server devices that can communicate with the central management device 24, or the like.
- part or all of the simulation processing unit 29 may be a virtual machine or the like on a cloud service.
- FIG. 29 is a diagram showing an example of disclosing an interest level map or a simulation result of changes in the interest information by the interest level measuring system 1 according to the fourth embodiment.
- FIG. 29 shows an example of a building 2c to which the degree-of-interest measurement system 1 is applied and a building 2d to which the external system 99 is applied.
- a building 2d to which the external system 99 is applied is an example of a third building.
- Guidance information such as destination candidates is transmitted from the interest level measurement system 1 to the external system 99 to the building 2d.
- buildings 2c and 2d are shown on a certain day.
- the user A has used the building 2c several times until this date.
- the user A uses the building 2d for the first time on this day.
- a clothing store, P store is located on the fourth floor.
- the Q store which is a clothing store, is opened on the second floor.
- the interest level measurement system 1 has acquired user A's interest information using the building 2c.
- the building 2c from which the user's interest information is acquired is an example of the first building.
- the interest information storage unit 21 stores a clothing store as an attribute with the highest degree of interest for the user A who used the building 2c or the like.
- the external system 99 has previously transmitted images of each area of each floor of the building 2d to the interest degree measurement system 1.
- the degree-of-interest measurement system 1 that has received the image pre-generates a bird's-eye view map of the building 2d in the same manner as shown in FIG.
- the camera 12 is arranged, for example, at the landing of the elevator 3 .
- the external system 99 transmits the image of the user A to the central management device 24 .
- the receiving unit 25 of the central management device 24 receives the image of user A from the external system 99 .
- the user identification unit 14 of the central management device 24 identifies user A based on the image received from the external system 99 .
- the user identifying section 14 of the central management device 24 that identifies the user based on the image received from the external system 99 is an example of the third user identifying section. After identifying the user A, the user identification unit 14 of the central management device 24 determines the coordinates of the user A on the bird's-eye view map of the building 2d.
- the transmission unit 26 reads the interest information about the specified user A from the interest information storage unit 21, and selects the attribute with the highest interest level corresponding to each area of each floor on the bird's-eye view map of the building 2d as the interest information. , and transmits to the external system 99 destination candidates in the building 2d.
- the transmission unit 26 transmits to the external system 99 information indicating that the attribute of the highest degree of interest of the user A, who is the user identified by the image, is the clothing store.
- the external system 99 receives destination candidates for the building 2d from the central management device 24.
- the external system 99 receives that the attribute of the highest interest to the user A in the area of the building 2d and its attributes is the clothing store. Therefore, the external system 99 presents the Q shop, which is a clothing store, as a destination to the user A who uses the building 2d. Note that the building 2d to which the external system 99 is applied may not be the building that the user A uses for the first time.
- the interest information acquisition unit 20 determines the attributes of an area on the bird's-eye view map, such as a clothing store, based on the image received by the reception unit 25 from the external system 99. judge. At this time, the interest information acquisition unit 20 acquires the interest information of the user of the building 2d based on the determined correspondence between the area and the attribute.
- the visualization processing unit 27 generates an interest level map for one or more floors in the building 2d based on the correspondence between the areas and attributes determined in this way and the user's interest information.
- the simulation processing unit 29 simulates changes in the interest information of the building 2d based on the correspondence between the areas and the attributes thus determined and the user's interest information.
- Information such as interest level maps and simulation results will be disclosed in the form of information that cannot be processed, regardless of medium or communication method, based on a contract with the owner of the third building.
- the interest level measurement system 1 includes the attribute storage unit 13, the user identification unit 14 corresponding to the building 2 to which the interest level measurement system 1 is applied, the floor Floor determination unit 19, behavior information acquisition unit 15, interest information acquisition unit 20, interest information storage unit 21, user identification unit 14 of central management device 24, reception unit 25, transmission unit 26, visualization and a processing unit 27 .
- the attribute storage unit 13 stores the attribute of each area for each floor of the corresponding building 2 .
- the user identification unit 14 identifies a user in the corresponding building 2 based on images captured by at least one of the cameras 12 provided in the corresponding building 2 .
- the floor determination unit 19 determines whether the user is on the basis of the image captured by at least one of the cameras 12. Determine arrival floor.
- the behavior information acquisition unit 15 acquires behavior information representing the behavior of the specified user at the determined arrival floor based on the image captured by at least one of the cameras 12 .
- the interest information acquiring unit 20 obtains interest information indicating the degree of interest of the identified user for each attribute, based on the determined arrangement of areas on the arrival floor, the attributes of the areas, and the relationship between the behavior information. Get information.
- the interest information storage unit 21 stores the interest information acquired by the interest information acquisition unit 20 for each user, including time and place information.
- the receiving unit 25 receives from the external system 99 an image necessary for generating a bird's-eye view map of each area of each floor in the building 2d to which the external system 99 is applied, and an image of the user who starts using the elevator equipment. Receive sequentially.
- the user identifying section 14 of the central management device 24 identifies the user based on the image received by the receiving section 25 .
- the visualization processing unit 27 makes a determination based on the information stored as interest information in the interest information storage unit 21 for the user specified by the user specifying unit 14 of the central management device 24 and the image received by the receiving unit 25.
- the interest level map of the building 2d is generated using attribute information for each area of at least one of the floors of the building 2d.
- the degree-of-interest map generated here visualizes the distribution of the degrees of interest of the users of the building 2d on the floors for which attribute information has been determined among the plurality of floors of the building 2d.
- the transmission unit 26 transmits guidance information such as destination candidates to the external system 99 for the user identified by the user identification unit 14 of the central management device 24 .
- the effect of guidance can be confirmed from the images that are sequentially sent to the receiving unit 25 .
- the degree-of-interest map of the building 2d or the simulation results of changes can be disclosed by contract with the owner of the third building. For example, by disclosing a degree-of-interest map that simultaneously measures mutual movement with adjacent buildings, it becomes possible to consider more efficient flow of people.
- the first building and the third building may or may not be adjacent.
- the identification of the user, the determination of the arrival floor, and the acquisition of the action information are performed based on the image captured by the camera 12 provided in the building 2, so that the user who does not operate the equipment of the elevator equipment , the behavior information on the arrival floor is also acquired.
- interest information is acquired based on the user's behavior information. Therefore, interest information is obtained even for users who do not operate devices of the lifting equipment. For this reason, interest information is acquired as information on the user's interest even for a user of the building 2 who does not possess a pre-registered mobile device.
- the interest level measurement system 1 does not request the external system 99 for other identification information of the user's image. For this reason, the interest level measurement system 1 does not provide the external system 99 with personal information such as a name that identifies the user, but guides each user to the area of the building 2d that has the attribute of the highest interest. It can be carried out.
- the attribute storage unit 13 is provided for each building 2 .
- the attribute storage unit 13 is implemented on a server device or a cloud service
- the attribute storage unit 13 that stores information about each building 2 can be stored in a single attribute storage unit 13 or the number of buildings 2. It may be integrated into a smaller attribute storage unit 13 .
- the user identification unit 14 is provided for each building 2 .
- the user identification unit 14 when the user identification unit 14 is implemented on a server device or a cloud service, the user identification unit 14 that stores information about each building 2 may be a single user identification unit 14 or building 2 may be integrated into the user identification units 14 whose number is less than the number of .
- functional units such as the floor determination unit 19, the behavior information acquisition unit 15, the behavior information storage unit 16, the interest information acquisition unit 20, the interest information storage unit 21, and the visualization processing unit 27 are also partially Alternatively, the functional units for each building 2 may be integrated into a single functional unit or fewer functional units than the number of buildings 2, such as when all functional units are implemented on a server device or cloud service. .
- the interest level measurement system and simulation system according to the present disclosure can be applied to buildings with multiple floors.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Software Systems (AREA)
- Psychiatry (AREA)
- Databases & Information Systems (AREA)
- Evolutionary Computation (AREA)
- Medical Informatics (AREA)
- Artificial Intelligence (AREA)
- Human Computer Interaction (AREA)
- Computing Systems (AREA)
- Social Psychology (AREA)
- Economics (AREA)
- Finance (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Development Economics (AREA)
- Accounting & Taxation (AREA)
- General Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Quality & Reliability (AREA)
- Operations Research (AREA)
- Data Mining & Analysis (AREA)
- Game Theory and Decision Science (AREA)
- Indicating And Signalling Devices For Elevators (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/JP2021/040434 WO2023079600A1 (ja) | 2021-11-02 | 2021-11-02 | 興味関心度計測システムおよびシミュレーションシステム |
| US18/692,336 US20240378923A1 (en) | 2021-11-02 | 2021-11-02 | Interest degree measurement system and simulation system |
| JP2023557868A JP7593504B2 (ja) | 2021-11-02 | 2021-11-02 | 興味関心度計測システムおよびシミュレーションシステム |
| CN202180103735.5A CN118202375A (zh) | 2021-11-02 | 2021-11-02 | 兴趣关注度计测系统和模拟系统 |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/JP2021/040434 WO2023079600A1 (ja) | 2021-11-02 | 2021-11-02 | 興味関心度計測システムおよびシミュレーションシステム |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023079600A1 true WO2023079600A1 (ja) | 2023-05-11 |
Family
ID=86240771
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2021/040434 Ceased WO2023079600A1 (ja) | 2021-11-02 | 2021-11-02 | 興味関心度計測システムおよびシミュレーションシステム |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20240378923A1 (https=) |
| JP (1) | JP7593504B2 (https=) |
| CN (1) | CN118202375A (https=) |
| WO (1) | WO2023079600A1 (https=) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7823142B1 (ja) * | 2024-10-15 | 2026-03-03 | 東芝エレベータ株式会社 | 情報処理装置、エレベータ制御システムおよびエレベータ制御方法 |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7315049B1 (ja) * | 2022-02-22 | 2023-07-26 | 富士通株式会社 | 情報処理プログラム、情報処理方法、および情報処理装置 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150187102A1 (en) * | 2014-01-02 | 2015-07-02 | Samsung Techwin Co., Ltd. | Heatmap providing apparatus and method |
| JP2017188023A (ja) * | 2016-04-08 | 2017-10-12 | パナソニックIpマネジメント株式会社 | 施設内活動分析装置、施設内活動分析システムおよび施設内活動分析方法 |
| US20190019207A1 (en) * | 2017-07-13 | 2019-01-17 | Samsung Sds Co., Ltd. | Apparatus and method for store analysis |
| JP2020077358A (ja) * | 2019-05-28 | 2020-05-21 | 株式会社スペース二十四インフォメーション | 移動ルート解析システム |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010098024A1 (ja) * | 2009-02-24 | 2010-09-02 | 三菱電機株式会社 | 人物追跡装置及び人物追跡プログラム |
| US9423268B2 (en) * | 2014-06-20 | 2016-08-23 | Apple Inc. | Graphical representation generation for multiple points of interest |
| CN111108500B (zh) * | 2017-08-08 | 2023-12-05 | 株式会社日立制作所 | 建筑物仿真器以及建筑物仿真方法 |
-
2021
- 2021-11-02 US US18/692,336 patent/US20240378923A1/en active Pending
- 2021-11-02 JP JP2023557868A patent/JP7593504B2/ja active Active
- 2021-11-02 WO PCT/JP2021/040434 patent/WO2023079600A1/ja not_active Ceased
- 2021-11-02 CN CN202180103735.5A patent/CN118202375A/zh active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150187102A1 (en) * | 2014-01-02 | 2015-07-02 | Samsung Techwin Co., Ltd. | Heatmap providing apparatus and method |
| JP2017188023A (ja) * | 2016-04-08 | 2017-10-12 | パナソニックIpマネジメント株式会社 | 施設内活動分析装置、施設内活動分析システムおよび施設内活動分析方法 |
| US20190019207A1 (en) * | 2017-07-13 | 2019-01-17 | Samsung Sds Co., Ltd. | Apparatus and method for store analysis |
| JP2020077358A (ja) * | 2019-05-28 | 2020-05-21 | 株式会社スペース二十四インフォメーション | 移動ルート解析システム |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7823142B1 (ja) * | 2024-10-15 | 2026-03-03 | 東芝エレベータ株式会社 | 情報処理装置、エレベータ制御システムおよびエレベータ制御方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| US20240378923A1 (en) | 2024-11-14 |
| JPWO2023079600A1 (https=) | 2023-05-11 |
| JP7593504B2 (ja) | 2024-12-03 |
| CN118202375A (zh) | 2024-06-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102816829B1 (ko) | 안내 시스템 | |
| KR102473630B1 (ko) | 로봇 친화형 건물 | |
| JP6678529B2 (ja) | エレベーターシステム及びかご呼び推定方法 | |
| EP3041775B1 (en) | Elevator dispatch using facial recognition | |
| WO2021016964A1 (zh) | 一种电梯广告投放的方法、装置及广告投放设备 | |
| CN106144862A (zh) | 用于乘客运输门控制的基于深度传感器的乘客感测 | |
| CN106144796A (zh) | 用于空乘客运输外壳确定的基于深度传感器的乘客感测 | |
| US12547185B2 (en) | Autonomous driving vehicle operation system | |
| CN101506077A (zh) | 用于在目的地登记调度操作中执行安全跟踪的匿名乘客标引系统 | |
| CN106144797A (zh) | 用于乘客运输的通行列表产生 | |
| JPH056500A (ja) | 移動体・施設制御システム | |
| CN103065196A (zh) | 利用建筑物信息模型及毗邻信息的最优高效的警卫巡视配置方法 | |
| JP7593504B2 (ja) | 興味関心度計測システムおよびシミュレーションシステム | |
| CN113261277A (zh) | 信息处理系统、信息处理装置、服务器装置、程序或者方法 | |
| CN111738134A (zh) | 获取客流数据的方法、装置、设备及介质 | |
| JP2019106631A (ja) | 画像監視装置 | |
| US20050228868A1 (en) | Data notification method and system thereof | |
| JP7294538B2 (ja) | 建物の交通管理システム | |
| US12043520B2 (en) | Passenger guiding system for elevator, elevator system and passenger guiding method | |
| JP2017197373A (ja) | エレベータの群管理システム、及びエレベータシステム | |
| CN114770559B (zh) | 一种机器人的取物控制系统及方法 | |
| CN108693863A (zh) | 电梯仿真器 | |
| CN118378773B (zh) | 一种基于区块链的智慧楼宇管理方法及装置 | |
| JP2020102135A (ja) | 追跡システム、追跡処理方法、及びプログラム | |
| WO2021191981A1 (ja) | エレベーターシステム |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21963198 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023557868 Country of ref document: JP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 12024550544 Country of ref document: PH |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 18692336 Country of ref document: US |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2401002029 Country of ref document: TH |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202447027819 Country of ref document: IN |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202180103735.5 Country of ref document: CN |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 11202402265S Country of ref document: SG |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 21963198 Country of ref document: EP Kind code of ref document: A1 |