CN108197971A

CN108197971A - Information collecting method, information processing method, apparatus and system

Info

Publication number: CN108197971A
Application number: CN201711296567.8A
Authority: CN
Inventors: 黄纯波; 蔡敏生; 江培和; 郑晓嵩; 范金泉; 曾春
Original assignee: Beijing Tian Zheng Polymerization Technology Co Ltd
Current assignee: Beijing Tian Zheng Polymerization Technology Co Ltd; Guangdong Tianzheng Computer Service Co Ltd
Priority date: 2017-12-08
Filing date: 2017-12-08
Publication date: 2018-06-22

Abstract

The embodiment of the present disclosure discloses a kind of information collecting method, information processing method, apparatus and system.Described information acquisition method includes：Determine the residence time in pre-position target user；The article of predetermined kind is placed in the pre-position；When the residence time being more than predetermined threshold, the facial image of the target user is obtained；The precalculated position and the facial image are sent to server.The embodiment of the present disclosure target user the specific position residence time be more than threshold value when will automatic trigger take pictures, obtain the facial image of target user, the location information of target user, facial image are uploaded background system and handled again later, background system carries out recognition of face according to the collected facial image of institute, location information, extract the relevant attribute of target user and feature, then it determines article interested to target user further according to location information, and establishes the related information of user information and Item Information.

Description

Information acquisition method, information processing method, device and system

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to an information acquisition method, an information processing device, and an information processing system.

Background

With the rapid development of internet technology and online advertising markets, online retail of electronic commerce pays attention to data collection of behaviors and hobby habits of target users, and the data fineness degree of the online retail is far better than that of an offline retail scene, so that online marketing is more accurate and more efficient. Although offline retail has better experience, the behavior and hobbies of the target user are not effectively collected, some transaction records can be tracked by an offline member mechanism, a certain effect can be achieved, but the stay time of the target user in places such as a market and a counter and the commodities which are tried are difficult to track, so that the commodities and promotion information which the target user is interested in cannot be well pushed.

Disclosure of Invention

The embodiment of the disclosure provides an information acquisition method, an information acquisition device and an information acquisition system, an information processing method, an information processing device and an information processing system, a control device, a server and a computer-readable storage medium.

In a first aspect, an embodiment of the present disclosure provides an information acquisition method, including:

determining a dwell time of the target user at the predetermined location; placing a predetermined kind of article at the predetermined location;

when the staying time exceeds a preset threshold value, acquiring a face image of the target user;

and sending the preset position and the face image to a server.

Optionally, determining the dwell time of the target user at the predetermined location comprises:

receiving a first detection signal that a target user is detected at the predetermined position;

starting a timer in response to the first detection signal;

when the stay time exceeds a preset threshold value, acquiring a face image of the target user, wherein the acquisition comprises the following steps:

and when the timing time exceeds the preset threshold value, acquiring the face image of the target user.

Optionally, acquiring a face image of the target user includes:

sending an image acquisition control signal to at least one image acquisition unit which is arranged corresponding to the preset position;

and acquiring the face image acquired by the at least one image acquisition unit.

In a second aspect, an embodiment of the present disclosure provides an information processing method, including:

acquiring a face image of a target user and a staying position of the target user; the face image is acquired when the target user stays at the stay position, and a preset kind of articles are placed at the stay position;

acquiring user information of the target user according to the face image;

determining article information of the article according to the stop position;

and storing the user information and the article information in a correlation mode.

Optionally, the obtaining a face image of a target user and a staying position of the target user includes:

and when the staying time exceeds a preset threshold value, acquiring the face image of the target user, and setting the preset position as the staying position.

starting a timer in response to the first detection signal;

Optionally, acquiring a face image of the target user includes:

Optionally, acquiring the user information according to the face image includes:

matching the facial features in the facial image with a first database, wherein the first database stores the corresponding relation between user information and the facial features in advance;

and after the matching is successful, acquiring the user information according to the matching result.

Optionally, the obtaining the user information according to the face image further includes:

and when the matching fails, establishing a corresponding relation between the face characteristics of the target user and the user information, and storing the corresponding relation to the first database.

Optionally, the user information includes identity information and behavior data of the target user.

Optionally, determining the item information of the item according to the stop position includes:

matching the stopping position with a second database, wherein the second database stores the corresponding relation between the position information and the article information in advance;

determining the item information corresponding to the stop position as the item information of the item.

In a third aspect, an embodiment of the present disclosure provides an information collecting apparatus, including:

a first determination module configured to determine a dwell time of a target user at a predetermined location; placing a predetermined kind of article at the predetermined location;

a first acquisition module configured to acquire a face image of the target user when the dwell time exceeds a predetermined threshold;

a sending module configured to send the predetermined position and the face image to a server.

Optionally, the first determining module includes:

a first receiving sub-module configured to receive a first detection signal that a target user is detected at the predetermined position;

a first response submodule configured to start a timer in response to a first detection signal;

the first obtaining module includes:

and the first acquisition sub-module is configured to acquire the facial image of the target user when the timing time exceeds the preset threshold value.

Optionally, the first obtaining module includes:

a first transmitting sub-module configured to transmit an image capture control signal to at least one image capture unit provided corresponding to the predetermined position;

and the second acquisition sub-module is configured to acquire the face image acquired by the at least one image acquisition unit.

In a fourth aspect, an embodiment of the present disclosure provides an information processing apparatus, including:

the second acquisition module is configured to acquire a face image of a target user and a stop position of the target user; the face image is acquired when the target user stays at the stay position, and a preset kind of articles are placed at the stay position;

a third obtaining module configured to obtain user information of the target user according to the face image;

a second determination module configured to determine item information for the item from the stop location;

a storage module configured to store the user information in association with the item information.

Optionally, the second obtaining module includes:

a first determination submodule configured to determine a dwell time of a target user at a predetermined location; placing a predetermined kind of article at the predetermined location;

and the third acquisition sub-module is configured to acquire the facial image of the target user when the staying time exceeds a preset threshold value, and set the preset position as the staying position.

Optionally, the first determining sub-module includes:

a second receiving sub-module configured to receive a first detection signal that a target user is detected at the predetermined position;

a second response submodule configured to start a timer in response to the first detection signal;

a fourth obtaining sub-module configured to obtain the facial image of the target user when the staying time exceeds a predetermined threshold, including:

and the fifth acquisition sub-module is configured to acquire the face image of the target user when the timing time exceeds the preset threshold value.

Optionally, the third obtaining sub-module includes:

a second transmitting sub-module configured to transmit an image capture control signal to at least one image capture unit provided in correspondence with the predetermined position;

and the sixth acquisition sub-module is configured to acquire the face image acquired by the at least one image acquisition unit.

Optionally, the third obtaining module includes:

the first matching submodule is configured to match the facial features in the facial image with a first database, and the first database stores the corresponding relation between user information and the facial features in advance;

and the seventh obtaining submodule is configured to obtain the user information according to a matching result after the matching is successful.

Optionally, the third obtaining module further includes:

and the establishing sub-module is configured to establish a corresponding relation between the facial features of the target user and the user information when the matching fails, and store the corresponding relation to the first database.

Optionally, the second determining module includes:

the second matching submodule is configured to match the stopping position with a second database, and the second database stores the corresponding relation between the position information and the article information in advance;

a second determination sub-module configured to determine item information corresponding to the stop position as item information of the item.

The functions can be realized by hardware, and the functions can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the above-described functions.

In a fifth aspect, an embodiment of the present disclosure provides an information acquisition system, including: the system comprises at least one detector, at least one image acquisition unit and a controller; wherein,

the at least one detector is arranged at a predetermined position and used for sending a first detection signal when the target user stays at the predetermined position; a goods shelf is arranged at the preset position, and one or more articles are placed on the goods shelf;

the at least one image acquisition unit is arranged in front of the shelf and used for acquiring images at the preset positions;

the controller is used for receiving a first detection signal of the infrared sensor and sending an image acquisition control signal to the at least one image acquisition unit when the time that the target user stays at the preset position is determined to exceed a preset threshold value; and sending the face image of the target user received from the at least one image acquisition unit and the predetermined position to a server.

Optionally, the detector is an infrared sensor; and each preset position is provided with one infrared sensor and a plurality of image acquisition units, and the plurality of image acquisition units are used for acquiring the face images of the target users positioned at the preset positions from different angles.

Optionally, the controller includes an image acquisition unit controller and a Gateway, and the image acquisition unit controller is configured to send an image acquisition control signal to the image acquisition unit; the Gateway is used for controlling the detector and the image acquisition unit controller and communicating with the server.

Optionally, the controller is configured to implement the method steps of the first aspect.

Optionally, the information collecting system further includes:

and the server is used for receiving the face image of the target user and the preset position and processing the face image and the preset position.

In a sixth aspect, an embodiment of the present disclosure provides a control device, including a memory and a processor; wherein,

the memory is configured to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to perform the method steps of the first aspect.

In a seventh aspect, an embodiment of the present disclosure provides a server, including a memory and a processor; wherein,

the memory is configured to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the method steps of the second aspect.

In an eighth aspect, an embodiment of the present disclosure provides an information processing system, including: an information acquisition system according to a fifth aspect and a server according to a seventh aspect.

In a ninth aspect, the present disclosure provides a computer-readable storage medium, on which computer instructions are stored, and the computer instructions, when executed by a processor, implement the method steps of the first aspect.

In a tenth aspect, the present disclosure provides a computer-readable storage medium, on which computer instructions are stored, and the computer instructions, when executed by a processor, implement the method steps of the second aspect.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:

the information acquisition and information processing scheme provided by the embodiment of the disclosure is used for acquiring target user information and object information interested by a target user in an intelligent scene and processing the target user information and the object information to associate the target user with the object information. When collecting target user information and interested article information, in order to more clearly understand the behavior of the target user, the interest of the target user in a certain article is generally required to be more detailed understood; people flow in which areas in the intelligent scene is more considerable; which time periods the target user is more interested in which items. In order to establish the information association, the embodiment of the disclosure is implemented by associating data of various sensors, when the staying time of a target user at a specific position (such as a certain article shelf) exceeds a threshold, photographing is automatically triggered to obtain a face image of the target user, then the position information and the face image of the target user are uploaded to a background system for processing, the background system performs face recognition according to the collected face image and position information, extracts the relevant attributes and features of the target user, then determines an article which the target user is interested in according to the position information, and establishes the association information of user information and article information in a customer relationship management CRM system.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

Other features, objects, and advantages of the present disclosure will become more apparent from the following detailed description of non-limiting embodiments when taken in conjunction with the accompanying drawings. In the drawings:

FIG. 1 shows a flow diagram of an information collection method according to an embodiment of the present disclosure;

FIG. 2 shows a flow chart of step S102 according to the embodiment shown in FIG. 1;

FIG. 3 shows a flow diagram of an information processing method according to an embodiment of the present disclosure;

FIG. 4 shows a flowchart of step S302 according to the embodiment shown in FIG. 3;

FIG. 5 shows a further flowchart of step S302 according to the embodiment shown in FIG. 3;

fig. 6 shows a block diagram of an information acquisition apparatus according to an embodiment of the present disclosure;

fig. 7 shows a block diagram of the structure of an information processing apparatus according to an embodiment of the present disclosure;

FIG. 8 shows a block diagram of an information handling system according to an embodiment of the present disclosure;

FIG. 9 shows a physical diagram of an infrared sensor of an information handling system in accordance with an example of the present disclosure;

FIG. 10 shows a physical diagram of an intelligent camera of an information handling system in accordance with an example of the present disclosure;

FIG. 11 shows an entity diagram of a Gateway of an information handling system in an example of the present disclosure;

fig. 12 is a schematic structural diagram of a control device suitable for implementing an information acquisition method according to an embodiment of the present disclosure.

Detailed Description

Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement them. Also, for the sake of clarity, parts not relevant to the description of the exemplary embodiments are omitted in the drawings.

In the present disclosure, it is to be understood that terms such as "including" or "having," etc., are intended to indicate the presence of the disclosed features, numbers, steps, behaviors, components, parts, or combinations thereof, and are not intended to preclude the possibility that one or more other features, numbers, steps, behaviors, components, parts, or combinations thereof may be present or added.

It should be further noted that the embodiments and features of the embodiments in the present disclosure may be combined with each other without conflict. The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.

At present, a technology of market traffic tracking appears in an offline scene, which can track the passenger flow of a market, and even can track the behavior of a specific target user in the market based on a face recognition technology, and a camera based on a specific position can track and analyze the behavior of the target user in a certain area. However, it is difficult for these techniques to correlate user information with specific merchandise information to analyze interests and preferences of target users.

In addition, there is also a technology that determines which commodities are more concerned by the target user through a sensor, for example, an infrared sensor is preset at a counter or a shelf, etc. to detect how many target users are concerned or try commodities. These techniques can track the target user traffic for a good, but it is also difficult to correlate user information with specific good information.

In order to solve the problem of information association, the present disclosure provides an information collecting and processing scheme, which is used for collecting and processing target user information and object information that a target user is interested in an intelligent scene, so as to associate the target user with the object information. When collecting target user information and interested article information, in order to more clearly understand the behavior of the target user, the interest of the target user in a certain article is generally required to be more detailed understood; people flow in which areas in the intelligent scene is more considerable; which time periods the target user is more interested in which items. In order to establish the information association, the embodiment of the disclosure is implemented by associating data of various sensors, when the staying time of a target user at a specific position (such as a certain article shelf) exceeds a threshold, photographing is automatically triggered to obtain a face image of the target user, then the position information and the face image of the target user are uploaded to a background system for processing, the background system performs face recognition according to the collected face image and position information, extracts the relevant attributes and features of the target user, then determines an article which the target user is interested in according to the position information, and establishes the association information of user information and article information in a customer relationship management CRM system. It can be understood that the technical scheme disclosed by the embodiment of the disclosure can be used in any intelligent scene in which an article interested by a user needs to be collected and associated information between user information and article information is established, and is not limited to the scene of off-line retail goods.

Fig. 1 shows a flow chart of an information collection method according to an embodiment of the present disclosure. As shown in fig. 1, the information collecting method includes the following steps S101 to S103:

in step S101, the stay time of the target user at the predetermined position is determined;

in step S102, when the staying time exceeds a predetermined threshold, acquiring a face image of the target user;

in step S103, the predetermined position and the face image are sent to a server.

In this embodiment, the target user may be a group of people, that is, the group of users for which the information collection of this embodiment is directed, such as customers in a mall, a supermarket or a shop. The embodiment of the disclosure can distinguish the customer from the salesperson when collecting information, and particularly can distinguish the customer from the salesperson by human face recognition or any sensing equipment which is carried by the salesperson and can indicate the sales identity. The predetermined location may be a predetermined location, such as a counter, shelf, etc. in a mall, supermarket, or store. The stay state of the target user can be determined by arranging a human body sensing device such as an infrared sensor at a preset position, and then an image acquisition unit can be arranged at the preset position and used for acquiring a face image of the target user.

For example, in a mall, supermarket or shop, when a customer stays at a specific location (such as a certain merchandise counter) for more than a threshold time, a photo is automatically triggered, and the triggered action can be detected by an infrared sensor. When the infrared sensor senses a person, a detection signal is sent to the control device, the control device requests the information acquisition unit to take a picture when determining that the staying time of the person exceeds a time threshold value, if clear data can be obtained, the picture is continuously taken for 3 times and the like, and then the data of the information acquisition unit and the infrared sensor and 3 taken pictures are uploaded to a background system to be processed. The data of the infrared sensors can be the device identifications of the infrared sensors, the device identifications of each infrared sensor and the positions of the infrared sensors can be stored correspondingly in advance, and the background system can determine the positions of customers according to the identifications of the infrared sensors.

In this embodiment, in order to determine the items of interest to the user, the items may be placed at different predetermined positions according to categories, so that each predetermined position corresponds to one category of the items. When the target user stays at a certain predetermined position, the type of the object in which the user is interested can be determined according to the predetermined position information. For example, in a shopping mall, a supermarket or a shop, an infrared sensor is placed on a shelf, an infrared sensor is arranged at a position corresponding to each type or each kind of articles, and the position information of the infrared sensor corresponds to the stop position of the user, so as to correspond to the commodity which the user is interested in.

In an optional implementation manner of this embodiment, the step S101, that is, the step of determining the staying time of the target user at the predetermined position, further includes the following steps:

starting a timer in response to the first detection signal;

In this alternative implementation manner, when it is detected that a target user stays at a predetermined position, timing is started, and when the timing time exceeds a predetermined threshold, a face image of the target user is acquired. For example, a target user is detected through an infrared sensor, when the target user is detected to be in front of the infrared sensor, a first detection signal is sent out, then if the target user leaves, a second detection signal can be sent out, after the first detection signal is received, before the second detection signal is received, if the time exceeds a preset threshold, the stay time of the target user is considered to exceed the preset threshold, at this time, the user can be considered to be interested in an article corresponding to the current standing position, and therefore the face image of the target user is collected. If the timing time does not exceed the preset threshold value after the first detection signal is received, the target user leaves the preset position, the user can be considered to have insufficient interest degree in the article at the preset position, and the target user information and the article information at the moment do not need to be collected.

In an optional implementation manner of this embodiment, as shown in fig. 2, in the step S102, the step of acquiring the face image of the target user further includes the following steps:

in step S201, sending an image capture control signal to at least one image capture unit disposed corresponding to the predetermined position;

in step S202, a face image acquired by the at least one image acquisition unit is acquired.

In this optional implementation manner, after it is determined that the staying time of the target user exceeds the predetermined threshold, the at least one image acquisition unit is controlled to acquire the facial image of the target user staying at the predetermined position by sending a control signal to the at least one image acquisition unit arranged at the predetermined position. The face image is an image including a face portion of the target user, and may be an image including only a face portion, or an image including a face portion and other portions. The image acquisition unit can be an intelligent camera capable of automatically identifying the face position and directly acquiring the face position image, and can also directly acquire the image of a target user at a preset position.

For example, an intelligent camera is arranged in a mall, a supermarket or a shop, is mainly used for shooting a face photo of a customer, can be deployed at a higher position of a counter or a shelf and faces the stream of people in front of the counter, and can be deployed at different angles according to the arrangement of the counter.

Fig. 3 illustrates a flow chart of an information processing method according to an embodiment of the present disclosure. As shown in fig. 3, the information processing method includes the following steps S301 to S304:

in step S301, a face image of a target user and a staying position of the target user are obtained; the face image is acquired when the target user stays at the stay position, and a preset kind of articles are placed at the stay position;

in step S302, user information of the target user is acquired according to the face image;

in step S303, determining item information of the item according to the stop position;

in step S304, the user information and the item information are stored in association with each other.

In this embodiment, the information processing method may be executed on a background server, where the background server obtains a face image of a target user and a stop position of the target user through a control device set in an intelligent scene, and identifies the face image to obtain user information of the target user, determines an object interested by the target user according to the stop position, that is, information of the object interested by the target user, and then establishes an association relationship between the user information of the target user and the object information, so as to perform subsequent statistical analysis on the information of the object interested by the target user, obtain the interest of the target user, provide a service more meeting the needs of the target user for the target user, and improve user experience.

Of course, in other embodiments, the information processing method may also be run on the control device set in the intelligent scene together with the information acquisition method, and may be specifically set according to an actual situation, which is not limited herein.

In an optional implementation manner of the embodiment of the present disclosure, the obtaining, in step S301, a face image of a target user and a stop position of the target user includes:

the method for acquiring the face image of the target user and the stop position of the target user comprises the following steps:

In this optional implementation, the information processing method may run on a background server, or may run on a field control device in an intelligent scene. The on-site control equipment acquires the face image and the stop position of the target user by controlling the human body induction equipment and the image acquisition unit which are arranged in the intelligent scene, and further processes the face image and the stop position by the on-site control equipment to establish the incidence relation between the user information and the article information of the target user. In other embodiments, the background server may also control the human body sensing device and the image acquisition unit, acquire the face image and the stop position of the target user, and establish the association relationship between the user information and the article information. In other embodiments, the human body sensing device and the image acquisition unit can be controlled by the field control device in an intelligent scene to acquire the human face image and the stop position of the target user, and the background server processes the human face image and the stop position to establish the association relationship between the user information and the article information. Which mode is specifically adopted can be set according to actual conditions, and is not limited herein.

In the optional implementation manner, the manner of acquiring the face image and the staying position of the target user is similar to that of the information acquisition method in the embodiment shown in fig. 1, and specific details may refer to the description of the information acquisition method above, which is not described herein again.

In an optional implementation manner of the embodiment of the present disclosure, the determining the staying time of the target user at the predetermined position in the above step includes:

starting a timer in response to the first detection signal;

For specific details of the optional implementation, reference may be made to the above description of the information acquisition method, and details are not described herein again.

In an optional implementation manner of the embodiment of the present disclosure, the acquiring a face image of the target user in the above steps includes:

For details of the optional implementation, reference may also be made to the above description of the information acquisition method, which is not described herein again.

In an optional implementation manner of the embodiment of the present disclosure, as shown in fig. 4, the step S302, namely the step of obtaining the user information according to the face image, further includes the following steps:

in step S401, matching the facial features in the facial image with a first database, where the first database stores a correspondence between user information and facial features in advance;

in step S402, after the matching is successful, the user information is obtained according to the matching result.

In this optional implementation, the corresponding relationship between the user information and the face features is stored in the database in advance, and after the face image of the target user is acquired, the user information of the target user may be determined based on the corresponding relationship stored in the database in advance. Optionally, the user information of the target user includes identity information, behavior data, and the like of the target user. For example, for a shopping mall, a supermarket or a store, the identity information of the user can be obtained when the user purchases goods or establishes a membership card, and the behavior data can be the behaviors of the user such as fitting, trying, purchasing and the like in the shopping mall, the supermarket or the store.

In an optional implementation manner of the embodiment of the present disclosure, the step S302, namely the step of obtaining the user information according to the face image, further includes the following steps:

In this optional implementation manner, if the target user appears for the first time or information of the target user is acquired for the first time, data corresponding to the face features of the target user may not be stored in the database, at this time, the face features of the target user may be stored, and the behavior data of the target user in the intelligent scene at this time and the like may be stored as user information in association with the face features. For example, the information of the object in which the target user is interested at this time is stored in association with the facial features, and the like.

In an optional implementation manner of the embodiment of the present disclosure, as shown in fig. 5, the step S302 of determining the item information of the item according to the stop position further includes the following steps:

in step S501, the stop position is matched with a second database, where a corresponding relationship between position information and article information is stored in advance in the second database;

in step S502, the item information corresponding to the stay position is determined as the item information of the item.

In this optional implementation manner, the item information in which the target user is interested is determined according to a pre-established correspondence between the item information and the predetermined position and the position information where the target user currently stays.

As described in the above information processing method, in the intelligent scene, the articles may be placed according to types, and human body sensing devices such as sensors may be disposed at different types of articles. When the target user is determined to be interested in a certain type of articles (for example, the stay time exceeds a preset threshold), the face image and the stay position of the target user are obtained, the user information of the target user can be obtained according to the face image, and the articles which are interested by the user can be obtained according to the stay position. The incidence relation between the user information of the target user and the article information of the interested article is established in the mode, so that the subsequent analysis and research on the target user are facilitated, and a better basis is laid for providing better service for the target user.

The following are embodiments of the disclosed apparatus that may be used to perform embodiments of the disclosed methods.

Fig. 6 shows a block diagram of an information acquisition apparatus according to an embodiment of the present disclosure, which may be implemented as part or all of an electronic device by software, hardware, or a combination of the two. As shown in fig. 6, the information collecting apparatus includes a first determining module 601, a first obtaining module 602, and a sending module 603:

a first determination module 601 configured to determine a dwell time of a target user at a predetermined location; placing a predetermined kind of article at the predetermined location;

a first obtaining module 602, configured to obtain a facial image of the target user when the dwell time exceeds a predetermined threshold;

a sending module 603 configured to send the predetermined position and the face image to a server.

In an optional implementation manner of this embodiment, the first determining module 601 includes:

the first obtaining module includes:

In an optional implementation manner of this embodiment, the first obtaining module 602 includes:

The information processing apparatus corresponds to the information processing method in the embodiment shown in fig. 3, and specific details can be referred to the description of fig. 3 and related contents, which are not described herein again.

Fig. 7 shows a block diagram of an information acquisition apparatus according to an embodiment of the present disclosure, which may be implemented as part or all of an electronic device by software, hardware, or a combination of the two. As shown in fig. 7, the information collecting apparatus includes:

a second obtaining module 701 configured to obtain a face image of a target user and a staying position of the target user; the face image is acquired when the target user stays at the stay position, and a preset kind of articles are placed at the stay position;

a third obtaining module 702, configured to obtain user information of the target user according to the face image;

a second determining module 703 configured to determine item information of the item according to the stop position;

a storage module 704 configured to store the user information in association with the item information.

In an optional implementation manner of this embodiment, the second obtaining module 701 includes:

In an optional implementation manner of this embodiment, the first determining sub-module includes:

In an optional implementation manner of this embodiment, the third obtaining sub-module includes:

In an optional implementation manner of this embodiment, the third obtaining module 702 includes:

In an optional implementation manner of this embodiment, the third obtaining module 702 further includes:

In an optional implementation manner of this embodiment, the user information includes identity information and behavior data of the target user.

In an optional implementation manner of this embodiment, the second determining module 703 includes:

Fig. 8 shows a block diagram of an information acquisition system according to an embodiment of the present disclosure. As shown in fig. 8, the information acquisition system includes: at least one detector 801, at least one image acquisition unit 802, a controller 803; wherein,

the at least one detector 801 is disposed at a predetermined position for transmitting a first detection signal when a target user stays at the predetermined position; a goods shelf is arranged at the preset position, and one or more articles are placed on the goods shelf;

the at least one image acquisition unit 802 is arranged in front of the shelf and used for acquiring images at the preset positions;

the controller 803 is configured to receive a first detection signal of the infrared sensor, and send an image capturing control signal to the at least one image capturing unit when it is determined that the time that the target user stays at the predetermined position exceeds a preset threshold; and sending the face image of the target user received from the at least one image acquisition unit and the predetermined position to a server.

The at least one detector 801, the at least one image acquisition unit 802, and the controller 803 may be used for information acquisition, and the method for information acquisition is shown in the embodiment shown in fig. 1, and for details, reference may be made to the above detailed description of the embodiment shown in fig. 1 and related contents.

The detector is an infrared sensor; and each preset position is provided with one infrared sensor and a plurality of image acquisition units, and the plurality of image acquisition units are used for acquiring the face images of the target users positioned at the preset positions from different angles.

In an optional implementation manner of the embodiment of the present disclosure, the controller 803 includes an image capturing unit controller and a Gateway, where the image capturing unit controller is configured to send an image capturing control signal to the image capturing unit; the Gateway is used for controlling the detector and the image acquisition unit controller and communicating with the server.

In an optional implementation manner of the embodiment of the present disclosure, the controller is configured to implement the information acquisition method.

In an optional implementation manner of the embodiment of the present disclosure, the information acquisition system further includes:

and the server 804 is configured to receive the face image of the target user and the predetermined position, and process the face image and the predetermined position.

The details of the above-described embodiment are exemplified below by an information acquisition system disposed within a mall.

The information acquisition system is implemented by deploying various sensors and a centralized controller on a counter of a shopping mall, wherein the sensors can comprise an infrared sensor (corresponding to the detector 801) and an intelligent camera (corresponding to the image acquisition unit 802), and the centralized controller (corresponding to the controller 803) comprises a camera controller and a Gateway.

Fig. 9 shows a physical picture of an infrared sensor, which is mainly used for detecting whether a customer stays in front of a counter and the time of the customer staying in front of the counter, and a plurality of infrared sensors are disposed according to the positions of counter commodities, which can be used for distinguishing the categories of the commodities and also can be used for distinguishing different positions where the customer stays in the counter. When the time that the customer stays in front of the counter exceeds the threshold time, the infrared sensor sends a photographing request to the Gateway and forwards the photographing request to the camera controller to trigger the intelligent camera to photograph. Usually, one infrared sensor is associated with a plurality of intelligent cameras to be grouped, so that shooting at different angles can be triggered, and finally, the picture with the best quality and angle can be selected from the pictures.

The physical picture of the intelligent camera is shown in fig. 10, and is mainly used for taking a picture of a face of a customer, and is generally deployed at a higher position of a counter or a shelf, facing the stream of people in front of the counter, and a plurality of intelligent cameras are deployed at different angles according to the arrangement of the counter. The intelligent camera is controlled by the camera controller. When a customer stays at the counter and the camera controller receives information from the infrared sensor, the intelligent camera is automatically triggered to take a picture.

The camera controller is mainly used for receiving a photographing request forwarded by the Gateway and triggering the intelligent camera to photograph, information is submitted to a Customer Relationship Management (CRM) system after a photo is simply cut, and the camera controller corresponds to the intelligent camera one by one and communicates with the intelligent camera and the Gateway through Wifi.

An entity picture of the Gateway is shown in fig. 11, and is mainly used for controlling the infrared sensor, forwarding information to the camera controller, receiving App setting information, and configuring the infrared sensor and the intelligent camera. The Gateway communicates with the infrared sensor through a Zigbee protocol and communicates with the camera controller through Wifi. 15 infrared sensors and camera controllers can be managed and controlled simultaneously.

In order to collect information about the location of a customer at a counter and the items of interest, the arrangement of the items at the counter needs to be carefully planned. There can be significant differences in the amount of traffic from location to location, with factors including counter orientation, the attractiveness of the merchandise itself, and shopping guide promotions. The purpose of the merchandise arrangement is to associate merchandise information, location information and infrared sensors so that when a customer is at a location on the counter, the infrared sensor at the corresponding location is triggered.

The sensor arrangement mainly comprises the arrangement of an infrared sensor and an intelligent camera; generally, infrared sensors are arranged according to counter size, store layout and commodity positions so as to collect the positions of customers and concerned commodities in a finer granularity. Also, the intelligent cameras need to be arranged according to the counter orientation, so that the human face can be captured more accurately. Usually, one infrared sensor is associated with a plurality of intelligent cameras to be grouped, so that shooting at different angles can be triggered, and finally, the picture with the best quality and angle can be selected from the pictures.

The server is used for customer relationship management, and the customer relationship management CRM system mainly realizes member management, transaction management and customer behavior management, associates customer information, face characteristics and commodity information, and maintains a face library to support the face searching and comparing functions. When a customer first arrives at a store, the customer is profiled, including facial features of the customer (such as age and gender), behavioral data of the customer, such as stay time at a certain counter and information on items of interest, and transaction data of the customer, such as the purchase of a certain item. When the customer goes to the store for the second time, the CRM system is inquired through the face features to obtain the associated information of the customer, and then the sales promotion information interested by the customer can be actively pushed to the mobile phone of the customer.

In a market or a store, infrared sensors and intelligent cameras are placed in different commodity type areas or shelves and are numbered, and the numbers correspond to equipment records in a Customer Relationship Management (CRM) system one by one. The device record may be associated with various categories of merchandise. When a customer arrives at the area of a certain commodity, the infrared sensor triggers the intelligent camera to take a picture, after the system captures face information and equipment information, the corresponding commodity information and the customer information can be inquired in the customer relationship management CRM system, and at the moment, the system can establish the association between certain face information and the commodity, and the information such as the frequency of browsing the commodity by the certain face information, the stay time and the like.

As shown in fig. 12, the control apparatus 1200 includes a Central Processing Unit (CPU)1201, which can execute various processes in the embodiment shown in fig. 1 described above according to a program stored in a Read Only Memory (ROM)1202 or a program loaded from a storage section 1208 into a Random Access Memory (RAM) 1203. In the RAM1203, various programs and data necessary for controlling the operation of the apparatus 1200 are also stored. The CPU1201, ROM1202, and RAM1203 are connected to each other by a bus 1204. An input/output (I/O) interface 1205 is also connected to bus 1204.

The following components are connected to the I/O interface 1205: an input section 1206 including a keyboard, a mouse, and the like; an output portion 1207 including a display device such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 1208 including a hard disk and the like; and a communication section 1209 including a network interface card such as a LAN card, a modem, or the like. The communication section 1209 performs communication processing via a network such as the internet. A driver 1210 is also connected to the I/O interface 1205 as needed. A removable medium 1211, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like, is mounted on the drive 1210 as necessary, so that a computer program read out therefrom is mounted into the storage section 1208 as necessary.

In particular, according to embodiments of the present disclosure, the method described above with reference to fig. 1 may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program tangibly embodied on a medium readable thereby, the computer program comprising program code for performing the information gathering method of FIG. 1. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 1209, and/or installed from the removable medium 1211.

The embodiment of the disclosure also discloses a server, which is similar to the device shown in fig. 12 in structure and is suitable for implementing the information processing method according to the embodiment of the disclosure. In particular, the method described above with reference to fig. 3 may be implemented as a computer software program, according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program tangibly embodied on a medium readable thereby, the computer program comprising program code for performing the information gathering method of FIG. 3. In such an embodiment, the computer program may be downloaded and installed from a network through the communication part of the server, and/or installed from a removable medium of the server.

The embodiment of the present disclosure further discloses an information acquisition system, which includes the control device suitable for the information acquisition method shown in fig. 12 and the server suitable for implementing the information processing method.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, a program segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units or modules described in the embodiments of the present disclosure may be implemented by software or hardware. The units or modules described may also be provided in a processor, and the names of the units or modules do not in some cases constitute a limitation of the units or modules themselves.

As another aspect, the present disclosure also provides a computer-readable storage medium, which may be the computer-readable storage medium included in the apparatus in the above-described embodiment; or it may be a separate computer readable storage medium not incorporated into the device. The computer-readable storage medium stores one or more programs, which are used by one or more processors to execute the information acquisition method and the information processing method described in the present disclosure.

The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention in the present disclosure is not limited to the specific combination of the above-mentioned features, but also encompasses other embodiments in which any combination of the above-mentioned features or their equivalents is possible without departing from the inventive concept. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.

Claims

1. An information acquisition method, comprising:

and sending the preset position and the face image to a server.

2. The information acquisition method of claim 1, wherein determining the dwell time of the target user at the predetermined location comprises:

starting a timer in response to the first detection signal;

3. The information acquisition method according to claim 1 or 2, wherein the acquiring of the face image of the target user includes:

4. An information processing method characterized by comprising:

acquiring user information of the target user according to the face image;

determining article information of the article according to the stop position;

5. The information processing method according to claim 4, wherein acquiring the face image of the target user and the stay position of the target user includes:

6. The information acquisition method of claim 5, wherein determining the dwell time of the target user at the predetermined location comprises:

starting a timer in response to the first detection signal;

7. The information acquisition method according to claim 5 or 6, wherein the acquiring of the face image of the target user comprises:

8. The information processing method according to any one of claims 4 to 7, wherein acquiring the user information from the face image includes:

9. The information processing method according to any one of claims 4 to 7, wherein the obtaining of the user information from the face image further includes:

10. The information processing method according to claim 9, wherein the user information includes identity information and behavior data of a target user.

11. The information processing method according to any one of claims 4 to 7, wherein determining item information of the item based on the stop position includes:

12. An information acquisition apparatus, comprising:

13. The information acquisition apparatus according to claim 12, wherein the first determination module includes:

the first obtaining module includes:

14. The information acquisition apparatus according to claim 12 or 13, wherein the first acquisition module includes:

15. An information processing apparatus characterized by comprising:

16. The information processing apparatus according to claim 15, wherein the second acquisition module includes:

17. The information acquisition apparatus according to claim 16, wherein the first determination submodule includes:

18. The information acquisition apparatus according to claim 16 or 17, wherein the third acquisition submodule includes:

19. The information processing apparatus according to any one of claims 15 to 18, wherein the third acquisition module includes:

20. The information processing apparatus according to any one of claims 15 to 18, wherein the third acquisition module further includes:

21. The information processing apparatus according to any one of claims 15 to 18, wherein the user information includes identity information and behavior data of a target user.

22. The information processing apparatus according to any one of claims 15 to 18, wherein the second determination module includes:

23. An information acquisition system, comprising: the system comprises at least one detector, at least one image acquisition unit and a controller; wherein,

24. The information acquisition system of claim 23, wherein the detector is an infrared sensor; and each preset position is provided with one infrared sensor and a plurality of image acquisition units, and the plurality of image acquisition units are used for acquiring the face images of the target users positioned at the preset positions from different angles.

25. The information acquisition system according to claim 23, wherein said controller comprises an image acquisition unit controller and a Gateway, said image acquisition unit controller being configured to send an image acquisition control signal to said image acquisition unit; the Gateway is used for controlling the detector and the image acquisition unit controller and communicating with the server.

26. An information acquisition system according to claim 23, wherein the controller is adapted to implement the method steps of any of claims 1-3.

27. The information acquisition system of claim 23, further comprising:

28. A control device comprising a memory and a processor; wherein,

the memory is configured to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the method steps of any of claims 1-11.

29. A computer-readable storage medium having stored thereon computer instructions, characterized in that the computer instructions, when executed by a processor, carry out the method steps of any of claims 1-11.