CN113032605A - Information display method, device and equipment and computer storage medium - Google Patents
Information display method, device and equipment and computer storage medium Download PDFInfo
- Publication number
- CN113032605A CN113032605A CN201911352925.1A CN201911352925A CN113032605A CN 113032605 A CN113032605 A CN 113032605A CN 201911352925 A CN201911352925 A CN 201911352925A CN 113032605 A CN113032605 A CN 113032605A
- Authority
- CN
- China
- Prior art keywords
- information
- target
- user
- tof
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/54—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
- G06Q30/0269—Targeted advertisements based on user profile or attribute
- G06Q30/0271—Personalized advertisement
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- General Physics & Mathematics (AREA)
- Entrepreneurship & Innovation (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Economics (AREA)
- Game Theory and Decision Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an information display method, an information display device, information display equipment and a computer storage medium. The method comprises the following steps: respectively acquiring time of flight (TOF) information and image information of a plurality of users in a preset area; determining a target user according to TOF information and image information of a plurality of users; determining at least one first target information according to the image information of the target user; and displaying at least one first target information. The target user is determined through the TOF information and the image information of the user, targeted target information is provided for the target user according to the image information of the target user, and the pertinence of information display is improved.
Description
Technical Field
The invention belongs to the field of information display, and particularly relates to an information display method, an information display device, information display equipment and a computer storage medium.
Background
The existing information display mode is roughly divided into two modes, one is a fixed content mode, and the display information is pasted or directly printed on carriers such as bulletin boards and the like through paper in the mode; the other is electronic type, and the display information is statically or rollably displayed through a display or a projector. The current information display is randomly displayed for users and has no pertinence.
The advertisement is a relatively representative type in the aspect of information display, the advertisement refers to a medium for transmitting advertisement information, most of the existing advertisements display contents to random users, and the method is not targeted and cannot attract the interests of viewers. Such advertisements occupy a large number of positions but cannot achieve a good advertising effect, which causes resource waste.
Therefore, how to improve the pertinence of information presentation becomes a problem to be solved.
Disclosure of Invention
The embodiment of the invention provides an information display method, an information display device, information display equipment and a computer storage medium, and aims to solve the problem that the display information of the current advertisement is not high in pertinence.
In a first aspect, the present application provides an information display method applied to an information display device, the method including: respectively acquiring time of flight (TOF) information and image information of a plurality of users in a preset area; determining a target user according to TOF information and image information of a plurality of users; determining at least one first target information according to the image information of the target user; and displaying at least one first target information.
The information display equipment is used for displaying target information.
In one possible implementation, after presenting the at least one first objective information, the method further comprises: receiving a target action input of a target user; second target information is determined from the at least one first target information according to the target motion input.
In one possible implementation, determining at least one first target information according to the image information of the target user includes: determining a characteristic label of a target user according to the image information of the target user; at least one first target information is determined according to the characteristic label of the target user.
In one possible implementation, determining the target user according to TOF information and image information of a plurality of users includes:
determining moving speed information of each user according to TOF information and image information of a plurality of users; determining a user corresponding to the moving speed information meeting the preset condition as a first user; the first user is taken as a target user.
In one possible implementation, determining the target user from the TOF information and the image information of each user includes:
determining face information of each user according to the TOF information and the image information of each user; determining a user corresponding to the face information meeting the preset condition as a first user; the first user is taken as a target user.
In one possible implementation, in the case that the number of the first users is at least two, the distances between the at least two first users and the information presentation device are respectively determined; taking the first user as a target user, specifically comprising: and determining the first user corresponding to the distance meeting the preset condition as the target user.
In one possible implementation, receiving a target action input of a target user includes: acquiring TOF information of the whole outline area of a target user; determining TOF information of a local area of a target user according to TOF information of the whole outline area of the target user and a pre-trained TOF information model of the user; and determining target action input of the target user according to the TOF information of the local area.
In one possible implementation, determining second target information from the at least one first target information according to the target action input includes: determining a user instruction according to the target action input of the target user; and determining second target information from the at least one first target information according to the user instruction.
In one possible implementation, after determining the target user from the TOF information and the image information of the plurality of users, the method further comprises: acquiring TOF information of a target user; determining a target distance between a target user and the information display equipment according to TOF information of the target user; and under the condition that the target distance is greater than the preset threshold value, displaying first information on the information display equipment, wherein the first information is used for enabling the user to move towards the direction of reducing the target distance.
In one possible implementation, obtaining TOF information of the target user overall contour region includes: receiving initial TOF information acquired by at least one TOF device; and determining TOF information of the overall contour region of the target user according to the initial TOF information.
In a second aspect, an embodiment of the present invention provides an information displaying apparatus, where the apparatus includes: the acquisition module is used for respectively acquiring the TOF information and the image information of the flight time of a plurality of users in a preset area; the first determining module is used for determining a target user according to TOF information and image information of a plurality of users; the second determining module is used for determining at least one first target information according to the image information of the target user; and the display module is used for displaying at least one piece of first target information.
In a third aspect, an embodiment of the present invention provides a computing device, where the device includes: a processor and a memory storing computer program instructions; the processor, when executing the computer program instructions, implements the processing methods as provided by embodiments of the present invention.
In a fourth aspect, an embodiment of the present invention provides a computer storage medium, where computer program instructions are stored, and when the computer program instructions are executed by a processor, the computer program instructions implement the processing method provided by the embodiment of the present invention.
According to the information display method, the information display device, the information display equipment and the computer storage medium, the target user is determined through the TOF information and the image information of the user, and the targeted information with pertinence is provided for the target user according to the image information of the target user, so that the pertinence of information display is improved, and the user experience is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the embodiments of the present invention will be briefly described below, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flow chart of an information displaying method according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of an interactive advertisement device according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a resource pool system according to an embodiment of the present invention;
FIG. 4 is a block diagram of a program system according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of another interactive advertisement device provided by the embodiment of the present invention;
fig. 6 is a schematic structural diagram of an information display apparatus according to an embodiment of the present invention;
fig. 7 is a schematic diagram of an exemplary hardware architecture provided by an embodiment of the present invention.
Detailed Description
Features and exemplary embodiments of various aspects of the present invention will be described in detail below, and in order to make objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not to be construed as limiting the invention. It will be apparent to one skilled in the art that the present invention may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present invention by illustrating examples of the present invention.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The existing information display methods are roughly divided into two types, one is a fixed content type, and the other is an electronic type. The current information display is randomly displayed for users and has no pertinence. The advertisement is a relatively representative type in the aspect of information display, the advertisement refers to a medium for transmitting advertisement information, most of the existing advertisements are in two forms, one is a fixed content type, and the advertisement content is pasted on carriers such as a billboard through paper or is directly printed on the carriers; the other is electronic type, and the advertisement content is displayed through a display or a projector.
The existing information display (or advertisement) mainly has the following defects: firstly, most of the existing advertisements show the content to random users, and the mode has no pertinence and cannot attract the interest of viewers; secondly, most of the existing advertisements only have the function of outputting information, and only can recommend the advertisement content to the viewer, according to the prior art, the viewer needs to purchase corresponding commodities in other ways, such as mobile phone purchase, telephone order and the like, under most conditions, the popularization rate of the method is low, the viewer can forget the advertisement content after leaving the billboard, the conversion rate is low, additional operation is needed for purchasing in other ways, and the convenience is not provided. Thirdly, most of the existing advertisement contents are single, which easily causes the viewers to feel dislike, thereby reducing the promotion rate of the advertisement and the satisfaction degree of the viewers.
With the rapid development of Artificial Intelligence technology in recent years and the improvement of computer performance, Artificial Intelligence (AI) is used to obtain user characteristics in the field of information display, so that information display can be performed better according to the user characteristics, and the trend is popular.
In order to solve the problem of low pertinence of the current information display, comprehensive judgment can be carried out according to user image information acquired by an image sensor and Time of Flight (TOF) information acquired by TOF equipment, the advantages of the two information acquisition equipment can be fully exerted, user characteristic information with high data rate is obtained, and then the targeted information display based on the user characteristic information is realized. Based on this, the embodiment of the invention provides an information display method.
The information display method provided by the embodiment of the invention is described below.
Fig. 1 is a schematic flow chart of an information display method according to an embodiment of the present invention.
As shown in fig. 1, the information presentation method may include S101-S104, and the method is applied to a server, and specifically as follows:
s101, respectively acquiring time of flight (TOF) information and image information of a plurality of users in a preset area.
S102, determining target users according to the TOF information and the image information of the multiple users.
S103, determining at least one piece of first target information according to the image information of the target user.
S104, displaying at least one piece of first target information.
According to the information display method, the target user is determined through the TOF information and the image information of the user, and targeted information is provided for the target user according to the image information of the target user, so that the pertinence of information display is improved, and the user experience is improved.
The contents of S101-S104 are described below, respectively:
first, a specific implementation of S101 will be described.
In one embodiment, time of flight TOF information and image information of a plurality of users in a preset area are respectively obtained, wherein the preset area can be a preset area in front of the information display device at a certain distance, and collecting the TOF information and the image information of the users in the preset area can help to judge whether the users are target users to interact.
Next, a specific implementation of S102 is described.
The step of determining the target user according to the TOF information and the image information of the multiple users may include two implementation methods, and the specific implementation manner is as follows.
(1) The step of determining the target user according to the TOF information and the image information of a plurality of users in the embodiment of the invention may include:
determining moving speed information of each user according to TOF information and image information of a plurality of users; determining a user corresponding to the moving speed information meeting the preset condition as a first user; the first user is taken as a target user.
According to the TOF information and the image information of a plurality of users, the coordinate corresponding relation between the image information of each user and the TOF information of each user is established, the human body contour of each user in the image information can be judged more accurately, the moving speed of each user is judged, and if the average moving speed of the user in a preset time period is smaller than a preset threshold value, the user can be used as a candidate user of a target user. For example, a user whose average moving speed in the first 2 seconds of the current time is lower than 0.5 m/s is taken as the candidate user for the target user.
(2) The step of determining the target user according to the TOF information and the image information of a plurality of users in the embodiment of the invention may include:
determining face information of each user according to the TOF information and the image information of each user; determining a user corresponding to the face information meeting the preset condition as a first user; the first user is taken as a target user.
According to the TOF information and the image information of the users, the coordinate corresponding relation between the image information of each user and the TOF information is established, and the face information of each user in the image information can be judged more accurately. Face information for each user may be determined based on a pre-trained face recognition model.
The face information here may be face orientation information, and whether or not the user is looking at the information presentation apparatus is judged by the face orientation information of the user, and if the output result of the face recognition model is that the user is looking at the information presentation apparatus, it may be a candidate user of the target user. The face information here may also be user pupil information, and it may be determined whether the user is looking at the information presentation apparatus based on an output result of a pupil recognition model trained in advance, and if the output result is that the user is looking at the information presentation apparatus, it may be used as an alternative user to the target user.
Therefore, through the two implementation methods for determining the target user according to the TOF information and the image information of the multiple users, the target user can be accurately screened from the multiple users, and the pertinence is improved for the information display service provided for the target user subsequently.
For more accurate determination of the target user, after the step of determining the target user at S102, the following steps may be further included:
respectively determining the distances between at least two first users and the information display equipment under the condition that the number of the first users is at least two; taking the first user as a target user, specifically comprising: and determining the first user corresponding to the distance meeting the preset condition as the target user.
If a plurality of alternative users of the target user are determined by the two target user determining modes. That is, if the speed information of a plurality of candidate users meets the preset condition, or the face information of a plurality of candidate users meets the preset condition, the candidate user closest to the information display device is marked as the target user. Therefore, the target user can be determined more accurately, accurate interactive service can be provided for the target user subsequently, and user experience is improved.
In order to improve the effect of information presentation, after the step of determining the target user in S102, the following steps may be further included:
acquiring TOF information of a target user; determining a target distance between a target user and the information display equipment according to TOF information of the target user; and under the condition that the target distance is greater than the preset threshold value, displaying first information on the information display equipment, wherein the first information is used for enabling the user to move towards the direction of reducing the target distance.
Judging the distance between the target user and the information display equipment, judging the signal intensity of the target user through the TOF signal, further judging whether the target user is too far away, inputting an image for guiding the target user to move forwards if the target user is out of the threshold range, and guiding the target to move forwards actively. The image guiding the target user to move forward may be a mini-game or an Augmented Reality (AR) game. The information display equipment is used for displaying target information.
For example, the information presentation device displays an image obtained by a camera, and displays a highlighted circle in an augmented reality manner in an optimal recognition range of the TOF through an AR technology, thereby guiding a target user to actively approach the information presentation device. Therefore, TOF signals of the user can be better captured, more accurate interaction service is provided for the user, and the information display effect can be improved.
Then, a specific implementation of S103 is introduced.
The step of determining at least one first target information according to the image information of the target user in the embodiment of the present invention may include: determining a characteristic label of a target user according to the image information of the target user; at least one first target information is determined according to the characteristic label of the target user.
And performing AI portrait according to the image information of the target user to obtain a feature tag of the target user, and determining at least one first target information according to the feature tag of the target user. For example, the target information is commodity information, and the commodity information comprises commodity name information, commodity advertisement image information, commodity classification information and commodity label information; the commodity label information is a characteristic label of the commodity, and comprises applicable people, applicable age, style, color, size information and the like of the commodity.
Therefore, the information highly matched with the characteristics of the target user can be displayed for the target user in a targeted manner according to the characteristics of the target user, and the information display effect is improved.
Next, a specific implementation of S104 will be described.
As an implementation manner of the present application, in order to better display the target information and improve the user experience, after S104, the following steps may be further included: receiving a target action input of a target user; second target information is determined from the at least one first target information according to the target motion input.
The information display device comprises an information display screen, a display screen and a display control unit, wherein the information display screen comprises at least one first target information display unit, the first target information display unit is used for displaying the first target information, the display control unit is used for displaying the first target information on the display screen, and the display control unit is used for controlling the display control unit to display the first target information. The motion input here may be a touch screen motion input, or may be gesture information of the user, for example, if the user compares "OK" with hand, it indicates confirmation.
The step of receiving the target action input of the target user may specifically include: acquiring TOF information of the whole outline area of a target user; determining TOF information of a local area of a target user according to TOF information of the whole outline area of the target user and a pre-trained TOF information model of the user; and determining target action input of the target user according to the TOF information of the local area.
And comparing the acquired TOF signal of the whole contour area of the target user with the TOF signal of the body limb obtained through deep learning to obtain the joint node position of the main target, so that the TOF signal of the local area of the target user can be determined, and the action of the target user is determined in real time according to the TOF signal of the local area of the target user.
For example, the obtained TOF signal of the limb outline of the target user is compared with the TOF signal of the human limb obtained by deep learning to obtain the joint node position of the main target, the arm joint of the main target is identified to obtain the TOF signal of the target arm limb, and the action of the TOF signal of the target arm limb is obtained in real time to obtain the action information of the target arm limb. The interaction operation is mainly carried out according to the gesture action of the target in the subsequent interaction process, and the signal for judging the action of the target limb by the interference in the TOF signal can be filtered in advance through the signal filtering, so that the accuracy of target action input identification can be improved in the subsequent interaction process, the interaction information to be expressed by a user can be received more accurately, and the user experience is improved.
The step of obtaining TOF information of the target user overall contour region may specifically include: receiving initial TOF information acquired by at least one TOF device; and determining TOF information of the overall contour region of the target user according to the initial TOF information.
The recognizable range of the TOF equipment is increased by arranging the TOF equipment in the direction far away from the information display equipment, so that the recognition accuracy of the TOF equipment is improved, and the interaction experience of the target is optimized. For example, for an information presentation device working outdoors, a plurality of TOF devices may be arranged in a direction away from the information presentation device, and after signals of all TOF devices are acquired, the signal acquired by the TOF device with the strongest signal may be selected for limb identification of a user. And multiple groups of signals acquired by multiple TOF devices can be weighted to obtain more stable signals. Therefore, the identification accuracy of the TOF equipment can be improved, and the interaction experience of the target is optimized.
The step of determining the second target information from the at least one first target information according to the target action input may specifically include: determining a user instruction according to the target action input of the target user; and determining second target information from the at least one first target information according to the user instruction.
And comparing the target action input of the target user with the preset action information to determine the interactive content information of the target user, namely the user instruction. And if the interactive content information is a switching instruction, switching the currently displayed information on the information display equipment, and if the interactive content information is a confirmation instruction, confirming the currently displayed information on the information display equipment. And the user experience is further improved.
In summary, according to the information display method provided by the embodiment of the invention, the target user is determined through the TOF information and the image information of the user, the targeted target information is provided to the target user according to the image information of the target user, the user action information can be determined according to the TOF information of the target user, and then the target user is interacted with the target user, the target user can switch the target information matched with the target user in the interaction process, the pertinence of information display is improved, and the user experience is improved.
In addition, based on the information display method, an embodiment of the present invention further provides an interactive advertisement device, which is specifically described in detail with reference to fig. 2.
Fig. 2 is a schematic structural diagram of an interactive advertisement device according to an embodiment of the present invention.
As shown in fig. 2, the interactive advertising apparatus may include: processor 200, image input interface 210, TOF device interface 220, image output interface 230, transaction interface 240, audiovisual component interface 250, resource pool system 300, program system 400, and sensor interface 260.
The following are described separately:
and a processor 200 for integrating information output by the constituent elements of the interactive advertising device to perform hierarchical processing.
An image input interface 210 for inputting image information, the image input interface being capable of connecting to an image acquisition device such as a camera.
A TOF device interface 220 for connecting to a TOF device.
And an image output interface 230 for outputting an image, which can be connected to an image output device such as a display or a projector.
And a transaction interface 240 for connecting to a transaction platform or a shopping platform, wherein the interactive advertisement device can initiate a transaction to the transaction platform through the transaction interface.
And the audio and video component interface 250 is used for connecting the audio and video components and outputting sound information, and can be connected with sound output equipment such as audio and video.
Resource pool system 300 includes a user representation resource pool and a content resource pool. The user portrait resource pool is used for carrying out AI portrait according to the image of the target to obtain a characteristic label of the target; the content resource pool comprises a commodity content resource pool and an interactive content resource pool.
The program system 400 includes a signal acquiring unit, a signal processing unit, a content matching unit, and an interaction control unit.
And a sensor interface 260 for connecting a sensor, which may be a distance sensor.
Next, the resource pool system 300 will be described in detail with reference to fig. 3.
As shown in fig. 3, the resource pool system 300 may include: user representation resource pool 310 and content resource pool 320. Content asset pool 320, in turn, includes commodity content asset pool 330 and interactive content asset pool 340.
The following are described separately:
a user portrait resource pool 310, configured to perform AI portrait according to an image of a target to obtain a feature tag of the target; specifically, the user portrait resource pool stores feature image information and feature tag information corresponding thereto.
Content asset pool 320 includes commodity content asset pool 330 and interactive content asset pool 340.
A commodity content resource pool 330 for storing commodity information, wherein the commodity information includes commodity name information, commodity advertisement image information, commodity classification information, and commodity label information; the commodity label information is a characteristic label of the commodity, and comprises applicable people, applicable age, style, color, size information and the like of the commodity.
The interactive content resource pool 340 is used for storing interactive content and interactive information corresponding to the interactive content; the interactive content includes a commodity content switching action, a purchase confirmation action, an interactive game action and the like, and the interactive information is corresponding gesture information and/or image information and the like.
Next, the program system 400 will be described in detail with reference to fig. 4.
As shown in fig. 4, the program system 400 may include:
the program system comprises: a signal acquisition unit 410, a signal processing unit 420, a signal output unit 430, and an interaction control unit 440.
The signal acquisition unit 410 is first introduced.
A signal acquisition unit 410 for transmitting the video image information and the TOF signal to a signal processing unit 420. The signal acquisition unit 410 includes a guidance interaction unit 411, an image signal acquisition unit 412, and a TOF signal acquisition unit 413.
The guidance interaction unit 411 is configured to guide the target to adjust the position of the target to a position with better interaction experience, that is, a position with higher identification sensitivity of the TOF device, specifically, the guidance interaction unit acquires image information input by the image signal acquisition unit 412 and a TOF signal input by the TOF signal acquisition unit 413 in real time, determines the distance between the target and the device through the image information, determines whether the target is within a threshold interval in combination with a distance value of the TOF signal, and sends interaction content, which is included in the interaction content resource pool and can guide the target to move to the threshold interval of the optimal identification range of the TOF, to the signal output unit 430 if the target is not within the threshold interval of the optimal identification range of the TOF, so that the signal output unit 430 outputs a corresponding interaction content image to guide the target to actively move to the optimal identification interval of the TOF.
The guiding interaction unit 411 is further configured to obtain sensor data input by the sensor interface 260 in real time, and if the sensor data reaches a preset threshold interval, send the interaction content of the interaction content resource pool guiding target moving to the optimal identification range threshold interval of the TOF to the signal output unit 430, so that the signal output unit 430 outputs a corresponding interaction content image to guide the target to actively move to the optimal identification interval of the TOF.
The guiding interaction unit 411 is specifically configured to attract the attention of the target through an interaction means, and actively guide the target to an interaction area; the popularization rate of the advertisement is improved; specifically, the guiding interaction unit judges the distance between the target and the device through image information, judges the signal intensity of the target through TOF signals, further judges whether the target is too far away, and inputs an image for guiding the target to move forward if the target is out of a threshold range, so as to guide the target to move forward actively; the image guiding the forward movement of the target may be a mini game or an AR game; for example, the advertising device displays an image obtained by a camera, displays a highlighted circle in an augmented reality manner at an optimal recognition range of TOF by AR technology, and thus guides the target to actively move to the optimal recognition range of TOF.
The back and the side of the interactive advertising device are not in an interactive range, so that distance sensors are arranged on the back and the side of the interactive advertising device and are connected with the processor through the sensor interface 260, the guide interaction unit 411 obtains parameters output by the distance sensors, when a person approaches, sound information is output through the loudspeaker 251 to attract the attention of a target, the guide target actively moves to an interaction area, the popularization rate of the advertising device can be improved, and the interactive experience of participants is improved.
And an image signal acquiring unit 412, configured to acquire video image information input by the image input interface in real time.
And the TOF signal acquisition unit 413 is used for acquiring the TOF signal input by the TOF equipment interface in real time.
The TOF signal acquiring unit 413 further includes a TOF signal selecting unit 414, where the TOF signal selecting unit 414 is used for determining a trusted TOF device when the TOF device is connected to multiple TOF devices through interfaces, and specifically, the TOF signal selecting unit acquires TOF signals input by all TOF devices and removes TOF signals with weak signals and long target distances.
The signal processing unit 420 is described next.
And the signal processing unit 420 is used for processing signals and sending the commodity list to the signal output unit. The signal processing unit 420 includes a user profile unit 421, a signal filtering unit 422, and a content matching unit 423.
The user portrait unit 421 is configured to obtain the video image information output by the signal obtaining unit, and compare the image information with the image information in the user portrait resource pool to obtain a matched user feature tag.
And the signal filtering unit 422 is configured to filter the TOF signal in combination with the video image information output by the image signal acquiring unit to obtain the motion information of the target arm limb.
The signal filtering unit 422 is used for filtering TOF signals, and specifically comprises a main target filtering unit 4221 and a limb filtering unit 4222.
The main target filtering unit 4221 is configured to filter signals other than the target signal in the TOF signal, specifically, the main target filtering unit obtains the image signal output by the image signal obtaining unit and the TOF signal output by the TOF signal obtaining unit, establishes a coordinate corresponding relationship between the image signal and the TOF signal, determines a human body contour in the image signal, and determines a moving speed of the human body contour, if its average moving speed of the last 2 seconds is lower than 0.5 meters per second, the object closest to the device is marked as the primary object if a plurality of human body contours are satisfied, and obtaining a limb contour signal of a main target in the TOF signal through the coordinate corresponding relation between the image signal and the TOF signal, removing other signals except the limb contour signal of the main target, only reserving the limb contour signal of the main target, and outputting the limb contour signal of the main target to a limb filtering unit.
The limb filtering unit 4222 is used for filtering other signals except for the arm limb signal in the limb contour signal; specifically, the TOF signals of the human body limbs, recorded by the limb filtering unit and obtained through deep learning, comprise position information of human body joint nodes, the TOF signals of the limb outline of the main target are obtained by the limb filtering unit, the TOF signals of the human body limbs, obtained through deep learning, are compared with the TOF signals of the human body limbs to obtain the joint node positions of the main target, arm joints of the human body limbs are identified to obtain the TOF signals of the target arm limbs, and the action of the TOF signals of the target arm limbs is obtained in real time to obtain action information of the target arm limbs.
The signal filtering unit 422 can also realize a filtering algorithm of the TOF signal, wherein the TOF signal acquired by the TOF device is filtered to finally obtain the action information of the target arm limb.
The content matching unit 423 is configured to perform product content matching on the target, and specifically, the content matching unit obtains tag information of the target output by the user portrait unit, and compares the tag information with tag information of the product recorded in the product content resource pool to obtain a matched product content list.
The signal output unit 430 is then introduced.
And the signal output unit 430 is configured to obtain the commodity content list output by the content matching unit, search commodity contents related to the commodity content list in the commodity content resource pool, and output commodity advertisement image information through the image output interface.
Finally, an interaction control unit 440 is introduced.
And the interaction control unit 440 comprises a switching unit and a transaction unit. And the action instruction is used for identifying the target.
The switching unit 441 is configured to obtain the motion information of the target arm limb output by the signal filtering unit in real time, compare the motion information of the target arm limb with the gesture information recorded in the interactive content resource pool to obtain matched interactive content information, and perform judgment by the switching unit, if the interactive content information is a switching instruction, send a content switching instruction to the signal output unit, and the signal output unit switches a commodity target according to the commodity content list and finally outputs commodity advertisement image information through the image output interface.
The transaction unit 442 is configured to obtain the motion information of the target arm limb output by the signal filtering unit in real time, compare the motion information of the target arm limb with the gesture information recorded in the interactive content resource pool to obtain matched interactive content information, and perform judgment by the interactive unit, and send transaction information to the transaction interface if the interactive content information is a transaction instruction.
In summary, the program system shown in fig. 4 can push targeted product advertisement content to a target, the target can browse the matched product content in an interactive manner, and can also purchase a specified product in an interactive manner, the interactive manner can quickly attract the attention of the target, the target can quickly purchase the recommended product, target forgetting is prevented, the promotion rate of product advertisement is improved, and convenience of user operation is improved.
Next, an interactive advertisement apparatus including a plurality of TOF devices is further described with particular reference to fig. 5.
As shown in fig. 5, TOF device interface 220 connects a plurality of TOF devices, which may include: a first TOF device 22, a second TOF device 222 and a third TOF device 223.
The interactive advertising device is used for being installed outdoors, and the recognizable range of the TOF equipment is enlarged by arranging a plurality of TOF equipment in a direction far away from the interactive advertising device; therefore, the identification accuracy of the TOF equipment is improved, and the interaction experience of the target is optimized.
Specifically, set up a plurality of TOF equipment to the mutual advertisement device of outdoor work on the ground direction of keeping away from mutual advertisement device, TOF signal selection unit acquires the signal of all TOF equipment inputs, and the TOF equipment signal nearest apart from the target is strong, and other signals weaken in proper order, and TOF signal selection unit selects the TOF equipment that the signal is strong to be used for user's limbs discernment, improves TOF equipment's discernment accuracy, optimizes the interactive experience of target.
In addition, based on the information display method, the embodiment of the invention also provides a structural schematic diagram of the information display device.
As shown in fig. 6, the apparatus 600 may include:
the acquiring module 610 is configured to acquire time of flight TOF information and image information of a plurality of users in a preset region respectively.
A first determining module 620, configured to determine a target user according to TOF information and image information of multiple users.
The first determining module 620 may be specifically configured to determine moving speed information of each user according to TOF information and image information of a plurality of users; determining a user corresponding to the moving speed information meeting the preset condition as a first user; the first user is taken as a target user.
The first determining module 620 may be specifically configured to determine face information of each user according to TOF information and image information of each user; determining a user corresponding to the face information meeting the preset condition as a first user; the first user is taken as a target user.
Therefore, the target user can be accurately screened from the plurality of users, and the pertinence of the information display service provided for the target user is improved.
The first determining module 620 may be further configured to determine distances between the at least two first users and the information presentation device, respectively, if the number of the first users is at least two; and determining the first user corresponding to the distance meeting the preset condition as the target user.
Therefore, the target user can be determined more accurately, accurate interactive service can be provided for the target user subsequently, and user experience is improved.
The first determination module 620 may also be configured to obtain TOF information of the target user; determining a target distance between a target user and the information display equipment according to TOF information of the target user; and under the condition that the target distance is greater than the preset threshold value, displaying first information on the information display equipment, wherein the first information is used for enabling the user to move towards the direction of reducing the target distance.
Therefore, TOF signals of the user can be better captured, more accurate interaction service is provided for the user, and the information display effect can be improved.
A second determining module 630, configured to determine at least one first target information according to the image information of the target user.
Therefore, the information highly matched with the characteristics of the target user can be displayed for the target user in a targeted manner according to the characteristics of the target user, and the information display effect is improved.
The second determining module 630 may be specifically configured to determine the feature tag of the target user according to the image information of the target user; at least one first target information is determined according to the characteristic label of the target user.
A display module 640 is configured to display at least one first target information.
The presentation module 640 may also be configured to receive a target action input by a target user; second target information is determined from the at least one first target information according to the target motion input.
The presentation module 640 may also be configured to obtain TOF information of the overall contour region of the target user; determining TOF information of a local area of a target user according to TOF information of the whole outline area of the target user and a pre-trained TOF information model of the user; and determining target action input of the target user according to the TOF information of the local area.
Therefore, the accuracy of target action input identification can be improved, the interactive information to be expressed by the user can be received more accurately, and the user experience is improved.
The presentation module 640 may also be used to receive initial TOF information acquired by at least one TOF device; and determining TOF information of the overall contour region of the target user according to the initial TOF information.
Therefore, the identification accuracy of the TOF equipment can be improved, and the interaction experience of the target is optimized.
The presentation module 640 may also be configured to determine a user instruction based on a target action input of a target user; and determining second target information from the at least one first target information according to the user instruction.
In summary, the information display device provided by the embodiment of the invention determines the target user through the TOF information and the image information of the user, provides targeted target information to the target user according to the image information of the target user, and also determines user action information according to the TOF information of the target user, so as to interact with the target user, and the target user can switch the target information matched with the target user in the interaction process, thereby improving the pertinence of information display and improving the user experience.
Fig. 7 is a diagram illustrating an exemplary hardware architecture provided by an embodiment of the present invention.
The positioning device may include a processor 701 and a memory 702 storing computer program instructions.
Specifically, the processor 701 may include a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or may be configured as one or more Integrated circuits implementing an embodiment of the present invention.
The processor 701 reads and executes the computer program instructions stored in the memory 702 to implement any one of the information presentation methods in the above embodiments.
In one example, the positioning device may also include a communication interface 703 and a bus 710. As shown in fig. 7, the processor 701, the memory 702, and the communication interface 703 are connected by a bus 710 to complete mutual communication.
The communication interface 703 is mainly used for implementing communication between modules, apparatuses, units and/or devices in the embodiment of the present invention.
The processing device may execute the information presentation method in the embodiment of the present invention, thereby implementing the information presentation method described in conjunction with fig. 1.
In addition, in combination with the information display method in the foregoing embodiments, the embodiments of the present invention may provide a computer storage medium to implement. The computer storage medium having computer program instructions stored thereon; the computer program instructions, when executed by a processor, implement any of the information presentation methods in the embodiments described above.
It is to be understood that the embodiments of the invention are not limited to the particular configurations and processes described above and shown in the drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the embodiments of the present invention are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications and additions or change the order between the steps after comprehending the spirit of the embodiments of the present invention.
It should also be noted that the exemplary embodiments mentioned in this patent describe some methods or systems based on a series of steps or devices. However, the embodiments of the present invention are not limited to the order of the above steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.
As described above, only the specific embodiments of the present invention are provided, and it can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the system, the module and the unit described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. It should be understood that the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present invention, and these modifications or substitutions should be covered within the scope of the present invention.
Claims (13)
1. An information display method is applied to information display equipment, and is characterized by comprising the following steps:
respectively acquiring time of flight (TOF) information and image information of a plurality of users in a preset area;
determining a target user according to the TOF information and the image information of the plurality of users;
determining at least one first target information according to the image information of the target user;
and displaying the at least one first target information.
2. The method of claim 1, wherein after said presenting said at least one first target information, said method further comprises:
receiving a target action input of the target user;
determining second target information from the at least one first target information according to the target action input.
3. The method of claim 1, wherein determining at least one first target information from the image information of the target user comprises:
determining a feature tag of a target user according to image information of the target user;
and determining the at least one first target information according to the characteristic label of the target user.
4. The method of claim 1, wherein determining the target user based on the TOF information and the image information of the plurality of users comprises:
determining the moving speed information of each user according to the TOF information and the image information of the plurality of users;
determining a user corresponding to the moving speed information meeting the preset condition as a first user;
and taking the first user as a target user.
5. The method of claim 1, wherein determining the target user based on the TOF information and the image information of each user comprises:
determining the face information of each user according to the TOF information and the image information of each user;
determining a user corresponding to the face information meeting the preset condition as a first user;
and taking the first user as a target user.
6. The method according to claim 4 or 5, characterized in that the method further comprises:
respectively determining the distances between the at least two first users and the information display equipment under the condition that the number of the first users is at least two;
the taking the first user as a target user specifically includes:
and determining the first user corresponding to the distance meeting the preset condition as the target user.
7. The method of claim 2, wherein receiving the target action input of the target user comprises:
acquiring TOF information of the whole contour region of the target user;
determining TOF information of the target user local area according to TOF information of the target user overall contour area and a pre-trained user TOF information model;
and determining target action input of the target user according to the TOF information of the local area.
8. The method of claim 2, wherein determining second goal information from the at least one first goal information based on the goal action input comprises:
determining a user instruction according to the target action input of the target user;
and determining second target information from the at least one first target information according to the user instruction.
9. The method of claim 1, wherein after the determining a target user from the TOF information and the image information of the plurality of users, the method further comprises:
acquiring TOF information of the target user;
determining a target distance between a target user and the information display equipment according to TOF information of the target user;
and displaying first information on the information display equipment under the condition that the target distance is greater than a preset threshold, wherein the first information is used for enabling a user to move towards the direction of reducing the target distance.
10. The method of claim 7, wherein the obtaining TOF information of the target user global contour region comprises:
receiving initial TOF information acquired by at least one TOF device;
and determining TOF information of the whole contour region of the target user according to the initial TOF information.
11. An information presentation device, comprising:
the acquisition module is used for respectively acquiring the TOF information and the image information of the flight time of a plurality of users in a preset area;
a first determining module, configured to determine a target user according to TOF information and image information of the multiple users;
the second determining module is used for determining at least one first target information according to the image information of the target user;
and the display module is used for displaying the at least one piece of first target information.
12. A computing device, the device comprising: a processor and a memory storing computer program instructions;
the processor, when executing the computer program instructions, implements the information presentation method of any one of claims 1-10.
13. A computer storage medium having computer program instructions stored thereon, which when executed by a processor, implement the information presentation method of any one of claims 1-10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911352925.1A CN113032605B (en) | 2019-12-25 | 2019-12-25 | Information display method, device, equipment and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911352925.1A CN113032605B (en) | 2019-12-25 | 2019-12-25 | Information display method, device, equipment and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113032605A true CN113032605A (en) | 2021-06-25 |
| CN113032605B CN113032605B (en) | 2023-08-18 |
Family
ID=76452385
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911352925.1A Active CN113032605B (en) | 2019-12-25 | 2019-12-25 | Information display method, device, equipment and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113032605B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116028002A (en) * | 2023-03-30 | 2023-04-28 | 中国联合网络通信有限公司湖南省分公司 | Display screen data display method and system based on Internet of things |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2295378A1 (en) * | 1998-12-31 | 2000-06-30 | Steve Mann | Point of purchase (pop) terminal |
| CN102081918A (en) * | 2010-09-28 | 2011-06-01 | 北京大学深圳研究生院 | Video image display control method and video image display device |
| US20120016747A1 (en) * | 2010-07-17 | 2012-01-19 | Yang Pan | System and Method of Delivering Advertising Messages from a Shop Window to a Stop-by Potential Customer |
| US20130229342A1 (en) * | 2010-11-10 | 2013-09-05 | Nec Corporation | Information providing system, information providing method, information processing apparatus, method of controlling the same, and control program |
| CN103295503A (en) * | 2012-03-02 | 2013-09-11 | 鸿富锦精密工业（深圳）有限公司 | Digital bulletin system and digital bulletin method |
| US20150145777A1 (en) * | 2013-11-27 | 2015-05-28 | Shenzhen Huiding Technology Co., Ltd. | Eye tracking and user reaction detection |
| CN105868685A (en) * | 2015-12-29 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Advertisement recommendation method and device based on face recognition |
| CN106575203A (en) * | 2014-08-12 | 2017-04-19 | 微软技术许可有限责任公司 | Hover-based interaction with rendered content |
| CN106997544A (en) * | 2016-01-25 | 2017-08-01 | 秒针信息技术有限公司 | A kind of method and apparatus for monitoring outdoor advertising |
| CN107533357A (en) * | 2014-10-21 | 2018-01-02 | 伊特显示器私人有限公司 | A kind of display device and content display system |
| CN107633066A (en) * | 2017-09-21 | 2018-01-26 | 北京金山安全软件有限公司 | Information display method and device, electronic equipment and storage medium |
| CN207586991U (en) * | 2017-11-29 | 2018-07-06 | 南京甄视智能科技有限公司 | Trade company based on face recognition technology promotes device |
| CN108733429A (en) * | 2018-05-16 | 2018-11-02 | Oppo广东移动通信有限公司 | Method of adjustment, device, storage medium and the mobile terminal of system resource configuration |
| CN109376614A (en) * | 2018-09-29 | 2019-02-22 | 爱笔（北京）智能科技有限公司 | A kind of service providing method and device based on face |
| CN109885164A (en) * | 2019-02-22 | 2019-06-14 | 北京猎户星空科技有限公司 | Smart machine control method, device and storage medium |
| CN109903392A (en) * | 2017-12-11 | 2019-06-18 | 北京京东尚科信息技术有限公司 | Augmented reality method and apparatus |
| CN110322294A (en) * | 2019-07-08 | 2019-10-11 | 秒针信息技术有限公司 | A kind of determination method, apparatus, electronic equipment and the storage medium of audience size |
-
2019
- 2019-12-25 CN CN201911352925.1A patent/CN113032605B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2295378A1 (en) * | 1998-12-31 | 2000-06-30 | Steve Mann | Point of purchase (pop) terminal |
| US20120016747A1 (en) * | 2010-07-17 | 2012-01-19 | Yang Pan | System and Method of Delivering Advertising Messages from a Shop Window to a Stop-by Potential Customer |
| CN102081918A (en) * | 2010-09-28 | 2011-06-01 | 北京大学深圳研究生院 | Video image display control method and video image display device |
| US20130229342A1 (en) * | 2010-11-10 | 2013-09-05 | Nec Corporation | Information providing system, information providing method, information processing apparatus, method of controlling the same, and control program |
| CN103295503A (en) * | 2012-03-02 | 2013-09-11 | 鸿富锦精密工业（深圳）有限公司 | Digital bulletin system and digital bulletin method |
| US20150145777A1 (en) * | 2013-11-27 | 2015-05-28 | Shenzhen Huiding Technology Co., Ltd. | Eye tracking and user reaction detection |
| CN106575203A (en) * | 2014-08-12 | 2017-04-19 | 微软技术许可有限责任公司 | Hover-based interaction with rendered content |
| CN107533357A (en) * | 2014-10-21 | 2018-01-02 | 伊特显示器私人有限公司 | A kind of display device and content display system |
| CN105868685A (en) * | 2015-12-29 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Advertisement recommendation method and device based on face recognition |
| CN106997544A (en) * | 2016-01-25 | 2017-08-01 | 秒针信息技术有限公司 | A kind of method and apparatus for monitoring outdoor advertising |
| CN107633066A (en) * | 2017-09-21 | 2018-01-26 | 北京金山安全软件有限公司 | Information display method and device, electronic equipment and storage medium |
| CN207586991U (en) * | 2017-11-29 | 2018-07-06 | 南京甄视智能科技有限公司 | Trade company based on face recognition technology promotes device |
| CN109903392A (en) * | 2017-12-11 | 2019-06-18 | 北京京东尚科信息技术有限公司 | Augmented reality method and apparatus |
| CN108733429A (en) * | 2018-05-16 | 2018-11-02 | Oppo广东移动通信有限公司 | Method of adjustment, device, storage medium and the mobile terminal of system resource configuration |
| CN109376614A (en) * | 2018-09-29 | 2019-02-22 | 爱笔（北京）智能科技有限公司 | A kind of service providing method and device based on face |
| CN109885164A (en) * | 2019-02-22 | 2019-06-14 | 北京猎户星空科技有限公司 | Smart machine control method, device and storage medium |
| CN110322294A (en) * | 2019-07-08 | 2019-10-11 | 秒针信息技术有限公司 | A kind of determination method, apparatus, electronic equipment and the storage medium of audience size |
Non-Patent Citations (1)
| Title |
|---|
| 张旭: "交互式信息终端与信息精准投放的可行性研究", 《包装工程》, vol. 37, no. 22, pages 20 - 24 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116028002A (en) * | 2023-03-30 | 2023-04-28 | 中国联合网络通信有限公司湖南省分公司 | Display screen data display method and system based on Internet of things |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113032605B (en) | 2023-08-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109918975B (en) | Augmented reality processing method, object identification method and terminal | |
| CN109816441B (en) | Policy pushing method, system and related device | |
| US20240152548A1 (en) | Electronic apparatus for searching related image and control method therefor | |
| CN111142673B (en) | Scene switching method and head-mounted electronic equipment | |
| CN106164959A (en) | Behavior affair system and correlation technique | |
| CN104516501A (en) | Display device and content display method | |
| CN111666898B (en) | Method and device for identifying class to which vehicle belongs | |
| CN104025615A (en) | Interactive streaming video | |
| CN109815409A (en) | A kind of method for pushing of information, device, wearable device and storage medium | |
| CN113900577B (en) | Application program control method and device, electronic equipment and storage medium | |
| CN103985137A (en) | Moving object tracking method and system applied to human-computer interaction | |
| US20200402112A1 (en) | Method and system for gesture-based cross channel commerce and marketing | |
| US11164000B2 (en) | Method and mobile terminal for providing information based on image | |
| CN110837512A (en) | Visitor information management method and device, electronic equipment and storage medium | |
| CN114168644A (en) | Interaction method, equipment and system for exhibition scene | |
| AU2020309094B2 (en) | Image processing method and apparatus, electronic device, and storage medium | |
| CN103886284A (en) | Character attribute information identification method and device and electronic device | |
| JP2017156514A (en) | Electronic signboard system | |
| CN111708944A (en) | Multimedia resource identification method, device, equipment and storage medium | |
| CN111382644A (en) | Gesture recognition method and device, terminal equipment and computer readable storage medium | |
| CN111738736A (en) | Method and system for data feedback | |
| Hegde et al. | Gestar: Real time gesture interaction for ar with egocentric view | |
| CN111435422B (en) | Action recognition method, control method and device, electronic equipment and storage medium | |
| CN113032605B (en) | Information display method, device, equipment and computer storage medium | |
| CN110322262B (en) | Store information processing method and device and store system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |