CN117631907B - Information display apparatus having image pickup module and information display method - Google Patents

Abstract

The application provides an information display device with a camera module and an information display method, wherein the information display device with the camera module can determine a user needing route guidance by collecting face characteristic information of a plurality of users in a first range of the information display device and matching the face characteristic information with binding information in a server, then generates simple navigation information according to the matched binding information, and displays the simple navigation information in a simple navigation area of a touch display screen, wherein the simple navigation area can display the simple navigation information of the plurality of users at the same time, and the binding information is generated when the user inquires for the first time and determines that navigation is needed; in addition, the touch display screen also comprises a user operation area for a user to operate, so that other users can normally use the device when the simple navigation information is displayed; the scheme not only can provide accurate personalized place guidance for users simply, conveniently, quickly and nearly without sense, but also can be used by multiple people at the same time, and the use efficiency of the scheme is greatly improved.

Description

Information display apparatus having image pickup module and information display method

Technical Field

The present invention relates to the field of image capturing apparatuses, and in particular, to an information display apparatus having an image capturing module and an information display method.

Background

Along with the luxury development of economy, people's life is more and more colorful, and various markets, shopping centers, exhibition halls, amusement parks and the like are more and more, and the channel designs of spacious places and various features bring comfortable and novel experience to people, and people in the channel designs can feel trouble when seeking ways.

Although the existing navigation technology is mature, the existing navigation technology is limited to outdoor road guidance, and the guiding effect on places in the indoor or in the park can not meet the demands of people (weak signals or untimely updating). In order to solve this problem, many venues such as shops, shopping centers, exhibition halls, amusement parks and the like are provided with information display devices such as advertising machines and the like having camera modules inside the venues so as to indicate the distribution of the venues inside the venues.

In the research and practice process of the prior art, the inventor of the present application finds that the place guiding function of the existing information display device is mainly facing the public, but has universality, but the indicated content is relatively general, in most cases, customers or tourists can get lost, that is, the place guiding of the existing scheme is not clear, the guiding effect is poor, and individuation is lacking, and the existing information display device can only be used by a single person, so that the use efficiency is low.

Disclosure of Invention

The embodiment of the invention provides information display equipment with a camera module and an information display method, which not only can provide accurate personalized place guidance for users in a place simply, conveniently, quickly and nearly without sense, improve the guiding effect, but also can be used by multiple people at the same time and greatly improve the use efficiency.

The embodiment of the invention provides information display equipment with a camera module, which comprises the camera module, a front-end processing module, a rear-end processing module and a touch display screen, wherein the touch display screen comprises a simple navigation area positioned at the top of the touch display screen and a user operation area positioned at the bottom of the touch display screen;

The camera module is used for collecting face characteristic information of a plurality of users in a first range of the information display equipment to obtain a plurality of first type characteristic information, sending the plurality of first type characteristic information to the front end processing module, collecting face characteristic information of the users in a second range of the information display equipment to obtain second type characteristic information, and sending the second type characteristic information to the rear end processing module, wherein the second range is smaller than the first range;

the front-end processing module is used for controlling the camera module to acquire a plurality of first type characteristic information in real time, sending the plurality of first type characteristic information to the server for matching, generating simple navigation information according to the matched binding information if the binding information matched with the first type characteristic information exists in the server, and sending the simple navigation information to a simple navigation area for display, wherein the simple navigation information comprises a user number and a route guidance mark;

The back-end processing module is used for generating a navigation route according to the inquiry touch control instruction when the inquiry touch control instruction is received, sending the navigation route to the user operation area for display, controlling the camera module to acquire second-class feature information according to the navigation touch control instruction when the inquiry touch control instruction is received, generating a user number based on the second-class feature information, binding the user number, the second-class feature information and the navigation route to obtain binding information, and sending the binding information to the server;

The simple navigation area is used for simultaneously displaying simple navigation information of a plurality of users;

The user operation area is used for receiving a query touch instruction of a user, sending the query touch instruction to the back-end processing module, receiving a navigation route returned by the back-end processing module based on the query touch instruction, displaying the navigation route, receiving a navigation touch instruction triggered by the user based on the navigation route, and sending the navigation touch instruction to the back-end processing module.

Optionally, in some embodiments of the present application, the camera module includes a monitoring camera and a feature acquisition camera;

the monitoring camera is used for collecting face characteristic information of a plurality of users in a first range of the information display device, obtaining a plurality of first type characteristic information and sending the plurality of first type characteristic information to the front-end processing module;

The feature acquisition camera is used for acquiring face feature information of a user in a second range of the information display device, obtaining second-class feature information, and sending the second-class feature information to the rear-end processing module, wherein the second range is smaller than the first range.

Optionally, in some embodiments of the present application, the front end processing module is further configured to, before generating the simple navigation information according to the matched binding information, determine whether the current position of the user is on a navigation route according to the binding information, if yes, execute an operation of generating the simple navigation information according to the matched binding information, if not, send a route adjustment request to the back end processing module, receive an adjusted navigation route returned by the back end processing module based on the route adjustment request, generate the simple navigation information according to the adjusted navigation route and the user number, and send the simple navigation information to a simple navigation area for display, where the simple navigation information includes the user number and the route guidance identifier;

And the back-end processing module is also used for adjusting the navigation route according to the current position of the user when the route adjustment request is received, so as to obtain an adjusted navigation route.

Optionally, in some embodiments of the present application, the front end processing module is further configured to, after receiving the adjusted navigation route returned by the back end processing module, send the adjusted navigation route to the user operation area if it is determined that the user operation area is not used by a person;

The user operation area is further used for displaying the adjusted navigation route when the adjusted navigation route is received.

Optionally, in some embodiments of the present application, the user operation area is further configured to receive a confirmation update instruction triggered by a user based on the displayed adjusted navigation route, and send the confirmation update instruction to the back-end processing module;

And the back-end processing module is also used for responding to the confirmation updating instruction and updating the navigation route of the corresponding binding information in the server according to the adjusted navigation route.

Optionally, in some embodiments of the present application, the user operation area is further configured to receive a live-action diagram display instruction triggered by a user located in a second range of the information display device, and send the live-action diagram display instruction to a back-end processing module;

the back-end processing module is further used for responding to the live-action image display instruction, acquiring an environment live-action image within a preset range of the current position of the user, and sending the environment live-action image to a user operation area for display.

Optionally, in some embodiments of the present application, the front end processing module is specifically configured to, when determining that binding information matching the first type of feature information exists in the server, extract a user number and a navigation route from the binding information, obtain a setting position and an orientation of the information display device, generate, according to the setting position and the orientation, a direction identifier consistent with the navigation route, obtain a route guidance identifier, and send the route guidance identifier and the user number as simple navigation information to a simple navigation area for display.

Optionally, in some embodiments of the present application, the image capturing module is specifically configured to collect image information within a second range of the information display device, and if a human body image with a front surface facing the information display device exists in the image information, select a human body image closest to the information display device as a target user, collect face feature information of the target user, obtain second type feature information, and send the second type feature information to the back-end processing module.

Optionally, in some embodiments of the present application, the front-end processing module is further configured to start a timer when the simple navigation information is sent to the simple navigation area for display, and stop displaying the simple navigation information in the simple navigation area when the timer expires; and setting survival time for the binding information when the user number, the second type characteristic information and the navigation route are bound, and deleting the binding information when the survival time expires.

Correspondingly, the embodiment of the application also provides an information display method which is applied to the information display equipment with the camera module, wherein the information display equipment is provided with a touch display screen, the touch display screen comprises a simple navigation area positioned at the top of the touch display screen and a user operation area positioned at the bottom of the touch display screen, and the method comprises the following steps:

Responding to a query touch instruction triggered by a user, generating a navigation route according to the query touch instruction, and sending the navigation route to the user operation area for display;

Responding to a navigation touch instruction triggered by a user, acquiring face characteristic information of the user in a second range of the information display equipment to obtain second class characteristic information, generating a user number based on the second class characteristic information, binding the user number, the second class characteristic information and a navigation route to obtain binding information, and transmitting the binding information to a server;

Acquiring face characteristic information of a plurality of users in a first range of the information display equipment to obtain a plurality of first type of characteristic information, wherein a second range is smaller than the first range;

transmitting the plurality of first type characteristic information to a server for matching;

if binding information matched with the first type of characteristic information exists in the server, simple navigation information is generated according to the matched binding information, and the simple navigation information comprises a user number and a route guidance identifier;

and sending the simple navigation information to the simple navigation area for displaying, wherein the simple navigation area is used for simultaneously displaying the simple navigation information of a plurality of users.

It can be seen that, in the embodiment of the present application, the face feature information of a plurality of users in a first range of an information display device having a camera module may be collected and matched with binding information in a server to determine a user needing route guidance, then simple navigation information is generated according to the matched binding information and displayed in a simple navigation area of a touch display screen, where the simple navigation area may display the simple navigation information of the plurality of users at the same time, and the binding information is generated when the user first queries and determines that navigation is needed, and stored in the server; that is, for a user who has requested navigation, the device can provide accurate personalized location guidance to the user without having to do so too much on his way to the target location within the venue; in addition, because the simple navigation information comprises the route guidance identification and the user number, even if the simple navigation area simultaneously displays the simple navigation information of a plurality of users, each user can clearly see the route guidance required by the user according to the user number, namely the equipment can serve the plurality of users at the same time; in addition, the touch display screen comprises a user operation area besides the simple navigation area, so that the original purpose of the device is not influenced when the device provides route guidance for a plurality of users, and the operation of other users on the device, such as inquiry or request navigation, is not influenced, and the practicability and the use efficiency of the device are greatly improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic structural diagram of an information display apparatus having an image capturing module according to an embodiment of the present application;

FIG. 2 is an exemplary diagram of a camera module acquiring facial feature information in an embodiment of the present application;

FIG. 3 is a diagram illustrating the display and operation of a touch display screen in an embodiment of the application;

fig. 4 is a schematic view of a scene of an information display device with an image capturing module according to an embodiment of the present application;

FIG. 5 is a diagram showing an example of an environmental live view of an embodiment of the application;

Fig. 6 is a flowchart of an information display method according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to fall within the scope of the application.

The embodiment of the application provides an information display device with a camera module and an information display method, wherein the information display device with the camera module can be integrated in various types of terminals, such as a personal computer (Personal Computer), a self-service terminal, an advertisement machine, a query machine or a number calling machine, and the like, and the information display device with the camera module is respectively described in detail below.

As shown in fig. 1, an information display apparatus 01 having an image pickup module includes an image pickup module 011, a front-end processing module 012, a rear-end processing module 013, and a touch display screen 014; touch screen 014 includes a simple navigation area at the top of touch screen 014, and a user operation area at the bottom of touch screen 014; wherein:

The camera module 011 is configured to collect facial feature information of a plurality of users within a first range of the information display apparatus 01, obtain a plurality of first type feature information, and send the plurality of first type feature information to the front end processing module 012; and acquiring face characteristic information of the user in a second range of the information display device 01, obtaining second-class characteristic information, and sending the second-class characteristic information to the back-end processing module 013, wherein the second range is smaller than the first range.

The front-end processing module 012 is configured to control the camera module 011 to collect a plurality of first type feature information in real time, and send the plurality of first type feature information to a server for matching, if binding information matched with the first type feature information exists in the server, generate simple navigation information according to the matched binding information, send the simple navigation information to a simple navigation area for display, where the simple navigation information includes a user number and a route guidance identifier.

The back-end processing module 013 is configured to generate a navigation route according to the inquiry touch instruction when the inquiry touch instruction is received, send the navigation route to the user operation area for display, control the camera module 011 to collect second-class feature information according to the navigation touch instruction when the inquiry touch instruction is received, generate a user number based on the second-class feature information, bind the user number, the second-class feature information and the navigation route to obtain binding information, and send the binding information to the server.

The simple navigation area is used for simultaneously displaying simple navigation information of a plurality of users.

The user operation area is configured to receive a query touch instruction of a user, send the query touch instruction to the back-end processing module 013, receive a navigation route returned by the back-end processing module 013 based on the query touch instruction, display the navigation route, receive a navigation touch instruction triggered by the user based on the navigation route, and send the navigation touch instruction to the back-end processing module 013.

The user operation area may also be used for receiving a user number returned by the back-end processing module 013 based on the navigation touch instruction, and displaying the user number.

The query touch instruction carries a target location, and after receiving the query touch instruction, the back-end processing module 013 can generate a navigation route from the current position (the position where the information display device 01 is located) to the target location based on the query touch instruction.

Optionally, the query touch instruction may further include a route location besides the target location, and if the query touch instruction further includes a route location, the back-end processing module 013 may generate the current position (the position where the information display device 01 is located) based on the query touch instruction after receiving the query touch instruction, route the route location, and finally reach the navigation route of the target location.

In addition, it should be noted that, when the image capturing module 011 captures facial feature information, the first range and the second range may be preset according to the requirements of practical applications. For example, taking the specific integration of the information display system 01 into an advertisement machine as an example, as shown in fig. 2, an area with a front radius of 2 to 3 meters may be set as the first range, and an area with a front radius of 1 meter may be set as the second range, with the advertisement machine as the center; for example, in the case where the information display system 01 is specifically integrated in the query machine, the query machine may be taken as the center of the length of one side, the square area within 3 meters immediately in front of the query machine may be taken as the first range, the square area within 1 meter immediately in front of the query machine may be taken as the second range, and the like. Optionally, the first range may include the second range, or may not include the second range, and may specifically be set according to the needs of practical applications.

In particular, when the camera module 011 can acquire the face feature information in the first range and the second range by adopting a camera with a large visual angle, or can acquire the face feature information in the first range and the second range by adopting different cameras. For example, a monitoring camera may be employed to collect facial feature information in a first range, a feature collection camera may be employed to collect facial feature information in a second range, and so on.

That is, the camera module 011 may include a monitoring camera and a feature acquisition camera, as follows:

The monitoring camera is configured to collect facial feature information of a plurality of users within a first range of the information display device 01, obtain a plurality of first type feature information, and send the plurality of first type feature information to the front end processing module 012.

The feature collection camera is configured to collect facial feature information of a user within a second range of the information display device 01, obtain second type feature information, and send the second type feature information to the back-end processing module 013, where the second range is smaller than the first range.

It should be noted that, for convenience of description, in the embodiment of the present application, the face feature information collected in the first range of the information display apparatus 01 is referred to as first type feature information, and the face feature information collected in the second range of the information display apparatus 01 is referred to as second type feature information, and it should be understood that the first type feature information and the second type feature information are both face feature information.

The face feature information may include geometric features of the face, that is, geometric relationships between facial features such as eyes, nose, mouth, and the like, such as distance, area, angle, and the like, and characterization features, that is, global or local features extracted by using gray information of the face image through some algorithms such as local binary pattern (LBP, local Binary Patterns) algorithm, and the like.

Optionally, the setting positions of the monitoring camera and the feature collection camera may be determined according to the requirements of practical applications, for example, the monitoring camera may be set at the top of the advertisement machine, the feature collection camera may be set below the monitoring camera, or the feature collection camera may be set at the front side of the screen of the advertisement machine, or the monitoring camera may be further suspended and set above the advertisement machine in a peripheral manner, and meanwhile, the feature collection camera may be set at the top of the advertisement machine, and so on, which will not be described herein.

Alternatively, in order to facilitate the user operation, the number of users may be limited, for example, if there are multiple users in the second range of the information display apparatus 01, one of the users may be selected as the target user according to a preset policy, where the preset policy may be set according to the requirements of the actual application, for example, the user closest to the information display apparatus 01 may be selected as the target user from multiple users facing the information display apparatus 01 from the front, and so on. I.e. the camera module 011, may specifically be configured to perform the following operations:

And acquiring image information in a second range of the information display device 01, if a human body image with the front face facing the information display device 01 exists in the image information, selecting the human body image closest to the information display device 01 as a target user, acquiring human face characteristic information of the target user, acquiring second type characteristic information, and transmitting the second type characteristic information to a rear-end processing module 013.

Of course, other strategies may be adopted, such as selecting the user closest to the screen of the information display device 01 and closest to the central axis of the screen of the information display device 01 as the target user, etc., which are not described herein.

A specific scenario will be described in detail below as an example.

For example, referring to fig. 3, the touch display 014 includes a simple navigation area at the top and a user operation area at the bottom, wherein the simple navigation area simultaneously displays simple navigation information of a plurality of users, specifically, the arrows in the simple navigation area represent the advancing directions of the respective users, for example, the advancing directions of the users with the user numbers "8001", "8003" and "8023" are rightward, the advancing directions of the users with the user numbers "8004" and "8011" are leftward, the advancing directions of the users with the user numbers "8024" and "8033" are forward, and so on.

When the simple navigation area displays simple navigation information of a plurality of users, for example, referring to fig. 3, taking the case that the user a is currently located in the second range of the advertisement machine a, when the user a needs to query a route reaching the S restaurant, a target location may be input in the user operation area of the touch display screen 014 of the advertisement machine a, for example, "S restaurant" (of course, a route location may also be input) in the "target location" input field, and click on "route query" to trigger a query touch instruction, where the user operation area may send the query touch instruction to the back-end processing module 013, and after receiving the query touch instruction, the back-end processing module 013 generates a navigation route according to the query touch instruction and sends the navigation route to the user operation area for displaying; optionally, the user a may further click on a "start navigation" key in the user operation area to trigger a navigation touch instruction, where the user operation area may send the navigation touch instruction to the back-end processing module 013, and after receiving the navigation touch instruction, the back-end processing module 013 controls the camera module 011 to collect face feature information (i.e. second type feature information) of the user a according to the navigation touch instruction, and generates a user number based on the face feature information, for example, "8045", binds the user number, the face feature information of the user a and the navigation route to obtain binding information, and then sends the binding information to the server, and sends the user number "8045" to the user operation area for display; optionally, the user operation area may also display a route guidance identifier of the current location of the user a, for example, a direction identifier indicating "forward", as shown in fig. 3.

Optionally, the user operation area may also display a corresponding prompt message to instruct the user to perform a subsequent operation, for example, "the notified along-road manager serves as a small host, the in-road manager will indicate a direction for you on the screen, please go forward according to the direction corresponding to the user number of you", so that the user a can obtain the forward direction by looking at the simple navigation message in the simple navigation area of the along-road advertiser screen, so as to quickly reach S restaurant.

For example, referring to fig. 4, when the user a is located in the first range of the advertiser B, the advertiser B may acquire the face feature information of the user a through the camera module 011 to obtain a first type of feature information, and then the front end processing module 012 of the advertiser B sends the first type of feature information to the server to perform matching.

Similarly, when the user a is located in the first range of the advertiser C, the advertiser C may acquire the face feature information of the user a through the camera module 011 to obtain first type feature information, and then the front end processing module 012 of the advertiser C sends the first type feature information to the server to perform matching, after obtaining the matched binding information, the simple navigation information may be generated according to the matched binding information, and the simple navigation information may be sent to the touch display 014 simple navigation area of the advertiser C to display. By analogy, on the way that the user a arrives at the S restaurant, the advertisement machines along the way can display corresponding simple navigation information in the simple navigation area of the touch display screen 014 of the advertisement machines per se, so as to guide the route for the user a.

It should be noted that, when the user performs the operation in the user operation area, the operation of the user does not affect the display of the simple navigation information in the simple navigation area, for example, referring to fig. 3, if during the operation of the user a, the user in the first range of the advertisement machine changes, for example, the user with the user number "8023" has left the first range of the advertisement machine and exceeds the preset time, and the user with the user number "8033" has entered the first range of the advertisement machine, at this time, the simple navigation area may end the display of the simple navigation information of "8023" and display the simple navigation information of "8033", and so on.

Optionally, the front-end processing module 012 may generate the simple navigation information according to the matched binding information in various manners, for example, specifically, the user number and the navigation route may be extracted from the binding information respectively, then the direction identifier of the current position (i.e., the position where the information display device 01 is located) is generated according to the extracted navigation route, the generated direction identifier is the route guidance identifier, and then the route guidance identifier and the user number may be sent as the simple navigation information to the simple navigation area for display.

Alternatively, since there is a possibility that there is a difference in the setting position and orientation of the information display apparatus 01, when generating the direction flag based on the current position, the setting position and orientation of the information display apparatus 01 may also be taken as one of consideration, namely:

the front-end processing module 012 may be specifically configured to, when it is determined that binding information matching the first type of feature information exists in the server, extract a user number and a navigation route from the binding information, obtain a set position and an orientation of the information display device 01, generate, according to the set position and the orientation, a direction identifier consistent with the navigation route, obtain a route guidance identifier, and send the route guidance identifier and the user number as simple navigation information to a simple navigation area for display.

Wherein the "generating a direction identification consistent with the navigation route according to the set position and orientation" may include: and determining the advancing direction of the current position according to the navigation route, and generating a direction mark consistent with the advancing direction according to the set position and the direction.

Optionally, in order to improve the accuracy of the route guidance, when the user route deviates, the navigation route may be adjusted, and then the simple navigation information may be generated based on the adjusted navigation route. Namely:

The front-end processing module 012 is further configured to determine, before generating the simple navigation information according to the matched binding information, whether the current position of the user is on the navigation route according to the binding information, if yes, execute an operation of generating the simple navigation information according to the matched binding information, if no, send a route adjustment request to the back-end processing module 013, receive an adjusted navigation route returned by the back-end processing module 013 based on the route adjustment request, generate the simple navigation information according to the adjusted navigation route and the user number, and send the simple navigation information to the simple navigation area for display;

The back-end processing module 013 is further configured to, when receiving the route adjustment request, adjust the navigation route according to the current position of the user, and obtain an adjusted navigation route.

The simple navigation information includes a user number and a route guidance identifier, that is, when the simple navigation information is generated according to the adjusted navigation route and the user number, the user number is not regenerated, but the original user number is used, so that the route guidance identifier is only generated according to the adjusted navigation route.

Optionally, in order to facilitate the user to know the latest situation of the navigation route in time, after obtaining the adjusted navigation route, the adjusted navigation route may also be displayed to the user, that is, optionally, the front-end processing module 012 may be further configured to perform the following operations:

After receiving the adjusted navigation route returned by the back-end processing module 013, if it is determined that the user operation area is not used by a person, the adjusted navigation route is sent to the user operation area.

The user operation area may also be used to display the adjusted navigation route when the adjusted navigation route is received.

Optionally, in order to improve accuracy and flexibility of the route guidance, besides displaying the adjusted navigation route to the user, related instructions triggered by the user based on the adjusted navigation route, such as an update confirmation instruction, or an update non-update confirmation instruction, etc., may be received. For example, the following may be possible:

The user operation area may be further configured to receive a confirmation update instruction triggered by the user based on the displayed adjusted navigation route, and send the confirmation update instruction to the back-end processing module 013.

The back-end processing module 013 may be further configured to update the navigation route of the corresponding binding information in the server according to the adjusted navigation route in response to the confirmation update instruction.

Or the user operation area may be further configured to receive a confirmation non-update instruction triggered by the user based on the displayed adjusted navigation route, and send the confirmation non-update instruction to the back-end processing module 013.

The back-end processing module 013 may be further configured to not send the adjusted navigation route to the server in response to the confirmation not to update the instruction, that is, to retain the original navigation route of the corresponding binding information in the server, and not to update the navigation route.

Optionally, in order to better guide the user, when the user has a need, more detailed route guide information, such as an environmental live-action diagram, can be provided for the user. For example, the following may be specifically mentioned:

The user operation area may be further configured to receive a live-action image display instruction triggered by a user within the second range of the information display device 01, send the live-action image display instruction to the back-end processing module 013, and display the environmental live-action image when receiving the environmental live-action image returned by the back-end processing module 013.

The back-end processing module 013 is further configured to obtain an environmental live-action diagram within a preset range of the current position of the user in response to the live-action diagram display instruction, and send the environmental live-action diagram to the user operation area for display.

Optionally, in the environmental live-action diagram, a route guidance identifier may also be identified, i.e. the advancing direction may be indicated in the environmental live-action diagram, so as to more clearly guide the route for the user.

For example, as shown in fig. 5, when the user clicks a "live-action" button in the user operation area, a live-action display instruction is triggered, the user operation area sends the live-action display instruction to the back-end processing module 013, and in response to the live-action display instruction, the back-end processing module 013 obtains an environmental live-action image within a preset range of the current position of the user, and sends the environmental live-action image to the user operation area for display, where a forward direction (see a solid arrow direction in fig. 5) may also be indicated.

As can be seen from the environmental live-action diagram displayed in the user operation area of fig. 5, the current position is located at a crossing, and if the current position is based on simple navigation information (the simple navigation information indicates only the approximate advancing direction in a simplified manner), the route is easily shifted due to the error in selection, so that the displayed environmental live-action diagram is used as the supplement of the simple navigation information, and specific route guidance can be given in a very vivid and clear manner, so that the user is prevented from shifting the route.

Optionally, in order to facilitate the user to view, the environmental live-action image displayed in the user operation area may be a 360-degree panorama, which may be moved to view the surrounding environmental information of any position in the preset range, in addition to the surrounding environmental information of the current position.

The user operation area is further used for receiving a screen movement request triggered by a user based on the environment live-action image, wherein the screen movement request indicates a viewing position and a viewing angle, and according to the screen movement request, the environment live-action image taking the viewing position as a viewpoint and the viewing angle as a visual direction is displayed, and optionally, the advancing direction can be indicated in the environment live-action image.

For example, as shown in fig. 5, when the user slides forward in the user operation area, the user operation area can display an environmental live view of the next intersection in front, in which the forward direction (see the solid arrow direction in fig. 5) is also clearly and specifically indicated, in the same way as the current position, avoiding the route deviation of the target object at the next intersection due to the walk deviation.

Optionally, in order to avoid the collision of routes when the user requests different route guidance for multiple times, it may be further configured to delete the original navigation route when the user updates the target location, and generate a new navigation route according to the updated target location, that is, the back-end processing module 013 may be further configured to perform the following operations:

Receiving a target place updating request input by a user, wherein the target place updating request carries an updated target place, deleting a historical navigation route (namely an original navigation route) according to the target place updating request, determining a current position, generating a navigation route of which the current position reaches the updated target place according to the target place updating request, sending the navigation route to the user operation area for display, and updating binding information in a server according to the newly generated navigation route when a navigation touch instruction is received, namely updating the original navigation route in the binding information into the newly generated navigation route.

Optionally, the display of the simple navigation information may be stopped after a preset time, that is, the back-end processing module 013 may be further configured to perform the following operations:

when the simple navigation information is sent to the simple navigation area for display, a timer is started, and when the timer expires, the display of the simple navigation information in the simple navigation area is stopped.

Similarly, after a preset period, the binding information of the user, that is, the back-end processing module 013, may also be set to execute the following operations:

When the user number, the second type characteristic information and the navigation route are bound, the survival time is set for the binding information, and when the survival time expires, the binding information is deleted.

The timer time and the survival time can be set according to the actual application requirement, which is not described herein.

In practice, the information display apparatus 01 can be placed in various places such as malls, shopping malls, exhibition halls, amusement parks, scenic spots, and the like, and particularly can be placed at various intersections in the places.

As can be seen from the above, in the embodiment of the present application, the user who needs to perform route guidance may be determined by collecting the face feature information of multiple users in the first range of the information display device 01 and matching the face feature information with the binding information in the server, and then simple navigation information is generated according to the matched binding information and displayed in the simple navigation area of the touch display screen 014, where the simple navigation area can simultaneously display the simple navigation information of multiple users, and the binding information is generated when the user queries for the first time and determines that navigation is needed and stored in the server; that is, for a user who has requested navigation, the device can provide accurate personalized location guidance to the user without having to do so too much on his way to the target location within the venue; in addition, because the simple navigation information comprises the route guidance identification and the user number, even if the simple navigation area simultaneously displays the simple navigation information of a plurality of users, each user can clearly see the route guidance required by the user according to the user number, namely the equipment can serve the plurality of users at the same time; in addition, since the touch display screen 014 further includes a user operation area in addition to the simple navigation area, the original use of the device is not affected when the device provides route guidance for a plurality of users, and the operation of other users on the device, such as inquiry or request navigation, is not affected, so that the practicability and the use efficiency of the device are greatly improved; in summary, the scheme can provide accurate personalized location guidance for a plurality of users in a place simply, conveniently, quickly and nearly without sense while not affecting the original use function of the equipment as much as possible, and greatly improves the guiding effect and the use efficiency.

Accordingly, the embodiment of the present application further provides an information display method applied to an information display device 01, where the information display device 01 has a touch display screen 014, the touch display screen 014 includes a simple navigation area located at the top of the touch display screen 014 and a user operation area located at the bottom of the touch display screen 014, and the information display method includes:

Acquiring face characteristic information of a plurality of users in a first range of the information display device 01, obtaining a plurality of first type characteristic information, sending the plurality of first type characteristic information to a server for matching, generating simple navigation information according to the matched binding information if the binding information matched with the first type characteristic information exists in the server, wherein the simple navigation information comprises a user number and a route guidance identifier, sending the simple navigation information to a simple navigation area for displaying, and the simple navigation area is used for simultaneously displaying the simple navigation information of the plurality of users.

The binding information is generated when the user inquires for the first time and determines that navigation is needed, namely the information display method can further comprise the following steps:

Responding to a query touch instruction triggered by a user, generating a navigation route according to the query touch instruction, and sending the navigation route to the user operation area for display; responding to a navigation touch instruction triggered by a user, acquiring face characteristic information of the user in a second range of the information display device 01, obtaining second class characteristic information, generating a user number based on the second class characteristic information, binding the user number, the second class characteristic information and a navigation route, obtaining binding information, and sending the binding information to a server; wherein the second range is smaller than the first range.

For example, as shown in fig. 6, the specific flow of the information display method may be as follows:

s101, responding to a query touch instruction triggered by a user, generating a navigation route according to the query touch instruction, and sending the navigation route to the user operation area for display; for example, the following may be specifically mentioned:

The back-end processing module 013 responds to the inquiry touch control instruction triggered by the user, determines the position of the information display device 01, obtains the current position, generates a navigation route of the current position reaching the target place, and sends the navigation route to the user operation area for display.

The query touch instruction carries a target location, optionally, the query touch instruction may further carry a route location, and if the query touch instruction further carries a route location, the back-end processing module 013 may generate a route location of the current location route based on the query touch instruction after receiving the query touch instruction and determining the current location, and finally arrive at a navigation route of the target location.

The number of the route sites may be set according to the actual application requirements, and is not limited herein.

S102, responding to a navigation touch instruction triggered by a user, acquiring face characteristic information of the user in a second range of the information display device 01, obtaining second type characteristic information, and then executing step S103.

For example, face feature information of a user in a second range of the information display apparatus 01 itself (the information display apparatus 01) can be acquired by the image pickup module 011 of the information display apparatus 01, to obtain second-class feature information.

Optionally, in order to facilitate the user operation, the number of people may be limited, for example, if there are multiple users in the second range of the information display device 01, one of the users may be selected as the target user according to a preset policy, where the preset policy may be set according to the requirements of the actual application, for example, the user closest to the information display device 01 may be selected as the target user from multiple users facing the information display device 01 from the front, or the user closest to the screen of the information display device 01 and closest to the central axis of the screen of the information display device 01 may be selected as the target user, which is described in detail in the foregoing embodiments herein.

And S103, generating a user number based on the second type of characteristic information, binding the user number, the second type of characteristic information and the navigation route to obtain binding information, and sending the binding information to the server.

For example, if the user number of the user a is "8045", at this time, the "8045", the face feature information of the user a, and the navigation route of the user a may be specifically bound to obtain binding information, and the binding information may be sent to the server for storage.

Optionally, the utilization ratio of the storage resource may be improved, and a certain survival time may be set for the binding information, that is, after the step of binding the user number, the second type feature information, and the navigation route to obtain the binding information, the information display method may further include:

a survival time is set for the binding information, and the binding information is deleted from the server when the survival time expires.

Optionally, in order to avoid that the route collides when the user requests different route guidance for multiple times, it may be further configured to delete the original navigation route when the user updates the target location, and generate a new navigation route according to the updated target location, that is, the information display method may further include:

Receiving a target place updating request input by a user, wherein the target place updating request carries an updated target place, deleting a historical navigation route (namely an original navigation route) according to the target place updating request, determining a current position, generating a navigation route of which the current position reaches the updated target place according to the target place updating request, sending the navigation route to the user operation area for display, and updating binding information in a server according to the newly generated navigation route when a navigation touch instruction is received.

S104, acquiring face characteristic information of a plurality of users in a first range of the information display device 01, obtaining a plurality of first type characteristic information, and then executing step S105.

For example, face feature information of a plurality of users within a first range of themselves (the information display apparatus 01) can be acquired by the image capturing module 011 of the information display apparatus 01, to obtain a plurality of first-class feature information.

The second range is smaller than the first range, the first range and the second range may be preset according to the requirements of practical applications, and besides the camera module 011 may collect facial feature information in the first range and the second range by using a camera with a large viewing angle, different cameras may also be used to collect facial feature information in the first range and the second range, for example, a monitoring camera may be used to collect facial feature information in the first range, a feature collection camera may be used to collect facial feature information in the second range, and so on, which are described in detail in the foregoing embodiments herein.

S105, the plurality of first type characteristic information is sent to a server to be matched, if binding information matched with the first type characteristic information exists in the server, step S106 is executed, otherwise, if binding information matched with the first type characteristic information does not exist in the server, step S104 is executed in a returning mode.

For example, taking the case that the plurality of first type feature information includes the face feature information of the user a, if the binding information corresponding to the user a is already stored in the server in step S103, at this time, the front-end processing module 012 can match the binding information corresponding to the user a with the face feature information of the user a, so that step S106 can be executed.

S106, generating simple navigation information according to the matched binding information, and then executing step S107, wherein the simple navigation information comprises a user number and a route guidance identifier.

For example, the front-end processing module 012 may extract the user number and the navigation route from the binding information, respectively, and then generate the route guidance identifier of the current location according to the extracted navigation route, and then use the route guidance identifier and the user number as simple navigation information.

Alternatively, since there is a possibility that there is a difference in the setting position and orientation of the information display apparatus 01, when generating the direction identifier based on the current position, the setting position and orientation of the information display apparatus 01 may also be used as one of consideration factors, namely, step "route guidance identifier for generating the current position from the extracted navigation route", specifically:

the setting position and the orientation of the information display device 01 are acquired, and the route guidance mark of the current position is obtained according to the setting position and the orientation and the direction mark consistent with the navigation route.

For example, after the setting position and the direction of the information display apparatus 01 are acquired, the advancing direction of the current position may be determined according to the navigation route, and the route guidance identifier of the current position may be obtained by generating a direction identifier consistent with the advancing direction according to the setting position and the direction.

Optionally, in order to improve the accuracy of the route guidance, when the user route deviates, the navigation route may be adjusted, and then the simple navigation information may be generated based on the adjusted navigation route. That is, before the step of generating the easy navigation information from the matched binding information, the information display method may further include:

The front-end processing module 012 determines whether the current position of the user is on the navigation route according to the binding information, if yes, the step of generating simple navigation information according to the matched binding information is performed, if no, a route adjustment request is sent to the back-end processing module 013, the back-end processing module 013 receives the adjusted navigation route returned by the route adjustment request, and generates simple navigation information according to the adjusted navigation route and the user number, for example, a route guidance identifier (i.e., a direction identifier) of the current position may be specifically generated according to the adjusted navigation route, and then the route guidance identifier and the user number are used as simple navigation information.

Optionally, after receiving the adjusted navigation route returned by the back-end processing module 013, if it is determined that the user operation area is not used by a person, the front-end processing module 012 may further send the adjusted navigation route to the user operation area for the user to view, and receive a related instruction triggered by the user based on the adjusted navigation route, which is specifically referred to the previous embodiments and will not be described herein.

And S107, transmitting the simple navigation information to the simple navigation area for displaying, wherein the simple navigation area is used for simultaneously displaying the simple navigation information of a plurality of users, for example, see fig. 3.

Optionally, the method may further include stopping the display of the simple navigation information after the preset time, that is, after the step of "sending the simple navigation information to the simple navigation area for display", the information display method may further include:

when the simple navigation information is sent to the simple navigation area for display, a timer is started, and when the timer expires, the display of the simple navigation information in the simple navigation area is stopped.

Optionally, in order to better guide the user, when the user has a need, more detailed route guide information, such as an environmental live-action diagram, may be provided for the user, that is, after the step of "send the simple navigation information to the simple navigation area for display", the information display method may further include:

And receiving a live-action diagram display instruction triggered by a user in a second range of the information display device 01, sending the live-action diagram display instruction to a back-end processing module 013, acquiring an environment live-action diagram in a preset range of the current position of the user by the back-end processing module 013 according to the live-action diagram display instruction, and sending the environment live-action diagram to a user operation area for display.

Optionally, in the environmental live-action diagram, a route guidance identifier may also be identified, i.e. the advancing direction may be indicated in the environmental live-action diagram, so as to more clearly guide the route for the user.

Optionally, in order to facilitate the user to view, the environmental live-action image displayed in the user operation area may be a 360-degree panorama, and besides being capable of viewing the surrounding environmental information of the current position, the method may further include:

and receiving a screen movement request triggered by a user based on the environment live-action image, wherein the screen movement request indicates a viewing position and a viewing angle, and displaying the environment live-action image taking the viewing position as a viewpoint and the viewing angle as a visual direction according to the screen movement request, and optionally, indicating a forward direction in the environment live-action image.

As can be seen from the above, in the embodiment of the present application, the user who needs to perform route guidance may be determined by collecting the face feature information of multiple users in the first range of the information display device 01 and matching the face feature information with the binding information in the server, and then simple navigation information is generated according to the matched binding information and displayed in the simple navigation area of the touch display screen 014, where the simple navigation area can simultaneously display the simple navigation information of multiple users, and the binding information is generated when the user queries for the first time and determines that navigation is needed and stored in the server; that is, for a user who has requested navigation, the device can provide accurate personalized location guidance to the user without having to do so too much on his way to the target location within the venue; in addition, because the simple navigation information comprises the route guidance identification and the user number, even if the simple navigation area simultaneously displays the simple navigation information of a plurality of users, each user can clearly see the route guidance required by the user according to the user number, namely the equipment can serve the plurality of users at the same time; in addition, since the touch display screen 014 further includes a user operation area in addition to the simple navigation area, the original use of the device is not affected when the device provides route guidance for a plurality of users, and the operation of other users on the device, such as inquiry or request navigation, is not affected, so that the practicability and the use efficiency of the device are greatly improved; in summary, the scheme can provide accurate personalized location guidance for a plurality of users in a place simply, conveniently, quickly and nearly without sense while not affecting the original use function of the equipment as much as possible, and greatly improves the guiding effect and the use efficiency.

The information display system and the information display method provided by the embodiments of the present application are described in detail, and specific examples are applied to illustrate the principles and embodiments of the present application, and the description of the above embodiments is only used to help understand the method and the core idea of the present application; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, the present description should not be construed as limiting the present application.

Claims (9)

1. The information display device with the camera module is characterized by comprising the camera module, a front-end processing module, a rear-end processing module and a touch display screen, wherein the touch display screen comprises a simple navigation area positioned at the top of the touch display screen and a user operation area positioned at the bottom of the touch display screen;

The camera module is used for collecting face characteristic information of a plurality of users in a first range of the information display equipment to obtain a plurality of first type characteristic information, sending the plurality of first type characteristic information to the front end processing module, collecting face characteristic information of the users in a second range of the information display equipment to obtain second type characteristic information, and sending the second type characteristic information to the rear end processing module, wherein the second range is smaller than the first range;

The front-end processing module is used for controlling the camera module to acquire a plurality of first type characteristic information in real time and transmitting the plurality of first type characteristic information to the server for matching, and if binding information matched with the first type characteristic information exists in the server, when the current position of the user is judged to be on a navigation route according to the binding information, simple navigation information is generated according to the matched binding information, the simple navigation information is transmitted to a simple navigation area for display, and the simple navigation information comprises a user number and a route guidance mark;

The back-end processing module is used for generating a navigation route according to the inquiry touch control instruction when the inquiry touch control instruction is received, sending the navigation route to the user operation area for display, controlling the camera module to acquire second-class feature information according to the navigation touch control instruction when the inquiry touch control instruction is received, generating a user number based on the second-class feature information, binding the user number, the second-class feature information and the navigation route to obtain binding information, and sending the binding information to the server;

The simple navigation area is used for simultaneously displaying simple navigation information of a plurality of users;

The user operation area is used for receiving a query touch instruction of a user, sending the query touch instruction to the back-end processing module, receiving a navigation route returned by the back-end processing module based on the query touch instruction, displaying the navigation route, receiving a navigation touch instruction triggered by the user based on the navigation route, sending the navigation touch instruction to the back-end processing module, receiving a live-action image display instruction triggered by the user in a second range of the information display device, sending the live-action image display instruction to the back-end processing module, and receiving a screen movement request triggered by the user based on an environment live-action image, wherein the screen movement request indicates a viewing position and a viewing angle, and displaying the environment live-action image with the viewing position as a viewpoint and the viewing angle as a visual direction according to the screen movement request;

The back-end processing module is further used for responding to the live-action diagram display instruction, acquiring an environment live-action diagram within a preset range of the current position of the user, sending the environment live-action diagram to a user operation area for display, and indicating the advancing direction in the environment live-action diagram;

and when the simple navigation area displays the simple navigation information of a plurality of users in the first range of the information display equipment, the user operation area receives a query touch instruction of the users in the second range of the information display equipment.

2. The information display apparatus with a camera module according to claim 1, wherein the camera module includes a monitoring camera and a feature collection camera;

the monitoring camera is used for collecting face characteristic information of a plurality of users in a first range of the information display device, obtaining a plurality of first type characteristic information and sending the plurality of first type characteristic information to the front-end processing module;

The feature acquisition camera is used for acquiring face feature information of a user in a second range of the information display device, obtaining second-class feature information, and sending the second-class feature information to the rear-end processing module, wherein the second range is smaller than the first range.

3. The information display apparatus with the camera module according to claim 1, wherein,

The front-end processing module is further configured to send a route adjustment request to the back-end processing module when the current position of the user is not located on the navigation route according to the binding information, receive an adjusted navigation route returned by the back-end processing module based on the route adjustment request, generate simple navigation information according to the adjusted navigation route and the user number, and send the simple navigation information to a simple navigation area for display, where the simple navigation information includes the user number and a route guidance identifier;

And the back-end processing module is also used for adjusting the navigation route according to the current position of the user when the route adjustment request is received, so as to obtain an adjusted navigation route.

4. An information display apparatus having an image pickup module according to claim 3, wherein,

The front-end processing module is further used for sending the adjusted navigation route to the user operation area if the user operation area is determined to be unmanned after receiving the adjusted navigation route returned by the back-end processing module;

The user operation area is further used for displaying the adjusted navigation route when the adjusted navigation route is received.

5. The information display apparatus with the camera module according to claim 4, wherein,

The user operation area is also used for receiving a confirmation update instruction triggered by a user based on the displayed adjusted navigation route and sending the confirmation update instruction to the back-end processing module;

And the back-end processing module is also used for responding to the confirmation updating instruction and updating the navigation route of the corresponding binding information in the server according to the adjusted navigation route.

6. The information display apparatus with an image pickup module according to any one of claims 1 to 5, wherein,

The front-end processing module is specifically configured to, when it is determined that binding information matched with the first type of feature information exists in the server, extract a user number and a navigation route from the binding information, obtain a set position and an orientation of the information display device, generate a direction identifier consistent with the navigation route according to the set position and the orientation, obtain a route guidance identifier, and send the route guidance identifier and the user number as simple navigation information to a simple navigation area for display.

7. The information display apparatus with an image pickup module according to any one of claims 1 to 5, wherein,

The camera module is specifically configured to collect image information in a second range of the information display device, if a human body image with a front surface facing the information display device exists in the image information, select a human body image closest to the information display device as a target user, collect face feature information of the target user, obtain second type feature information, and send the second type feature information to the back-end processing module.

8. The information display apparatus with an image pickup module according to any one of claims 1 to 5, wherein,

The front-end processing module is also used for starting a timer when the simple navigation information is sent to the simple navigation area for display, and stopping displaying the simple navigation information in the simple navigation area when the timer expires; and setting survival time for the binding information when the user number, the second type characteristic information and the navigation route are bound, and deleting the binding information when the survival time expires.

9. An information display method, characterized in that it is applied to an information display device having a camera module, the information display device having a touch display screen including a simple navigation area at the top of the touch display screen and a user operation area at the bottom of the touch display screen, the method comprising:

Responding to a query touch instruction triggered by a user, generating a navigation route according to the query touch instruction, and sending the navigation route to the user operation area for display;

Responding to a navigation touch instruction triggered by a user, acquiring face characteristic information of the user in a second range of the information display equipment to obtain second class characteristic information, generating a user number based on the second class characteristic information, binding the user number, the second class characteristic information and a navigation route to obtain binding information, and transmitting the binding information to a server;

Acquiring face characteristic information of a plurality of users in a first range of the information display equipment to obtain a plurality of first type of characteristic information, wherein a second range is smaller than the first range;

transmitting the plurality of first type characteristic information to a server for matching;

If binding information matched with the first type of characteristic information exists in the server, when the current position of the user is judged to be on a navigation route according to the binding information, simple navigation information is generated according to the matched binding information, and the simple navigation information comprises a user number and a route guidance identifier;

the simple navigation information is sent to the simple navigation area for display, and the simple navigation area is used for simultaneously displaying the simple navigation information of a plurality of users;

receiving a live-action diagram display instruction triggered by a user in a second range of the information display equipment;

Responding to the live-action diagram display instruction, acquiring an environment live-action diagram within a preset range of the current position of a user, and sending the environment live-action diagram to a user operation area for display, wherein the environment live-action diagram indicates the advancing direction;

Receiving a screen movement request triggered by a user based on an environment live-action graph, wherein the screen movement request indicates a viewing position and a viewing angle;

Displaying an environment live-action graph with the viewing position as a view point and the viewing angle as a visual direction according to the screen movement request;

and when the simple navigation area displays the simple navigation information of a plurality of users in the first range of the information display equipment, the user operation area receives a query touch instruction of the users in the second range of the information display equipment.