TWI734464B - Information displaying method based on optical communitation device, electric apparatus, and computer readable storage medium - Google Patents

Abstract

The present invention provides an information displaying method based on optical communication device comprising: obtaining label information via capturing an image from an optical communication device; transmitting a request comprising the label information of the optical communication device to a server; receiving a response comprising an information corresponding to an object which is prepared to display on the display medium from the server; and displaying the object on the displaying medium of the apparatus based on the corresponding information to the object.

Description

Information display method based on optical communication device, electronic equipment, and computer readable recording medium

The present invention belongs to the field of information technology, and in particular relates to an information display method based on an optical communication device realized by using a device with an image acquisition function and corresponding electronic equipment.

The statements in this section are only to provide background information related to the present invention to explain the understanding of the present invention, and such background information does not necessarily constitute the prior art.

With the continuous development of information technology, there are more and more ways of information interaction. In one case, the corresponding information can be pushed to the user according to the user's current location. For example, when the user brings his mobile phone to a certain place, his mobile phone will receive a reminder in the form of SMS or WeChat, etc. Messages, advertisements, promotional information, etc. However, the reception of these information is not initiated by the user, so in many cases it is not of interest to the user and will cause great interference to the user. For the information sender, this information push method based on the location of the user’s mobile phone usually uses wireless signals to determine the approximate location of the user’s mobile phone. Therefore, in many cases, the information sender does not know the relevant information of the user (for example, gender, occupation, age, hobbies, etc.), so that most users who receive the information are not potential target customers of the information sender.

Therefore, it is desirable to provide an information display method initiated by the user.

One aspect of the present invention relates to an information display method based on an optical communication device implemented by using a device with an image acquisition function, including: performing image acquisition on the optical communication device to obtain identification information of the optical communication device; Send a request, the request includes the identification information of the optical communication device; receive a response from the server, the response includes information related to the display object to be presented on the display medium of the device; and based on the display The information related to the object presents the display object on the display medium of the device.

Further, wherein the display object to be presented on the display medium of the device is determined based on the identification information of the optical communication device and the following information: information related to the device or its user; and/or the current time News.

Further, wherein the information related to the display object includes presentation position information of the display object on the display medium of the device.

Further, the above-mentioned information display method further includes: adding a new display object through the display medium of the device, and uploading information related to the new display object to the server.

Further, the above-mentioned information display method further includes: determining the display position of the optical communication device on the display medium of the device; and determining the display of the display object on the device based on the display position of the optical communication device The presentation position on the medium.

Further, wherein the information related to the display object includes presentation position information of the display object on the display medium of the device, and the presentation position information is a relative position relative to the display position of the optical communication device Information, and wherein the determining the presentation position of the display object on the display medium of the device based on the display position of the optical communication device includes: based on the display position of the optical communication device and the relative position information , To determine the presentation position of the display object on the display medium of the device.

Further, wherein the relative position information is determined based on the position of the object in the real world relative to the optical communication device.

Further, the above-mentioned information display method further includes: periodically or instantly re-determining the display position of the optical communication device on the display medium of the device; and updating the display object in the display based on the re-determined display position. The presentation position on the display medium of the device.

Further, the above-mentioned information display method further includes: adding a new display object through the display medium of the device, and uploading information related to the new display object to the server, wherein the information related to the new display object The information includes the relative position relationship between the display position of the new display object and the display position of the optical communication device.

Further, the above-mentioned information display method further includes: determining distance information of the device relative to the optical communication device; and setting the size of the display object presented on the display medium of the device based on the distance information.

Further, the above-mentioned information display method further includes: periodically or instantly re-determining the distance information of the device relative to the optical communication device; and updating the information displayed on the display medium of the device based on the re-determined distance information. Display the size of the object.

Further, wherein the information related to the display object includes position information of the display object in space, and wherein, the information display method further includes: the device obtains its position information and posture information relative to the optical communication device The device presents the display object on the display medium of the device based on its position information and posture information relative to the optical communication device and the position information of the display object in space.

Further, wherein the position information and posture information of the device relative to the optical communication device are obtained in the following manner: the device collects an image including the optical communication device and analyzes the image to determine its relative position to the optical communication device. Location information and posture information.

Further, the request sent to the server further includes position information and/or attitude information of the device relative to the optical communication device, and wherein the server passes the identification information of the optical communication device and the The position information and/or posture information of the device relative to the optical communication device is used to obtain information related to the display object to be presented on the display medium of the device.

Further, one aspect of the present invention relates to a storage medium in which a computer program is stored, and when the computer program is executed by a processor, it can be used to implement the above method.

Further, one aspect of the present invention relates to an electronic device, including a processor and a memory, the memory stores a computer program, and when the computer program is executed by the processor, it can be used to implement the above method.

By adopting the method of the present invention, the optical tag can be used to provide relevant information to devices within a certain range or their users in a targeted manner, and since the information provision process is initiated by the user, it can avoid causing damage to the user. Disturb or cause discomfort to users.

In order to make the objectives, technical solutions, and advantages of the present invention clearer, the following further describes the present invention in detail through specific embodiments with reference to the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present invention, but not used to limit the present invention.

Optical communication devices are also called optical tags, and these two terms can be used interchangeably in this article. Optical tags can transmit information by emitting different lights. They have the advantages of long recognition distance, loose visible light conditions, and strong directivity. The information transmitted by optical tags can change over time, which can provide large information capacity and flexibility. Configuration capabilities.

The optical tag usually includes a controller and at least one light source, and the controller can drive the light source through different driving modes to transmit different information to the outside. Fig. 1 shows an exemplary optical label 100, which includes three light sources (respectively a first light source 101, a second light source 102, and a third light source 103). The optical label 100 also includes a controller (not shown in FIG. 1), which is used to select a corresponding driving mode for each light source according to the information to be transmitted. For example, in different driving modes, the controller can use different driving signals to control the light emitting mode of the light source, so that when the light label 100 is photographed by a device with an image acquisition function, the image of the light source therein can show Different appearance (for example, different colors, patterns, brightness, etc.). By analyzing the imaging of the light source in the optical label 100, the driving mode of each light source at the moment can be analyzed, so as to analyze the information transmitted by the optical label 100 at the moment.

In order to provide users with corresponding services based on optical tags, each optical tag can be assigned an identification information (ID), which is used to uniquely identify or identify the optical tag by the manufacturer, manager, or user of the optical tag. Label. Generally, the light source can be driven by the controller in the light tag to transmit the identification information outward, and the user can use the device to collect the image of the light tag to obtain the identification information transmitted by the light tag, and thus can access based on the identification information Corresponding services, such as accessing web pages associated with the identification information of the light tag, obtaining other information associated with the identification information (for example, the location information of the light tag corresponding to the identification information), etc. The device mentioned in this article can be, for example, a device with image capture function carried by the user (for example, a mobile phone with a camera, a tablet computer, smart glasses, a smart helmet, a smart watch, etc.), or a device with an image Machines capable of autonomous movement that collect functions (for example, drones, unmanned vehicles, robots, etc.). The device can use the camera on it to perform continuous image acquisition of the optical label to obtain multiple images containing the optical label, and analyze the optical label in each image (or each of the optical labels) through the built-in application program. Light source) to identify the information transmitted by the optical tag.

The optical tag can be installed in a fixed location, and the identification information (ID) of the optical tag and any other information (such as location information) can be stored in the server. In reality, a large number of optical labels can be constructed into an optical label network. Fig. 2 shows an exemplary optical label network. The optical label network includes a plurality of optical labels and at least one server, wherein the information related to each optical label can be stored on the server. For example, the identification information (ID) or any other information of each light tag can be saved on the server, such as service information related to the light tag, description information or attributes related to the light tag, such as location information of the light tag , Physical size information, physical shape information, posture or orientation information, etc. The device can use the identification information of the identified optical label to query the server to obtain other information related to the optical label. The location information of the optical tag can refer to the actual location of the optical tag in the physical world, which can be indicated by geographic coordinate information. The server can be a software program running on a computing device, a computing device, or a cluster composed of multiple computing devices. The optical tag can be offline, that is, the optical tag does not need to communicate with the server. Of course, it can be understood that online optical tags that can communicate with the server are also feasible. The optical tag may also be movable. For example, the optical tag may be installed on a vehicle or a person and move with the vehicle or person.

Figure 3 shows a light tag arranged above a restaurant door. When the user scans the optical tag with the device, the identification information transmitted by the optical tag can be recognized, and the identification information can be used to access corresponding services, for example, to visit the webpage of the restaurant associated with the identification information of the optical tag. The light tags can be deployed in various places as needed, for example, on squares, store facades, restaurants, vehicles, and even people.

When the user uses the device to scan the optical label, based on the obtained optical label identification information, some display objects can be displayed on the display medium of the user device. The display objects can be pictures, texts, emoticons, virtual three-dimensional Objects, an animation, a video, a link to a webpage that can be jumped, etc. The display medium can be, for example, an electronic screen, a screen, etc., but it is not limited to this, and it can be various media that can be used to display information. For example, in some smart glasses, an image containing a display object is projected onto a prism, lens, mirror, etc. through a projector, and finally projected into the human eye. These prisms, lenses, mirrors, etc. are also considered to be display media.

When a device scans the optical tag and recognizes the identification information of the optical tag, the location of the device can be determined to be within the recognition range of the optical tag (for example, within a range of tens of meters around the optical tag). In this way, the server associated with the optical tag can provide some display objects to the devices in the range for presentation on the device in a targeted manner. These display objects can be used for various purposes, such as navigation instructions, information push, commercial promotion, and many more. For example, for the optical label shown in Figure 3, the device for scanning the optical label is usually located in front of the restaurant where the optical label is located. The restaurant’s business hours information, discount activity information, dish information, current queue information, etc., to provide users with the information they need about the restaurant. Moreover, since the action of scanning the light tag is actively initiated by the user, the presentation of related display objects on the user device will not cause interference or discomfort to the user.

Fig. 4 shows an information display method based on optical tags implemented by using a device with image capture function according to an embodiment of the present invention, the method includes:

Step 401: Perform image collection on the optical label to obtain identification information of the optical label.

For example, the device can recognize the identification information transmitted by the optical label by collecting and analyzing the image of the optical label.

Step 402: Use the identification information of the optical tag and the information related to the device or its user to send a request to the server.

After the device recognizes the identification information of the optical label, it can use the identification information together with the information related to the device itself or the user of the device to send a query request to the server to query the display object to be presented on the display medium of the device. The information related to the device itself may be, for example, identification information of the device, model information of the device, configuration information of the device, and the like. The information related to the user of the device may be, for example, the user's identification information, identity information, age information, gender information, occupation information, personal hobby information, and so on.

The information related to the optical tag can be pre-stored at the server, which may include, for example, identification information of the optical tag, location information of the optical tag, relevant information of the owner of the optical tag, and one or more associated with the optical tag. Display related information of the object, etc. The related information of the display object may include, for example, description information of the display object, presentation rule information, presentation time information, and so on. After the server receives the query request from the device, it can determine the display object to be displayed at the device based on the optical label identification information contained in the query request and the information related to the device or its user, and combine it with Related information is sent to the device as a response. When determining the display object to be presented at the device, the server can, for example, select one suitable for the current device or its user from the multiple display objects associated with the optical tag based on the information related to the device or its user. Or multiple display objects. This is very advantageous. For example, in the navigation field, when different users with different destinations use their devices to scan the same light tag, they can show different results on their devices. Indicators (as display objects) to guide these users separately. In one case, if the device user’s information shows that the user is younger, the server can choose to display objects in cartoon form. If the device user’s information shows that the user is older, the server can Select the display object displayed in the traditional form. In one case, if the device user’s information shows that the user’s gender is male, the server can select display objects related to car advertisements, etc. If the device user’s information shows that the user’s gender is female, then The server can select display objects related to cosmetics advertisements and the like. In this way, the required information can be presented to the device or its user in a targeted manner, and a better user experience can be provided to the device or its user.

In one embodiment, the query request sent by the device may not include information related to the device itself or its user. For example, when the device starts the application for the light label or when the user of the device logs in the application, the server can obtain information related to the device itself or its user. In this way, when the user uses the device to scan a certain light When labeling, it is not necessary to include information related to the device or its user in the query request, because the information has already been obtained by the server.

In another embodiment, when the server determines the display object to be displayed on the device, it may not consider the information related to the device or its user. Both present the same display object. In this way, the server does not need to use information related to the device or its user, nor does it need to include the information in the query request.

Step 403: Receive a response from the server, the response including information related to the display object to be presented on the display medium of the device.

The device may receive a response to the query request from the server, and the response includes information related to one or more display objects to be displayed at the device, such as description information of the display object. The description information of the display object is the information used to describe the display object. Based on the description information, the device can present the corresponding display object on its display medium. In one embodiment, the description information of the display object may only be the identification information of the display object. After the device obtains the identification information, it can use the identification information to obtain a presentation update for the display object locally on the device or from a third-party vendor. Detailed description information.

Step 404: Present the display object on the display medium of the device based on the information related to the display object.

After receiving the response, the device can present the corresponding display object on its display medium based on the information related to the display object contained therein. The presentation position of the display object may be, for example, a predetermined position on the display medium of the device, for example, the middle area, the upper left corner, and the upper right corner of the display medium of the device. The predetermined position can be specified by the server and included in the response as information related to the display object. The presentation position of the display object may also be a random position on the display medium of the device. In one embodiment, the display object may be dynamically presented on the display medium of the device, and therefore, a series of presentation positions that change over time on the display medium of the device may be predetermined by the server. In an embodiment, the presentation position of the display object may also be specified by the device.

In some embodiments, after the display object is presented on the display medium of the device, the device or its user can perform operations on the display object to change the attributes of the display object. For example, the device or its user can move the position of the displayed object, change the size or color of the displayed object, add annotations on the displayed object, and so on. In one embodiment, after the device or its user changes the attributes of the displayed object, the modified attribute information of the displayed object can be uploaded to the server. The server can modify its stored information related to the display object based on the modified attribute information. In this way, when other users use their equipment to scan the optical label later, the modified display object can be presented on the display medium of the equipment.

In some embodiments, the user of the device can also manually add display objects on the display medium of the device. For example, the user can use the operation buttons on the device (which can be physical operation buttons, or they can be displayed on the display medium). Virtual operation buttons) to add pictures, text, emoticons, etc. to the display medium of the device. When adding, the user can determine the display position of the added display object. After the user adds a display object, the device can upload information related to the display object to the server. In this way, when other users use their equipment to scan the optical tag later, the display objects added by the previous user can be presented on the display medium of the equipment. In this way, an interactive platform similar to a virtual message board can be realized through light tags. Different users can add different display objects (for example, pictures, text, emoticons, etc.) by scanning light tags, so as to achieve Interaction between different users.

In some cases, it may be desirable to determine the presentation position of the display object based on the display position of the optical label on the display medium of the device. Fig. 5 shows a method for displaying information based on light tags implemented by using a device with image capture function according to another embodiment of the present invention. Some steps in the method are similar to those in Fig. 4, and are not here. Go into details again. The method includes:

Step 501: Perform image collection on the optical label to obtain identification information of the optical label.

Step 502: Use the identification information of the optical tag and the information related to the device or its user to send a request to the server.

As mentioned above, in other embodiments, the request sent by the device may not include information related to the device or its user. The server may obtain information related to the device or its user in other ways, or the server may not obtain the information and does not use the information when determining the display object to be presented on the display medium of the device.

Step 503: Receive a response from the server, the response including information related to the display object to be presented on the display medium of the device.

Step 504: Determine the display position of the optical label on the display medium of the device.

The optical tag usually has a specific structure or shape feature, for example, it contains several light sources arranged in a specific manner, and these specific structure or shape features can be used to determine the imaging position or display position of the optical tag. After the device collects the image containing the optical tag, it can analyze it to determine the imaging area corresponding to the structure or shape feature of the optical tag, and determine the display position of the optical tag on the display medium of the device based on the area. The display position of the optical label on the display medium can be represented by the position information of a point, for example, the position information of the center point of the imaging area of the optical label can be used to indicate the display position of the optical label on the display medium; the optical label is on the display medium The display position of the optical label can also be represented by the position information of multiple points, for example, the display position of the optical label on the display medium can be represented by the position information of multiple points that can define the approximate outline of the imaging area of the optical label; The display position on the display medium can also be represented by the position information of a region; and so on.

Step 505: Based on the information related to the display object and the display position of the light tag, present the display object on the display medium of the device.

After the display position of the optical label on the display medium is determined, the device can determine the presentation position of the display object on the display medium based on the display position of the optical label on the display medium, and then it can be displayed on the display medium of the device. The display object is presented at the presentation position. In one embodiment, the display position of the optical label on the display medium can be directly determined as the presentation position of the display object on the display medium. In another embodiment, a position that has a certain relative positional relationship with the display position of the light label can be determined as the presentation position of the display object on the display medium. For example, 50 images above the display position of the light label can be determined. A certain position at the element is determined as the presentation position of the display object on the display medium. In one embodiment, the relative position relationship between the presentation position of the display object and the display position of the optical label may be determined based on the position of other objects located near the optical label in the real world relative to the optical label. For example, if there is an object above the optical label, and it is desired to present a display object near the imaging position of the object, the presentation position of the display object may be determined to be somewhere above the display position of the optical label.

In an embodiment, the device may also determine the display position of the optical label on the display medium of the device when identifying the identification information of the optical label or at other suitable times. In one embodiment, after the device determines the display position of the light tag through the imaging of the light tag, it can use methods known in the art (for example, a terminal device such as a mobile phone can use its built-in acceleration sensor, Gyroscope, visual odometer, etc.) to track the translation or rotation of the device, and correspondingly determine the display position of the light tag at different subsequent times. In one embodiment, the device may periodically or instantly determine the display position of the optical label on the display medium of the device, for example, the device may determine the current display position of the optical label every 0.1 seconds. In one embodiment, after the display object is presented on the display medium of the device, the device will continue to determine or track the display position of the optical label, and dynamically adjust or change the display position of the display object according to the latest display position of the optical label.

In one embodiment, after the display object is presented on the display medium of the device, the presentation position of the display object can be dynamically adjusted or changed by tracking the translation or rotation of the device. During the translation or rotation of the device, the presentation position of the display object may move out of the field of view of the device. In this case, the display object may no longer be presented. Due to the accuracy problem of the built-in sensor of the device and the lack of texture features in some scenes (for example: dark night with bad light, white wall without texture feature, blue sky, etc.), the existing technology adopts the built-in sensor or vision The method of odometer tracking the position and posture of the device is easy to cause the drift of the displayed object. For example, after a period of translation or rotation of the device, it will be found that the current presentation position of the display object is no longer accurate and deviates. This deviation usually gets worse over time. In order to solve this problem, the device can re-(for example, when the optical label leaves the field of view of the device and then re-enters the field of view of the device, or every certain time when the optical label is kept in the field of view of the device) determine that the optical label is on the display medium of the device And re-determine the display position of the display object on the display medium based on the display position of the light label on the display medium, so as to correct the display of the display object. For example, if the present position of the display object currently presented by the device differs from the newly determined present position or the difference exceeds a preset threshold, the device may present the display object according to the newly determined present position. In this way, the position of the displayed object can be prevented from drifting with the rotation or movement of the device.

In some embodiments, after the user of the device adds a display object to the display medium of the device, the device can determine the relative positional relationship between the display position of the display object and the display position of the light label, and compare the relative position The relationship is uploaded to the server. In this way, when other users use their equipment to scan the optical label later, the display object added by the user can be presented at an appropriate position on the display medium of the equipment according to the relative position relationship.

In some cases, it may be desirable to adjust the size of the display object displayed on the display medium of the device based on the distance between the device and the optical label. For example, when the device is relatively close to the optical label, the size of the display object can be set to compare Large, when the device is far away from the optical label, the size of the display object can be set to be relatively small. In this way, as the user approaches or moves away from the light tag, the size of the display object can be dynamically adjusted accordingly, which will bring a certain sense of reality to the user, as if the display object does exist in the real world scene, thereby improving the user Experience. In addition, when the user is far away from a light tag, one or more other light tags may appear in the field of view of the user device. At this time, the display objects associated with these other light tags may also appear on the display medium of the device. Above, if the size of the display object is always kept large, it will cause the overlapping or interlacing of multiple display objects, thereby affecting the rendering effect, and this problem can be avoided by the above solution. Fig. 6 shows an information display method based on optical tags implemented by using a device with image capture function according to another embodiment of the present invention. Some steps in the method are similar to those in Fig. 4, and are not here. Go into details again. The method includes:

Step 601: Perform image collection on the optical label to obtain identification information of the optical label.

Step 602: Use the identification information of the optical tag and the information related to the device or its user to send a request to the server.

As mentioned above, in other embodiments, the request sent by the device may not include information related to the device or its user. The server may obtain information related to the device or its user in other ways, or the server may not obtain the information and does not use the information when determining the display object to be presented on the display medium of the device.

Step 603: Receive a response from the server, the response including information related to the display object to be presented on the display medium of the device.

Step 604: Determine the distance information of the device relative to the optical tag.

The device can use various methods to determine its distance information relative to the optical tag. In one embodiment, the device can determine the distance information relative to the optical label by acquiring an image including the optical label and analyzing the image. For example, the device can determine the relative distance between the light tag and the recognition device through the image size of the light tag in the image and optional other information (for example, the actual physical size of the light tag, the focal length of the device’s camera) to determine the relative distance between the light tag and the recognition device (the larger the image , The closer the distance; the smaller the image, the farther the distance). The device may use the identification information of the optical label to obtain the actual physical size information of the optical label from the server, or the optical label may have a uniform physical size and store the physical size on the device. In an embodiment, the device can also directly obtain the relative distance between the optical tag and the identification device through a depth camera or binocular camera installed on it. The device can also use any other existing positioning method to determine its distance information relative to the optical tag.

Step 605: Based on the information related to the display object and the distance information, present the display object on the display medium of the device.

The device can set the size of the display object to be displayed based on its distance relative to the light label. For example, the device can scale and adjust the preset size of the display object based on the distance, so as to present a display of an appropriate size on the display medium of the device. object.

In one embodiment, the device can also determine the distance to the optical label when identifying the identification information of the optical label or at other suitable times. In one embodiment, after the device has determined its distance relative to the optical tag through imaging of the optical tag, it can use methods known in the art (for example, a terminal device such as a mobile phone can use its built-in acceleration sensing Detector, gyroscope, visual odometer, etc.) to track the movement of the device, and determine its distance relative to the optical tag at different subsequent times accordingly. In one embodiment, the device can determine its distance relative to the optical tag periodically or instantaneously, for example, the device can determine its distance relative to the optical tag every 0.1 seconds. In one embodiment, after the display object is presented on the display medium of the device, the device will continue to determine or track its distance from the optical tag, and dynamically adjust or change the size of the displayed object according to the distance.

In some cases, it may be expected that the device can display different display objects when scanning the light tag at different times. For example, when the device scans the light tag in the daytime, the display object displayed is different from the device when it scans the light tag in the evening. The display object. To this end, in one embodiment, the server may pre-store information related to one or more display objects associated with the optical tag. The relevant information may include, for example, presentation rule information or presentation time information of the display object, etc. To define the presentation time of each display object. When the server receives the query request sent by the device, it can use the optical label identification information and the current time information included in the query request to determine the display object to be presented on the display medium of the device. In one embodiment, the display object can have a consistent presentation time for all devices or their users. For example, for a light tag installed on the facade of a restaurant, it can be associated with a display object related to restaurant dining information. The presentation time is set to only the meal time, and other display objects are presented at other times. In another embodiment, different presentation times can be set for the display object for different devices or users.

In one embodiment, the information related to the display object includes position information of the display object in space, which may be represented by three-dimensional space coordinates, for example. The position information of the display object in space can be, for example, the position information of the display object relative to the light label (for example, the position information in the coordinate system with the light label as the coordinate origin), or the display object in other coordinate systems ( For example, location information in the location coordinate system or the world coordinate system. The device can obtain its position information and posture information relative to the light tag. Then, the device can display the display object on the display medium of the device based on its position information and posture information relative to the light tag and the position information of the display object in space. . In one embodiment, the device can first obtain the location and posture information of the device in the location coordinate system or the world coordinate system based on its position information and posture information relative to the optical tag and the position and posture information of the optical tag itself, and then, The device can present the display object on the display medium of the device based on the position information and posture information and the position information of the display object in space. The position and posture information of the optical label itself can be inquired through the identification information of the optical label. In the above manner, according to different positions and postures of the device, different display objects can be displayed on the display medium of the device or the display objects can be displayed in different presentation positions or in different presentation postures.

In one embodiment, the device can collect an image including the light tag and analyze the image to determine its position information and posture information relative to the light tag. For example, the device can analyze the imaging size, position, and perspective deformation of the optical tag to determine its position information and posture information relative to the optical tag.

In some cases, when the device uses the identification information of the optical label to query the display object, it may not need to send it all the display objects associated with the optical label, or it may not need to be displayed on the device within the field of view of the device. Instead, it can only present one or more display objects that are suitable for the current position and posture of the device, for example, only display objects located within the device’s field of view and at a moderate distance, or only present in the center area of the device’s field of view Nearby display objects, or only display objects that are not blocked or covered, etc. In addition, if there are many display objects associated with the optical label, when the device uses the identification information of the optical label to query to determine the display object to be superimposed and the superimposition information of the display object, a large amount of information from the server to the device may be involved. Data transfer. For example, the server may need to transmit the description information and superimposition information (for example, superimposed position information, superimposed posture information, superimposed time information), etc. of all displayed objects associated with the optical tag to the device, which will increase the communication burden and increase Delay and affect the user's interactive experience, this problem is particularly serious when there are many display objects or the display objects themselves are more complicated. To this end, in one embodiment, the request sent by the device to the server also includes the position information and/or posture information of the device relative to the optical tag. After that, the server can use the identification information of the optical tag and the device relative to the optical tag. Position information and/or posture information to obtain information related to the display object to be presented on the display medium of the device. In this way, the required real objects can be screened based on the position information and/or posture information of the device relative to the optical tag.

FIG. 7 shows the content displayed on the screen of a mobile phone using the information display method according to an embodiment of the present invention, in which display objects related to the lobby performance information of the Oriental Commercial Building are superimposed on the real scene collected by the mobile phone camera. In order to inform people nearby about the performance.

In an embodiment of the present invention, the present invention can be implemented in the form of a computer program. The computer program can be stored in various computer-readable recording media (for example, hard disk, optical disk, flash memory, etc.), and when the computer program is executed by the processor, it can be used to implement the method of the present invention.

In another embodiment of the present invention, the present invention may be implemented in the form of an electronic device. The electronic device includes a processor and a memory, and a computer program is stored in the memory. When the computer program is executed by the processor, it can be used to implement the method of the present invention.

References herein to "each embodiment", "some embodiments", "one embodiment", or "an embodiment", etc. refer to the specific features, structures, or properties described in connection with the embodiments that are included in In at least one embodiment. Therefore, the appearances of the phrases "in various embodiments", "in some embodiments", "in one embodiment", or "in an embodiment" in various places throughout this document do not necessarily refer to the same Examples. In addition, specific features, structures, or properties can be combined in any suitable manner in one or more embodiments. Therefore, a specific feature, structure, or property shown or described in combination with one embodiment can be combined in whole or in part with the feature, structure, or property of one or more other embodiments without limitation, as long as the combination is not incompatible. Logical or not working. Expressions similar to "according to A", "based on A", "through A" or "using A" appearing in this article mean non-exclusive, that is, "according to A" can cover "only according to A" or Covers "according to A and B" unless specifically stated or clearly known from the context as "only according to A". For clarity in this application, some illustrative operating steps are described in a certain order, but those skilled in the art can understand that each of these operating steps is not indispensable, and some of the steps can be omitted. Or replaced by other steps. These operating steps do not have to be executed sequentially in the manner shown. On the contrary, some of these operating steps can be executed in different sequences according to actual needs, or executed concurrently, as long as the new execution method is not illogical or unable to work.

Thus, several aspects of at least one embodiment of the present invention have been described, and it can be understood that various changes, modifications and improvements can be easily made by those skilled in the art. Such changes, modifications and improvements are intended to be within the spirit and scope of the present invention. Although the present invention has been described through preferred embodiments, the present invention is not limited to the embodiments described here, and also includes various changes and changes made without departing from the scope of the present invention.

100: light label 101: The first light source 102: second light source 103: third light source 401-404: steps 501-505: steps 601-605: steps

Figure 1 is an exemplary optical label in the present invention;

Figure 2 is an exemplary optical label network in the present invention;

Figure 3 is a light label arranged above a restaurant door according to the present invention;

FIG. 4 is an information display method based on optical tags implemented by using a device with an image acquisition function according to an embodiment of the present invention;

FIG. 5 is an information display method based on optical tags implemented by using a device with image capture function according to another embodiment of the present invention;

FIG. 6 is an information display method based on optical tags implemented by using a device with image capture function according to another embodiment of the present invention; and

FIG. 7 shows the content presented on the screen of the mobile phone using the information display method according to an embodiment of the present invention.

401-404: steps

Claims (15)

An information display method based on an optical communication device, comprising: performing image collection on an optical communication device to obtain identification information of the optical communication device; sending a request to a server, the request including the identification information of the optical communication device Receiving a response from the server, the response including information related to the display object to be presented on the display medium of the device, the information related to the display object including the location information of the display object in space; the device Obtain its position information and posture information relative to the optical communication device; and based on the information related to the display object, and the device based on its position information and posture information relative to the optical communication device and the display object in space The location information of the display object is displayed on the display medium of the device. The information display method based on the optical communication device as described in the first item of the patent application, wherein the display object to be displayed on the display medium of the device is determined based on the identification information of the optical communication device and the following information: and Information about the device or its user; and/or current time information. The information display method based on the optical communication device as described in item 1 or item 2 of the scope of patent application, wherein the information related to the display object includes the presentation position information of the display object on the display medium of the device . As described in item 1 or item 2 of the scope of patent application, the information display method based on the optical communication device further includes: adding a new display object through the display medium of the device, and adding information related to the new display object Upload to the server. The information display method based on the optical communication device as described in item 1 or item 2 of the scope of patent application, further includes: determining the display position of the optical communication device on the display medium of the device; and based on the optical communication The display position of the device determines the presentation position of the display object on the display medium of the device. The information display method based on the optical communication device according to the fifth item of the scope of patent application, wherein the information related to the display object includes presentation position information of the display object on the display medium of the device, and the presentation The position information is relative position information relative to the display position of the optical communication device, and wherein the determining the display position of the display object on the display medium of the device based on the display position of the optical communication device includes :base The display position of the optical communication device and the relative position information are used to determine the presentation position of the display object on the display medium of the device. The method for displaying information based on an optical communication device as described in the scope of patent application, wherein the relative position information is determined based on the position of an object in the real world relative to the optical communication device. The information display method based on the optical communication device as described in item 5 of the scope of patent application, further includes: periodically or instantly re-determining the display position of the optical communication device on the display medium of the device; and based on re-determination To update the presentation position of the display object on the display medium of the device. As described in item 5 of the scope of patent application, the information display method based on the optical communication device further includes: adding a new display object through the display medium of the device, and uploading information related to the new display object to the The server, wherein the information related to the new display object includes the relative position relationship between the display position of the new display object and the display position of the optical communication device. The information display method based on an optical communication device as described in item 1 or item 2 of the scope of the patent application further includes: determining the distance information of the device relative to the optical communication device; and The size of the display object presented on the display medium of the device is set based on the distance information. The information display method based on the optical communication device as described in item 10 of the scope of patent application, further includes: periodically or instantly re-determining the distance information of the device relative to the optical communication device; and based on the re-determined distance information To update the size of the display object presented on the display medium of the device. The information display method based on the optical communication device as described in the first item of the scope of patent application, wherein the position information and attitude information of the device relative to the optical communication device are obtained in the following manner: the device collects information including the optical communication device Image and analyze the image to determine its position information and posture information relative to the optical communication device. The information display method based on the optical communication device according to the first item of the scope of patent application, wherein the request sent to the server also includes the position information and/or attitude information of the device relative to the optical communication device, and among them, The server obtains information related to the display object to be presented on the display medium of the device through the identification information of the optical communication device and the position information and/or posture information of the device relative to the optical communication device. A computer-readable recording medium in which a computer program is stored, and when the computer program is executed by a processor, it can be used to implement the method described in any one of claim items 1-13. An electronic device, comprising a processor and a memory, and a computer program is stored in the memory. When the computer program is executed by the processor, it can be used to implement the method according to any one of claim items 1-13 .

Images