CN110826376B - Marker identification method and device, terminal equipment and storage medium - Google Patents

Marker identification method and device, terminal equipment and storage medium Download PDF

Info

Publication number
CN110826376B
CN110826376B CN201810911024.0A CN201810911024A CN110826376B CN 110826376 B CN110826376 B CN 110826376B CN 201810911024 A CN201810911024 A CN 201810911024A CN 110826376 B CN110826376 B CN 110826376B
Authority
CN
China
Prior art keywords
marker
brightness
target
image
parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810911024.0A
Other languages
Chinese (zh)
Other versions
CN110826376A (en
Inventor
胡永涛
戴景文
贺杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Virtual Reality Technology Co Ltd
Original Assignee
Guangdong Virtual Reality Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Virtual Reality Technology Co Ltd filed Critical Guangdong Virtual Reality Technology Co Ltd
Priority to CN201810911024.0A priority Critical patent/CN110826376B/en
Priority to PCT/CN2019/100101 priority patent/WO2020030156A1/en
Priority to US16/720,015 priority patent/US11113849B2/en
Publication of CN110826376A publication Critical patent/CN110826376A/en
Application granted granted Critical
Publication of CN110826376B publication Critical patent/CN110826376B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/24—Aligning, centring, orientation detection or correction of the image
    • G06V10/245—Aligning, centring, orientation detection or correction of the image by locating a pattern; Special marks for positioning

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)

Abstract

The embodiment of the application discloses a marker identification method, a marker identification device, terminal equipment and a storage medium, and relates to the technical field of display. The marker identification method is applied to terminal equipment, and comprises the following steps: when the marker is identified, acquiring target parameters, wherein the target parameters are used for adjusting imaging parameters of the marker; adjusting the imaging parameters based on the target parameters; acquiring a marker image containing the marker according to the adjusted imaging parameters; identifying the marker based on the marker image. The method can improve the accuracy of the identification of the marker.

Description

Marker identification method and device, terminal equipment and storage medium
Technical Field
The present application relates to the field of display technologies, and in particular, to a marker identification method, apparatus, terminal device, and storage medium.
Background
In recent years, with the progress of science and technology, technologies such as Augmented Reality (AR) have become hot spots of research at home and abroad, and Augmented Reality is a technology for increasing the perception of a user to the real world through information provided by a computer system, in which a virtual object generated by a computer, a scene, or a content object such as system prompt information is superimposed on a real scene to enhance or modify the perception of the real world environment or data representing the real world environment.
In most cases, when the virtual content is displayed by using the terminal device, the virtual content is displayed according to the identification result of the marker after the marker acquired image is identified. However, when affected by imaging factors, the accuracy of the result recognized by the terminal device from the acquired marker image will be affected.
Disclosure of Invention
The embodiment of the application provides a marker identification method, a marker identification device, terminal equipment and a storage medium, and the marker identification accuracy can be improved.
In a first aspect, an embodiment of the present application provides a marker identification method, which is applied to a terminal device, and the method includes: when the marker is identified, acquiring target parameters, wherein the target parameters are used for adjusting imaging parameters of the marker; adjusting the imaging parameters based on the target parameters; acquiring a marker image containing the marker according to the adjusted imaging parameters; identifying the marker based on the marker image.
In a second aspect, an embodiment of the present application provides a marker identification apparatus, which is applied to a terminal device, and the apparatus includes: the system comprises a parameter acquisition module, a parameter adjustment module, an image acquisition module and an image identification module, wherein the parameter acquisition module is used for acquiring target parameters for adjusting imaging parameters of marker imaging when a marker is identified; the parameter adjusting module is used for adjusting the imaging parameters based on the target parameters; the image acquisition module is used for acquiring a marker image containing the marker according to the adjusted imaging parameters; the image recognition module is configured to recognize the marker based on the marker image.
In a third aspect, an embodiment of the present application provides a terminal device, including: one or more processors; a memory; one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the marker identification method provided in the first aspect above.
In a fourth aspect, an embodiment of the present application provides a storage medium, where a program code is stored in the computer-readable storage medium, and the program code may be called by a processor to execute the marker identification method provided in the first aspect.
According to the scheme, when the terminal equipment identifies the marker in the real scene, the target parameter used for adjusting the imaging parameter of the marker is acquired, then the imaging parameter is adjusted based on the target parameter, the marker image containing the marker is acquired according to the adjusted imaging parameter, and finally, the identification result of the marker is acquired based on the image of the marker, so that the adjustment of the imaging parameter when the marker is identified can be realized, and the accuracy of the identification result of the acquired marker image is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 shows a schematic diagram of an application scenario suitable for use in an embodiment of the present application.
FIG. 2 shows a flow chart of a marker identification method according to one embodiment of the present application.
FIG. 3 shows a flow chart of a marker identification method according to another embodiment of the present application.
FIG. 4 shows a flow chart of a marker identification method according to yet another embodiment of the present application.
FIG. 5 shows a flow chart of a marker identification method according to yet another embodiment of the present application
FIG. 6 shows a block diagram of a marker identification device according to one embodiment of the present application.
Fig. 7 is a block diagram of a terminal device for executing a marker identification method according to an embodiment of the present application.
Fig. 8 is a storage unit for storing or carrying a program code implementing a marker identification method according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
In most application scenarios of the augmented reality technology, a marker is set in the application scenario, and the marker is used for displaying virtual content. When the terminal equipment displays the virtual content, the camera and other image acquisition devices of the terminal equipment are used for imaging the marker, then the information of the marker is identified according to the imaging to obtain an identification result, and the virtual content is displayed according to the identification result.
When the marker is identified by the terminal equipment, the marker is influenced by imaging factors when an image is collected, so that the collected image is not enough or too high in brightness, the characteristic points in the image are not easy to distinguish, and the identification result of the collected marker image is influenced. For example, when the terminal device is closer to or farther from the marker, due to different imaging luminances at different distances, the luminance of the acquired marker image is lower or higher, so that feature points in the marker image are not easily distinguished, and the accuracy of the result of the marker image recognition by the terminal device is reduced. When the subsequent terminal device displays the virtual content according to the identification result of the marker, the display position or the content of the virtual content is inaccurate, and the watching experience of the user is influenced.
In view of the above problems, the inventors have studied and proposed a marker identification method, an apparatus, a terminal device and a storage medium provided in the embodiments of the present application for a long time, so as to improve the accuracy of the terminal device in identifying a marker, and further enable the content displayed by the terminal device to be accurate.
An application scenario of the marker identification method provided in the embodiment of the present application is described below.
Referring to fig. 1, a schematic view of an application scenario of the marker identification method provided in the embodiment of the present application is shown, where the application scenario includes a display system 10. The display system 10 includes: a terminal device 100 and a tag 200.
In the embodiment of the present application, the marker 200 may be disposed within the visual field of the terminal device 100, so that the terminal device 100 may capture an image of the marker 200 and identify the marker 200.
In the embodiment of the present application, the terminal device 100 may be a head-mounted display device, or may be a mobile device such as a mobile phone and a tablet. When the terminal device 100 is a head-mounted display device, the head-mounted display device may be an integrated head-mounted display device. The terminal device 100 may also be an intelligent terminal such as a mobile phone connected to an external head-mounted display device, that is, the terminal device 100 may be inserted or connected to the external head-mounted display device as a processing and storage device of the head-mounted display device, and perform a display function on a virtual object in the head-mounted display device.
In the embodiment of the present application, the marker 200 is placed within the field of view of the image capturing device of the terminal device 100, i.e., the image capturing device can capture an image of the marker 200. The image of the marker 200 is stored in the terminal device 100, and is used for positioning the spatial position of the terminal device 100 relative to the marker 200, identifying the identity information of the marker 200, and the like.
The marker 200 may be a marker image including at least one shaped sub-marker, a polyhedral marker including at least two markers distributed on different planes, or an object which is formed by a light spot and can emit light. Of course, the specific tag 200 is not limited in the embodiment of the present application, and the tag only needs to be recognized by the terminal device 100 as the tag 200.
Referring to fig. 2, an embodiment of the present application provides a tag identification method, which is applicable to a terminal device, and the method may include:
step S110: when the marker is identified, a target parameter is obtained, and the target parameter is used for adjusting the imaging parameter of the marker.
When the terminal device identifies the marker, the marker is imaged in the identification process, and the marker is affected by the imaging conditions, so that the marker is inaccurately identified. The reason why the identification of the marker is inaccurate is that the feature points in the acquired image of the marker are not easily distinguished due to the conditions during imaging, so that the accuracy of the finally identified information of the marker is insufficient.
Therefore, the characteristic points in the images of the markers acquired by the subsequent terminal equipment can be more easily distinguished by adjusting the imaging parameters of the markers. The imaging parameters may be the light source brightness of the terminal device, or the brightness of the marker itself, and these imaging parameters may affect the distinction of the feature points in the acquired marker image. Of course, in the embodiment of the present application, the specific imaging parameter may not be limited, and may also be other imaging parameters, for example, a size of an aperture of an image capturing device of the terminal device, an exposure time, and other parameters that may affect the brightness of the captured marker image.
In the embodiment of the application, the imaging parameters for imaging the marker can be adjusted according to some target parameters when the marker is identified. The target parameter may be a parameter related to the imaging parameter, such as a distance between the marker and the terminal device, an image feature in an image acquired by the marker with the current imaging parameter, and the like. Of course, in the embodiment of the present application, the specific target parameter may not be limited, and may also be other parameters, for example, the brightness of the ambient light and the like, which may obtain the brightness of the acquired marker image.
First, the terminal device may acquire a target parameter that adjusts an imaging parameter of the marker. In the embodiment of the present application, the target parameter may be obtained by a sensor or by recognizing an image. For example, when the target parameter is the distance between the terminal device and the marker, the sensor may detect the distance between the marker and the terminal device, so as to obtain the target parameter. For another example, when the target imaging parameter is an image feature in an image, the target parameter can be obtained by identifying the marker image to obtain the image feature. Of course, the specific manner of obtaining the target parameters is not limited in the embodiments of the present application, and may be selected according to the content of the specific target parameters.
Step S120: the imaging parameters are adjusted based on the target parameters.
After the target parameters are obtained, the imaging parameters can be adjusted according to the target parameters, that is, the light source brightness of the terminal device or the brightness of the marker itself is adjusted, so that feature points in images of the marker which can be acquired later are easy to distinguish.
In the embodiment of the present application, the imaging parameter is adjusted according to the target parameter, and may be adjusted according to the corresponding relationship between the imaging parameter and the target parameter, or the imaging parameter is increased or decreased to the target size according to the relationship between the imaging parameter and the preset threshold. For example, when the imaging parameter is the light source brightness of the terminal device or the brightness of the marker itself, and the target parameter is the distance of the marker from the terminal device, the brightness is adjusted according to the relationship that the brightness is proportional to the distance of the marker from the terminal device.
It can be understood that, whether the brightness of the acquired marker image is normal or not can be known according to the target parameter, therefore, when the brightness of the acquired marker image is higher according to the target parameter, the imaging parameter can be adjusted, for example, the brightness of the light source or the brightness of the marker itself is reduced, so that the brightness of the acquired marker image is reduced to a normal range; when it is known from the target parameters that the brightness of the acquired marker image is low, the imaging parameters may be adjusted, for example, the brightness of the light source or the brightness of the marker itself may be increased, so as to increase the brightness of the acquired marker image to the normal range.
Therefore, the imaging parameters of the marker can be adjusted according to the obtained target parameters, so that the brightness of the subsequently acquired marker image is normal, the feature points in the marker can be distinguished conveniently, and the accuracy of marker image identification is improved.
Step S130: and acquiring a marker image containing the marker according to the adjusted imaging parameters.
In the embodiment, the marker may include at least one sub-marker, and the sub-marker may be a pattern having a certain shape. In one embodiment, each sub-marker may have one or more feature points, wherein the shape of the feature points is not limited, and may be a dot, a ring, a triangle, or other shapes. In addition, the distribution rules of the sub-markers in different markers are different, so each marker can have different identity information, and the terminal device can acquire the identity information corresponding to the marker by identifying the sub-markers included in the marker, wherein the identity information can be information that can be used for uniquely identifying the marker, such as codes, but is not limited thereto.
In one embodiment, the outline of the marker may be rectangular, but the shape of the marker may be other shapes, and the rectangular region and the plurality of sub-markers in the region constitute one marker.
Of course, the marker may also be an object which is composed of a light spot and can emit light, the light spot marker may emit light of different wavelength bands or different colors, and the terminal device acquires the identity information corresponding to the marker by identifying information such as the wavelength band or the color of the light emitted by the light spot marker. Of course, the specific marker is not limited in the embodiment of the present application, and the marker only needs to be recognized by the terminal device.
In the embodiment of the application, after the imaging parameter of the marker is adjusted according to the target parameter, the marker can be subjected to image acquisition according to the adjusted imaging parameter, so that a marker image containing the marker is obtained.
Step S140: based on the marker image, the marker is identified.
After the marker image of the marker is obtained, the marker image can be identified, and after the characteristic point in the marker image is identified, an identification result for identifying the marker can be obtained, wherein the identification result comprises the spatial position of the marker relative to the terminal equipment, the identity information for identifying the marker and the like. The spatial position may include a position of the marker relative to the terminal device, posture information, and the like, where the posture information is an orientation and a rotation angle of the marker relative to the terminal device.
Because the brightness of the marker image acquired according to the adjusted imaging parameters is normal, the feature points of the marker are easy to distinguish, so that the identification precision is high when the feature points in the marker image are identified, and the accuracy of the identification result is improved.
According to the marker identification method provided by the embodiment of the application, when the terminal equipment identifies the marker, the target parameter used for adjusting the imaging parameter of the marker is obtained, then the imaging parameter is adjusted based on the target parameter, and then the marker image is obtained according to the adjusted imaging parameter.
Referring to fig. 3, another embodiment of the present application provides a tag identification method, which can be applied to a terminal device, and the method can include:
step S210: when the marker is identified, the distance of the marker from the terminal device is acquired, and the distance is used as a target parameter for adjusting the imaging parameter of the marker.
In the embodiment of the present application, the target parameter for adjusting the imaging parameter of the marker may be a distance of the marker relative to the terminal device. It can be understood that when the distances of the markers from the terminal device are different, the images of the markers are acquired by using the same imaging parameters of the markers, so that the brightness of the acquired images of the markers is different, and therefore, when the terminal device identifies the markers, the distances of the markers from the terminal device can be acquired, and the distances are used as target parameters for adjusting the imaging parameters of the markers.
In this embodiment of the present application, obtaining the distance between the marker and the terminal device may include: acquiring a first image of the marker according to the current imaging parameters, and acquiring the distance of the marker relative to the terminal equipment based on the first image; or acquiring the distance of the marker relative to the terminal equipment by using a distance sensor of the terminal equipment.
It can be understood that the terminal device obtains the distance between the marker and the terminal device, the marker can be identified by using the current imaging parameters, the identification result of the marker is preliminarily obtained, and the distance between the marker and the terminal device is obtained according to the position of the marker relative to the terminal device in the identification result of the marker.
Therefore, under the current brightness of the light source or the brightness of the marker, the marker can be subjected to image acquisition to obtain a first image containing the marker, then the first marker is identified to obtain the position information of the marker relative to the terminal equipment, and the distance of the marker relative to the terminal equipment can be obtained according to the position information of the marker relative to the terminal equipment.
In addition, the distance of the marker from the terminal device may be obtained by detecting the distance of the marker from the terminal device by a sensor of the terminal device in accordance with the operation of the terminal device by the user. The sensor may be a distance sensor.
Of course, the sensor for detecting the distance between the marker and the terminal device is not limited in the embodiment of the present application, and may be other sensors, such as a proximity sensor and an ultrasonic sensor.
Therefore, the distance of the marker relative to the terminal equipment can be acquired for adjusting the imaging parameters of the marker subsequently.
Step S220: the imaging parameters are adjusted based on the target parameters.
In the embodiment of the application, after the distance from the marker to the terminal device is obtained, the current imaging parameter may be adjusted according to the distance from the marker to the terminal device, and then the marker image including the marker is acquired again according to the adjusted imaging parameter, so as to identify the marker, and obtain the identification result.
As an embodiment, the imaging parameter may include a light source brightness of the terminal device. Adjusting the imaging parameters based on the target parameters may include:
acquiring light source target brightness corresponding to the distance; and adjusting the light source brightness of the terminal equipment to the light source target brightness.
It can be understood that, when the imaging parameter is the light source brightness of the terminal device, the light source brightness can be adjusted according to the distance between the marker and the terminal device. When the distance of the marker relative to the terminal device is different, the marker can be imaged by utilizing different light source brightness, so that the brightness of the imaged marker image is normal. Specifically, the light source target brightness corresponding to the distance may be searched according to the distance between the marker and the terminal device. The light source can be a visible light source or an invisible light source such as infrared light source, when the image acquisition device of the terminal equipment is an infrared camera and acquires an infrared image containing a marker through the infrared camera, the brightness of the infrared light source can be adjusted to acquire the image.
In the embodiment of the present application, the distance between the marker and the terminal device and the brightness of the light source may be stored in the terminal device in the form of a correspondence table. When the light source target brightness to be adjusted is obtained according to the distance between the marker and the terminal device, the correspondence table may be read, and then the light source target brightness corresponding to the distance between the marker and the terminal device is found. Of course, the relationship between the distance of the marker from the terminal device and the light source target brightness in the correspondence table should satisfy the relationship that the light source target brightness is proportional to the distance, that is, the greater the distance of the marker from the terminal device, the greater the light source target brightness.
In addition, a calculation function of the distance between the marker and the terminal device and the light source brightness may be established and stored in the terminal device. And when the terminal equipment acquires the light source brightness corresponding to the distance between the marker and the terminal equipment, substituting the distance into the calculation function to obtain the light source target brightness corresponding to the distance. Of course, the corresponding relationship between the distance and the light source brightness in the function should also satisfy the relationship that the target brightness of the light source is in direct proportion to the distance, that is, the greater the distance of the marker relative to the terminal device, the greater the target brightness of the light source.
The distance between the marker and the terminal device may be compared with a preset distance, when the distance between the marker and the terminal device is greater than a first preset distance, the brightness of the light source is increased to a target brightness, when the distance between the marker and the terminal device is less than a second preset distance, the brightness of the light source is decreased to another target brightness, and when the distance between the marker and the terminal device is between the first preset distance and the second preset distance, the brightness of the light source may not be adjusted.
And after the target brightness of the light source to be adjusted is obtained, adjusting parameters corresponding to the light source brightness so as to adjust the light source brightness of the terminal equipment to the target brightness of the light source.
As another embodiment, the imaging parameters may include brightness of the marker, and the adjusting of the imaging parameters based on the target parameters includes:
acquiring the target brightness of the marker corresponding to the distance; and generating a first control signal based on the target brightness of the marker, and sending the first control signal to the marker, wherein the first control signal is used for instructing the marker to adjust the brightness of the marker to the target brightness of the marker.
It will be appreciated that where the marker is an object which itself may emit light, consisting of a light spot, the imaging parameter may be the brightness of the marker. Therefore, the brightness of the marker can be adjusted according to the distance of the marker relative to the terminal equipment. When the distance of the marker relative to the terminal device is different, the brightness of the marker can be controlled to be different, so that the brightness of the imaged marker image is normal. Specifically, the target brightness of the marker corresponding to the distance may be searched for according to the distance between the marker and the terminal device.
In the embodiment of the present application, the distance of the marker from the terminal device and the brightness of the marker may be stored in the terminal device in the form of a correspondence table. When the target brightness of the marker to be adjusted is obtained according to the distance between the marker and the terminal device, the correspondence table may be read, and then the target brightness of the marker corresponding to the distance between the marker and the terminal device is found. Of course, the relationship between the distance of the marker from the terminal device and the brightness of the marker in the correspondence table should satisfy the relationship that the brightness of the marker is proportional to the distance, that is, the greater the distance of the marker from the terminal device, the greater the brightness of the marker.
A calculation function of the distance between the marker and the terminal equipment and the brightness of the marker can also be established, and the calculation function is stored in the terminal equipment. And when the terminal equipment acquires the marker brightness corresponding to the distance between the marker and the terminal equipment, substituting the distance into the calculation function to obtain the marker brightness corresponding to the distance. Of course, the correspondence between the distance and the brightness of the marker in the function should also satisfy the relationship that the target brightness of the marker is proportional to the distance, that is, the greater the distance of the marker relative to the terminal device, the greater the brightness of the marker.
The distance between the marker and the terminal device can be compared with a preset distance, when the distance between the marker and the terminal device is larger than a first preset distance, the brightness of the marker is increased to be one target brightness, when the distance between the marker and the terminal device is smaller than a second preset distance, the brightness of the marker is reduced to be another target brightness, and when the distance between the marker and the terminal device is between the first preset distance and the second preset distance, the brightness of the marker can not be adjusted.
In an embodiment of the application, a communication connection between the terminal device and the marker may be established. After the target brightness of the marker to be adjusted is obtained, a first control signal corresponding to the target brightness of the marker can be generated, and the first control signal is sent to the marker. After the marker receives the first control signal, the parameter corresponding to the marker brightness can be adjusted in response to the first control signal, so that the marker brightness is adjusted to the target marker brightness.
Therefore, the light source brightness or the marker brightness can be adjusted, imaging is carried out according to the adjusted light source brightness or the adjusted marker brightness subsequently, the brightness of the subsequently collected marker image can be normal, the feature points in the marker can be distinguished conveniently, and the marker image identification accuracy is improved.
Step S230: and acquiring a marker image containing the marker according to the adjusted imaging parameters.
In the embodiment of the present application, after the light source brightness or the marker brightness is adjusted according to the distance between the marker and the terminal device, the marker may be image-captured according to the adjusted light source brightness or marker brightness, so as to obtain a marker image including the marker.
Step S240: based on the marker image, the marker is identified.
After the marker image of the marker is obtained, the marker image can be recognized, and a recognition result of recognizing the marker can be obtained. Because according to the adjusted light source brightness or marker brightness, the brightness of the collected marker image is normal, and the characteristic points of the marker are easy to distinguish, the identification precision is high when the characteristic points in the marker image are identified, and the accuracy of the identification result is improved.
In the embodiment of the present application, when the target parameter is the distance of the marker from the terminal device, the imaging parameter such as the exposure time or the aperture size may be adjusted according to the distance of the marker from the terminal device. For example, the exposure time of the image capturing device may be adjusted according to the relationship that the larger the distance between the marker and the terminal device is, the larger the exposure time of the image capturing device is; for example, the aperture size of the image capturing device may be adjusted in accordance with the relationship that the larger the distance between the marker and the terminal device, the larger the aperture size of the image capturing device.
According to the marker identification method provided by the embodiment of the application, when the terminal equipment identifies the marker, the distance between the marker and the terminal equipment is obtained, then the light source brightness or the marker brightness is adjusted based on the distance between the marker and the terminal equipment, and then the marker image is obtained according to the adjusted light source brightness or the marker brightness.
Referring to fig. 4, another embodiment of the present application provides a tag identification method, which can be applied to a terminal device, and the method can include:
step S310: upon identification of the marker, a second image of the marker is acquired based on the current imaging parameters.
In embodiments of the present application, a marker may include at least one first feature region and a second feature region.
As an embodiment, the marker may comprise several sub-markers, each having one or more feature points. The sub-marker is a pattern with a certain shape, and the sub-marker can be formed by one or more characteristic points, the shape of the characteristic points is not limited, and the characteristic points can be round points, circular rings, triangles or other shapes. The color of the different feature points may be different, and specifically, the color of the feature point may include white and black, and the first feature region may be a black feature point in the marker, and the second feature region may be a white feature point in the marker. In addition, in the marker, the size of each of the white feature points and the black feature points may be the same, and the ratio of the number of the white feature points to the number of the black feature points may be a fixed ratio.
When the brightness of the acquired marker images is different due to different imaging parameters, the ratio of the number of the first feature regions to the number of the second feature regions is different, that is, the ratio of the number of the first feature regions to the number of the second feature regions identified from the second image acquired according to the current imaging parameters may not be the fixed ratio, and thus, the identification result may be inaccurate.
When the first characteristic region is a black characteristic point and the second characteristic region is a white characteristic point, when the brightness of the marker image exceeds a normal value, the number of the recognizable black characteristic points is less, the ratio of the number of the first characteristic regions to the number of the second characteristic regions is smaller than the fixed ratio, when the marker image is lower than the normal value, the number of the recognizable white characteristic points is less, and the ratio of the number of the first characteristic regions to the number of the second characteristic regions is larger than the fixed ratio.
Therefore, in the embodiment of the present application, a ratio of the number of the first characteristic regions to the number of the second characteristic regions, which is identified according to the second image acquired by the current imaging parameter, may be used as a target parameter for adjusting the imaging parameter.
Step S320: and acquiring a first ratio of the number of the first characteristic regions to the number of the second characteristic regions in the second image, and taking the first ratio as a target parameter for adjusting the imaging parameter of the marker.
After the second image of the marker is obtained according to the current imaging parameters, the second image can be identified, and the number of the first characteristic regions and the number of the second characteristic regions can be identified. When the first feature region is a black feature point and the second feature region is a white feature point, the number of black feature points and the number of white feature points can be obtained.
Then, a first ratio of the number of the first characteristic regions to the number of the second characteristic regions is calculated, and the first ratio is used as a target parameter for adjusting the imaging parameter.
Step S330: the imaging parameters are adjusted based on the target parameters.
In this embodiment of the application, after the first ratio of the number of the first feature regions to the number of the second feature regions is obtained, the imaging parameter of the marker may be adjusted according to the first ratio.
As an embodiment, the imaging parameter may include a light source brightness of the terminal device. Adjusting the imaging parameters based on the target parameters may include:
if the first ratio is larger than the ratio threshold, increasing the light source brightness of the terminal equipment to a first target brightness; and if the first ratio is smaller than the ratio threshold value, reducing the light source brightness of the terminal equipment to a second target brightness.
It can be understood that, when the imaging parameter is the light source brightness of the terminal device, the light source brightness may be adjusted according to a first ratio of the number of the first feature regions to the number of the second feature regions. When the first ratio of the number of the first characteristic regions to the number of the second characteristic regions is different, the marker may be imaged with different light source brightness, so that the brightness of the imaged marker image is normal. Specifically, the first ratio may be compared with a ratio threshold, and then the brightness of the light source may be adjusted according to the comparison result. Wherein, the ratio threshold is a fixed ratio of the number of the first characteristic regions to the number of the second characteristic regions in the marker.
Specifically, when the first ratio is greater than the ratio threshold, the light source brightness of the terminal device is increased to a first target brightness, and when the first ratio is less than the ratio threshold, the light source brightness of the terminal device is decreased to a second target brightness. The magnitudes of the first target brightness and the second target brightness may be selected according to an actual first ratio, for example, when the first ratio contrast threshold is larger, the first target brightness is larger, and when the first ratio contrast threshold is smaller, the first target brightness is smaller. In the embodiment of the present application, specific magnitudes of the first target brightness and the second target brightness may not be limited.
For example, when the ratio of the number of the black feature points to the number of the white feature points is greater than a ratio threshold, the light source brightness of the terminal device is increased to a first target brightness, and when the ratio of the number of the black feature points to the number of the white feature points is less than the ratio threshold, the light source brightness of the terminal device is decreased to a second target brightness.
As another embodiment, the imaging parameter includes a brightness of the marker. Adjusting imaging parameters based on the target parameters, including:
if the first ratio is larger than the ratio threshold, sending a second control signal to the marker, wherein the second control signal is used for indicating the marker to increase the brightness of the marker to a third target brightness; and if the first ratio is smaller than the ratio threshold, sending a third control signal to the marker, wherein the third control signal is used for indicating the marker to reduce the brightness of the marker to a fourth target brightness.
It can be understood that, when the imaging parameter is the marker brightness, the marker brightness can be adjusted according to a first ratio of the number of the first feature regions to the number of the second feature regions. When the first ratio of the number of the first characteristic regions to the number of the second characteristic regions is different, the markers with different brightness are imaged, so that the brightness of the imaged marker image is normal. Specifically, the first ratio may be compared with a ratio threshold, and then the brightness of the marker may be adjusted according to the comparison result. Wherein, the ratio threshold is a fixed ratio of the number of the first characteristic regions to the number of the second characteristic regions in the marker.
Specifically, when the first ratio is greater than the ratio threshold, the marker luminance is increased to the third target luminance, and when the first ratio is less than the ratio threshold, the marker luminance is decreased to the fourth target luminance. The third target brightness and the fourth target brightness may be selected according to the actual first ratio, for example, the larger the first ratio contrast threshold is, the larger the third target brightness is, and the smaller the first ratio contrast threshold is, the smaller the fourth target brightness is. In the embodiment of the present application, specific magnitudes of the third target brightness and the fourth target brightness may not be limited.
For example, when the ratio of the number of black feature points to the number of white feature points is greater than a ratio threshold, the marker luminance is increased to a first target luminance, and when the ratio of the number of black feature points to the number of white feature points is less than the ratio threshold, the marker luminance is decreased to a second target luminance.
In an embodiment of the application, a communication connection between the terminal device and the marker may be established. After the target brightness required to be adjusted is obtained, a control signal corresponding to the target brightness of the marker can be generated, and the control signal is sent to the marker. After the marker receives the control signal, the parameter corresponding to the brightness of the marker can be adjusted in response to the control signal. Specifically, when the first ratio is judged to be larger than the ratio threshold, a second control signal is generated and sent to the marker, so that the marker increases the brightness of the marker to a third target brightness according to the second control signal; and if the first ratio is smaller than the ratio threshold value, generating a third control signal and sending the third control signal to the marker, so that the marker reduces the brightness of the marker to a fourth target brightness according to the third control signal.
Step S340: and acquiring a marker image containing the marker according to the adjusted imaging parameters.
In the embodiment of the present application, after the light source brightness or the marker brightness is adjusted according to the ratio of the first characteristic region to the second characteristic region in the marker, the marker may be image-captured according to the adjusted light source brightness or marker brightness, so as to obtain a marker image including the marker.
Step S350: based on the marker image, the marker is identified.
After the marker image of the marker is obtained, the marker image can be recognized, and a recognition result of recognizing the marker can be obtained. Because according to the adjusted light source brightness or marker brightness, the brightness of the collected marker image is normal, and the characteristic points of the marker are easy to distinguish, the identification precision is high when the characteristic points in the marker image are identified, and the accuracy of the identification result is improved.
In the embodiment of the present application, in addition to using the ratio of the number of the first feature regions to the number of the second feature regions as the target parameter for adjusting the light source brightness or the marker brightness, the ratio of the area of the first feature regions to the area of the second feature regions may also be used as the target parameter for adjusting the light source brightness or the marker brightness, and the specific adjustment manner may be the same as the above method.
In the embodiment of the present application, imaging parameters such as exposure time and aperture size may be adjusted based on the first ratio between the number of first characteristic regions and the number of second characteristic regions. For example, the exposure time of the image acquisition device may be increased, and conversely, the exposure time may be decreased, according to the first ratio being greater than the ratio threshold; for another example, the size of the aperture of the image capturing device may be increased, and conversely, the size of the aperture may be decreased, according to the first ratio being greater than the threshold value.
In the embodiment of the application, when the terminal device identifies the marker, the terminal device acquires a first ratio of the number of the first characteristic regions to the number of the second characteristic regions in the marker image acquired by the current imaging parameter, then adjusts the light source brightness or the marker brightness based on the ratio, and acquires the marker image according to the adjusted light source brightness or the adjusted marker brightness.
Referring to fig. 5, another embodiment of the present application provides a tag identification method, which can be applied to a terminal device, and the method can include:
step S410: upon identification of the marker, a third image of the marker is acquired based on the current imaging parameters.
In the embodiment of the present application, when the marker is the marker in the above embodiments, under the condition that the brightness of the marker image acquired by the image acquisition device is normal, the average brightness of the area of a certain color will be a fixed brightness. When the brightness of the marker image acquired by the image acquisition device is high, the average brightness of the area of the color will be high, and when the brightness of the marker image acquired by the image acquisition device is low, the average brightness of the area of the color will be low.
Therefore, the average brightness of the identified region of the first color may be used as the target parameter for adjusting the imaging parameters according to the marker image acquired by the current imaging parameters.
First, the marker may be imaged according to the current imaging parameters, resulting in a third image of the marker.
Step S420: and acquiring the average brightness of the area of the first color in the third image, and taking the average brightness as a target parameter for adjusting the imaging parameter of the marker.
After obtaining the third image of the marker with the current imaging parameters, the third image may then be image processed to obtain an average brightness of the region of the first color. In the embodiment of the present application, the first color may be white, that is, the average brightness of a white area in the marker is obtained.
Step S430: the imaging parameters are adjusted based on the target parameters.
In this embodiment, after the average brightness of the region of the first color is obtained, the imaging parameter of the marker may be adjusted according to the average brightness.
As an embodiment, the imaging parameter may include a light source brightness of the terminal device. Adjusting the imaging parameters based on the target parameters may include:
if the average brightness is larger than the brightness threshold value, reducing the light source brightness of the terminal equipment to a fifth target brightness; and if the average brightness is smaller than the brightness threshold value, increasing the brightness of the light source of the terminal device to a sixth target brightness.
It is understood that, when the imaging parameter is the light source brightness of the terminal device, the light source brightness may be adjusted according to the average brightness of the area of the first color. When the average brightness of the first color region is different, the marker can be imaged by using different light source brightness, so that the brightness of the imaged marker image is normal. Specifically, the average brightness of the area of the first color may be compared with a brightness threshold, and then the brightness of the light source may be adjusted according to the comparison result. The brightness threshold is the average brightness of the area of the first color in the marker image when the brightness of the marker image is normal.
Specifically, when the average brightness is greater than the brightness threshold, the light source brightness of the terminal device is increased to a fifth target brightness, and when the average brightness is less than the brightness threshold, the light source brightness of the terminal device is decreased to a sixth target brightness. The magnitudes of the fifth target brightness and the sixth target brightness may be selected according to the actual average brightness, for example, when the average brightness relative ratio threshold is larger, the fifth target brightness is larger, and when the average brightness relative ratio threshold is smaller, the sixth target brightness is smaller. In the embodiment of the present application, specific magnitudes of the fifth target luminance and the sixth target luminance may not be limiting.
As another embodiment, the imaging parameters may include brightness of the marker, and the adjusting of the imaging parameters based on the target parameters includes:
if the average brightness is larger than the brightness threshold value, sending a fourth control signal to the marker, wherein the fourth control signal is used for indicating the marker to reduce the brightness of the marker to a seventh target brightness; and if the average brightness is smaller than the brightness threshold value, sending a fifth control signal to the marker, wherein the fifth control signal is used for indicating the marker to increase the brightness of the marker to the eighth target brightness.
It is understood that, when the imaging parameter is the brightness of the marker, the brightness of the marker can be adjusted according to the average brightness of the area of the first color. When the average brightness of the regions of the first color is different, markers of different brightness may be imaged such that the brightness of the imaged marker image is normal. Specifically, the average brightness of the area of the first color may be compared with a brightness threshold, and then the brightness of the marker may be adjusted according to the comparison result. The brightness threshold is the average brightness of the area of the first color in the marker image when the brightness of the marker image is normal.
Specifically, when the average brightness is greater than the brightness threshold, the marker brightness is increased to the seventh target brightness, and when the average brightness is less than the brightness threshold, the marker brightness is decreased to the eighth target brightness. The magnitudes of the seventh target brightness and the eighth target brightness may be selected according to the actual average brightness, for example, when the average brightness relative ratio threshold is larger, the seventh target brightness is also larger, and when the average brightness relative ratio threshold is smaller, the eighth target brightness is also smaller. In the embodiment of the present application, specific magnitudes of the seventh target luminance and the eighth target luminance may not be limiting.
In the embodiment of the application, a communication connection between the terminal device and the marker can be established, and after the target brightness required to be adjusted is obtained, a control signal corresponding to the target brightness of the marker can be generated and sent to the marker. After the marker receives the control signal, the parameter corresponding to the brightness of the marker can be adjusted in response to the control signal.
Step S440: and acquiring a marker image containing the marker according to the adjusted imaging parameters.
In this embodiment, after the light source brightness or the marker brightness is adjusted according to the average brightness of the area of the first color in the marker, the marker may be subjected to image acquisition according to the adjusted light source brightness or marker brightness, so as to obtain a marker image including the marker. Since the light source brightness or the marker brightness is adjusted, the brightness of the acquired marker image can be set to a normal range, and the feature points of the marker in the marker image can be easily distinguished.
Step S450: based on the marker image, the marker is identified.
After the marker image of the marker is obtained, the marker image can be recognized, and a recognition result of recognizing the marker can be obtained. Because according to the adjusted light source brightness or marker brightness, the brightness of the collected marker image is normal, and the characteristic points of the marker are easy to distinguish, the identification precision is high when the characteristic points in the marker image are identified, and the accuracy of the identification result is improved.
In the embodiment of the present application, imaging parameters such as exposure time and aperture size may be adjusted according to the average luminance of the first color region. For example, the exposure time of the image acquisition device may be increased according to the average brightness of the area of the first color being greater than the ratio threshold, and conversely the exposure time may be decreased; for another example, the aperture size of the image capturing device may be decreased, and conversely the exposure time may be decreased, according to the average brightness of the area of the first color being greater than the ratio threshold.
According to the marker identification method provided by the embodiment of the application, when the terminal equipment identifies the marker, the average brightness of the first color area in the marker image acquired by the current imaging parameters is acquired, then the light source brightness or the marker brightness is adjusted based on the average brightness, and then the marker image is acquired according to the adjusted light source brightness or the marker brightness.
In one embodiment, the target parameter may also be a ratio of an area of a first color region of the marker to an area of a second color region of the marker in the marker image. The method comprises the steps that firstly, the terminal equipment can obtain a fourth image of a marker according to current imaging parameters, then the fourth image is recognized, the area size of a first color region and the area size of a second color region of the marker in the image of the marker are obtained, then the ratio of the area size of the first color region to the area size of the second color region is obtained, and finally the imaging parameters are adjusted according to the ratio of the area size of the first color region to the area size of the second color region.
Further, the first color region may be a black color region, and the second color region may be a white color region. When the ratio of the area size of the first color region to the area size of the second color region is larger than the ratio of the area size of the first color region to the area size of the second color region in the image with normal brightness, the light source brightness of the terminal device is increased to ninth target brightness, or the brightness of the marker is controlled to be increased to tenth target brightness, and when the ratio of the area size of the first color region to the area size of the second color region is smaller than the ratio of the area size of the first color region to the area size of the second color region in the image with normal brightness, the light source brightness of the terminal device is reduced to eleventh target brightness, or the brightness of the marker is controlled to be reduced to twelfth target brightness.
Referring to fig. 6, a block diagram of a tag identification apparatus 400 according to an embodiment of the present application is shown, where the tag identification apparatus 400 is applied to a terminal device. The marker recognition device 400 may include: a parameter acquisition module 410, a parameter adjustment module 420, an image acquisition module 430, and an image recognition module 440. The parameter obtaining module 410 is configured to obtain a target parameter for adjusting an imaging parameter for imaging a marker when the marker is identified; the parameter adjusting module 420 is configured to adjust the imaging parameters based on the target parameters; the image obtaining module 430 is configured to obtain a marker image including a marker according to the adjusted imaging parameter; the image recognition module 440 is configured to recognize the marker based on the marker image.
As one approach, the parameter acquisition module 410 may be specifically configured to: and acquiring the distance of the marker relative to the terminal equipment, and taking the distance as a target parameter for adjusting the imaging parameter of the marker.
Further, the imaging parameter may include a light source brightness of the terminal device. The parameter adjustment module 420 may be specifically configured to: acquiring light source target brightness corresponding to the distance; and adjusting the light source brightness of the terminal equipment to the light source target brightness.
The imaging parameters may also include: brightness of the marker. The parameter adjustment module 420 may be specifically configured to: acquiring the target brightness of the marker corresponding to the distance; and generating a first control signal based on the target brightness of the marker, and sending the first control signal to the marker, wherein the first control signal is used for instructing the marker to adjust the brightness of the marker to the target brightness of the marker.
The parameter obtaining module 410 obtains the distance between the marker and the terminal device, and may include: acquiring a first image of the marker according to the current imaging parameters, and acquiring the distance of the marker relative to the terminal equipment based on the first image; or acquiring the distance of the marker relative to the terminal equipment by using a distance sensor of the terminal equipment.
Alternatively, the marker may include at least one first feature region and a second feature region. The parameter obtaining module 410 may be specifically configured to: acquiring a second image of the marker according to the current imaging parameters; acquiring a first ratio of the number of the first characteristic regions to the number of the second characteristic regions in the second image, and taking the first ratio as a target parameter for adjusting the imaging parameter of the marker
Further, the imaging parameter may include a light source brightness of the terminal device. The parameter adjustment module 420 may be specifically configured to: if the first ratio is larger than the ratio threshold, increasing the light source brightness of the terminal equipment to a first target brightness; and if the first ratio is smaller than the ratio threshold value, reducing the light source brightness of the terminal equipment to a second target brightness.
The imaging parameter may include the brightness of the marker. The parameter adjustment module 420 may be specifically configured to: if the first ratio is larger than the ratio threshold, sending a second control signal to the marker, wherein the second control signal is used for indicating the marker to increase the brightness of the marker to a third target brightness; and if the first ratio is smaller than the ratio threshold, sending a third control signal to the marker, wherein the third control signal is used for indicating the marker to reduce the brightness of the marker to a fourth target brightness.
As another way, the parameter obtaining module 410 may be specifically configured to: acquiring a third image of the marker according to the current imaging parameters; and acquiring the average brightness of the area of the first color in the third image, and taking the average brightness as a target parameter for adjusting the imaging parameter of the marker.
Further, the imaging parameter includes the brightness of a light source of the terminal device. The parameter adjustment module 420 may be specifically configured to: if the average brightness is larger than the brightness threshold value, reducing the light source brightness of the terminal equipment to a fifth target brightness; and if the average brightness is smaller than the brightness threshold value, increasing the brightness of the light source of the terminal device to a sixth target brightness.
The imaging parameters include the brightness of the marker. The parameter adjustment module 420 may be specifically configured to: if the average brightness is larger than the brightness threshold value, sending a fourth control signal to the marker, wherein the fourth control signal is used for indicating the marker to reduce the brightness of the marker to a seventh target brightness; and if the average brightness is smaller than the brightness threshold value, sending a fifth control signal to the marker, wherein the fifth control signal is used for indicating the marker to increase the brightness of the marker to the eighth target brightness.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other type of coupling.
In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
To sum up, according to the marker identification method and apparatus provided in the embodiments of the present application, when the terminal device identifies the marker in the real scene, the target parameter for adjusting the imaging parameter of the marker is obtained, then the imaging parameter is adjusted based on the target parameter, the marker image including the marker is obtained according to the adjusted imaging parameter, and finally the identification result of the marker is obtained based on the image of the marker, so that the adjustment of the imaging parameter when the marker is identified can be realized, and the accuracy of the result identified by the acquired marker image is improved.
Referring to fig. 7, a block diagram of a terminal device according to an embodiment of the present application is shown. The terminal device 100 may be a terminal device capable of running an application, such as a smart phone, a tablet computer, an electronic book, or the like. The terminal device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, an image acquisition apparatus 130, a light source 140, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by the one or more processors 110, the one or more programs configured to perform the methods as described in the aforementioned method embodiments.
Processor 110 may include one or more processing cores. The processor 110 connects various parts within the entire terminal device 100 using various interfaces and lines, performs various functions of the terminal device 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120, and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.
The Memory 120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The storage data area may also store data created by the terminal 100 in use, and the like.
In the embodiment of the present application, the image capturing device 130 is used to capture an image of a marker. The image capturing device 130 may be an infrared camera or a color camera, and the specific type of the camera is not limited in the embodiment of the present application.
In the embodiment of the present application, the light source 140 is used to provide light for the image capturing device 130 to capture an image of an object to be captured. Specifically, the illumination angle of the light source 140 and the number of the light sources 140 may be set according to actual use, so that the emitted illumination light can cover the object to be photographed. The light source 140 is an infrared light illuminating device capable of emitting infrared light, and the image capturing device is a near-infrared camera capable of receiving infrared light. By means of active illumination, the image quality of the target image acquired by the image acquisition device 130 is improved, and specifically, the number of the light sources 140 is not limited, and may be one or multiple.
Referring to fig. 8, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer readable medium 800 has stored therein a program code that can be called by a processor to execute the method described in the above method embodiments.
The computer-readable storage medium 800 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 800 includes a non-volatile computer-readable storage medium. The computer readable storage medium 800 has storage space for program code 810 to perform any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 810 may be compressed, for example, in a suitable form.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (12)

1. A marker identification method is applied to terminal equipment, and the method comprises the following steps:
when the marker is identified, acquiring a second image of the marker according to the current imaging parameters;
acquiring a first ratio of the number of first characteristic regions to the number of second characteristic regions in a second image, and taking the first ratio as a target parameter for adjusting imaging parameters of a marker, wherein the marker comprises a plurality of sub-markers, each sub-marker comprises one or more characteristic points, the colors of the characteristic points are a first color and a second color, the first characteristic region is a characteristic point of the first color in the marker, the second characteristic region is a characteristic point of the second color in the marker, the ratio of the number of the characteristic points of the first color to the number of the characteristic points of the second color is a fixed ratio, and the target parameter is used for adjusting the imaging parameters of the marker;
adjusting the imaging parameters based on the target parameters;
acquiring a marker image containing the marker according to the adjusted imaging parameters;
identifying the marker based on the marker image, wherein the identification result of the marker is used for displaying virtual content in augmented reality;
the imaging parameters comprise the brightness of a light source of the terminal equipment, and the adjusting the imaging parameters based on the target parameters comprises:
if the first ratio is larger than a ratio threshold value, increasing the light source brightness of the terminal equipment to a first target brightness;
and if the first ratio is smaller than the ratio threshold, reducing the light source brightness of the terminal equipment to a second target brightness.
2. The method of claim 1, wherein obtaining target parameters comprises:
and acquiring the distance of the marker relative to the terminal equipment, and taking the distance as a target parameter for adjusting the imaging parameter of the marker.
3. The method of claim 2, wherein the imaging parameters include a light source brightness of the terminal device, and wherein adjusting the imaging parameters based on the target parameters comprises:
acquiring the brightness of a light source target corresponding to the distance;
and adjusting the light source brightness of the terminal equipment to the light source target brightness.
4. The method of claim 2, wherein the imaging parameter comprises a brightness of the marker, and wherein adjusting the imaging parameter based on the target parameter comprises:
acquiring the target brightness of the marker corresponding to the distance;
and generating a first control signal based on the marker target brightness, and sending the first control signal to the marker, wherein the first control signal is used for instructing the marker to adjust the brightness of the marker to the marker target brightness.
5. The method according to claim 2, wherein the obtaining of the distance of the marker from the terminal device comprises:
acquiring a first image of the marker according to the current imaging parameters, and acquiring the distance between the marker and the terminal equipment based on the first image; or
And acquiring the distance between the marker and the terminal equipment by utilizing a distance sensor of the terminal equipment.
6. The method of claim 1, wherein the imaging parameter comprises a brightness of the marker, the adjusting the imaging parameter based on the target parameter further comprising:
if the first ratio is larger than a ratio threshold, sending a second control signal to the marker, wherein the second control signal is used for indicating the marker to increase the brightness of the marker to a third target brightness;
and if the first ratio is smaller than a ratio threshold value, sending a third control signal to the marker, wherein the third control signal is used for indicating the marker to reduce the brightness of the marker to a fourth target brightness.
7. The method of claim 1, wherein the obtaining target parameters for adjusting imaging parameters of a marker comprises:
acquiring a third image of the marker according to the current imaging parameters;
and acquiring the average brightness of the area of the first color in the third image, and taking the average brightness as a target parameter for adjusting the imaging parameter of the marker.
8. The method of claim 7, wherein the imaging parameters comprise a light source brightness of the terminal device, and wherein adjusting the imaging parameters based on the target parameters comprises:
if the average brightness is larger than the brightness threshold value, reducing the light source brightness of the terminal equipment to a fifth target brightness;
and if the average brightness is smaller than the brightness threshold value, increasing the light source brightness of the terminal equipment to a sixth target brightness.
9. The method of claim 8, wherein the imaging parameter comprises a brightness of the marker, and wherein adjusting the imaging parameter based on the target parameter comprises:
if the average brightness is larger than the brightness threshold value, sending a fourth control signal to the marker, wherein the fourth control signal is used for indicating the marker to reduce the brightness of the marker to a seventh target brightness;
and if the average brightness is smaller than the brightness threshold value, sending a fifth control signal to the marker, wherein the fifth control signal is used for instructing the marker to increase the brightness of the marker to an eighth target brightness.
10. A marker recognition device, applied to a terminal device, the device comprising: a parameter acquisition module, a parameter adjustment module, an image acquisition module and an image identification module, wherein,
the parameter acquisition module is used for acquiring a second image of the marker according to the current imaging parameters when the marker is identified; acquiring a first ratio of the number of first characteristic regions to the number of second characteristic regions in a second image, and taking the first ratio as a target parameter for adjusting imaging parameters of a marker, wherein the marker comprises a plurality of sub-markers, each sub-marker comprises one or more characteristic points, the colors of the characteristic points are a first color and a second color, the first characteristic region is a characteristic point of the first color in the marker, the second characteristic region is a characteristic point of the second color in the marker, the ratio of the number of the characteristic points of the first color to the number of the characteristic points of the second color is a fixed ratio, and the target parameter is used for adjusting the imaging parameters of the marker;
the parameter adjusting module is used for adjusting the imaging parameters based on the target parameters;
the image acquisition module is used for acquiring a marker image containing the marker according to the adjusted imaging parameters;
the image identification module is used for identifying the marker based on the marker image, and the identification result of the marker is used for displaying virtual content in augmented reality;
the imaging parameters include light source brightness of the terminal device, and the parameter adjusting module is specifically configured to: if the first ratio is larger than a ratio threshold value, increasing the light source brightness of the terminal equipment to a first target brightness; and if the first ratio is smaller than the ratio threshold, reducing the light source brightness of the terminal equipment to a second target brightness.
11. A terminal device, comprising:
one or more processors;
a memory;
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-9.
12. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 9.
CN201810911024.0A 2018-08-10 2018-08-10 Marker identification method and device, terminal equipment and storage medium Active CN110826376B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201810911024.0A CN110826376B (en) 2018-08-10 2018-08-10 Marker identification method and device, terminal equipment and storage medium
PCT/CN2019/100101 WO2020030156A1 (en) 2018-08-10 2019-08-10 Image processing method, terminal device, and computer readable medium
US16/720,015 US11113849B2 (en) 2018-08-10 2019-12-19 Method of controlling virtual content, terminal device and computer readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810911024.0A CN110826376B (en) 2018-08-10 2018-08-10 Marker identification method and device, terminal equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110826376A CN110826376A (en) 2020-02-21
CN110826376B true CN110826376B (en) 2022-08-12

Family

ID=69541460

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810911024.0A Active CN110826376B (en) 2018-08-10 2018-08-10 Marker identification method and device, terminal equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110826376B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112257729B (en) * 2020-11-13 2023-10-03 腾讯科技（深圳）有限公司 Image recognition method, device, equipment and storage medium
CN112328086A (en) * 2020-11-14 2021-02-05 上海卓腾展览展示有限公司 Intelligent display method, system and device based on video identification and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106991699A (en) * 2017-03-31 2017-07-28 联想(北京)有限公司 Control method and electronic equipment
CN107113379A (en) * 2016-08-09 2017-08-29 深圳市瑞立视多媒体科技有限公司 The brightness adjusting method of infrared light supply moves with device, optics and catches video camera

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2003259291A1 (en) * 2002-07-26 2004-02-16 Zaxel Systems, Inc. Virtual reality immersion system
US10347002B2 (en) * 2016-07-01 2019-07-09 Guangdong Virtual Reality Technology Co., Ltd. Electronic tracking device, electronic tracking system and electronic tracking method
US20180046874A1 (en) * 2016-08-10 2018-02-15 Usens, Inc. System and method for marker based tracking
WO2019041353A1 (en) * 2017-09-04 2019-03-07 深圳前海达闼云端智能科技有限公司 Wearable display device-based method for measuring binocular brightness sensitivity, device and mobile terminal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107113379A (en) * 2016-08-09 2017-08-29 深圳市瑞立视多媒体科技有限公司 The brightness adjusting method of infrared light supply moves with device, optics and catches video camera
CN107181918A (en) * 2016-08-09 2017-09-19 深圳市瑞立视多媒体科技有限公司 A kind of dynamic filming control method and system for catching video camera of optics
CN106991699A (en) * 2017-03-31 2017-07-28 联想(北京)有限公司 Control method and electronic equipment

Also Published As

Publication number Publication date
CN110826376A (en) 2020-02-21

Similar Documents

Publication Publication Date Title
US10880539B2 (en) Method for controlling structured light projector, depth camera and electronic device
CN107635101B (en) Shooting method, shooting device, storage medium and electronic equipment
CN110300264B (en) Image processing method, image processing device, mobile terminal and storage medium
US9978000B2 (en) Information processing device, information processing method, light-emitting device regulating apparatus, and drive current regulating method
CN111345029B (en) Target tracking method and device, movable platform and storage medium
WO2008129540A2 (en) Device and method for identification of objects using color coding
US11113849B2 (en) Method of controlling virtual content, terminal device and computer readable medium
WO2006011635A1 (en) Image processing method and apparatus, image sensing apparatus, and program
KR102383129B1 (en) Method for correcting image based on category and recognition rate of objects included image and electronic device for the same
US10885609B2 (en) Electronic device for processing image based on priority and method for operating thereof
CN108551552B (en) Image processing method, device, storage medium and mobile terminal
JP2017504017A (en) Measuring instrument, system, and program
CN110826376B (en) Marker identification method and device, terminal equipment and storage medium
CN107018407B (en) Information processing device, evaluation chart, evaluation system, and performance evaluation method
CN108765380A (en) Image processing method, device, storage medium and mobile terminal
CN112040202A (en) Scene recognition method, device and storage medium
CN111563966B (en) Virtual content display method, device, terminal equipment and storage medium
JP6650739B2 (en) Light emitting device adjustment apparatus and drive current adjustment method
CN113297880A (en) Fingerprint acquisition method, fingerprint acquisition device, fingerprint acquisition terminal and storage medium
CN110659587A (en) Marker, marker identification method, marker identification device, terminal device and storage medium
CN110796740A (en) Security protection method, system and readable storage medium based on AR game
CN111913560A (en) Virtual content display method, device, system, terminal equipment and storage medium
US20230156349A1 (en) Method for generating image and electronic device therefor
CN108921097B (en) Human eye visual angle detection method and device and computer readable storage medium
CN111399630A (en) Virtual content interaction method and device, terminal equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant