CN106204743A - Control method, device and the mobile terminal of a kind of augmented reality function - Google Patents
Control method, device and the mobile terminal of a kind of augmented reality function Download PDFInfo
- Publication number
- CN106204743A CN106204743A CN201610503164.5A CN201610503164A CN106204743A CN 106204743 A CN106204743 A CN 106204743A CN 201610503164 A CN201610503164 A CN 201610503164A CN 106204743 A CN106204743 A CN 106204743A
- Authority
- CN
- China
- Prior art keywords
- preset
- augmented reality
- preset object
- area
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 245
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000001514 detection method Methods 0.000 claims abstract description 21
- 230000008569 process Effects 0.000 abstract description 5
- 230000006870 function Effects 0.000 description 97
- 238000005516 engineering process Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 2
- PEDCQBHIVMGVHV-UHFFFAOYSA-N Glycerine Chemical compound OCC(O)CO PEDCQBHIVMGVHV-UHFFFAOYSA-N 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
- Studio Devices (AREA)
Abstract
The embodiment of the invention discloses control method, device and the mobile terminal of a kind of augmented reality function, wherein, the method includes: whether there is default object in detection photographic head viewfinder range；When there is at least one default object in described photographic head viewfinder range being detected, it is judged that whether described default object meets augmented reality treatment conditions；If described default object meets described augmented reality treatment conditions, then control augmented reality function and open；Obtain the augmented reality content of described default object matches, according to described augmented reality content, described default object is carried out enhancement process.The control method of augmented reality function, device and mobile terminal disclosed in the embodiment of the present invention, it is not necessary to user's manual operation can open augmented reality function.
Description
Technical Field
The embodiment of the invention relates to the technical field of augmented reality, in particular to a control method and device for an augmented reality function and a mobile terminal.
Background
With the development of technology, mobile terminals have spread throughout the lives of people. Various functions (e.g., photographing function) in mobile terminals have become a tool for people to record life. Due to the great demand of users for the photographing function, the photographing function has become a standard configuration of the mobile terminal. The user can utilize the photographing function on the mobile terminal to record the scene and the wonderful moment around the user in daily life.
The pictures shot in the common shooting mode are the same as those seen by human eyes and even attenuated, and many scenes, phenomena or objects cannot be shot only through adjusting camera parameters, such as a rainy scene cannot be shot in a sunny day, a moon cannot be shot at a dark and dense night, and the like. More and more users have been unable to meet the needs of taking real scenes, but rather want to blend more elements into the picture when taking the picture, making it more aesthetically pleasing or noticeable.
Augmented reality technology can meet such needs of users. Augmented Reality (AR) technology is a technology for increasing the perception of a user to the real world through information provided by a computer system, applies virtual information to the real world, and superimposes virtual objects, scenes or system prompt information generated by a computer to the real scene, thereby realizing the enhancement of Reality. The augmented reality technology can be used for superposing virtual content serving as augmented content and an image acquired by the camera to obtain an augmented reality picture.
Currently, augmented reality technology has been applied to mobile terminals. When a user takes a picture, if the user wants to enhance the picture to be taken by utilizing the augmented reality technology, the user needs to search for a corresponding button below a menu key in the camera to manually start the augmented reality function, so that the operation is more complicated, and the user experience is poorer.
Disclosure of Invention
The embodiment of the invention provides a control method and device for an augmented reality function and a mobile terminal, and aims to solve the problems that the operation for starting the augmented reality function in the prior art is complicated, and the user experience is poor.
In a first aspect, an embodiment of the present invention provides a method for controlling an augmented reality function, including:
detecting whether a preset object exists in a camera viewing range;
when detecting that at least one preset object exists in the camera viewing range, judging whether the preset object meets augmented reality processing conditions or not;
if the preset object meets the augmented reality processing condition, controlling an augmented reality function to be started;
and acquiring augmented reality content matched with the preset object, and performing augmented processing on the preset object according to the augmented reality content.
In a second aspect, an embodiment of the present invention further provides a device for controlling an augmented reality function, including:
the detection module is used for detecting whether a preset object exists in the view finding range of the camera;
the judging module is used for judging whether at least one preset object exists in the camera viewing range or not when detecting that the preset object meets the augmented reality processing condition;
the control module is used for controlling the augmented reality function to be started if the preset object meets the augmented reality processing condition;
and the augmented reality processing module is used for acquiring the augmented reality content matched with the preset object and carrying out augmented processing on the preset object according to the augmented reality content.
In a third aspect, an embodiment of the present invention further provides a mobile terminal, including the control device with the augmented reality function provided in the second aspect.
According to the control method and device for the augmented reality function and the mobile terminal provided by the embodiment of the invention, whether the preset object exists in the camera viewing range is detected, when at least one preset object exists in the camera viewing range, whether the preset object meets augmented reality processing conditions is judged, and if the preset object meets the augmented reality processing conditions, the augmented reality function is controlled to be started. The augmented reality function is automatically started when the preset object exists in the camera viewing range and meets the augmented reality processing condition, the augmented reality function is not manually started by a user, and only the preset object to be processed by the augmented reality is placed in the camera viewing range by the user mobile terminal, so that the starting operation of the augmented reality function can be simplified, and the user experience is improved.
Drawings
Fig. 1 is a schematic flowchart of a control method for an augmented reality function according to an embodiment of the present invention.
Fig. 2 is a schematic flow chart of a control method for an augmented reality function according to a second embodiment of the present invention.
Fig. 3 is a schematic flow chart of a control method for an augmented reality function according to a third embodiment of the present invention.
Fig. 4 is a schematic flowchart of a control method for an augmented reality function according to a fourth embodiment of the present invention.
Fig. 5 is a schematic view of a camera viewing interface of a control method for an augmented reality function according to a fourth embodiment of the present invention.
Fig. 6 is a schematic flowchart of a control method for an augmented reality function according to a fifth embodiment of the present invention.
Fig. 7 is a schematic flowchart of a control method for an augmented reality function according to a sixth embodiment of the present invention.
Fig. 8 is a schematic view of a camera viewing interface of a control method for an augmented reality function according to a sixth embodiment of the present invention.
Fig. 9 is a schematic structural diagram of a control device for augmented reality function according to a seventh embodiment of the present invention.
Detailed Description
The technical scheme of the invention is further explained by the specific implementation mode in combination with the attached drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the various steps may be rearranged. The process may be terminated when its steps are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Example one
Fig. 1 is a flowchart illustrating a method for controlling an augmented reality function according to an embodiment of the present invention, where the method may be performed by a device for controlling an augmented reality function, where the device may be implemented by software and/or hardware, and may be generally integrated in a mobile terminal. As shown in fig. 1, the method includes:
step 101, detecting whether a preset object exists in a camera view range. If yes, executing step 102; if not, step 101 is performed.
And opening the camera application software, and after entering a photographing mode, starting to detect whether a preset object exists in the camera view finding range. The detection can be performed every moment or every time (for example, 3 seconds). It can be understood that: when the detection action is performed once every a period of time, the purpose of ensuring the detection and saving resources can be achieved only by reasonably designing the interval time. It should be noted that: the interval time may be designed according to actual needs, and is not limited in the embodiment of the present invention.
As long as at least one preset object exists in the camera view range, the fact that the preset object exists in the camera view range is described. The existence of the preset object in the camera view range can be that all areas of the preset object are positioned in the camera view range, or that partial areas of the preset object are positioned in the camera view range. When the detection result of the step 101 is that at least one preset object exists in the view range of the camera, continuing to execute the following step 102; when the detection result of step 101 is that no preset object exists in the camera viewing range, the above step 101 is continuously executed.
And 102, judging whether the preset object meets the augmented reality processing condition. If yes, go to step 103; if not, step 104 is performed.
And judging whether a preset object existing in the camera view range meets preset augmented reality processing conditions or not. In step 102, it may be determined whether each preset object existing within the camera viewing range meets the augmented reality processing condition, or whether some preset objects among all preset objects existing within the camera viewing range meet the augmented reality processing condition. It can be understood that: when judging whether every preset object that exists in the camera viewing range satisfies the augmented reality processing conditions, the judgment of all preset objects can be realized, and whether there is the preset object that satisfies the augmented reality processing conditions in all preset objects that exist in the camera viewing range can be better judged.
If at least one preset object in all preset objects existing in the camera view range meets the augmented reality processing condition, which indicates that the preset object meets the augmented reality processing condition, executing the following step 103; if all the preset objects existing in the camera viewing range do not satisfy the augmented reality processing condition, which indicates that the preset objects do not satisfy the augmented reality processing condition, the following step 104 is executed.
The augmented reality processing condition may be a default of the system, or may be set by the user. It can be understood that: when the augmented reality processing conditions are set by the user, the requirements of the user can be better met.
And 103, controlling the augmented reality function to be started.
And when at least one preset object in all preset objects in the camera view range meets the augmented reality processing condition, automatically controlling the augmented reality function to be started. After that, the user can utilize the augmented reality function to carry out augmented reality processing on the preset object in the camera view range.
And step 104, keeping the augmented reality function closed.
When all preset objects existing in the camera view range do not meet the augmented reality processing conditions, the augmented reality function is kept closed. Thereafter, the user cannot perform augmented reality processing on a preset object within the camera viewing range using the augmented reality function.
And 105, acquiring augmented reality content matched with the preset object, and performing augmented processing on the preset object according to the augmented reality content.
In order to enable the user to perform augmented reality processing on the picture captured in the view range of the camera by using the augmented reality function, on the basis of the scheme, the method may further include the following steps after step 103: acquiring position information of each preset object in a camera view range; performing preset object recognition on each preset object existing in the view finding range of the camera to obtain a recognition object corresponding to each preset object; acquiring augmented reality virtual content corresponding to each preset object according to the identification object corresponding to each preset object; and performing augmented reality processing on the corresponding preset object according to the position information of each preset object and the augmented reality virtual content corresponding to each preset object.
In the method for controlling an augmented reality function provided in an embodiment of the present invention, whether a preset object exists in a camera viewing range is detected, and when it is detected that at least one preset object exists in the camera viewing range, whether the preset object meets augmented reality processing conditions is determined, and if the preset object meets the augmented reality processing conditions, the augmented reality function is controlled to be turned on. The augmented reality function is automatically started when the preset object exists in the camera viewing range and meets the augmented reality processing condition, the augmented reality function is not manually started by a user, and only the preset object to be processed by the augmented reality is placed in the camera viewing range by the user mobile terminal, so that the starting operation of the augmented reality function can be simplified, and the user experience is improved.
Example two
Fig. 2 is a flowchart illustrating a control method for an augmented reality function according to a second embodiment of the present invention, where the second embodiment is optimized based on the first embodiment, and in the second embodiment, the augmented reality processing condition in step 102 is optimized as: and presetting a preset threshold value of the stay time of the object in the camera viewing range. As shown in fig. 2, the method includes:
step 201, detecting whether a preset object exists in a camera view range. If yes, go to step 202; if not, step 201 is performed.
Step 202, the stay time of each preset object existing in the camera view range is obtained.
When the detection result of step 201 is that at least one preset object exists in the camera view range, continuously acquiring the stay time of each preset object existing in the camera view range. The stay time of each preset object within the camera view range may be calculated from the time when the preset object appears within the camera view range.
And 203, judging whether the stay time of each preset object is greater than or equal to a preset threshold value. If the stay time of at least one preset object is greater than or equal to a preset threshold, executing step 204; if the stay time of all the preset objects is less than the preset threshold, step 205 is executed.
And judging whether the stay time of each preset object is greater than or equal to a preset threshold value or not according to the stay time of each preset object in the camera view range acquired in the step 202. As long as the stay time of at least one preset object in all preset objects existing in the camera view range is greater than or equal to a preset threshold, which indicates that the preset object meets the augmented reality processing condition, executing the following step 204; if the stay time of all the preset objects existing in the camera view range is not greater than or equal to the preset threshold (i.e., is less than the preset threshold), which indicates that the preset objects do not satisfy the augmented reality processing condition, the following step 205 is executed.
The preset threshold may be a default value (e.g., 5 seconds) of the system, or may be set by the user. It can be understood that: when the preset threshold is set by the user, the requirement of the user can be better met. The preset threshold may be designed according to actual needs, and is not specifically limited in the embodiment of the present invention.
And step 204, controlling the augmented reality function to be started.
And step 205, keeping the augmented reality function closed.
And step 206, acquiring the augmented reality content matched with the preset object, and performing augmented processing on the preset object according to the augmented reality content.
It should be noted that: for details that are not described in detail in the second embodiment of the present invention, reference may be made to the first embodiment, and details are not described herein.
In the control method for the augmented reality function provided in the second embodiment of the present invention, whether a preset object exists in the camera view range is detected, when it is detected that at least one preset object exists in the camera view range, a staying time length of each preset object existing in the camera view range is obtained, and whether the staying time length of each preset object is greater than or equal to a preset threshold is determined, and if the staying time length of at least one preset object is greater than or equal to the preset threshold, the augmented reality function is controlled to be started. The augmented reality function is automatically started when the preset object exists in the camera viewing range and the stay time of the preset object in the camera viewing range is more than or equal to the preset threshold value, the user does not need to manually start the augmented reality function, and only the preset object to be processed by the user mobile terminal is required to be placed in the camera viewing range, so that the starting operation of the augmented reality function can be simplified, and the user experience is improved.
EXAMPLE III
Fig. 3 is a schematic flow chart of a control method for an augmented reality function according to a third embodiment of the present invention, where the third embodiment is optimized based on the first embodiment, and in the third embodiment, the augmented reality processing condition in step 102 is optimized as: an augmented reality object. As shown in fig. 3, the method includes:
step 301, detecting whether a preset object exists in a camera view range. If yes, go to step 302; if not, step 301 is performed.
And 302, performing object identification on each preset object in the camera view range to obtain an identification object corresponding to each preset object.
And when the detection result in the step 301 is that at least one preset object exists in the camera view range, performing object recognition on each preset object existing in the camera view range to obtain a recognition object corresponding to each preset object existing in the camera view range.
The object recognition is performed to obtain what each preset object exists in the viewing range of the camera (for example, a cup or the sun), and accordingly, the recognition object corresponding to each preset object is what each preset object corresponds to (for example, a cup or the sun).
And 303, matching the identification object corresponding to each preset object with the augmented reality object in the augmented reality object list stored by the identification object. If at least one preset object is successfully matched, executing step 304; if all preset objects fail to match, step 305 is performed.
The augmented reality object list is stored in the mobile terminal, and the augmented reality object list comprises a plurality of augmented reality objects, wherein the augmented reality objects refer to objects capable of being processed in an augmented reality mode.
And matching the recognition object corresponding to each preset object obtained in the step 302 with the augmented reality object in the augmented reality object list stored in the recognition object. If there is a matching (i.e., a successful matching) between the recognition object corresponding to at least one preset object and the augmented reality object in the self-stored augmented reality object list, which indicates that the preset object satisfies the augmented reality processing condition, the following step 304 is executed; if the recognition objects corresponding to all the preset objects existing in the camera view range do not match the augmented reality objects in the self-stored augmented reality object list (i.e. matching fails), which indicates that the preset objects do not satisfy the augmented reality processing conditions, the following step 305 is executed.
And step 304, controlling the augmented reality function to be started.
And 305, keeping the augmented reality function closed.
And 306, acquiring augmented reality content matched with the preset object, and performing augmented processing on the preset object according to the augmented reality content.
In addition, since the identification object corresponding to each preset object is already obtained in step 302, when the augmented reality function is used to perform augmented reality processing on the picture captured within the viewing range of the camera (this part of content can be referred to as the first embodiment), the identification object corresponding to each preset object obtained in step 302 can be directly used, and it is not necessary to obtain the identification object corresponding to each preset object again.
It should be noted that: for details that are not described in detail in the third embodiment of the present invention, reference may be made to the first embodiment, and details are not described herein.
In the method for controlling an augmented reality function provided by the third embodiment of the present invention, whether a preset object exists in a camera viewing range is detected, when it is detected that at least one preset object exists in the camera viewing range, object recognition is performed on each preset object existing in the camera viewing range, an identification object corresponding to each preset object is obtained, the identification object corresponding to each preset object is matched with an augmented reality object in an augmented reality object list stored in the identification object list, and if at least one identification object corresponding to the preset object is successfully matched with the augmented reality object, the augmented reality function is controlled to be turned on. The augmented reality function is automatically started when the preset object exists in the camera viewing range and the preset object exists in the matching state with the augmented reality object, the augmented reality function is not manually started by a user, and only the preset object to be augmented reality processed by the mobile terminal of the user is required to be placed in the camera viewing range, so that the starting operation of the augmented reality function can be simplified, and the user experience is improved.
Example four
Fig. 4 is a schematic flow chart of a control method for an augmented reality function according to a fourth embodiment of the present invention, where the fourth embodiment is optimized based on the first embodiment, and in the fourth embodiment, step 101 is optimized as follows: only whether a preset object exists in the preset area is detected. As shown in fig. 4, the method includes:
step 401, detecting whether a preset object exists in a preset area in a camera view range. If so, go to step 402; if not, step 401 is performed.
Fig. 5 is a schematic view of a camera viewing interface of a control method for an augmented reality function according to a fourth embodiment of the present invention. As shown in fig. 5, it is detected whether or not a preset object exists in a preset area 502 within a camera view range 501.
The preset area 502 may be default to the system or may be set by the user, and it is understood that: when the preset area 502 is set by the user himself, the user's needs can be better satisfied. The number of the preset regions 502 may be one or multiple, and the number of the preset regions 502 may be designed according to actual needs, which is not described in detail in the embodiment of the present invention. The frame representing the preset area 502 may not be displayed in the camera viewing range 501, and may also be displayed in the camera viewing range 501, and it can be understood that: when the frame representing the preset area 502 is displayed in the camera viewing range 501, the user can conveniently place the preset object to be augmented reality processed in the preset area 502, so that the user can operate more conveniently, and the user experience is better.
Step 402, judging whether the preset object meets the augmented reality processing condition. If so, go to step 403; if not, step 404 is performed.
And step 403, controlling the augmented reality function to be started.
And step 404, keeping the augmented reality function closed.
And 405, acquiring augmented reality content matched with the preset object, and performing augmented processing on the preset object according to the augmented reality content.
It should be noted that: for details that are not described in detail in the fourth embodiment of the present invention, reference may be made to the first embodiment, and details are not described herein.
Compared with the control method for the augmented reality function provided by the first embodiment of the invention, the control method for the augmented reality function provided by the fourth embodiment of the invention can reduce the calculated amount during detection by only detecting whether the preset object exists in the preset area, thereby not only improving the response speed, but also reducing the energy consumption.
EXAMPLE five
Fig. 6 is a schematic flow chart of a control method for an augmented reality function according to a fifth embodiment of the present invention, where the fifth embodiment is optimized based on the fourth embodiment, and in the fifth embodiment, step 401 is optimized as follows: and judging whether the preset object belongs to the preset area or not according to the position information of the preset object. As shown in fig. 6, the method includes:
step 601, acquiring position information of each preset object in a camera view range.
And acquiring the position information of each preset object in the view range of the camera. The position information of the preset object may be a coordinate value of the preset position of the preset object within the viewing range of the camera. The preset position of the preset object may be a preset certain point of the preset object, such as a center point or a gravity center point, and the preset position is not limited in the embodiment of the present invention.
Step 602, judging whether each preset object belongs to a preset area according to the position information. If at least one preset object belongs to the preset area, executing step 603; if all the preset objects do not belong to the preset area, step 601 is executed.
And judging whether each preset object belongs to a preset area or not according to the position information of each preset object in the camera view range acquired in the step 601. When the position information of the preset object is a coordinate value of the preset position of the preset object in the camera viewing range, the preset region can be represented by the coordinate value range, and at the moment, whether each preset object belongs to the preset region or not can be judged according to the coordinate value in the position information and the coordinate value range in the preset region. When at least one preset object belongs to the preset area, the preset area is indicated to have at least one preset object, and then the following step 603 is executed; if all the preset objects do not belong to the preset area, which indicates that no preset object exists in the preset area, the step 601 is executed.
Step 603, judging whether the preset object meets the augmented reality processing condition. If yes, go to step 604; if not, step 605 is performed.
And step 604, controlling the augmented reality function to be started.
Step 605, keep the augmented reality function off.
And 606, acquiring the augmented reality content matched with the preset object, and performing augmented processing on the preset object according to the augmented reality content.
It should be noted that: for details that are not described in detail in the fifth embodiment of the present invention, reference may be made to the fourth embodiment specifically, and details are not described herein again.
In the control method for the augmented reality function provided by the fifth embodiment of the present invention, the position information of each preset object in the camera view range is obtained, and whether each preset object belongs to the preset area is determined according to the position information, and when at least one preset object belongs to the preset area, the augmented reality function is controlled to be turned on. The augmented reality function is automatically started when the preset object exists in the preset area and the existing preset object meets the augmented reality processing condition, the augmented reality function is not manually started by a user, and only the preset object to be augmented reality processed is placed in the preset area by the mobile terminal of the user, so that the starting operation of the augmented reality function can be simplified, and the user experience is improved.
EXAMPLE six
Fig. 7 is a schematic flow chart of a control method for an augmented reality function according to a sixth embodiment of the present invention, where the sixth embodiment is optimized based on the fourth embodiment, and in the sixth embodiment, step 401 is optimized as follows: and judging whether the preset object belongs to the preset area or not according to the area of the preset object. As shown in fig. 7, the method includes:
and 701, acquiring the area of a part of each preset object in a preset area within the view range of the camera.
Fig. 8 is a schematic view of a camera viewing interface of a control method for an augmented reality function according to a sixth embodiment of the present invention. As shown in fig. 8, all of the preset objects in the camera viewing range 801 may not fall within the preset area 802 (i.e., only a portion of the preset objects in the camera viewing range 801 may be within the preset area 802). At this time, the area of a portion of each preset object in the preset region 802 within the camera view range 801 can be acquired.
Step 702, determining whether the area of the part of each preset object in the preset area is greater than or equal to a preset value. If the area of the part of at least one preset object in the preset area is greater than or equal to the preset value, executing step 703; if the areas of all the parts of the preset objects in the preset area are smaller than the preset value, step 701 is executed.
And judging whether the area of the part of each preset object in the preset area is larger than or equal to the preset value or not according to the area of the part of each preset object in the preset area in the camera view range acquired in the step 701.
The preset value can be default of the system or can be set by the user, and it can be understood that when the preset value is set by the user, the requirement of the user can be better met.
The values of the preset values are exemplified below. The preset values may be: presetting a first ratio of the area of all parts of the object, and further: area of the preset area is a second proportion. The first proportion and the second proportion may be designed according to actual needs, and are not limited in the embodiment of the present invention.
And 703, judging whether the preset object meets the augmented reality processing condition. If so, go to step 704; if not, step 705 is performed.
And 704, controlling the augmented reality function to be started.
Step 705, keep the augmented reality function off.
Step 705, obtaining the augmented reality content matched with the preset object, and performing augmented processing on the preset object according to the augmented reality content.
It should be noted that: for details that are not described in detail in the sixth embodiment of the present invention, reference may be made to the fourth embodiment specifically, and details are not described herein again.
In the control method for the augmented reality function provided by the sixth embodiment of the present invention, by obtaining the area of the part of each preset object in the preset area within the viewing range of the camera, and determining whether the area of the part of each preset object in the preset area is greater than or equal to the preset value, when the area of the part of at least one preset object in the preset area is greater than or equal to the preset value, the augmented reality function is controlled to be turned on. The augmented reality function is automatically started when at least one preset object is equal to or larger than a preset value in the area of the part in the preset area and the preset object meets the augmented reality processing condition, the user does not need to manually start the augmented reality function, and only the user needs to move the mobile terminal to place the preset object to be processed in the preset area, so that the starting operation of the augmented reality function can be simplified, and the user experience is improved.
EXAMPLE seven
Fig. 9 is a schematic structural diagram of a control device for an augmented reality function according to a seventh embodiment of the present invention, where the control device can be implemented by software and/or hardware, and is generally integrated in a mobile terminal, and can implement control over the augmented reality function by executing a control method for the augmented reality function. As shown in fig. 9, the apparatus includes: a detection module 901, a judgment module 902, a control module 903 and an enhancement processing module 904.
The detection module 901 is configured to detect whether a preset object exists in a camera view range; a determining module 902, configured to determine whether a preset object meets an augmented reality processing condition when it is detected that at least one preset object exists within a camera viewing range; the control module 903 is used for controlling the augmented reality function to be started if the preset object meets the augmented reality processing condition; and the augmented reality processing module 904 is configured to obtain augmented reality content matched with the preset object, and perform augmented processing on the preset object according to the augmented reality content.
According to the control device for the augmented reality function, provided by the embodiment of the invention, whether a preset object exists in the camera viewing range is detected, when at least one preset object exists in the camera viewing range, whether the preset object meets augmented reality processing conditions is judged, and if the preset object meets the augmented reality processing conditions, the augmented reality function is controlled to be started. The augmented reality function is automatically started when the preset object exists in the camera viewing range and meets the augmented reality processing condition, the augmented reality function is not manually started by a user, and only the preset object to be processed by the augmented reality is placed in the camera viewing range by the user mobile terminal, so that the starting operation of the augmented reality function can be simplified, and the user experience is improved.
Preferably, the determining module 902 may include: a stay time length obtaining unit and a stay time length judging unit. The device comprises a stay time length acquisition unit, a display unit and a control unit, wherein the stay time length acquisition unit is used for acquiring the stay time length of each preset object in the view finding range of the camera; the stay time length judging unit is used for judging whether the stay time length of each preset object is larger than or equal to a preset threshold value, if the stay time length of at least one preset object is larger than or equal to the preset threshold value, then: the preset object satisfies augmented reality processing conditions.
Preferably, the determining module 902 may include: an object recognition unit and an object matching unit. The object identification unit is used for carrying out object identification on each preset object in the camera view range to obtain an identification object corresponding to each preset object; the object matching unit is used for matching the identification object corresponding to each preset object with the augmented reality object in the augmented reality object list stored by the object matching unit, and if the identification object corresponding to at least one preset object is successfully matched with the augmented reality object, the object matching unit is used for: the preset object satisfies augmented reality processing conditions.
Preferably, the detection module 901 may include: and the detection unit is used for detecting whether a preset object exists in a preset area in the camera view range.
Preferably, the detection unit may include: a position information acquiring subunit and a position information judging subunit. The device comprises a position information acquisition subunit, a position information acquisition unit and a control unit, wherein the position information acquisition subunit is used for acquiring the position information of each preset object in the view range of the camera; the position information judging subunit is used for judging whether each preset object belongs to the preset area or not according to the position information, and if at least one preset object belongs to the preset area, the position information judging subunit: at least one preset object is present in the preset area.
Preferably, the detection unit may include: the area acquisition subunit is used for acquiring the area of a part of each preset object in the preset area within the view range of the camera; the area judgment subunit is configured to judge whether an area of a portion of each preset object in the preset area is greater than or equal to a preset value, and if the area of the portion of at least one preset object in the preset area is greater than or equal to the preset value, then: at least one preset object is present in the preset area.
The device can execute the method provided by any one of the first embodiment to the sixth embodiment of the invention, and has corresponding functional modules and beneficial effects for executing the method. For details of the technology that are not described in detail in this embodiment, reference may be made to the method provided in any one of the first to sixth embodiments of the present invention.
In addition, an embodiment of the present invention further provides a mobile terminal, which includes the apparatus provided in the seventh embodiment of the present invention, and is capable of executing the method provided in any one of the first to sixth embodiments of the present invention. According to the mobile terminal provided by the embodiment of the invention, whether the preset object exists in the camera view range is detected, when at least one preset object exists in the camera view range, whether the preset object meets the augmented reality processing condition is judged, and if the preset object meets the augmented reality processing condition, the augmented reality function is controlled to be started. The augmented reality function is automatically started when the preset object exists in the camera viewing range and meets the augmented reality processing condition, the augmented reality function is not manually started by a user, and only the preset object to be processed by the augmented reality is placed in the camera viewing range by the user mobile terminal, so that the starting operation of the augmented reality function can be simplified, and the user experience is improved.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (11)
1. A control method for augmented reality function, comprising:
detecting whether a preset object exists in a camera viewing range;
when detecting that at least one preset object exists in the camera viewing range, judging whether the preset object meets augmented reality processing conditions or not;
if the preset object meets the augmented reality processing condition, controlling an augmented reality function to be started;
and acquiring augmented reality content matched with the preset object, and performing augmented processing on the preset object according to the augmented reality content.
2. The method of claim 1, wherein determining whether the preset object satisfies augmented reality processing conditions comprises:
acquiring the stay time of each preset object in the view-finding range of the camera;
judging whether the stay time of each preset object is greater than or equal to a preset threshold value or not;
and if the stay time of at least one preset object is greater than or equal to the preset threshold, the preset object meets the augmented reality processing condition.
3. The method of claim 1, wherein determining whether the preset object satisfies augmented reality processing conditions comprises:
performing object identification on each preset object in the camera view range to obtain an identification object corresponding to each preset object;
matching the recognition object corresponding to each preset object with the augmented reality objects in the augmented reality object list stored by the recognition object;
and if the identification object corresponding to at least one preset object is successfully matched with the augmented reality object, the preset object meets the augmented reality processing condition.
4. The method of claim 1, wherein detecting whether a preset object exists in the viewing range of the camera comprises:
whether a preset object exists in a preset area in the camera view range is detected.
5. The method of claim 4, wherein detecting whether a preset object exists in a preset area within the viewing range of the camera comprises:
acquiring position information of each preset object in the camera view range;
judging whether each preset object belongs to the preset area or not according to the position information;
if at least one preset object belongs to the preset area, at least one preset object exists in the preset area;
or,
acquiring the area of part of each preset object in the preset area within the camera viewing range;
judging whether the area of the part of each preset object in the preset area is larger than or equal to a preset value or not;
if the area of the part of at least one preset object in the preset area is larger than or equal to the preset value, at least one preset object exists in the preset area.
6. An augmented reality function control apparatus, comprising:
the detection module is used for detecting whether a preset object exists in the view finding range of the camera;
the judging module is used for judging whether at least one preset object exists in the camera viewing range or not when detecting that the preset object meets the augmented reality processing condition;
the control module is used for controlling the augmented reality function to be started if the preset object meets the augmented reality processing condition;
and the augmented reality processing module is used for acquiring the augmented reality content matched with the preset object and carrying out augmented processing on the preset object according to the augmented reality content.
7. The apparatus of claim 6, wherein the determining module comprises:
the stay time length acquisition unit is used for acquiring the stay time length of each preset object in the view finding range of the camera;
and the stay time judging unit is used for judging whether the stay time of each preset object is greater than or equal to a preset threshold value or not, and if at least one stay time of the preset object is greater than or equal to the preset threshold value, the preset object meets the augmented reality processing condition.
8. The apparatus of claim 6, wherein the determining module comprises:
the object recognition unit is used for performing object recognition on each preset object in the camera view range to obtain a recognition object corresponding to each preset object;
and the object matching unit is used for matching the identification object corresponding to each preset object with the augmented reality object in the augmented reality object list stored by the object matching unit, and if the identification object corresponding to at least one preset object is successfully matched with the augmented reality object, the preset object meets the augmented reality processing condition.
9. The apparatus of claim 6, wherein the detection module comprises:
and the detection unit is used for detecting whether a preset object exists in a preset area in the camera view range.
10. The apparatus of claim 9, wherein the detection unit comprises:
the position information acquisition subunit is used for acquiring the position information of each preset object in the view range of the camera;
a position information judging subunit, configured to judge whether each preset object belongs to the preset region according to the position information, and if there is at least one preset object that belongs to the preset region, then: at least one preset object exists in the preset area;
alternatively, the detection unit includes:
the area acquisition subunit is used for acquiring the area of a part of each preset object in the preset area within the camera view range;
and the area judgment subunit is configured to judge whether the area of the part of each preset object in the preset area is greater than or equal to a preset value, and if the area of the part of at least one preset object in the preset area is greater than or equal to the preset value, at least one preset object exists in the preset area.
11. A mobile terminal characterized in that it integrates control means of the augmented reality function according to any one of claims 6 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610503164.5A CN106204743B (en) | 2016-06-28 | 2016-06-28 | Control method and device for augmented reality function and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610503164.5A CN106204743B (en) | 2016-06-28 | 2016-06-28 | Control method and device for augmented reality function and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106204743A true CN106204743A (en) | 2016-12-07 |
| CN106204743B CN106204743B (en) | 2020-07-31 |
Family
ID=57463111
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610503164.5A Active CN106204743B (en) | 2016-06-28 | 2016-06-28 | Control method and device for augmented reality function and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106204743B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107918955A (en) * | 2017-11-15 | 2018-04-17 | 百度在线网络技术（北京）有限公司 | Augmented reality method and apparatus |
| CN108304067A (en) * | 2018-01-26 | 2018-07-20 | 百度在线网络技术（北京）有限公司 | System, method and apparatus for showing information |
| CN111420400A (en) * | 2020-03-23 | 2020-07-17 | 网易（杭州）网络有限公司 | Display method, device, equipment and medium for game elements in AR game |
| CN112633303A (en) * | 2020-12-18 | 2021-04-09 | 上海影创信息科技有限公司 | Height-limiting picture deformation detection method and system and vehicle |
| WO2022089625A1 (en) * | 2020-11-02 | 2022-05-05 | 华为技术有限公司 | Augmented reality function control method and electronic device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101763388A (en) * | 2008-12-25 | 2010-06-30 | 北京中星微电子有限公司 | Method for searching video, system therefor and device therefor as well as video storing method and system thereof |
| CN102045543A (en) * | 2009-10-23 | 2011-05-04 | 佳能株式会社 | Image processing apparatus and image processing method |
| CN102566756A (en) * | 2010-12-16 | 2012-07-11 | 微软公司 | Comprehension and intent-based content for augmented reality displays |
| US20120195461A1 (en) * | 2011-01-31 | 2012-08-02 | Qualcomm Incorporated | Correlating areas on the physical object to areas on the phone screen |
| CN105069754A (en) * | 2015-08-05 | 2015-11-18 | 意科赛特数码科技(江苏)有限公司 | System and method for carrying out unmarked augmented reality on image |
| CN105338117A (en) * | 2015-11-27 | 2016-02-17 | 亮风台（上海）信息科技有限公司 | Method, device and system for generating AR applications and presenting AR instances |
| CN105701863A (en) * | 2016-01-11 | 2016-06-22 | 华为技术有限公司 | Image processing method and device |
-
2016
- 2016-06-28 CN CN201610503164.5A patent/CN106204743B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101763388A (en) * | 2008-12-25 | 2010-06-30 | 北京中星微电子有限公司 | Method for searching video, system therefor and device therefor as well as video storing method and system thereof |
| CN102045543A (en) * | 2009-10-23 | 2011-05-04 | 佳能株式会社 | Image processing apparatus and image processing method |
| CN102566756A (en) * | 2010-12-16 | 2012-07-11 | 微软公司 | Comprehension and intent-based content for augmented reality displays |
| US20120195461A1 (en) * | 2011-01-31 | 2012-08-02 | Qualcomm Incorporated | Correlating areas on the physical object to areas on the phone screen |
| CN105069754A (en) * | 2015-08-05 | 2015-11-18 | 意科赛特数码科技(江苏)有限公司 | System and method for carrying out unmarked augmented reality on image |
| CN105338117A (en) * | 2015-11-27 | 2016-02-17 | 亮风台（上海）信息科技有限公司 | Method, device and system for generating AR applications and presenting AR instances |
| CN105701863A (en) * | 2016-01-11 | 2016-06-22 | 华为技术有限公司 | Image processing method and device |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107918955A (en) * | 2017-11-15 | 2018-04-17 | 百度在线网络技术（北京）有限公司 | Augmented reality method and apparatus |
| CN108304067A (en) * | 2018-01-26 | 2018-07-20 | 百度在线网络技术（北京）有限公司 | System, method and apparatus for showing information |
| CN111420400A (en) * | 2020-03-23 | 2020-07-17 | 网易（杭州）网络有限公司 | Display method, device, equipment and medium for game elements in AR game |
| WO2022089625A1 (en) * | 2020-11-02 | 2022-05-05 | 华为技术有限公司 | Augmented reality function control method and electronic device |
| CN112633303A (en) * | 2020-12-18 | 2021-04-09 | 上海影创信息科技有限公司 | Height-limiting picture deformation detection method and system and vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106204743B (en) | 2020-07-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106204743B (en) | Control method and device for augmented reality function and mobile terminal | |
| CN109961453B (en) | Image processing method, device and equipment | |
| CN106210334B (en) | Intelligent flash lamp control method and system and mobile terminal | |
| US9571752B2 (en) | Display control apparatus and display control method | |
| CN103257939B (en) | A kind of obtain the method for image, device and equipment | |
| US9098243B2 (en) | Display device and method for adjusting observation distances thereof | |
| CN108762501B (en) | AR display method, intelligent terminal, AR device and AR system | |
| CN109302628B (en) | Live broadcast-based face processing method, device, equipment and storage medium | |
| CN105812553A (en) | Rapid shooting method and mobile terminal | |
| CN104754219B (en) | A kind of terminal | |
| CN103297697A (en) | Method and device for displaying template pictures during photographing | |
| CN103795926A (en) | Method, system and photographing device for controlling photographing focusing by means of eyeball tracking technology | |
| CN106941588B (en) | Data processing method and electronic equipment | |
| CN104869322A (en) | Eyeprint identification based mobile terminal camera self-adaptation adjustment method and system | |
| CN106657798A (en) | Photographing method for intelligent terminal | |
| CN113395456B (en) | Auxiliary shooting method and device, electronic equipment and computer readable storage medium | |
| US20130308829A1 (en) | Still image extraction apparatus | |
| CN106161970B (en) | A kind of image pickup method, device and mobile terminal | |
| CN105704395A (en) | Shooting method and shooting device | |
| CN106126066A (en) | Control method, device and the mobile terminal of a kind of augmented reality function | |
| CN105516577B (en) | Camera shooting control method and system | |
| WO2016078440A1 (en) | Method and apparatus for controlling screen of mobile terminal | |
| CN116600190A (en) | Photographing control method and device for mobile phone and computer readable storage medium | |
| CN109089158B (en) | Human face image quality parameter processing system for smart television and implementation method thereof | |
| CN108391162B (en) | Volume adjustment method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |