WO2020057130A1

WO2020057130A1 - Application control method and means

Info

Publication number: WO2020057130A1
Application number: PCT/CN2019/084799
Authority: WO
Inventors: 周凡贻
Original assignee: 深圳市泰衡诺科技有限公司
Priority date: 2018-09-17
Filing date: 2019-04-28
Publication date: 2020-03-26
Also published as: CN109348003A

Abstract

Embodiments of the present invention provide an application control method and means, being applied to a terminal device. The terminal device is provided with a photographing means. The application control method comprises: receiving a first instruction inputted by a user; if the first instruction is a long press instruction, obtaining a first image acquired by the photographing means; if a first object is identified in the first image, determining the identifier of a page corresponding to the first object and displaying the identifier of the page; and if the first instruction is a click instruction, performing photographing by means of the photographing means. The present invention is used for improving the flexibility of application control.

Description

Application control method and device

Technical field

Embodiments of the present invention relate to the field of cameras of terminal devices, and in particular, to an application control method and device.

Background technique

At present, most terminal devices (such as mobile phones, computers, and other devices) are usually provided with a camera device, and the terminal device can implement a shooting function and an Augmented Reality (AR) function through the camera device. The AR function refers to functions that can collect images of real things through the camera device in the terminal device, and can recognize the acquired images and recommend related content through the computer system in the terminal device.

In the prior art, a camera application program and an AR application program are usually installed in a terminal device, a shooting function is implemented by the camera application program, and an AR function is implemented by the AR application program. In the actual application process, when the user needs to use the shooting function of the terminal device, the user starts the camera application in the terminal device. At this time, if the user needs to use the AR function of the terminal device, the user needs to exit the camera application in the terminal device. Program and launch the AR application. The control method of the above application program is single and rigid, resulting in poor flexibility of application control.

Summary of the Invention

The embodiments of the present invention provide an application control method and device, which improves the flexibility of application control.

In a first aspect, an embodiment of the present invention provides an application control method, including:

Receiving a first instruction input by a user;

If the first instruction is a long-press instruction, obtaining a first image collected by the camera device; if a first object is identified in the first image, determining an identifier of a page corresponding to the first object And display the logo of the page;

If the first command is a click command, shooting is performed by the camera device.

In a possible implementation manner, the determining an identifier of a page corresponding to the first object includes:

Acquiring object information of the first object, where the object information includes an object category and an object attribute of the first object;

An identifier of the page is determined according to the object information.

In another possible implementation manner, determining the identifier of the page according to the object information includes:

Determining an application corresponding to the object category;

An identifier of the page is determined according to the object attribute and the application, and the page is a page in the application.

In another possible implementation manner, if the first instruction is a long-press instruction, if the first object is not identified in the first image, the method further includes:

The shooting interface is displayed.

In another possible implementation manner, the receiving a first instruction input by a user includes:

After receiving an application start instruction input by the user, displaying a shooting interface;

Receiving the first instruction input by the user on the shooting interface.

In a second aspect, an embodiment of the present invention provides an application control device applied to a terminal device. The terminal device is provided with a camera device. The application control device includes a receiving module, an acquiring module, an identifying module, a determining module, and a display module. And shooting module,

The receiving module is configured to receive a first instruction input by a user;

The acquiring module is configured to acquire a first image acquired by the camera when the first instruction is a long-press instruction;

The identification module is configured to identify a first object in the first image;

The determining module is configured to determine an identifier of a page corresponding to the first object when the recognition module identifies a first object in the first image;

The display module is configured to display an identifier of the page;

The photographing module is configured to perform photographing through the imaging device when the first instruction is a click instruction.

In a possible implementation manner, the determining module is specifically configured to:

An identifier of the page is determined according to the object information.

In another possible implementation manner, the determining module is specifically configured to:

Determining an application corresponding to the object category;

In another possible implementation manner, the display module is further configured to display when the first instruction is a long-press instruction and the recognition module does not recognize a first object in the first image. Shooting interface.

In another possible implementation manner, the display module is specifically configured to display a shooting interface after receiving a start instruction of an application program input by a user;

Accordingly, the receiving module is specifically configured to receive the first instruction input by a user on the shooting interface.

According to a third aspect, an embodiment of the present invention provides a terminal device, including: a processor, the processor being coupled to a memory;

The memory is configured to store a computer program;

The processor is configured to execute a computer program stored in the memory, so that the terminal device executes the method according to any one of the foregoing first aspects.

In a fourth aspect, an embodiment of the present invention provides a readable storage medium including a program or an instruction. When the program or the instruction is run on a computer, the method according to any one of the foregoing first aspects is executed.

The application control method and device provided by the embodiments of the present invention receive a first instruction input by a user. If the first instruction is a long-press instruction, the terminal device enables the AR function, that is, the camera device collects the object to obtain a first image of the object. If the first object is identified in the image, the identifier of the page corresponding to the first object is determined, and the page identifier is displayed; if the first instruction is a click instruction, the camera device in the terminal setting enables the shooting function. In the above process, the shooting function and AR function are combined in one application. During the operation of an application, the user can enter different instructions (long press or click instructions) according to the actual needs, so that the application Corresponding functions are provided to increase the flexibility of application control. Further, when the user needs to switch between the shooting function or the AR function, the user does not need to input the operation of quitting the application and starting the application in the terminal device, simplifying the operation of the user, thereby improving the user experience.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly explain the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without paying creative labor.

FIG. 1 is a first flowchart of an application control method according to an embodiment of the present invention; FIG.

2 is a second flowchart of an application control method according to an embodiment of the present invention;

3 is a schematic diagram of a process of displaying an application program interface according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of an application control apparatus according to an embodiment of the present invention.

detailed description

In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, but not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

The method shown in the embodiment of the present invention can be applied to a terminal device. A camera device is provided in the terminal device, and the terminal device can collect images through the camera device. Optionally, the terminal device may be a mobile phone, a computer, a camera, or the like. Optionally, the camera device may be a front camera or a rear camera.

An application can also be installed in the terminal device. After the user launches the application in the terminal device, the terminal device can display the shooting interface, the terminal device can also call the camera device to make the camera device perform image acquisition, and the terminal device displays the camera in the shooting interface. The device acquires the obtained image.

In this application, one application can implement the shooting function and AR function. During the running of an application program, the user can input different instructions (long press or click instructions) according to actual needs, so that the application program provides corresponding functions, thereby improving the flexibility of application control. Further, when the user needs to switch between using the shooting function or the AR function, the user does not need to input the operation of exiting the application program and starting the application program in the terminal device, which simplifies the operation of the user and further improves the user experience.

In the following, the technical solutions shown in the present application are described in detail through specific embodiments. It should be noted that the following specific embodiments may be combined with each other, and the same or similar content will not be repeatedly described in different embodiments.

FIG. 1 is a flowchart of an application control method according to an embodiment of the present invention. Please refer to FIG. 1. The application control method may specifically include:

S101: Receive a first instruction input by a user.

The execution subject of this embodiment of the present invention may be a terminal device, or may be an application control device provided in the terminal device. Optionally, the application control device may be implemented by software, or the start button may also be implemented by a combination of software and hardware.

Optionally, an application program can be installed in the terminal device, and the one application program can implement both the camera function and the AR function.

After the user starts the one application program in the terminal device, the one application program can call the camera device of the terminal device and display a shooting interface, and the shooting interface displays an image collected by the camera device.

After the terminal device displays the shooting interface, the user can input a first instruction.

Optionally, a physical button is provided on the terminal device. Correspondingly, the user can perform a pressing operation on the physical key to implement input of the first instruction.

Optionally, the shooting interface may include a first icon, and the user may perform a touch operation on the first icon to implement input of the first instruction.

Optionally, the first instruction may be a long press instruction or a click instruction.

Of course, the first instruction may also be another type of instruction, which is not specifically limited in this embodiment of the present invention.

Optionally, the type of the first instruction may be determined according to the instruction duration corresponding to the first instruction.

Optionally, if the first instruction is generated by a user pressing a physical key, the instruction duration may be the user's pressing time of the physical key.

Optionally, if the first instruction is generated by the user touching the first icon, the instruction duration may be the user's touch duration of the first icon.

Optionally, a preset duration may be set in advance on the terminal device, and when the duration of the first instruction is shorter than the preset duration, it is determined that the first instruction is a click instruction. When the instruction duration of the first instruction is greater than or equal to a preset duration, it is determined that the first instruction is a long-press instruction.

For example, the preset duration may be 1 second, 2 seconds, 3 seconds, or the like.

Of course, in an actual application process, the preset duration may be set according to actual needs, which is not specifically limited in this embodiment of the present invention.

S102: Determine whether the first instruction is a long-press instruction.

If yes, execute S103.

If not, execute S104.

S103: Acquire a first image collected by the camera device, and if a first object is identified in the first image, determine an identifier of a page corresponding to the first object, and display the identifier of the page.

For example, the user can press a physical button on the terminal device for 4 seconds, or the user can touch the first icon in the shooting interface for 4 seconds to input a first instruction with a duration of 4 seconds. If the preset duration in the terminal device is 3 seconds, the duration corresponding to the first instruction is 4 seconds greater than or equal to the preset duration of 3 seconds, that is, the first instruction is a long-press instruction.

It should be noted that the AR function in the embodiment of the present invention includes at least the following functions: acquiring an image collected by the camera device, identifying an object included in the image, determining a page identifier corresponding to the object, and displaying a page identifier.

Optionally, the first object may be something existing in the real world.

For example, the first object may be a book, a computer, a person, or the like.

Optionally, the first image may be any image acquired by the camera device.

For example, the first image may be an image of a book, a computer, a person, or the like acquired by the camera device.

For example, the camera captures a book to obtain a first image of the book.

Optionally, the terminal device recognizes the first image to obtain a first object.

Optionally, after the first object is identified in the first image, object information of the first object may be acquired, and an identifier of a page corresponding to the first object may be determined according to the object information.

Optionally, the object information includes an object category and an object attribute of the first object.

Optionally, the object category can be books, computers, people, and so on.

Optionally, the object attributes may include a name, a version number, and the like of the first object.

For example, assuming that a book (first object) is identified in the first image, the object category of the first object is "book", and the object attributes of the first object may include the name, author, and version QR code of the book. Wait.

Optionally, the terminal device may determine an identifier of a page corresponding to the first object according to the object information of the first object.

Optionally, the identifier of the page may be a URL link in an application installed in the terminal device.

Optionally, the number of page identifiers corresponding to the first object may be one or multiple.

For example, if the first object is a book "Our Book", the page identifier of the first object is a URL link of a webpage in the application program for displaying sales information of the book "Our Book".

Optionally, the terminal device sorts the multiple applications according to the frequency of use of the multiple applications by the user, and displays the identification of the page of the application most frequently used by the user.

S104: Perform shooting by using an imaging device.

For example, the user may press a physical button on the terminal device for 1 second, or the user may touch the first icon in the shooting interface for 1 second to implement inputting a first instruction with a duration of 1 second. If the preset duration in the terminal device is 3 seconds, the duration corresponding to the first instruction is 1 second shorter than the preset duration of 3 seconds, that is, the first instruction is a click instruction.

Optionally, when the first instruction is a click instruction, the terminal device enables a shooting function.

Optionally, the shooting function may include at least one of a shooting function and a video recording function.

For example, an application that can enable the AR function and the shooting function is installed in the terminal device. After the user opens the one application, the display interface on the terminal device displays a first icon.

When the user touches the first icon for a time greater than or equal to a preset time, the terminal device enables the AR function. For example, at this time, the camera device in the terminal device collects a computer. First, the acquired computer is displayed on a display interface. Then, the terminal device recognizes the first image to obtain the first object as a computer, and the first object includes a computer's object category "Computer" and object attribute "X4431S", and then, according to the computer's object category "Computer" and object attribute "X4431S", the display interface displays the identification of the page of the computer in an application with the highest user usage.

When the user touches the first icon for a time shorter than the preset time, the terminal device enables the shooting function. For example, at this time, the display interface in the terminal device displays an object in the field of view of the camera device. Optionally, if the user touches the first icon in the shooting interface again, the camera device can shoot and record images of objects within the field of view of the camera device from multiple angles.

The application control method provided by the embodiment of the present invention receives a first instruction input by a user. If the first instruction is a long-press instruction, the application program enables the AR function, that is, the camera device collects the object to obtain a first image of the object. If the first object is identified in the image, the identifier of the page corresponding to the first object is determined, and the identifier of the page is displayed; if the first instruction is a click instruction, the application program enables the shooting function. In the above process, an application can enable the shooting function and AR function. During the operation of an application, the user can enter different instructions (long press or click instructions) according to the actual needs, so that the application provides the corresponding Functions, which in turn increases the flexibility of application control. Further, when the user needs to switch the shooting function or AR function used, the user does not need to input the operation of exiting the application program and starting the application program in the terminal device, simplifying the operation of the user, thereby improving the user experience.

Based on any one of the above embodiments, the technical solution of the method according to the present invention will be further described in detail below with reference to FIG. 2. For details, refer to FIG. 2.

FIG. 2 is a second flowchart of an application control method according to an embodiment of the present invention. Referring to FIG. 2, the method includes:

S201: Receive a first instruction input by a user.

S202: Determine whether the first instruction is a long-press instruction.

If yes, execute S203.

If not, execute S208.

S203: Acquire a first image acquired by the imaging device.

Optionally, the camera device in the terminal device collects at least one object to obtain a first image corresponding to the at least one object.

For example, the camera device in the terminal device collects a computer to obtain a first image corresponding to the computer.

For example, the camera device in the terminal device collects the character Zhang San to obtain a first image corresponding to the character Zhang San.

S204: Determine whether the first object is identified in the first image.

If yes, execute S205.

If not, execute S208.

For example, the terminal device may recognize a first image including a computer image, and obtain that the first object is a computer.

Optionally, the terminal device may recognize a first image including an image of the character Zhang San, and obtain that the first object is a character.

S205: Obtain object information of the first object, where the object information includes an object category and an object attribute of the first object.

For example, the object information of the first object (a computer) includes the object category “computer” and the object attribute “SVMX” of the first object, where “SVMX” is the brand name of the computer.

Optionally, the object information of the first object (person Zhang San) includes the object category “person” and the object attribute “person name” of the first object.

S206: Determine the application corresponding to the object category, and determine the identifier of the page according to the object attribute and the application. The page is a page in the application.

In a feasible implementation manner, the identifier of the page can be determined according to the object information through the following feasible implementation methods: determining the application corresponding to the object category; determining the identifier of the page according to the object attribute and the application, and the page being in the application Page.

For example, the application corresponding to the object category "computer" is a shopping application. According to the object attribute "SVMX" and the shopping application, the identification of the web page containing "SVMX" is determined in the shopping application.

For example, the application corresponding to the object category "Zhang San" is an address book application in the terminal device.

Optionally, according to the object attribute "person name" and the address book application, the identification of the page containing "Zhang San" is determined in the address book application.

S207: Display the identifier of the page.

Optionally, the identification of the page in the shopping application includes multiple URL links selling "SVMX".

Optionally, the page identifier in the address book application includes multiple "Zhang" surnames.

S208: Display the shooting interface.

Optionally, when the first input instruction is a click instruction, a shooting interface is displayed. That is, the terminal device enables the shooting function, the display interface in the terminal device displays the first icon, and at the same time, the display interface displays a camera device to display objects within its field of view.

Optionally, when the first input instruction is a long-press instruction, the terminal device cannot recognize the first object in the first image, and displays a shooting interface.

For example, when the first input instruction is a long-press instruction, the camera device collects the first image of a person, and the terminal device cannot identify the first object (that is, the person) in the first image of the person, and thus cannot obtain the object information of the person. , Further, the identity of the person's page cannot be displayed in the display interface, at this time, the shooting interface is displayed.

In the embodiment of FIG. 2, by combining the shooting function and the AR function in one application, the user does not need to implement the shooting function through the camera application alone, and the AR function through the AR application, which improves the user experience.

Based on any one of the above embodiments, the technical solution shown in the above method embodiment will be described in detail through a specific example with reference to FIG. 3 below.

FIG. 3 is a schematic diagram of a process displayed by an application program interface according to an embodiment of the present invention, including pages 301-306.

See page 301. An application is installed in the terminal device, and the main interface of the terminal device includes an application startup icon. When the user needs to use the shooting function of an application, the user can perform a click operation on the startup icon to implement an application on the terminal device. After an application is launched, the terminal device displays the shooting interface. For details, see page 302.

Please refer to page 302. After an application program is started, an application program also calls the camera device to make the camera device perform image acquisition. Accordingly, the terminal device can display the real-time image captured by the camera device in the shooting interface. Optionally, the shooting interface may further include a first icon A. When the user needs to take a picture, the user can use the camera device to collect the scene that he wants to take. For example, if the user wants to take a picture of a bunch of flowers, the first image of the bunch of flowers can be displayed on the page 302.

See page 303. After the first image of a bunch of flowers is displayed on page 302, the user touches the first icon A in page 303. When the first icon A is touched for a time shorter than a preset time, the terminal device The flower is photographed while displaying the first image of the bunch of flowers at position B of the page 403.

When the user needs to identify, there is no need to exit the current shooting function. For details, see interface 304.

Please refer to page 304. The user uses the camera to collect the object to be identified. For example, if the user wants to identify a book, the first image of the book can be displayed on page 304.

See page 305. After the first image of this book is displayed on page 304, the user touches the first icon A in page 305. When the first icon A is touched for a time greater than or equal to a preset time, the terminal device The first image of the book is identified to obtain the object information of the book, where the object information includes the object category "we" and the object attribute "book", and the terminal device is based on the object category of the book "our "" And the object attribute "book" determine the identity of the page of the book, and the identity of the page of the book is displayed. For details, see interface 306.

Please refer to page 306, where page 306 includes an identification of at least one page of the book in a shopping application, wherein the identification of one page is a sale information of the book, such as "Zhang Sanjia Store", "Zhang Sanjia Store" Wait. Optionally, the user can click on the logo of any of these pages to view detailed information about the book.

FIG. 4 is a schematic diagram of an application control apparatus according to an embodiment of the present invention. Referring to FIG. 4, the application control device includes a receiving module 41, an obtaining module 42, an identifying module 43, a determining module 44, a display module 45, and a photographing module 46, where:

The receiving module 41 is configured to receive a first instruction input by a user;

The acquiring module 42 is configured to acquire a first image acquired by the camera when the first instruction is a long-press instruction;

The identification module 43 is configured to identify a first object in the first image;

The determining module 44 is configured to determine an identifier of a page corresponding to the first object when the recognition module identifies a first object in the first image;

The display module 45 is configured to display an identifier of the page;

The photographing module 46 is configured to perform photographing by using the imaging device when the first instruction is a click instruction.

The application control device provided by the embodiment of the present invention can execute the technical solutions shown in the foregoing method embodiments, and the implementation principles and beneficial effects thereof are similar, and details are not described herein again.

In a possible implementation manner, the determining module 44 is specifically configured to:

An identifier of the page is determined according to the object information.

Determining an application corresponding to the object category;

In a possible embodiment, it is characterized by:

The shown display module 45 is further configured to display a shooting interface when the first instruction is a long-press instruction and the recognition module 43 does not recognize a first object in the first image.

In a possible embodiment, it is characterized by:

The display module 45 is specifically configured to display a shooting interface after receiving a start instruction of an application program input by a user;

Correspondingly, the receiving module 41 is specifically configured to receive the first instruction input by the user on the shooting interface.

An embodiment of the present invention provides a terminal device, including: a processor, the processor being coupled to a memory;

The memory is configured to store a computer program;

The processor is configured to execute a computer program stored in the memory, so that the terminal device executes the method according to any of the foregoing method embodiments.

An embodiment of the present invention provides a readable storage medium including a program or an instruction. When the program or the instruction is run on a terminal device, a method according to any of the foregoing method embodiments is executed.

A person of ordinary skill in the art may understand that all or part of the steps of implementing the foregoing method embodiments may be implemented by a program instructing related hardware. The aforementioned program may be stored in a readable storage medium in a computer. When the program is executed, the steps including the foregoing method embodiments are performed; and the foregoing storage media include: ROM, RAM, magnetic disks, and optical discs, which can store program codes.

Finally, it should be noted that the above embodiments are only used to describe the technical solutions of the embodiments of the present invention, but not limited thereto; although the embodiments of the present invention have been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art It should be understood that it is still possible to modify the technical solutions described in the foregoing embodiments, or to replace some or all of the technical features equivalently; and these modifications or replacements do not deviate the essence of the corresponding technical solutions from the embodiments of the present invention The scope of the programme.

Claims

An application control method is characterized in that the method is applied to a terminal device, and the terminal device is provided with a camera device, and the method includes:

Receiving a first instruction input by a user;

If the first instruction is a long-press instruction, obtaining a first image collected by the camera device; if a first object is identified in the first image, determining an identifier of a page corresponding to the first object And display the logo of the page;

If the first command is a click command, shooting is performed by the camera device.
The method according to claim 1, wherein the determining an identifier of a page corresponding to the first object comprises:

Acquiring object information of the first object, where the object information includes an object category and an object attribute of the first object;

An identifier of the page is determined according to the object information.
The method according to claim 2, wherein determining the identifier of the page according to the object information comprises:

Determining an application corresponding to the object category;

An identifier of the page is determined according to the object attribute and the application, and the page is a page in the application.
The method according to any one of claims 1 to 3, wherein if the first instruction is a long-press instruction, if the first object is not recognized in the first image, the method further comprises :

The shooting interface is displayed.
The method according to any one of claims 1-3, wherein the receiving a first instruction input by a user comprises:

After receiving an application start instruction input by the user, displaying a shooting interface;

Receiving the first instruction input by the user on the shooting interface.
An application control device is characterized in that it is applied to a terminal device, and the terminal device is provided with a camera device. The application control device includes a receiving module, an acquiring module, an identifying module, a determining module, a displaying module, and a photographing module, wherein ,

The receiving module is configured to receive a first instruction input by a user;

The acquiring module is configured to acquire a first image acquired by the camera when the first instruction is a long-press instruction;

The identification module is configured to identify a first object in the first image;

The determining module is configured to determine an identifier of a page corresponding to the first object when the recognition module identifies a first object in the first image;

The display module is configured to display an identifier of the page;

The photographing module is configured to perform photographing through the imaging device when the first instruction is a click instruction.
The apparatus according to claim 6, wherein the determining module is specifically configured to:

Acquiring object information of the first object, where the object information includes an object category and an object attribute of the first object;

An identifier of the page is determined according to the object information.
The apparatus according to claim 7, wherein the determining module is specifically configured to:

Determining an application corresponding to the object category;

An identifier of the page is determined according to the object attribute and the application, and the page is a page in the application.
The method according to any one of claims 6 to 8, wherein:

The shown display module is further configured to display a shooting interface when the first instruction is a long-press instruction and the recognition module does not recognize a first object in the first image.
The method according to any one of claims 6 to 8, wherein:

The display module is specifically configured to display a shooting interface after receiving a start instruction of an application program input by a user;

Accordingly, the receiving module is specifically configured to receive the first instruction input by a user on the shooting interface.