WO2019184140A1

WO2019184140A1 - Vr-based application program opening method, electronic apparatus, device and storage medium

Info

Publication number: WO2019184140A1
Application number: PCT/CN2018/095356
Authority: WO
Inventors: 刘真
Original assignee: 平安科技（深圳）有限公司
Priority date: 2018-03-27
Filing date: 2018-07-12
Publication date: 2019-10-03
Also published as: CN108509231A; CN108509231B

Abstract

The present application discloses a VR-based application program opening method, and belongs to the field of virtual reality technology. The method comprises the following steps: S1, storing an association relationship between an application program and an object in a pre-stored picture; S2, photographing an image by means of a camera on a terminal device, and recognizing an object having a clear contour from the photographed image; S3, comparing the recognized object with the object in the stored association relationship, and determining whether there is an object identical to the recognized object in the stored association relationship, if so, executing S4, otherwise, directly ending; S4, acquiring the icon of an application program associated with the identical object, and displaying same in the photographed image; and S5, opening the application program corresponding to the icon after the icon is triggered by the user. The present application can enable a user to quickly find the icon of a corresponding application program by using a familiar item, without the need for the user to search and find by themselves, improving the usage efficiency of the application program.

Description

VR-based application opening method, electronic device, device and storage medium

The application claims the priority of the Chinese patent application entitled "VR-based application opening method, electronic device, device and storage medium", which is filed on March 27, 2018, with the application number of 20110125924. The content is incorporated herein by reference.

Technical field

The present application relates to the field of virtual reality technologies, and relates to a VR-based application opening method, an electronic device, a device, and a storage medium.

Background technique

Smart terminals can be extended by installing applications, so users can install a wide variety of applications based on their needs.

At present, smart terminals are increasingly favored by young consumers, who can watch TV, novels, play games, and shopping through smart terminals. As the application gets more and more, the icons are more and more, and often the icons we need to find will be buried by a lot of other icons.

In general, users open applications by clicking different icons. In order to quickly find the applications they need, it is common to use different files to classify icons. But even if the icons are classified, there are more folders and more icons in the folder, it will be more difficult to find, which will take more time and reduce the efficiency of use.

Summary of the invention

The technical problem to be solved by the present application is to overcome the problem that the existing application cannot be quickly found from a pile of applications in the prior art, and a VR-based application opening method, an electronic device, a device and a storage medium are proposed. Quickly find the corresponding icons by familiar items around you to open the applications you need to use and improve the user's efficiency.

The present application solves the above technical problems by the following technical solutions:

A VR-based application opening method includes the following steps:

S1, saving an association relationship between the application and an object in the pre-stored picture;

S2: capturing an image with a clear outline from the captured image by taking a picture through a camera on the terminal device;

S3. Comparing the identified object with the object in the saved association relationship, determining whether there is an object identical to the identified object in the saved association relationship, and if yes, executing S4, if otherwise, directly ending;

S4. An icon of an application that acquires the same object is displayed in a photographed screen, where the icon is an original icon of the application, and the icon is clicked to start an application;

S5. Open the application corresponding to the icon after the icon is triggered by the user.

An electronic device, on which the VR-based application opening system is stored, the VR-based application opening system includes:

An association module, configured to save an association relationship between an application and an object in a pre-stored picture;

a shooting module, configured to capture an image with a clear outline from the captured image by taking a picture through a camera on the terminal device;

a comparison module, configured to compare the identified object with the object in the saved association relationship;

a display module, configured to display an icon of an application associated with the same object in a captured image when the same object as the recognized object exists in the saved association relationship;

The application opening module is configured to open an application corresponding to the icon after the icon is triggered by the user.

A terminal device includes a memory and a processor on which is stored a VR-based application openable system executable by the processor, the system being implemented by the processor to perform the operations of the following steps:

A computer readable storage medium having stored therein a VR based application opening system, the VR based application opening system being executable by at least one processor to cause the at least one The processor performs the following steps:

The positive progress of the application is that the applicant can quickly find the icon of the corresponding application through the familiar items, avoiding the user's own search and search, and improving the use efficiency of the application.

DRAWINGS

1 is a flowchart of Embodiment 1 of a VR-based application opening method of the present application;

2 is a flowchart of Embodiment 2 of a VR-based application opening method of the present application;

Figure 3 shows a picture containing a wallet and banknotes;

Figure 4 shows two screenshots of the wallet and banknotes taken from Figure 3;

FIG. 5 is a flowchart of Embodiment 3 of a VR-based application opening method of the present application;

6 is a schematic diagram showing a program module of a first embodiment of a VR-based application opening system in an electronic device of the present application;

FIG. 7 is a schematic diagram showing the icon floating display of the Alipay APP in the center of the shooting screen;

FIG. 8 is a schematic diagram showing the hardware architecture of an embodiment of a terminal device of the present application.

Reference mark:

终端设备Terminal Equipment	22
基于VR的应用程序打开系统VR-based application opens the system	2020
存储器Memory	21twenty one
处理器processor	22twenty two
网络接口Network Interface	23twenty three
摄像头camera	24twenty four
关联模块 Association module	201201
拍摄模块 Shooting module	202202
比对模块 Alignment module	203203
显示模块 Display module	204204
应用打开模块Application open module	205205
流程步骤Process step	S1-S5，S11-S15，S21-S23S1-S5, S11-S15, S21-S23

The implementation, functional features and advantages of the present application will be further described with reference to the accompanying drawings.

detailed description

The present application is further illustrated by the following examples, but is not intended to limit the scope of the embodiments.

First of all, the present application proposes a VR-based application opening method.

In the first embodiment, as shown in FIG. 1, the VR-based application opening method includes the following steps:

S1. Save the relationship between the application and the objects in the pre-stored picture.

Step S1 is set by the user in advance on the terminal device, and only the application that has saved the association relationship can be opened by the method, otherwise it has no effect.

The association between the object and the application is realized by writing the information of the screenshot formed by the object into the configuration file of the application, and specifically, the display position, brightness, color, and the like of the aforementioned screenshot written in the configuration file of the application are required.

The pre-stored picture refers to an existing picture saved in the memory of the terminal device.

It should be pointed out that an application can be associated with several objects, so that the same application can be found by different objects identified; in addition, an object can also be associated with multiple applications, so subsequent identification may be An object that comes out finds multiple different applications at the same time.

The identification of the object in the pre-stored picture is the same as the description of the object outline recognition in step S2.

S2: The image is captured by the camera on the terminal device, and an object having a clear outline is recognized from the captured image.

The photographing screen refers to photographing by using a camera on the terminal device, that is, the terminal device must have a camera or a camera that can be used, and the screen photographed by the camera can be displayed on the terminal device.

The identification of the contour of the object in the method can be identified by the phase color difference method, which mainly includes the following four steps:

First, the input image is preprocessed. The common method is to use a small two-dimensional Gaussian template for smoothing filtering to remove image noise. The small-scale template is used to ensure the accuracy of subsequent contour positioning, because large-scale smoothing often Will result in a smooth transition, which blurs the edges and greatly affects subsequent edge detection.

Secondly, the edge detection processing is performed on the smoothed image to obtain a preliminary edge response image, which usually involves brightness, color and the like, and the gradient feature information that can distinguish the object from the background.

Then, the edge response is further processed to obtain a better edge response image.

Finally, the precise positioning of the contour is usually divided into two processes: the first step is to refine the edge response image to obtain a single pixel edge image. This process is generally adopted by the non-maximum suppression method (local maximum search). Non-maximum suppression can very effectively refine the ridge strips in the gradient magnitude image, leaving only the points with the largest local variation. The second step is to perform binarization processing based on the lag threshold. The lag threshold uses the recursive tracking algorithm to ensure that the final contour image is continuous.

S3: Comparing the identified object with the object in the saved association relationship, determining whether there is an object identical to the recognized object in the stored association relationship, and if yes, executing S4, if not, ending directly.

It should be noted that the same object refers to two objects whose similarity obtained by the feature point based image similarity calculation method exceeds a preset threshold. For example, if the preset threshold is 80%, then when the similarity of the two objects based on the image similarity of the feature points is calculated to be more than 80%, it is judged that the two are the same object.

S4. An icon for acquiring an application associated with the same object is displayed in a photographed screen, the icon is an original icon of the application, and the icon is clicked to launch an application.

The original icon refers to the icon that the application publisher has configured for the application.

In order for the user to quickly see the icon of the application, it is preferable to display the icon in the center of the captured picture.

However, since there may be more than one object having a clear outline recognized from the captured image, further, there may be multiple objects in the plurality of saved associations that are identical to the identified plurality of objects, and this is recognized more Groups of the same object may be associated with the same application, or may be associated with multiple different applications. When multiple different applications are associated, multiple different application icons may be displayed on the captured screen at the same time. Will be displayed in a floating manner.

Since the foregoing has explained that there may be more than one icon displayed, the application cannot be automatically launched after the icon is found, but the user needs to trigger the icon that he wants to open before the corresponding application can be started.

Through this method, the user can quickly find the icon of the corresponding application by using the familiar items, avoiding the user's own searching and searching for the application, which wastes time and improves the application efficiency.

In the second embodiment, based on the first embodiment, as shown in FIG. 2, the S1 specifically includes the following sub-steps:

S11. Select a picture from the pre-stored picture as the selected picture.

When setting the association between an object and an application, only one image is processed at a time. If it is necessary to associate objects in multiple images with the same application, the association setting is required multiple times.

S12. Identify an object having a distinct outline from the selected picture, the object being at least one.

A picture may contain more than one object with a distinct outline. This step is intended to identify all objects with a distinct outline in the picture for use.

S13. Perform separate screenshots and temporarily store each of the identified objects;

Since multiple objects exist in one picture, and the association between the object and the application is set one by one, if the picture containing multiple objects is directly associated with the application, then in the subsequent comparison The uncertainty will increase, so here is a screenshot for each object, each object is saved as a single image, and in a separately saved image, the object has a distinct outline, except that the same background color is used. For example, all use a white background color.

S14. Select at least one screenshot from the temporarily stored screenshot to associate with the selected application;

The screenshot is a picture of an object with only a distinct outline, when multiple screenshots need to be associated with the same application, or multiple screenshots are associated with different applications, or a screenshot and more When a different application is associated, the association is performed in a one-to-one correspondence relationship, and after the pair is set, the second pair is further set, and the association relationship is sequentially set by the foregoing method.

S15. Save the relationship between the screenshot and the application.

The association refers to the display position, brightness, color, and the like of the foregoing screenshot written in the configuration file of the application by writing the information of the screenshot into the configuration file of the application.

After the relationship between the screenshots obtained from one image and the application is set, these one-to-one associations are uniformly saved today.

If there are other pictures that need to intercept the object and make association settings, the above steps are repeated from step S11.

The following is an example of the user's association between the screenshot and the application in the smartphone:

1. The user finds a picture containing the wallet and banknotes from the album of the mobile phone (as shown in Figure 3).

2. By identifying the outline of the object in the picture, two screenshots of the wallet and the banknote are identified (as shown in FIG. 4).

3. Save these two screenshots separately, which is recorded as a wallet screenshot and a banknote screenshot.

4, first select the wallet screenshot and Alipay APP to associate, and then select the banknote screenshot is also associated with the Alipay APP.

5. The relationship between the wallet screenshot and the Alipay APP and the relationship between the banknote screenshot and the Alipay APP are saved.

In the third implementation, based on the second embodiment, as shown in FIG. 5, the S2 specifically includes the following sub-steps:

S21. Start a camera shooting screen on the terminal device.

The camera on the terminal device may be built-in or externally connected, as long as the final captured picture can be displayed on the display of the terminal device.

S22. Capture a picture from the captured picture at a preset intercept time interval.

Since the shooting described in the foregoing steps refers to photography, and the recognition of the outline of the object is based on the static picture, it is necessary to intercept the static picture from the captured dynamic video, and can be set to take a picture every 100 ms. The specific interval is set according to the actual situation.

S23. Identify an object with a distinct outline from the intercepted picture.

The object contour recognition described herein is the same as that of the object contour described in the first embodiment, and can also be identified by the phase color difference method, which will not be described again.

Secondly, the present application proposes an electronic device on which a VR based application open system 20 is stored, which system 20 can be partitioned into one or more program modules.

For example, FIG. 6 shows a schematic diagram of a program module of the first embodiment of the VR-based application opening system 20. In this embodiment, the system 20 can be divided into an association module 201, a shooting module 202, and a comparison module. 203. The display module 204 and the application open module 205. Wherein, the program module referred to in the present application refers to a series of computer program instruction segments capable of performing a specific function. The following description will specifically describe the specific functions of the program modules 201-205.

The association module 201 is configured to save an association relationship between the application and an object in the pre-stored picture.

The association module is used to preset the association relationship between the object and the application, and only the application that has saved the association relationship can be opened by the system, otherwise it does not have any effect.

For specific settings, only one image is processed at a time. If you need to associate objects in multiple images with the same application, you need to set the association multiple times. At the same time, a picture may contain more than one object with a distinct outline. These objects need to be taken out from a picture. Each object is saved as a picture separately, and in a separately saved picture, the object has an obvious The outline of the image is the same as the background color, such as a white background color.

These separately saved images can be associated with different applications or associated with the same application (ie, the same application can be found when any subsequent object is captured), and the settings are pressed. The one-to-one correspondence is associated, and after the pair is set, the second pair is further set, and the association relationship is sequentially set by the foregoing method.

The shooting module 202 is configured to capture a picture with a clear outline from the captured picture by taking a picture through a camera on the terminal device.

The camera on the terminal device may be built-in or externally connected, as long as the final captured picture can be displayed on the display of the terminal device. For example, when the terminal device is a smart phone or a tablet computer, the camera is usually built-in; and when the terminal device is a desktop computer, the camera is usually external.

The comparison module 203 is configured to compare the identified objects with the objects in the saved association relationship.

The shooting module driving the camera shooting refers to photography, and the recognition of the contour of the object is based on the static picture, so the static picture needs to be intercepted from the captured dynamic video, and can be set to take a picture every 100 ms. The specific interval is set according to the actual situation.

Further, the same object refers to two objects whose similarity obtained by the feature point based image similarity calculation method exceeds a preset threshold. For example, if the preset threshold is 80%, then when the similarity of the two objects based on the image similarity of the feature points is calculated to be more than 80%, it is judged that the two are the same object.

The display module 204 is configured to display an icon of an application associated with the same object in a captured image when the same object as the recognized object exists in the saved association relationship.

In addition, since there may be a plurality of objects having a clear outline recognized from the captured image, further, it is possible that a plurality of objects in the plurality of saved associations are identical to the plurality of identified objects, and the recognized Multiple sets of identical objects may be associated with the same application, or may be associated with multiple different applications. When multiple different applications are associated, multiple different application icons may be displayed simultaneously on the captured image. The icons are displayed in a floating manner.

The application opening module 205 is configured to open an application corresponding to the icon after the icon is triggered by the user.

The program module in this system specifically uses the phase color difference method to identify the contour of the object, which mainly includes the following four steps:

The following is an example of a user using a smart phone with a VR-based application installed to open the system:

1. The user saves the relationship between the wallet and the Alipay APP and the relationship between the banknote and the Alipay APP in advance in the smart phone. The specific setting steps are the same as the second embodiment of the method, and are not described here.

2. When the user needs Alipay payment, the camera on the smart phone is opened to shoot the banknotes seen, and the complete coins are identified from the photographed banknotes.

3. Compare the identified coins with the objects in the saved relationship and find the coins in the coin screenshot.

4. Acquire an Alipay APP associated with the coin screenshot, and then display the icon of the Alipay APP in the center of the shooting screen (as shown in FIG. 7).

5. The user clicks on the icon of the Alipay APP displayed to open Alipay for payment operation.

Through the use of the system, the user can quickly find the icon of the corresponding application by using the familiar items, avoiding the user's own search and searching for the application, which wastes time and improves the application efficiency.

Again, the present application also proposes a terminal device.

FIG. 8 is a schematic diagram of a hardware architecture of an embodiment of a terminal device of the present application. In the present embodiment, the terminal device 2 is a device capable of automatically performing numerical calculation and/or information processing in accordance with an instruction set or stored in advance. For example, it can be a smartphone, a tablet, a laptop, a desktop computer, a rack server, a blade server, a tower server, or a rack server (including a stand-alone server, or a server cluster composed of multiple servers). As shown, the terminal device 2 includes at least, but not limited to, a memory 21, a processor 22, a network interface 23, a camera 24, and a VR-based application open system 20 via a system bus. among them:

The memory 21 includes at least one type of computer readable storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), Static Random Access Memory (SRAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Programmable Read Only Memory (PROM), magnetic memory, magnetic disk, optical disk, and the like. In some embodiments, the memory 21 may be an internal storage unit of the terminal device 2, such as a hard disk or memory of the terminal device 2. In other embodiments, the memory 21 may also be an external storage device of the terminal device 2, such as a plug-in hard disk equipped on the terminal device 2, a smart memory card (SMC), and a secure digital device. (Secure Digital, SD) card, flash card, etc. Of course, the memory 21 may also include both the internal storage unit of the terminal device 2 and its external storage device. In this embodiment, the memory 21 is generally used to store an operating system installed in the terminal device 2 and various types of application software, for example, the program code of the VR-based application opening system 20 and the like. Further, the memory 21 can also be used to temporarily store various types of data that have been output or are to be output.

The processor 22 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data processing chip in some embodiments. The processor 22 is typically used to control the overall operation of the terminal device 2, such as performing control and processing related to data interaction or communication with the terminal device 2. In this embodiment, the processor 22 is configured to run program code or process data stored in the memory 21, such as running the VR-based application to open the system 20 or the like.

The network interface 23 may comprise a wireless network interface or a wired network interface, which is typically used to establish a communication connection between the terminal device 2 and other terminal devices. For example, the network interface 23 is configured to connect the terminal device 2 to an external terminal through a network, establish a data transmission channel, a communication connection, and the like between the terminal device 2 and an external terminal. The network may be an intranet, an Internet, a Global System of Mobile communication (GSM), a Wideband Code Division Multiple Access (WCDMA), a 4G network, or a 5G network. Wireless or wired networks such as network, Bluetooth, Wi-Fi, etc.

The camera 24 is configured to be activated or deactivated by the camera module 202 for capturing objects that are visible everywhere around the user. Generally speaking, if the terminal device 2 is a smart phone or a tablet computer, the camera 24 is generally a built-in camera on a smartphone or a tablet, including a front camera or a rear camera; if the terminal device 2 is a notebook computer, the camera 24 Generally, the camera built in the top of the display screen on the notebook computer can also be connected to the external camera; if the terminal device 2 is a desktop computer, the camera 24 is generally an external camera.

It is pointed out that Figure 8 only shows the terminal device 2 with the components 21-23, but it should be understood that not all illustrated components are required to be implemented, and more or fewer components may be implemented instead.

In the present embodiment, the VR-based application open system 20 stored in the memory 21 can be executed by one or more processors (the processor 22 in this embodiment) to complete the VR-based application described above. Open the operation of the method.

Moreover, the present application is a computer readable storage medium having stored therein a VR based application open system 20, when the VR based application open system 20 is executable by one or more processors, The above-described VR-based application opening method or operation of the electronic device is implemented.

While the embodiments of the present invention have been described above, it will be understood by those skilled in the art that the scope of the invention is defined by the appended claims. A person skilled in the art can make various changes or modifications to these embodiments without departing from the spirit and scope of the present application, and such changes and modifications fall within the scope of the present application.

Claims

A VR-based application opening method, comprising the steps of:

S1, saving an association relationship between the application and an object in the pre-stored picture;

S2: capturing an image with a clear outline from the captured image by taking a picture through a camera on the terminal device;

S3. Comparing the identified object with the object in the saved association relationship, determining whether there is an object identical to the identified object in the saved association relationship, and if yes, executing S4, if otherwise, directly ending;

S4. An icon of an application that acquires the same object is displayed in a photographed screen, where the icon is an original icon of the application, and the icon is clicked to start an application;

S5. Open the application corresponding to the icon after the icon is triggered by the user.
The VR-based application opening method according to claim 1, wherein S1 comprises the following sub-steps:

S11. Select a picture from the pre-stored picture as the selected picture.

S12. Identify an object having a clear outline from the selected picture, the object is at least one;

S13. Perform separate screenshots and temporarily store each of the identified objects;

S14. Select at least one screenshot from the temporarily stored screenshot to associate with the selected application;

S15. Save the relationship between the screenshot and the application.
The VR-based application opening method according to claim 1, wherein

S2 includes the following substeps:

S21. Start a camera shooting screen on the terminal device;

S22. Capture a picture from the captured picture according to a preset interception time interval;

S23. Identify an object with a distinct outline from the intercepted picture.
The VR-based application opening method according to claim 1, wherein the same object refers to two objects whose similarity obtained by the feature point based image similarity calculation method exceeds a preset threshold.
The VR-based application opening method according to claim 1, wherein the icon is suspended in the center of the captured picture in S4.
The VR-based application opening method according to claim 1, wherein when a plurality of objects having a clear outline are identified from the captured image, and a plurality of saved association relationships exist and are identified. When a plurality of objects having the same object are respectively displayed, an application associated with each of the same objects is displayed on the captured screen.
The VR-based application opening method according to any one of claims 1 to 6, wherein the object is identified by a phase difference color difference method.
An electronic device, wherein the electronic device stores a VR-based application opening system, and the VR-based application opening system includes:

An association module, configured to save an association relationship between an application and an object in a pre-stored picture;

a shooting module, configured to capture an image with a clear outline from the captured image by taking a picture through a camera on the terminal device;

a comparison module, configured to compare the identified object with the object in the saved association relationship;

a display module, configured to display an icon of an application associated with the same object in a captured image when the same object as the recognized object exists in the saved association relationship;

The application opening module is configured to open an application corresponding to the icon after the icon is triggered by the user.
A terminal device includes a memory and a processor, wherein the memory stores a VR-based application opening system executable by the processor, and the system implements the following steps when executed by the processor Operation:

S1, saving an association relationship between the application and an object in the pre-stored picture;

S2: capturing an image with a clear outline from the captured image by taking a picture through a camera on the terminal device;

S3. Comparing the identified object with the object in the saved association relationship, determining whether there is an object identical to the identified object in the saved association relationship, and if yes, executing S4, if otherwise, directly ending;

S4. An icon of an application that acquires the same object is displayed in a photographed screen, where the icon is an original icon of the application, and the icon is clicked to start an application;

S5. Open the application corresponding to the icon after the icon is triggered by the user.
The terminal device according to claim 9, wherein S1 comprises the following substeps:

S11. Select a picture from the pre-stored picture as the selected picture.

S12. Identify an object having a clear outline from the selected picture, the object is at least one;

S13. Perform separate screenshots and temporarily store each of the identified objects;

S14. Select at least one screenshot from the temporarily stored screenshot to associate with the selected application;

S15. Save the relationship between the screenshot and the application.
The terminal device according to claim 9, wherein S2 comprises the following substeps:

S21. Start a camera shooting screen on the terminal device;

S22. Capture a picture from the captured picture according to a preset interception time interval;

S23. Identify an object with a distinct outline from the intercepted picture.
The terminal device according to claim 9, wherein the same object refers to two objects whose similarity obtained by the feature point based image similarity calculation method exceeds a preset threshold; when from the captured picture When a plurality of objects having a distinct contour are identified, and a plurality of objects having the same identity as the plurality of identified objects are present in the plurality of saved association relationships, respectively, the same objects are displayed in the captured image. application.
The terminal device according to claim 9, wherein the icon is suspended in the center of the captured picture in S4.
The terminal device according to any one of claims 9 to 13, characterized in that the object is identified by a phase difference color difference method.
A computer readable storage medium, wherein the computer readable storage medium stores a VR based application opening system, the VR based application opening system being executable by at least one processor to enable The at least one processor performs the operations of the following steps:

S1, saving an association relationship between the application and an object in the pre-stored picture;

S2: capturing an image with a clear outline from the captured image by taking a picture through a camera on the terminal device;

S3. Comparing the identified object with the object in the saved association relationship, determining whether there is an object identical to the identified object in the saved association relationship, and if yes, executing S4, if otherwise, directly ending;

S4. An icon of an application that acquires the same object is displayed in a photographed screen, where the icon is an original icon of the application, and the icon is clicked to start an application;

S5. Open the application corresponding to the icon after the icon is triggered by the user.
The computer readable storage medium of claim 15 wherein S1 comprises the following substeps:

S11. Select a picture from the pre-stored picture as the selected picture.

S12. Identify an object having a clear outline from the selected picture, the object is at least one;

S13. Perform separate screenshots and temporarily store each of the identified objects;

S14. Select at least one screenshot from the temporarily stored screenshot to associate with the selected application;

S15. Save the relationship between the screenshot and the application.
The computer readable storage medium of claim 15 wherein S2 comprises the following substeps:

S21. Start a camera shooting screen on the terminal device;

S22. Capture a picture from the captured picture according to a preset interception time interval;

S23. Identify an object with a distinct outline from the intercepted picture.
The computer readable storage medium according to claim 15, wherein the same object refers to two objects whose similarity obtained by the feature point based image similarity calculation method exceeds a preset threshold; When a plurality of objects having a clear outline are recognized in the screen, and a plurality of objects having the same identity as the plurality of identified objects are present in the plurality of saved associations, the same objects are displayed on the captured screen. Associated application.
The computer readable storage medium according to claim 15, wherein said icon is suspended in the center of the captured picture in S4.
The computer readable storage medium according to any one of claims 15 to 19, wherein the object is identified by a phase difference color difference method.