WO2023082817A1

WO2023082817A1 - Application program recommendation method

Info

Publication number: WO2023082817A1
Application number: PCT/CN2022/118236
Authority: WO
Inventors: 毛璐; 王晨博; 潘宇欣; 孙甜甜; 李一博
Original assignee: 荣耀终端有限公司
Priority date: 2021-11-12
Filing date: 2022-09-09
Publication date: 2023-05-19
Also published as: CN116126197A

Abstract

The present application provides an application program recommendation method. The method comprises: an electronic device displays a first text and a second text on a display interface of a first application; in response to a first operation of a user on the first text, a first icon corresponding to a second application is displayed on the display interface; in response to a second operation of the user on the first icon, the electronic device displays an interface of the second application corresponding to the first icon; the user can also adjust a selected file, and in response to a third operation of the user on the first text and the second text, the electronic device displays a second icon corresponding to a third application on the display interface; and in response to a fourth operation of the user on the second icon, the electronic device displays an interface of the third application corresponding to the second icon. By means of the application program recommendation method, the electronic device can directly recommend an application according to a text selected by a user, such that the user does not need to exit the first application and search for a target application from a large number of applications in a desktop, the operation is convenient, and the time consumed by the user for searching for the application can be saved.

Description

App Recommendation Method

This application claims the priority of a Chinese patent application with application number 202111341981.2 and application title "Application Recommendation Method" filed with the China Patent Office on November 12, 2021, the entire contents of which are incorporated herein by reference.

technical field

The present application relates to the field of terminal equipment, and in particular to a method for recommending application programs.

Background technique

Currently, a large number of applications are usually installed in smart terminal electronic devices such as mobile phones and tablets. When using such electronic devices, users often encounter the need to find applications for content in text or pictures, for example, the text contains addresses and the user wants to find a map application for navigation. At this time, the user needs to exit the current text and search for the navigation application from a large number of applications contained in the main interface. The operation process is cumbersome and time-consuming, resulting in poor user experience.

Contents of the invention

The present application provides a method for recommending an application, by which an application can be recommended based on a text selected by a user, without requiring the user to manually search for a target application from a large number of applications installed in an electronic device, thereby improving user experience.

In some embodiments, the electronic device may display the second text on the display interface of the first application in response to the user's first operation on the first text displayed on the display interface of the first application, such as copying, selecting, clicking or long pressing. The first icon corresponding to the application recommends application information to the user in the form of the first icon, and the user performs the second operation on the first icon, which triggers the electronic device to display the interface of the second application, without requiring the user to exit the first application. Searching for the second application in the application, the operation is convenient and can save the time spent by the user in searching for the application. Not only that, the user can also adjust the selected text, and the electronic device responds to the user's third operation on the first text and the second text, and displays on the display interface the third application corresponding to the text analysis of the first text and the second text. the second icon; the electronic device responds to the user's fourth operation on the second icon, and displays the interface of the third application corresponding to the second icon, and the user can flexibly adjust the selected text to trigger the system to recommend different applications. The operation is convenient and It can improve the fun of app recommendation.

In a first aspect, the present application provides a method for recommending an application, which is applied to an electronic device, wherein the method includes: the electronic device displays the first text and the second text on the display interface of the first application; the electronic device responds to the The first operation of the user on the first text displays the first icon corresponding to the second application on the display interface of the first application, so as to recommend the second application to the user. When the user wants to open the second application, the first icon can be executed The second operation is, for example, a click operation, and the electronic device displays the interface of the second application corresponding to the first icon in response to the user's second operation on the first icon. Wherein, both the first operation and the third operation may include but not limited to: click, copy, select or long press operation, and the first application may include but not limited to: gallery, real-time screenshot, browser, memo and short message, etc. When the user wants to adjust the selected text to trigger the electronic device to re-recommend the application, the third operation can be performed on the text displayed on the display interface of the first application again, and the electronic device responds to the user's third operation on the first text and the second text , the second icon corresponding to the third application is displayed on the display interface, wherein the second icon is obtained according to the text analysis of the first text and the second text; when the user wants to switch to the third application, the second icon can be executed In a fourth operation, the electronic device displays the interface of the third application corresponding to the second icon in response to the user's fourth operation on the second icon. Wherein, both the fourth operation and the second operation may include but not limited to: single click, double click, or long press.

In this way of application program recommendation, the electronic device can recommend applications to the user according to the text selected by the user, and the user can trigger the electronic device to open the corresponding application by performing a second operation on the recommended application icon, without the need for the user to log out of the first application and start the application from the electronic device. Find the target application from a large number of applications installed on the device, which is convenient to operate and can save the time spent on application search.

According to the application program recommendation method of the first aspect, the first text includes: plain text or text recognized by image OCR. Sources of plain text may include, but are not limited to: browsers, memos, and short messages. The source of the picture may include but not limited to: gallery, real-time screenshot, browser or social software, etc. This application recommendation method can not only perform application recommendation for plain text, but also can perform application recommendation for text in pictures, and has strong universality.

According to the first aspect, or any implementation manner of the above first aspect, before the electronic device displays the first text and the second text on the display interface of the first application, the method further includes: the electronic device responds to the user at the first The fifth operation on a picture in an application is to display the picture in the display interface of the first application; if the picture includes text, display a first button, wherein the first button is used to trigger OCR recognition of the displayed picture to obtain The first text and the second text; when the user wants to obtain the text recognized by OCR, the sixth operation can be performed on the first button. The first button, the electronic device responds to the sixth operation of the first button by the user, and highlights it in the display interface The first text and the second text recognized by OCR are displayed. The fifth operation may include but not limited to operations such as single click, double click, long press, and two-finger click, and the sixth operation may include but not limited to operations such as single click, double click, or long press. This method of OCR recognition of pictures is simple and convenient to operate.

According to the first aspect, or any implementation manner of the above first aspect, when the electronic device highlights the first text and the second text on the display interface, the electronic device highlights the first text obtained by performing OCR recognition on the picture on the display interface. A text and a second text, and display an underline under the first text and the second text, wherein the first text and the second text are preset entities, and the preset entities may include but not limited to: address, code, ID number , phone number, courier tracking number, website, email address, foreign language, Taobao password or Douyin password. This method of adding an underline to the preset entity for display, on the one hand, is convenient for the user to intuitively know which preset entities are, on the other hand, the user can click on some preset entities or the underline to select the preset entity without using the cursor Move and select multi-text text in the text, which is convenient for users to operate. It should be noted that, for non-preset entities in the OCR recognition results, they can be highlighted but not underlined.

According to the first aspect, or any implementation manner of the above first aspect, the method further includes: canceling display of the first icon on the display interface when the electronic device detects that the user performs a third operation on the second text. In this method of canceling the display of the icon of the last recommended application during the process of adjusting the selected text, since the icon is canceled, the text that the user wants to select will not be blocked, which is convenient for the user to operate.

According to the first aspect, or any implementation manner of the above first aspect, the method further includes: the electronic device responds to the user's seventh operation on the third text and the second text, and displays the second text corresponding to the second application on the display interface. An icon and a third icon corresponding to the fourth application; wherein, the first text includes the third text, and the first icon and the third icon are obtained according to the text analysis of the first text and the third text; The eighth operation of the icon is to display the interface of the fourth application corresponding to the third icon; in response to the user's third operation on the first text and the second text, the electronic device displays the second icon corresponding to the third application on the display interface, wherein , the second icon is obtained according to the text analysis of the first text and the second text; in response to the user's fourth operation on the second icon, an interface of the second application corresponding to the first icon is displayed.

The seventh operation may be the same as the first operation in the foregoing manner, and the eighth operation may be the same as the second operation in the foregoing manner, which will not be repeated here. In this application program recommendation method, when the third text selected by the user is not related to the first text, the electronic device performs text analysis on the third text to determine the fourth application, and performs text analysis on the first text to determine the second application. application, and then recommend the third icon of the fourth application and the first icon of the second application, without requiring the user to manually search for icons. When the first text selected by the user is related to the second text, the electronic device performs text analysis on the first text and the second text to determine the third application, and recommends the second icon corresponding to the third application. The application recommendation method is flexible and diverse. .

According to the first aspect, or any implementation manner of the above first aspect, when the electronic device displays the first icon corresponding to the second application on the display interface of the first application in response to the user's first operation on the first text, it includes : The electronic device displays a floating ball on a display interface of the first application in response to a user's click operation on the first text, wherein the floating ball includes a first icon of the second application obtained by performing text analysis on the first text. The first icon of the second application is displayed in the form of a floating ball. On the one hand, the floating display of the floating ball can always be kept at the top of the screen to avoid being covered by other content; on the other hand, the floating ball covers a small screen area, which can avoid excessive coverage Image content; the third is to directly display the first icon of the second application to be more eye-catching, which is convenient for the user to determine whether the second application is an application to be switched.

According to the first aspect, or any implementation manner of the above first aspect, the electronic device displays the first icon corresponding to the second application on the display interface of the first application in response to the user's first operation on the first text, including: In response to the user's click operation on the first text, the electronic device displays a floating window on the display interface of the first application, the floating window includes service options obtained by performing text analysis on the first text, and the service options include at least the service options corresponding to the second application. Service options. In this method of recommending a matching service option list according to the first text selected by the user, multiple service options are recommended at the same time, which is convenient for the user to find the target option from the recommended service options.

According to the first aspect, or any implementation manner of the above first aspect, the first operation includes: click, copy, select and long press. Clicking can include but not limited to: single-finger click, single-finger double-click, two-finger click, etc. Copying can include moving the cursor in the text and selecting the first text to display a menu bar containing copy options. The user clicks the copy option to complete the first text copy. There is no specific limitation on the specific duration of the long press, for example: long press for 1 second, 2 seconds or 3 seconds. This way of setting the first operation in a variety of ways makes the setting of the first operation more flexible.

According to the first aspect, or any implementation manner of the above first aspect, the electronic device displays the first icon corresponding to the second application on the display interface of the first application in response to the user's first operation on the first text, including: In response to the user's selection operation on the first text, the electronic device displays a floating ball corresponding to the second application on the display interface of the first application, wherein the first text includes a plurality of combinable preset entities, and the floating ball includes the second The first icon corresponding to the second application. In this application recommendation method, when it is recognized that the first text contains a plurality of combinable preset entities, only one application is recommended, that is, the first icon corresponding to the second application, and the recommendation result is more accurate, which is convenient for the user to select.

According to the first aspect, or any implementation manner of the above first aspect, the electronic device displays the first icon corresponding to the second application on the display interface of the first application in response to the user's first operation on the first text, including: In response to the user's selection operation on the first text, the electronic device displays a floating window on the display interface of the first application, wherein the first text includes multiple non-combinable preset entities, the floating window includes multiple application icons, and multiple The application icons include at least the first icon of the second application. In this application recommendation method, when it is recognized that the first text contains multiple non-combinable preset entities, since the user’s true intention is uncertain, multiple application recommendations are recommended for the user to choose, which is convenient for the user to select the second entity that the user wants to switch to. application.

According to the first aspect, or any implementation manner of the above first aspect, the electronic device displays the first icon corresponding to the second application on the display interface of the first application in response to the user's first operation on the first text, including: In response to the user's copy operation on the first text, the electronic device displays a floating window on the display interface of the first application, the floating window includes multiple application icons, and the multiple application icons include the first icon corresponding to the second application. In this application recommendation method, when the copied first text does not contain preset entities, since the user’s true intention is not sure, multiple application recommendations are recommended for the user to choose, which is convenient for the user to select the second desired switch. application.

According to the first aspect, or any implementation manner of the above first aspect, the second operation includes: single click, double click and long press. Single-click can include but not limited to: single-finger single-click, double-finger single-click, double-click can also include but not limited to: single-finger double-click, two-finger double-click, there is no specific limit for the specific duration of long press, for example: long press Press for 1 second, 2 seconds or 3 seconds, etc. This way of setting the second operation in a variety of ways makes the setting of the second operation more flexible.

In a second aspect, the present application further provides a method for recommending an application program, the method is applied to an electronic device, and the method includes: the electronic device responds to the user's first operation on the first text in the first application, such as clicking, long pressing or copying , identify the preset entity contained in the first text; in the case of the preset entity contained in the first text, determine the information to be recommended based on the preset entity contained in the first text; if the preset entity is not contained in the first text In the case of , the information to be recommended is determined based on the content of the first text, wherein the information to be recommended includes: an application icon or a list of services; the first icon is displayed on the display interface of the first application, and the first icon corresponds to the information to be recommended .

This application program recommendation method recommends an application or service list based on the first text selected by the user. The user clicks on the second application from the recommendation to trigger the electronic device to open the second application. Searching for a second application among a large number of installed applications is convenient and can save time spent on application search.

According to the application program recommendation method of the second aspect, before the electronic device responds to the user's first operation on the first text in the first application, the method further includes: the electronic device responds to the user's second operation on the picture in the first application Operations such as: click, long press and other operations to display a picture in the display interface of the first application; identify whether the picture contains text; if the picture contains text, perform OCR recognition on the picture to obtain the second text; display the second text A button, wherein the first button is used to trigger the display of the second text; when the user previews the OCR recognition result, the third operation can be performed on the first button, and the electronic device responds to the user's third operation on the first button, and displays The second text is highlighted in the interface, where the second text includes the first text. This method of OCR recognition of pictures is simple and convenient to operate.

According to the first aspect, or any implementation manner of the above first aspect, in the case that the first text contains preset entities, determining the information to be recommended by the electronic device based on the preset entities contained in the first text includes: In the case of a single preset entity included in a text, the electronic device determines a second application or service list that matches the preset entity included in the first text. In this way of recommending a single application or service list based on a single preset entity, the recommended content is more in line with user expectations. For example, the default entity is the Taobao password. When the user checks the Taobao password, it is very likely that he wants to open the Taobao application, so the Taobao application is recommended to the user. There is no need for users to manually find the Taobao application from the desktop.

According to the first aspect, or any implementation manner of the above first aspect, in the case that the first text contains preset entities, determining the information to be recommended by the electronic device based on the preset entities contained in the first text includes: When a text contains multiple preset entities, the electronic device determines whether the multiple preset entities can be combined; if the multiple preset entities can be combined, a third application is determined based on the multiple preset entities. In this application recommendation method, when it is recognized that the first text contains a plurality of combinable preset entities, only one application, that is, the second application, is recommended, and the recommendation result is more accurate, which is convenient for the user to select. For example: when it is recognized that the first text includes a name, a phone number, and an address, it is determined that the user is likely to want to switch to a shopping application, and therefore a shopping application is recommended.

According to the first aspect, or any implementation manner of the above first aspect, when the electronic device determines that multiple preset entities cannot be combined, respectively determine the fourth application that each of the included preset entities matches, and convert the determined Multiple fourth applications are determined as recommended information. In this application recommendation method, when it is recognized that the first text contains multiple non-combinable preset entities, since the user's real intention is uncertain, multiple application recommendations are recommended for the user to choose, so that the user can select the desired application. For example, when the first text includes foreign language, Taobao password and address, since these three preset entities cannot be combined, the application translation application, map application and shopping application corresponding to each preset entity are respectively recommended.

According to the second aspect, or any implementation of the above second aspect, in the case that the first text does not contain a preset entity, determining the information to be recommended based on the content of the first text includes: the electronic device in the first text In the case of not including the preset entity, perform feature extraction on the first text; determine the first application classification and the second application classification matching the first text based on the extracted features; filter out the first preset from the first application classification The number of fifth applications; the second preset number of sixth applications are filtered out from the second application category; the fifth application and the sixth application are determined as information to be recommended. Wherein, the first preset number is greater than the second preset number, and the specific values of the first preset number and the second preset number can be flexibly set by those skilled in the art, and there is no specific limitation in this solution. In this application recommendation method, when the first text does not contain a preset entity, since the user's true intention is uncertain, multiple application recommendations are recommended for the user to choose, so that the user can select the second application desired to switch.

According to the second aspect, or any implementation manner of the above second aspect, the first icon includes: a floating ball or a floating window. The screen area covered by the floating ball is small, and the floating window can display more content. The electronic device can adaptively select the first icon style according to the content of the information to be recommended.

According to the second aspect, or any implementation method of the above second aspect, the preset entity may include but not limited to: address, code, ID number, phone number, courier number, website, email address, foreign language, Taobao password Or Douyin password. The preset entities can be flexibly adjusted by those skilled in the art. Multiple preset entities are set, and corresponding application recommendation information is preset for each preset entity, so as to facilitate reliable application recommendation for users during use.

In a third aspect, the present application provides a computer-readable medium for storing a computer program, the computer program including instructions for executing the method in any possible implementation of the first aspect or the second aspect, or including using Instructions for executing the method in any possible implementation manner of the first aspect or the second aspect.

In a fourth aspect, the present application provides a computer program, the computer program includes instructions for executing the method in any possible implementation of the first aspect or the second aspect, or includes instructions for executing the method of the first aspect or the second aspect An instruction for a method in any possible implementation of an aspect.

Description of drawings

FIG. 1 is a schematic diagram of a hardware structure of an exemplary electronic device;

FIG. 2 is a schematic diagram of a software structure of an exemplary electronic device;

FIG. 3 is a schematic diagram of an interface for performing OCR recognition on pictures in a gallery;

FIG. 4A is a schematic diagram of an interface for application recommendation based on a single preset entity;

Fig. 4B is an exemplary interface schematic diagram showing a service list recommendation based on a single preset entity;

FIG. 5 is a schematic diagram of an interface for recommending applications based on the Taobao password;

FIG. 6 is a sequence flow chart of interaction between a user and a device when recommending an application based on a single preset entity in a picture;

Fig. 7 is an exemplary diagram showing a change in the interface when recommending applications based on multiple associated preset entities selected by the user twice successively;

Fig. 8 is another schematic diagram of interface changes when recommending applications based on multiple preset entities selected twice by the user;

FIG. 9 is an exemplary diagram showing a change in the interface when recommending an application list based on multiple non-associated preset entities selected by the user twice successively;

Fig. 10 is a sequence flow chart of the interaction between the user and the device when recommending applications based on multiple preset entities in the picture;

Fig. 11 is a schematic diagram of an interface for recommending applications based on pictures that do not contain preset entities;

FIG. 12 is a sequence flow chart of the interaction between the user and the device when recommending applications based on picture content.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

The term "and/or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and/or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations.

The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects, rather than to describe a specific order of objects. For example, the first target object, the second target object, etc. are used to distinguish different target objects, rather than describing a specific order of the target objects.

In the embodiments of the present application, words such as "exemplary" or "for example" are used as examples, illustrations or illustrations. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of the present application shall not be interpreted as being more preferred or more advantageous than other embodiments or design schemes. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete manner.

In the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

The method for recommending application programs in the embodiments of the present application may be applied to a scenario where text in a first application of the same electronic device is copied to a second application.

In an example, the scenario may be, for example, copying and pasting text from applications such as a browser, memo, email, and WeChat into other applications that are different from the source application of the text. In this example, text within the application can be directly selected, copied, or clicked.

In another example, the scenario may be, for example: copying and pasting target text in an optical character recognition (Optical Character Recognition, OCR) recognition result of a picture into an application. Among them, the pictures can come from the gallery, real-time screenshots, browsers, WeChat, QQ and other applications. The embodiment of this application does not limit the source of the picture. In this example, the text in the application comes from the OCR recognition result of the picture, and the text in the picture cannot be directly selected before OCR recognition.

For example, a courier photo contains information such as address information, phone number, recipient, etc., and the user wants to add the address information to the delivery address of a shopping application. At this time, the application recommendation method in the embodiment of this application can be applied, and the address information in the photo can be pasted into the delivery address of the shopping application.

The application of optical character recognition technology can recognize the character strings in the picture. These recognized character strings are the OCR recognition results of the pictures as text. The target text selected by the user in the OCR recognition results can be called the first text, the second text etc. In the OCR recognition result of the picture, the character string can be further judged whether it is a preset entity, such as: address, code, ID number, phone number, courier number, website, email address, foreign language, Taobao password or Douyin password etc., the user can single-select or multi-select the preset entities in the OCR recognition result, and the user can select and copy the non-preset entities in the OCR recognition result to select the target text. After selecting the target text, the user usually wants to paste the target text into the text input box of an application or a service, and the system will recommend the application or service list based on the target text, so that the user can select the target application or service, and paste the target text Paste into the target application or target service. Wherein, an application may also be called an application program, an application corresponding to a target application or a target service may also be called an application triggered by the system after the user clicks on a recommended icon, and the application currently displaying the picture may also be called the first application.

The target text selected by the user may have the following situations: first, it contains a single preset entity; second, it contains multiple preset entities with association relationships; third, it contains multiple preset entities without association relationships. Fourth, it does not contain default entities. Depending on the preset entities contained in the target text, the system will use different recommendation methods to recommend applications or service lists. When the target text contains a single preset entity, the system recommends a single application or service list; when the target text contains multiple preset entities with associated relationships, the system recommends a single application or service list; In the case that there is no preset entity of association relationship, the system recommends the taskbar, which may also be called a recommended application list, and in the case that the target text does not contain the preset entity, the system recommends the taskbar. Wherein, the task bar includes multiple recommended applications. For the recommendation process and specific recommendation content of the application or service list under various circumstances, please refer to the relevant description below.

The application interaction method in the embodiments of the present application may be applied to electronic devices. The electronic device may be, for example, a mobile phone, a tablet, and the like. FIG. 1 is a schematic structural diagram of an electronic device 100 exemplarily shown. It should be understood that the electronic device 100 shown in FIG. 1 is only an example of an electronic device, and the electronic device 100 may have more or fewer components than those shown in the figure, and two or more components may be combined , or can have different component configurations. The various components shown in FIG. 1 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

Referring to Fig. 1, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142 , antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193 , a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.

The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100 .

FIG. 2 is a schematic block diagram showing the software structure of the electronic device 100 according to the embodiment of the present application.

The layered architecture of the electronic device 100 divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces. In some embodiments, the Android system is divided into four layers, which are application program layer, application program framework layer, Android runtime (Android runtime) and system library, and kernel layer respectively from top to bottom.

The application layer can consist of a series of application packages.

As shown in Figure 2, the application package may include applications such as sensors, cameras, image galleries, OCR engines, application recommendation modules, third-party applications, and screenshots.

Among them, the OCR engine can be used to perform OCR recognition on the picture, and recognize the preset entity in the OCR recognition result; the picture can be a screenshot obtained by a screenshot application, or a photo taken by a camera application, or a gallery The pictures stored in , etc., the embodiment of this application does not limit the source of the pictures.

The application recommendation is used to predict an application or service list related to the target text content according to the target text content, and recommend the predicted application to the user. Third-party applications are used to provide pictures or provide text information that can be selected and copied.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

As shown in Figure 2, the application framework layer may include a view system, a resource manager, a window manager, an activity manager, and the like.

Wherein, the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and the like. The view system can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.

A window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.

The activity manager is used to manage the life cycle of each application program and the navigation fallback function, and is responsible for creating the main thread of Android and maintaining the life cycle of each application program.

Android runtime includes core library and virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

The core library includes two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android (Android).

The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application program layer and the application program framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

The system library may include multiple functional modules, such as a surface manager (surface manager) and the like.

The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

The kernel layer is the layer between hardware and software. The kernel layer can contain modules such as display drivers and sensor drivers.

It can be understood that the layers in the software structure shown in FIG. 2 and the components included in each layer do not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or fewer layers than shown, and each layer may include more or fewer components, which is not limited in the present application.

For the convenience of description, the electronic device will be referred to as a device for short in the following text. It should be understood that the devices mentioned herein can have the same hardware structure (such as the hardware structure shown in FIG. 1 ) and the same software structure (such as the software structure shown in FIG. 2 ) as the electronic device 100 in the foregoing embodiments. ).

In the embodiment of the present application, the specific flow of the application recommendation method of the present application is described by taking three scenarios, namely, that the target text selected by the user contains a single entity, multiple entities, and no entity, as examples.

The process of recommending an application when the target text selected by the user contains a single entity is described below with reference to FIGS. 3 to 6 . FIG. 6 is an exemplary diagram showing a sequence flow chart of interaction between a user and a device when recommending an application based on a single entity in a picture. The process of recommending an application includes the following steps:

S1: The user clicks picture a in the gallery.

S2: The device displays the picture a on the device screen in response to clicking the picture a.

The user can perform the operation of clicking the picture in various situations, thereby displaying the picture on the device screen. The device here may be, for example, a mobile phone, a tablet, and the like. In this document, the device is a mobile phone as an example for illustration. It should be understood that the description in this document taking a mobile phone as an example is also applicable to other non-mobile devices, such as a tablet.

S3: The device detects whether there are texts in the picture a, and if there are texts, obtains the OCR recognition result of the picture a.

For example, FIG. 3 is a schematic diagram of an interface for performing OCR recognition on pictures in a gallery. Please refer to Figure 3. In an exemplary implementation, the user can click the "Gallery" icon in the main interface of the mobile phone (see (a) of Figure 3), and after clicking the "Gallery" icon, enter the "Gallery" icon. ” The internal interface of the application, the interface display at this time is shown in Figure 3 (b). Please refer to figure (b) of 3, the "Gallery" includes picture a, picture 1, picture 2, picture 3, picture n and other pictures. The user can continue to click on the picture on the interface shown in (b) of FIG. 3 . For example, suppose the user clicks on picture a.

At this time, the mobile phone displays the picture a on the screen of the mobile phone in response to clicking on the picture a, as shown in FIG. 3( c ). Figures (a) to (c) in FIG. 3 are illustrated by taking the access to the image display interface from the gallery as an example. It should be noted that the present application does not limit the way of entering the image display interface. For example, in other embodiments of the present application, it is also possible to enter the picture display interface by clicking on the screenshot picture after taking a screenshot, or to enter the picture display interface by clicking on a picture in the web page during web browsing, or to enter the picture display interface through During the chatting process of social communication software, click the picture in the chat interface to enter the picture display interface. You can also enter the picture display interface by clicking the picture in the circle of friends or the official account, etc., and will not list them here. .

Please continue to refer to FIG. 3 , after the picture a is displayed, the application recommendation method in the embodiment of the present application further detects whether there is text in the picture a. If there is text in picture a, get the OCR recognition result of picture a. If there is no text in the picture a, the flow of the application recommendation method in the embodiment of the present application ends.

In the embodiment of the present application, the device may obtain the OCR recognition result of picture a in various ways.

In an exemplary implementation process, if the storage data of picture a includes the OCR recognition result of picture a, the device may directly read the OCR recognition result of picture a from the storage data of picture a.

In another exemplary implementation process, if the stored data of picture a does not include the OCR recognition result of picture a, the device can call the OCR engine of the application layer shown in Figure 2 to perform real-time OCR recognition of picture a, from the OCR The OCR recognition result of picture a is obtained from the output data of the engine.

Wherein, the OCR engine is used to perform OCR recognition on the picture, and output the OCR recognition result of the picture.

S4: If the OCR recognition result of picture a is obtained, an OCR button pops up on the screen of the device.

In this step, the OCR recognition button that pops up on the device screen is not turned on. For the device interface at this time, please refer to (d) of FIG. 3 . When the user does not click the OCR recognition button in (d) of FIG. 3 , characters such as text in picture a cannot be selected or copied.

At this time, the user may click the OCR button to trigger subsequent operations of highlighting the OCR recognition result and adding an underline to the preset entity contained in the OCR recognition result.

If the device does not detect the operation of clicking the OCR button within the preset period of time after the OCR button pops up on the screen, it can be confirmed that the user has not selected the target text from the OCR recognition results to trigger the system to recommend applications. At this time, the device may actively stop displaying the OCR button on the device screen, that is, the OCR identification button disappears from the interface of picture a. The preset duration can be flexibly set by those skilled in the art, for example: set to 2 seconds, 3 seconds, 5 seconds, etc., which is not specifically limited in this embodiment of the present application.

In an exemplary implementation process, if the user does not need to select the target text from the OCR recognition result to trigger the system to recommend an application, the user can also click anywhere other than the OCR button. At this time, the device detects that the user clicks any place other than the OCR button, and may stop displaying the OCR button on the device screen. In this way, the device passively stops displaying the OCR button based on user actions.

Of course, in another exemplary implementation process, if the user does not need to select the target text from the OCR recognition result and trigger the system to recommend the application, the device can also keep the OCR button in the off state.

S5: the user clicks the OCR button.

The device detects the user's click operation on the OCR button, which can confirm that the user has the need to select the target text from the OCR recognition results to trigger the system to recommend applications.

The click operation on the OCR button is not limited to the single click operation shown in FIG. 3d, and may also be a double click or long press operation.

S6: In response to the click operation on the OCR button, the device highlights the OCR recognition result of the picture a on the device screen, and adds an underline to the recognized preset entity.

Preset entity information is managed in the system, and the preset entity information can be stored in the form of a list. Preset entities may include but are not limited to: name, address, code, ID card number, phone number, courier number, website, email address, foreign language, Taobao password or Douyin password, etc. The preset entities can be added, deleted or modified flexibly by those skilled in the art.

Refer to (e) of FIG. 3 for the interface after the user clicks the OCR button. At this point, the OCR recognition result is highlighted, and an underline is added under the preset entity. The characters in the OCR recognition result shown in (e) of FIG. 3 are selectable, clickable, and copyable.

It should be noted that, FIG. 3( e ) is only an exemplary way of displaying the OCR recognition result and highlighting the preset entities in the OCR recognition result. In the actual implementation process, those skilled in the art can set it flexibly, and the present application does not limit the display mode of the OCR recognition result.

For example, in one example, a border is added to the characters in the OCR recognition result to indicate that the OCR recognition result is selectable, clickable or copyable. In another example, a frame may be added to the characters in the OCR recognition result and the frame may be filled with a background color different from that of the picture background.

The OCR recognition results in Figure 3(e) include three preset entities: "recipient: xxx", "telephone: 151xxxxxx", "xx building, xx Road, Haidian District, Beijing", and add to these three preset entities Underline to remind the user which of the recognized OCR recognition results are preset entities. It should be noted that, in FIG. 3( e ), it is only an example of emphasizing the preset entity by adding an underline to the preset entity for illustration. In the actual implementation process, the device may display in other preset emphatic display methods. For example, the device can highlight entities with a color that distinguishes them from non-preset entities, or set a background color for entities that is different from other non-preset entity texts in the OCR recognition results, etc. The emphatic display mode of the default entity is not limited.

The entity recognition method can be realized based on NLU (Natural Language Understanding, natural language understanding) technology. The NLU system can be set in the OCR engine, or can be set separately in other functional modules. In the embodiment of the present application, the NLU system is set in the OCR engine as an example for illustration.

The NLU system imitates the basic way humans understand language, that is, sentence segmentation, word segmentation, etc., and cuts the text into a series of semantic and grammatical units. Of course, there are also some segmentation methods that do not conform to human intuition, such as segmentation methods such as N-gram algorithm and byte pair encoding, and the string units divided into are not words. For this reason, the word "token" is usually used to represent the string unit obtained by text segmentation.

Based on the token sequence, the NLU system uses text representation models such as word vector space models and distributed representation models to obtain a numerical vector or matrix. This matrix is the numerical representation of the text. Many algorithms in the field of artificial intelligence can only deal with numerical data. And some algorithms, such as the text similarity calculation method based on the bag of words model, can directly process string sequences, and can also deal with text representations in the form of numerical vectors. Therefore, people often use exponential vectors or matrices as a unified textual representation within a system. The NLU system will represent data based on text, use classification algorithms, sequence labeling methods, etc., to calculate "key information" in the text, such as entities, triples, intentions, events, and so on. In the embodiment of the present application, the OCR recognition result can be used as the text to be segmented, and the NLU system can be used to identify the file to be segmented, and recognize the preset entity contained in the OCR recognition result.

S7: The user clicks to select a single preset entity in the OCR recognition result.

After the OCR recognition result of picture a is displayed in the interface, the user can select a preset entity by clicking on any position of the preset entity or the underline corresponding to the preset entity.

S8: The device recommends a single application or service list according to the selected preset entity in response to the operation of selecting the preset entity.

The preset entity selected by the user is the target text selected by the user. When the user selects a single preset entity, the system recommends a single application or service list based on the single preset entity. The preset entity selected by the user is different, and the single application or service list recommended based on the preset entity is different.

The system can preset the correspondence between preset entities and applications, preset entities and service lists, and the correspondence can be stored in the storage area in the form of a list or in other forms. For the convenience of subsequent descriptions, the list can be named as The recommendation rule list, it should be noted that in the embodiment of the present application, there is no limitation on the specific name of the list including the correspondence between preset entities and applications, preset entities and service lists. When the system determines a single preset entity selected by the user, the system may query the list of applications or services corresponding to the preset entity selected by the user from the recommendation list for recommended display.

Please refer to Figure 4A. Figure 4A is a schematic diagram of an interface for application recommendation based on a single preset entity. As shown in Figure 4A(a), the user clicks "×× Building, ×× Road, Haidian District, Beijing" For this entity, the system determines that the preset entity selected by the user is an address, searches for the recommended application corresponding to the address from the recommendation rule list, finds that the recommended application is a map application, and the system can select one or more of the map applications installed on the device. Multiple map apps for recommendations. An exemplary schematic diagram of an interface displaying a single map application is shown in FIG. 4A(b). On the right side of the interface, a recommended single application icon "Map Application A" 401 is floating and displayed, and the user can click "Map Application A" Trigger the system to open the map application A, and then add "XX Building, ×× Road, Haidian District, Beijing" to the map application A to view the navigation route. The icon of a single application may be displayed in the form of a floating ball, and the recommended application icons are included in the floating ball.

When the system determines that a map application needs to be recommended and searches for a map application from the map applications installed in the device for final recommendation, it can randomly select a map application from the map applications installed in the device for the final recommendation; Regarding the frequency of use of each map application, a map application with the highest frequency of use is selected for final recommendation, which is not specifically limited in this embodiment of the present application.

It should be noted that FIG. 4A(b) is only a schematic diagram of an interface for recommending a single application, and the icons of multiple recommended single applications are not limited to being displayed on the right side of the interface, and may also be displayed on the interface to the left, middle, or any other appropriate location. The icon of a single application can also be displayed in the taskbar. For the relevant description of the taskbar, please refer to the relevant introduction of the taskbar when recommending multiple applications below.

Please refer to FIG. 4B. FIG. 4B is another schematic diagram of an interface for application recommendation based on a single preset entity. As shown in FIG. 4B(a), the user clicks on the preset entity "Phone: 151xxxxxxx", The system determines that the preset entity selected by the user is a phone number, searches for the recommended application corresponding to the phone number from the recommendation rule list, and finds out that the phone number corresponds to the recommended first service list. The first service list includes: call phone service options, send Messaging service options, Add to Contacts service options, and Copy service options. After finding the first service list, the system recommends the first service list in the interface. An exemplary schematic diagram of the interface displaying the first service list is shown in Fig. The first service list 402, the first service list includes: "call phone", "send message", "add to address book" and "copy" service options, the user can click on any service option to trigger the system to jump to this In the target interface corresponding to the service option, the user can manually or automatically add "Phone: 151xxxxxxx" to the target input box in the target interface. The recommended service list may be displayed in the form of a floating window, and each recommended service option is displayed in the floating window.

FIG. 4A uses the address in the OCR recognition result of the picture selected by the user to recommend a single map application, and FIG. 4B uses the phone number in the OCR recognition result of the picture selected by the user to recommend the first service list as an example for illustration. Referring to FIG. 5 , which is an exemplary interface for recommending applications based on Taobao passwords, the process of recommending Taobao applications by the system for the Taobao passwords in the OCR recognition results of pictures selected by users will be described.

Please refer to the process of OCR recognition of the picture in Figure 3. After the OCR engine performs OCR recognition on the picture containing the Taobao password "Xixi:/ah FfthxKgYVSh Wei Shi Gaozhi's Glorious Years Full Set...more information", as shown in Figure 5 (a ), highlight the OCR recognition result in the interface, and add an underline under the preset entity "Xixi:/ah FfthxKgYVSh Micro Scrooge's Glory Years Full Set...More Information". As shown in Figure 5(b), the user clicks "Xixi:/ah FfthxKgYVSh full set of Wei Shi Gaozhi's glory days... more information", and the terminal receives the user's selection of "Xixi:/ah FfthxKgYVSh Wei Shi Gaozhi's glory days full set ... more information" to determine that the target text selected by the user is the Taobao password, and search for the application or service list corresponding to the Taobao password from the recommendation rule list, and determine that the Taobao password corresponds to the Taobao application through the search. Therefore, the system recommends Taobao in the interface Application, an exemplary schematic diagram of the interface displaying the recommended Taobao application is shown in Figure 5(c). The "Taobao application" icon is displayed floating on the right side of the interface, and the user can click the "Taobao application" icon to trigger a system jump In the Taobao application, the user can manually or automatically add the Taobao password selected by the user to the corresponding interface in the Taobao application.

Fig. 4A, Fig. 4B and Fig. 5 are only examples showing the corresponding relationship between the three entities and the application or service list. The specific corresponding relationship contained in the recommended rule list can be flexibly set by those skilled in the art. Exemplary correspondences included in the recommended rule list may include:

Address recommends a single map app, a foreign language recommends a single translation app, a courier number recommends a shopping app, a Taobao password recommends a Taobao app, a Douyin password recommends a Douyin app, etc.

The phone number corresponds to the recommended first service list, which may include but not limited to: "call phone", "send message", "add to address book" and "copy" service options. The ID card number corresponds to the recommended second service list, which may include but not limited to "add to address book", "copy", "share" and "previous switching application" service options.

Codes may include but not limited to payment codes, identification QR codes, etc. Codes correspond to the recommended third service list, which may include but not limited to: "open in xxx app", "open in browser", "copy link" , "Share" and "Add to Notes" and other service options. The URL corresponds to the recommended fourth service list, which may include but not limited to: "Open Link", "Add to Link List", "Copy Link", and "Share" and other service options. The email address corresponds to the recommended fifth service list, which may include but not limited to: service options such as "create email", "copy" and "share".

The embodiment of this application provides a way to recommend an application or service list based on a single preset entity selected by the user. On the one hand, after the system automatically performs OCR recognition on the text in the picture, the OCR recognition result can be selected and copied. Displayed to the user, the user can directly select the target text, so that the target text can be added to the corresponding input box in the target application or service later, without the need for the user to manually enter the target text, which is convenient to operate and can avoid the problem of user editing errors. In the second aspect, after the user selects a single preset entity, the system lists a single application or service based on the single preset entity selected by the user, and the user clicks on the service option in the recommended application or service list to jump to the target interface without After the user copies the target text, he leaves the gallery and performs tedious operations manually to enter the target interface.

The following describes the process of recommending applications when the target text selected by the user contains multiple preset entities with reference to FIGS. 7 to 10 . FIG. 10 is an exemplary flow chart showing the interaction between the user and the device when recommending applications based on multiple preset entities in the picture. The application recommendation process includes the following steps:

S1: The user clicks picture b in the gallery.

S2: The device displays picture b on the device screen in response to clicking picture b.

S3: The device detects whether there are texts in the picture b, and if there are texts, obtains the OCR recognition result of the picture b.

S4: If the OCR recognition result of picture b is obtained, an OCR button pops up on the screen of the device.

S5: the user clicks the OCR button.

S6: In response to the click operation on the OCR button, the device highlights the OCR recognition result of the picture b on the device screen, and adds an underline to the recognized preset entity.

S1 to S6 shown in FIG. 10 are the process of performing OCR recognition on picture b in the gallery, recognizing preset entities in the OCR recognition result, and displaying the OCR recognition result. For this process, it is enough to refer to the specific description of S1 to S6 in FIG. 6 , which will not be repeated here.

S7: Click to select multiple preset entities in the OCR recognition result.

Please refer to Fig. 7, which is an exemplary schematic diagram of interface changes when recommending applications based on multiple associated preset entities selected by the user twice successively. The schematic diagram of the interface showing picture b is shown in Fig. 7(a) As shown, the OCR recognition result of picture b in the interface is highlighted and an underline is added under the preset entities "Recipient: xxx", "Phone: 151xxxxxx", "xx Building, xx Road, Haidian District, Beijing". The user can control the cursor on the screen with a finger to select multiple preset entities, as shown in Figure 7(b), there are cursors at the start position and end position of the preset entity selected by the user's finger, and the selected preset entity Assuming that the background fill color of the entity has changed to indicate that the preset entity circled by the cursor has been selected, after the user completes the action of selecting the preset entity, as shown in Figure 7(b), the system displays the function menu bar, the function The menu bar includes functional options such as "Select All", "Cut" and "Copy". The selected target text in Fig. 7(b) can be regarded as the first text.

It should be noted that Fig. 7(b) is only an exemplary way of selecting multiple preset entities. In the actual implementation process, the user can click each preset entity successively within the second preset duration, Multiple preset entities are thus selected. The second preset duration is a shorter duration, for example: 1 second or 1.5 seconds.

S8: The device determines whether the multiple preset entities can be combined in response to the selection operation on the multiple preset entities.

The system recognizes the number of preset entities contained in the target text, and when it recognizes that multiple preset entities are included, for example, as shown in Figure 7(b) contains 2 preset entities, it determines the number of preset entities contained in the target text Whether there is an association relationship, if the determination result indicates that there is an association relationship, the recommended single application is determined based on each preset entity with the association relationship. Determining whether the preset entities can be combined means determining whether the preset entities have an association relationship. If multiple preset entities have an association relationship, it is determined that they can be combined; otherwise, it is determined that they cannot be combined.

The system stores associations with preset entities, and the associations between preset entities can be stored in an association list, and each association includes multiple preset entities and the type of application recommended by the association. After the system recognizes the preset entity of the target text selected by the user, it determines the N preset entities contained in the target text, and searches for the matching relationship of the N preset entities from the list of association relationships. If there is, determine the N preset entities The entity is a preset entity that can be associated; otherwise, if it does not exist, it is determined that the N preset entities are non-associated default entities. Wherein, N is an integer greater than or equal to 2.

The association relationship list can be combined with the recommendation rule list, or can exist independently. The specific content included in the association relationship list can be flexibly set and modified by those skilled in the art, and is not specifically limited in this embodiment of the present application. For example, the relationship list may include: the first relationship: name-phone-address-shopping application, the second relationship: name-ID number-ticket swiping applet, etc.

S9: If the multiple entities can be combined, the device recommends a single application based on the combined entity; if the multiple entities cannot be combined, the device recommends a taskbar containing multiple applications based on the multiple entities.

When it is determined that the N preset entities included in the target text selected by the user are associated preset entities, then search for the recommended application type corresponding to the association relationship between the N preset entities from the association relationship list. After the application type is determined, a target application may be selected from the applications of the application type installed in the device for recommendation.

Screening rules can be set by those skilled in the art according to actual needs, for example: random screening, screening based on application usage frequency, etc. can be set.

Continue to refer to Figure 7(c) Since the two preset entities "recipient: xxx" and "telephone: 151xxxxxx" are determined by the system as preset entities with an association relationship, these two preset entities can be determined by searching the association relationship list Assume that the entity corresponds to the phone application, so the system only displays the phone application icon 701 when recommending. The user can click the phone application icon 701 to enter the interface of the phone application and make a call. As shown in Figure 7(c), after completing a single application recommendation, the target text selected by the user is still highlighted and underlined under the preset entity, so that the user can re-select the preset entity to trigger the system to download. A round of app recommendations.

After the user selects "recipient: xxx" and "telephone: 151xxxxxx" to trigger the system for application recommendation, if he wants to adjust the selected target text to trigger the system to make application recommendation again, he can do it as shown in Figure 7(d ) to manually adjust the cursor to adjust the selected target text, and adjust the selected target text to "Recipient: xxx", "Phone: 151xxxxxx", "xx Building, xx Road, Haidian District, Beijing", and adjust the selected target text During the writing process, the phone application icon 701 recommended last time disappears. In this specific example, "xx Building, xx Road, Haidian District, Beijing" is the newly added text selected by the user, which may be regarded as the second text.

Continuing to refer to Figure 7(e) Since the three preset entities "recipient: xxx", "telephone: 151xxxxxx" and "xx building, xx Road, Haidian District, Beijing" are determined by the system as preset entities with a relationship, It can be determined that these three preset entities correspond to shopping applications by looking up the association relationship list, so the system only recommends a single shopping application such as "shopping application B" 701 when recommending.

As shown in Figure 7, in the application recommendation method based on multiple associable preset entities provided by this application, whether the user selects 2 or 3 or more preset entities, the selected preset entities are associable In the case of , the system recommends a single application.

As shown in Figure 7, when it is determined that the target text selected by the user contains multiple preset entities that can be associated, a single application program is recommended. The recommended application matches the user's expectations with a high degree of matching, and the user directly clicks on the recommended application. The icon can be used to enter the target application, and the user does not need to exit from the current interface, and then manually find the target application from the desktop to enter the target application, which is convenient to operate.

Please refer to FIG. 8 . FIG. 8 is a schematic diagram illustrating another interface change when application recommendation is performed based on multiple preset entities selected by the user twice successively.

The schematic diagram of the interface showing picture b is shown in Figure 8(a). In the interface, the OCR recognition result of picture b is highlighted and displayed in the preset entities "Recipient: xxx", "Phone: 151xxxxxx", "Beijing Add an underline under "XX Building, XX Road, Haidian District". As shown in Figure 8(b), the user selects "Tel: 151xxxxxx", "xx Building, xx Road, Haidian District, Beijing" as the target text, and after the user completes the preset entity selection action, as shown in Figure 8(b), The system displays a function menu bar, which includes options such as "Select All", "Cut" and "Copy". The selected target text in FIG. 8 can be regarded as the first text. The device judges that the two preset entities "Phone: 151xxxxxx" and "xx Building, xx Road, Haidian District, Beijing" are phone numbers and addresses, and the two cannot be associated. It is determined that the phone number corresponds to the recommended phone application, and the address corresponds to the recommended navigation application. As shown in FIG. 8( c ), the icon of the phone application and the icon of the navigation application A are recommended in the task bar 801 . In addition, an add button 802 may also be displayed in the task bar 801 , and for the description of the add button 802 , please refer to the above-mentioned relevant description, and details will not be repeated here.

After app recommendation, the two preset entities selected by the user, "Tel: 151xxxxxx" and "xx Building, xx Road, Haidian District, Beijing", remain selected. The user may click on the recommended application icon in the taskbar to trigger the system to enter the application corresponding to the selected application icon.

Not only that, after the user selects "Tel: 151xxxxxx" and "xx Building, xx Road, Haidian District, Beijing" for application recommendation, if the user wants to adjust the selected target text to trigger the system to re-apply Recommended, you can manually adjust the cursor to adjust the selected target text as shown in Figure 8(d), and adjust the selected target text to "Recipient: xxx", "Tel: 151xxxxxx", "xx Road, Haidian District, Beijing Building", the last recommended task bar 801 disappears during the process of adjusting the selected target text. In this specific example, the newly added text selected by the user as "recipient xxx" can be regarded as the second text.

Continuing to refer to Figure 8(e) Since the three preset entities "recipient: xxx", "telephone: 151xxxxxx", and "xx building, xx Road, Haidian District, Beijing" are determined by the system to be preset entities with a relationship, It can be determined that these three preset entities correspond to shopping applications by looking up the association relationship list, so the system only recommends a single shopping application such as "shopping application B" when recommending.

As shown in Figure 8, the application recommendation method based on multiple pre-associated preset entities provided by this application, when the multiple pre-set entities selected by the user are non-associated entities, respectively based on the selected pre-set entities For application recommendation, the user can adjust the selected target text after completing a recommendation. If the adjusted target text contains multiple preset entities that can be associated, the system will recommend a single application. It can be seen that when the system recommends applications, it does not only recommend based on the number of preset entities selected by the user, but also considers the associability of the selected preset entities.

Please refer to Fig. 9, which is a schematic diagram of interface changes when recommending applications based on multiple non-associated preset entities selected by the user twice successively. In FIG. 9, the picture b containing English, Taobao password and address is taken as an example for illustration. Figure 9(a) to Figure 9(b) is the process in which the user selects multiple preset entities in the displayed OCR recognition results, the process can refer to the relevant descriptions in Figure 7(a) to (b), and will not be described here Let me repeat. In the displayed OCR results, underlines are only added to preset entities, and non-default entities are not underlined. As shown in Figure 9(a), the "receipt address" is not a preset entity, and no underline is added below these four words.

The user selects three preset entities: "Name: TOM", "Xixi:/ah FfthxKgYVSh Wei Shi Gaozhi's Glorious Years Complete Set...More Information" and "×× Building ×× Road, Haidian District, Beijing", and the system determines that the three The preset entities are foreign language, Tao password and address. Matching these three preset entities with the association relationship stored in the association relationship list, the association relationship cannot be matched, so these three preset entities are determined to be non-association presets entity. The system finds from the list of recommendation rules that the recommended application corresponding to the foreign language is a translation application, the recommended application corresponding to the Taobao password is a shopping application such as Taobao application, and the recommended application corresponding to the address is a map application. Determine target applications "translation application A", "map application B" and "shopping application C", and generate a task bar 901 including "translation application A", "map application B" and "shopping application C" , a schematic diagram of an interface displaying a task bar is shown in FIG. 9( c ). The sorting of the recommended application icons in the taskbar is consistent with the sorting of the selected preset entities in the picture. In addition to multiple recommended applications, the task bar may also include an add button 902 .

Correspondingly, when wanting to display application icons of other applications (such as translation application B) other than "translation application A", "map application B" and "shopping application C" in the taskbar, the user can click The button 902 is added. At this time, the taskbar may display "shopping application C", "map application B" and "translation application D" sequentially from top to bottom. The user can switch the recommended application icons in the task bar by clicking the add button 902 . The task bar 901 can also be regarded as a floating window.

It should be noted that, continuing to refer to Figure 9, if only one translation application, one map application, and one shopping application are installed in the device, only one translation application and one map application may be displayed on the taskbar when recommending applications. As well as an icon of a shopping application, the add button 902 may not be displayed because there is no other application to switch between recommendations.

Continuing to refer to Figure 9(d), after the user selects the three unrelated preset entity trigger systems shown in Figure 9(c) for application recommendation, if he wants to adjust the selected target text trigger system to make application recommendation again, he can As shown in Figure 9(d), manually adjust the cursor to adjust the selected target text, and adjust the selected target text to "receipt address: xx Building, xx Road, Haidian District, Beijing". The recommended task bar 901 disappears once, and the system recommends map application B based on the user-adjusted target text "delivery address: xx building, xx Road, Haidian District, Beijing".

In the application recommendation method shown in Figure 9, after the user selects the target text from the image OCR recognition results to trigger the system to make an application recommendation, he can also adjust the selected target text to trigger the system to make another application recommendation. After adjusting the selected target During the writing process, the previous application recommendation information disappears. It should be noted that the above is only an example of adjusting the target text once. In the actual implementation process, the user can adjust the target text twice or more, and each adjustment of the target text can trigger the system to re-recommend the application.

In the embodiment of the present application, the control corresponding to the task bar is located at the top of the screen, so that the recommended application list can be prevented from being covered by other interfaces on the device screen, which will affect the subsequent operation of selecting an application from the recommended application list.

It should be understood that the above method of determining the recommended application list according to the target text content is only an illustrative example, and the embodiment of the present application does not limit the specific method of determining the recommended application list according to the target text content.

As shown in FIG. 9 , when it is determined that the target text selected by the user contains multiple non-associated preset entities, multiple application programs are recommended. The recommended applications are strongly related to the preset entities selected by the user, providing The task bar contains multiple applications for the user to choose. After the user determines the target application from the recommended applications, he can directly click the corresponding application icon to enter the target application. There is no need for the user to exit from the current interface and then manually search for the target application from the desktop. After application, enter the target application, and the operation is convenient.

The following describes the process of recommending an application when the target text selected by the user does not contain a preset entity with reference to FIGS. 11 to 12 . Fig. 12 is an exemplary flow chart showing the interaction between the user and the device when recommending an application based on picture content, the application recommending process includes the following steps:

S1: The user clicks picture c in the gallery.

S2: The device displays the picture c on the device screen in response to clicking the picture c.

S3: The device detects whether there are texts in the picture c, and if there are texts, obtains the OCR recognition result of the picture c.

S4: If the OCR recognition result of picture c is obtained, an OCR button pops up on the screen of the device.

S5: the user clicks the OCR button.

S6: In response to the click operation on the OCR button, the device highlights the OCR recognition result of picture c on the device screen.

S1 to S6 shown in FIG. 12 are the process of performing OCR recognition on picture c in the gallery and displaying the OCR recognition result. For this process, it is enough to refer to the specific description of S1 to S6 in FIG. 6 , which will not be repeated here.

S7: The user selects the copy target text in the OCR recognition result.

Please refer to Figure 11. Figure 11 is an exemplary schematic diagram of an interface for recommending applications based on pictures that do not contain preset entities. The schematic diagram of the interface that displays picture c is shown in Figure 11(a). c's OCR recognition result "The main function of the mobile phone is communication, which is convenient for people to communicate. Today's smart phones also have entertainment, navigation, shopping and other functions" are highlighted. Since the OCR recognition result does not contain preset entities, there is no Underline characters.

Fig. 11(b) is the process for the user to select the target text from the displayed OCR recognition results. For the relevant description of this process, please refer to the relevant description in Fig. 11(b), and details will not be repeated here. As shown in Figure 11(c), the user clicks the "Copy" option in the function menu bar to select the target text circled by the cursor, and the system receives the user's click operation on the "Copy" option, and copies the target text selected by the user.

S8: In response to the operation of copying the target text, the device recognizes that the target text does not contain a preset entity.

For the method of identifying whether the target text contains a preset entity, refer to the relevant description under S6 in FIG. 6 , and details will not be repeated here.

S9: The device performs feature extraction on the target text, matches multiple applications based on the extracted features, and displays a task bar containing the multiple applications.

An exemplary method of matching multiple applications based on the extracted features is: predicting the extracted text features based on the application classification model, and the prediction result is a score corresponding to each application classification. A higher score indicates that the extracted text features are consistent with The higher the classification matching degree of the application is. The first application category with the highest score and the second application category with the second highest score are selected from the predicted scores corresponding to each application category. Judging whether the number of applications under the first application category installed in the device is greater than the first preset number, for example 3, if yes, then filter out the first preset number of applications from the first application category as applications to be recommended, if not , all the applications contained in the first application category are regarded as the applications to be recommended under the first application category. Determine whether the number of applications under the second application category installed in the device is greater than a second preset number, for example, 2, and if so, filter out the second preset number of applications from the second application category as pending applications under the second application category. Recommended applications, if not, all the applications included in the second application classification are regarded as the applications to be recommended under the second application classification. Finally, the applications to be recommended under the first application category and the applications to be recommended under the second application category are used as recommended applications, and a task bar containing recommended application icons is displayed. The application classification can be flexibly set by those skilled in the art, which is not specifically limited in this embodiment of the present application. For example, application classification may include: video applications, social applications, map applications, and shopping applications.

Wherein, the first preset number is greater than the second preset number. When filtering applications to be recommended from the first application category, the applications under the first application category can be sorted according to the user's usage frequency of the application within a preset time period, the currently activated application, and other conditions, and the top one can be selected. A preset number of applications are used as applications to be recommended. Similarly, applications to be recommended can be screened from the second application category.

Continuing to refer to Figure 11, the system determines the recommended shopping and social applications based on the target text selected by the user "The main function of the mobile phone is communication, which facilitates people's communication. Today's smart phones also have functions such as entertainment, navigation, and shopping." , since the shopping applications installed in the device only include shopping application B, and the social applications installed in the device only include social applications A and C, so when recommending applications, as shown in Figure 11(d), in the task bar 1101 Icons of shopping application B, social application A and social application C are displayed in . The task bar 1101 includes a plurality of recommended application icons and an add button 1102 . For the introduction of the task bar 1101 and the add button 1102 , please refer to the above-mentioned relevant descriptions, and details will not be repeated here.

It should be noted that if it is determined that the social application is the first application category, the first preset number is 3, and the shopping application is the second application category, the second preset number is 2, and there are 3 social networking applications installed in the device, respectively A, C, and D, and shopping apps B and E are installed in the devices, then when recommending apps, social apps A, C, and D and shopping apps B and E are all recommended apps. The number of application icons is limited, so only some of the recommended application icons can be displayed, and the rest can be hidden, and then displayed one by one after receiving the user's click operation on the add button 1102 .

It should be noted that, in the above embodiment, the user selects the target text in the picture OCR recognition result and the system recommends the application according to the target text selected by the user as an example for illustration. In the actual implementation process, the user can also select, copy and click the text content in the memo, short message and other interfaces, and trigger the system to recommend applications based on the target text selected by the user.

It can be understood that, in order to realize the above functions, the electronic device includes hardware and/or software modules corresponding to each function. Combining the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions in combination with the embodiments for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.

Wherein, all relevant content of each step involved in the above-mentioned method embodiment can be referred to the function description of the corresponding function module, and will not be repeated here.

This embodiment also provides a computer storage medium, the computer storage medium stores computer instructions, and when the computer instructions are run on the electronic device, the electronic device executes the above-mentioned related method steps to implement the application program recommendation method in the above-mentioned embodiment .

This embodiment also provides a computer program product, which, when running on a computer, causes the computer to execute the above related steps, so as to implement the method for recommending an application in the above embodiment.

Wherein, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is all used to execute the corresponding method provided above, therefore, the beneficial effects it can achieve can refer to the corresponding method provided above The beneficial effects in the method will not be repeated here.

Through the description of the above embodiments, those skilled in the art can understand that for the convenience and brevity of the description, only the division of the above-mentioned functional modules is used as an example for illustration. In practical applications, the above-mentioned functions can be assigned by different Completion of functional modules means that the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or It may be integrated into another device, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

A unit described as a separate component may or may not be physically separated, and a component shown as a unit may be one physical unit or multiple physical units, which may be located in one place or distributed to multiple different places. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

Any content of each embodiment of the present application, as well as any content of the same embodiment, can be freely combined. Any combination of the above contents is within the scope of the present application.

Those skilled in the art should be aware that, in the foregoing one or more examples, the functions described in the embodiments of the present application may be implemented by hardware, software, firmware or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.

The embodiments of the present application have been described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementations. The above-mentioned specific implementations are only illustrative and not restrictive. Those of ordinary skill in the art will Under the inspiration of this application, without departing from the purpose of this application and the scope of protection of the claims, many forms can also be made, all of which belong to the protection of this application.

Claims

A method for recommending applications, applied to electronic devices, characterized in that it includes:

displaying the first text and the second text on the display interface of the first application;

In response to a user's first operation on the first text, displaying a first icon corresponding to the second application on the display interface, wherein the first icon is obtained according to text analysis of the first text;

In response to a user's second operation on the first icon, display an interface of the second application corresponding to the first icon;

In response to a user's third operation on the first text and the second text, displaying a second icon corresponding to the third application on the display interface, wherein the second icon is based on the first text and the text analysis of the second text is obtained;

In response to a user's fourth operation on the second icon, an interface of the third application corresponding to the second icon is displayed.
The method according to claim 1, characterized in that:

The first text includes: plain text or text recognized by image OCR.
The method according to claim 2, wherein, before displaying the first text and the second text on the display interface of the first application, the method further comprises:

In response to the user's fifth operation on the picture in the first application, displaying the picture on the display interface of the first application;

In the case that the picture includes text, a first button is displayed, wherein the first button is used to trigger display of the first text and the second text recognized by OCR of the picture;

The displaying the first text and the second text on the display interface of the first application includes:

In response to a sixth operation performed by the user on the first button, the first text and the second text are highlighted in the display interface, wherein the sixth operation at least includes: clicking.
The method according to claim 3, wherein the step of highlighting the first text and the second text in the display interface comprises:

In the display interface, the first text and the second text are highlighted, and an underline is displayed under the first text and the second text, wherein the first text and the second text It is a preset entity, and the preset entity includes: address, code, ID number, phone number, courier number, website, email address, foreign language, Taobao password or Douyin password.
The method according to claim 1, further comprising:

When it is detected that the user performs a third operation on the second text, the display of the first icon is canceled in the display interface.
The method according to claim 1, further comprising:

In response to the user's seventh operation on the third text and the second text, a first icon corresponding to the second application and a third icon corresponding to the fourth application are displayed on the display interface; wherein, the first The text includes the third text, and the first icon and the third icon are obtained according to text analysis of the first text and the third text;

In response to an eighth operation performed by the user on the third icon, displaying an interface of the fourth application corresponding to the third icon;

In response to a user's third operation on the first text and the second text, displaying a second icon corresponding to the third application on the display interface, wherein the second icon is based on the first text and the text analysis of the second text is obtained;

In response to a user's fourth operation on the second icon, an interface of the second application corresponding to the first icon is displayed.
The method according to claim 4, wherein in response to the user's first operation on the first text, displaying the first icon corresponding to the second application on the display interface includes:

In response to the user's click operation on the first text, a floating ball is displayed on the display interface, wherein the floating ball includes a first icon of the second application obtained by performing text analysis on the first text.
The method according to claim 4, wherein in response to the user's first operation on the first text, displaying the first icon corresponding to the second application on the display interface includes:

In response to the user's click operation on the first text, a floating window is displayed on the display interface, the floating window includes service options obtained by performing text analysis on the first text, and the service options include at least the Service options corresponding to the second application.
The method according to claim 1, wherein in response to the user's first operation on the first text, displaying the first icon corresponding to the second application on the display interface includes:

In response to the user's selection operation on the first text, a floating ball corresponding to the second application is displayed on the display interface of the first application, wherein the first text includes a plurality of combinable preset entities, The floating ball includes the first icon corresponding to the second application.
The method according to claim 1, wherein in response to the user's first operation on the first text, displaying the first icon corresponding to the second application on the display interface includes:

In response to the user's selection operation on the first text, a floating window is displayed on the display interface of the first application, wherein the first text includes a plurality of non-combinable preset entities, and the floating window includes A plurality of application icons, the plurality of application icons at least including the first icon corresponding to the second application.
The method according to claim 1, wherein in response to the user's first operation on the first text, displaying the first icon corresponding to the second application on the display interface includes:

In response to the user's copy operation on the first text, a floating window is displayed on the display interface of the first application, the floating window includes a plurality of application icons, and the plurality of application icons include the corresponding text of the second application. number one icon.
The method according to claim 1, wherein the second operation comprises: single click, double click and long press.
An application program recommendation method applied to electronic equipment, characterized in that the method includes:

Responding to a user's first operation on the first text in the first application, identifying a preset entity contained in the first text;

In the case that the first text contains a preset entity, determining information to be recommended based on the preset entity contained in the first text;

If the first text does not contain a preset entity, determine information to be recommended based on content of the first text, where the information to be recommended includes: an application icon or a service list;

A first icon is displayed on the display interface of the first application, and the first icon corresponds to the information to be recommended.
The method according to claim 13, wherein before the responding to the user's first operation on the first text in the first application, the method further comprises:

displaying the picture on the display interface of the first application in response to the user's second operation on the picture in the first application;

identify whether the picture contains text;

In the case that the picture includes text, performing OCR recognition on the picture to obtain a second text;

displaying a first button, wherein the first button is used to trigger display of the second text;

In response to a third operation of the first button by the user, the second text is highlighted in the display interface, wherein the second text includes the first text.
The method according to claim 13, wherein in the case that the first text contains preset entities, determining the information to be recommended based on the preset entities contained in the first text includes:

In the case of a single preset entity contained in the first text, a second application or service list matching the preset entity is determined.
The method according to claim 13, wherein in the case that the first text contains preset entities, determining the information to be recommended based on the preset entities contained in the first text includes:

If the first text contains multiple preset entities, determine whether the multiple preset entities are combinable;

In the case that the multiple preset entities are combinable, a third application is determined based on the multiple preset entities.
The method according to claim 16, wherein after determining whether the plurality of preset entities can be combined, the method further comprises:

In the case that the plurality of preset entities cannot be combined, respectively determine a fourth application that each of the included preset entities matches.
The method according to claim 13, wherein when the first text does not contain a preset entity, determining the information to be recommended based on the content of the first text includes:

In the case of a preset entity not included in the first text, perform feature extraction on the first text;

determining a first application classification and a second application classification of the first text match based on the extracted features;

Filter out a first preset number of fifth applications from the first application category;

Screen out a second preset number of sixth applications from the second application category;

The fifth application and the sixth application are determined as information to be recommended.
The method according to claim 13, wherein the first icon comprises: a floating ball or a floating window.
The method according to claim 13, wherein the preset entity includes: address, code, ID number, telephone number, express delivery number, website, email address, foreign language, Taobao password or Douyin password.
A computer-readable storage medium, comprising a computer program, characterized in that, when the computer program is run on an electronic device, the electronic device is made to execute the recommended application program according to any one of claims 1-20 method.