CN116431044A

CN116431044A - Method and device for starting application program and terminal equipment

Info

Publication number: CN116431044A
Application number: CN202310331735.1A
Authority: CN
Inventors: 张谷原
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2019-11-22
Filing date: 2019-11-22
Publication date: 2023-07-14
Also published as: CN112835495B; CN112835495A

Abstract

The application is applicable to the technical field of terminals, and provides a method and a device for starting an application program and terminal equipment, wherein the method comprises the following steps: when a preset operation of the current display content of the first application program is detected, capturing a picture containing the display content; identifying the picture to obtain an identification result; and opening a page of a second application program associated with the identification result, wherein the second application program is an application program limited by the first application program. According to the method and the device for the content sharing, the function of directly starting the second application limited by the first application in the first application program through the preset operation can be achieved, and the operation of starting the content shared by the limited application is simple and convenient.

Description

Method and device for starting application program and terminal equipment

Technical Field

The application belongs to the technical field of terminals, and particularly relates to a method and a device for starting an application program and terminal equipment.

Background

With the development of terminal technology, the intelligent terminal equipment can share the content of various other applications through social software, so that more convenient and quick functions can be provided for users.

However, since other applications are limited on some social software, for the content shared by other applications on the social software, the shared content needs to be selected on the social software, copied, then the social software is exited, then a target application corresponding to the shared content is opened, and a page corresponding to the shared content is opened by the target application according to the shared content; or copying and pasting the shared content to a corresponding browser, and starting a corresponding target application through the browser; the operation process of opening the content shared by other applications according to the shared content in the social software is complex and cumbersome.

Disclosure of Invention

The embodiment of the application starting method, device and terminal equipment can solve the problems that the operation process of starting the content shared by other applications according to the shared content in social software is complex and tedious.

In a first aspect, an embodiment of the present application provides a method for opening an application, including:

when a preset operation of the current display content of the first application program is detected, capturing a picture containing the display content; identifying the picture to obtain an identification result; and opening a page of a second application program associated with the identification result, wherein the second application program is an application program limited by the first application program.

By adopting the method for starting the application program, the page of the second application limited by the first application program can be started through the preset operation of the current display content of the first application program, and a series of complicated operations such as copying the corresponding display content, exiting the first application program, then starting the second application program and the like are not needed by a user, so that the operation flow is simplified, and the operation efficiency is improved.

In a possible implementation manner of the first aspect, when detecting a preset operation on a current display content of the first application program, intercepting a picture including the display content includes:

when a preset operation of the current display content of the first application program is detected, determining an area corresponding to the preset operation, and capturing a picture containing the area.

In a possible implementation manner of the first aspect, the identifying the picture includes:

determining a region corresponding to the preset operation, and identifying the region of the picture to obtain an identification result.

By adopting the possible implementation manner, the processing range of the image data is reduced and the data processing efficiency is improved by determining the region corresponding to the preset operation and directly selecting the region corresponding to the preset operation in the picture for identification.

In a possible implementation manner of the first aspect, the identification result includes a keyword of a page of the second application program.

In a possible implementation manner of the first aspect, the identification result includes a uniform resource locator URL feature or a sharing password of the page of the second application program.

performing optical character recognition on the picture; if character string information is identified, URL feature matching is carried out on the identified character string information; and if the URL characteristic matched with the character string information exists, taking the content containing the character string information as the identification result.

In a possible implementation manner of the first aspect, before opening a page of the second application program associated with the identification result, the method further includes:

and copying the identification result to a sticky board of the memory.

By adopting the possible implementation manner, the identification result can be directly copied into the memory paste board by the terminal equipment, and the second application program is called after being started so as to jump to the corresponding page of the second application program, so that the page of the second application program corresponding to the display content can be directly opened and jumped to according to the read identification result, the second application program does not need to be opened manually, and the operation is more convenient.

In a possible implementation manner of the first aspect, before capturing a picture including the display content, the method further includes:

acquiring the name of the first application program, and determining whether the first application program is a social application program according to the name of the first application program;

correspondingly, when detecting the preset operation of the current display content of the first application program, intercepting the picture containing the display content comprises the following steps:

when the first application program is a social application program and a preset operation of the current display content of the first application program is detected, a picture containing the display content is intercepted.

By adopting the possible implementation manner, the type of the first application program is determined by acquiring the name of the first application program, so that the reliability of the intercepted picture of the current display content and the effectiveness of the subsequent identification flow triggered by the preset operation event are further ensured.

In a possible implementation manner of the first aspect, the preset operation includes a finger joint clicking operation.

The preset operation can select the operation of clicking the finger joints, so that the input event of other touch operation instructions can be independent, the system can respond in a targeted manner, and the accuracy and the reliability of the response to the touch operation instructions are improved.

It should be understood that, when the identification result is copied to the adhesive board of the memory, the application management service module of the terminal device directly opens the page of the second application program associated with the identification result, and after the second application program is started, the data in the adhesive board of the memory is called, so as to jump to the page of the second application program corresponding to the display content.

As a specific embodiment of the first aspect, in the foregoing manner, an interaction entry of a knuckle click event is added, so that the knuckle click event triggers identification of the current display content of the first application program and a process of starting a second application program associated with the identification result, so that an operation process of starting content shared by other application programs limited in the first application program is simpler and more convenient.

In a second aspect, an embodiment of the present application provides an apparatus for opening an application, including:

the acquisition module is used for intercepting pictures containing the display content when detecting the preset operation of the current display content of the first application program;

the identification module is used for identifying the picture and obtaining an identification result;

and the starting module is used for starting a page of a second application program associated with the identification result, wherein the second application program is an application program limited by the first application program.

In one possible implementation manner, the acquiring module includes:

the positioning unit is used for determining a region corresponding to a preset operation when the preset operation of the current display content of the first application program is detected, and capturing a picture containing the region.

In one possible implementation, the identification module is further configured to:

In one possible implementation, the recognition result includes a keyword of a page of the second application program.

In one possible implementation, the identification result includes a uniform resource locator URL feature or a shared password of the page of the second application.

In one possible implementation, the identification module includes:

an optical recognition unit for performing optical character recognition on the picture;

the character matching unit is used for carrying out URL feature matching on the identified character string information if the character string information is identified;

and the result extraction module is used for taking the content containing the character string information as the identification result if the URL characteristic matched with the character string information exists.

In one possible implementation, the apparatus further includes:

and the copying unit is used for copying the identification result to the adhesive board of the memory.

In one possible implementation, the apparatus further includes:

the application management module is used for acquiring the name of the first application program and determining whether the first application program is a social application program according to the name of the first application program;

correspondingly, the obtaining module is further configured to intercept a picture including the display content when the first application program is a social application program and a preset operation on the current display content of the first application program is detected.

In one possible implementation, the preset operation includes a finger joint clicking operation.

In a third aspect, an embodiment of the present application provides a terminal device, including a memory, a processor, and a touch screen, where the memory, the touch screen, and the processor are coupled, the memory is configured to store a computer program, and the computer program includes instructions that, when executed by the terminal device, cause the terminal device to execute the method for opening an application program.

In a fourth aspect, embodiments of the present application provide a computer storage medium storing a computer program, where the computer program includes instructions that when executed on a terminal device cause the terminal device to execute the method for opening an application program.

In a fifth aspect, embodiments of the present application provide a computer program product comprising instructions that, when run on a terminal device, cause the terminal device to perform the method of opening an application according to any one of the first aspects above.

It is to be appreciated that the advantages of the second aspect to the fifth aspect may refer to the technical effects of the first aspect or the respective implementation manners of the first aspect, which are not described herein.

Compared with the prior art, the embodiment of the application has the beneficial effects that: when a preset operation of the current display content of the first application program is detected, the method for starting the application program is adopted, and a picture containing the display content is intercepted; identifying the picture to obtain an identification result; opening a page of a second application program associated with the identification result, wherein the second application program is an application program limited by the first application program; the problem of complex operation when the first application program interface starts the limited second application program is solved; by setting the preset operation, the identification of the picture of the display content is triggered, and the second application program which is related to the identification result and limited by the first application program is started, so that the function of quickly starting the second application program on the first application interface is realized, the operation flow is simplified, the efficiency of starting the second application program is improved, and the performance of the terminal equipment is improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required for the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic structural diagram of a mobile phone to which a method for opening an application provided in an embodiment of the present application is applicable;

FIG. 2 is a schematic diagram of a software architecture to which a method for opening an application according to an embodiment of the present application is applicable;

FIG. 3 is a schematic diagram of information interaction of a method for executing the application program according to the software architecture according to an embodiment of the present application;

FIG. 4 is a flow chart of a method for opening an application according to an embodiment of the present application;

fig. 5 is a schematic view of an application scenario provided in an embodiment of the present application;

fig. 6 is a schematic view of an application scenario provided in another embodiment of the present application;

fig. 7 is a schematic view of an application scenario provided in another embodiment of the present application;

fig. 8 is a schematic structural diagram of an apparatus for opening an application according to an embodiment of the present application;

Fig. 9 is a schematic structural diagram of a terminal device provided in an embodiment of the present application.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system configurations, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It should also be understood that the term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.

As used in this specification and the appended claims, the term "if" may be interpreted as "when..once" or "in response to a determination" or "in response to detection" depending on the context. Similarly, the phrase "if a determination" or "if a [ described condition or event ] is detected" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon detection of a [ described condition or event ]" or "in response to detection of a [ described condition or event ]".

In addition, in the description of the present application and the appended claims, the terms "first," "second," "third," and the like are used merely to distinguish between descriptions and are not to be construed as indicating or implying relative importance.

Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.

The method, the device and the terminal equipment for starting the application program can be applied to the scene that links of other application programs which are different from the social application and limited by the social application are shared in the social application when information sharing interaction is carried out through the social application, and other application programs are directly started through preset operation of sharing content. When the preset operation of the current display content of the first application program is detected, the starting of the target application by the background and the jump of the foreground to the target application program can be conveniently and quickly realized, so that some other applications limited in the social application can also directly start the related target application program through one preset operation without complex operations such as copying the display content.

The method for opening the application program provided by the embodiment of the application can be applied to terminal equipment such as mobile phones, tablet computers, wearable equipment, vehicle-mounted equipment, notebook computers, ultra-mobile personal computer (UMPC), netbooks, personal digital assistants (personal digital assistant, PDA) and the like, and the specific type of the terminal equipment is not limited.

For example, the terminal device may be a handheld device, a computing device or other processing device connected to a wireless modem, an in-vehicle device, an in-vehicle networking terminal, a handheld communication device, a handheld computing device and/or other devices for communicating over a wireless system, as well as next generation communication systems, such as a mobile terminal in a 5G network or a mobile terminal in a future evolved public land mobile network (Public Land Mobile Network, PLMN) network, etc.

Taking the terminal equipment as a mobile phone as an example. Fig. 1 is a block diagram illustrating a part of a structure of a mobile phone according to an embodiment of the present application. Referring to fig. 1, a mobile phone includes: the portable electronic device comprises a processor 110, a display 120, an input unit 130, an internal memory 140, an external memory interface 150, a sensor module 160, a mobile communication module 170, a wireless communication module 180, a Universal Serial Bus (USB) interface 190, a charge management module 191, a power management module 192, a battery 193 and the like.

Wherein the input unit 130 may include a touch panel 131 and other input devices 132; the sensor module 160 may include a pressure sensor 161, a magnetic sensor 162, an acceleration sensor 163, a touch sensor 164, a gyro sensor 165, and the like.

Those skilled in the art will appreciate that the handset configuration shown in fig. 1 is not limiting of the handset and may include more or fewer components than shown, or may combine certain components, or may be arranged in a different arrangement of components. The illustrated components may be implemented in hardware or software, or in a combination of hardware and software.

The following describes the components of the mobile phone in detail with reference to fig. 1:

the processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, an image processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a digital signal processor (digital signal processor, DSP), and/or a neural network processor (neural-network processing unit, NUP), etc.

Wherein the different units may be separate devices or may be integrated in one or more processors. The processor 110 may connect various parts of the entire mobile phone using various interfaces and lines, and execute various functions and process data of the mobile phone by running or executing software programs and/or modules stored in the memory 120 and invoking data stored in the memory 120, for example, when detecting a preset operation on the current display content of the first application program, invoke a corresponding event processing module to perform analysis processing on the preset operation, and execute an instruction corresponding to the preset operation.

The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system. For example, in one embodiment of the present application, the content shared by the social application is identified, an identification result is obtained, and if the identification result includes a link or a password, the shared link or the password is directly copied to a paste board of the memory, that is, a memory provided in the processor, so that after the second application is started, the second application enters a page corresponding to the second application according to the content in the paste board of the memory.

In some embodiments, the processor 110 may also include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal one-step transceiver (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI) interface, a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

Wherein, the processor 110 can be coupled with the touch sensor 164 and the charger, etc. through different I2C interfaces, respectively; for example, the processor 110 may be coupled to the touch sensor 164 via an I2C interface, such that the processor 110 communicates with the touch sensor 164 via an I2C bus interface to implement a touch function of the handset. The MIPI interface may be used to connect peripheral devices such as the processor 110 and the display 120; the MIPI interface includes a display serial interface (display serial interface, DSI) through which the processor 110 and the display 120 communicate in some embodiments, enabling the display functionality of the handset. The GPIO interface can be configured by software, can be configured as a control signal and can also be configured as a data signal; in some embodiments, a GPIO interface may be used to connect the processor 110 with the display 120, the sensor module 160, the wireless communication module 180, and the like.

The mobile phone realizes the display function through a GPU, a display screen 120 and an application processor, wherein the GPU is a microprocessor for image processing and is connected with the display screen 120 and the application processor. The GPU is used to perform data and geometry calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display 120 is used to display images, videos, and the like. The display screen includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), a quantum light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the handset may include 1 or N displays 120, N being an integer greater than 1.

The input unit 130 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the handset. In particular, the input unit 130 may include a touch panel 131 and other input devices 132. The touch panel 131, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 131 or thereabout by using any suitable object or accessory such as a finger joint, finger, or stylus) and drive the corresponding connection device according to a predetermined program. Alternatively, the touch panel 131 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into touch point coordinates, which are then sent to the processor 180, and receives and executes commands sent from the processor 180. In addition, the touch panel 131 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave.

The internal memory 140 may be used to store computer executable program code that includes instructions. The internal memory 140 may include a storage program area and a storage data area. The storage program area may store at least one application program (such as an image data identification function, a URL feature matching function, a start target application function, etc.) required by the operating system. The storage data area may store data (e.g., image data, etc.) created during use of the handset. The processor 110 performs various functional applications and data processing of the handset by executing instructions stored in the internal memory 140 and/or instructions stored in a memory provided in the processor.

The external memory interface 150 may be used to connect to an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the handset. The external memory card communicates with the processor through an external memory interface 150 to implement data storage functions.

The pressure sensor 161 is used for sensing a pressure signal and converting the pressure signal into an electrical signal. In some embodiments, the pressure sensor 161 may be disposed on the display 120. When a touch operation is applied to the display 120, the mobile phone detects the touch operation intensity according to the pressure sensor 161. The mobile phone may also detect the touch operation intensity according to the pressure sensor 161. The mobile phone may calculate the position of the touch based on the detection signal of the pressure sensor 161. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions. For example: when the touch operation intensity is larger than the first pressure threshold and the action time is smaller than the first time threshold, the instruction of intercepting and analyzing the image data of the current screen display interface is executed when the touch operation intensity acts on the shared content area of the social application interface.

The magnetic sensor 162 includes a hall sensor. The mobile phone can detect the opening and closing of the flip holster through the magnetic sensor 162. In some embodiments, when the handset is a flip phone, the handset may detect the opening and closing of the flip based on the magnetic sensor 162. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.

The acceleration sensor 163 can detect the magnitude of acceleration of the handset in various directions (typically three axes). The magnitude and direction of gravity can be detected when the mobile phone is stationary. The method can also be used for recognizing the gesture of the mobile phone, and can be applied to the applications of horizontal and vertical screen switching, pedometers, vibration recognition related functions (such as pedometers and knocking) and the like. The initial motion state of the mobile phone generated by stress can be judged according to the preset operation executed by the user on the touch screen, for example, the finger joint clicks the mobile phone screen, a certain clicking acting force can be generated on the mobile phone, so that the mobile phone generates initial acceleration corresponding to the acting force direction, and the accuracy of judging the preset operation is improved.

Touch sensor 164, also referred to as a "touch control". The touch sensor 164 may be disposed on the display 120, and the touch sensor 164 and the display 120 form a touch screen, which is also referred to as a "touch screen" or a "touch display". The touch sensor 164 is used to detect touch operations acting on or near it, such as contact with a display screen when a finger joint clicks on the screen. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation may be provided through the display screen 120. Such as a finger joint clicking screen event, a sliding screen event, etc., different event types correspond to different instructions, and different instructions are executed to implement different functions. In other embodiments, the touch sensor 164 may also be disposed on the surface of the mobile phone at a different location than the display 120.

The gyro sensor 165 may be used to determine the motion pose of the handset. In some embodiments, the angular velocity of the handpiece about three axes (i.e., x-axis, y-axis, and z-axis) can be determined by gyro sensor 165. For example, when the screen receives the finger joint clicking action, the angular speed generated by the action of the force applied to the mobile phone can be calculated through the gyroscope sensor so as to determine the motion state of the mobile phone, and the accuracy and the reliability of judging the finger joint clicking event are improved. The gyro sensor 165 may also be used for photographing anti-shake. Illustratively, when the shutter is pressed, the gyro sensor 165 detects the shake angle of the mobile phone, calculates the distance to be compensated by the lens module according to the angle, and makes the lens counteract the shake of the mobile phone by running in the opposite direction, thereby realizing anti-shake. The gyro sensor 165 may also be used to navigate, somatosensory game scenes.

By way of example, the sensor module 160 may also include fingerprint sensors, ambient light sensors, temperature sensors, distance sensors, barometric pressure sensors, proximity light sensors, bone conduction sensors, and the like.

The wireless communication function of the mobile phone can be realized by the antenna 1, the antenna 2, the mobile communication module 170, the wireless communication module 180, a modem processor, a baseband processor and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the handset may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 170 may provide a solution for wireless communication including 2G/3G/4G/5G, etc. applied to a cellular phone. The mobile communication module 170 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 170 may amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate the electromagnetic waves. In some embodiments, at least some of the functional modules of the mobile communication module 170 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 170 may be disposed in the same device as at least some of the functional modules of the processor.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to speakers or receivers, etc.), or displays images or video through the display 120. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 170 or other functional module, independent of the processor 110.

The wireless communication module 180 may provide solutions for wireless communication including wireless local area network (wireless local area network, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc. applied to a cell phone. The wireless communication module 180 may be one or more devices integrated with at least one communication module, and the wireless communication module 180 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 180 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, the antenna 1 and the mobile communication module 170 of the handset are coupled, and the antenna 2 and the wireless communication module 180 are coupled, so that the handset can communicate with a network and other devices through wireless communication technology. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communication, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division multiple access (time-division code division multiple access, TDSCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global position system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).

The USB interface 190 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface can be used for connecting a charger to charge the mobile phone and can also be used for transmitting data between the mobile phone and peripheral equipment. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other electronic devices, such as AR devices, etc.

It should be understood that the connection relationship between the modules illustrated in the embodiments of the present application is only illustrative, and is not limited to the structure of the mobile phone. In other embodiments of the present application, the mobile phone may also use different interfacing manners in the foregoing embodiments, or a combination of multiple interfacing manners.

The charge management module 191 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charge management module 191 may receive a charging input of a wired charger through the USB interface 190. In some wireless charging embodiments, the charging management module may receive wireless charging input through a wireless charging coil of the cell phone. The charging management module 191 may also supply power to the mobile phone through the power management module 191 while charging the battery 193.

The power management module 192 is used to connect the battery 193, the charge management module 191 and the processor 110. The power management module 192 receives input from the battery 192 and/or the charge management module 191 to power the processor 110, the internal memory 140, the display 120, the wireless communication module 180, and the like. The power management module 192 may also be used to monitor battery capacity, battery cycle times, battery health (leakage, impedance) and other parameters. In other embodiments, the power management module 192 may also be located in the processor 110. In other embodiments, the power management module 192 and the charge management module 191 may be disposed in the same device.

Although not shown, the handset may also include a camera, audio module, speaker, receiver, microphone, earphone interface, keys, motor, indicator, SIM card interface, etc. The mobile phone can realize audio functions through an audio module, a speaker receiver, a microphone, an earphone interface, an application processor and the like. Such as music playing, recording, etc.

In addition, although not shown, the mobile phone may further include a bluetooth module, etc., which will not be described herein.

The software system of the terminal equipment can adopt a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture or a cloud architecture. In the embodiment of the application, an Android system with a layered architecture is taken as an example, and a software structure of terminal equipment is illustrated in an exemplary manner.

Fig. 2 is a schematic diagram of a software structure of a mobile phone as an example in the present application. Taking an Android system as an example of a mobile phone operating system, a layered architecture divides software into a plurality of layers, each layer has clear roles and division, and the layers are communicated through software interfaces. In some embodiments, the Android system is divided into four layers, namely an application layer, an application framework layer (FWK), a system layer and a hardware abstraction layer, and the layers communicate through software interfaces.

As shown in fig. 2, the application layer may be a series of application packages, and the application packages may include applications such as short messages, calendars, cameras, videos, navigation, WLAN, navigation, bluetooth, music, gallery, and calls.

In some embodiments of the present application, the application package may further include a screen reading application, an optical character recognition module, and a URL feature matching module. The screen reading application can execute the functions of intercepting screen images and identifying image data according to an instruction triggered by a preset operation on the current display content of the first application program; the URL feature matching module can match the content displayed in the application program with the feature code preset in the database to obtain the effective link or password in the content displayed in the application program, and further execute the instruction of the application program associated with the link or password.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for applications of the application layer. The application framework layer may include some predefined functions, such as functions for receiving events sent by the application framework layer.

As shown in fig. 2, the application framework layer may include an application manager, a window manager, a resource manager, a content provider, a notification manager, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen, read the screen and the like. The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

In some embodiments of the present application, the window manager may be embodied as a window management service (Window Manager Service, WMS) that stores information of each application window displayed in the current screen, such as coordinates, size, and whether to split the screen, etc. of each application window.

When an application program of the application layer starts to run, the WMS is informed of the information of the size, the position, the split screen and the like of the started application window. And when the size and the position of the window change, the changed data are timely refreshed into the WMS. Accordingly, information of each application window displayed in the current screen can be acquired from the WMS.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, etc.; for example, by capturing displayed image data of a current screen in response to a finger joint click event.

The resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files, and so forth.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.

The application manager may also be referred to as an application management service (Activity Manager Service, AMS) module, which is a service that manages application scheduling, such as application start, exit, foreground-background switching, etc., in a system, all managed by the AMS module.

The application framework layer may further include:

a view system including visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The system layer may include a plurality of functional modules. For example: the system comprises a sensor service module, a physical state identification module, a three-dimensional graphic processing library (for example, openGL ES), an input event management service module, a finger joint processing module and the like.

The sensor service module is used for monitoring sensor data uploaded by various sensors of the hardware layer and determining the physical state of the mobile phone;

the physical state recognition module is used for analyzing and recognizing gestures, faces and the like of a user, such as finger joint clicking gestures executed by the user on a screen;

the three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The incoming event management module, also referred to as incoming event management service (Input Manager Service, IMS) module, is the processing module for user incoming events. For example, single click, double click, sliding, screen-off, etc. events are handled and distributed by the IMS module, as are finger joint single click events in one embodiment of the present application.

The finger joint processing module is also called a finger joint input event processing module, and performs corresponding processing on finger joint input events (such as single click, double click, sliding and other input events), for example, double click performs screen capturing operation, sliding performs screen capturing of a selected area and the like. In one embodiment of the present application, finger joint clicking events are correspondingly processed, and relevant identification instructions are executed.

The system layer may further include:

the surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The application layer and the application framework layer run in virtual machines. The virtual machine executes Java files of the application layer and the application framework as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The hardware abstraction layer is a layer between hardware and software. The hardware abstraction layer may include display drivers, camera drivers, sensor drivers, etc. for driving the relevant hardware of the hardware layer, such as a display screen, camera, sensor, etc.

The workflow of the terminal device hardware and software is illustrated below in conjunction with the actual application scenario of the open application.

When a preset operation (such as a finger joint clicking operation) on the current display content of the first application program is detected, a corresponding hardware interrupt is sent to a hardware abstraction layer (or called a kernel layer). The hardware abstraction layer processes the preset operation into an original input event (including information such as position coordinates of the preset operation, time stamp of the preset operation, and the like). The raw input events are stored at the hardware abstraction layer. The system layer acquires an original input event from the hardware abstraction layer, and identifies a processing module corresponding to the input event.

The preset operation, for example, a finger joint clicking operation, refer to fig. 3, which is a schematic information interaction diagram of the method for executing the application program by the corresponding software architecture according to an embodiment of the present application, is implemented on a mobile phone having the above hardware structure/software structure. The processing module corresponding to the finger joint clicking operation manages an IMS module for the input event service, and the IMS module receives the finger joint clicking event, recognizes the finger joint clicking event and distributes corresponding instructions. First, a finger joint event is input to a finger joint processing module, and the finger joint processing module recognizes and confirms the finger joint clicking event. For example, upon receiving a finger joint clicking event, notifying an ASM module of the application framework layer to determine the type of application currently running in the foreground; the screen reading application or the screen capturing application calls an interface of an application framework layer, acquires window information of the current display content of the application program, and intercepts bitmap information of a picture containing the display content; the optical character recognition module of the application layer recognizes the bitmap information and analyzes the character string information in the bitmap information; matching the character string information with a preset feature code in a database through a URL feature matching module of an application layer, and identifying URL link information in the character string information through URL feature matching; and querying the target application corresponding to the link information, and executing an instruction for starting the target application associated with the link information.

The technical solutions involved in the following embodiments may be implemented on a terminal device having the above-described hardware structure/software structure. The following embodiments take a terminal device as a mobile phone as an example, and describe a method for opening an application program provided in the embodiments of the present application.

Fig. 4 shows a schematic flow chart of a method for opening an application provided in the present application, which can be applied to the above-mentioned mobile phone by way of example and not limitation.

Step S401, when a preset operation of the current display content of the first application program is detected, a picture containing the display content is intercepted.

In one possible implementation, the execution subject may be a terminal device, which may be a smart phone, a notebook computer, or a tablet computer. The first application may be various social applications installed on the terminal device that can perform information interaction. When different users interact with each other on the social application program, the shared content is sent or received in the form of links or passwords through the social application program.

In some embodiments of the present application, the preset operation may be a click or a slide operation performed by a user on the touch screen, for example, a finger joint click, a three-finger slide operation, or the like.

When different preset operations are detected for different display pages of the touch screen, different instructions are correspondingly executed respectively to respond to the different preset operations. For example, executing a finger joint clicking operation in a region where the first application program currently displays content, and executing an instruction for intercepting a screen in response to the finger joint clicking operation; and executing the operation of sliding down the two fingers on any display page of the touch screen, and executing the instruction for intercepting the screen so as to respond to the operation of sliding down the two fingers.

In addition, each preset operation may be an event; the input event management service module is used for processing and distributing preset operations input by a user on the touch screen, and different preset operation events are corresponding to different response instructions. For example, a finger joint input event is sent to a finger joint processing module, and is processed by the finger joint processing module, current screen capture and recognition processing is performed for a finger joint click event, screen capture processing is performed for a finger joint double click event, and the like.

Illustratively, the first application currently displaying content includes shared content of other applications in character form or in pure link form. The preset operation performed in the area where the first application program currently displays the content may be any position of the current display interface of the first application program on the touch screen, where the current display interface may include content of other application programs shared in a card or text form or a pure link form; the preset operation may be further performed within a target area set according to needs and meeting a preset requirement, where the preset requirement may be an area for displaying specific content on a screen display interface, for example, an area for displaying the shared content in a character form on a social application interface.

Specifically, when the information such as the preset operation of the current display content of the first application program and the motion state of the terminal equipment is detected through devices such as a touch sensor and an acceleration sensor arranged on the touch screen, the type of an input event corresponding to the preset operation is determined. The touch sensor, the acceleration sensor and other devices transmit acquired data to the processor, the processor analyzes and processes the data, the data is transmitted to the corresponding input event management service module, and the preset operation is processed and responded through the combination of software and hardware.

It should be noted that the preset operation is not limited to the finger joint clicking operation, but may include operations different from other input events defined by the operating system, for example, gestures such as finger joint three-connection or finger tip clicking, and the like, which are not limited specifically. The taken picture containing the display content can be a picture of the whole screen display interface, and can also be a picture of a part of the screen display interface containing the display content. Specifically, matching calculation can be performed according to the coordinates of the display content and the detected coordinates of the preset operation, so as to determine the size of the intercepted picture.

In one possible implementation manner, when detecting a preset operation on the current display content of the first application program, intercepting a picture containing the display content includes:

In one embodiment, the current display content of the first application program may include a plurality of different contents, each corresponding to a different area, and the preset operation may only correspond to the area where a certain content is located. When the preset operation of the current display content of the first application program is detected, the position of the preset operation on the display screen can be determined by a touch sensor arranged in the display screen, so that the area corresponding to the position of the preset operation can be determined by calculating the area of each display content in the screen, and the picture of the area can be intercepted by the screen capturing application.

Optionally, before capturing the picture containing the display content, the method further includes:

In one possible implementation manner, the name of the first application program is obtained, whether the first application is a social application is judged according to the name of the first application program, and the social application is an application program which can perform information interaction by establishing an account or establishing a private letter, such as application programs of WeChat, QQ, microblog and the like.

Specifically, an identification process is triggered through a preset operation, a first application program operated in the foreground is identified, the name of the first application program is obtained through an AMS application management service module, and whether the first application program is a social application program or not is judged according to the name of the first application program and a preset social application program type. If the first application program is a social application program and a preset operation on the current display content of the first application program is detected, acquiring a picture containing the display content in the current display interface of the first application program through a screen capturing application or a screen reading application.

For example, a position of a preset operation in a screen may be predefined, and a size of an area for acquiring a picture including display content may be determined according to the preset operation detected at the predefined position. For example, if there is no limitation on the position of the preset operation, the whole screen display interface (including the picture of the display content) may be acquired; if the position of the preset operation is limited, that is, the position of the preset operation is located in a specific area, the preset operation event is valid, and the identification process is triggered, the picture of the area where the position of the preset operation is located can be obtained according to the position of the preset operation, wherein the specific area can be the area containing the shared content.

By adopting the possible implementation manner, the type of the first application program is determined by reading the information of the first application program running in the current foreground, so that the reliability of the acquired picture containing the display content and the effectiveness of the identification process triggered by the preset operation event are further ensured.

In one possible implementation manner, after receiving a preset operation on the current display content of the first application program, the input event management service IMS module processes an input event corresponding to the preset operation, for example, events such as clicking, sliding, turning on and off a screen are all processed and distributed by the IMS.

In some embodiments of the present application, a processing function for a preset operation event (for example, a finger joint clicking operation event) is added, and the preset operation may include a finger joint clicking operation, and the finger joint clicking operation event is transmitted to a finger joint processing module through an IMS module, so as to process and respond to the finger joint clicking event. Such as finger joint single click trigger screen shots and recognized instructions.

The screen capturing application or the screen reading application in the mobile phone can call a surface control to capture a picture containing the current display content of the first application program, wherein the picture can be a whole display interface of the first application program or a partial area interface containing the display content. Meanwhile, the screen capturing application or the screen reading application calls the window management service of the application program framework layer, and information such as the size, the coordinates and the like of the window of the current first application is obtained, so that data can be conveniently called when the subsequently opened application program is subjected to split-screen display or multi-screen display.

For example, setting a corresponding processing function for an event type of the preset operation, for example, if there is no predefined specific area for a position of the preset operation event executed on the touch screen, the corresponding processing function may be set to acquire an entire screen display interface of the first application program; if the specific area is predefined for the position executed by the preset operation event on the touch screen, a corresponding processing function can be set according to the position information of the preset operation on the touch screen, so that a picture of the specific area or a picture containing the specific area where the position information is located in the screen display interface of the first application program is acquired.

It should be noted that, when the first application program receives the preset operation, the foreground runs the application program. Before the picture containing the display content is acquired, the type of the first application program can be identified, the name of the first application program is acquired through the AMS module, the type of the first application program is judged according to the name, and if the first application program is a social application, the function of capturing the picture containing the display content is triggered.

By way of example and not limitation, the preset operation may be a finger joint clicking operation. The method for intercepting the picture containing the display content can comprise the steps of calling a surface control through a screen intercepting application or a screen reading application, and intercepting the picture of the whole display interface of the screen or the picture of a partial area containing the display content; meanwhile, the screen capturing application or the screen reading application calls the window management service of the application program framework layer, and information such as the size, the coordinates and the like of the first application program window is acquired, so that data can be conveniently called when the screen division display or the multi-screen display is carried out on a plurality of applications in the later period.

In one possible implementation, the knuckle click event may be a specific operation of the preset operation. For the finger joint clicking event, corresponding predefining can be set for the execution position of the finger joint clicking event, namely, the position of the finger joint clicking screen is limited, for example, when the position of the finger joint clicking screen is positioned in the area where the shared content of the first application program display interface is positioned, the finger joint clicking event is effective, and the like; the position of the preset operation may not be limited, for example, the position of the finger joint clicking screen may be any position in the display interface of the first application program.

Specifically, when the position of the corresponding finger joint clicking screen is located in the area where the shared content of the first application program display interface is located, acquiring a picture containing the area where the shared content is located through screen capturing application and coordinate calculation; when the position of the finger joint clicking screen is any position in the display interface of the first application program, the whole display interface of the first application program is directly obtained through the screen capturing application.

For example, if the position of the finger joint clicking screen is located in the area where the shared content of the social application interface is located, the window management server of the application framework layer may be called to read coordinate information of the area where the shared content is located, and the screen capturing application or the function may acquire image data of the area where the shared content is located according to the coordinate information.

In addition, the determination of the target area where the shared content is located may be set according to the situation when the social application performs information interaction, and may be an area in which the social application information interaction is displayed in the screen, or an area occupied by a certain piece of independent information in the interaction area is a target area, and the like.

It should be noted that, in the above embodiments, the content sharing is shared in the information interaction interface of the first application program (or social application), and different from the current first application program (or social application), the content information of other application programs including links or passwords is presented in the form of characters or pure links. The implementation of the above embodiment is not limited to the application of the finger joint clicking operation, and the above corresponding functions can be implemented corresponding to other types of preset operations.

Step S402, identifying the picture to obtain an identification result.

In one possible implementation, the bitmap data of the picture is obtained by capturing the picture containing the display content through a screen capturing application or function. And calling an optical character recognition module of the application layer through the operation event processing module, and analyzing the input bitmap data, namely recognizing character strings in the bitmap data. For example, the shared content in the current screen display interface includes a character string "abc", and after bitmap data of the current screen display interface is intercepted, the "abc" character string information can be obtained through the optical character recognition module.

Specifically, after the character string information is obtained, the character string information is matched with a preset feature code. The preset feature codes are feature codes stored in addresses or link formats of other applications in the database. And matching the obtained character string information with a preset feature code to obtain a link or password in the character string information. For example, the shared link format of application a is "app A shared message" + specific message content + "please copy this message and open app A", and "app A shared message x please copy this message and open app A" is the feature code of application a, where x is a wild card for matching different message contents. And determining the target application program corresponding to the shared content according to the link or the password obtained by matching.

According to the feature code matching, whether the target application program is an application program limited by the first application program or not can be determined; the links or passwords in the string information are content of other target applications different from the current first application, and the other target applications are applications limited by the first application. The embodiment of the application can realize the sharing of the content of the restricted target application program, and the function of the restricted target application program is directly started through the preset operation on the display content; the method for starting the application program provided by the embodiment of the application optimizes the operation performance of the system.

Optionally, the identifying the picture, and obtaining the identification result includes:

In one possible implementation manner, when a preset operation on the current display content of the first application program is detected, the intercepted picture can be a picture of the whole screen containing the display content, and in the identification process, identification is performed aiming at a preset operation area; and the picture of the region where the screenshot is located can be identified according to the region where the preset operation is located.

For example, when a preset operation on the current display content of the first application program is detected, the intercepted picture may also be a picture of an area local screen display interface containing the display content; when the picture is identified, the identified picture is identified.

Optionally, the identification result includes a keyword of the page of the second application program.

In one possible implementation, the recognition result may include keywords of the page of the second application, e.g., the keywords may be treasured's warship flagship store, etc.

Optionally, the identification result includes a uniform resource locator URL feature or a shared password of the page of the second application program.

In one possible implementation, the recognition result may also include a page sharing link that identifies the uniform resource locator URL feature, and a sharing password of a particular format associated with the different application programs. For example, the page sharing connection obtained in the recognition result is "http:// m.aa. Cn/h.ege4pwysm=5147 f6", and the password may be "∈heujyglciau".

In one possible implementation, bitmap data of a picture is obtained, where the bitmap data of the picture is image data of a pixel matrix formed by using a gray value number representing each pixel in the picture, and each pixel point has a different color and a different corresponding gray value. And reading bitmap data of each pixel in the picture, and identifying the gray value of each pixel of the region corresponding to the preset operation in the picture through the optical character identification module so as to determine character string information in the region.

Specifically, the optical character recognition module can recognize a section of text or pure link content to acquire character string information therein. For example, an optical character recognition module of an application layer is called by a background to recognize a region corresponding to a preset operation in a picture, so that character string information is obtained; for example, the string may be "http:// m.AA.cn/h.egE4PWysm=5147 f 6. Cndot. HeujYgLCIAu. Cndot.).

In one possible implementation, the database stores preset feature codes of link formats associated with various applications, for example, the shared link format of the application a is "app A shared message" + specific message content + "please copy this message and open app A", and "app A shared message x please copy this message and open app A" is the feature code of the application a. And matching the character string information with preset feature codes of a plurality of applications, determining a second application program corresponding to the character string information, namely a target application program corresponding to the display content, and acquiring information such as page keywords, page sharing links or sharing passwords in the character string information.

It should be noted that the recognized character string may include both a link or a password, and the above-described character string information includes the link "http:// m.aa.cn/h.ege4pwysm=5147 f6" and the password "∈heujyglciau.

In one possible implementation manner, the second application program may also be judged whether to be the application program limited by the first application program according to the identification result; and if the second application program is the application program limited by the first application program, taking the sharing link or the sharing password as the identification result or taking the content containing the character string information as the identification result.

In one possible implementation, the second application may be an application that is restricted by the first application.

Specifically, the application management service AMS module is a module for scheduling and managing applications, and starting, exiting and foreground-background switching of applications in the system are managed by the ASM module. The AMS module is used for acquiring information of the second application program, transmitting the information of the second application program to the processor, and judging whether the second application program is an application program limited by the first application program or not according to the limited content of the first application program by the processor. And if the second application program is the application program limited by the first application program, the matched sharing link or sharing password is used as a final identification result.

It should be noted that, the method for opening an application program provided by the present application may be applicable to a scenario in which a second application program (i.e., a target application program) is an application program limited by a first application program; the embodiment of the application can realize the sharing content of the restricted target application program, and the function of the restricted target application program is directly started by detecting the preset operation of the sharing content; the method and the device realize the universality and convenience of the operating system on the content sharing operation in the application program.

Step S403, opening a page of a second application associated with the identification result, where the second application is the application limited by the first application.

Optionally, before opening the page of the second application program associated with the identification result, the method further includes:

and copying the identification result to a sticky board of the memory.

In one possible implementation manner, since the system performs the processes of copying, reading and calling the data independently, after determining the link or the password of the second application program, the link or the password needs to be copied into the paste board of the memory, and after the system opens the second application program, the second application program is used for reading the content in the paste board of the memory and jumping to the page associated with the link or the password.

In one possible implementation manner, the identification result includes a page sharing link or sharing password of the second application program (i.e., the target application program), after determining the associated second application program according to the identification result, the system directly starts the second application program, reads the identification result in the memory patch board after the second application program is started, invokes the corresponding sharing link or sharing password, and jumps to the page associated with the identification result.

Specifically, when the background starts the second application program according to the identification result, a prompt about whether to open the second application program can be given, and according to the selection of the user, the background continues to start the second application program and the foreground interface is supported to skip to the second application program; the background can also directly start the second application program without giving a prompt about whether to start the second application program, and the foreground jumps to the second application program.

When the foreground jumps to the interface of the second application program, the second application program reads the identification result in the adhesive board of the memory and gives a prompt of entering the page corresponding to the identification result, and the user can select the page corresponding to the entering identification result according to the prompt, and can ignore the prompt and keep the page at the first page of the second application program.

Optionally, the preset operation includes a finger joint clicking operation.

In one possible implementation manner, the preset operation includes a finger joint clicking operation, which can distinguish other forms of operation events set and supported in an operating system of the terminal device, and the finger joint clicking operation is used as a trigger event of a subsequent identification process.

Specifically, the finger joint clicking operation is used as a specific event, the finger joint clicking event input by the user is acquired through the input event management service module, category processing is carried out on the finger joint clicking event, the finger joint clicking event is distributed to the finger joint processing module, and the finger joint processing module sends out an instruction for executing a subsequent recognition flow according to the finger joint clicking event.

The touch screen display interface may be divided into a plurality of display areas with different contents, and when the user performs a finger joint clicking operation on the touch screen, the user may be at any position on the current touch screen display interface, or may be an area with specific contents, and may be specifically set as required.

In some embodiments of the present application, when an area where a finger joint click specific content is located is selected, a subsequent identification process is triggered, that is, when a finger joint click event is received, the position where the event occurs is determined according to a touch sensor, and if the occurred position is in a shared content area of a current social application display interface, the subsequent identification process is continuously triggered.

For example, the picture containing the display content is identified, and an identification result is obtained, where the identification result may include page links or passwords corresponding to a plurality of application programs. When the links or passwords in the identification result correspond to a plurality of different application programs, the application programs are directly started through a preset operation instruction, pages of the first application program can be displayed through a first screen, and the pages corresponding to the contained application programs are displayed through the second screen in a split mode through coordinate calculation.

By adopting the embodiment, the user can select the operation of clicking the finger joints by the preset operation on the touch screen so as to distinguish the input events of other touch operations, avoid the confusion of the terminal equipment on the operation of the input events, generate error response and improve the response accuracy of the preset operation instruction.

Exemplary, after reading the identification result in the adhesive board of the memory, the method for starting the application program further includes: and receiving an instruction for starting the second application program or canceling the starting selected by the user according to the prompt information.

It should be appreciated that after copying the recognition result to the memory's adhesive board, the second application is started so that the second application can read the recognition result in the memory's adhesive board and call the associated page; thereby improving the performance of the operating system.

In the embodiment of the application, a finger joint clicking event input by a user is received in a target area of shared content of a first application program interface. The identification procedure is triggered by a knuckle click event. Firstly, acquiring the name of a first application program running in the current foreground through an ASM module, identifying the category of the first application program according to the name, and determining that the first application program is a social application program; secondly, analyzing character strings in the image data by an optical recognition module by intercepting the image data of the current screen display interface to obtain character string information of a target area; and matching the character string information with preset feature codes of a plurality of applications through the URL feature matching module, determining a second application program corresponding to the shared content, and acquiring a shared link and a shared password in the character string information. Then, identifying the determined second application program, and confirming whether the second application program is an application program limited by the first application program; if the second application program is the application program limited by the first application program, the shared link or the shared password is used as an identification result meeting the condition, and the shared password or the shared link is restored to the memory paste board. And finally, reading the sharing link or the sharing password in the memory paste board, directly starting the second application program by the system background, and supporting the foreground to directly jump to the page of the second application program.

It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic of each process, and should not limit the implementation process of the embodiment of the present application in any way. The above embodiments may be arbitrarily combined on the premise that the schemes are not contradictory.

According to the method and the device for processing the shared content, the interaction entrance of the finger joint clicking touch screen is increased, the shared content is identified by the finger joint clicking event triggering, and the target application is directly opened according to the identification result, so that the operation process of opening the content shared by other applications limited in the social application is simpler and more convenient. The preset operation of the user on the touch screen can select finger joint clicking operation, and can be distinguished from input events of other operation instructions, so that the terminal equipment is prevented from confusing the operation of the input events, error response is generated, and the response accuracy of the preset operation instructions is improved. The finger joint is clicked on the touch screen to be positioned in a target area of the touch screen for displaying the shared content, the image data of the shared content is directly selected and obtained, the processing range of the image data is reduced, and the data processing efficiency is improved. By performing optical character recognition on the image data of the screen display interface, determining the type of the second application program corresponding to the shared content, the content shared by the second application program limited by the first application program can be recognized, and operations such as copying the content shared by the limited application program are not needed. According to the method and the device, the application program corresponding to the shared content is directly jumped and opened according to the read identification result, and the target application does not need to be opened manually. Through the embodiment of the application, a series of complicated operations such as copying and sharing content, exiting the first application, opening the second application and the like are not required by a user, so that the operation flow is simplified, the operation efficiency is improved, the functions of the terminal equipment are increased, the performance of an operating system is improved, and the user experience is improved.

Based on the implementation principle of the above method embodiment, referring to fig. 5, an application scenario schematic diagram provided in an embodiment of the present application is shown, when a user performs information interaction or sharing on a social application, content of other applications is directly shared into the current social application in a link or password form, and is embodied in a character form or a pure link form on an interface of the social application.

When some other applications are limited by the currently running social application, the user cannot directly open the target application according to the links or passwords in the shared content. According to the embodiment provided by the application, the shared content area of the finger joint clicking screen display interface is adopted, the terminal equipment responds to the finger joint clicking event input by a user, acquires the screen display interface of the currently running social application, reads the picture of the screen display interface, acquires the bitmap information of the picture, and identifies the bitmap information through the optical character identification module to acquire the character string information in the shared content.

Exemplary, shared content, shown in FIG. 5 in the form of a piece of text, including links and passwords; after receiving a finger joint clicking event executed in the shared content area, reading image data of a current screen display interface, and identifying the image data through an optical character identification module to obtain character string information contained in the shared content, for example: "http:// m.AA.cn/h.egE4PWysm=5147 f 6. Sup. HeujYgLCIAu. Sup."; and matching the character string information with preset feature codes of other applications stored in a database by adopting a URL feature matching mode to acquire links or passwords of shared contents in the character string information, wherein the links and the passwords are respectively 'http:// m.AA.cn/h.egE4PWysm=5147 f 6' and 'HeujYgLCIAu' as shown in figure 5. And determining that the name of the application corresponding to the shared content is 'AA' (only a certain application is indicated by letters, and the name of the application can also be indicated by words) through feature matching, so that the target application is determined to be AA.

The terminal equipment copies and pastes the link or the password to a paste board of the memory, opens a second application associated with the link or the password, and gives a prompt whether to open the second application program when the foreground jumps to a second application program interface; wherein, the prompt can be provided with a plurality of options, and the user can choose to cancel, and the corresponding target application program is not opened; if the instruction can be selected to be ignored, when the instruction of the same finger joint clicking event is executed later, prompting is not performed any more and a corresponding target application program is directly opened; the determination may be selected and the target application is opened directly.

After the starting, starting the target application in the background, and directly jumping to the page of the target application AA by the foreground operation interface; after the target application is started, the target application reads the content in the memory paste board and gives a prompt whether to open a page corresponding to the link or the password. As shown in fig. 5, an entry page may be selected; the lower close symbol may also be clicked, and remain on the main page of the target application.

The sharing content of the limited target application can be directly opened by clicking the sharing content of the social application interface through the finger joints, a series of complicated operations such as copying the sharing content, exiting the social application, opening the target application and the like are not needed, the operation flow is simplified, the operation efficiency is improved, and the user experience is improved.

After receiving the finger joint clicking instruction, the terminal device also needs to judge the currently running application, determine whether the currently running application is a social application, whether the finger joint clicking event is valid, and whether other subsequent instructions need to be continued or not, and all the subsequent instructions are operated and processed by the system background.

In addition, referring to fig. 6, an application scenario is schematically shown in another embodiment of the present application, and, unlike the previous application scenario, a prompt box for prompting the user about whether to open the target application in a middle pop-up manner is omitted.

In the application scenario process provided by the embodiment, when a finger joint clicking event executed in a content sharing area of a current screen display interface is detected, a picture containing the shared content is intercepted, optical character recognition is performed on the picture, character string information in the shared content is recognized, feature codes in the character string information are matched with preset feature codes of other application programs in a database, a sharing link or a sharing password in the character string information is obtained, a target application is determined, the sharing link or the sharing password is copied to a memory paste board, a prompt box is not popped up to prompt a user to open the target application, a background is directly opened, the foreground screen display interface jumps to an operation page of the target application, and after the opened target application reads data in the paste board of a memory, the user is prompted to enter a page corresponding to the shared content. And the user selects to enter a page corresponding to the shared content or a home page reserved in the target application program.

With the increase of the mobile phone screen, especially the appearance of a folding screen mobile phone, a user can use the mobile phone to open a plurality of application programs, and can operate corresponding to the plurality of application programs in one display interface of the screen. As shown in fig. 7, another embodiment of the present application provides an application scenario schematic diagram.

When the method is applied to the folding screen mobile phone, the function of performing coordinate calculation on the first screen and the second screen of the folding screen mobile phone is added through the knuckle clicking event executed on the shared content of the social application interface, the knuckle clicking event triggers the function of displaying the social application interface on the first screen, starting the target application program and displaying the target application program page on the second screen. And the operation is convenient, and the experience of a user is improved.

When a plurality of sharing contents exist in the social application interface, finger joint clicking operations are respectively executed for different sharing contents, and a plurality of target applications can be simultaneously displayed on a second screen of the folding screen mobile phone through coordinate calculation, namely, the target applications which are directly opened are displayed in a split screen mode. The number and the split mode of the specific split screens are not limited, and the setting is performed according to practical application.

The function of opening the restricted application program is realized on the folding screen mobile phone, so that the operation is more convenient, the screen splitting operation is performed on the social application and the target application, the application is more convenient, the performance of the mobile phone is optimized, the function display of the mobile phone is enriched, and the experience of a user is improved.

In addition, for the form of the shared content, the shared content can be a section of text form (the shared link or the shared password with a preset format is included in the shared content), or can be a simple website or link, and the concrete expression form of the shared content is not limited; meanwhile, the method can be used for directly opening and jumping to a corresponding target application page aiming at the target application program limited by the current social application.

Corresponding to the method for opening an application program and the application scenario embodiment described in the foregoing embodiments, fig. 8 is a block diagram illustrating a device for opening an application program according to an embodiment of the present application, and for convenience of explanation, only a portion related to the embodiment of the present application is shown.

Referring to fig. 8, the apparatus includes an acquisition module 81, an identification module 82, and a start module 83. Wherein, each module functions as follows:

an obtaining module 81, configured to intercept a picture containing a current display content of a first application when a preset operation on the display content is detected;

The identification module 82 is configured to identify the picture, and obtain an identification result;

a starting module 83, configured to start a page of a second application associated with the identification result, where the second application is an application limited by the first application.

By adopting the method for starting the application program, the page of the second application limited by the first application program can be started through the preset operation of the current display content of the first application program, a user is not required to copy the corresponding display content, log out of the first application, then start the second application and other complicated operations, the operation flow is simplified, and the operation efficiency is improved.

In one possible implementation manner, the acquiring module includes:

In one possible implementation, the identification module includes:

In one possible implementation, the apparatus further includes:

It should be noted that, because the content of information interaction and execution process between the above devices/units is based on the same concept as the method embodiment of the present application, specific functions and technical effects thereof may be referred to in the method embodiment section, and will not be described herein again.

In this embodiment, other contents may refer to the description in the foregoing embodiment, and will not be repeated here.

It is to be understood that the above embodiments may be arbitrarily combined without contradiction between schemes.

According to the method for starting the application program, when the terminal equipment detects the preset operation of the current display content of the first application program, the screen capturing can be carried out on the content displayed by the first application program belonging to the social category, the picture containing the display content is obtained, the identification result is obtained through identifying the content in the picture, the terminal equipment determines the second application program according to the identification result, and the page of the second application program associated with the identification result is started, so that a user is not required to copy and share the content, log out of the first application program, then start the second application program and a series of complicated operations such as operation flow is simplified, operation is more convenient, and system performance is improved.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.

Fig. 9 is a schematic structural diagram of a terminal device according to an embodiment of the present application. As shown in fig. 9, the terminal device 9 of this embodiment includes: at least one processor 91 (only one is shown in fig. 9), a memory 92, a computer program 93 stored in the memory 92 and executable on the at least one processor 91, and a touch screen 94. The memory 92, the touch screen 94 are coupled to the processor 91, the memory 92 is used for storing a computer program 93, the computer program 93 comprises instructions, the processor 91 reads the instructions from the memory 92, so that the terminal device 9 performs the following operations:

When detecting a preset operation on the current display content of the first application program, intercepting a picture containing the display content comprises the following steps:

The step of identifying the picture, wherein the step of obtaining an identification result comprises the following steps:

Before opening the page of the second application program associated with the identification result, the method further comprises:

and copying the identification result to a sticky board of the memory.

By adopting the possible implementation manner, the identification result can be directly copied into the memory paste board by the terminal equipment and is used for being called by the second application program after the second application program is started so as to jump to the corresponding page of the second application program, so that the page of the second application program corresponding to the display content can be directly opened and jumped to according to the read identification result, the second application program does not need to be opened manually, and the operation is more convenient.

Before capturing the picture containing the display content, the method further comprises:

The preset operation includes a knuckle clicking operation.

According to the embodiment, when a preset operation of the current display content of the first application program is detected, a picture containing the display content is intercepted; identifying the picture to obtain an identification result; opening a page of a second application program associated with the identification result, wherein the second application program is an application program limited by the first application program; the problem of complex operation when the first application program interface starts the limited second application program is solved; by setting the preset operation, the identification of the picture of the display content is triggered, and the second application program which is related to the identification result and limited by the first application program is started, so that the function of quickly starting the second application program on the first application interface is realized, the operation flow is simplified, the efficiency of starting the second application program is improved, and the performance of the terminal equipment is improved.

The terminal device 9 may be a computing device such as a desktop computer, a notebook computer, a palm computer, a mobile phone, etc. The terminal device may include, but is not limited to, a processor 91, a memory 92. It will be appreciated by those skilled in the art that fig. 9 is merely an example of the terminal device 9 and is not meant to be limiting as to the terminal device 9, and may include more or fewer components than shown, or may combine certain components, or different components, such as may also include input-output devices, network access devices, etc.

The processor 91 may be a central processing unit (Central Processing Unit, CPU), the processor 91 may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory 92 may in some embodiments be an internal storage unit of the terminal device 9, such as a hard disk or a memory of the terminal device 9. The memory 92 may in other embodiments also be an external storage device of the terminal device 9, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the terminal device 9. Further, the memory 92 may also include both an internal storage unit and an external storage device of the terminal device 9. The memory 92 is used to store an operating system, applications, boot loader (BootLoader), data, and other programs, such as program code for the computer program. The memory 92 may also be used to temporarily store data that has been output or is to be output.

The embodiment of the application also provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program comprises instructions, and when the instructions are run on terminal equipment, the instructions cause the terminal equipment to execute the method for starting the application program.

Embodiments of the present application provide a computer program product comprising instructions, which when run on a terminal device, cause the terminal device to perform a method of opening an application as described in any of the first aspects above.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present application implements all or part of the flow of the method of the above embodiments, and may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, where the computer program, when executed by a processor, may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include at least: any entity or device capable of carrying computer program code to a photographing device/terminal apparatus, recording medium, computer Memory, read-Only Memory (ROM), random access Memory (RAM, random Access Memory), electrical carrier signals, telecommunications signals, and software distribution media. Such as a U-disk, removable hard disk, magnetic or optical disk, etc. In some jurisdictions, computer readable media may not be electrical carrier signals and telecommunications signals in accordance with legislation and patent practice.

In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus/network device and method may be implemented in other manners. For example, the apparatus/network device embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions in actual implementation, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

The above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.

Claims

1. A method of opening an application, comprising:

when a preset operation of the current display content of the first application program is detected, capturing a picture containing the display content;

Identifying the picture to obtain an identification result;

and opening a page of a second application program associated with the identification result, wherein the second application program is an application program limited by the first application program.

2. The method for opening an application according to claim 1, wherein intercepting a picture containing the display content when a preset operation for the first application to currently display the content is detected comprises:

3. The method for opening an application program according to claim 1, wherein the identifying the picture includes:

4. A method of opening an application according to any one of claims 1 to 3, wherein the recognition result comprises keywords of a page of the second application.

5. A method of opening an application according to any one of claims 1 to 3, wherein the identification result comprises a uniform resource locator URL feature or a shared password of a page of the second application.

6. The method for opening an application program according to claim 5, wherein the identifying the picture includes:

performing optical character recognition on the picture;

if character string information is identified, URL feature matching is carried out on the identified character string information;

and if the URL characteristic matched with the character string information exists, taking the content containing the character string information as the identification result.

7. The method for opening an application of claim 1, further comprising, prior to opening a page of a second application associated with the identification result:

and copying the identification result to a sticky board of the memory.

8. The method for opening an application of claim 1, further comprising, prior to intercepting a picture containing the display content:

9. A method of opening an application as claimed in claim 1, comprising: the preset operation includes a knuckle clicking operation.

10. An apparatus for opening an application, comprising:

11. The apparatus for opening an application of claim 10, wherein the acquisition module comprises:

12. The apparatus for opening an application of claim 10, wherein the identification module is further configured to:

13. An apparatus for opening an application according to any one of claims 10-12, wherein the recognition result comprises a keyword of a page of the second application.

14. The apparatus for opening an application according to any one of claims 10-12, wherein the identification result comprises a uniform resource locator, URL, feature or a shared password of a page of the second application.

15. The apparatus for opening an application of claim 14, wherein the identification module comprises:

16. The apparatus for opening an application of claim 10, wherein the apparatus further comprises:

17. The apparatus for opening an application of claim 16, wherein the start-up module comprises:

the reading unit is used for reading the identification result from the adhesive board of the memory;

and the opening unit is used for opening the page of the second application program associated with the identification result.

18. The apparatus for opening an application of claim 10, wherein the apparatus further comprises:

19. The apparatus for opening an application of claim 10, wherein the preset operation comprises a finger joint clicking operation.

20. A terminal device comprising a memory, a processor, and a touch screen, the memory, the touch screen being coupled to the processor, the memory for storing a computer program comprising instructions that, when executed by the terminal device, cause the terminal device to perform the method of opening an application of any of claims 1-9.

21. A computer storage medium, characterized in that the computer readable storage medium stores a computer program comprising instructions that, when run on a terminal device, cause the terminal device to perform the method of opening an application according to any of claims 1 to 9.

22. A computer program product comprising instructions which, when run on a terminal device, cause the terminal device to perform the method of opening an application according to any of claims 1 to 9.