CN108008874B - Data processing method and device of mobile terminal and mobile terminal - Google Patents
Data processing method and device of mobile terminal and mobile terminal Download PDFInfo
- Publication number
- CN108008874B CN108008874B CN201711153379.XA CN201711153379A CN108008874B CN 108008874 B CN108008874 B CN 108008874B CN 201711153379 A CN201711153379 A CN 201711153379A CN 108008874 B CN108008874 B CN 108008874B
- Authority
- CN
- China
- Prior art keywords
- image data
- matching degree
- program object
- mobile terminal
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Telephone Function (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention provides a data processing method and device of a mobile terminal and the mobile terminal, wherein the mobile terminal stores preset User Interface (UI) image data, and runs a system program object and an application program object, and the method comprises the following steps: capturing, by the system program object, current UI image data of the application program object when the system program object is running; judging whether the matching degree of the current UI image data and the preset UI image data is greater than a preset matching degree threshold value or not; when the matching degree is larger than a preset matching degree threshold value, extracting feature data in the current UI image data; presenting the feature data in the system program object. According to the embodiment of the invention, the historical information of various application programs of the user can be recorded and classified, the user can browse intuitively, the convenience and the rapidness of the user for looking up are improved, and the user experience is improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of mobile terminals, in particular to a data processing method of a mobile terminal and the mobile terminal.
Background
With the development of scientific technology, mobile terminals (including smart phones) play more and more important roles in the life of people, and the existing mobile terminals can run various application programs besides the basic call function and the short message sending function, and realize additional functions, such as photographing, video chatting with other users, payment operation and the like.
The mobile terminal can also support more and more application programs, a user can check the historical information on the application program one by opening the application program, but the historical information is managed only by a management mechanism in the application program, the management is too scattered for the user, even a part of the application program does not provide a historical information management function, the user cannot conveniently search and browse the historical information, and the use experience of the user on the mobile terminal is reduced.
Disclosure of Invention
The embodiment of the invention provides a data processing method and device of a mobile terminal and the mobile terminal, and aims to solve the problems that the historical information management function of the mobile terminal is lacked, and a user cannot search and browse historical information conveniently.
In order to solve the technical problem, the invention is realized as follows: a data processing method of a mobile terminal, wherein the mobile terminal stores preset User Interface (UI) image data, and runs a system program object and an application program object, the method comprises the following steps:
capturing, by the system program object, current UI image data of the application program object when the system program object is running;
judging whether the matching degree of the current UI image data and the preset UI image data is greater than a preset matching degree threshold value or not;
when the matching degree is larger than a preset matching degree threshold value, extracting feature data in the current UI image data;
presenting the feature data in the system program object.
In a first aspect, an embodiment of the present invention further provides a data processing apparatus for a mobile terminal, where the mobile terminal stores preset UI image data, and the mobile terminal runs a system program object and an application program object, and the apparatus includes:
a current UI image data capture module for capturing current UI image data of the application object by the system object when the system object is running;
the judging module is used for judging whether the matching degree of the current UI image data and the preset UI image data is greater than a preset matching degree threshold value or not;
the characteristic data extraction module is used for extracting the characteristic data in the current UI image data when the matching degree is greater than a preset matching degree threshold value;
a rendering module for rendering the characteristic data in the system program object.
In a second aspect, an embodiment of the present invention provides a mobile terminal, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program, when executed by the processor, implements the steps of the data processing method of the mobile terminal described above.
In the embodiment of the invention, the mobile terminal stores preset user interface UI image data, the mobile terminal runs a system program object and an application program object, and when the system program object runs, the system program object captures the current UI image data of the application program object; judging whether the matching degree of the current UI image data and the preset UI image data is greater than a preset matching degree threshold value or not; when the matching degree is larger than a preset matching degree threshold value, extracting feature data in the current UI image data; rendering the feature data in the system program object; according to the embodiment of the invention, the historical information of various application programs of the user can be recorded and classified, the user can browse intuitively, the convenience and the rapidness of the user for looking up are improved, and the user experience is improved.
Drawings
Fig. 1 is a flowchart illustrating a first step of a data processing method of a mobile terminal according to an embodiment of the present invention;
fig. 2 is a flowchart of steps of a second embodiment of a data processing method of a mobile terminal according to the present invention;
FIG. 3 is a schematic diagram of a display interface in an embodiment of the invention;
FIG. 4 is a representation of a feature data in an embodiment of the invention;
FIG. 5 is a block diagram of an embodiment of a data processing apparatus of a mobile terminal according to the present invention;
fig. 6 is a block diagram of a mobile terminal according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a flowchart illustrating a first step of a data processing method of a mobile terminal according to an embodiment of the present invention is shown, where the mobile terminal stores preset UI (User Interface) image data, and the mobile terminal runs a system program object and an application program object, and the first step may specifically include the following steps:
in a specific implementation, the embodiments of the present invention may be applied to a mobile terminal, such as a mobile phone, a tablet computer, a personal digital assistant, a wearable device (such as glasses, a watch, etc.), and the like.
In the embodiment of the present invention, the operating system of the mobile terminal may include Android (Android), IOS, Windows phone, Windows, and the like.
In a specific implementation of the embodiment of the present invention, the mobile terminal stores preset UI image data, where the UI image data may be an image that includes characteristic data and is preset by a user, for example, a payment interface of payment software or a transfer interface of financial management software, which is obtained in advance, and the embodiment of the present invention is not limited to this.
Further, the mobile terminal runs a system program object and an application program object, the system program object may include a calendar application program, or the system program object may be a system program with an independent display function; further, the application object may include third party applications, which may be classified into different categories based on different categories of information; for example, the third-party application may include payment, financial, game, call, short message, recording, photo, weather, system security, social communication, audio/video, video/audio, photography, news reading, convenient life, traffic navigation, travel hotel, shopping discount, sports health, education and study, theme wallpaper, office business and the like, which are not limited in the embodiments of the present invention.
In particular, when the system program object runs, the system program object captures current UI image data of the application program object; that is, current UI image data displaying an application object on a screen of the mobile terminal is captured when the system object runs in the background. For example, when the calendar system program is running in the form of a background program, the mobile terminal further includes a certain payment application program running at the front end, at this time, the calendar system program may obtain current UI image data of the payment application program, and it should be noted that the current UI image data is currently displayed UI image data, which may include a shopping interface when a user shops, or a payment interface; the embodiments of the present invention are not limited in this regard.
in practical application to the embodiment of the present invention, the mobile terminal may determine whether the matching degree of the current UI image data and the preset UI image data is greater than a preset matching degree threshold; specifically, the UI image data may be an image containing feature data set in advance by a user, and after the current UI image data is acquired, the current UI image data may be compared with the preset UI image data to acquire a matching degree therebetween, specifically, the current UI image data may be compared with the preset UI image data in a matching degree manner in an image recognition manner, that is, each image feature between the two is compared, the matching degree between the image features is determined, and a sum of the matching degrees of the image features is used as the matching degree of the image data.
It should be noted that the preset matching degree threshold may be any value set by those skilled in the art according to practical situations, such as 80%, 90%, or 95%; the embodiments of the present invention are not limited in this regard.
103, when the matching degree is greater than a preset matching degree threshold value, extracting feature data in the current UI image data;
further, when the mobile terminal determines whether the matching degree is greater than a preset matching degree threshold, the feature data in the current UI image data may be extracted.
It should be noted that the feature data may include one or more of application package name information, money amount information, time information, article information, image information, text information, and web page information, and the embodiment of the present invention does not limit the type of the feature data.
Practically speaking, when the current UI image data is a payment interface, money information, user information, product information, or product image information may be extracted; when the current UI image data is a transfer interface, money information and financial institution information can be extracted; when the current UI image data is a shopping interface, product image information, time information, or address information may be extracted, the above examples are only examples of the embodiment of the present invention, and should not be construed as limitations to the embodiment of the present invention, and different feature data of different interfaces may also be extracted, which is not limited in this embodiment of the present invention.
In the embodiment of the present invention, the feature data may also be presented in the system program object, and specifically, the feature data is presented in a display interface in the system program object.
In a preferred embodiment of the present invention, a mapping relationship between the application type information and the feature data is first established, that is, a mapping relationship between the feature data and the application object is established, and the feature data is categorized into the corresponding application object, and further, the feature data may be categorized into the application objects of the same class according to the class information.
For example, the feature data of the payment interface may be mapped with the corresponding payment software, and the feature data of the shopping interface may also be mapped with the corresponding shopping software.
Further, the mobile terminal may present the feature data in the system program object according to the mapping relationship, specifically, the system program object includes a display interface, the type information has a corresponding type control on the display interface, when a click operation instruction for the type control is received, the feature data corresponding to the type information is presented on the display interface according to the mapping relationship, and the feature data corresponding to the type information may be presented according to time information or product information.
In the embodiment of the invention, the mobile terminal stores preset user interface UI image data, the mobile terminal runs a system program object and an application program object, and when the system program object runs, the system program object captures the current UI image data of the application program object; judging whether the matching degree of the current UI image data and the preset UI image data is greater than a preset matching degree threshold value or not; when the matching degree is larger than a preset matching degree threshold value, extracting feature data in the current UI image data; rendering the feature data in the system program object; according to the embodiment of the invention, the historical information of various application programs of the user can be recorded and classified, the user can browse intuitively, the convenience and the rapidness of the user for looking up are improved, and the user experience is improved.
Referring to fig. 2, a flowchart illustrating steps of a second embodiment of a data processing method for a mobile terminal according to the present invention is shown, where the mobile terminal stores preset UI image data, and the mobile terminal runs a system program object and an application program object, and the method specifically includes the following steps:
in the embodiment of the present invention, the mobile terminal runs the system program object and the application program object at the same time, and preferably, the system program object runs in a background of the mobile terminal (i.e., runs as a background program), and the application program object runs in a front end of the mobile terminal.
When the system program object runs, the system program object captures the current UI image data of the application program object; that is, current UI image data displaying an application object on a screen of the mobile terminal is captured when the system object runs in the background. For example, when the calendar system program is running in the form of a background program, the mobile terminal further includes a certain payment application program running in the front end, and at this time, the calendar system program may acquire current UI image data of the payment application program.
It should be noted that the preset UI image data may also be stored in the server, and when the mobile terminal needs to perform comparison, a request is sent to the server to obtain the preset UI image data; the preset UI image data may be preset by the user.
further, acquiring the matching degree of the current UI image data and the preset UI image data, specifically, respectively performing graying processing and binarization processing on the current UI image data and the preset UI image data in an image identification mode; and extracting a connection domain, respectively obtaining a plurality of characteristics of the current UI image data and the preset UI image data, comparing the plurality of characteristics of the current UI image data and the preset UI image data, and obtaining the matching degree of the current UI image data and the preset UI image data.
It should be noted that the above-mentioned method is only an example of the embodiment of the present invention, and other manners may also be used to obtain the matching degree between the current UI image data and the preset UI image data, such as an algorithm based on feature matching, and the like.
specifically, the mobile terminal may further determine whether the matching degree is greater than the preset matching degree threshold, for example, when the matching degree of the current UI image data and the preset UI image data is 94%, and the preset matching degree threshold is 90%, it may be determined that the matching degree is greater than the preset matching degree threshold.
It should be noted that the preset matching degree threshold may be any value set by those skilled in the art according to practical situations, such as 80%, 90%, or 95%; the embodiments of the present invention are not limited in this regard.
specifically, when the mobile terminal determines that the matching degree is greater than the preset matching degree threshold, the feature data in the current UI image data may be extracted.
Preferably, the feature data includes one or more of application package name information, money amount information, time information, article information, image information, text information, and web page information.
In practical application, when the current UI image data is a transfer interface, money information and financial institution information can be extracted; when the current UI image data is a shopping interface, product image information, time information, or address information may be extracted, which is not limited in the embodiment of the present invention.
in the embodiment of the present invention, the mobile terminal may obtain the type information of the application object, specifically, the application object may include a plurality of third-party applications, and each third-party application includes preset type information;
the third party application program can be divided into different categories according to different categories of information; for example, the third party applications may include payment, financial, gaming, messaging, text messaging, voice recording, photos, weather, system security, social communications, audio-visual, video-audio, photography, news reading, convenience of life, traffic navigation, travel hotels, shopping offers, sports health, educational learning, theme wallpaper, office commerce, and other categories.
specifically, the mobile terminal may establish a mapping relationship between the type information and the feature data, that is, a mapping relationship between each type of application program and the feature data, for example, a mapping relationship between the type information of the payment type application program and the corresponding feature data.
Further, a mapping relationship between each application program and corresponding feature data may be established, so as to perform different levels of display, which is not limited in the embodiment of the present invention.
Actually applied to the embodiment of the invention, the characteristic data is presented in the system program object according to the mapping relation; the system program object comprises a display interface, wherein a plurality of type controls are arranged on the display interface, and specifically, each type control can control the presentation of characteristic data corresponding to each type of application program; preferably, each type control can control the presentation of the feature data corresponding to each application.
Specifically, when a system program object is received and a click operation instruction for the type control is received, feature data corresponding to the type information is presented on the display interface according to the mapping relation; for example, when a click operation instruction of a user for the payment type control is received, the system program object pays the feature data of the application program in the display interface according to the mapping relation.
Referring to fig. 3, a schematic diagram of a display interface in the embodiment of the present invention is shown, as shown in the figure, when a system program object is a calendar program, the display interface may include multiple types of controls, such as "call," "short message," "recording," "photo," and "payment," on a certain date, and further, the display interface may also present elements such as a schedule activity on a certain date, which is not limited in this embodiment of the present invention.
Referring to fig. 4, a schematic diagram of presenting feature data in the embodiment of the present invention is shown, as shown in the figure, when a click event of a user on a "payment" control is received, the calendar program may present payment-related feature information, such as money information, product information, website information, and the like, such as "pay 10 yuan", "buy mobile phone", and "pan".
In the embodiment of the invention, when the system program object runs, the system program object captures the current UI image data of the application program object; obtaining the matching degree of the current UI image data and the preset UI image data in an image recognition mode; judging whether the matching degree is greater than the preset matching degree threshold value or not; when the matching degree is larger than a preset matching degree threshold value, extracting feature data in the current UI image data; acquiring the type information of the application program object; establishing a mapping relation between the type information and the characteristic data; presenting the feature data in the system program object according to the mapping relation; the history information of various application programs of a user can be recorded and classified, the data is integrated in a certain application program, the user can browse intuitively, the convenience and the rapidness for the user to look up are improved, the data of a third-party application program does not need to be acquired through a data interface, and the complexity of the data acquisition step is reduced.
Fig. 5 is a block diagram illustrating a data processing apparatus 300 of a mobile terminal storing predetermined UI image data, the mobile terminal running a system program object and an application program object, according to an embodiment of the present invention, where the data processing apparatus 300 of the mobile terminal illustrated in fig. 5 includes a current UI image data capturing module 301, a determining module 302, a feature data extracting module 303, and a presenting module 304;
a current UI image data capturing module 301, configured to capture current UI image data of the application object by the system object when the system object runs;
a determining module 302, configured to determine whether a matching degree of the current UI image data and the preset UI image data is greater than a preset matching degree threshold;
a feature data extraction module 303, configured to extract feature data in the current UI image data when the matching degree is greater than a preset matching degree threshold;
a rendering module 304 for rendering the characteristic data in the system program object.
Preferably, the determining module 302 includes:
the matching degree obtaining sub-module is used for obtaining the matching degree of the current UI image data and the preset UI image data in an image recognition mode;
and the judging submodule is used for judging whether the matching degree is greater than the preset matching degree threshold value.
Preferably, the feature data includes one or more of application package name information, money amount information, time information, article information, image information, text information, and web page information.
Preferably, the presentation module 304 comprises:
the type information acquisition submodule is used for acquiring the type information of the application program object;
the mapping relation establishing submodule is used for establishing the mapping relation between the type information and the characteristic data;
and the presentation submodule is used for presenting the characteristic data in the system program object according to the mapping relation.
Preferably, the system program object includes a display interface, the type information has a corresponding type control on the display interface, and the presentation sub-module includes:
and the presentation unit is used for presenting the characteristic data corresponding to the type information on the display interface according to the mapping relation when a click operation instruction aiming at the type control is received.
The mobile terminal provided in the embodiment of the present invention can implement each process implemented by the mobile terminal in the method embodiments of fig. 1 to fig. 2, and is not described herein again to avoid repetition.
In the embodiment of the invention, the mobile terminal stores preset user interface UI image data, the mobile terminal runs a system program object and an application program object, and when the system program object runs, the system program object captures the current UI image data of the application program object; judging whether the matching degree of the current UI image data and the preset UI image data is greater than a preset matching degree threshold value or not; when the matching degree is larger than a preset matching degree threshold value, extracting feature data in the current UI image data; rendering the feature data in the system program object; according to the embodiment of the invention, the historical information of various application programs of the user can be recorded and classified, the user can browse intuitively, the convenience and the rapidness of the user for looking up are improved, and the user experience is improved.
Figure 6 is a schematic diagram of a hardware configuration of a mobile terminal implementing various embodiments of the present invention,
the mobile terminal 400 includes, but is not limited to: radio frequency unit 401, network module 402, audio output unit 403, input unit 404, sensor 405, display unit 406, user input unit 407, interface unit 408, memory 409, processor 410, and power supply 411. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 6 is not intended to be limiting of mobile terminals, and that a mobile terminal may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
Wherein processor 410 is configured to capture current UI image data of the application object when the system program object is running; judging whether the matching degree of the current UI image data and the preset UI image data is greater than a preset matching degree threshold value or not; when the matching degree is larger than a preset matching degree threshold value, extracting feature data in the current UI image data; presenting the feature data in the system program object.
In the embodiment of the invention, when the system program object runs, the system program object captures the current UI image data of the application program object; obtaining the matching degree of the current UI image data and the preset UI image data in an image recognition mode; judging whether the matching degree is greater than the preset matching degree threshold value or not; when the matching degree is larger than a preset matching degree threshold value, extracting feature data in the current UI image data; acquiring the type information of the application program object; establishing a mapping relation between the type information and the characteristic data; presenting the feature data in the system program object according to the mapping relation; the history information of various application programs of a user can be recorded and classified, the data is integrated in a certain application program, the user can browse intuitively, the convenience and the rapidness for the user to look up are improved, the data of a third-party application program does not need to be acquired through a data interface, and the complexity of the data acquisition step is reduced.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 401 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 410; in addition, the uplink data is transmitted to the base station. Typically, radio unit 401 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. Further, the radio unit 401 can also communicate with a network and other devices through a wireless communication system.
The mobile terminal provides the user with wireless broadband internet access through the network module 402, such as helping the user send and receive e-mails, browse web pages, and access streaming media.
The audio output unit 403 may convert audio data received by the radio frequency unit 401 or the network module 402 or stored in the memory 409 into an audio signal and output as sound. Also, the audio output unit 403 may also provide audio output related to a specific function performed by the mobile terminal 400 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 403 includes a speaker, a buzzer, a receiver, and the like.
The input unit 404 is used to receive audio or video signals. The input Unit 404 may include a Graphics Processing Unit (GPU) 4041 and a microphone 4042, and the Graphics processor 4041 processes image data of a still picture or video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 406. The image frames processed by the graphic processor 4041 may be stored in the memory 409 (or other storage medium) or transmitted via the radio frequency unit 401 or the network module 402. The microphone 4042 may receive sound, and may be capable of processing such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 401 in case of the phone call mode.
The mobile terminal 400 also includes at least one sensor 405, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 4061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 4061 and/or the backlight when the mobile terminal 400 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the mobile terminal (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 405 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be described in detail herein.
The display unit 406 is used to display information input by the user or information provided to the user. The Display unit 406 may include a Display panel 4061, and the Display panel 4061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 407 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 407 includes a touch panel 4071 and other input devices 4072. Touch panel 4071, also referred to as a touch screen, may collect touch operations by a user on or near it (e.g., operations by a user on or near touch panel 4071 using a finger, a stylus, or any suitable object or attachment). The touch panel 4071 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 410, receives a command from the processor 410, and executes the command. In addition, the touch panel 4071 can be implemented by using various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 4071, the user input unit 407 may include other input devices 4072. Specifically, the other input devices 4072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a track ball, a mouse, and a joystick, which are not described herein again.
Further, the touch panel 4071 can be overlaid on the display panel 4061, and when the touch panel 4071 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 410 to determine the type of the touch event, and then the processor 410 provides a corresponding visual output on the display panel 4061 according to the type of the touch event. Although in fig. 6, the touch panel 4071 and the display panel 4061 are two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 4071 and the display panel 4061 may be integrated to implement the input and output functions of the mobile terminal, which is not limited herein.
The interface unit 408 is an interface through which an external device is connected to the mobile terminal 400. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 408 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 400 or may be used to transmit data between the mobile terminal 400 and external devices.
The memory 409 may be used to store software programs as well as various data. The memory 409 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 409 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 410 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 409 and calling data stored in the memory 409, thereby integrally monitoring the mobile terminal. Processor 410 may include one or more processing units; preferably, the processor 410 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 410.
The mobile terminal 400 may further include a power supply 411 (e.g., a battery) for supplying power to various components, and preferably, the power supply 411 may be logically connected to the processor 410 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.
In addition, the mobile terminal 400 includes some functional modules that are not shown, and thus, are not described in detail herein.
Preferably, an embodiment of the present invention further provides a mobile terminal, including a processor 610, a memory 609, and a computer program stored in the memory 609 and capable of running on the processor 610, where the computer program, when executed by the processor 610, implements each process of the data processing method embodiment of the mobile terminal, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the data processing method embodiment of the mobile terminal, and can achieve the same technical effect, and in order to avoid repetition, the detailed description is omitted here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (9)
1. A data processing method of a mobile terminal is characterized in that the mobile terminal stores preset User Interface (UI) image data, the mobile terminal runs a system program object and an application program object, and the method comprises the following steps:
capturing, by the system program object, current UI image data of the application program object when the system program object is running;
judging whether the matching degree of the current UI image data and the preset UI image data is greater than a preset matching degree threshold value or not;
when the matching degree is larger than a preset matching degree threshold value, extracting feature data in the current UI image data;
rendering the feature data in the system program object;
the step of judging whether the matching degree of the current UI image data and the preset UI image data is greater than a preset matching degree threshold value comprises the following steps:
obtaining the matching degree of the current UI image data and the preset UI image data in an image recognition mode;
and judging whether the matching degree is greater than the preset matching degree threshold value.
2. The method of claim 1, wherein the feature data comprises one or more of application package name information, money amount information, time information, article information, image information, text information, and web page information.
3. The method of claim 1, wherein the step of rendering the feature data in the system program object comprises:
acquiring the type information of the application program object;
establishing a mapping relation between the type information and the characteristic data;
and presenting the characteristic data in the system program object according to the mapping relation.
4. The method of claim 3, wherein the system program object comprises a display interface, the type information has a corresponding type control on the display interface, and the step of presenting the feature data in the system program object according to the mapping relationship comprises:
and when a click operation instruction aiming at the type control is received, presenting the characteristic data corresponding to the type information on the display interface according to the mapping relation.
5. A data processing apparatus of a mobile terminal, wherein the mobile terminal stores preset User Interface (UI) image data, and the mobile terminal runs a system program object and an application program object, the apparatus comprising:
a current UI image data capture module for capturing current UI image data of the application object by the system object when the system object is running;
the judging module is used for judging whether the matching degree of the current UI image data and the preset UI image data is greater than a preset matching degree threshold value or not;
the characteristic data extraction module is used for extracting the characteristic data in the current UI image data when the matching degree is greater than a preset matching degree threshold value;
a rendering module for rendering the feature data in the system program object;
the judging module comprises:
the matching degree obtaining sub-module is used for obtaining the matching degree of the current UI image data and the preset UI image data in an image recognition mode;
and the judging submodule is used for judging whether the matching degree is greater than the preset matching degree threshold value.
6. The apparatus of claim 5, wherein the feature data comprises one or more of application package name information, money amount information, time information, article information, image information, text information, and web page information.
7. The apparatus of claim 5, wherein the presentation module comprises:
the type information acquisition submodule is used for acquiring the type information of the application program object;
the mapping relation establishing submodule is used for establishing the mapping relation between the type information and the characteristic data;
and the presentation submodule is used for presenting the characteristic data in the system program object according to the mapping relation.
8. The apparatus of claim 7, wherein the system program object comprises a display interface, wherein the type information has a corresponding type control on the display interface, and wherein the rendering sub-module comprises:
and the presentation unit is used for presenting the characteristic data corresponding to the type information on the display interface according to the mapping relation when a click operation instruction aiming at the type control is received.
9. A mobile terminal, characterized in that it comprises a processor, a memory and a computer program stored on the memory and executable on the processor, which computer program, when executed by the processor, carries out the steps of the data processing method of the mobile terminal according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711153379.XA CN108008874B (en) | 2017-11-20 | 2017-11-20 | Data processing method and device of mobile terminal and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711153379.XA CN108008874B (en) | 2017-11-20 | 2017-11-20 | Data processing method and device of mobile terminal and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108008874A CN108008874A (en) | 2018-05-08 |
| CN108008874B true CN108008874B (en) | 2020-05-19 |
Family
ID=62052598
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711153379.XA Active CN108008874B (en) | 2017-11-20 | 2017-11-20 | Data processing method and device of mobile terminal and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108008874B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20100025673A (en) * | 2008-08-28 | 2010-03-10 | 주식회사 현대오토넷 | Mobile telematics service terminal having smart memo function and method of sharing real-time memo data between mobile telematics service terminals |
| CN103336647A (en) * | 2012-02-24 | 2013-10-02 | 三星电子株式会社 | Method and device for generating captured image from display windows |
| CN103823836A (en) * | 2013-12-06 | 2014-05-28 | 华为技术有限公司 | Method and terminal for searching historical behavior records |
| CN103984732A (en) * | 2014-05-20 | 2014-08-13 | 天津三星通信技术研究有限公司 | Data management method based on calendar system and portable terminal |
| CN104657423A (en) * | 2015-01-16 | 2015-05-27 | 北京合辉信息技术有限公司 | Method and device thereof for sharing contents of applications |
-
2017
- 2017-11-20 CN CN201711153379.XA patent/CN108008874B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20100025673A (en) * | 2008-08-28 | 2010-03-10 | 주식회사 현대오토넷 | Mobile telematics service terminal having smart memo function and method of sharing real-time memo data between mobile telematics service terminals |
| CN103336647A (en) * | 2012-02-24 | 2013-10-02 | 三星电子株式会社 | Method and device for generating captured image from display windows |
| CN103823836A (en) * | 2013-12-06 | 2014-05-28 | 华为技术有限公司 | Method and terminal for searching historical behavior records |
| CN103984732A (en) * | 2014-05-20 | 2014-08-13 | 天津三星通信技术研究有限公司 | Data management method based on calendar system and portable terminal |
| CN104657423A (en) * | 2015-01-16 | 2015-05-27 | 北京合辉信息技术有限公司 | Method and device thereof for sharing contents of applications |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108008874A (en) | 2018-05-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108491123B (en) | Method for adjusting application program icon and mobile terminal | |
| CN107846352B (en) | Information display method and mobile terminal | |
| CN110719402B (en) | Image processing method and terminal equipment | |
| CN109240577B (en) | Screen capturing method and terminal | |
| CN109194818B (en) | Information processing method and terminal | |
| CN108135033B (en) | Bluetooth connection method and mobile terminal | |
| CN108616448B (en) | Information sharing path recommendation method and mobile terminal | |
| CN108833661B (en) | Information display method and mobile terminal | |
| CN107734170B (en) | Notification message processing method, mobile terminal and wearable device | |
| CN110674662A (en) | Scanning method and terminal equipment | |
| CN109412932B (en) | Screen capturing method and terminal | |
| CN109523253B (en) | Payment method and device | |
| CN107734172B (en) | Information display method and mobile terminal | |
| CN109753202B (en) | Screen capturing method and mobile terminal | |
| CN110971510A (en) | Message processing method and electronic equipment | |
| CN109544172B (en) | Display method and terminal equipment | |
| CN109495638B (en) | Information display method and terminal | |
| CN111064654A (en) | Message display method and electronic equipment | |
| CN108196781B (en) | Interface display method and mobile terminal | |
| CN109669656B (en) | Information display method and terminal equipment | |
| CN109669710B (en) | Note processing method and terminal | |
| CN108958579B (en) | Red packet sending and receiving method and red packet sending and receiving device | |
| CN111007980A (en) | Information input method and terminal equipment | |
| CN108491143B (en) | Object movement control method and mobile terminal | |
| CN108093119B (en) | Strange incoming call number marking method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |