WO2019223484A1

WO2019223484A1 - Information display method and apparatus, and mobile terminal and storage medium

Info

Publication number: WO2019223484A1
Application number: PCT/CN2019/083968
Authority: WO
Inventors: 黄千洋; 揭骏仁
Original assignee: Oppo广东移动通信有限公司
Priority date: 2018-05-24
Filing date: 2019-04-23
Publication date: 2019-11-28
Also published as: CN108803972B; CN108803972A

Abstract

Embodiments of the present application relate to the technical field of mobile terminals, and provide an information display method and apparatus, and a mobile terminal and a storage medium. The information display method is applied to the mobile terminal and comprises: displaying a user interface of the mobile terminal, and detecting an operation acting on the user interface; when the operation is a copy operation, selecting at least one interface element on the user interface according to the copy operation; and displaying at least one card on a part of a region of the user interface in an overlap mode, the at least one card being used for displaying information identified by the at least one interface element. According to the information display method and apparatus, the mobile terminal and the storage medium, text is identified and displayed by means of a shortcut operation, the text identification process is simplified, and the user experience is improved.

Description

Information display method, device, mobile terminal and storage medium

Cross-reference to related applications

This application claims priority from a Chinese application with an application number of 201810510349.8, filed on May 24, 2018, which is incorporated herein by reference in its entirety for all purposes.

Technical field

The present application relates to the technical field of mobile terminals, and more particularly, to an information display method, device, mobile terminal, and storage medium.

Background technique

With the development of science and technology, mobile terminals have become one of the most commonly used electronic products in people's daily lives. In addition, users often obtain a large amount of information through mobile terminals to meet their own reading needs.

Summary of the Invention

In view of the above problems, this application proposes an information display method, device, mobile terminal, and storage medium to improve the above problems.

In a first aspect, an embodiment of the present application provides an information display method applied to a mobile terminal. The method includes: displaying a user interface of the mobile terminal, detecting an operation acting on the user interface; and when the operation When the copy operation is performed, at least one interface element on the user interface is selected according to the copy operation; at least one card is superimposedly displayed on a partial area of the user interface, and the at least one card is used to display Information identified by interface elements.

In a second aspect, an embodiment of the present application provides an information display device applied to a mobile terminal. The device includes: an operation detection module for displaying a user interface of the mobile terminal, and detecting a user interface acting on the user interface. Operation; an interface element selection module for selecting at least one interface element on the user interface according to the copy operation when the operation is a copy operation; a card display module for use on a partial area of the user interface At least one card is displayed superimposed, and the at least one card is used to display information identified by the at least one interface element.

In a third aspect, an embodiment of the present application provides a mobile terminal including a touch screen, a memory, and a processor. The touch screen and the memory are coupled to the processor, and the memory stores instructions. When the processor executes, the processor executes the above method.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores program code, and the program code can be called by a processor to execute the foregoing method.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to explain the technical solutions in the embodiments of the present application more clearly, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are just some embodiments of the application. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative labor.

FIG. 1 is a schematic flowchart of an information display method according to an embodiment of the present application;

FIG. 2a is a schematic diagram of a first user interface of a mobile terminal according to an embodiment of the present application; FIG.

FIG. 2b is a schematic diagram of a second user interface of a mobile terminal according to an embodiment of the present application; FIG.

3 is a schematic flowchart of an information display method according to another embodiment of the present application;

4 is a schematic flowchart of an information display method according to another embodiment of the present application;

FIG. 5 shows a schematic flowchart of step S330 of the information display method provided by the embodiment shown in FIG. 4 of the present application;

FIG. 6 shows a module block diagram of an information display device provided by an embodiment of the present application; FIG.

FIG. 7 shows a module block diagram of an information display device according to another embodiment of the present application; FIG.

FIG. 8 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application; FIG.

FIG. 9 shows a block diagram of a mobile terminal for performing an information display method according to an embodiment of the present application;

FIG. 10 illustrates a storage unit for storing or carrying a program code for implementing an information display method according to an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

At present, when users use the mobile terminal to chat, read text, view pictures, or watch videos, they often become interested in some of these contents and search for more detailed information. At this time, users first need to copy the content of interest or Remember the content of interest, then open the browser, and paste the copied content into the browser's search box or enter the remembered content into the browser's search box to search for detailed information, resulting in a very tedious process , Takes a long time and is prone to errors. In view of the above technical problems, the inventor has proposed an information display method, device, mobile terminal, and storage medium provided in the embodiments of the present application. The text is recognized and displayed through quick operations, which simplifies the text recognition process and improves the user experience. The specific information display method is described in detail in the subsequent embodiments.

Please refer to FIG. 1, which is a schematic flowchart of an information display method according to an embodiment of the present application. The information display method is used for recognizing and displaying text through quick operations, simplifying the text recognition process, and improving user experience. In a specific embodiment, the information display method is applied to an information display device 200 as shown in FIG. 6 and a mobile terminal 100 (FIG. 8) configured with the information display device 200. In the following, a mobile terminal is taken as an example to describe the specific process of this embodiment. Of course, it can be understood that the mobile terminal applied in this embodiment may be a smart phone, a tablet computer, a wearable electronic device, etc., and is not described in detail here. limited. The process shown in FIG. 1 will be described in detail below. The information display method may specifically include the following steps:

Step S110: Display a user interface of the mobile terminal, and detect an operation acting on the user interface.

In this embodiment, the mobile terminal first displays a user interface, where the user interface may be an interface corresponding to the system desktop of the mobile terminal or an interface corresponding to a page of an application, and when the user interface is an application When the interface corresponding to the page is displayed, the application may be a native application provided by the mobile terminal system, such as memos, photos, etc., or a third-party application installed by the user, such as a novel reader, Weibo, and WeChat Today's headlines, etc., are not specifically limited here. Understandably, for an application, it usually includes multiple user interfaces. When the application is running in the foreground of a mobile terminal, one of the user interfaces of the application is displayed on the touch screen of the mobile terminal. .

Further, the operation on the user interface of the mobile terminal is detected. As a method, the operation may include single-finger tap, multi-finger tap, single-finger long tap, multi-finger long tap, heavy pressure, multiple taps. , Slide operation, voice input, copy operation, etc., where the single-finger click refers to the operation of single-finger clicking on the user interface; the multi-finger click refers to the operation of multi-finger clicking on the user interface at the same time; single-finger click Long press refers to single finger pressing on the user interface for more than the preset duration; multi-finger long press refers to multi-finger pressing on the user interface for more than the preset duration at the same time; heavy pressing refers to pressing pressure on the user interface exceeding the preset strength; Multiple clicks means that the number of clicks exceeds the preset number of times within a preset time; a swipe operation refers to dragging a card to slide on the touch screen; a voice input indicates the voice information entered when the mobile terminal displays a user interface; a copy operation refers to User interface operation to copy text information to pasteboard.

Step S120: When the operation is a copy operation, select at least one interface element on the user interface according to the copy operation.

In this embodiment, when the operation acting on the user interface is determined to be a copy operation through detection, the mobile terminal selects at least one interface element on the user interface according to the copy operation in response. Specifically, as shown in FIG. 2a, the user interface includes a plurality of interface elements, and when it is detected that a pressing operation on at least one interface element on the user interface exceeds a preset duration, a control is popped up and displayed on the user interface superimposedly. , Where the control includes selectable buttons such as "copy", "send to friend", "favorite", "reminder", "translation", "delete" and "more", and upon detecting that the user has When you touch the button, you can confirm that the operation is a copy operation. Further, the mobile terminal selects at least one interface element on the user interface in response to the copy operation, wherein the mobile terminal can determine at least one interface element based on the pressed position of the operation. For example, as a first way, the pressed position can be obtained. Coordinate information, and then obtain at least one element that coincides with the position of the coordinate information based on the coordinate information, determine the at least one element as at least one interface element, and finally copy at least one interface element at the pressed position to the pasteboard; as the first In two ways, the coordinate information of the pressed position can be obtained, and then based on the coordinate information, at least one element that coincides with the position of the coordinate information is obtained, and then the paragraph in which the at least one element is located is understood. It is understandable that when the at least one element is in the For the same paragraph, a paragraph is determined. When the at least one element is in multiple paragraphs, multiple paragraphs are determined. Then, all elements included in the paragraph are obtained, and all elements included in the paragraph are determined as at least one interface element. , And finally you can place All interface elements that are located in the same paragraph are copied to the pasteboard; as a third method, the coordinate information of the pressed position can be obtained, and then based on the coordinate information, a selection box is generated and displayed in the user interface, where the selection box Used to select interface elements. In addition, the size and position of the selection box can be controlled and changed. Based on the user's control of the selection box, the interface element in the selection box is determined to be at least one interface element. The interface elements selected by manual operation are copied to the pasteboard, and are not specifically limited here.

Step S130: Overlay and display at least one card on a part of the user interface, and the at least one card is used to display information identified by the at least one interface element.

Referring to FIG. 2b, a partial area of the user interface may be located in a lower area of the user interface, a partial area in the upper half of the user interface, a partial area in the left half of the user interface, It can also be located in a part of the right half of the user interface, etc. Optionally, in this embodiment, the part of the user interface is located in the lower half of the user interface near the bottom, and its size is not specifically limited. . Specifically, the interface elements in the user interface include, but are not limited to, text, pictures, audio, and / or video. After copying the text, pictures, audio, and / or video to the pasteboard, they are identified to obtain the same information as The search result information corresponding to the content in the user interface is displayed in the form of a card, where the card serves as a carrier carrying the search result information, and each card can display at least one search result information, at least The amount of search result information displayed by each card in a card may be the same or different, and the search result information displayed by each card may come from the same application or from different applications.

Further, the at least one card is displayed in a superimposed form on a partial area of the user interface. Understandably, at this time, the card may be displayed in a layered manner above the partial area of the user interface. It may also cover a part of the user interface and be displayed at a different level from the user interface. In addition, in this embodiment, when the at least one card is superimposed and displayed in a partial area of the user interface, the original content located in the partial area is still partially visible and is not completely blocked for a user's click operation.

Understandably, the text information copied to the pasteboard can be directly identified to obtain the content corresponding to the text information, and displayed on the user interface in the form of a card. Therefore, if the user only wishes to copy the interface elements to the paste When searching through a search box, it may conflict with the technical solution of the embodiment of the present application. Therefore, as a method, in this embodiment, it is first detected whether the identification function after copying is turned on, that is, it is first detected whether the mobile terminal allows identification and display of the content copied to the pasteboard. When the mobile terminal has enabled the identification function after copying, the interface elements copied to the pasteboard are identified, and at least one card is displayed superimposed on a part of the user interface.

An information display method provided by an embodiment of the present application displays a user interface of a mobile terminal, detects an operation acting on the user interface, and when the operation is a copy operation, selects at least one interface element on the user interface according to the copy operation. At least one card is superimposed and displayed on a part of the user interface, and the at least one card is used to display information identified by at least one interface element, so as to recognize and display the text through a quick operation, simplify the text recognition process, and improve the user experience.

Please refer to FIG. 3, which is a schematic flowchart of an information display method according to another embodiment of the present application. The process shown in FIG. 3 will be described in detail below. The method may specifically include the following steps:

Step S210: Display the user interface of the mobile terminal, and detect an operation acting on the user interface.

Step S220: When the operation is a copy operation, select at least one interface element on the user interface according to the copy operation.

Step S230: Detect the staying time of the mobile terminal in the user interface.

In this embodiment, after at least one interface element on the user interface is copied to the pasteboard, the length of stay of the mobile terminal in the user interface is detected, where the user interface is an interface for the user to perform a copy operation.

Step S240: It is determined whether the stay duration reaches a duration threshold.

Wherein, the mobile terminal sets and stores a time threshold in advance, and the time threshold is used as a basis for judging the stay duration. Therefore, in this embodiment, after obtaining the stay duration of the mobile terminal in the user interface, The dwell duration is compared with a duration threshold to determine whether the dwell duration reaches the duration threshold.

Step S250: When the stay duration reaches the duration threshold, the at least one card is superimposedly displayed on a partial area of the user interface.

Understandably, if the user's staying time in the user interface reaches the time threshold, it indicates that the user expects to display the content obtained after identifying the copied interface elements in the user interface, and the mobile terminal responds to the part of the user interface At least one card is displayed superimposed on the area; if the user's stay in the user interface is adjusted to other user interfaces without reaching the duration threshold, it indicates that the user desires to paste the copied interface element to other user interfaces, and the mobile terminal does not Interface elements are identified.

As a method, the touch operation on the user interface during the dwell time is detected. Similarly, the touch operation may include: single-finger tap, multi-finger tap, single-finger long press, multi-finger long press, re- Press, multiple clicks, swipe operations, copy operations, etc. It can be understood that if no touch operation on the user interface is detected within the dwell time, it indicates that the user expects to display the content obtained after identifying the copied interface element in the user interface, and the mobile terminal responds At least one card is displayed superimposed on a part of the user interface; if a touch operation acting on the user interface is detected within the dwell time, it indicates that the user desires to paste the copied interface element to another user interface, said moving The terminal does not perform a recognition operation on the interface element.

An information display method according to another embodiment of the present application displays a user interface of a mobile terminal, detects an operation acting on the user interface, and when the operation is a copy operation, selects at least one interface element on the user interface according to the copy operation, and detects The length of time the mobile terminal stays on the user interface to determine whether the length of the stay has reached the duration threshold. When the length of the stay reaches the duration threshold, at least one card is displayed superimposed on a part of the user interface, so as to determine whether the user desires quick identification by the duration of the stay. Screen, and recognize and display text through quick operations, simplify the text recognition process, and improve user experience.

Please refer to FIG. 4, which is a schematic flowchart of an information display method according to another embodiment of the present application. The process shown in FIG. 4 will be described in detail below. The method may specifically include the following steps:

Step S310: Display the user interface of the mobile terminal, and detect operations acting on the user interface.

Step S320: When the operation is a copy operation, select at least one interface element on the user interface according to the copy operation.

Step S330: identify the at least one interface element, and obtain a target interface element among the at least one interface element.

In this embodiment, the target interface element may include, but is not limited to, a movie name, a place name, a hotel name, a scenic spot name, a character name, a time, and the like.

Please refer to FIG. 5, which is a schematic flowchart of step S330 of the information display method provided by the embodiment shown in FIG. 4 of the present application. The process shown in FIG. 5 will be described in detail below. The method may specifically include the following steps:

Step S331: identify and segment the at least one interface element to obtain a segmentation result.

In this embodiment, at least one interface element is identified to obtain information such as a movie name, a place name, a hotel name, an attraction name, a character name, and a time in the at least one interface element, and the at least one interface is based on the information. The element is segmented to obtain multiple words, words, phrases, named entities, etc., which is the segmentation result.

Step S332: displaying the word segmentation result on the user interface, and detecting a selection operation acting on the word segmentation result.

Further, after the segmentation of at least one interface element, the segmentation result is displayed, so that the user can directly select the target interface element that needs further operation from the segmentation result, which is convenient for the user to directly operate the target interface element in the text. , The target interface element selected by the user can be one, two or more, etc., which is not limited here. As a way, a selection operation acting on the word segmentation result is detected to obtain a target interface element selected by the user.

Step S333: Determine the target interface element from the word segmentation result based on the selection operation.

Step S340: Perform a search based on the target interface element, obtain content corresponding to the target interface element, form at least one card based on the content, and superimpose and display the at least one card on a partial area of the user interface.

After the target interface element is obtained, the target interface element is identified and keywords in the target interface element are extracted, and a search is performed based on the keyword. It is understandable that the search for the keyword may correspond to multiple searches. Result information, displaying the plurality of search result information on at least one card, and the mobile terminal displaying the at least one card on a partial area of a user interface. Further, the search result information may correspond to detailed information in a browser, and may also correspond to playback information of an application, for example, when the keyword is a movie name, the search result information may include a browser The introduction of the key information about the movie in the movie can also include the video playback application program playing the movie, etc., which are all displayed on the card, which is more convenient for users to obtain a variety of information corresponding to the movie name.

Further, as a way, during the process of identifying at least one interface element and searching based on the target interface element, a loading bar animation transition is displayed on a partial area of the user interface, where the partial area includes the partial area , And the partial area and the partial area are both located in a bottom area of the user interface.

The information display method provided by another embodiment of the present application displays a user interface of a mobile terminal, detects an operation acting on the user interface, and when the operation is a copy operation, selects at least one interface element on the user interface according to the copy operation. The at least one interface element is identified, a target interface element in the at least one interface element is obtained, a search is performed based on the target interface element, content corresponding to the target interface element is obtained, and at least one card is formed based on the content on a part of the user interface The at least one card is superimposedly displayed, so that the text is recognized and displayed through a quick operation, the text recognition process is simplified, and the user experience is improved.

Please refer to FIG. 6, which illustrates a block diagram of an information display device 200 according to an embodiment of the present application. The following is a description of the block diagram shown in FIG. 6. The information display device 200 is applied to a mobile terminal. The information display device 200 includes: an operation detection module 210, an interface element selection module 220, and a card display module 230, of which:

The operation detection module 210 is configured to display a user interface of the mobile terminal, and detect an operation acting on the user interface.

An interface element selection module 220 is configured to select at least one interface element on the user interface according to the copy operation when the operation is a copy operation.

The card display module 230 is configured to superimpose and display at least one card on a part of the user interface, and the at least one card is used to display information identified by the at least one interface element. Please refer to FIG. 7, which illustrates a block diagram of an information display device according to another embodiment of the present application. Further, the card display module 230 includes a stay duration detection sub-module 231, a stay duration determination sub-module 232, First card display sub-module 233, touch operation detection sub-module 234, second card display sub-module 235, target interface element acquisition sub-module 236, third card display sub-module 237, status detection sub-module 238, and fourth card display Submodule 239, where:

The dwell duration detection sub-module 231 is configured to detect a dwell duration of the mobile terminal in the user interface.

The dwell duration determination sub-module 232 is configured to determine whether the dwell duration reaches a duration threshold.

The first card display submodule 233 displays the at least one card on a partial area of the user interface when the stay duration reaches the duration threshold.

The touch operation detection sub-module 234 is configured to detect a touch operation acting on the user interface during the dwell time.

A second card display sub-module 235 is configured to superimpose and display the at least one card on a partial area of the user interface when a touch operation acting on the user interface is not detected within the dwell time.

The target interface element acquisition submodule 236 is configured to identify the at least one interface element, and obtain a target interface element in the at least one interface element. Further, the target interface element acquisition submodule 236 includes a word segmentation result acquisition unit, a selection operation detection unit, and a target interface element acquisition unit, wherein:

The segmentation result acquisition unit is configured to identify and segment the at least one interface element to obtain a segmentation result.

A selection operation detection unit is configured to display the word segmentation result on the user interface, and detect a selection operation acting on the word segmentation result.

A target interface element obtaining unit is configured to determine the target interface element from the word segmentation result based on the selection operation.

A third card display sub-module 237 is configured to perform a search based on the target interface element, obtain content corresponding to the target interface element, form at least one card based on the content, and superimpose and display on a partial area of the user interface The at least one card.

A status detection sub-module 238, configured to detect whether the identification function is enabled after copying;

A fourth card display sub-module 239 is configured to superimpose and display the at least one card on a partial area of the user interface when a function of identifying after copying is turned on.

In summary, an information display method, device, mobile terminal, and storage medium provided in the embodiments of the present application display a user interface of a mobile terminal, and detect an operation acting on the user interface. When the operation is a copy operation, according to The copy operation selects at least one interface element on the user interface, and displays at least one card superimposed on a part of the user interface. The at least one card is used to display information identified by the at least one interface element, thereby identifying the text through a quick operation And display, simplify the process of text recognition and improve user experience.

It should be noted that each embodiment in this specification is described in a progressive manner. Each embodiment focuses on the differences from other embodiments. The same and similar parts between the various embodiments refer to each other. can. As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple. For the relevant part, refer to the description of the method embodiment. Any of the processing methods described in the method embodiments can be implemented by corresponding processing modules in the device embodiments, and will not be described in detail in the device embodiments.

Please refer to FIG. 8 again. Based on the above information display method and device, an embodiment of the present application further provides a mobile terminal 100, which includes an electronic body portion 10, the electronic body portion 10 includes a casing 12 and is disposed on the casing. Main display 120 on the body 12. The casing 12 can be made of metal, such as steel and aluminum alloy. In this embodiment, the main display screen 120 generally includes a display panel 111, and may also include a circuit for responding to a touch operation on the display panel 111, and the like. The display panel 111 may be a liquid crystal display (Liquid Crystal Display, LCD). In some embodiments, the display panel 111 is a touch screen 109 at the same time.

Please refer to FIG. 9 at the same time. In an actual application scenario, the mobile terminal 100 can be used as a smart phone terminal. In this case, the electronic body portion 10 usually further includes one or more (only shown in the figure) (A) The processor 102, the memory 104, an RF (Radio Frequency) module 106, an audio circuit 110, a sensor 114, an input module 118, and a power module 122. Those of ordinary skill in the art can understand that the structure shown in FIG. 9 is only schematic, and it does not limit the structure of the electronic body portion 10. For example, the electronic body portion 10 may further include more or fewer components than those shown in FIG. 9, or have a different configuration from that shown in FIG. 9.

Those of ordinary skill in the art can understand that, relative to the processor 102, all other components belong to peripheral devices, and the processor 102 and these peripheral devices are coupled through multiple peripheral interface 124. The peripheral interface 124 may be implemented based on the following standards: Universal Asynchronous Receiver / Transmitter (UART), General Input / Output (GPIO), Serial Peripheral Interface , SPI), Inter-Integrated Circuit (I2C), but not limited to the above standards. In some examples, the peripheral interface 124 may only include a bus; in other examples, the peripheral interface 124 may further include other elements, such as one or more controllers, for example, for connecting the display panel. A display controller of 111 or a memory controller for connecting a memory. In addition, these controllers can also be separated from the peripheral interface 124 and integrated into the processor 102 or a corresponding peripheral.

The memory 104 may be used to store software programs and modules, and the processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104. The memory 104 may include a high-speed random access memory, and may further include a non-volatile memory, such as one or more magnetic storage devices, a flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memories remotely disposed with respect to the processor 102, and these remote memories may be connected to the electronic body portion 10 or the main display screen 120 through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The RF module 106 is used to receive and send electromagnetic waves, to realize the mutual conversion of electromagnetic waves and electrical signals, and to communicate with a communication network or other equipment. The RF module 106 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption / decryption chip, a subscriber identity module (SIM) card, a memory, and the like . The RF module 106 can communicate with various networks, such as the Internet, an intranet, and a wireless network, or communicate with other devices through a wireless network. The wireless network may include a cellular telephone network, a wireless local area network, or a metropolitan area network. The above wireless network can use various communication standards, protocols and technologies, including but not limited to Global System for Mobile Communication (GSM), Enhanced Data Communication Technology (GSM) Environment, EDGE, Broadband Code Division multiple access technology (wideband code division multiple access, W-CDMA), code division multiple access technology (Code division access, CDMA), time division multiple access technology (time division multiple access, TDMA), wireless fidelity technology (Wireless, Fidelity , WiFi) (such as the American Institute of Electrical and Electronics Engineers standards IEEE 802.10A, IEEE 802.11b, IEEE802.11g, and / or IEEE 802.11n), Voice over Internet (Internet Protocol, VoIP), Global Microwave Interoperability (Worldwide Interoperability for Microwave Access (Wi-Max), other protocols for mail, instant messaging, and short messaging, and any other suitable communication protocol, even those that have not yet been developed.

The audio circuit 110, the earpiece 101, the sound jack 103, and the microphone 105 collectively provide an audio interface between the user and the electronic body portion 10 or the main display screen 120. Specifically, the audio circuit 110 receives sound data from the processor 102, converts the sound data into electrical signals, and transmits the electrical signals to the handset 101. The earpiece 101 converts electrical signals into sound waves that human ears can hear. The audio circuit 110 also receives electrical signals from the microphone 105, converts the electrical signals into sound data, and transmits the sound data to the processor 102 for further processing. Audio data may be obtained from the memory 104 or through the RF module 106. In addition, the audio data may also be stored in the memory 104 or transmitted through the RF module 106.

The sensor 114 is disposed in the electronic body portion 10 or the main display screen 120. Examples of the sensor 114 include, but are not limited to, a light sensor, a running sensor, a pressure sensor, a gravity acceleration sensor, and other sensors. .

Specifically, the sensor 114 may include a light sensor 114F and a pressure sensor 114G. Among them, the pressure sensor 114G can detect a pressure generated by pressing on the mobile terminal 100. That is, the pressure sensor 114G detects the pressure generated by the contact or pressing between the user and the mobile terminal, such as the pressure generated by the contact or pressing between the user's ear and the mobile terminal. Therefore, the pressure sensor 114G can be used to determine whether a contact or a press has occurred between the user and the mobile terminal 100, and the magnitude of the pressure.

Please refer to FIG. 9 again. Specifically, in the embodiment shown in FIG. 9, the light sensor 114F and the pressure sensor 114G are disposed adjacent to the display panel 111. The light sensor 114F may turn off the display output when an object approaches the main display screen 120, for example, when the electronic body portion 10 moves to the ear.

As a type of motion sensor, a gravity acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the attitude of the mobile terminal 100 (such as horizontal and vertical Screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap) and so on. In addition, the electronic body portion 10 may be configured with other sensors such as a gyroscope, a barometer, a hygrometer, and a thermometer, which are not described herein again.

In this embodiment, the input module 118 may include the touch screen 109 provided on the main display screen 120, and the touch screen 109 may collect a user's touch operation on or near the user (such as a user using a finger, a stylus, etc.). Wait for any suitable object or accessory to be operated on or near the touch screen 109), and drive the corresponding connection device according to a preset program. Optionally, the touch screen 109 may include a touch detection device and a touch controller. The touch detection device detects a user's touch position, and detects a signal caused by a touch operation, and transmits the signal to the touch controller. The touch controller receives touch information from the touch detection device, and The touch information is converted into touch point coordinates, and then sent to the processor 102, and can receive and execute commands sent by the processor 102. In addition, various types such as resistive, capacitive, infrared, and surface acoustic wave can be used to implement the touch detection function of the touch screen 109. In addition to the touch screen 109, in other modified embodiments, the input module 118 may further include other input devices, such as keys 107. The keys 107 may include, for example, character keys for inputting characters, and control keys for triggering control functions. Examples of the control buttons include a "return to the home screen" button, an on / off button, and the like.

The main display screen 120 is used to display information input by the user, information provided to the user, and various graphical user interfaces of the electronic body portion 10, and these graphical user interfaces may include graphics, text, icons, numbers, videos, and The touch panel 109 may be arranged in any combination. In one example, the touch screen 109 may be disposed on the display panel 111 so as to form a whole with the display panel 111.

The power module 122 is configured to provide power to the processor 102 and other components. Specifically, the power module 122 may include a power management system, one or more power sources (such as a battery or an AC power source), a charging circuit, a power failure detection circuit, an inverter, a power status indicator, and any other electronic body. Components related to the generation, management, and distribution of power in the unit 10 or the main display screen 120.

The mobile terminal 100 further includes a locator 119, which is configured to determine an actual location where the mobile terminal 100 is located. In this embodiment, the locator 119 uses a positioning service to implement positioning of the mobile terminal 100. The positioning service should be understood as obtaining position information (such as latitude and longitude coordinates) of the mobile terminal 100 through a specific positioning technology. ), A technology or service for marking the location of an object on an electronic map.

It should be understood that the above-mentioned mobile terminal 100 is not limited to a smart phone terminal, and it should refer to a computer device that can be used in mobile. Specifically, the mobile terminal 100 refers to a mobile computer device equipped with a smart operating system. The mobile terminal 100 includes, but is not limited to, a smart phone, a smart watch, a tablet computer, and the like.

Please refer to FIG. 10, which is a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. The computer-readable storage medium 300 stores program code, which can be called by a processor to execute the method described in the foregoing method embodiment.

The computer-readable storage medium 300 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read-Only Memory), an EPROM, a hard disk, or a ROM. Optionally, the computer-readable storage medium 300 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 300 has a storage space of a program code 310 that executes any of the method steps in the above method. These program codes can be read from or written into one or more computer program products. The program code 310 may be compressed in a suitable form, for example.

In the description of this specification, the description with reference to the terms “one embodiment”, “some embodiments”, “examples”, “specific examples”, or “some examples” and the like means specific features described in conjunction with the embodiments or examples , Structure, materials, or features are included in at least one embodiment or example of the present application. In this specification, the schematic expressions of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. In addition, without any contradiction, those skilled in the art may combine and combine different embodiments or examples and features of the different embodiments or examples described in this specification.

In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present application, the meaning of "plurality" is at least two, for example, two, three, etc., unless it is specifically and specifically defined otherwise.

Any process or method description in a flowchart or otherwise described herein can be understood as a module, fragment, or portion of code that includes one or more executable instructions for implementing a particular logical function or step of a process And, the scope of the preferred embodiments of the present application includes additional implementations, in which the functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order according to the functions involved, which should It is understood by those skilled in the art to which the embodiments of the present application pertain.

Logic and / or steps represented in a flowchart or otherwise described herein, for example, a sequenced list of executable instructions that may be considered to implement a logical function, may be embodied in any computer-readable medium, For use by or in combination with an instruction execution system, device, or device (such as a computer-based system, a system including a processor, or other system that can fetch and execute instructions from an instruction execution system, device, or device) Or equipment. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connections (mobile terminals) with one or more wirings, portable computer disk enclosures (magnetic devices), random access memory (RAM), Read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, because, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or other suitable Processing to obtain the program electronically and then store it in computer memory.

It should be understood that each part of the application may be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods may be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it may be implemented using any one or a combination of the following techniques known in the art: Discrete logic circuits, application specific integrated circuits with suitable combinational logic gate circuits, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.

A person of ordinary skill in the art can understand that all or part of the steps carried by the methods in the foregoing embodiments may be implemented by a program instructing related hardware. The program may be stored in a computer-readable storage medium. The program is When executed, one or a combination of the steps of the method embodiment is included. In addition, each functional unit in each embodiment of the present application may be integrated into one processing module, or each unit may exist separately physically, or two or more units may be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

The aforementioned storage medium may be a read-only memory, a magnetic disk, or an optical disk. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present application. Those skilled in the art can interpret the above within the scope of this application. Embodiments are subject to change, modification, substitution, and modification.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present application, but not limited thereto. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still Modifications to the technical solutions described in the foregoing embodiments, or equivalent replacements of some of the technical features thereof; and these modifications or replacements do not drive the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

An information display method, which is applied to a mobile terminal, and the method includes:

Displaying a user interface of the mobile terminal, and detecting operations acting on the user interface;

When the operation is a copy operation, selecting at least one interface element on the user interface according to the copy operation;

At least one card is displayed superimposed on a part of the user interface, and the at least one card is used to display information identified by the at least one interface element.
The method according to claim 1, wherein the displaying at least one card superimposed on a part of the user interface comprises:

Detecting a dwell time of the mobile terminal in the user interface;

Judging whether the stay duration reaches a duration threshold;

When the stay duration reaches the duration threshold, the at least one card is superimposedly displayed on a partial area of the user interface.
The method according to claim 2, further comprising:

Detecting a touch operation on the user interface during the dwell time;

When no touch operation on the user interface is detected within the dwell time, the at least one card is superimposedly displayed on a partial area of the user interface.
The method according to any one of claims 1 to 3, wherein the displaying at least one card superimposed on a partial area of the user interface comprises:

Identify the at least one interface element, and obtain a target interface element in the at least one interface element;

A search is performed based on the target interface element to obtain content corresponding to the target interface element, at least one card is formed based on the content, and the at least one card is superimposedly displayed on a partial area of the user interface.
The method according to claim 4, wherein the interface element includes text information, and the identifying the at least one interface element to obtain a target interface element among the at least one interface element comprises:

Identify and segment the at least one interface element to obtain a segmentation result;

Displaying the word segmentation result on the user interface, and detecting a selection operation acting on the word segmentation result;

Determining the target interface element from the word segmentation result based on the selection operation.
The method according to claim 4, further comprising:

During the process of identifying the at least one interface element and searching based on the target interface element, a loading bar animation is displayed on a local area of the user interface, wherein the partial area includes the local area.
The method according to claim 2, wherein the displaying at least one card superimposed on a partial area of the user interface comprises:

Check whether the recognition function is enabled after copying;

When the identification function is enabled after copying, the at least one card is superimposedly displayed on a partial area of the user interface.
The method according to claim 7, further comprising:

When the dwell time does not reach the time threshold, detecting whether the function of identifying after copying is on;

When the identification function after copying is in an on state, the identification function after copying is turned off.
The method according to any one of claims 1-8, wherein when the operation is a copy operation, before selecting at least one interface element on the user interface according to the copy operation, further comprising:

When it is detected that a pressing operation on at least one interface element on the user interface exceeds a preset duration, a control is popped up and displayed on the user interface, wherein the control includes at least a copy button.
The method according to claim 9, wherein the control further comprises a send button, a favorite button, a reminder button, a translation button, and a delete button.
The method according to claim 9 or 10, wherein when the operation is a copy operation, selecting at least one interface element on the user interface according to the copy operation includes:

When the operation is a copy operation, obtaining a pressing position corresponding to the pressing operation;

The at least one interface element is determined based on the pressed position.
The method according to claim 11, wherein the determining the at least one interface element based on the pressing position comprises:

Acquiring coordinate information of the pressing position;

Acquiring at least one element located on the coordinate information, and determining the at least one element as the at least one interface element.
The method according to claim 11, wherein the determining the at least one interface element based on the pressing position comprises:

Acquiring coordinate information of the pressing position;

Acquiring at least one element located on the coordinate information, and acquiring a paragraph in which the at least one element is located;

All elements included in the paragraph are acquired, and all elements included in the paragraph are determined as the at least one interface element.
The method according to claim 11, wherein the determining the at least one interface element based on the pressing position comprises:

Acquiring coordinate information of the pressing position;

Generating a selection box based on the coordinate information and displaying it on the user interface, where the selection box is used to select interface elements;

Based on a user's control of the selection box, an interface element in the selection box is determined as the at least one interface element.
The method according to any one of claims 1 to 14, wherein the interface elements include text, pictures, audio, and / or video.
The method according to any one of claims 1-15, wherein the user interface comprises an interface corresponding to a system desktop of the mobile terminal, or an interface corresponding to a page of an application program of the mobile terminal.
The method according to any one of claims 1-16, wherein the displaying at least one card superimposed on a part of the user interface includes:

Displaying the at least one card in a layer on a partial area of the user interface; or

The at least one card covers a part of the user interface and is displayed at a different level from the user interface.
An information display device, which is applied to a mobile terminal, and the device includes:

An operation detection module for displaying a user interface of the mobile terminal and detecting an operation acting on the user interface;

An interface element selection module, configured to select at least one interface element on the user interface according to the copy operation when the operation is a copy operation;

The card display module is configured to superimpose and display at least one card on a part of the user interface, and the at least one card is used to display information identified by the at least one interface element.
A mobile terminal includes a touch screen, a memory, and a processor. The touch screen and the memory are coupled to the processor, and the memory stores instructions that are executed when the instructions are executed by the processor. The processor executes the method according to any one of claims 1-17.
A computer-readable storage medium, characterized in that the computer-readable storage medium stores program code, and the program code can be called by a processor to execute the method according to any one of claims 1-17. .