CN108958576A - content identification method, device and mobile terminal - Google Patents

content identification method, device and mobile terminal Download PDF

Info

Publication number
CN108958576A
CN108958576A CN201810588338.1A CN201810588338A CN108958576A CN 108958576 A CN108958576 A CN 108958576A CN 201810588338 A CN201810588338 A CN 201810588338A CN 108958576 A CN108958576 A CN 108958576A
Authority
CN
China
Prior art keywords
identification
user interface
content
touch
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810588338.1A
Other languages
Chinese (zh)
Other versions
CN108958576B (en
Inventor
段丽霞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201810588338.1A priority Critical patent/CN108958576B/en
Publication of CN108958576A publication Critical patent/CN108958576A/en
Priority to PCT/CN2019/088874 priority patent/WO2019233318A1/en
Application granted granted Critical
Publication of CN108958576B publication Critical patent/CN108958576B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)

Abstract

The embodiment of the present application discloses a kind of content identification method, device and mobile terminal, is related to technical field of mobile terminals.Wherein, this method comprises: when receiving the identification touch-control to user interface, content recognition is carried out to the user interface;If the content recognition to the user interface fails, adjustable screenshot box is shown in user interface;Content in the screenshot box is identified.In this method, content recognition directly can be carried out in user interface, it is simple to operate.

Description

Content identification method, device and mobile terminal
Technical field
This application involves technical field of mobile terminals, eventually more particularly, to a kind of content identification method, device and movement End.
Background technique
The display screen of mobile terminal can show various contents, if user wants to obtain the detailed of some of them display content Information then needs corresponding content copying to browser search box, and operating process is cumbersome.
Summary of the invention
In view of the above problems, present applicant proposes a kind of content identification method, device and mobile terminals, for user circle The content in face is identified, identification process is simplified, and improves user experience.
In a first aspect, the embodiment of the present application provides a kind of content identification method, which comprises receive to user When the identification touch-control at interface, content recognition is carried out to the user interface;If the content recognition to the user interface fails, The user interface shows adjustable screenshot box;Content in the screenshot box is identified.
Second aspect, the embodiment of the present application provide a kind of content identification apparatus, and described device includes: the first identification mould Block when for receiving the identification touch-control to user interface, carries out content recognition to the user interface;Frame modeling block, is used for If the content recognition to the user interface fails, adjustable screenshot box is shown in the user interface;Second identification module, For being identified to the content in the screenshot box.
The third aspect, the embodiment of the present application provide a kind of mobile terminal, including display screen, memory and processor, institute It states display screen and the memory is couple to the processor, the memory store instruction, when described instruction is by the processing The processor above-mentioned method when device executes.
Fourth aspect, the embodiment of the present application provide it is a kind of with processor can be performed program code it is computer-readable Storage medium, said program code make the processor execute above-mentioned method.
Content identification method, device and mobile terminal provided by the present application, in response to identifying touch-control to user interface In the case where content recognition failure, adjustable screenshot box is shown, and identify to the content of screenshot box, so as to direct Content recognition is carried out in user interface, it is simple to operate.
Detailed description of the invention
In order to more clearly explain the technical solutions in the embodiments of the present application, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, the drawings in the following description are only some examples of the present application, for For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached Figure.
Fig. 1 shows the flow chart of the content identification method of one embodiment of the application proposition;
Fig. 2 shows the first display schematic diagrams that the embodiment of the present application proposes;
Fig. 3 shows the second display schematic diagram of the embodiment of the present application proposition;
Fig. 4 shows the third display schematic diagram of the embodiment of the present application proposition;
Fig. 5 shows the flow chart for the content identification method that another embodiment of the application proposes;
Fig. 6 shows the 4th display schematic diagram of the embodiment of the present application proposition;
Fig. 7 shows the 5th display schematic diagram of the embodiment of the present application proposition;
Fig. 8 shows the 6th display schematic diagram of the embodiment of the present application proposition;
Fig. 9 shows the 7th display schematic diagram of the embodiment of the present application proposition;
Figure 10 shows the functional block diagram of the content identification apparatus of the embodiment of the present application proposition;
Figure 11 shows a kind of structural block diagram of the mobile terminal of the embodiment of the present application proposition;
Figure 12 shows a kind of structural schematic diagram of the mobile terminal of the embodiment of the present application proposition;
Figure 13 shows the movement for being used to execute the content identification method according to the embodiment of the present application of the embodiment of the present application The block diagram of terminal.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall in the protection scope of this application.
Currently, user by mobile terminal Internet access chat, read text, check picture or viewing video when, often Interest can be generated to some of which content and scans for obtaining more detailed information.At this point, user is firstly the need of duplication Interested content is perhaps kept firmly in mind in interested, then opens browser, and the content of duplication is pasted into searching for browser It is input in the search box of browser in rope frame or by the content kept firmly in mind and scans for leading to operating process to obtain details It is very cumbersome, it takes a long time and is easy to produce mistake.
It further, can be by technologies such as pressure sensitives to aobvious in order to which the operating process for solving the problems, such as search is cumbersome The content shown carries out selection and identifies the content of selection, recognition result is obtained, to promote the acquisition speed of information.But It is that inventor is by a large amount of the study found that corresponding directly to the identification of touch-control progress content of the user in user interface, knowledge It may not fail, the recognition result that user wants can not be obtained.
In view of the above technical problems, the embodiment of the present application proposes a kind of content identification method, device and mobile terminal, In the case where recognition failures, adjustable screenshot box is shown in user interface, so as to by selecting in user interface again frame Content is identified, the recognition result for catering to user demand is obtained.
Below in conjunction with attached drawing and by specific embodiment to content identification method provided by the embodiments of the present application, device And mobile terminal is illustrated.
Referring to Fig. 1, the embodiment of the present application provides a kind of content identification method, the content identification method is used for aobvious The all or part of the content in user interface that display screen is shown is identified.In the particular embodiment, the content recognition side Method be applied to content identification apparatus as shown in Figure 10 and be corresponding with content identification apparatus 300 mobile terminal 400 (Figure 11, Figure 12).Above-mentioned content identification method can specifically include following steps:
Step S110: when receiving the identification touch-control to user interface, content recognition is carried out to the user interface.
When user wants to identify certain contents of user interface to obtain the content more detailed information, Ke Yi User interface carries out identification touch-control.Wherein, the specific corresponding touch control operation of the identification touch-control is not in the embodiment of the present application It limits, such as singly refers to long-pressing, two fingers long-pressing, refers to that long-pressing, articulations digitorum manus long-pressing, single give directions hit, two fingers click, give more directions and hit, refer to pass more Section percussion singly refers to large area pressing, the pressing of two fingers large area, refers to large area pressing more, singly refers to, two fingers or mostly finger are by desired guiding trajectory Sliding etc..If the touch control operation is to slide by desired guiding trajectory, sliding trace can be closed figure, in closed figure Content is identified.
Mobile terminal knows content corresponding to the identification touch-control in user interface when receiving identification touch-control Not.As a kind of specific embodiment, the display content of identification can be all the elements in the user interface.
As a kind of specific embodiment, the display content of identification can be touch control operation touch-control in the user interface Content corresponding to position.Wherein, specifically corresponding content can be position of touch, the text paragraph where position of touch, touching Control the picture where position, the control where position of touch.Such as shown in Fig. 2, the interface of display be by the user interface of touch-control, Circle A indicates position of touch, the display content identified using the text paragraph where circle A as needs.
As a kind of specific embodiment, the display content of identification is to show in the corresponding text control of position of touch Text.It can specifically include: determining the corresponding text control of position of touch of the identification touch-control;It obtains in the text control Text identified.Wherein, the corresponding text control of position of touch can be the text control nearest from position of touch.
That is, if position of touch touch-control is in text control, using the text control by touch-control as to be identified Text control.Such as in chat interface shown in Fig. 2, circle A indicates position of touch, the corresponding text control B of chat message The text control that touch-control arrives for the position of touch institute, then identify the chat message in text control B.
If position of touch touch-control, can be in the text control nearest from the position of touch in the position of non-textual control Text identified.Such as in chat interface shown in Fig. 3, circle A indicate position of touch, non-touch-control in text control, The corresponding text control B of chat message is the text control nearest from the position of touch, then believes the chat in text control B Breath is identified.
Some existing identification methods, such as participle, semantics recognition wherein can be used to the identification of display content, herein Without limitation.
In addition, the identification of display content is also possible to through backstage screenshot, after carrying out screenshot to the content that needs identify, It is identified by picture analyzing, is such as known by OCR (Optical Character Recognition, optical character identification) Not.Specifically such as, the position of touch of the identification touch-control in the user interface is determined;In the user interface, in the touch-control Screenshot is carried out in the preset range of position;Text identification is carried out to the picture that the screenshot obtains.The size of the preset range exists It is not limited in the embodiment of the present application, can be the rectangular extent of default length and width, the circular scope of pre-set radius or other are pre- If the range of shape and default size.
Step S120: if the content recognition to the user interface fails, adjustable screenshot box is shown in user interface.
Due to various reasons, may fail to the identification of the content of user interface.Wherein the reason of recognition failures, may have It is a variety of, for example, network connection is unstable, mobile terminal is not connected with the network problems such as network and leads to not identification or identify super When;Or such as, in response to identifying touch-control, effective identification content can not be obtained;Or the content as needed to identify is unhealthy information Deng not doing exhaustion herein.
If recognition failures do not obtain recognition result, adjustable screenshot box can be shown in user interface.Such as Fig. 4, this section Picture frame K can be rectangle frame as shown in the figure, be also possible to the closed figure of other shapes, such as circle, prismatic, triangle, more The arbitrary shapes such as side shape.Wherein, which is the user interface that display screen is shown when identifying touch-control.
Step S130: the content in the screenshot box is identified.
As shown in figure 4, being corresponding with the content of user interface in screenshot box K.Content representation in screenshot box is known Therefore other content can identify the content in screenshot box.
In the embodiment of the present application, the identification touch-control to user interface is being received, content recognition is carried out to user interface But in the case where recognition failures, by showing adjustable screenshot box in user interface, user interface is carried out by screenshot box Frame choosing, then the content of frame choosing is identified.To, in the case where recognition failures, can be selected by frame key again with The frame again that family interface carries out identification content is selected and is identified.
In the embodiment of the present application, adjustable screenshot box can be adjusted according to demand by user, be made in screenshot box Content be user want identification content.Specifically, Fig. 5 is referred to, and in the method provided by the embodiment of the present application, packet It includes:
Step S210: when receiving the identification touch-control to user interface, content recognition is carried out to the user interface.
User can initiate the identification touch control operation identified to display content in user interface.Wherein, as previously mentioned, The user interface can be chat interface, web interface, video clip, user interface of various application programs etc., in the application It is not limited in embodiment.When receiving the touch-control of user, content recognition is carried out in the user interface of institute's touch-control.
Step S220: if the content recognition to the user interface fails, adjustable screenshot box is shown in user interface.
If recognition failures, the recognition result of the content in the user interface to institute's touch-control is not obtained, is shown in user interface Screenshot box carries out frame choosing identification to user interface.
As a kind of specific embodiment, when user interface shows adjustable screenshot box, can be such as Fig. 4 institute Show, be the user interface for identifying touch-control when institute touch-control at the interface that display screen is shown, shows screenshot box K in the user interface.
It, can be with as shown in fig. 6, when user interface shows adjustable screenshot box as a kind of specific embodiment The user interface of touch-control is reduced into display, screenshot box K is shown in the user interface of the diminution.
Optionally, when showing screenshot box, only have screenshot box that can operate in user interface, other positions are inoperable.
In the embodiment of the present application, when recognition failures start to show screenshot box, the position that screenshot box is shown first is not It limits.
As an implementation, screenshot box can be shown with default size in predeterminated position.The default size can be with It is pre-set fixed size, is also possible to pre-set and user interface scale.The predeterminated position can be Some in display screen fixes position, is also possible to by some position of the user interface of touch-control.
As an implementation, the display position of screenshot box can be determined according to the position of touch of identification touch-control.Specifically , it can be, position of touch frame is selected in interior screenshot box.Optionally, which can be default size, be also possible to by The corresponding touch area frame of position of touch is selected in interior minimum screenshot box etc..
In this embodiment, if being also possible to position of touch on control, screenshot box arrives the position of touch institute touch-control Control frame be selected in.Specifically, control corresponding to the position of touch of the identification touch-control can be determined, which can be with table Show in the user interface, which overlaps with position of touch.It shows again in the user interface by the control frame It is selected in interior adjustable screenshot box.
Optionally, before showing screenshot box, user's recognition failures can be prompted with display reminding information, if enter frame Choosing identification, if user's selection is to show adjustable screenshot box in user interface;If user's selection is no, knowledge can be exited Other process does not obtain recognition result to the end of identification of user interface.
Step S230: the content in the screenshot box is identified.
In the embodiment of the present application, the content that can be selected screenshot box institute's frame identifies.The identification can be, and directly obtain The content in screenshot box is taken, if included text control in screenshot box, the text in text control is obtained, includes picture in screenshot box Control directly acquires the picture etc. in the picture control.In addition, the identification is also possible to the content for selecting the screenshot circle Interception is picture, for example, all the elements in screenshot box are carried out screenshot and are cut using the edge of screenshot box as interception edge The picture taken, then the content in picture is identified.The identification process can be obtained in picture by image procossing first Content herein with no restrictions, can such as OCR (Optical Character Recognition, optical character identification) processing etc. To pass through the existing processing mode that can obtain the various contents such as text in image, picture, two dimensional code.
As a kind of specific embodiment, user interface shows screenshot box, to all or part of the content in screenshot box It is identified.
As a kind of specific embodiment, when showing screenshot box, while one or more identification types are provided can Option, the identification types indicate type belonging to the content to be identified, such as two dimensional code, commodity, text, picture.It is mobile whole End can receive the target identification type that user selects from one or more identification types;To target identification in the screenshot box The corresponding content of type is identified.That is, receiving the knowledge that user selects from one or more identification types Other type, using the identification types that user selects as target identification type, to belonging to target identification class in the content in screenshot box The content of type is identified.Fig. 6 shows three two dimensional code, commodity, text optional identification types.
In this embodiment, to the identification of different identification types, it can be the difference of identification content, only such as text identification Parsing is carried out to the content of text in screenshot box and obtains recognition result, picture recognition only carries out parsing to the picture in screenshot box and obtains Take recognition result.It is also possible to the difference of identification method, such as identification to text, picture, two dimensional code, by corresponding identifying processing Server is realized, can then jump to third party's shopping platform, such as Taobao to the identification of commodity, and the content in screenshot box is passed Third party's shopping platform is passed to identify.Be also possible to recognition result shows difference, for example, to text, commodity, picture etc. Identification, can be directly shown by card by forms such as participle, brief introduction, links, the identification to commodity can pass through Third party's shopping platform is shown.
Specifically, identification process can be, the content in screenshot box is analyzed, therefrom obtains target identification type institute Corresponding content identifies the content of target identification type.For example, if target identification type is two dimensional code, to screenshot After content in frame carries out analysis acquisition two dimensional code therein, two dimensional code is identified, obtains the information that two dimensional code is included. For another example, if target identification type is text, the text in screenshot box is segmented, is parsed, the operation such as semantic search, and is anti- Present the recognition result of the text.
It wherein, optionally, can be therein by carrying out analysis acquisition to screenshot box when target identification type is text Content of text, then be filtered to content of text after filtering out messy code therein, obtains effective text, then to effective text into Row parsing identification.In this embodiment, messy code can be the text other than preset kind text, as the text of preset kind is Chinese character, English character and selected common punctuate, then other punctuates etc. other than other texts, common punctuate, all by It is determined as messy code.
It in this embodiment, optionally, can be with one of identification types if the non-selected target identification type of user As default identification types, the content that identification types are defaulted in screenshot box is identified.Optionally, if the non-selected target of user Identification types, can also without identification, user select identification types after, then to the corresponding content of the identification types of selection into Row identification.
In the embodiment of the present application, screenshot box is adjustable screenshot box, which includes the adjustment and size of position Adjustment.Mobile terminal can receive the size to the screenshot box or the adjustment of position;To the screenshot box adjusted Interior content is identified.
Such as Fig. 4 and the frame shown in fig. 6 for screenshot box after selecting interface into frame in user interface select, user can pass through The different directions at the angle of screenshot box are pulled, the size of screenshot box is adjusted, is illustrated in figure 7 the screenshot after turning down relative to Fig. 4 Frame K.User can also drag screenshot box by sideline, the interior zone etc. for pressing screenshot box and change position, be illustrated in figure 8 phase Screenshot box adjusted for the position Fig. 7.
In the embodiment of the present application, the shape that can also change screenshot box receives what user changed screenshot box shape The shape of screenshot box is changed into round, triangle or other arbitrary polygons etc. according to the request by request.Such as it can be with Corresponding screenshot box K provides shape select button, when receiving the pressing to the button, shows selectable shape.If user selects Triangle has been selected, then the shape of current screenshot box has been changed into triangle.
As a kind of specific embodiment, in the embodiment of the present application, shown in response to identification touch-control recognition failures When screenshot box, if not receiving the adjustment to screenshot box also, without identification;The adjustment to screenshot box is being received, it is just right Content in screenshot box adjusted is identified, recognition result is obtained.
As a kind of specific embodiment, when showing screenshot box in response to identification touch-control recognition failures, to screenshot box In content identified, obtain recognition result.If receiving the adjustment to screenshot box, in screenshot box adjusted Appearance is identified, updates recognition result according to the identification to screenshot box adjusted.That is, as shown in figure 5, in the implementation It can also include step S240 after step S230 in mode: receive to the size of the screenshot box or the tune of position It is whole.Step S250: screenshot identification is carried out to the screenshot box adjusted.
It in the embodiment of the present application, may include being searched to the participle and correspondence of corresponding contents to the identification in screenshot box Rope, recognition result may include word segmentation result, brief introduction, the link of video display, books, personage etc., the map in place, the purchase of commodity Channel, schedule information, express delivery information etc. are one or more, are not intended to limit in the embodiment of the present application, can be display content Any explanation information.If Fig. 9 shows a kind of specific recognition result display mode, the recognition result of display may include to phase The participle for the content answered, user can from select to replicate after word in word segmentation result, Quan Xuan, translation or search etc..
Optionally, in the embodiment of the present application, the recognition result can be shown by card, as shown in figure 9, Card C shows recognition result.Wherein, card is the carrier for showing information, can be the combination of a control or multiple controls. The information that card is shown in the embodiment of the present application can be the corresponding information of recognition result.In the same card, it can show same The different recognition results of one display content or the different recognition results of same display content can be shown in different cards.
Optionally, in the embodiment of the present application, if it is unsuccessful to the content recognition in screenshot box, it can show recognition failures Prompt information.
In conclusion in content identification method provided by the embodiments of the present application, when receiving identification touch-control, to user circle Face carries out content recognition.If recognition failures, the screenshot box that frame choosing is carried out to user interface is provided.When receiving to the big of screenshot box The adjustment such as small or position, identifies the content in screenshot box adjusted, to realize that user can be according to itself need The size and location for seeking adjustment screenshot box, the property frame of desired identification is selected in screenshot box and is identified, desired knowledge is obtained Other result.
The embodiment of the present application also provides a kind of content identification apparatus 300, referring to Figure 10, which includes: first Identification module 310 when for receiving the identification touch-control to user interface, carries out content recognition to the user interface.Frame choosing Module 320, if showing adjustable screenshot box in user interface for the content recognition failure to the user interface.Second Identification module 330, for being identified to the content in the screenshot box.
Optionally, the first identification module 310 may include control determination unit, for determining the touch-control of the identification touch-control The corresponding text control in position;Recognition unit is identified for obtaining the text in the text control.
Optionally, the first identification module may include position determination unit, for determining the touch-control position of the identification touch-control It sets;Image acquisition unit, for carrying out screenshot in the preset range of the position of touch in the user interface;Identification Unit, the picture for obtaining to the screenshot carry out text identification.
Optionally, which can also include: determination type module, for receiving user from one or more identification types The target identification type of middle selection;Second identification module is used to carry out the corresponding content of target identification type in the screenshot box Identification.
Optionally, which can also include: adjustment module, for receiving to the size of the screenshot box or position Adjustment.Second identification module is also used to carry out screenshot identification to the screenshot box adjusted.
Optionally, frame modeling block 320 can be also used for default size showing the screenshot box in predeterminated position.Or For determining control corresponding to the position of touch of the identification touch-control;It is shown in the user interface and selects the control frame Adjustable screenshot box inside.
In conclusion in the embodiment of the present application, when user is in chat or access text in a browser, in identification use After the text failure in the selected region in family, manual screenshot box is shown, need the region of screenshot so that user manually selects, then The picture intercepted is identified, wherein when identifying for the picture of screenshot, it is that two dimensional code is known that user, which can choose, Not or text identification or article identification.Wherein it is possible to preliminary screening be done to the result parsed, to messy code and character It is filtered, after filtering if without effective text, walks the unidentified process to any content, if effective text after filtering This, then pass to text identification.
Referring to Figure 11, based on above-mentioned content identification method and device, the embodiment of the present application also provides a kind of shifting Dynamic terminal 400.As shown in figure 11, which includes display screen 120, memory 104 and processor 102, the display Screen 120 and the memory 104 are couple to the processor 102, and the display screen 120 is for showing content, parsing identification knot Fruit etc., 104 store instruction of memory, when described instruction is executed by the processor 102, the processor 102 executes sheet Apply for the method that embodiment provides.
Specifically, as shown in figure 12, which may include electronic body portion 10, the electronic body portion 10 Including shell 12 and the display screen 120 being arranged on the shell 12.Metal, such as steel, aluminium alloy can be used in the shell 12 It is made.In the present embodiment, the display screen 120 generally includes display panel 111, may also comprise for responding to the display surface The circuit etc. of the progress touch control operation of plate 111.The display panel 111 can be a liquid crystal display panel (Liquid Crystal Display, LCD), in some embodiments, the display panel 111 is a touch screen 109 simultaneously.
Please refer to Figure 13, in actual application scenarios, the mobile terminal 400 can be used as intelligent mobile phone terminal into It exercises and uses, the electronic body portion 10 also typically includes one or more (only showing one in figure) processors in this case 102, memory 104, RF (Radio Frequency, radio frequency) module 106, voicefrequency circuit 110, sensor 114, input module 118, power module 122.It will appreciated by the skilled person that structure shown in Figure 13 is only to illustrate, not to institute The structure for stating electronic body portion 10 causes to limit.For example, the electronic body portion 10 may also include it is more than shown in Figure 13 or The less component of person, or with the correspondence different from shown in Figure 13.
It will appreciated by the skilled person that every other component belongs to for the processor 102 It is coupled between peripheral hardware, the processor 102 and these peripheral hardwares by multiple Peripheral Interfaces 124.The Peripheral Interface 124 can Based on following standard implementation: Universal Asynchronous Receive/sending device (Universal Asynchronous Receiver/ Transmitter, UART), universal input/output (General Purpose Input Output, GPIO), serial peripheral connect Mouthful (Serial Peripheral Interface, SPI), internal integrated circuit (Inter-Integrated Circuit, I2C), but it is not limited to above-mentioned standard.In some instances, the Peripheral Interface 124 can only include bus;In other examples In, the Peripheral Interface 124 may also include other elements, such as one or more controller, such as connecting the display The display controller of panel 111 or storage control for connecting memory.In addition, these controllers can also be from described It detaches, and is integrated in the processor 102 or in corresponding peripheral hardware in Peripheral Interface 124.
The memory 104 can be used for storing software program and module, and the processor 102 is stored in institute by operation The software program and module in memory 104 are stated, thereby executing various function application and data processing.The memory 104 may include high speed random access memory, may also include nonvolatile memory, and such as one or more magnetic storage device dodges It deposits or other non-volatile solid state memories.In some instances, the memory 104 can further comprise relative to institute The remotely located memory of processor 102 is stated, these remote memories can pass through network connection to the electronic body portion 10 Or the display screen 120.The example of above-mentioned network includes but is not limited to internet, intranet, local area network, mobile radio communication And combinations thereof.
The RF module 106 is used to receive and transmit electromagnetic wave, realizes the mutual conversion of electromagnetic wave and electric signal, thus It is communicated with communication network or other equipment.The RF module 106 may include various existing for executing these functions Circuit element, for example, antenna, RF transceiver, digital signal processor, encryption/deciphering chip, subscriber identity module (SIM) card, memory etc..The RF module 106 can be carried out with various networks such as internet, intranet, wireless network Communication is communicated by wireless network and other equipment.Above-mentioned wireless network may include cellular telephone networks, wireless Local area network or Metropolitan Area Network (MAN).Various communication standards, agreement and technology can be used in above-mentioned wireless network, including but not limited to Global system for mobile communications (Global System for Mobile Communication, GSM), enhanced mobile communication skill Art (Enhanced Data GSM Environment, EDGE), Wideband CDMA Technology (wideband code Division multiple access, W-CDMA), Code Division Multiple Access (Code division access, CDMA), time-division Multiple access technology (time division multiple access, TDMA), adopting wireless fidelity technology (Wireless, Fidelity, WiFi) (such as American Institute of Electrical and Electronics Engineers's standard IEEE 802.10A, IEEE 802.11b, IEEE802.11g and/ Or IEEE 802.11n), the networking telephone (Voice over internet protocal, VoIP), worldwide interoperability for microwave accesses (Worldwide Interoperability for Microwave Access, Wi-Max), other be used for mail, Instant Messenger The agreement and any other suitable communications protocol of news and short message, or even may include that those are not developed currently yet Agreement.
Voicefrequency circuit 110, loudspeaker 101, microphone 103, microphone 105 provide user and the electronic body portion jointly Audio interface between 10 or the display screen 120.
The setting of sensor 114 is in the electronic body portion 10 or in the display screen 120, the sensor 114 Example include but is not limited to: acceleration transducer 114F, gyroscope 114G, magnetometer 114H and other sensors.
In the present embodiment, the input module 118 may include the touch screen 109 being arranged on the display screen 120, The touch screen 109 collects the touch operation of user on it or nearby, and (for example user is suitble to using finger, stylus etc. are any Object or attachment operation on the touch screen 109 or near the touch screen 109), it is hereby achieved that user Touch gestures, and corresponding attachment device is driven according to a pre-set procedure, therefore, user can pass through the touching in display screen Control operation selected target region.Optionally, the touch screen 109 may include touch detecting apparatus and touch controller.Wherein, institute The touch orientation of touch detecting apparatus detection user is stated, and detects touch operation bring signal, transmits a signal to the touching Touch controller;The touch controller receives touch information from the touch detecting apparatus, and the touch information is converted into Contact coordinate, then give the processor 102, and order that the processor 102 is sent can be received and executed.In addition, The touch detection of the touch screen 109 can be realized using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves Function.In addition to the touch screen 109, in other change embodiments, the input module 118 can also include other inputs Equipment, such as key 107.The key 107 for example may include the character keys for inputting character, and for triggering control function The control button of energy.The example of the control button includes " returning to main screen " key, power on/off key etc..
The display screen 120 is used for the information and the electronics sheet for showing information input by user, being supplied to user The various graphical user interface in body portion 10, these graphical user interface can be by figure, text, icon, number, video and Qi Ren Meaning combination is to constitute.In an example, the touch screen 109 may be disposed on the display panel 111 to show with described Show that panel 111 constitutes an entirety.
The power module 122 is used to provide power supply to the processor 102 and other each components.Specifically, The power module 122 may include power-supply management system, one or more power supply (such as battery or alternating current), charging circuit, Power-fail detection circuit, inverter, indicator of the power supply status and any other and electronic body portion 10 are described aobvious The generation, management of electric power and the relevant component of distribution in display screen 120.
The mobile terminal 400 further includes locator 119, and the locator 119 is for determining 400 institute of mobile terminal The physical location at place.In the present embodiment, the locator 119 realizes the positioning of the mobile terminal 400 using positioning service, The positioning service, it should be understood that the location information of the mobile terminal 400 is obtained by specific location technology (as passed through Latitude coordinate), it is marked on the electronic map by the technology or service of the position of positioning object.
It should be understood that above-mentioned mobile terminal 400 is not limited to intelligent mobile phone terminal, should refer to can moved Computer equipment used in dynamic.Specifically, mobile terminal 400, refers to the mobile computer for being equipped with intelligent operating system Equipment, mobile terminal 400 include but is not limited to smart phone, smartwatch, tablet computer, etc..
It should be noted that all the embodiments in this specification are described in a progressive manner, each embodiment weight Point explanation is the difference from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For device class embodiment, since it is basically similar to the method embodiment, so being described relatively simple, related place ginseng See the part explanation of embodiment of the method.For arbitrary processing mode described in embodiment of the method, in device reality Apply in example can no longer be repeated in Installation practice by corresponding processing modules implement one by one.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example Point is contained at least one embodiment or example of the application.In the present specification, schematic expression of the above terms are not It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office It can be combined in any suitable manner in one or more embodiment or examples.In addition, without conflicting with each other, the skill of this field Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples It closes and combines.
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or Implicitly include at least one this feature.In the description of the present application, the meaning of " plurality " is at least two, such as two, three It is a etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion Point, and the range of the preferred embodiment of the application includes other realization, wherein can not press shown or discussed suitable Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, to execute function, this should be by the application Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set It is standby and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, stores, communicates, propagates or pass Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment It sets.The more specific example (non-exhaustive list) of computer-readable medium include the following: there is the electricity of one or more wirings Interconnecting piece (mobile terminal), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory (ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable Medium, because can then be edited, be interpreted or when necessary with it for example by carrying out optical scanner to paper or other media His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each section of the application can be realized with hardware, software, firmware or their combination.Above-mentioned In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage Or firmware is realized.It, and in another embodiment, can be under well known in the art for example, if realized with hardware Any one of column technology or their combination are realized: having a logic gates for realizing logic function to data-signal Discrete logic, with suitable combinational logic gate circuit specific integrated circuit, programmable gate array (PGA), scene Programmable gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.In addition, in each embodiment of the application In each functional unit can integrate in a processing module, be also possible to each unit and physically exist alone, can also two A or more than two units are integrated in a module.Above-mentioned integrated module both can take the form of hardware realization, can also It is realized in the form of using software function module.If the integrated module realized in the form of software function module and as Independent product when selling or using, also can store in a computer readable storage medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..Although having been shown and retouching above Embodiments herein is stated, it is to be understood that above-described embodiment is exemplary, and should not be understood as the limit to the application System, those skilled in the art can be changed above-described embodiment, modify, replace and become within the scope of application Type.
Finally, it should be noted that above embodiments are only to illustrate the technical solution of the application, rather than its limitations;Although The application is described in detail with reference to the foregoing embodiments, those skilled in the art are when understanding: it still can be with It modifies the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features;And These are modified or replaceed, do not drive corresponding technical solution essence be detached from each embodiment technical solution of the application spirit and Range.

Claims (11)

1. a kind of content identification method, which is characterized in that the described method includes:
When receiving the identification touch-control to user interface, content recognition is carried out to the user interface;
If the content recognition to the user interface fails, adjustable screenshot box is shown in the user interface;
Content in the screenshot box is identified.
2. the method according to claim 1, wherein described carry out content recognition to the user interface, comprising:
Determine the corresponding text control of position of touch of the identification touch-control;
The text obtained in the text control is identified.
3. the method according to claim 1, wherein described carry out content recognition to the user interface, comprising:
Determine the position of touch of the identification touch-control;
In the user interface, screenshot is carried out in the preset range of the position of touch;
Text identification is carried out to the picture that the screenshot obtains.
4. the method according to claim 1, wherein the method also includes:
Receive the target identification type that user selects from one or more identification types;
The corresponding content of target identification type in the screenshot box is identified.
5. according to the method described in claim 4, it is characterized in that, the identification types include:
Two dimensional code, commodity or text.
6. the method according to claim 1, wherein the method also includes:
It receives to the size of the screenshot box or the adjustment of position;
Screenshot identification is carried out to the screenshot box adjusted.
7. the method according to claim 1, wherein described show adjustable screenshot box in the user interface Include:
The screenshot box is shown with default size in predeterminated position.
8. the method according to claim 1, wherein described show adjustable screenshot box in the user interface Include:
Determine control corresponding to the position of touch of the identification touch-control;
It is shown in the user interface and the control frame is selected in interior adjustable screenshot box.
9. a kind of content identification apparatus, which is characterized in that described device includes:
First identification module when for receiving the identification touch-control to user interface, carries out content recognition to the user interface;
Frame modeling block, if showing adjustable section in the user interface for the content recognition failure to the user interface Picture frame;
Second identification module, for being identified to the content in the screenshot box.
10. a kind of mobile terminal, which is characterized in that including display screen, memory and processor, the display screen and the storage Device is couple to the processor, the memory store instruction, when executed by the processor the processor Perform claim requires 1 to 8 described in any item methods.
11. a kind of computer readable storage medium for the program code that can be performed with processor, which is characterized in that described program Code makes the processor perform claim require 1 to 8 described in any item methods.
CN201810588338.1A 2018-06-08 2018-06-08 Content identification method and device and mobile terminal Active CN108958576B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201810588338.1A CN108958576B (en) 2018-06-08 2018-06-08 Content identification method and device and mobile terminal
PCT/CN2019/088874 WO2019233318A1 (en) 2018-06-08 2019-05-28 Content identification method and device, and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810588338.1A CN108958576B (en) 2018-06-08 2018-06-08 Content identification method and device and mobile terminal

Publications (2)

Publication Number Publication Date
CN108958576A true CN108958576A (en) 2018-12-07
CN108958576B CN108958576B (en) 2021-02-02

Family

ID=64494007

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810588338.1A Active CN108958576B (en) 2018-06-08 2018-06-08 Content identification method and device and mobile terminal

Country Status (2)

Country Link
CN (1) CN108958576B (en)
WO (1) WO2019233318A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109933275A (en) * 2019-02-12 2019-06-25 努比亚技术有限公司 A kind of knowledge screen method, terminal and computer readable storage medium
WO2019233318A1 (en) * 2018-06-08 2019-12-12 Oppo广东移动通信有限公司 Content identification method and device, and mobile terminal
CN110647640A (en) * 2019-09-30 2020-01-03 京东方科技集团股份有限公司 Computer system, method for operating a computing device and system for operating a computing device
CN111310482A (en) * 2020-01-20 2020-06-19 北京无限光场科技有限公司 Real-time translation method, device, terminal and storage medium
CN112596656A (en) * 2020-12-28 2021-04-02 北京小米移动软件有限公司 Content identification method, device and storage medium
CN115033658A (en) * 2021-02-24 2022-09-09 北京小米移动软件有限公司 Information searching method, device, equipment and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105005551A (en) * 2015-06-29 2015-10-28 东南(福建)汽车工业有限公司 Method for implementing rapid acquisition of picture characters in document revision
US20160147742A1 (en) * 2014-11-26 2016-05-26 Naver Corporation Apparatus and method for providing translations editor
CN106020694A (en) * 2016-05-24 2016-10-12 北京京东尚科信息技术有限公司 Electronic device, selected area dynamic adjusting method and device
CN106325688A (en) * 2016-08-17 2017-01-11 北京锤子数码科技有限公司 Text processing method and device
CN106484266A (en) * 2016-10-18 2017-03-08 北京锤子数码科技有限公司 A kind of text handling method and device
CN107358226A (en) * 2017-06-23 2017-11-17 联想(北京)有限公司 The recognition methods of electronic equipment and electronic equipment
CN107632773A (en) * 2017-10-17 2018-01-26 北京百度网讯科技有限公司 For obtaining the method and device of information
CN107797750A (en) * 2017-10-27 2018-03-13 珠海市魅族科技有限公司 A kind of screen content identifying processing method, apparatus, terminal and medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108958576B (en) * 2018-06-08 2021-02-02 Oppo广东移动通信有限公司 Content identification method and device and mobile terminal

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160147742A1 (en) * 2014-11-26 2016-05-26 Naver Corporation Apparatus and method for providing translations editor
CN105005551A (en) * 2015-06-29 2015-10-28 东南(福建)汽车工业有限公司 Method for implementing rapid acquisition of picture characters in document revision
CN106020694A (en) * 2016-05-24 2016-10-12 北京京东尚科信息技术有限公司 Electronic device, selected area dynamic adjusting method and device
CN106325688A (en) * 2016-08-17 2017-01-11 北京锤子数码科技有限公司 Text processing method and device
CN106484266A (en) * 2016-10-18 2017-03-08 北京锤子数码科技有限公司 A kind of text handling method and device
CN107358226A (en) * 2017-06-23 2017-11-17 联想(北京)有限公司 The recognition methods of electronic equipment and electronic equipment
CN107632773A (en) * 2017-10-17 2018-01-26 北京百度网讯科技有限公司 For obtaining the method and device of information
CN107797750A (en) * 2017-10-27 2018-03-13 珠海市魅族科技有限公司 A kind of screen content identifying processing method, apparatus, terminal and medium

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019233318A1 (en) * 2018-06-08 2019-12-12 Oppo广东移动通信有限公司 Content identification method and device, and mobile terminal
CN109933275A (en) * 2019-02-12 2019-06-25 努比亚技术有限公司 A kind of knowledge screen method, terminal and computer readable storage medium
CN110647640A (en) * 2019-09-30 2020-01-03 京东方科技集团股份有限公司 Computer system, method for operating a computing device and system for operating a computing device
CN111310482A (en) * 2020-01-20 2020-06-19 北京无限光场科技有限公司 Real-time translation method, device, terminal and storage medium
CN112596656A (en) * 2020-12-28 2021-04-02 北京小米移动软件有限公司 Content identification method, device and storage medium
CN115033658A (en) * 2021-02-24 2022-09-09 北京小米移动软件有限公司 Information searching method, device, equipment and storage medium

Also Published As

Publication number Publication date
WO2019233318A1 (en) 2019-12-12
CN108958576B (en) 2021-02-02

Similar Documents

Publication Publication Date Title
CN108958576A (en) content identification method, device and mobile terminal
CN109085982A (en) content identification method, device and mobile terminal
WO2019233212A1 (en) Text identification method and device, mobile terminal, and storage medium
CN108664190B (en) Page display method, device, mobile terminal and storage medium
CN108415652B (en) Text processing method and mobile terminal
CN109101498B (en) Translation method and device and mobile terminal
CN108156508B (en) Barrage information processing method and device, mobile terminal, server and system
WO2015135381A1 (en) Device, system, and method for creating virtual credit card field of the technology
CN108932102B (en) Data processing method and device and mobile terminal
CN106875181A (en) A kind of barcode scanning payment processing method and mobile terminal
CN108664475A (en) Translate display methods, device, mobile terminal and storage medium
CN109165292A (en) Data processing method, device and mobile terminal
CN107766548B (en) Information display method and device, mobile terminal and readable storage medium
CN109032491B (en) Data processing method and device and mobile terminal
CN108958634A (en) Express delivery information acquisition method, device, mobile terminal and storage medium
CN106375179A (en) Method and device for displaying instant communication message
CN111597542A (en) Verification information sharing method and device, electronic equipment and storage medium
US20150153921A1 (en) Apparatuses and methods for inputting a uniform resource locator
CN108763193A (en) Literal processing method, device, mobile terminal and storage medium
CN108763297A (en) Web page resources processing method, device and mobile terminal
CN108664205A (en) Method for information display, device, mobile terminal and storage medium
CN108803961B (en) Data processing method and device and mobile terminal
CN108803972B (en) Information display method, device, mobile terminal and storage medium
WO2019228370A1 (en) Data processing method and device, mobile terminal and storage medium
CN108958621A (en) information display method, device and mobile terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant