CN108958576A - content identification method, device and mobile terminal - Google Patents
content identification method, device and mobile terminal Download PDFInfo
- Publication number
- CN108958576A CN108958576A CN201810588338.1A CN201810588338A CN108958576A CN 108958576 A CN108958576 A CN 108958576A CN 201810588338 A CN201810588338 A CN 201810588338A CN 108958576 A CN108958576 A CN 108958576A
- Authority
- CN
- China
- Prior art keywords
- identification
- user interface
- content
- touch
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
Abstract
The embodiment of the present application discloses a kind of content identification method, device and mobile terminal, is related to technical field of mobile terminals.Wherein, this method comprises: when receiving the identification touch-control to user interface, content recognition is carried out to the user interface;If the content recognition to the user interface fails, adjustable screenshot box is shown in user interface;Content in the screenshot box is identified.In this method, content recognition directly can be carried out in user interface, it is simple to operate.
Description
Technical field
This application involves technical field of mobile terminals, eventually more particularly, to a kind of content identification method, device and movement
End.
Background technique
The display screen of mobile terminal can show various contents, if user wants to obtain the detailed of some of them display content
Information then needs corresponding content copying to browser search box, and operating process is cumbersome.
Summary of the invention
In view of the above problems, present applicant proposes a kind of content identification method, device and mobile terminals, for user circle
The content in face is identified, identification process is simplified, and improves user experience.
In a first aspect, the embodiment of the present application provides a kind of content identification method, which comprises receive to user
When the identification touch-control at interface, content recognition is carried out to the user interface;If the content recognition to the user interface fails,
The user interface shows adjustable screenshot box;Content in the screenshot box is identified.
Second aspect, the embodiment of the present application provide a kind of content identification apparatus, and described device includes: the first identification mould
Block when for receiving the identification touch-control to user interface, carries out content recognition to the user interface;Frame modeling block, is used for
If the content recognition to the user interface fails, adjustable screenshot box is shown in the user interface;Second identification module,
For being identified to the content in the screenshot box.
The third aspect, the embodiment of the present application provide a kind of mobile terminal, including display screen, memory and processor, institute
It states display screen and the memory is couple to the processor, the memory store instruction, when described instruction is by the processing
The processor above-mentioned method when device executes.
Fourth aspect, the embodiment of the present application provide it is a kind of with processor can be performed program code it is computer-readable
Storage medium, said program code make the processor execute above-mentioned method.
Content identification method, device and mobile terminal provided by the present application, in response to identifying touch-control to user interface
In the case where content recognition failure, adjustable screenshot box is shown, and identify to the content of screenshot box, so as to direct
Content recognition is carried out in user interface, it is simple to operate.
Detailed description of the invention
In order to more clearly explain the technical solutions in the embodiments of the present application, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, the drawings in the following description are only some examples of the present application, for
For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 shows the flow chart of the content identification method of one embodiment of the application proposition;
Fig. 2 shows the first display schematic diagrams that the embodiment of the present application proposes;
Fig. 3 shows the second display schematic diagram of the embodiment of the present application proposition;
Fig. 4 shows the third display schematic diagram of the embodiment of the present application proposition;
Fig. 5 shows the flow chart for the content identification method that another embodiment of the application proposes;
Fig. 6 shows the 4th display schematic diagram of the embodiment of the present application proposition;
Fig. 7 shows the 5th display schematic diagram of the embodiment of the present application proposition;
Fig. 8 shows the 6th display schematic diagram of the embodiment of the present application proposition;
Fig. 9 shows the 7th display schematic diagram of the embodiment of the present application proposition;
Figure 10 shows the functional block diagram of the content identification apparatus of the embodiment of the present application proposition;
Figure 11 shows a kind of structural block diagram of the mobile terminal of the embodiment of the present application proposition;
Figure 12 shows a kind of structural schematic diagram of the mobile terminal of the embodiment of the present application proposition;
Figure 13 shows the movement for being used to execute the content identification method according to the embodiment of the present application of the embodiment of the present application
The block diagram of terminal.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on
Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall in the protection scope of this application.
Currently, user by mobile terminal Internet access chat, read text, check picture or viewing video when, often
Interest can be generated to some of which content and scans for obtaining more detailed information.At this point, user is firstly the need of duplication
Interested content is perhaps kept firmly in mind in interested, then opens browser, and the content of duplication is pasted into searching for browser
It is input in the search box of browser in rope frame or by the content kept firmly in mind and scans for leading to operating process to obtain details
It is very cumbersome, it takes a long time and is easy to produce mistake.
It further, can be by technologies such as pressure sensitives to aobvious in order to which the operating process for solving the problems, such as search is cumbersome
The content shown carries out selection and identifies the content of selection, recognition result is obtained, to promote the acquisition speed of information.But
It is that inventor is by a large amount of the study found that corresponding directly to the identification of touch-control progress content of the user in user interface, knowledge
It may not fail, the recognition result that user wants can not be obtained.
In view of the above technical problems, the embodiment of the present application proposes a kind of content identification method, device and mobile terminal,
In the case where recognition failures, adjustable screenshot box is shown in user interface, so as to by selecting in user interface again frame
Content is identified, the recognition result for catering to user demand is obtained.
Below in conjunction with attached drawing and by specific embodiment to content identification method provided by the embodiments of the present application, device
And mobile terminal is illustrated.
Referring to Fig. 1, the embodiment of the present application provides a kind of content identification method, the content identification method is used for aobvious
The all or part of the content in user interface that display screen is shown is identified.In the particular embodiment, the content recognition side
Method be applied to content identification apparatus as shown in Figure 10 and be corresponding with content identification apparatus 300 mobile terminal 400 (Figure 11,
Figure 12).Above-mentioned content identification method can specifically include following steps:
Step S110: when receiving the identification touch-control to user interface, content recognition is carried out to the user interface.
When user wants to identify certain contents of user interface to obtain the content more detailed information, Ke Yi
User interface carries out identification touch-control.Wherein, the specific corresponding touch control operation of the identification touch-control is not in the embodiment of the present application
It limits, such as singly refers to long-pressing, two fingers long-pressing, refers to that long-pressing, articulations digitorum manus long-pressing, single give directions hit, two fingers click, give more directions and hit, refer to pass more
Section percussion singly refers to large area pressing, the pressing of two fingers large area, refers to large area pressing more, singly refers to, two fingers or mostly finger are by desired guiding trajectory
Sliding etc..If the touch control operation is to slide by desired guiding trajectory, sliding trace can be closed figure, in closed figure
Content is identified.
Mobile terminal knows content corresponding to the identification touch-control in user interface when receiving identification touch-control
Not.As a kind of specific embodiment, the display content of identification can be all the elements in the user interface.
As a kind of specific embodiment, the display content of identification can be touch control operation touch-control in the user interface
Content corresponding to position.Wherein, specifically corresponding content can be position of touch, the text paragraph where position of touch, touching
Control the picture where position, the control where position of touch.Such as shown in Fig. 2, the interface of display be by the user interface of touch-control,
Circle A indicates position of touch, the display content identified using the text paragraph where circle A as needs.
As a kind of specific embodiment, the display content of identification is to show in the corresponding text control of position of touch
Text.It can specifically include: determining the corresponding text control of position of touch of the identification touch-control;It obtains in the text control
Text identified.Wherein, the corresponding text control of position of touch can be the text control nearest from position of touch.
That is, if position of touch touch-control is in text control, using the text control by touch-control as to be identified
Text control.Such as in chat interface shown in Fig. 2, circle A indicates position of touch, the corresponding text control B of chat message
The text control that touch-control arrives for the position of touch institute, then identify the chat message in text control B.
If position of touch touch-control, can be in the text control nearest from the position of touch in the position of non-textual control
Text identified.Such as in chat interface shown in Fig. 3, circle A indicate position of touch, non-touch-control in text control,
The corresponding text control B of chat message is the text control nearest from the position of touch, then believes the chat in text control B
Breath is identified.
Some existing identification methods, such as participle, semantics recognition wherein can be used to the identification of display content, herein
Without limitation.
In addition, the identification of display content is also possible to through backstage screenshot, after carrying out screenshot to the content that needs identify,
It is identified by picture analyzing, is such as known by OCR (Optical Character Recognition, optical character identification)
Not.Specifically such as, the position of touch of the identification touch-control in the user interface is determined;In the user interface, in the touch-control
Screenshot is carried out in the preset range of position;Text identification is carried out to the picture that the screenshot obtains.The size of the preset range exists
It is not limited in the embodiment of the present application, can be the rectangular extent of default length and width, the circular scope of pre-set radius or other are pre-
If the range of shape and default size.
Step S120: if the content recognition to the user interface fails, adjustable screenshot box is shown in user interface.
Due to various reasons, may fail to the identification of the content of user interface.Wherein the reason of recognition failures, may have
It is a variety of, for example, network connection is unstable, mobile terminal is not connected with the network problems such as network and leads to not identification or identify super
When;Or such as, in response to identifying touch-control, effective identification content can not be obtained;Or the content as needed to identify is unhealthy information
Deng not doing exhaustion herein.
If recognition failures do not obtain recognition result, adjustable screenshot box can be shown in user interface.Such as Fig. 4, this section
Picture frame K can be rectangle frame as shown in the figure, be also possible to the closed figure of other shapes, such as circle, prismatic, triangle, more
The arbitrary shapes such as side shape.Wherein, which is the user interface that display screen is shown when identifying touch-control.
Step S130: the content in the screenshot box is identified.
As shown in figure 4, being corresponding with the content of user interface in screenshot box K.Content representation in screenshot box is known
Therefore other content can identify the content in screenshot box.
In the embodiment of the present application, the identification touch-control to user interface is being received, content recognition is carried out to user interface
But in the case where recognition failures, by showing adjustable screenshot box in user interface, user interface is carried out by screenshot box
Frame choosing, then the content of frame choosing is identified.To, in the case where recognition failures, can be selected by frame key again with
The frame again that family interface carries out identification content is selected and is identified.
In the embodiment of the present application, adjustable screenshot box can be adjusted according to demand by user, be made in screenshot box
Content be user want identification content.Specifically, Fig. 5 is referred to, and in the method provided by the embodiment of the present application, packet
It includes:
Step S210: when receiving the identification touch-control to user interface, content recognition is carried out to the user interface.
User can initiate the identification touch control operation identified to display content in user interface.Wherein, as previously mentioned,
The user interface can be chat interface, web interface, video clip, user interface of various application programs etc., in the application
It is not limited in embodiment.When receiving the touch-control of user, content recognition is carried out in the user interface of institute's touch-control.
Step S220: if the content recognition to the user interface fails, adjustable screenshot box is shown in user interface.
If recognition failures, the recognition result of the content in the user interface to institute's touch-control is not obtained, is shown in user interface
Screenshot box carries out frame choosing identification to user interface.
As a kind of specific embodiment, when user interface shows adjustable screenshot box, can be such as Fig. 4 institute
Show, be the user interface for identifying touch-control when institute touch-control at the interface that display screen is shown, shows screenshot box K in the user interface.
It, can be with as shown in fig. 6, when user interface shows adjustable screenshot box as a kind of specific embodiment
The user interface of touch-control is reduced into display, screenshot box K is shown in the user interface of the diminution.
Optionally, when showing screenshot box, only have screenshot box that can operate in user interface, other positions are inoperable.
In the embodiment of the present application, when recognition failures start to show screenshot box, the position that screenshot box is shown first is not
It limits.
As an implementation, screenshot box can be shown with default size in predeterminated position.The default size can be with
It is pre-set fixed size, is also possible to pre-set and user interface scale.The predeterminated position can be
Some in display screen fixes position, is also possible to by some position of the user interface of touch-control.
As an implementation, the display position of screenshot box can be determined according to the position of touch of identification touch-control.Specifically
, it can be, position of touch frame is selected in interior screenshot box.Optionally, which can be default size, be also possible to by
The corresponding touch area frame of position of touch is selected in interior minimum screenshot box etc..
In this embodiment, if being also possible to position of touch on control, screenshot box arrives the position of touch institute touch-control
Control frame be selected in.Specifically, control corresponding to the position of touch of the identification touch-control can be determined, which can be with table
Show in the user interface, which overlaps with position of touch.It shows again in the user interface by the control frame
It is selected in interior adjustable screenshot box.
Optionally, before showing screenshot box, user's recognition failures can be prompted with display reminding information, if enter frame
Choosing identification, if user's selection is to show adjustable screenshot box in user interface;If user's selection is no, knowledge can be exited
Other process does not obtain recognition result to the end of identification of user interface.
Step S230: the content in the screenshot box is identified.
In the embodiment of the present application, the content that can be selected screenshot box institute's frame identifies.The identification can be, and directly obtain
The content in screenshot box is taken, if included text control in screenshot box, the text in text control is obtained, includes picture in screenshot box
Control directly acquires the picture etc. in the picture control.In addition, the identification is also possible to the content for selecting the screenshot circle
Interception is picture, for example, all the elements in screenshot box are carried out screenshot and are cut using the edge of screenshot box as interception edge
The picture taken, then the content in picture is identified.The identification process can be obtained in picture by image procossing first
Content herein with no restrictions, can such as OCR (Optical Character Recognition, optical character identification) processing etc.
To pass through the existing processing mode that can obtain the various contents such as text in image, picture, two dimensional code.
As a kind of specific embodiment, user interface shows screenshot box, to all or part of the content in screenshot box
It is identified.
As a kind of specific embodiment, when showing screenshot box, while one or more identification types are provided can
Option, the identification types indicate type belonging to the content to be identified, such as two dimensional code, commodity, text, picture.It is mobile whole
End can receive the target identification type that user selects from one or more identification types;To target identification in the screenshot box
The corresponding content of type is identified.That is, receiving the knowledge that user selects from one or more identification types
Other type, using the identification types that user selects as target identification type, to belonging to target identification class in the content in screenshot box
The content of type is identified.Fig. 6 shows three two dimensional code, commodity, text optional identification types.
In this embodiment, to the identification of different identification types, it can be the difference of identification content, only such as text identification
Parsing is carried out to the content of text in screenshot box and obtains recognition result, picture recognition only carries out parsing to the picture in screenshot box and obtains
Take recognition result.It is also possible to the difference of identification method, such as identification to text, picture, two dimensional code, by corresponding identifying processing
Server is realized, can then jump to third party's shopping platform, such as Taobao to the identification of commodity, and the content in screenshot box is passed
Third party's shopping platform is passed to identify.Be also possible to recognition result shows difference, for example, to text, commodity, picture etc.
Identification, can be directly shown by card by forms such as participle, brief introduction, links, the identification to commodity can pass through
Third party's shopping platform is shown.
Specifically, identification process can be, the content in screenshot box is analyzed, therefrom obtains target identification type institute
Corresponding content identifies the content of target identification type.For example, if target identification type is two dimensional code, to screenshot
After content in frame carries out analysis acquisition two dimensional code therein, two dimensional code is identified, obtains the information that two dimensional code is included.
For another example, if target identification type is text, the text in screenshot box is segmented, is parsed, the operation such as semantic search, and is anti-
Present the recognition result of the text.
It wherein, optionally, can be therein by carrying out analysis acquisition to screenshot box when target identification type is text
Content of text, then be filtered to content of text after filtering out messy code therein, obtains effective text, then to effective text into
Row parsing identification.In this embodiment, messy code can be the text other than preset kind text, as the text of preset kind is
Chinese character, English character and selected common punctuate, then other punctuates etc. other than other texts, common punctuate, all by
It is determined as messy code.
It in this embodiment, optionally, can be with one of identification types if the non-selected target identification type of user
As default identification types, the content that identification types are defaulted in screenshot box is identified.Optionally, if the non-selected target of user
Identification types, can also without identification, user select identification types after, then to the corresponding content of the identification types of selection into
Row identification.
In the embodiment of the present application, screenshot box is adjustable screenshot box, which includes the adjustment and size of position
Adjustment.Mobile terminal can receive the size to the screenshot box or the adjustment of position;To the screenshot box adjusted
Interior content is identified.
Such as Fig. 4 and the frame shown in fig. 6 for screenshot box after selecting interface into frame in user interface select, user can pass through
The different directions at the angle of screenshot box are pulled, the size of screenshot box is adjusted, is illustrated in figure 7 the screenshot after turning down relative to Fig. 4
Frame K.User can also drag screenshot box by sideline, the interior zone etc. for pressing screenshot box and change position, be illustrated in figure 8 phase
Screenshot box adjusted for the position Fig. 7.
In the embodiment of the present application, the shape that can also change screenshot box receives what user changed screenshot box shape
The shape of screenshot box is changed into round, triangle or other arbitrary polygons etc. according to the request by request.Such as it can be with
Corresponding screenshot box K provides shape select button, when receiving the pressing to the button, shows selectable shape.If user selects
Triangle has been selected, then the shape of current screenshot box has been changed into triangle.
As a kind of specific embodiment, in the embodiment of the present application, shown in response to identification touch-control recognition failures
When screenshot box, if not receiving the adjustment to screenshot box also, without identification;The adjustment to screenshot box is being received, it is just right
Content in screenshot box adjusted is identified, recognition result is obtained.
As a kind of specific embodiment, when showing screenshot box in response to identification touch-control recognition failures, to screenshot box
In content identified, obtain recognition result.If receiving the adjustment to screenshot box, in screenshot box adjusted
Appearance is identified, updates recognition result according to the identification to screenshot box adjusted.That is, as shown in figure 5, in the implementation
It can also include step S240 after step S230 in mode: receive to the size of the screenshot box or the tune of position
It is whole.Step S250: screenshot identification is carried out to the screenshot box adjusted.
It in the embodiment of the present application, may include being searched to the participle and correspondence of corresponding contents to the identification in screenshot box
Rope, recognition result may include word segmentation result, brief introduction, the link of video display, books, personage etc., the map in place, the purchase of commodity
Channel, schedule information, express delivery information etc. are one or more, are not intended to limit in the embodiment of the present application, can be display content
Any explanation information.If Fig. 9 shows a kind of specific recognition result display mode, the recognition result of display may include to phase
The participle for the content answered, user can from select to replicate after word in word segmentation result, Quan Xuan, translation or search etc..
Optionally, in the embodiment of the present application, the recognition result can be shown by card, as shown in figure 9,
Card C shows recognition result.Wherein, card is the carrier for showing information, can be the combination of a control or multiple controls.
The information that card is shown in the embodiment of the present application can be the corresponding information of recognition result.In the same card, it can show same
The different recognition results of one display content or the different recognition results of same display content can be shown in different cards.
Optionally, in the embodiment of the present application, if it is unsuccessful to the content recognition in screenshot box, it can show recognition failures
Prompt information.
In conclusion in content identification method provided by the embodiments of the present application, when receiving identification touch-control, to user circle
Face carries out content recognition.If recognition failures, the screenshot box that frame choosing is carried out to user interface is provided.When receiving to the big of screenshot box
The adjustment such as small or position, identifies the content in screenshot box adjusted, to realize that user can be according to itself need
The size and location for seeking adjustment screenshot box, the property frame of desired identification is selected in screenshot box and is identified, desired knowledge is obtained
Other result.
The embodiment of the present application also provides a kind of content identification apparatus 300, referring to Figure 10, which includes: first
Identification module 310 when for receiving the identification touch-control to user interface, carries out content recognition to the user interface.Frame choosing
Module 320, if showing adjustable screenshot box in user interface for the content recognition failure to the user interface.Second
Identification module 330, for being identified to the content in the screenshot box.
Optionally, the first identification module 310 may include control determination unit, for determining the touch-control of the identification touch-control
The corresponding text control in position;Recognition unit is identified for obtaining the text in the text control.
Optionally, the first identification module may include position determination unit, for determining the touch-control position of the identification touch-control
It sets;Image acquisition unit, for carrying out screenshot in the preset range of the position of touch in the user interface;Identification
Unit, the picture for obtaining to the screenshot carry out text identification.
Optionally, which can also include: determination type module, for receiving user from one or more identification types
The target identification type of middle selection;Second identification module is used to carry out the corresponding content of target identification type in the screenshot box
Identification.
Optionally, which can also include: adjustment module, for receiving to the size of the screenshot box or position
Adjustment.Second identification module is also used to carry out screenshot identification to the screenshot box adjusted.
Optionally, frame modeling block 320 can be also used for default size showing the screenshot box in predeterminated position.Or
For determining control corresponding to the position of touch of the identification touch-control;It is shown in the user interface and selects the control frame
Adjustable screenshot box inside.
In conclusion in the embodiment of the present application, when user is in chat or access text in a browser, in identification use
After the text failure in the selected region in family, manual screenshot box is shown, need the region of screenshot so that user manually selects, then
The picture intercepted is identified, wherein when identifying for the picture of screenshot, it is that two dimensional code is known that user, which can choose,
Not or text identification or article identification.Wherein it is possible to preliminary screening be done to the result parsed, to messy code and character
It is filtered, after filtering if without effective text, walks the unidentified process to any content, if effective text after filtering
This, then pass to text identification.
Referring to Figure 11, based on above-mentioned content identification method and device, the embodiment of the present application also provides a kind of shifting
Dynamic terminal 400.As shown in figure 11, which includes display screen 120, memory 104 and processor 102, the display
Screen 120 and the memory 104 are couple to the processor 102, and the display screen 120 is for showing content, parsing identification knot
Fruit etc., 104 store instruction of memory, when described instruction is executed by the processor 102, the processor 102 executes sheet
Apply for the method that embodiment provides.
Specifically, as shown in figure 12, which may include electronic body portion 10, the electronic body portion 10
Including shell 12 and the display screen 120 being arranged on the shell 12.Metal, such as steel, aluminium alloy can be used in the shell 12
It is made.In the present embodiment, the display screen 120 generally includes display panel 111, may also comprise for responding to the display surface
The circuit etc. of the progress touch control operation of plate 111.The display panel 111 can be a liquid crystal display panel (Liquid
Crystal Display, LCD), in some embodiments, the display panel 111 is a touch screen 109 simultaneously.
Please refer to Figure 13, in actual application scenarios, the mobile terminal 400 can be used as intelligent mobile phone terminal into
It exercises and uses, the electronic body portion 10 also typically includes one or more (only showing one in figure) processors in this case
102, memory 104, RF (Radio Frequency, radio frequency) module 106, voicefrequency circuit 110, sensor 114, input module
118, power module 122.It will appreciated by the skilled person that structure shown in Figure 13 is only to illustrate, not to institute
The structure for stating electronic body portion 10 causes to limit.For example, the electronic body portion 10 may also include it is more than shown in Figure 13 or
The less component of person, or with the correspondence different from shown in Figure 13.
It will appreciated by the skilled person that every other component belongs to for the processor 102
It is coupled between peripheral hardware, the processor 102 and these peripheral hardwares by multiple Peripheral Interfaces 124.The Peripheral Interface 124 can
Based on following standard implementation: Universal Asynchronous Receive/sending device (Universal Asynchronous Receiver/
Transmitter, UART), universal input/output (General Purpose Input Output, GPIO), serial peripheral connect
Mouthful (Serial Peripheral Interface, SPI), internal integrated circuit (Inter-Integrated Circuit,
I2C), but it is not limited to above-mentioned standard.In some instances, the Peripheral Interface 124 can only include bus;In other examples
In, the Peripheral Interface 124 may also include other elements, such as one or more controller, such as connecting the display
The display controller of panel 111 or storage control for connecting memory.In addition, these controllers can also be from described
It detaches, and is integrated in the processor 102 or in corresponding peripheral hardware in Peripheral Interface 124.
The memory 104 can be used for storing software program and module, and the processor 102 is stored in institute by operation
The software program and module in memory 104 are stated, thereby executing various function application and data processing.The memory
104 may include high speed random access memory, may also include nonvolatile memory, and such as one or more magnetic storage device dodges
It deposits or other non-volatile solid state memories.In some instances, the memory 104 can further comprise relative to institute
The remotely located memory of processor 102 is stated, these remote memories can pass through network connection to the electronic body portion 10
Or the display screen 120.The example of above-mentioned network includes but is not limited to internet, intranet, local area network, mobile radio communication
And combinations thereof.
The RF module 106 is used to receive and transmit electromagnetic wave, realizes the mutual conversion of electromagnetic wave and electric signal, thus
It is communicated with communication network or other equipment.The RF module 106 may include various existing for executing these functions
Circuit element, for example, antenna, RF transceiver, digital signal processor, encryption/deciphering chip, subscriber identity module
(SIM) card, memory etc..The RF module 106 can be carried out with various networks such as internet, intranet, wireless network
Communication is communicated by wireless network and other equipment.Above-mentioned wireless network may include cellular telephone networks, wireless
Local area network or Metropolitan Area Network (MAN).Various communication standards, agreement and technology can be used in above-mentioned wireless network, including but not limited to
Global system for mobile communications (Global System for Mobile Communication, GSM), enhanced mobile communication skill
Art (Enhanced Data GSM Environment, EDGE), Wideband CDMA Technology (wideband code
Division multiple access, W-CDMA), Code Division Multiple Access (Code division access, CDMA), time-division
Multiple access technology (time division multiple access, TDMA), adopting wireless fidelity technology (Wireless, Fidelity,
WiFi) (such as American Institute of Electrical and Electronics Engineers's standard IEEE 802.10A, IEEE 802.11b, IEEE802.11g and/
Or IEEE 802.11n), the networking telephone (Voice over internet protocal, VoIP), worldwide interoperability for microwave accesses
(Worldwide Interoperability for Microwave Access, Wi-Max), other be used for mail, Instant Messenger
The agreement and any other suitable communications protocol of news and short message, or even may include that those are not developed currently yet
Agreement.
Voicefrequency circuit 110, loudspeaker 101, microphone 103, microphone 105 provide user and the electronic body portion jointly
Audio interface between 10 or the display screen 120.
The setting of sensor 114 is in the electronic body portion 10 or in the display screen 120, the sensor 114
Example include but is not limited to: acceleration transducer 114F, gyroscope 114G, magnetometer 114H and other sensors.
In the present embodiment, the input module 118 may include the touch screen 109 being arranged on the display screen 120,
The touch screen 109 collects the touch operation of user on it or nearby, and (for example user is suitble to using finger, stylus etc. are any
Object or attachment operation on the touch screen 109 or near the touch screen 109), it is hereby achieved that user
Touch gestures, and corresponding attachment device is driven according to a pre-set procedure, therefore, user can pass through the touching in display screen
Control operation selected target region.Optionally, the touch screen 109 may include touch detecting apparatus and touch controller.Wherein, institute
The touch orientation of touch detecting apparatus detection user is stated, and detects touch operation bring signal, transmits a signal to the touching
Touch controller;The touch controller receives touch information from the touch detecting apparatus, and the touch information is converted into
Contact coordinate, then give the processor 102, and order that the processor 102 is sent can be received and executed.In addition,
The touch detection of the touch screen 109 can be realized using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves
Function.In addition to the touch screen 109, in other change embodiments, the input module 118 can also include other inputs
Equipment, such as key 107.The key 107 for example may include the character keys for inputting character, and for triggering control function
The control button of energy.The example of the control button includes " returning to main screen " key, power on/off key etc..
The display screen 120 is used for the information and the electronics sheet for showing information input by user, being supplied to user
The various graphical user interface in body portion 10, these graphical user interface can be by figure, text, icon, number, video and Qi Ren
Meaning combination is to constitute.In an example, the touch screen 109 may be disposed on the display panel 111 to show with described
Show that panel 111 constitutes an entirety.
The power module 122 is used to provide power supply to the processor 102 and other each components.Specifically,
The power module 122 may include power-supply management system, one or more power supply (such as battery or alternating current), charging circuit,
Power-fail detection circuit, inverter, indicator of the power supply status and any other and electronic body portion 10 are described aobvious
The generation, management of electric power and the relevant component of distribution in display screen 120.
The mobile terminal 400 further includes locator 119, and the locator 119 is for determining 400 institute of mobile terminal
The physical location at place.In the present embodiment, the locator 119 realizes the positioning of the mobile terminal 400 using positioning service,
The positioning service, it should be understood that the location information of the mobile terminal 400 is obtained by specific location technology (as passed through
Latitude coordinate), it is marked on the electronic map by the technology or service of the position of positioning object.
It should be understood that above-mentioned mobile terminal 400 is not limited to intelligent mobile phone terminal, should refer to can moved
Computer equipment used in dynamic.Specifically, mobile terminal 400, refers to the mobile computer for being equipped with intelligent operating system
Equipment, mobile terminal 400 include but is not limited to smart phone, smartwatch, tablet computer, etc..
It should be noted that all the embodiments in this specification are described in a progressive manner, each embodiment weight
Point explanation is the difference from other embodiments, and the same or similar parts between the embodiments can be referred to each other.
For device class embodiment, since it is basically similar to the method embodiment, so being described relatively simple, related place ginseng
See the part explanation of embodiment of the method.For arbitrary processing mode described in embodiment of the method, in device reality
Apply in example can no longer be repeated in Installation practice by corresponding processing modules implement one by one.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is contained at least one embodiment or example of the application.In the present specification, schematic expression of the above terms are not
It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office
It can be combined in any suitable manner in one or more embodiment or examples.In addition, without conflicting with each other, the skill of this field
Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples
It closes and combines.
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the present application, the meaning of " plurality " is at least two, such as two, three
It is a etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the application includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, to execute function, this should be by the application
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, stores, communicates, propagates or pass
Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment
It sets.The more specific example (non-exhaustive list) of computer-readable medium include the following: there is the electricity of one or more wirings
Interconnecting piece (mobile terminal), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable
Medium, because can then be edited, be interpreted or when necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each section of the application can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.It, and in another embodiment, can be under well known in the art for example, if realized with hardware
Any one of column technology or their combination are realized: having a logic gates for realizing logic function to data-signal
Discrete logic, with suitable combinational logic gate circuit specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.In addition, in each embodiment of the application
In each functional unit can integrate in a processing module, be also possible to each unit and physically exist alone, can also two
A or more than two units are integrated in a module.Above-mentioned integrated module both can take the form of hardware realization, can also
It is realized in the form of using software function module.If the integrated module realized in the form of software function module and as
Independent product when selling or using, also can store in a computer readable storage medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..Although having been shown and retouching above
Embodiments herein is stated, it is to be understood that above-described embodiment is exemplary, and should not be understood as the limit to the application
System, those skilled in the art can be changed above-described embodiment, modify, replace and become within the scope of application
Type.
Finally, it should be noted that above embodiments are only to illustrate the technical solution of the application, rather than its limitations;Although
The application is described in detail with reference to the foregoing embodiments, those skilled in the art are when understanding: it still can be with
It modifies the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features;And
These are modified or replaceed, do not drive corresponding technical solution essence be detached from each embodiment technical solution of the application spirit and
Range.
Claims (11)
1. a kind of content identification method, which is characterized in that the described method includes:
When receiving the identification touch-control to user interface, content recognition is carried out to the user interface;
If the content recognition to the user interface fails, adjustable screenshot box is shown in the user interface;
Content in the screenshot box is identified.
2. the method according to claim 1, wherein described carry out content recognition to the user interface, comprising:
Determine the corresponding text control of position of touch of the identification touch-control;
The text obtained in the text control is identified.
3. the method according to claim 1, wherein described carry out content recognition to the user interface, comprising:
Determine the position of touch of the identification touch-control;
In the user interface, screenshot is carried out in the preset range of the position of touch;
Text identification is carried out to the picture that the screenshot obtains.
4. the method according to claim 1, wherein the method also includes:
Receive the target identification type that user selects from one or more identification types;
The corresponding content of target identification type in the screenshot box is identified.
5. according to the method described in claim 4, it is characterized in that, the identification types include:
Two dimensional code, commodity or text.
6. the method according to claim 1, wherein the method also includes:
It receives to the size of the screenshot box or the adjustment of position;
Screenshot identification is carried out to the screenshot box adjusted.
7. the method according to claim 1, wherein described show adjustable screenshot box in the user interface
Include:
The screenshot box is shown with default size in predeterminated position.
8. the method according to claim 1, wherein described show adjustable screenshot box in the user interface
Include:
Determine control corresponding to the position of touch of the identification touch-control;
It is shown in the user interface and the control frame is selected in interior adjustable screenshot box.
9. a kind of content identification apparatus, which is characterized in that described device includes:
First identification module when for receiving the identification touch-control to user interface, carries out content recognition to the user interface;
Frame modeling block, if showing adjustable section in the user interface for the content recognition failure to the user interface
Picture frame;
Second identification module, for being identified to the content in the screenshot box.
10. a kind of mobile terminal, which is characterized in that including display screen, memory and processor, the display screen and the storage
Device is couple to the processor, the memory store instruction, when executed by the processor the processor
Perform claim requires 1 to 8 described in any item methods.
11. a kind of computer readable storage medium for the program code that can be performed with processor, which is characterized in that described program
Code makes the processor perform claim require 1 to 8 described in any item methods.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810588338.1A CN108958576B (en) | 2018-06-08 | 2018-06-08 | Content identification method and device and mobile terminal |
PCT/CN2019/088874 WO2019233318A1 (en) | 2018-06-08 | 2019-05-28 | Content identification method and device, and mobile terminal |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810588338.1A CN108958576B (en) | 2018-06-08 | 2018-06-08 | Content identification method and device and mobile terminal |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108958576A true CN108958576A (en) | 2018-12-07 |
CN108958576B CN108958576B (en) | 2021-02-02 |
Family
ID=64494007
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810588338.1A Active CN108958576B (en) | 2018-06-08 | 2018-06-08 | Content identification method and device and mobile terminal |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN108958576B (en) |
WO (1) | WO2019233318A1 (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109933275A (en) * | 2019-02-12 | 2019-06-25 | 努比亚技术有限公司 | A kind of knowledge screen method, terminal and computer readable storage medium |
WO2019233318A1 (en) * | 2018-06-08 | 2019-12-12 | Oppo广东移动通信有限公司 | Content identification method and device, and mobile terminal |
CN110647640A (en) * | 2019-09-30 | 2020-01-03 | 京东方科技集团股份有限公司 | Computer system, method for operating a computing device and system for operating a computing device |
CN111310482A (en) * | 2020-01-20 | 2020-06-19 | 北京无限光场科技有限公司 | Real-time translation method, device, terminal and storage medium |
CN112596656A (en) * | 2020-12-28 | 2021-04-02 | 北京小米移动软件有限公司 | Content identification method, device and storage medium |
CN115033658A (en) * | 2021-02-24 | 2022-09-09 | 北京小米移动软件有限公司 | Information searching method, device, equipment and storage medium |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105005551A (en) * | 2015-06-29 | 2015-10-28 | 东南(福建)汽车工业有限公司 | Method for implementing rapid acquisition of picture characters in document revision |
US20160147742A1 (en) * | 2014-11-26 | 2016-05-26 | Naver Corporation | Apparatus and method for providing translations editor |
CN106020694A (en) * | 2016-05-24 | 2016-10-12 | 北京京东尚科信息技术有限公司 | Electronic device, selected area dynamic adjusting method and device |
CN106325688A (en) * | 2016-08-17 | 2017-01-11 | 北京锤子数码科技有限公司 | Text processing method and device |
CN106484266A (en) * | 2016-10-18 | 2017-03-08 | 北京锤子数码科技有限公司 | A kind of text handling method and device |
CN107358226A (en) * | 2017-06-23 | 2017-11-17 | 联想(北京)有限公司 | The recognition methods of electronic equipment and electronic equipment |
CN107632773A (en) * | 2017-10-17 | 2018-01-26 | 北京百度网讯科技有限公司 | For obtaining the method and device of information |
CN107797750A (en) * | 2017-10-27 | 2018-03-13 | 珠海市魅族科技有限公司 | A kind of screen content identifying processing method, apparatus, terminal and medium |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108958576B (en) * | 2018-06-08 | 2021-02-02 | Oppo广东移动通信有限公司 | Content identification method and device and mobile terminal |
-
2018
- 2018-06-08 CN CN201810588338.1A patent/CN108958576B/en active Active
-
2019
- 2019-05-28 WO PCT/CN2019/088874 patent/WO2019233318A1/en active Application Filing
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160147742A1 (en) * | 2014-11-26 | 2016-05-26 | Naver Corporation | Apparatus and method for providing translations editor |
CN105005551A (en) * | 2015-06-29 | 2015-10-28 | 东南(福建)汽车工业有限公司 | Method for implementing rapid acquisition of picture characters in document revision |
CN106020694A (en) * | 2016-05-24 | 2016-10-12 | 北京京东尚科信息技术有限公司 | Electronic device, selected area dynamic adjusting method and device |
CN106325688A (en) * | 2016-08-17 | 2017-01-11 | 北京锤子数码科技有限公司 | Text processing method and device |
CN106484266A (en) * | 2016-10-18 | 2017-03-08 | 北京锤子数码科技有限公司 | A kind of text handling method and device |
CN107358226A (en) * | 2017-06-23 | 2017-11-17 | 联想(北京)有限公司 | The recognition methods of electronic equipment and electronic equipment |
CN107632773A (en) * | 2017-10-17 | 2018-01-26 | 北京百度网讯科技有限公司 | For obtaining the method and device of information |
CN107797750A (en) * | 2017-10-27 | 2018-03-13 | 珠海市魅族科技有限公司 | A kind of screen content identifying processing method, apparatus, terminal and medium |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019233318A1 (en) * | 2018-06-08 | 2019-12-12 | Oppo广东移动通信有限公司 | Content identification method and device, and mobile terminal |
CN109933275A (en) * | 2019-02-12 | 2019-06-25 | 努比亚技术有限公司 | A kind of knowledge screen method, terminal and computer readable storage medium |
CN110647640A (en) * | 2019-09-30 | 2020-01-03 | 京东方科技集团股份有限公司 | Computer system, method for operating a computing device and system for operating a computing device |
CN111310482A (en) * | 2020-01-20 | 2020-06-19 | 北京无限光场科技有限公司 | Real-time translation method, device, terminal and storage medium |
CN112596656A (en) * | 2020-12-28 | 2021-04-02 | 北京小米移动软件有限公司 | Content identification method, device and storage medium |
CN115033658A (en) * | 2021-02-24 | 2022-09-09 | 北京小米移动软件有限公司 | Information searching method, device, equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
WO2019233318A1 (en) | 2019-12-12 |
CN108958576B (en) | 2021-02-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108958576A (en) | content identification method, device and mobile terminal | |
CN109085982A (en) | content identification method, device and mobile terminal | |
WO2019233212A1 (en) | Text identification method and device, mobile terminal, and storage medium | |
CN108664190B (en) | Page display method, device, mobile terminal and storage medium | |
CN108415652B (en) | Text processing method and mobile terminal | |
CN109101498B (en) | Translation method and device and mobile terminal | |
CN108156508B (en) | Barrage information processing method and device, mobile terminal, server and system | |
WO2015135381A1 (en) | Device, system, and method for creating virtual credit card field of the technology | |
CN108932102B (en) | Data processing method and device and mobile terminal | |
CN106875181A (en) | A kind of barcode scanning payment processing method and mobile terminal | |
CN108664475A (en) | Translate display methods, device, mobile terminal and storage medium | |
CN109165292A (en) | Data processing method, device and mobile terminal | |
CN107766548B (en) | Information display method and device, mobile terminal and readable storage medium | |
CN109032491B (en) | Data processing method and device and mobile terminal | |
CN108958634A (en) | Express delivery information acquisition method, device, mobile terminal and storage medium | |
CN106375179A (en) | Method and device for displaying instant communication message | |
CN111597542A (en) | Verification information sharing method and device, electronic equipment and storage medium | |
US20150153921A1 (en) | Apparatuses and methods for inputting a uniform resource locator | |
CN108763193A (en) | Literal processing method, device, mobile terminal and storage medium | |
CN108763297A (en) | Web page resources processing method, device and mobile terminal | |
CN108664205A (en) | Method for information display, device, mobile terminal and storage medium | |
CN108803961B (en) | Data processing method and device and mobile terminal | |
CN108803972B (en) | Information display method, device, mobile terminal and storage medium | |
WO2019228370A1 (en) | Data processing method and device, mobile terminal and storage medium | |
CN108958621A (en) | information display method, device and mobile terminal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |