CN107944954A - Information processing method and its device - Google Patents
Information processing method and its device Download PDFInfo
- Publication number
- CN107944954A CN107944954A CN201711134979.1A CN201711134979A CN107944954A CN 107944954 A CN107944954 A CN 107944954A CN 201711134979 A CN201711134979 A CN 201711134979A CN 107944954 A CN107944954 A CN 107944954A
- Authority
- CN
- China
- Prior art keywords
- specified
- identified
- application program
- preview screen
- operational order
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0631—Item recommendations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
Abstract
Present disclose provides a kind of information processing method, including：Obtain the preview screen for including at least one object to be identified；At least one object to be identified included in preview screen is identified, to identify at least one object；Externally input operational order is obtained, wherein, operational order is used to indicate to perform the specified object at least one object for identifying to specify operation；And in response to operational order, to specify operation to specifying object to perform.The disclosure additionally provides a kind of information processor.
Description
Technical field
This disclosure relates to a kind of information processing method and its device.
Background technology
The camera device of electronic equipment can also be clapped in addition to it can identify object by scanning the two-dimensional code against article
According to, and then specific operation is performed to the reference object in photo, such as on certain shopping website, take pictures against some kinds of goods
Afterwards, can be searched on the web site based on captured photo and the same or similar kinds of goods of the kinds of goods.
During the embodiment of the present disclosure is realized, inventor has found that at least there are the following problems in correlation technique：Control
When object in piece performs specific operation, one can only be once identified, and usually require object to be identified and occupy entirely
The larger proportion of picture could be realized, when object to be identified in picture is more, it is impossible to selective to object to be identified
Specific operation is performed, causes user experience bad.
For the above problem in correlation technique, effective solution is not proposed also at present.
The content of the invention
In view of this, present disclose provides a kind of information processing method and its device.
An aspect of this disclosure provides a kind of information processing method, including：Acquisition includes at least one to be identified
The preview screen of object；Above-mentioned at least one object to be identified included in above-mentioned preview screen is identified, with identification
Go out at least one object；Externally input operational order is obtained, wherein, aforesaid operations instruction is used to indicate above-mentioned to what is identified
Specified object at least one object, which performs, specifies operation；And instructed in response to aforesaid operations, with to above-mentioned specified object
Perform above-mentioned specified operation.
Alternatively, above-mentioned at least one object to be identified included in above-mentioned preview screen is identified, with identification
Going out at least one object includes：Load Object identifying model；Be included in above-mentioned preview screen above-mentioned is obtained at least one to treat
Identify the characteristic parameter of object, wherein, features described above parameter is used for the attributive character for describing above-mentioned at least one object to be identified；
Features described above parameter is inputted into above-mentioned Object identifying model, so that above-mentioned Object identifying model is exported in response to features described above parameter
Corresponding recognition result；And above-mentioned at least one object is determined based on above-mentioned recognition result.
Alternatively, aforesaid operations instruction includes voice signal, is instructed in response to aforesaid operations, to be held to above-mentioned specified object
The above-mentioned specified operation of row includes：Natural language processing is carried out to above-mentioned voice signal, to obtain corresponding semantic information；Determine with
The upper associated specified operation of semantic information；And above-mentioned specified operation is performed to above-mentioned specified object.
Alternatively, above-mentioned specified operation is performed to above-mentioned specified object includes：The first application program is determined whether there is, its
In, above-mentioned first application program is the targeted application program of the above-mentioned specified operation of execution set in advance；And if there are upper
The first application program is stated, then above-mentioned specified operation is performed to above-mentioned specified object in above-mentioned first application program.
Alternatively, the above method further includes：If above-mentioned first application program is not present, it is determined that be able to carry out above-mentioned specify
The other applications of operation；And above-mentioned specified operation is performed to above-mentioned specified object in above-mentioned other applications.
Another aspect of the disclosure provides a kind of information processor, including：First acquisition module, is wrapped for obtaining
Preview screen module containing at least one object to be identified, the preview that at least one object to be identified is included for obtaining are drawn
Face；Identification module, for above-mentioned at least one object to be identified included in above-mentioned preview screen to be identified, with identification
Go out at least one object；Second acquisition module, for obtaining externally input operational order, wherein, aforesaid operations instruction is used for
Indicate to perform the specified object in above-mentioned at least one object for identifying and specify operation；And execution module, for responding
Instructed in aforesaid operations, to perform above-mentioned specified operation to above-mentioned specified object.
Alternatively, above-mentioned identification module includes：Loading unit, for loading Object identifying model；Acquiring unit, for obtaining
The characteristic parameter of above-mentioned at least one object to be identified included in above-mentioned preview screen is taken, wherein, features described above parameter is used
In the attributive character for describing above-mentioned at least one object to be identified；Input unit, it is above-mentioned right for features described above parameter to be inputted
As identification model, so that above-mentioned Object identifying model exports corresponding recognition result in response to features described above parameter；And first
Determination unit, for determining above-mentioned at least one object based on above-mentioned recognition result.
Alternatively, above-mentioned execution module includes：Processing unit, for carrying out natural language processing to above-mentioned voice signal,
To obtain corresponding semantic information；Second determination unit, for determining and the associated specified operation of upper semantic information；And hold
Row unit, for performing above-mentioned specified operation to above-mentioned specified object.
Alternatively, above-mentioned execution unit includes：First determination subelement, is used to determine whether there are the first application program,
Wherein, above-mentioned first application program is the targeted application program of the above-mentioned specified operation of execution set in advance；And first hold
Row subelement, in the case of there are above-mentioned first application program, is specified pair in above-mentioned first application program to above-mentioned
As performing above-mentioned specified operation.
Alternatively, above-mentioned execution unit further includes：Second determination subelement, for there is no above-mentioned first application program
In the case of, it is determined to perform the other applications of above-mentioned specified operation；And second perform subelement, for above-mentioned
Above-mentioned specified operation is performed to above-mentioned specified object in other applications.
Brief description of the drawings
In order to be more fully understood from the disclosure and its advantage, referring now to being described below with reference to attached drawing, wherein：
Fig. 1 diagrammatically illustrates the application scenarios of the information processing method and its device according to the embodiment of the present disclosure；
Fig. 2 diagrammatically illustrates the flow chart of the information processing method according to the embodiment of the present disclosure；
Fig. 3 A are diagrammatically illustrated according to the embodiment of the present disclosure at least one to be identified included in preview screen
Object is identified, to identify the flow chart of at least one object；
Fig. 3 B are diagrammatically illustrated according to the embodiment of the present disclosure in response to operational order, to be specified to specifying object to perform
The flow chart of operation；
Fig. 3 C diagrammatically illustrate the flow chart that operation is specified to specifying object to perform according to the embodiment of the present disclosure；
Fig. 3 D diagrammatically illustrate the flow chart that operation is specified to specifying object to perform according to another embodiment of the disclosure；
Fig. 4 diagrammatically illustrates the block diagram of the information processor according to the embodiment of the present disclosure；
Fig. 5 A diagrammatically illustrate the block diagram of the identification module according to the embodiment of the present disclosure；
Fig. 5 B diagrammatically illustrate the block diagram of the execution module according to the embodiment of the present disclosure；
Fig. 5 C diagrammatically illustrate the block diagram of the execution unit according to the embodiment of the present disclosure；
Fig. 5 D diagrammatically illustrate the block diagram of the execution unit according to another embodiment of the disclosure；And
Fig. 6 diagrammatically illustrates the frame of the computer system of the achievable information processing method using the embodiment of the present disclosure
Figure.
Embodiment
Hereinafter, it will be described with reference to the accompanying drawings embodiment of the disclosure.However, it should be understood that these descriptions are simply exemplary
, and it is not intended to limit the scope of the present disclosure.In addition, in the following description, the description to known features and technology is eliminated, with
Avoid unnecessarily obscuring the concept of the disclosure.
Term as used herein is not intended to limit the disclosure just for the sake of description specific embodiment.Use herein
Term " comprising ", "comprising" etc. indicate the presence of feature, step, operation and/or component, but it is not excluded that in the presence of or add
Add one or more other features, step, operation or components.
All terms (including technical and scientific term) as used herein have what those skilled in the art were generally understood
Implication, unless otherwise defined.It should be noted that term used herein should be interpreted that with consistent with the context of this specification
Implication, without should by idealization or it is excessively mechanical in a manner of explain.
, in general should be according to this in the case of using " in A, B and C etc. at least one " such statement is similar to
Field technology personnel are generally understood that the implication of the statement to make an explanation (for example, " having device at least one in A, B and C "
Should include but not limited to individually with A, individually with B, individually with C, with A and B, with A and C, with B and C, and/or
Device with A, B, C etc.).In the case of using " in A, B or C etc. at least one " such statement is similar to, it is general come
Say be generally understood that the implication of the statement to make an explanation (for example, " having in A, B or C at least according to those skilled in the art
The device of one " should include but not limited to individually with A, individually with B, individually with C, with A and B, with A and C, with
B and C, and/or device etc. with A, B, C).It should also be understood by those skilled in the art that substantially arbitrarily represent two or more
The adversative conjunction and/or phrase of optional project, either in specification, claims or attached drawing, shall be construed as
Give including one of these projects, the possibility of these projects either one or two projects.For example, " A or B " should for phrase
It is understood to include " A " or " B " or " possibility of A and B ".
Shown in the drawings of some block diagrams and/or flow chart.It is to be understood that some sides in block diagram and/or flow chart
Frame or its combination can be realized by computer program instructions.These computer program instructions can be supplied to all-purpose computer,
The processor of special purpose computer or other programmable data processing units, so that these instructions can be with when being performed by the processor
Create the device for being used for realization these block diagrams and/or function/operation illustrated in flow chart.
Therefore, the technology of the disclosure can be realized in the form of hardware and/or software (including firmware, microcode etc.).Separately
Outside, the technology of the disclosure can take the form of the computer program product on the computer-readable medium for being stored with instruction, should
Computer program product uses for instruction execution system or combined command execution system uses.In the context of the disclosure
In, computer-readable medium can be the arbitrary medium that can include, store, transmit, propagate or transmit instruction.For example, calculate
Machine computer-readable recording medium can include but is not limited to electricity, magnetic, optical, electromagnetic, infrared or semiconductor system, device, device or propagation medium.
The specific example of computer-readable medium includes：Magnetic memory apparatus, such as tape or hard disk (HDD)；Light storage device, such as CD
(CD-ROM)；Memory, such as random access memory (RAM) or flash memory；And/or wire/wireless communication link.
Present disclose provides a kind of information processing method, including：Obtain the preview for including at least one object to be identified
Picture, is identified at least one object to be identified included in preview screen, to identify at least one object, obtains
Externally input operational order, wherein, operational order is used to indicate to hold the specified object at least one object for identifying
Row specifies operation and in response to operational order, to specify operation to specifying object to perform.
Fig. 1 diagrammatically illustrates the application scenarios of the information processing method and its device according to the embodiment of the present disclosure.
The information processing method provided in accordance with an embodiment of the present disclosure can realize the camera device knowledge using electronic equipment
Do not go out object, and then the object to identifying performs the scene of specific operation.
As shown in Figure 1, in this scenario, there are a people being sitting on station, the computer of his at one's side, cup and certain businessman
The object such as reward voucher, these all or part of objects can be object to be identified.When taking the photograph using electronic equipment such as mobile phone
During as device such as camera against above-mentioned scene, the camera of camera can capture a preview screen, can be with the preview screen
Include all or part of object in above-mentioned scene, i.e., the position by adjusting camera camera, which can easily obtain, includes
There is the preview screen of at least one object to be identified.
The information processing method provided by embodiment of the disclosure easily just can search for him on certain shopping website
The shirt worn, with money cup, or finds favor information of certain businessman etc. in group buying websites.
It should be noted that the application scenarios of the present embodiment are only schematical, it can not limit or reduce the disclosure
Scope.Detailed expansion will be carried out to the information processing method that the disclosure provides by taking this scene as an example below.
Fig. 2 diagrammatically illustrates the flow chart of the information processing method according to the embodiment of the present disclosure.
As shown in Fig. 2, the information processing method can include operation S210~S240, wherein：
In operation S210, the preview screen for including at least one object to be identified is obtained.
Operation S220, at least one object to be identified included in preview screen is identified, with identify to
A few object.
In operation S230, externally input operational order is obtained, wherein, operational order is used to indicate to identifying at least
Specified object in one object, which performs, specifies operation.
In operation S240, in response to operational order, operation is specified to be performed to specified object.
When the camera device such as camera using electronic equipment such as mobile phone is against above-mentioned scene, the camera of camera can be caught
To a preview screen, at least one object to be identified is included in the preview screen, i.e. object to be identified can be above-mentioned scene
In an object or multiple objects, the number of object to be identified do not limit herein.Further, preview screen
In the number of object to be identified can be adjusted accordingly according to actual needs, such as can be by adjusting the camera device of electronic equipment
Position, specifically method of adjustment do not limit herein.Likewise, position of the object to be identified in preview screen is not also done
Limit, i.e., and be not required object to be identified to occupy the larger proportion of whole picture.It should be noted that except to above-mentioned scene
Obtain outside preview screen, can also take pictures to above-mentioned scene.
After above-mentioned preview screen is obtained, the object to be identified included in preview screen is identified, Ke Yishi
Do not go out an object, may recognize that multiple objects, and will identify that one or/or multiple objects are in preview screen subscript
Knowledge comes out, and cup, computer, the reward voucher of certain businessman that can such as will identify that add square frame displaying in preview screen, with side
Just check recognition result and the specified operation to be performed in next step is determined according to the object identified.It should be noted that mark
The concrete mode and marking effect of object, do not limit herein.
After the preview screen with tagged object is obtained, externally input operational order can also be utilized to identification
Different objects out perform different specified operations.Externally input operational order can be voice signal, can also be tactile
Operation is touched, is not limited herein.Specified operation can be that search with money and/or similar money kinds of goods, also may be used on certain shopping website
To be the reward voucher for searching for the businessman, it can also be and scan certain Quick Response Code to obtain the corresponding inventory information of the Quick Response Code herein not
Limit.
The description that a preview screen described above only for a moment is unfolded, it is to be understood that to acquisition
Include the preview screen of at least one object to be identified, this programme can be waited to know at least one in preview screen in real time
Other object is identified, to identify at least one object.
By embodiment of the disclosure, due to being carried out using at least one object to be identified included in preview screen
Identification, to identify at least one object, identifies multiple objects in frame out, and according to operational order, to specifying object to hold
Row specify operation technical solution, at least partly overcome in correlation technique, Object identifying scene is single, and can only identify one it is right
As and usually require object to be identified and occupy the technical problem that the larger proportion of whole picture could realize, reach when in picture
Object to be identified can recognize that multiple objects and identify when more, selective to perform specific operation to object to be identified,
Improve user experience and realize the experience effect of customer-centric.
Below with reference to Fig. 3 A~Fig. 3 D, the method shown in Fig. 2 is described further in conjunction with specific embodiments.
Fig. 3 A are diagrammatically illustrated according to the embodiment of the present disclosure at least one to be identified included in preview screen
Object is identified, to identify the flow chart of at least one object.
In this embodiment, the information processing method is except that can include retouching above with reference in the embodiment corresponding to Fig. 2
Outside the operation S210~S240 stated, operation S311~S314 can also be included.Wherein, the operation S220 of Fig. 2 descriptions is (i.e. to bag
At least one object to be identified being contained in preview screen is identified, to identify at least one object) operation can be included
S311~S314.As shown in Figure 3A, wherein：
In operation S311, Object identifying model is loaded.
In operation S312, acquisition is included in the characteristic parameter of at least one object to be identified in preview screen, wherein, it is special
Sign parameter is used for the attributive character for describing at least one object to be identified.
S313 is being operated, by characteristic parameter input object identification model, so that Object identifying model is in response to characteristic parameter
Export corresponding recognition result.
In operation S314, at least one object is determined based on recognition result.
It should be noted that Object identifying model is that training is obtained and is stored in advance using special object training sample
Local or server, when use, is loaded directly into.When Object identifying model has renewal, just need again from server
The Object identifying model after renewal is downloaded to locally.In the embodiments of the present disclosure, the basis of characterization of Object identifying model can wrap
Include but be not limited to：Marginal information of object etc..The characteristic parameter of one or more objects is obtained, can be by characteristic parameter input pair
As identification model, so that Object identifying model exports corresponding recognition result in response to characteristic parameter, to there is pair of recognition result
As being identified in preview screen, characteristic parameter is used to describing the attributive character of object to be identified, different objects often table
Reveal different attribute characteristics, therefore object to be identified can be identified according to the property parameters of acquisition.
By embodiment of the disclosure, the characteristic parameter of the object to be identified of acquisition is inputted into trained identification model
In, the recognition result of one or more objects is obtained, is at least partly overcome in correlation technique, Object identifying scene is single, and only
It can identify an object and usually require object to be identified and occupy the technical problem that the larger proportion of whole picture could be realized.
Fig. 3 B are diagrammatically illustrated according to the embodiment of the present disclosure in response to operational order, to be specified to specifying object to perform
The flow chart of operation.
In this embodiment, the information processing method is except that can include retouching above with reference in the embodiment corresponding to Fig. 2
Outside the operation S210~S240 stated, operation S321~S323 can also be included.Wherein, the operation S240 of Fig. 2 descriptions (is responded
In operational order, to specify operation to specifying object to perform) operation S321~S323 can be included.As shown in Figure 3B, wherein：
In operation S321, natural language processing is carried out to voice signal, to obtain corresponding semantic information.
In operation S322, determine and the associated specified operation of semantic information.
In operation S323, operation is specified to specifying object to perform.
As described above, externally input operational order, can be voice signal, can also be touch operation, in this pin
Operational order is illustrated for the situation of voice signal, details are not described herein for the operational order of other forms.Voice signal
Input mode does not also limit, and can obtain the voice signal by the Mike of electronic equipment, can also pass through electronic equipment
Other voice acquisition device obtain the voice signal.
For electronic equipment, its voice signal pre-defined can be generally identified, and input electronic equipment
Voice signal is multifarious, sometimes not necessarily and the voice that pre-defines is inconsistent.It is therefore possible to use to voice signal into
Row natural language processing, to obtain the method for corresponding semantic information, determines and the associated specified operation of semantic information so that electricity
Sub- equipment can identify that what is received specifies the voice signal of operation to specifying object to perform.Specified object can identify
Any object, such as can be the jacket, certain coupons and Quick Response Code identified, here, to specifying object not do specifically
Limit.
, can be by the voice signal of mobile phone Mike input " searching for this part jacket ", to the language such as to the jacket identified
Sound signal carry out natural language processing, obtain corresponding semantic information, such as " search jacket ", it may be determined that go out to the jacket this
It is " search " to specify the specified operation that object performs, according to the correlation of the part jacket obtained from the preview screen of this part jacket
Information, such as pictorial information and/or the property parameters of this part jacket, you can with searched on certain shopping website it is all or part of and this
The kinds of goods that part jacket is consistent.
Such as to certain coupons identified, can be inputted " reward voucher for searching for this retail shop " by mobile phone Mike
Voice signal, carries out natural language processing to the voice signal, obtains semantic information, such as " search reward voucher ", it may be determined that go out
To the retail shop, this specified operation for specifying object to perform is " search reward voucher ", is obtained according to from the preview screen of the retail shop
The retail shop relevant information, such as pictorial information and/or the property parameters of the retail shop, you can with certain shopping or/group buying websites
It is upper to search all or part of and relevant coupon information of the retail shop.
Such as to the Quick Response Code identified, the voice signal of " scanning this Quick Response Code " can be inputted by mobile phone Mike, it is right
The voice signal carry out natural language processing, obtain semantic information, such as " search Quick Response Code ", it may be determined that go out to Quick Response Code this
It is " scanning " to specify the specified operation that object performs, according to the correlation of the Quick Response Code obtained from the preview screen of the Quick Response Code
Information, such as pictorial information and/or the property parameters of the Quick Response Code, you can, such as can be with to identify the corresponding information of the Quick Response Code
It is addition good friend, payment etc., does not limit herein.
It should be noted that it is only schematical to the illustration for specifying object above, it can not limit or reduce
The scope of the present disclosure, other kinds of specified object, which performs, specifies the concrete mode of operation can be according to the specific embodiment of the disclosure
Spirit do appropriate expansion.
By embodiment of the disclosure, in the case that operational order is voice signal, natural-sounding is carried out to voice signal
Processing obtains semantic information, execution and the associated specified operation of semantic information, improves user experience, and further increase operation
The adaptability of instruction.
Fig. 3 C diagrammatically illustrate the flow chart that operation is specified to specifying object to perform according to the embodiment of the present disclosure.
In this embodiment, the information processing method is except that can include retouching above with reference in the embodiment corresponding to Fig. 3 B
Outside the operation S321~S323 stated, operation S331~S332 can also be included.Wherein, the operation S323 of Fig. 3 B descriptions is (i.e. pair
Specify object to perform and specify operation) operation S331~S332 can be included.As shown in Figure 3 C, wherein：
In operation S331, it is determined whether there are the first application program, wherein, the first application program is execution set in advance
Specify the targeted application program of operation.
In operation S332, if there are the first application program, behaviour is specified to specifying object to perform in the first application program
Make.
It should be noted that specifying operation to specifying object to perform, such as to the jacket that identifies, this specifies object execution
Specified operation be " search ", it may be determined whether it is set in advance to perform the search and specify the application program of operation, such as
The application program of certain shopping website, if performing " search " in the application program in the presence of if, this specifies operation, enabling base
All or part of kinds of goods being consistent with this part jacket are searched in search in the kinds of goods that the application program provides.Perform and specify operation
The method that presets of application program does not limit herein.
By embodiment of the disclosure, if there are the first application program set in advance for performing and specifying and operating, at this
Operation is specified to specifying object to perform in program, at least partly overcomes the technical problem that application scenarios are single in correlation technique,
Reach the technique effect of expanded application scene.
Fig. 3 D diagrammatically illustrate the flow chart that operation is specified to specifying object to perform according to another embodiment of the disclosure.
In this embodiment, the information processing method is except that can include retouching above with reference in the embodiment corresponding to Fig. 3 C
Outside the operation S331~S332 stated, operation S341~S342 can also be included.As shown in Figure 3D, wherein：
S341 is being operated, if the first application program is not present, it is determined that be able to carry out specifying the other applications of operation.
In operation S342, operation is specified to specifying object to perform in other applications.
It should be noted that if there is no the application journey that " search " this specified operation is then performed in the application program
Sequence, can be by being determined to perform the other applications for specifying operation, enabling based on it in order to reach search purpose
All or part of kinds of goods being consistent with this part jacket are searched in search in the associated article that his application program provides.
By embodiment of the disclosure, if performing specified the first application program operated there is no set in advance, really
Surely it is able to carry out specifying the other applications of operation, and is performed in other applications and specify operation, at least partly overcomes
The single technical problem of application scenarios in correlation technique, reaches the technique effect of expanded application scene.
Another aspect of the disclosure provides information processor.
Fig. 4 diagrammatically illustrates the block diagram of the information processor according to the embodiment of the present disclosure.
In this embodiment, which can include the first acquisition module 410, identification module 420, the
Two acquisition modules 430 and execution module 440.The information processor can perform the information processing side that above-mentioned reference chart 2 describes
Method.As shown in figure 4, wherein：
First acquisition module 410 is used to obtain the preview screen for including at least one object to be identified.
Identification module 420 is used at least one object to be identified included in preview screen be identified, with identification
Go out at least one object.
Second acquisition module 430 is used to obtain externally input operational order, wherein, operational order is used to indicate to identification
Specified object at least one object gone out, which performs, specifies operation.
Execution module 440 is used in response to operational order, to specify operation to specifying object to perform.
It is understood that the first acquisition module 410, identification module 420, the second acquisition module 430 and execution module 440
It may be incorporated in a module and realize, or any one module therein can be split into multiple modules.Alternatively, these
At least part function of one or more of module module can be combined with least part function of other modules, and one
Realized in a module.According to an embodiment of the invention, the first acquisition module 410, identification module 420,430 and of the second acquisition module
At least one in execution module 440 can at least be implemented partly as hardware circuit, such as field programmable gate array
(FPGA), programmable logic array (PLA), system-on-chip, the system on substrate, the system in encapsulation, application-specific integrated circuit
(ASIC), or can be realized with carrying out the hardware such as any other rational method that is integrated or encapsulating or firmware to circuit, or
Realized with software, the appropriately combined of hardware and firmware three kinds of implementations.Alternatively, the first acquisition module 410, identification module
420th, at least one in the second acquisition module 430 and execution module 440 can at least be implemented partly as computer program
Module, when the program is run by computer, can perform the function of corresponding module.
By embodiment of the disclosure, due to being carried out using at least one object to be identified included in preview screen
Identification, to identify at least one object, identifies multiple objects in frame out, and according to operational order, to specifying object to hold
Row specify operation technical solution, at least partly overcome in correlation technique, Object identifying scene is single, and can only identify one it is right
As and usually require object to be identified and occupy the technical problem that the larger proportion of whole picture could realize, reach when in picture
Object to be identified can recognize that multiple objects and identify when more, selective to perform specific operation to object to be identified,
Improve user experience and realize the experience effect of customer-centric.
Below with reference to Fig. 5 A~Fig. 5 D, the device shown in Fig. 4 is described further in conjunction with specific embodiments.
Fig. 5 A diagrammatically illustrate the block diagram of the identification module according to the embodiment of the present disclosure.
In this embodiment, the information processor 400 is except that can include above with reference in the embodiment corresponding to Fig. 4
Outside the first acquisition module 410, identification module 420, the second acquisition module 430 and the execution module 440 that describe, identification module
420 can also include loading unit 511, acquiring unit 512,513 and first determination unit 514 of input unit.For description
For purpose of brevity, the description to respective modules in Fig. 4 is omitted here.As shown in Figure 5A, wherein：Loading unit 511 is used for loading pair
As identification model.Acquiring unit 512 is used for the characteristic parameter for obtaining at least one object to be identified being included in preview screen,
Wherein, characteristic parameter is used for the attributive character for describing at least one object to be identified.Input unit 513 is used for characteristic parameter is defeated
Enter Object identifying model, so that Object identifying model exports corresponding recognition result in response to characteristic parameter.First determination unit
514 are used to determine at least one object based on recognition result.
By embodiment of the disclosure, the characteristic parameter of the object to be identified of acquisition is inputted into trained identification model
In, the recognition result of one or more objects is obtained, is at least partly overcome in correlation technique, Object identifying scene is single, and only
It can identify an object and usually require object to be identified and occupy the technical problem that the larger proportion of whole picture could be realized.
Fig. 5 B diagrammatically illustrate the block diagram of the execution module according to the embodiment of the present disclosure.
In this embodiment, the information processor 400 is except that can include above with reference in the embodiment corresponding to Fig. 4
Outside the first acquisition module 410, identification module 420, the second acquisition module 430 and the execution module 440 that describe, execution module
440 can also include processing unit 521, the second determination unit 522 and execution unit 523.For description for purpose of brevity, here
Omit the description to respective modules in Fig. 4.As shown in Figure 5 B, wherein：Processing unit 521 is used to carry out nature language to voice signal
Speech processing, to obtain corresponding semantic information.Second determination unit 522 is used to determine and the associated specified operation of semantic information.
Execution unit 523 is used to specify operation to specifying object to perform.
By embodiment of the disclosure, in the case that operational order is voice signal, natural-sounding is carried out to voice signal
Processing obtains semantic information, execution and the associated specified operation of semantic information, improves user experience, and further increase operation
The adaptability of instruction.
Fig. 5 C diagrammatically illustrate the block diagram of the execution unit according to the embodiment of the present disclosure.
In this embodiment, the information processor 400 is except the embodiment corresponding to can including above with reference to Fig. 5 B
Described in processing unit 521, outside the second determination unit 522 and execution unit 523, execution unit 523 can also include the
One determination subelement 531 and first performs subelement 532.For description for purpose of brevity, omit here to corresponding to mould in Fig. 5 B
The description of block.As shown in Figure 5 C, wherein：First determination subelement 531 is used to determine whether there are the first application program, wherein,
First application program is the application program set in advance for performing and specifying operation targeted.First, which performs subelement 532, is used for
In the case of there are the first application program, operation is specified to specifying object to perform in the first application program.
By embodiment of the disclosure, if there are the first application program set in advance for performing and specifying and operating, at this
Operation is specified to specifying object to perform in program, at least partly overcomes the technical problem that application scenarios are single in correlation technique,
Reach the technique effect of expanded application scene.
Fig. 5 D diagrammatically illustrate the block diagram of the execution unit according to another embodiment of the disclosure.
In this embodiment, the information processor 400 is except the embodiment corresponding to can including above with reference to Fig. 5 C
Described in processing unit 521, outside the second determination unit 522 and execution unit 523, execution unit 523 can also include the
Two determination subelements 541 and second perform subelement 542.For description for purpose of brevity, omit here to corresponding to mould in Fig. 5 C
The description of block.As shown in Figure 5 D, wherein：Second determination subelement 541 is used in the case of there is no the first application program, really
Surely it is able to carry out specifying the other applications of operation.Second, which performs subelement 542, is used in other applications to specifying
Object, which performs, specifies operation.
By embodiment of the disclosure, if performing specified the first application program operated there is no set in advance, really
Surely it is able to carry out specifying the other applications of operation, and is performed in other applications and specify operation, at least partly overcomes
The single technical problem of application scenarios in correlation technique, reaches the technique effect of expanded application scene.
Fig. 6 diagrammatically illustrates the frame of the computer system for being adapted for carrying out information processing method according to the embodiment of the present disclosure
Figure.Computer system shown in Fig. 6 is only an example, the function and use scope of the embodiment of the present disclosure should not be brought and appointed
What is limited.The computer system 600 can be used for performing the method with reference to figure 2, Fig. 3 A~Fig. 3 D information processing described.
Specifically, processor 610 can for example include general purpose microprocessor, instruction set processor and/or related chip group
And/or special microprocessor (for example, application-specific integrated circuit (ASIC)), etc..Processor 610 can also include being used to cache using
The onboard storage device on way.Processor 610 can be performed for according to the disclosure being implemented with reference to what figure 2, Fig. 3 A~Fig. 3 D were described
Single treatment unit either multiple processing units of the different actions of the method flow of example.
Readable storage medium storing program for executing 620, such as can be any Jie that can include, store, transmit, propagate or transmit instruction
Matter.For example, readable storage medium storing program for executing can include but is not limited to electricity, magnetic, optical, electromagnetic, infrared or semiconductor system, device, device
Or propagation medium.The specific example of readable storage medium storing program for executing includes：Magnetic memory apparatus, such as tape or hard disk (HDD)；Optical storage fills
Put, such as CD (CD-ROM)；Memory, such as random access memory (RAM) or flash memory；And/or wire/wireless communication link.
Readable storage medium storing program for executing 620 can include computer program 621, which can include code/calculating
Machine executable instruction, its when being performed by processor 610 so that processor 610 perform for example above in conjunction with reference to figure 2, Fig. 3 A~
The described method flows of Fig. 3 D and its any deformation.
Computer program 621 can be configured with such as computer program code including computer program module.Example
Such as, in the exemplary embodiment, the code in computer program 621 can include one or more program modules, such as including
621A, module 621B ....It should be noted that the dividing mode and number of module are not fixed, those skilled in the art can
To be combined according to actual conditions using suitable program module or program module, when these program modules are combined by processor 610
During execution so that processor 610 can perform for example above in conjunction with reference to figure 2, the described method flows of Fig. 3 A~Fig. 3 D and
Its any deformation.
It will be understood by those skilled in the art that the feature described in each embodiment and/or claim of the disclosure can
To carry out multiple combinations or/or combination, even if such combination or combination are not expressly recited in the disclosure.Especially, exist
In the case of not departing from disclosure spirit or teaching, the feature described in each embodiment and/or claim of the disclosure can
To carry out multiple combinations and/or combination.All these combinations and/or combination each fall within the scope of the present disclosure.
Although the disclosure, art technology has shown and described in the certain exemplary embodiments with reference to the disclosure
Personnel it should be understood that in the case of the spirit and scope of the present disclosure limited without departing substantially from the following claims and their equivalents,
A variety of changes in form and details can be carried out to the disclosure.Therefore, the scope of the present disclosure should not necessarily be limited by above-described embodiment,
But should be not only determined by appended claims, also it is defined by the equivalent of appended claims.
Claims (10)
1. a kind of information processing method, including：
Obtain the preview screen for including at least one object to be identified；
At least one object to be identified included in the preview screen is identified, it is at least one right to identify
As；
Externally input operational order is obtained, wherein, it is described at least one right to what is identified that the operational order is used to indicate
Specified object as in, which performs, specifies operation；And
In response to the operational order, to perform the specified operation to the specified object.
2. according to the method described in claim 1, wherein, to described at least one to be identified included in the preview screen
Object is identified, to identify that at least one object includes：
Load Object identifying model；
The characteristic parameter at least one object to be identified being included in the preview screen is obtained, wherein, the feature
Parameter is used for the attributive character for describing at least one object to be identified；
The characteristic parameter is inputted into the Object identifying model, so that the Object identifying model is in response to the characteristic parameter
Export corresponding recognition result；And
At least one object is determined based on the recognition result.
3. according to the method described in claim 1, wherein, the operational order includes voice signal, refer in response to the operation
Order, is included with performing the specified operation to the specified object：
Natural language processing is carried out to the voice signal, to obtain corresponding semantic information；
Determine and the associated specified operation of institute's semantic information；And
The specified operation is performed to the specified object.
4. according to the method described in claim 3, wherein, the specified operation is performed to the specified object to be included：
The first application program is determined whether there is, wherein, first application program is the execution specified behaviour set in advance
Make targeted application program；And
If there are first application program, the specified behaviour is performed to the specified object in first application program
Make.
5. according to the method described in claim 4, wherein, the method further includes：
If first application program is not present, it is determined that be able to carry out the other applications of the specified operation；And
The specified operation is performed to the specified object in the other applications.
6. a kind of information processor, including：
First acquisition module, the preview screen of at least one object to be identified is included for obtaining；
Identification module, at least one object to be identified included in the preview screen to be identified, to know
Do not go out at least one object；
Second acquisition module, for obtaining externally input operational order, wherein, the operational order is used to indicate to identifying
At least one object in specified object perform specify operation；And
Execution module, in response to the operational order, to perform the specified operation to the specified object.
7. device according to claim 6, wherein, the identification module includes：
Loading unit, for loading Object identifying model；
Acquiring unit, for obtaining the characteristic parameter at least one object to be identified being included in the preview screen,
Wherein, the characteristic parameter is used for the attributive character for describing at least one object to be identified；
Input unit, for the characteristic parameter to be inputted the Object identifying model, so that the Object identifying model responds
Corresponding recognition result is exported in the characteristic parameter；And
First determination unit, for determining at least one object based on the recognition result.
8. device according to claim 6, wherein, the execution module includes：
Processing unit, for carrying out natural language processing to the voice signal, to obtain corresponding semantic information；
Second determination unit, for determining and the associated specified operation of institute's semantic information；And
Execution unit, for performing the specified operation to the specified object.
9. device according to claim 8, wherein, the execution unit includes：
First determination subelement, is used to determine whether there are the first application program, wherein, first application program is to set in advance
The targeted application program of the fixed execution specified operation；And
First performs subelement, right in first application program in the case of there are first application program
The specified object performs the specified operation.
10. device according to claim 9, wherein, the execution unit further includes：
Second determination subelement, in the case of there is no first application program, being determined to perform described specify
The other applications of operation；And
Second performs subelement, for performing the specified operation to the specified object in the other applications.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711134979.1A CN107944954A (en) | 2017-11-15 | 2017-11-15 | Information processing method and its device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711134979.1A CN107944954A (en) | 2017-11-15 | 2017-11-15 | Information processing method and its device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107944954A true CN107944954A (en) | 2018-04-20 |
Family
ID=61931337
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711134979.1A Pending CN107944954A (en) | 2017-11-15 | 2017-11-15 | Information processing method and its device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107944954A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111144306A (en) * | 2019-12-27 | 2020-05-12 | 联想(北京)有限公司 | Information processing method, information processing apparatus, and information processing system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103915095A (en) * | 2013-01-06 | 2014-07-09 | 华为技术有限公司 | Method, interaction device, server and system for voice recognition |
| CN104881451A (en) * | 2015-05-18 | 2015-09-02 | 百度在线网络技术（北京）有限公司 | Image searching method and image searching device |
| CN105593847A (en) * | 2013-06-05 | 2016-05-18 | 弗瑞莎伯公司 | Methods and devices for smart shopping |
| CN106162355A (en) * | 2015-04-10 | 2016-11-23 | 北京云创视界科技有限公司 | video interactive method and terminal |
| CN106412229A (en) * | 2015-07-28 | 2017-02-15 | 阿里巴巴集团控股有限公司 | Interaction method and device for mobile terminal, and the mobile terminal |
-
2017
- 2017-11-15 CN CN201711134979.1A patent/CN107944954A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103915095A (en) * | 2013-01-06 | 2014-07-09 | 华为技术有限公司 | Method, interaction device, server and system for voice recognition |
| CN105593847A (en) * | 2013-06-05 | 2016-05-18 | 弗瑞莎伯公司 | Methods and devices for smart shopping |
| CN106162355A (en) * | 2015-04-10 | 2016-11-23 | 北京云创视界科技有限公司 | video interactive method and terminal |
| CN104881451A (en) * | 2015-05-18 | 2015-09-02 | 百度在线网络技术（北京）有限公司 | Image searching method and image searching device |
| CN106412229A (en) * | 2015-07-28 | 2017-02-15 | 阿里巴巴集团控股有限公司 | Interaction method and device for mobile terminal, and the mobile terminal |
Non-Patent Citations (1)
| Title |
|---|
| 丁爱萍主编: "《物联网导论》", 31 March 2017, 西安电子科技大学出版社 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111144306A (en) * | 2019-12-27 | 2020-05-12 | 联想(北京)有限公司 | Information processing method, information processing apparatus, and information processing system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105934760B (en) | It is searched for using the adaptive topography of computer vision auxiliary | |
| KR101729938B1 (en) | Integrative image searching system and service method of the same | |
| US10747991B2 (en) | People stream analysis method, people stream analysis apparatus, and people stream analysis system | |
| CN105446989B (en) | Searching method and device, display device | |
| JP5319828B1 (en) | Article estimation system, article estimation method, and article estimation program | |
| CN109040461A (en) | A kind of method and device for business processing based on Object identifying | |
| CN110249304A (en) | The Visual intelligent management of electronic equipment | |
| JP2009003701A (en) | Information system and information processing apparatus | |
| TWI586160B (en) | Real time object scanning using a mobile phone and cloud-based visual search engine | |
| US20130181054A1 (en) | System and method for processing bar-code enabled cards | |
| CN105117399B (en) | Image searching method and device | |
| CN108197621A (en) | Company information acquisition methods and system and information processing method and system | |
| CN107748879A (en) | For obtaining the method and device of face information | |
| CN107708080A (en) | Data processing method and electronic equipment | |
| KR101784287B1 (en) | Integrative image searching system and service method of the same | |
| TWI712903B (en) | Commodity information inquiry method and system | |
| KR20160106649A (en) | Evaluation of augmented reality skins | |
| CN105956092B (en) | A kind of examination question searching method and device applied to electric terminal | |
| CN107944954A (en) | Information processing method and its device | |
| CN109948072A (en) | Processing method, device and the equipment of shop search information | |
| CN108446737A (en) | The method and apparatus of object for identification | |
| US11659273B2 (en) | Information processing apparatus, information processing method, and non-transitory storage medium | |
| CN112329841A (en) | Image processing method, image processing device, electronic equipment and computer readable medium | |
| JP2018106524A (en) | Interactive device, interactive method, and program | |
| CN108121969A (en) | For handling the method and apparatus of image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180420 |
|
| RJ01 | Rejection of invention patent application after publication |