CN108334085A - Smart collaboration method, apparatus, system, intelligent terminal and storage medium - Google Patents

Smart collaboration method, apparatus, system, intelligent terminal and storage medium Download PDF

Info

Publication number
CN108334085A
CN108334085A CN201810070427.7A CN201810070427A CN108334085A CN 108334085 A CN108334085 A CN 108334085A CN 201810070427 A CN201810070427 A CN 201810070427A CN 108334085 A CN108334085 A CN 108334085A
Authority
CN
China
Prior art keywords
intelligent
intelligent terminal
data
feedback information
terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810070427.7A
Other languages
Chinese (zh)
Inventor
胡大成
黄伟才
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Science and Technology Beijing USTB
Original Assignee
University of Science and Technology Beijing USTB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Science and Technology Beijing USTB filed Critical University of Science and Technology Beijing USTB
Priority to CN201810070427.7A priority Critical patent/CN108334085A/en
Publication of CN108334085A publication Critical patent/CN108334085A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0214Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory in accordance with safety or protection criteria, e.g. avoiding hazardous areas
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • G06F16/285Clustering or classification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Abstract

The embodiment of the present disclosure discloses smart collaboration method, apparatus, system, intelligent terminal and computer readable storage medium.The method operates on the first intelligent terminal, including:When the confidence level of the handling result to the first data is less than the first predetermined threshold value, cooperation request is sent to one or more second intelligent terminals;Receive feedback information of one or more of second intelligent terminals for the cooperation request;The first data described at least one second intelligent terminal collaborative process are selected according to the feedback information.By embodiment of the present disclosure, any one intelligent terminal can share the intelligent capability of neighbouring intelligent terminal so that the ability of single intelligent terminal greatly enhances, and greatly improves user experience.

Description

Smart collaboration method, apparatus, system, intelligent terminal and storage medium
Technical field
This disclosure relates to intelligent identification technology field, and in particular to a kind of smart collaboration method, apparatus, system, intelligence are eventually End and computer readable storage medium.
Background technology
With the development of intelligent terminal technology and network technology, it has been applied to more complicated use environment, than Such as robot, autonomous driving vehicle, unmanned plane, smart home field.With environment complexity, to the sensing capability of environment and sentence Cutting capacity is also continuously improved.Therefore, intelligent algorithm is also evolving, and is required also more the computing capability of intelligent terminal Height, and intelligent algorithm causes it that can have capacity variance due to the disunity of application scenarios and learning training process, from And the calculating that will appear single intelligent terminal can be limited by its own hardware performance and intelligent capability, existing can not complete to count The problem of calculation.
Invention content
A kind of smart collaboration method, apparatus of embodiment of the present disclosure offer, electronic equipment and computer readable storage medium.
In a first aspect, providing a kind of smart collaboration method in the embodiment of the present disclosure, the method operates in the first intelligence In terminal, including:
When the confidence level of the handling result to the first data is less than the first predetermined threshold value, to the second intelligence of one or more Terminal sends cooperation request;
Receive feedback information of one or more of second intelligent terminals for the cooperation request;
The first data described at least one second intelligent terminal collaborative process are selected according to the feedback information.
Wherein, the cooperation request includes first data.
Wherein, first data include at least one of image, sound, secret key and radar data.
Wherein, the feedback information includes:The intelligent capability index of second intelligent terminal and/or second intelligence The identity information of terminal.
Wherein, the intelligent capability index includes at least one of:
The intelligent capability index is the intelligent capability index for first data;
The intelligent capability index is the performance determination previously according to second intelligent terminal;
The intelligent capability index is previously according to second intelligent terminal for the processing capacity of first data Determining Capability index.
Wherein, the feedback information includes the handling result to first data.
Wherein, the first data described at least one second intelligent terminal collaborative process are selected according to the feedback information, wrapped It includes:
Processing capacity of second intelligent terminal to first data is determined according to the feedback information;
When the processing capacity is more than the second predetermined threshold value, at least one second intelligent terminal collaborative process is selected First data.
Wherein, processing capacity of second intelligent terminal to first data is determined according to the feedback information, wrapped It includes:
The processing capacity is determined according to the intelligent capability index of the second intelligent terminal described in the feedback information, and/ Or,
The place is determined to the handling result of first data according to the second intelligent terminal described in the feedback information Reason ability.
Wherein, when receiving the feedback information of identical multiple second intelligent terminals of processing capacity, according to the feedback Information selectes the first data described at least one second intelligent terminal collaborative process, including:
Select shortest second intelligent terminal of feedback time.
Wherein, when receiving the feedback information of identical multiple second intelligent terminals of processing capacity, according to the feedback Information selectes the first data described at least one second intelligent terminal collaborative process, further includes:
When the feedback time of identical the multiple second intelligent terminal of processing capacity is also identical, processing capacity phase is obtained Handling result of same the multiple second intelligent terminal to first data;
In the handling result difference, the second number is sent to identical the multiple second intelligent terminal of processing capacity According to;Second data are different from first data.
Wherein, the first data described at least one second intelligent terminal collaborative process are selected according to the feedback information, also Including:
According to identical the multiple second intelligent terminal of processing capacity to the handling result of second data, from processing Identical the multiple second intelligent terminal of ability selects the first data described at least one second intelligent terminal collaborative process.
Wherein, when receiving the feedback information of identical multiple second intelligent terminals of processing capacity, according to the feedback Information selectes the first data described at least one second intelligent terminal collaborative process, including:
Obtain multiple handling results of identical the multiple second intelligent terminal of processing capacity to first data;
In the multiple handling result difference, the multiple handling result is clustered;
Collaborative process result of the handling result for selecting quantity most according to cluster result as first data.
Second aspect, the embodiment of the present disclosure provide a kind of smart collaboration device, and described device operates in the first intelligence eventually On end, including:
Sending module is configured as when the confidence level of the handling result to the first data is less than the first predetermined threshold value, to One or more second intelligent terminals send cooperation request;
Receiving module is configured as the feedback for receiving one or more of second intelligent terminals for the cooperation request Information;
Chosen module is configured as being selected described at least one second intelligent terminal collaborative process according to the feedback information First data.
Wherein, the cooperation request includes first data.
Wherein, first data include at least one of image, sound, secret key and radar data.
Wherein, the feedback information includes:The intelligent capability index of second intelligent terminal and/or second intelligence The identity information of terminal.
Wherein, the intelligent capability index includes at least one of:
The intelligent capability index is the intelligent capability index for first data;
The intelligent capability index is the performance determination previously according to second intelligent terminal;
The intelligent capability index is previously according to second intelligent terminal for the processing capacity of first data Determining Capability index.
Wherein, the feedback information includes the handling result to first data.
Wherein, the chosen module, including:
First determination sub-module is configured as determining second intelligent terminal to described first according to the feedback information The processing capacity of data;
First selected submodule is configured as when the processing capacity is more than the second predetermined threshold value, select it is described at least First data described in one the second intelligent terminal collaborative process.
Wherein, first determination sub-module, including:
Second determination sub-module is configured as being referred to according to the intelligent capability of the second intelligent terminal described in the feedback information Number determines the processing capacity, and/or,
Third determination sub-module is configured as according to the second intelligent terminal described in the feedback information to first number According to handling result determine the processing capacity.
Wherein, when receiving the feedback information of identical multiple second intelligent terminals of processing capacity, the chosen module Including:
Second selected submodule is configured as selection shortest second intelligent terminal of feedback time.
Wherein, when receiving the feedback information of identical multiple second intelligent terminals of processing capacity, the chosen module Further include:
First acquisition submodule is configured as the feedback time in identical the multiple second intelligent terminal of processing capacity Also when identical, handling result of identical the multiple second intelligent terminal of processing capacity to first data is obtained;
Sending submodule is configured as in the handling result difference, to processing capacity identical the multiple second Intelligent terminal sends the second data;Second data are different from first data.
Wherein, the chosen module further includes:
Third selectes submodule, is configured as according to identical the multiple second intelligent terminal of processing capacity to described The handling result of two data selects at least one second intelligent terminal from identical the multiple second intelligent terminal of processing capacity First data described in collaborative process.
Wherein, when receiving the feedback information of identical multiple second intelligent terminals of processing capacity, the chosen module Including:
Second acquisition submodule is configured as obtaining identical the multiple second intelligent terminal of processing capacity to described the Multiple handling results of one data;
Submodule is clustered, is configured as, in the multiple handling result difference, gathering the multiple handling result Class;
4th determination sub-module is configured as the handling result for selecting quantity most according to cluster result as described first The collaborative process result of data.
The function can also execute corresponding software realization by hardware realization by hardware.The hardware or Software includes one or more modules corresponding with above-mentioned function.
In a possible design, the structure of smart collaboration device includes memory and processor, the memory The computer instruction of smart collaboration method in above-mentioned first aspect is executed for storing one or more support smart collaboration device, The processor is configurable for executing the computer instruction stored in the memory.The smart collaboration device can be with Including communication interface, for smart collaboration device and other equipment or communication.
The third aspect, the embodiment of the present disclosure provide a kind of multi-agent systems, including:
First intelligent terminal includes the smart collaboration device as described in second aspect;
At least one second intelligent terminal.
Fourth aspect, the embodiment of the present disclosure provide a kind of first intelligent terminal, including memory and processor;Wherein, The memory is for storing one or more computer instruction, wherein one or more computer instruction is by the place Device is managed to execute to realize the method and step described in first aspect.
5th aspect, the embodiment of the present disclosure provide a kind of computer readable storage medium, for storing smart collaboration dress Computer instruction used is set, it includes refer to for executing the computer in above-mentioned first aspect involved by smart collaboration method It enables.
The technical solution that the embodiment of the present disclosure provides can include the following benefits:
The embodiment of the present disclosure is mainly used in intelligent terminal, and intelligent terminal is when carrying out some or certain data processings, such as Fruit there are self-ability deficiency, can not handle the data or handle the data result it is undesirable when, can ask periphery its He therefrom selects one according to feedback information at intelligent terminal collaborative process after receiving the feedback information of other intelligent terminals Or data described in other multiple intelligent terminal collaborative process.By embodiment of the present disclosure, any one intelligent terminal all may be used With the intelligent capability of shared neighbouring intelligent terminal so that the ability of single intelligent terminal greatly enhances, and greatly improves user Experience.
It should be understood that above general description and following detailed description is only exemplary and explanatory, not The disclosure can be limited.
Description of the drawings
In conjunction with attached drawing, by the detailed description of following non-limiting embodiment, the other feature of the disclosure, purpose and excellent Point will be apparent.In the accompanying drawings:
Fig. 1 shows the flow chart of the smart collaboration method according to one embodiment of the disclosure;
Fig. 2 shows according to intelligent automobile cooperation schematic diagram of a scenario in one embodiment of the disclosure;
Fig. 3 shows the flow chart of the step S103 of embodiment according to Fig. 1;
Fig. 4 shows the another flow chart of the step S103 of embodiment according to Fig. 1;
Fig. 5 shows another flow chart of the step S103 of embodiment according to Fig. 1;
Fig. 6 shows the structure diagram of the smart collaboration device according to one embodiment of the disclosure;
Fig. 7 is adapted for for realizing that the structure of the electronic equipment of the smart collaboration method according to one embodiment of the disclosure is shown It is intended to.
Specific implementation mode
Hereinafter, the illustrative embodiments of the disclosure will be described in detail with reference to the attached drawings, so that those skilled in the art can Easily realize them.In addition, for the sake of clarity, the portion unrelated with description illustrative embodiments is omitted in the accompanying drawings Point.
In the disclosure, it should be appreciated that the term of " comprising " or " having " etc. is intended to refer to disclosed in this specification Feature, number, step, behavior, the presence of component, part or combinations thereof, and be not intended to exclude other one or more features, Number, step, behavior, component, part or combinations thereof there is a possibility that or be added.
It also should be noted that in the absence of conflict, the feature in embodiment and embodiment in the disclosure It can be combined with each other.The disclosure is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
Currently, mainly making up the hypodynamic problem of calculating of single intelligent terminal, this technical side by cloud computing Case needs network support, due to transmission range and network composition etc., may result in network delay, existing cannot meet tightly The problem of intelligent capability deficiency in the case of urgency.Therefore, there is the Collaboration computing mode based on local self-organizing network, which During Collaboration computing, need to find one or more appropriate intelligent terminals progress Collaboration computings, or eventually to each intelligence The result of calculation at end is evaluated, so that it is determined that cooperation algorithm be presently, there are main problem.
Fig. 1 shows the flow chart of the smart collaboration method according to one embodiment of the disclosure.As shown in Figure 1, the intelligence Collaboration method operates on the first intelligent terminal, includes the following steps S101-S103:
In step S101, when the confidence level of the handling result to the first data is less than the first predetermined threshold value, to one Or multiple second intelligent terminals send cooperation request;
In step s 102, feedback information of one second intelligent terminal for the cooperation request is received;
In step s 103, it is selected first described at least one second intelligent terminal collaborative process according to the feedback information Data.
In the present embodiment, the first intelligent terminal and the second intelligent terminal can be intelligent automobile, intelligent industrial robot, intelligence The intelligent terminals with intelligent capability such as energy mobile phone, smart home.Intelligent terminal may have not because the direction of its application is different Same intelligent capability.Intelligent capability represents the level that intelligent terminal handles data in terms of some, this level can because The intelligent algorithm that producer loads to intelligent terminal when intelligent terminal hardware performance and/or manufacture it is different and variant, also can be because Difference is generated for the evolutionary learning during intelligent terminal use.For example, by taking Intelligent automobile obstacle avoidance as an example.Avoidance is intelligent vapour The basic function that vehicle needs to have, and be to complete the first step of avoidance to the identification of barrier, the intelligent vapour of different manufacturers Vehicle, the intelligent algorithm that vehicle intelligent system is loaded in manufacture has differences, even if identical producer, travels by real road Learning training in the process, vehicle-mounted intelligence system can also have differences, therefore there is also differences for the recognition capability of barrier Different, intelligent automobile passes through the intelligent capability of intelligent capability test calibration cognitive disorders object, the barrier for representing intelligent automobile Recognition capability.
Therefore, the first intelligent terminal can not handle data due to the limitation in terms of intelligent capability when handling the first data Or the undesirable i.e. confidence level of handling result can send the request that cooperates, to seek help it less than in the case of the first predetermined threshold value His the first data of intelligent terminal collaborative process.First intelligent terminal can basis for the confidence level of the handling result of the first data The attribute of first data, the difference of processing mode and handling result and set different measurement standards.For example, the first intelligence is eventually When end handles the first data using trained artificial intelligence model, output result is rendered as each output of artificial intelligence model Probability value, for example there are three output, respectively A, B, C, after the first data are input to artificial intelligence model for artificial intelligence model Obtained result is { A:90%, B:10, C:5% }, at this time it is considered that the handling result of the first data is A.But if this The probability value of any two in three outputs is very close, if A is 90%, B 85%, then can not just judge the first number According to handling result be A or B on earth, at this time can according to two probability values of artificial intelligence model higher than 50% output it Between similarity within preset range, then it is assumed that the confidence level of the handling result be less than the first predetermined threshold value.Of course, it is possible to manage Solution, the measurement standard of confidence level can also have an other modes, such as whole output probability values of artificial intelligence model are all low In 50% etc., it is arranged with specific reference to actual conditions, is not limited herein.
In one embodiment, the second intelligent terminal can be the intelligent terminal with the first intelligent terminal same type, can also It is different types of intelligent terminal.For example, the first intelligent terminal is intelligent automobile, the second intelligent terminal is also intelligent automobile;The One intelligent terminal is intelligent sound box, and the second intelligent terminal is smart television etc..First intelligent terminal can be by radio communication Network sends cooperation request to the second intelligent terminal, such as wifi, NFC march into the arena communication, bluetooth, Zigbee cordless communication networks.
In one embodiment, cooperation request can be the request for including a certain standardized intelligent capability, and the second intelligence is eventually End, which can be predisposed to, can identify cooperation request, and can first pass through the progress of the second intelligent terminal of evaluating method pair in advance The assessment of intelligent capability.The feedback information of second intelligent terminal may include the intelligent capability index of second intelligent terminal.
Optionally, the intelligent capability index includes at least one of:
The intelligent capability index is the intelligent capability index for first data;
The intelligent capability index is the performance determination previously according to second intelligent terminal;
The intelligent capability index is previously according to second intelligent terminal for the processing capacity of first data Determining Capability index.
For example, under a specific intelligent task, a precision index is set, can be higher than in the second intelligent terminal should Think that the intelligent terminal has the intelligent capability after precision index.Such as intelligent capability can by second intelligent terminal Exact classification is carried out to distinguish to certain a kind of data, can also be divided according to the result precision to a certain task execution different etc. Grade.One existing intelligent capability index can obtain example from the definition of current pilotless automobile, L1~L5 ranks Pilotless automobile has just corresponded to the automatic Pilot ability level of the pilotless automobile, therefore the grade can also be considered as One intelligent capability index.For another example natural-sounding identification can be used as an intelligence by its category of language that can be applicable in Capability index.Intelligent capability can be fixed within certain a period of time, can also be with method or data improvement gradually It is promoted.In addition to this, intelligent capability also includes the level of data-handling capacity, such as the time that processing same task is consumed Or energy consumption can also be used as the evaluating standard of intelligent capability.Therefore, identical standard can be used in different intelligent terminals Define a series of intelligent capability.
In one embodiment, the feedback information can also include the identity information of the second intelligent terminal.Optionally, second The identity information of intelligent terminal can be the holder information of the second intelligent terminal.In other embodiments, the second intelligent terminal Identity information can also include the second intelligent terminal the attribute informations such as brand, signal, device type.
In one embodiment, cooperation request can also include the first data.First data include image, sound, secret At least one of key and radar data.First intelligent terminal is by handling the first data, to identify in the first data Relevant information, or classify to the first data, to realize the Intelligent treatment of next step.Such as intelligent automobile is being driven automatically , can be based on the image recognition roadblock of acquisition during sailing, and then choose next step steering direction.Second intelligent terminal can be with After receiving cooperation request, the first data in asking cooperation carry out respective handling, when such as the first data are image data, The barrier etc. in identification image data is asked according to cooperation.
In one embodiment, the second intelligent terminal can also include for cooperation for the feedback information of the cooperation request The handling result of first data in request.For example, the first data that cooperation request includes are such as intelligent vapour of the first intelligent terminal The image data that vehicle is shot during automatic Pilot, the second intelligent terminal is after receiving image data, for image data Obstacle recognition is carried out, and obstacle recognition result is fed back into the first intelligent terminal.
It is anti-can to be based on the second intelligent terminal after the feedback information for receiving the second intelligent terminal for first intelligent terminal The intelligent capability of feedback and/or handling result to the first data, it is determined whether selected second intelligent terminal is whole as collaborative process End.In the case where the second intelligent terminal has only fed back its intelligent capability, intelligence that the first intelligent terminal passes through the second intelligent terminal Energy capability analysis determines whether the second intelligent terminal meets this collaborative process demand, i.e., whether can handle the first data, and Determine whether to select the second intelligent terminal as collaborative process terminal based on analysis result;Intelligence has been fed back in the second intelligent terminal While ability or individually when having fed back the handling result of the first data, the first intelligent terminal is also based on the second intelligence eventually End determines whether the handling result of second the first data of intelligent terminal pair meets the requirements for the handling result of the first data.Example Such as, whether the second intelligent terminal has identified the barrier etc. in the first data.Multiple are had received in the first intelligent terminal After the feedback information of two intelligent terminals, the second intelligence that is best or being most suitable for the first data of processing can be selected based on feedback information Energy terminal is as collaborative process terminal.
Above-mentioned smart collaboration method is described further below by the usage scenario of disclosure above-described embodiment.
Application scenarios 1:The present embodiment is by taking Intelligent automobile obstacle avoidance as an example, as shown in Fig. 2, the first intelligent terminal is one first intelligence Can automobile 201, barrier image data is shot by camera 2011, because without by identifying the barrier before it Training, therefore 201 None- identified of the first intelligent automobile barrier, but it can determine that the object is barrier 204, pass through The confidence level of trained obstacle recognition algorithm, recognition result is less than predetermined threshold, shows its None- identified barrier 204. At this point, the first intelligent automobile 201 sends out cooperation request letter by near radio data transmission to other neighbouring intelligent automobiles Breath 2012, cooperation solicited message 2012 can include a certain standardized intelligent capability request, such as inquire that the automatic of other side is driven Sail grade, traffic lights recognition capability etc..The solicited message that cooperates can also include barrier image data, receive cooperation request Intelligent automobile be that nearby there are two intelligent automobile, the first cooperation intelligent automobiles 202 for the first intelligent automobile 201 in the present embodiment With the second cooperation intelligent automobile 203;The first cooperation cooperation intelligent automobile 203 of intelligent automobile 202 and second receives cooperation request letter After breath, the first cooperation intelligent automobile 202 feeds back an information 2021, which may include identity information and cooperation The corresponding intelligent capability of demand information, after the first intelligent automobile 201 receives feedback information 2021, if the first cooperation intelligence The intelligent capability of automobile 202 selects the place of first cooperation intelligent automobile higher than the intelligent capability of the second cooperation intelligent automobile 203 Manage result.Wherein, the intelligent capability of feedback can be obtained according to the mode of cooperative information directional interrogation, such as be wrapped in cooperative information Containing the inquiry message for asking whether to include certain intelligent capability, then feedback information can include a capabilities list or whether It replies.The intelligent capability of feedback can also judge according to the task of transmission, such as cooperated by processing and obtained after request data Correspondence intelligent capability.Such as in solicited message comprising None- identified obstacle recognition image information, cooperate intelligent automobile By identifying that the identification model used in the image process finds the corresponding intelligent capability of the model, and the ability is included in instead In feedforward information.
Application scenarios 2, the present embodiment is by taking intelligent home voice controls as an example.Voice control is that one kind of smart home is important Control mode, the identification to phonetic order are to realize the premise of voice control, the smart home product of different intelligent household producer In manufacture, it can be loaded into phonetic order recognizer, or even have producer's loading accent recognition algorithm, but language all over the world The difference of the difference and various regions dialect of pronunciation, cause a new smart home product just to start for offering customers service when, deposit The None- identified phonetic order the problem of, and the smart home product for using after a period of time has been applicable in the dialect of user, It can correctly identify the phonetic order of user, therefore, the smart home product newly purchased is needed in None- identified phonetic control command Ask other smart home product cooperation identifications.For example, smart television is new purchase smart home product, as user user When speech sends out " TV opening " instruction, the voice input pickup of smart television gets the phonetic order of user, because it does not have By the training of user's dialect, the confidence level of the instruction of speech recognition algorithm None- identified or identification built in smart television is less than Threshold value shows its None- identified phonetic order;Smart television is transmitted by radio communication to neighbouring other smart homes production Product send out cooperation solicited message, and cooperation solicited message includes the voice data obtained, receives other smart homes of cooperation request Product, in the present embodiment other smart home products include intelligent electric lamp, intelligent thermometer, intelligent hot kettle, intelligent sound box and Tablet computer;After other smart home products receive cooperative information, by handling this section of voice data, tied according to processing Fruit obtains feedback information.For example, if this section of voice can be identified correctly, then meaning tool, there are one corresponding intelligent capability quilts It was found that and by the identification to this section of voice data, can differentiate its corresponding dialect information, consequently found that corresponding more specific Intelligent capability classification, such as { intelligent capability:X accent recognitions ability }.Hereafter the information for including these contents is fed back, this A feedback information includes identity information and the corresponding intelligent capability information of collaborative demand information, and smart television receives the letter of feedback After breath, then the object of cooperation can be selected according to feedback information.
In an optional realization method of the present embodiment, as shown in figure 3, the step S103, i.e., according to the feedback Information selectes the step of the first data described at least one second intelligent terminal collaborative process, further comprises the steps S301-S302:
In step S301, processing of second intelligent terminal to first data is determined according to the feedback information Ability;
In step s 302, when the processing capacity is more than the second predetermined threshold value, at least one second intelligence is selected It can terminal cooperation processing first data.
In the optional realization method, may include in feedback information the second intelligent terminal intelligent capability index and/ Or the handling result to the first data.
In one embodiment, according to described in the determination of the intelligent capability index of the second intelligent terminal described in the feedback information Processing capacity.Intelligent terminal can include a variety of different intelligent capability indexes for different data, for example, same intelligence is eventually End is higher than 90% for the intelligent capability index of image recognition, and for the intelligent capability index of speech recognition less than 50%, the Corresponding intelligent capability index is fed back in specific requirement during two intelligent terminals can be asked based on cooperation, can also be fed back existing All intelligent capability indexes.First intelligent terminal determines that the second intelligent terminal is handled based on the intelligent capability index in feedback information The ability of first data, for example, when the first data are image data, the processing capacity of the second intelligent terminal is higher than 90%, you can With think the second intelligent terminal processing capacity be more than the second predetermined threshold value, and the first data be voice data when, second intelligence The processing capacity of terminal is less than 50%, it is believed that the processing capacity of the second intelligent terminal is less than the second predetermined threshold value.Second is pre- If threshold value can be based on experience and actual conditions are pre-set.
In another embodiment, the processing according to the second intelligent terminal described in the feedback information to first data As a result the processing capacity is determined.When including the first data in cooperation request, the second intelligent terminal can handle the first number In the case of, can also the handling result of the first data directly be fed back into the first intelligent terminal, the first intelligent terminal can be with The processing capacity of the second intelligent terminal is determined according to the handling result of the first data.For example, the first data are image data, first Obstacle identity in intelligent terminal None- identified image, and have identified barrier in the feedback information of the second intelligent terminal Type, then the processing capacity of the second intelligent terminal be more than the first predetermined threshold value, can select the second intelligent terminal as cooperation at Manage terminal.
It is, of course, understood that it include intelligent capability index includes to the first data again to be in feedback information Handling result when, the first intelligent terminal can also consider the handling result selection of intelligent capability index and the second data most The second excellent intelligent terminal is as collaborative process terminal.
In an optional realization method of the present embodiment, identical multiple second intelligent terminals of processing capacity are being received Feedback information when, the step S301 selectes at least one second intelligent terminal collaborative process according to the feedback information The step of first data, further comprises the steps:
Select shortest second intelligent terminal of feedback time.
In the optional realization method, multiple second intelligent terminal feedback informations are being received, and multiple second intelligence are eventually When end is identical for the processing capacity of the first data, shortest second intelligent terminal of feedback time can be selected as collaborative process Terminal.By the handling result analysis to intelligent capability index or to the first data, determining has the intelligence of multiple second intelligent terminals When energy ability is identical, select the second intelligent terminal for being initially received feedback information as collaborative process terminal.Pass through this side Formula, identical in ability, the second intelligent terminal for selecting real-time best can save time cost, improve real-time Property.
In an optional realization method of the present embodiment, as shown in figure 4, receiving processing capacity identical multiple When the feedback information of two intelligent terminals, the step S103 selectes at least one second intelligence eventually according to the feedback information The step of holding the first data described in collaborative process, further comprising the steps of S401-S402:
In step S401, when the feedback time of identical the multiple second intelligent terminal of processing capacity is also identical, Obtain handling result of identical the multiple second intelligent terminal of processing capacity to first data;
In step S402, in the handling result difference, eventually to identical the multiple second intelligence of processing capacity End sends the second data;Second data are different from first data.
In the optional realization method, there are multiple intelligent capabilities are identical, and feedback time also identical multiple When two intelligent terminals, relatively simple way, which is that random selection is one of, is used as collaborative process terminal;But it is to be able to To best effect, it is also an option that by analyzing handling result of multiple second intelligent terminals for the first data, to determine Cooperate terminal.If do not have in feedback information include the first data handling result, the can be sent to the second intelligent terminal One data, when getting handling result of multiple second terminals for the first data, if multiple second terminals are for first The handling result of data is different, then can send the second data to the second intelligent terminal, the second data can be with the first data For the different data of same object.For example, the first data are the barrier photo that intelligent automobile is shot from first angle, and the Two data are another photo for the same barrier that intelligent automobile is shot from second angle.Even if intelligent capability is identical, but it is right It is different and different due to its training algorithm and training sample in the recognition result of same data.Therefore, pass through transmission Second data further confirm recognition capability of multiple second intelligent terminals for same object.
In an optional realization method of the present embodiment, identical multiple second intelligent terminals of processing capacity are being received Feedback information when, the step S103 selectes at least one second intelligent terminal collaborative process according to the feedback information It is the step of first data, further comprising the steps of:
According to identical the multiple second intelligent terminal of processing capacity to the handling result of second data, from processing Identical the multiple second intelligent terminal of ability selects the first data described at least one second intelligent terminal collaborative process.
In the optional realization method, after the handling result for obtaining the second data, pass through the processing knot of the second data Fruit determines second intelligent terminal as collaborative process terminal again, and selects it for the handling result of the first data.
In an optional realization method of the present embodiment, as shown in figure 5, receiving processing capacity identical multiple When the feedback information of two intelligent terminals, the step S301 selectes at least one second intelligence eventually according to the feedback information The step of holding the first data described in collaborative process, further comprises the steps:
In step S501, identical the multiple second intelligent terminal of processing capacity is obtained to the more of first data A handling result;
In step S502, in the multiple handling result difference, the multiple handling result is clustered;
In step S503, the cooperation of the handling result that selects quantity most according to cluster result as first data Handling result.
In the optional realization method, there are multiple intelligent capabilities are identical, and feedback time also identical multiple When two intelligent terminals, can the first data be sent to the second intelligent terminal simultaneously, to obtain the second intelligent terminal for the first number According to multiple handling results.It, can be with if multiple handling results for the first data of multiple second intelligent terminals are different By being clustered to multiple handling results, final process knot of a fairly large number of a kind of handling result as the first data is selected Fruit.This mode can consider handling result of multiple second intelligent terminals for the first data, be obeyed according to majority few Several principles selects to provide the second most intelligent terminal of same processing fruiting quantities as collaborative process terminal, and will processing As a result the final process result as the first data.In this way, that is, the processing knot of multiple second intelligent terminals is combined Fruit, overcomes one-sidedness, and is handled due to being not necessarily to retransmit the second data, shortens processing time, improves real-time.
Following is embodiment of the present disclosure, can be used for executing embodiments of the present disclosure.
Fig. 6 shows that the structure diagram of the smart collaboration device according to one embodiment of the disclosure, the device can be by soft Part, hardware or both are implemented in combination with as some or all of of electronic equipment.As shown in fig. 6, the smart collaboration dress It sets including sending module 601, receiving module 602 and chosen module 603:
Sending module 601 is configured as when the confidence level of the handling result to the first data is less than the first predetermined threshold value, Cooperation request is sent to one or more second intelligent terminals;
Receiving module 602 is configured as receiving one or more of second intelligent terminals for the cooperation request Feedback information;
Chosen module 603 is configured as selecting at least one second intelligent terminal collaborative process according to the feedback information First data.
The cooperation request includes first data.
In an optional realization method of the present embodiment, first data include image, sound, secret key and radar number At least one of according to.
In an optional realization method of the present embodiment, the feedback information includes:The intelligence of second intelligent terminal The identity information of energy Capability index and/or second intelligent terminal.
In an optional realization method of the present embodiment, the intelligent capability index includes at least one of:
The intelligent capability index is the intelligent capability index for first data;
The intelligent capability index is the performance determination previously according to second intelligent terminal;
The intelligent capability index is previously according to second intelligent terminal for the processing capacity of first data Determining Capability index.
In an optional realization method of the present embodiment, the feedback information includes the processing knot to first data Fruit.
In an optional realization method of the present embodiment, the chosen module, including:
First determination sub-module is configured as determining second intelligent terminal to described first according to the feedback information The processing capacity of data;
First selected submodule is configured as when the processing capacity is more than the second predetermined threshold value, select it is described at least First data described in one the second intelligent terminal collaborative process.
In an optional realization method of the present embodiment, first determination sub-module, including:
Second determination sub-module is configured as being referred to according to the intelligent capability of the second intelligent terminal described in the feedback information Number determines the processing capacity, and/or,
Third determination sub-module is configured as according to the second intelligent terminal described in the feedback information to first number According to handling result determine the processing capacity.
In an optional realization method of the present embodiment, identical multiple second intelligent terminals of processing capacity are being received Feedback information when, the chosen module includes:
Second selected submodule is configured as selection shortest second intelligent terminal of feedback time.
In an optional realization method of the present embodiment, identical multiple second intelligent terminals of processing capacity are being received Feedback information when, the chosen module further includes:
First acquisition submodule is configured as the feedback time in identical the multiple second intelligent terminal of processing capacity Also when identical, handling result of identical the multiple second intelligent terminal of processing capacity to first data is obtained;
Sending submodule is configured as in the handling result difference, to processing capacity identical the multiple second Intelligent terminal sends the second data;Second data are different from first data.
In an optional realization method of the present embodiment, the chosen module further includes:
Third selectes submodule, is configured as according to identical the multiple second intelligent terminal of processing capacity to described The handling result of two data selects at least one second intelligent terminal from identical the multiple second intelligent terminal of processing capacity First data described in collaborative process.
In an optional realization method of the present embodiment, identical multiple second intelligent terminals of processing capacity are being received Feedback information when, the chosen module includes:
Second acquisition submodule is configured as obtaining identical the multiple second intelligent terminal of processing capacity to described the Multiple handling results of one data;
Submodule is clustered, is configured as, in the multiple handling result difference, gathering the multiple handling result Class;
4th determination sub-module is configured as the handling result for selecting quantity most according to cluster result as described first The collaborative process result of data.
The disclosure additionally provides a kind of multi-agent systems, including:
First intelligent terminal includes the smart collaboration device as described in Fig. 6 and related embodiment;
At least one second intelligent terminal.
Fig. 7 is adapted for the structure of the first intelligent terminal for realizing the smart collaboration method according to disclosure embodiment Schematic diagram.
As shown in fig. 7, the first intelligent terminal 700 include central processing unit (CPU) 701, can according to be stored in only It reads the program in memory (ROM) 702 or is loaded into the program in random access storage device (RAM) 703 from storage section 708 And execute the various processing in above-mentioned embodiment shown in FIG. 1.In RAM703, it is also stored with the first intelligent terminal 700 behaviour Various programs and the first data needed for making.CPU701, ROM702 and RAM703 are connected with each other by bus 704.Input/defeated Go out (I/O) interface 705 and is also connected to bus 704.
It is connected to I/O interfaces 705 with lower component:Importation 706 including keyboard, mouse etc.;It is penetrated including such as cathode The output par, c 707 of spool (CRT), liquid crystal display (LCD) etc. and loud speaker etc.;Storage section 708 including hard disk etc.; And the communications portion 709 of the network interface card including LAN card, modem etc..Communications portion 709 via such as because The network of spy's net executes communication process.Driver 710 is also according to needing to be connected to I/O interfaces 705.Detachable media 711, such as Disk, CD, magneto-optic disk, semiconductor memory etc. are mounted on driver 710, as needed in order to be read from thereon Computer program be mounted into storage section 708 as needed.
Particularly, according to embodiment of the present disclosure, it is soft to may be implemented as computer above with reference to Fig. 1 methods described Part program.For example, embodiment of the present disclosure includes a kind of computer program product comprising be tangibly embodied in and its readable Computer program on medium, the computer program include the program code of the method for executing Fig. 1.In such implementation In mode, which can be downloaded and installed by communications portion 709 from network, and/or from detachable media 711 are mounted.
Flow chart in attached drawing and block diagram, it is illustrated that according to the system, method and computer of the various embodiments of the disclosure The architecture, function and operation in the cards of program product.In this regard, each box in course diagram or block diagram can be with A part for a module, section or code is represented, a part for the module, section or code includes one or more Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical On can be basically executed in parallel, they can also be executed in the opposite order sometimes, this is depended on the functions involved.Also it wants It is noted that the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart, Ke Yiyong The dedicated hardware based system of defined functions or operations is executed to realize, or can be referred to specialized hardware and computer The combination of order is realized.
Being described in unit or module involved in disclosure embodiment can be realized by way of software, also may be used It is realized in a manner of by hardware.Described unit or module can also be arranged in the processor, these units or module Title do not constitute the restriction to the unit or module itself under certain conditions.
As on the other hand, the disclosure additionally provides a kind of computer readable storage medium, the computer-readable storage medium Matter can be computer readable storage medium included in device described in the above embodiment;Can also be individualism, Without the computer readable storage medium in supplying equipment.There are one computer-readable recording medium storages or more than one journey Sequence, described program is used for executing by one or more than one processor is described in disclosed method.
Above description is only the preferred embodiment of the disclosure and the explanation to institute's application technology principle.People in the art Member should be appreciated that invention scope involved in the disclosure, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic Scheme, while should also cover in the case where not departing from the inventive concept, it is carried out by above-mentioned technical characteristic or its equivalent feature Other technical solutions of arbitrary combination and formation.Such as features described above has similar work(with (but not limited to) disclosed in the disclosure Can technical characteristic replaced mutually and the technical solution that is formed.

Claims (10)

1. a kind of smart collaboration method, which is characterized in that the method operates on the first intelligent terminal, including:
When the confidence level of the handling result to the first data is less than the first predetermined threshold value, to one or more second intelligent terminals Send cooperation request;
Receive feedback information of one or more of second intelligent terminals for the cooperation request;
The first data described at least one second intelligent terminal collaborative process are selected according to the feedback information.
2. smart collaboration method according to claim 1, which is characterized in that the cooperation request includes first number According to.
3. smart collaboration method according to claim 1, which is characterized in that first data include image, sound, secret At least one of key and radar data.
4. smart collaboration method according to claim 1, which is characterized in that the feedback information includes:Second intelligence It can the intelligent capability index of terminal and/or the identity information of second intelligent terminal.
5. smart collaboration method according to claim 4, which is characterized in that the intelligent capability index include it is following at least One of:
The intelligent capability index is the intelligent capability index for first data;
The intelligent capability index is the performance determination previously according to second intelligent terminal;
The intelligent capability index is that the processing capacity of first data is determined previously according to second intelligent terminal Capability index.
6. smart collaboration method according to claim 1, which is characterized in that the feedback information includes to first number According to handling result.
7. a kind of smart collaboration device, which is characterized in that described device operates on the first intelligent terminal, including:
Sending module is configured as when the confidence level of the handling result to the first data is less than the first predetermined threshold value, to one Or multiple second intelligent terminals send cooperation request;
Receiving module is configured as the feedback letter for receiving one or more of second intelligent terminals for the cooperation request Breath;
Chosen module is configured as being selected first described at least one second intelligent terminal collaborative process according to the feedback information Data.
8. a kind of multi-agent systems, which is characterized in that including:
First intelligent terminal, including smart collaboration device as claimed in claim 7;
At least one second intelligent terminal.
9. a kind of first intelligent terminal, which is characterized in that including memory and processor;Wherein,
The memory is for storing one or more computer instruction, wherein one or more computer instruction is by institute Processor is stated to execute to realize claim 1-6 any one of them method and steps.
10. a kind of computer readable storage medium, is stored thereon with computer instruction, which is characterized in that the computer instruction quilt Claim 1-6 any one of them method and steps are realized when processor executes.
CN201810070427.7A 2018-01-24 2018-01-24 Smart collaboration method, apparatus, system, intelligent terminal and storage medium Pending CN108334085A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810070427.7A CN108334085A (en) 2018-01-24 2018-01-24 Smart collaboration method, apparatus, system, intelligent terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810070427.7A CN108334085A (en) 2018-01-24 2018-01-24 Smart collaboration method, apparatus, system, intelligent terminal and storage medium

Publications (1)

Publication Number Publication Date
CN108334085A true CN108334085A (en) 2018-07-27

Family

ID=62925632

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810070427.7A Pending CN108334085A (en) 2018-01-24 2018-01-24 Smart collaboration method, apparatus, system, intelligent terminal and storage medium

Country Status (1)

Country Link
CN (1) CN108334085A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109330730A (en) * 2018-09-25 2019-02-15 孟薇 A kind of oral health inspection server based on artificial intelligence
CN110333952A (en) * 2019-07-09 2019-10-15 王延晋 Data processing method and system based on artificial intelligence
CN110442438A (en) * 2019-02-26 2019-11-12 北京蓦然认知科技有限公司 Task cooperative method, equipment and system between a kind of more equipment
CN113382389A (en) * 2020-03-09 2021-09-10 上海擎感智能科技有限公司 Data processing method, system, storage medium and vehicle terminal

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106538001A (en) * 2014-10-20 2017-03-22 华为技术有限公司 Cooperative locating method and wireless terminal
CN106790140A (en) * 2016-12-28 2017-05-31 芜湖乐锐思信息咨询有限公司 The data handling system of efficiently online cooperation
WO2017100068A1 (en) * 2011-08-18 2017-06-15 Rivada Research, Llc Method and system for providing enhanced location based services (elbs) trilateration using a single device
CN107113779A (en) * 2015-07-29 2017-08-29 华为技术有限公司 A kind of resource allocation method and relevant device
CN107484139A (en) * 2017-08-14 2017-12-15 北京邮电大学 A kind of car networking Cooperative Localization Method and device based on geographical location information

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017100068A1 (en) * 2011-08-18 2017-06-15 Rivada Research, Llc Method and system for providing enhanced location based services (elbs) trilateration using a single device
CN106538001A (en) * 2014-10-20 2017-03-22 华为技术有限公司 Cooperative locating method and wireless terminal
CN107113779A (en) * 2015-07-29 2017-08-29 华为技术有限公司 A kind of resource allocation method and relevant device
CN106790140A (en) * 2016-12-28 2017-05-31 芜湖乐锐思信息咨询有限公司 The data handling system of efficiently online cooperation
CN107484139A (en) * 2017-08-14 2017-12-15 北京邮电大学 A kind of car networking Cooperative Localization Method and device based on geographical location information

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109330730A (en) * 2018-09-25 2019-02-15 孟薇 A kind of oral health inspection server based on artificial intelligence
CN110442438A (en) * 2019-02-26 2019-11-12 北京蓦然认知科技有限公司 Task cooperative method, equipment and system between a kind of more equipment
CN110333952A (en) * 2019-07-09 2019-10-15 王延晋 Data processing method and system based on artificial intelligence
CN110333952B (en) * 2019-07-09 2021-09-14 王延晋 Data processing method and system based on artificial intelligence
CN113382389A (en) * 2020-03-09 2021-09-10 上海擎感智能科技有限公司 Data processing method, system, storage medium and vehicle terminal
CN113382389B (en) * 2020-03-09 2023-02-17 上海擎感智能科技有限公司 Data processing method, system, storage medium and vehicle terminal

Similar Documents

Publication Publication Date Title
CN108334085A (en) Smart collaboration method, apparatus, system, intelligent terminal and storage medium
US11216694B2 (en) Method and apparatus for recognizing object
US20210354305A1 (en) Serving robot and method for receiving customer using the same
US11138453B2 (en) Driving guide method and apparatus for vehicle
US11189278B2 (en) Device and method for providing response message to user input
US20200010095A1 (en) Method and apparatus for monitoring driving condition of vehicle
CN109767130A (en) Method for controlling a vehicle and device
EP3779888A1 (en) Generating candidate images appropriate for image synthesis with an input image
US10795357B2 (en) Method and device for controlling vehicle and autonomous driving vehicle
US11687850B2 (en) System and method for processing a task request to be executed and fulfilled
CN109408710A (en) Search result optimization method, device, system and storage medium
CN110398898B (en) Intelligent terminal management method, intelligent terminal management device, computer equipment and readable storage medium
US20200005643A1 (en) Method and apparatus for providing information on vehicle driving
WO2023202161A1 (en) Device connection method and apparatus, first device, and computer readable storage medium
US20200001463A1 (en) System and method for cooking robot
CN110262413A (en) Intelligent home furnishing control method, control device, car-mounted terminal and readable storage medium storing program for executing
CN111611402B (en) Driving behavior knowledge graph generation method, device and system based on position
CN111540222A (en) Intelligent interaction method and device based on unmanned vehicle and unmanned vehicle
US20210193138A1 (en) Artificial intelligence device and method for recognizing speech with multiple languages
US11605378B2 (en) Intelligent gateway device and system including the same
WO2022095813A1 (en) Service data processing method, device, and readable storage medium
US20200007772A1 (en) Imaging reproducing method and apparatus
US11323408B2 (en) Dynamic communications routing to disparate endpoints
CN109584619A (en) A kind of parking stall bootstrap technique and device
CN111464973B (en) Method for determining vehicle driving mode and driving route

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180727

RJ01 Rejection of invention patent application after publication