CN108667900A - The method and device of the control panel of remotely located smart machine - Google Patents
The method and device of the control panel of remotely located smart machine Download PDFInfo
- Publication number
- CN108667900A CN108667900A CN201810275033.5A CN201810275033A CN108667900A CN 108667900 A CN108667900 A CN 108667900A CN 201810275033 A CN201810275033 A CN 201810275033A CN 108667900 A CN108667900 A CN 108667900A
- Authority
- CN
- China
- Prior art keywords
- control panel
- smart machine
- target equipment
- intelligent target
- interactive interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2807—Exchanging configuration information on appliance services in a home automation network
- H04L12/2809—Exchanging configuration information on appliance services in a home automation network indicating that an appliance service is present in a home automation network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2807—Exchanging configuration information on appliance services in a home automation network
- H04L12/2814—Exchanging control software or macros for controlling appliance services in a home automation network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0813—Configuration setting characterised by the conditions triggering a change of settings
- H04L41/0816—Configuration setting characterised by the conditions triggering a change of settings the condition being an adaptation, e.g. in response to network events
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/085—Retrieval of network configuration; Tracking network configuration history
- H04L41/0853—Retrieval of network configuration; Tracking network configuration history by actively collecting configuration information or by backing up configuration information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
- H04M1/72415—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72469—User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
- H04M1/72412—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Automation & Control Theory (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Computer Security & Cryptography (AREA)
- Selective Calling Equipment (AREA)
- Telephonic Communication Services (AREA)
Abstract
The embodiment of the invention discloses a kind of methods of the control panel of remotely located smart machine, are applied to terminal device, including：Smart machine is searched in a local network, Intelligent target equipment is determined in the smart machine searched, is established and is connected with the Intelligent target equipment；Control switch order is sent by described connect to the Intelligent target equipment, receives control panel interactive interface of the Intelligent target equipment based on the Intelligent target equipment for throwing screen agreement feedback；Operation information of the detection for control panel interactive interface input；The setting regulating command for controlling the Intelligent target equipment is generated according to the operation information；The setting regulating command is sent to the Intelligent target equipment, so that the Intelligent target equipment is by executing the configuration that regulating command adjusting control panel is arranged.The invention also discloses the devices of the control panel of another remotely located smart machine.The method and device operation of the control panel of remotely located smart machine in the present invention is more convenient.
Description
Technical field
The present embodiments relate to intelligent terminal field, more particularly to the control panel of remotely located smart machine
Method and device.
Background technology
With mobile communication and the continuous development of development of Mobile Internet technology and people's living standards continue to improve, intelligence
Energy terminal device is more and more universal in people's life, has become a part indispensable in people's daily life.
Currently, people increasingly focus on the application shared content between distinct electronic apparatuses, mutually controlled, e.g., word content, figure
The shared and control of piece, music or video.
But the inventor of present patent application has found that at least there are the following problems in the prior art：
When people are using terminal device control other-end in the prior art, need to adjust setting first with terminal device
Instruction is sent to external network server, forwards setting regulating command to controlled terminal by external network server.It is passed by external network server
Defeated setting regulating command, the poor reliability of secure user data and control.Also, terminal device can only send out fixed and limited
Setting regulating command controlled, cumbersome complexity, and operation mode is more stiff.
Invention content
A kind of method for being designed to provide the control panel of remotely located smart machine of embodiment of the present invention and it is
System so that the control between terminal device and smart machine can be not based on external network server realization, improve user data peace
The reliability of full property and control.Also, terminal device can in human-computer interaction interface display control panel interactive interface, for
User inputs operation information, realizes the visual control operation for smart machine, simple and convenient, and operation mode
More flexibly.
In order to solve the above technical problems, embodiments of the present invention provide a kind of control plane of remotely located smart machine
The method of plate, which is characterized in that it is applied to terminal device, including：
Smart machine is searched in a local network, Intelligent target equipment is determined in the smart machine searched, with the mesh
It marks smart machine and establishes connection；
Control switch order is sent by described connect to the Intelligent target equipment, receives the Intelligent target equipment base
In the control panel interactive interface for the Intelligent target equipment for throwing screen agreement feedback；
Operation information of the detection for control panel interactive interface input；
The setting regulating command for controlling the Intelligent target equipment is generated according to the operation information；
The setting regulating command is sent to the Intelligent target equipment, so that the Intelligent target equipment passes through execution
The configuration of the setting regulating command adjusting control panel.
The smart machine of search in a local network includes in one of the embodiments,：
Pass through the broadcast packet and multicast packets protocol search smart machine of LAN subscriber datagram UDP.
Before the detection is for the operation information of control panel interactive interface input in one of the embodiments,
Further include：
Create include display control human-computer interaction interface, and by the control panel interactive interface with video or image
Form is rendered into the display control of the human-computer interaction interface.
The throwing screen agreement includes DLNA agreements, Miracast agreements and Airplay agreements in one of the embodiments,
At least one of.
Operation information packet of the detection for control panel interactive interface input in one of the embodiments,
It includes：
The monitoring that touch event is carried out to the control panel interactive interface obtains input according to the touch event listened to
Operation information, the operation information includes touch location, sliding trace, touches number, touches in duration and pressing dynamics
It is at least one.
In addition, in order to solve the above technical problems, embodiments of the present invention provide a kind of remotely located smart machine
The device of control panel, which is characterized in that it is applied to terminal device, including：
Smart machine is searched in a local network, Intelligent target equipment is determined in the smart machine searched, with the mesh
It marks smart machine and establishes connection；
Control switch order is sent by described connect to the Intelligent target equipment, receives the Intelligent target equipment base
In the control panel interactive interface for the Intelligent target equipment for throwing screen agreement feedback；
Operation information of the detection for control panel interactive interface input；
The setting regulating command for controlling the Intelligent target equipment is generated according to the operation information；
The setting regulating command is sent to the Intelligent target equipment, so that the Intelligent target equipment passes through execution
The configuration of the setting regulating command adjusting control panel.
The smart machine of search in a local network includes in one of the embodiments,：
Pass through the broadcast packet and multicast packets protocol search smart machine of LAN subscriber datagram UDP.
Before the detection is for the operation information of control panel interactive interface input in one of the embodiments,
Further include：
Create include display control human-computer interaction interface, and by the control panel interactive interface with video or image
Form is rendered into the display control of the human-computer interaction interface.
The throwing screen agreement includes DLNA agreements, Miracast agreements and Airplay agreements in one of the embodiments,
At least one of.
Operation information packet of the detection for control panel interactive interface input in one of the embodiments,
It includes：
The monitoring that touch event is carried out to the control panel interactive interface obtains input according to the touch event listened to
Operation information, the operation information includes touch location, sliding trace, touches number, touches in duration and pressing dynamics
It is at least one.
Implement the embodiment of the present invention, will have the advantages that：
The method and device of the control panel of above-mentioned remotely located smart machine so that user is with mobile phone, tablet or pen
Remember this computer remote control intelligent sound box, intelligent air condition, intelligent refrigerator etc. without display interactive interface or display interactive interface compared with
When small intelligent terminal, throwing can be passed through by receiving intelligent sound box, intelligent air condition, intelligent refrigerator and shield the control that agreement is sent
Panel interactive interface visually to show adjustable setting option to user, and user can be by patterned setting interface
The operations such as the temperature adjusting of the volume adjustment to intelligent sound box, intelligent air condition are completed, to improve the convenience of operation.
Description of the drawings
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
Obtain other attached drawings according to these attached drawings.
Wherein：
Fig. 1 is according to a kind of particular flow sheet of the method for the control panel of remotely located smart machine of the present invention；
Fig. 2 is according to a kind of particular flow sheet of the method for the control panel of remotely located smart machine of the present invention；
Fig. 3 is according to a kind of particular flow sheet of the method for the control panel of remotely located smart machine of the present invention；
Fig. 4 is according to a kind of structural schematic diagram of terminal device of the present invention；
Fig. 5 is according to a kind of structural schematic diagram of smart machine of the present invention；
Fig. 6 is the computer equipment of the method for the control panel that aforementioned remotely located smart machine is run in one embodiment
Structural schematic diagram.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other without creative efforts
Embodiment shall fall within the protection scope of the present invention.
In order to solve the operation that using terminal equipment in aforementioned conventional technology is configured intelligent terminal adjusting
In cumbersome technical problem, in one embodiment, the method that spy proposes the control panel of remotely located smart machine, the party
The realization of method can be dependent on computer program.User passes through in mobile phone, tablet computer, palm PC, laptop, individual PC
The computer program is run on equal terminal devices, smart machine (such as the intelligence of same LAN pair can be in the terminal device
Can speaker, intelligent air condition, intelligent refrigerator etc.) control panel be configured adjustings, operation is more convenient succinctly.
Specifically, as shown in Figure 1, the method for the control panel of the remotely located smart machine includes：
Step 101：Smart machine is searched in a local network, and Intelligent target equipment is determined in the smart machine searched,
It establishes and connects with the Intelligent target equipment.
Specifically, terminal device can be to network access equipment (e.g., wireless router) sending device inquiry request.Net
Network access device obtains each intelligence that connection is currently kept with itself when receiving the equipment query request from terminal device
The information of equipment, and feed back to terminal device.Each smart machine is set as target by terminal device according to the information of each smart machine
Smart machine, and establish and connect with each smart machine.More specifically, terminal device can be mobile phone, computer, tablet computer etc.
Electronic equipment, smart machine can be the video playback apparatus such as intelligent sound box, smart television.
Step 102, control switch order is sent by described connect to the Intelligent target equipment, receives the target intelligence
It can control panel interactive interface of the equipment based on the Intelligent target equipment for throwing screen agreement feedback.
Control switch order is that the expectation of the terminal device initiation of user terminal operation is configured Intelligent target equipment
Switch order, after the terminal device of user terminal operation has sent control switch order to Intelligent target equipment, i.e. user terminal
The setting of Intelligent target equipment is adjusted in the terminal device expectation of operation.For example, volume adjustment, temperature are adjusted, power tune
Section etc..
If the terminal device of Intelligent target equipment consenting user end operation is configured it, it can feed back and accordingly be arranged
The terminal device that control panel interactive interface is operated to user terminal.For example, for intelligent sound box, it can be by the control plane of volume adjustment
Plate interactive interface shields the mobile phone that agreement is sent to user terminal operation by throwing, is then shown on mobile phone, so as to allow user to obtain
Knowing can be to setting option that intelligent sound box is adjusted.
Specifically, throwing screen agreement may include at least one of DLNA agreements, Miracast agreements and Airplay agreements.
Step 103, operation information of the detection for control panel interactive interface input.
User can utilize mouse, keyboard on the terminal device according to content shown in control panel interactive interface
Equal external equipments are operated, and in order to the operation that terminal device is inputted according to external equipment, detect operation letter input by user
Breath.
More specifically, when terminal device is equipped with touching display screen, terminal device is interacted in detection for control panel
When the operation information of interface input, the monitoring of touch event is carried out to the control panel interactive interface, is touched according to what is listened to
The operation information that event obtains input is touched, in order to obtain operation information according to the touch event listened to.
Specifically, the operation information includes touch location, sliding trace, touches number, touches duration and pressing dynamics
At least one of.
However, the example above is only to illustrate, it is not man-machine to being mapped to terminal device detection user in present embodiment
The specific implementation form of the operation information of operation interface in interactive interface does any restriction.
Step 104, the setting regulating command is sent to the Intelligent target equipment, so that the Intelligent target equipment
By the configuration for executing the setting regulating command adjusting control panel.
Specifically, prestoring operation information and the correspondence that regulating command is arranged in terminal device, terminal device exists
In the correspondence to prestore, inquires and generate the corresponding setting regulating command of operation information.Wherein, regulating command being arranged can be
Setting regulating command in real time, or delay setting regulating command.
Specifically, terminal device when the setting regulating command of generation is sent to smart machine, will can be first arranged
The information of regulating command and smart machine sends jointly to network access equipment, and being transmitted to intelligence by network access equipment sets
It is standby；Smart machine can also be sent to by regulating command is arranged by internet directly according to the information of smart machine.This implementation
In mode, terminal device will be arranged regulating command using TCP procotols and be sent to smart machine, the reliability of event and continuous
Property is higher.
Compared with prior art, in present embodiment, the control between terminal device and smart machine can be not based on outer
Network server is realized, the reliability of secure user data and control is improved.Also, terminal device can be in human-computer interaction circle
Display control panel interactive interface in face realizes the visual reality for smart machine so that user inputs operation information
When control or delays time to control, it is simple and convenient, and operation mode is more flexible.
Second embodiment of the present invention is related to a kind of method of the control panel of remotely located smart machine, detailed process
As shown in Figure 2.Second embodiment is improved on the basis of first embodiment, is mainly theed improvement is that：In this hair
In bright second embodiment, one kind that terminal device establishes connection with the Intelligent target equipment in same LAN is provided
Specific implementation form increases the flexibility of embodiment of the present invention.
Step 202 is roughly the same to step 104 with step 102 in first embodiment to step 204 in present embodiment,
It is repeated to reduce, details are not described herein, is only illustrated below to different piece：
Step 201, it establishes and connects with the Intelligent target equipment in same LAN.
In present embodiment, step 201, to sub-step 2014, is specifically described below including sub-step 2011：
Sub-step 2011 searches for smart machine by the broadcast packet and multicast packet protocol of LAN subscriber datagram UDP.
Specifically, terminal device and smart machine are interacted by local area network, terminal device passes through local area network
User Datagram Protocol UDP send broadcast message.Wherein, broadcast message sends out response message for controlling smart machine.It rings
It includes the facility information of smart machine to answer message.In this way, terminal device can be automatically detected in place by local area network
All smart machines in current local area network.
Sub-step 2012, using the smart machine searched as the Intelligent target equipment in same LAN.
Specifically, terminal device is by monitoring TCP (Transmission Control Protocol, referred to as " TCP ")
The mode of port and udp port receives the response message of smart machine feedback.Then, terminal device is taken in message according to response
Intelligent target equipment is arranged in the facility information of band.
In present embodiment, the information of smart machine is added to by terminal device in the information for getting smart machine
In local list, local list is updated, and safeguard to local list.Specifically, terminal device is in the intelligence that will be searched
Can equipment information, before being added to local list, also detect local list in whether the information of existing smart machine, if having deposited
In the information of smart machine, then the information code of smart machine is abandoned, if there is no the information of smart machine, then executes and will search for
The information of the smart machine arrived, is added to local list.Own in this way, terminal device can not only be added disposably in LAN
Smart machine, achieve the purpose that quickly to add and quickly control, and the information of same smart machine can be avoided to be repeated
Addition, is easy to the maintenance and update of local list.
Compared with first embodiment, in present embodiment, terminal device can automatically be got positioned at current local
All smart machines in net realize that the control for more smart machines provides the foundation for user in terminal equipment side.
Third embodiment of the invention is related to a kind of method of the control panel of remotely located smart machine.Third embodiment party
Formula is improved on the basis of first embodiment, is mainly theed improvement is that：In third embodiment of the invention, provide
A kind of specific implementation form of the terminal device displaying based on the control panel interactive interface in the message for throwing screen agreement, increases
The flexibility of embodiment of the present invention.
Specifically, terminal device with the Intelligent target equipment in same LAN after establishing connection, terminal is set
It is standby that the request for recording control panel interactive interface is sent to Intelligent target equipment, in order to which Intelligent target equipment records control panel
Interactive interface, and generate data packet.Then, data packet is carried and is fed back in based on the message for throwing screen agreement by Intelligent target equipment
To terminal device.Wherein, when Intelligent target equipment based on the message for throwing screen agreement by terminal device is sent to, TCP can be utilized
Procotol or UDP procotols are transmitted.
More specifically, terminal device is right in the message based on throwing screen agreement for receiving Intelligent target equipment feedback
It is parsed based on the data packet in the message for throwing screen agreement, obtains control panel interactive interface.Then, terminal device creates packet
The human-computer interaction interface of display control is included, and the control panel interactive interface is rendered into the form of video or image described
In the display control of human-computer interaction interface.Such as, it may include coding parameter in the data packet of carrying control panel interactive interface, regard
Frequency frame and video parameter etc., terminal device parses data packet, obtains coding parameter, video frame and video in data packet
Parameter etc., and video parameter and video frame are sent into decoder, the hard decoders provided using system are decoded, and video is obtained
Image.Then, terminal device creates a page control, decoded video image is rendered on page control, to realize
Control panel interactive interface is in local display.
In present embodiment, terminal device is receiving the disappearing based on throwing screen agreement that Intelligent target equipment is sent by connection
When breath, by way of monitoring TCP port and udp port, the message based on throwing screen agreement that Intelligent target equipment is sent is received,
It can ensure that terminal device is received based on the message for throwing screen agreement.
Compared with first embodiment, in present embodiment, provides displaying that is easy to operate, being easy to implement and be based on throwing and shield
A kind of specific implementation form of control panel interactive interface in the message of agreement, increases the flexible of embodiment of the present invention
Property.
Four embodiment of the invention is related to a kind of method of the control panel of remotely located smart machine, is applied to intelligence
Equipment, detailed process are as shown in Figure 3.The core of present embodiment is：The control panel interaction that Intelligent target equipment is recorded
In showing interface to terminal device, according to the operation information that user inputs control panel interactive interface, in terminal equipment side reality
Now it is directed to the visual control operation of smart machine.Below to the control plane of the remotely located smart machine of present embodiment
The realization details of the method for plate is specifically described, and the following contents only for convenience of the realization details provided is understood, is not implemented
This programme it is necessary.
Step 301, it establishes and connects with the terminal device in same LAN.
Step 302, when detecting the control switch order from terminal device, control panel interactive interface is recorded.
Specifically, Intelligent target equipment can be equipped with entity display screen, virtual display can not also be equipped with.More specifically
Say that Intelligent target equipment can use the establishment virtual display method of system display manager class to create a virtual display in ground
Device, and the content on virtual monitor is rendered on page control.Secondly, Intelligent target equipment can be compiled using system media
Code device class carries out hard coded, is inputted page control as it.Finally, Intelligent target equipment takes out relevant parameter from encoder
Video frame after (e.g., coding parameter, video parameter etc.) and coding, using relevant parameter and video frame as the control panel recorded
Interactive interface is packaged.
Step 303, the control panel interactive interface of recording is shielded into agreement by throwing and is sent to terminal device.
Specifically, Intelligent target equipment carries packaged information is sent to end in based on the message for throwing screen agreement
End equipment.Wherein, Intelligent target equipment can utilize TCP procotols or the transmission of UDP procotols disappearing based on throwing screen agreement
Breath.
Step 304, the setting regulating command that receiving terminal apparatus is sent.
Specifically, Intelligent target equipment monitors TCP port, the setting regulating command that receiving terminal apparatus is sent can
The reliability and continuity of guarantee event.
Step 305, operation corresponding with setting regulating command is executed.
Specifically, smart machine can be according to setting regulating command, using pitching pile Instrumentation, with simulation
User realizes that terminal equipment side is directed to the operation information of the control panel interactive interface in human-computer interaction interface on terminal device
The visual control of smart machine operates.
Compared with prior art, in present embodiment, the control between terminal device and smart machine can be not based on outer
Network server is realized, the reliability of secure user data and control is improved.Also, terminal device can be in human-computer interaction circle
Display control panel interactive interface in face realizes the visual reality for smart machine so that user inputs operation information
When control or delays time to control, it is simple and convenient, and operation mode is more flexible.
The step of various methods divide above, be intended merely to describe it is clear, when realization can be merged into a step or
Certain steps are split, multiple steps are decomposed into, as long as including identical logical relation, all in the protection domain of this patent
It is interior；To either adding inessential modification in algorithm in flow or introducing inessential design, but its algorithm is not changed
Core design with flow is all in the protection domain of the patent.
Fifth embodiment of the invention is related to a kind of terminal device 41, as shown in figure 4, including：Smart machine link block
411, receiving module 412, display module 413, detection module 414, directive generation module 415 and instruction sending module 416, with
Under be specifically described：
Smart machine link block 411 is connected for being established with the Intelligent target equipment in same LAN.
Specifically, smart machine link block 411 can be to network access equipment (e.g., wireless router) sending device
Inquiry request.Network access equipment is obtained and is currently kept with itself when receiving the equipment query request from terminal device
The information of each smart machine of connection, and feed back to smart machine link block 411.Smart machine link block 411 is according to each
Each smart machine is set as Intelligent target equipment, and establishes and connect with each smart machine by the information of smart machine.
Receiving module 412 is used to receive the message based on throwing screen agreement that Intelligent target equipment is sent by connection.Its
In, include the control panel interactive interface that Intelligent target equipment is recorded based on the message for shielding agreement is thrown.
Display module 413, for showing based on the control panel interactive interface in the message for throwing screen agreement.
It is shown in local human-computer interaction interface specifically, terminal device launches control panel interactive interface
Show.
Detection module 414, for detecting the operation information for the input of control panel interactive interface.
Specifically, user can be outer using mouse, keyboard etc. according to content shown in control panel interactive interface
It connects equipment to be operated, in order to the operation that detection module 414 is inputted according to external equipment, detects operation letter input by user
Breath.
More specifically, when terminal device be equipped with touching display screen when, detection module 414 may include monitor submodule with
And processing submodule.Submodule is monitored, the monitoring for carrying out touch event to control panel interactive interface；Submodule is handled,
Operation information for obtaining input according to the touch event listened to.Wherein, touch event can be to click, pressing, slide
Equal action events.
However, the example above is only to illustrate, user is not detected to being mapped to people to detection module 414 in present embodiment
The specific implementation form of the operation information of operation interface in machine interactive interface does any restriction.
Directive generation module 415, for generating setting for control targe smart machine according to the operation information detected
Set regulating command.
Specifically, operation information and the correspondence that regulating command is set are prestored in directive generation module 415, instruction
Generation module 415 is inquired in the correspondence to prestore and generates the corresponding setting regulating command of operation information.Wherein, it is arranged
Regulating command can be setting regulating command in real time, or delay setting regulating command.
Instruction sending module 416 is sent to Intelligent target equipment for regulating command will to be arranged, is held for Intelligent target equipment
Row operation corresponding with setting regulating command.
Specifically, instruction sending module 416 is by the setting regulating command of generation when being sent to smart machine, Ke Yixian
The information that regulating command and smart machine is arranged is sent jointly into network access equipment, intelligence is transmitted to by network access equipment
It can equipment；Instruction sending module 416 can also will be arranged regulating command by internet and send out directly according to the information of smart machine
Give smart machine.In present embodiment, instruction sending module 416 is sent to using TCP procotols by regulating command is arranged
Smart machine, the reliability and continuity of event are higher.
It is not difficult to find that present embodiment is device embodiment corresponding with first embodiment, present embodiment can be with
First embodiment is worked in coordination implementation.The relevant technical details mentioned in first embodiment still have in the present embodiment
Effect, in order to reduce repetition, which is not described herein again.Correspondingly, the relevant technical details mentioned in present embodiment are also applicable in
In first embodiment.
Sixth embodiment of the invention is related to a kind of terminal device, and sixth embodiment is on the basis of five embodiments
It is improved, is mainly theed improvement is that：In sixth embodiment of the invention, smart machine link block 411 is provided
A kind of specific implementation form, increases the flexibility of embodiment of the present invention.
Specifically, smart machine link block 411 includes：Search for submodule, specified submodule and connection submodule.
Submodule is searched for, for the broadcast packet and multicast packet protocol by LAN subscriber datagram UDP, searches for smart machine.It is specified
Submodule, for using the smart machine searched as the Intelligent target equipment in same LAN.Submodule is connected, is used
It is connected in being established with Intelligent target equipment.
In present embodiment, search submodule sends broadcast message by the User Datagram Protocol UDP of local area network.
Wherein, broadcast message sends out response message for controlling smart machine.Response message includes the facility information of smart machine.And
And search submodule receives the response message of smart machine feedback by way of monitoring TCP port and udp port.Then,
Intelligent target equipment is arranged in the facility information that specified submodule carries in message according to response.
It is not difficult to find that present embodiment is device embodiment corresponding with second embodiment, present embodiment can be with
Second embodiment is worked in coordination implementation.The relevant technical details mentioned in second embodiment still have in the present embodiment
Effect, in order to reduce repetition, which is not described herein again.Correspondingly, the relevant technical details mentioned in present embodiment are also applicable in
In second embodiment.
Seventh embodiment of the invention is related to a kind of terminal device, and the 7th embodiment is on the basis of five embodiments
It is improved, is mainly theed improvement is that：In seventh embodiment of the invention, the one kind for providing display module 413 is specific
Way of realization increases the flexibility of embodiment of the present invention.Also, in present embodiment, receiving module 412 is passing through connection
When receiving the message based on throwing screen agreement that Intelligent target equipment is sent, by way of monitoring TCP port and udp port, connect
Receive the message based on throwing screen agreement that Intelligent target equipment is sent, it can be ensured that terminal device receives disappearing based on throwing screen agreement
Breath.
Specifically, display module 413 includes：Control creates submodule and renders submodule.Control creates submodule,
Control is shown for being created in local human-computer interaction interface.Submodule is rendered, is used for the control panel interactive interface
It is rendered into the form of video image in the display control.
It is not difficult to find that present embodiment is device embodiment corresponding with third embodiment, present embodiment can be with
Third embodiment is worked in coordination implementation.The relevant technical details mentioned in third embodiment still have in the present embodiment
Effect, in order to reduce repetition, which is not described herein again.Correspondingly, the relevant technical details mentioned in present embodiment are also applicable in
In third embodiment.
Eighth embodiment of the invention is related to a kind of smart machine 42, as shown in figure 5, including：Terminal device link block
421, respond module 422, sending module 423, command reception module 424, control module 425.It is specifically described below：
Terminal device link block 421 is connected for being established with the terminal device in same LAN.
Respond module 422, for when detecting the message from terminal device, recording control panel interactive interface.
Specifically, Intelligent target equipment can be equipped with entity display screen, virtual display can not also be equipped with.More specifically
Ground says that respond module 422 can use the establishment virtual display method of system display manager class to create a virtual monitor,
And the content on virtual monitor is rendered on page control.Secondly, respond module 422 can use system media encoder
Class carries out hard coded, is inputted page control as it.Finally, (e.g., respond module 422 takes out relevant parameter from encoder
Coding parameter, video parameter etc.) and coding after video frame, using relevant parameter and video frame as the control panel interaction recorded
Interface is packaged.
Sending module 423, for the control panel interactive interface recorded to be sent to the end by the connection
End equipment.
Specifically, sending module 423 carries packaged information is sent to end in based on the message for throwing screen agreement
End equipment.Wherein, sending module 423 can utilize TCP procotols or the transmission of UDP procotols disappearing based on throwing screen agreement
Breath.
Command reception module 424, the setting regulating command sent for receiving the terminal device.
Specifically, command reception module 424 monitors TCP port, the setting regulating command that receiving terminal apparatus is sent, energy
Enough ensure the reliability and continuity of event.
Control module 425, for executing operation corresponding with the setting regulating command.
Specifically, control module 425 can be according to setting regulating command, using pitching pile Instrumentation, with mould
User realizes terminal equipment side needle to the operation information of the control panel interactive interface in human-computer interaction interface on quasi- terminal device
Visual control operation to smart machine.
It is not difficult to find that present embodiment is device embodiment corresponding with the 4th embodiment, present embodiment can be with
4th embodiment is worked in coordination implementation.The relevant technical details mentioned in 4th embodiment still have in the present embodiment
Effect, in order to reduce repetition, which is not described herein again.Correspondingly, the relevant technical details mentioned in present embodiment are also applicable in
In first embodiment.
It is noted that each module involved in present embodiment is logic module, and in practical applications, one
A logic unit can be a physical unit, can also be a part for a physical unit, can also be with multiple physics lists
The combination of member is realized.In addition, in order to protrude the innovative part of the present invention, it will not be with solution institute of the present invention in present embodiment
The technical issues of proposition, the less close unit of relationship introduced, but this does not indicate that there is no other single in present embodiment
Member.
Ninth embodiment of the invention is related to a kind of tele-control system of smart machine, including：5th embodiment is extremely
In 7th embodiment it is any in the terminal device that is mentioned to and the smart machine being mentioned in the 8th embodiment.
That is, it will be understood by those skilled in the art that implement the method for the above embodiments be can be with
Relevant hardware is instructed to complete by program, which is stored in a storage medium, including some instructions are making
It obtains an equipment (can be microcontroller, chip etc.) or processor (processor) executes side described in each embodiment of the application
The all or part of step of method.And storage medium above-mentioned includes：USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. are various can store journey
The medium of sequence code.
It will be understood by those skilled in the art that the respective embodiments described above are to realize specific embodiments of the present invention,
And in practical applications, can to it, various changes can be made in the form and details, without departing from the spirit and scope of the present invention.
Implement the embodiment of the present invention, will have the advantages that：
The method and device of the control panel of above-mentioned remotely located smart machine so that user is with mobile phone, tablet or pen
Remember this computer remote control intelligent sound box, intelligent air condition, intelligent refrigerator etc. without display interactive interface or display interactive interface compared with
When small intelligent terminal, throwing can be passed through by receiving intelligent sound box, intelligent air condition, intelligent refrigerator and shield the control that agreement is sent
Panel interactive interface visually to show adjustable setting option to user, and user can be by patterned setting interface
The operations such as the temperature adjusting of the volume adjustment to intelligent sound box, intelligent air condition are completed, to improve the convenience of operation.
In one embodiment, as shown in fig. 6, Fig. 6 illustrates a kind of control of the above-mentioned remotely located smart machine of operation
The server apparatus of the computer system 10 based on von Neumann system of the method for panel.The computer system can be direct
The server, server cluster or offer virtual machine for executing the above put-on method are held as server program running environment
The server set group facility of row the above put-on method.Specifically, may include the network interface connected by system bus
1001, processor 1002, memory 1003.Memory 1003 may include external memory 10032 (such as hard disk, CD or floppy disk
Deng) and built-in storage 10034.
In the present embodiment, the operation of this method is based on computer program, and the program file of the computer program is stored in
In the external memory 10032 of the aforementioned computer system 10 based on von Neumann system, it is loaded into built-in storage at runtime
It in 10034, is then compiled as being transferred in processor 1002 after machine code executing, so that being based on von Neumann system
Computer system 10 in form initialization module 102 in logic, Fellow searching module 104, content and propagate evaluation of estimate update
Module 106, content-data pushing module 108.And in the above put-on method implementation procedure, the parameter of input passes through net
Network interface 1001 receives, and is transferred in memory 1003 and caches, and is then input in processor 1002 and is handled, processing
Result data or be cached in memory 1003 is subsequently handled, or is passed to network interface 1001 and is exported.
The above disclosure is only the preferred embodiments of the present invention, cannot limit the right model of the present invention with this certainly
It encloses, therefore equivalent changes made in accordance with the claims of the present invention, is still within the scope of the present invention.
Claims (10)
1. a kind of method of the control panel of remotely located smart machine, which is characterized in that it is applied to terminal device, including：
Smart machine is searched in a local network, Intelligent target equipment is determined in the smart machine searched, with the target intelligence
It can equipment foundation connection；
Control switch order is sent by described connect to the Intelligent target equipment, the Intelligent target equipment is received and is based on throwing
Shield the control panel interactive interface of the Intelligent target equipment of agreement feedback；
Operation information of the detection for control panel interactive interface input；
The setting regulating command for controlling the Intelligent target equipment is generated according to the operation information；
The setting regulating command is sent to the Intelligent target equipment, so that the Intelligent target equipment passes through described in execution
The configuration of regulating command adjusting control panel is set.
2. the method for the control panel of remotely located smart machine according to claim 1, which is characterized in that described in office
Search smart machine includes in the net of domain：
Pass through the broadcast packet and multicast packets protocol search smart machine of LAN subscriber datagram UDP.
3. the method for the control panel of remotely located smart machine according to any one of claim 1 to 2, feature exist
In the detection further includes before for the operation information of control panel interactive interface input：
Establishment includes the human-computer interaction interface of display control, and by the control panel interactive interface in the form of video or image
It is rendered into the display control of the human-computer interaction interface.
4. the method for the control panel of remotely located smart machine according to claim 3, which is characterized in that the throwing screen
Agreement includes at least one of DLNA agreements, Miracast agreements and Airplay agreements.
5. the method for the control panel of remotely located smart machine according to any one of claim 1 to 2, feature exist
In the detection includes for the operation information of control panel interactive interface input：
The monitoring that touch event is carried out to the control panel interactive interface obtains the behaviour of input according to the touch event listened to
Make information, the operation information includes touch location, sliding trace, touches number, touches in duration and pressing dynamics at least
It is a kind of.
6. a kind of device of the control panel of remotely located smart machine, which is characterized in that it is applied to terminal device, including：
Smart machine is searched in a local network, Intelligent target equipment is determined in the smart machine searched, with the target intelligence
It can equipment foundation connection；
Control switch order is sent by described connect to the Intelligent target equipment, the Intelligent target equipment is received and is based on throwing
Shield the control panel interactive interface of the Intelligent target equipment of agreement feedback；
Operation information of the detection for control panel interactive interface input；
The setting regulating command for controlling the Intelligent target equipment is generated according to the operation information；
The setting regulating command is sent to the Intelligent target equipment, so that the Intelligent target equipment passes through described in execution
The configuration of regulating command adjusting control panel is set.
7. the device of the control panel of remotely located smart machine according to claim 6, which is characterized in that described in office
Search smart machine includes in the net of domain：
Pass through the broadcast packet and multicast packets protocol search smart machine of LAN subscriber datagram UDP.
8. the device of the control panel of the remotely located smart machine according to any one of claim 6 to 7, feature exist
In the detection further includes before for the operation information of control panel interactive interface input：
Establishment includes the human-computer interaction interface of display control, and by the control panel interactive interface in the form of video or image
It is rendered into the display control of the human-computer interaction interface.
9. the device of the control panel of remotely located smart machine according to claim 8, which is characterized in that the throwing screen
Agreement includes at least one of DLNA agreements, Miracast agreements and Airplay agreements.
10. the device of the control panel of the remotely located smart machine according to any one of claim 6 to 7, feature
It is, the detection includes for the operation information of control panel interactive interface input：
The monitoring that touch event is carried out to the control panel interactive interface obtains the behaviour of input according to the touch event listened to
Make information, the operation information includes touch location, sliding trace, touches number, touches in duration and pressing dynamics at least
It is a kind of.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810275033.5A CN108667900A (en) | 2018-03-29 | 2018-03-29 | The method and device of the control panel of remotely located smart machine |
| PCT/CN2018/126030 WO2019184533A1 (en) | 2018-03-29 | 2018-12-31 | Method and apparatus for remotely configuring control panel of intelligent device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810275033.5A CN108667900A (en) | 2018-03-29 | 2018-03-29 | The method and device of the control panel of remotely located smart machine |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108667900A true CN108667900A (en) | 2018-10-16 |
Family
ID=63782620
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810275033.5A Pending CN108667900A (en) | 2018-03-29 | 2018-03-29 | The method and device of the control panel of remotely located smart machine |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108667900A (en) |
| WO (1) | WO2019184533A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110083324A (en) * | 2019-04-30 | 2019-08-02 | 华为技术有限公司 | Method, apparatus, electronic equipment and the computer storage medium of Image Rendering |
| WO2019184533A1 (en) * | 2018-03-29 | 2019-10-03 | 深圳市九洲电器有限公司 | Method and apparatus for remotely configuring control panel of intelligent device |
| CN113014614A (en) * | 2019-12-20 | 2021-06-22 | 青岛海信移动通信技术股份有限公司 | Equipment control method, control equipment and controlled equipment |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112000410B (en) * | 2020-08-17 | 2024-03-19 | 努比亚技术有限公司 | Screen projection control method, device and computer readable storage medium |
| CN114115775A (en) * | 2021-11-12 | 2022-03-01 | 广州视源电子科技股份有限公司 | Information screen projection method and device, terminal device, display device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014030929A1 (en) * | 2012-08-22 | 2014-02-27 | 에스케이텔레콤 주식회사 | Apparatus for providing user interface for sharing media contents in home network and recording medium for recording programs |
| CN104219551A (en) * | 2014-09-29 | 2014-12-17 | 武汉诚迈科技有限公司 | Method for screen sharing and remote control of intelligent device |
| CN105099517A (en) * | 2015-06-24 | 2015-11-25 | 小米科技有限责任公司 | Connection establishing method and device |
| CN105160854A (en) * | 2015-09-16 | 2015-12-16 | 小米科技有限责任公司 | Equipment control method, device and terminal equipment |
| CN106161151A (en) * | 2016-06-12 | 2016-11-23 | 青岛海信移动通信技术股份有限公司 | The control method of a kind of Smart Home and equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108667900A (en) * | 2018-03-29 | 2018-10-16 | 深圳市九洲电器有限公司 | The method and device of the control panel of remotely located smart machine |
-
2018
- 2018-03-29 CN CN201810275033.5A patent/CN108667900A/en active Pending
- 2018-12-31 WO PCT/CN2018/126030 patent/WO2019184533A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014030929A1 (en) * | 2012-08-22 | 2014-02-27 | 에스케이텔레콤 주식회사 | Apparatus for providing user interface for sharing media contents in home network and recording medium for recording programs |
| CN104219551A (en) * | 2014-09-29 | 2014-12-17 | 武汉诚迈科技有限公司 | Method for screen sharing and remote control of intelligent device |
| CN105099517A (en) * | 2015-06-24 | 2015-11-25 | 小米科技有限责任公司 | Connection establishing method and device |
| CN105160854A (en) * | 2015-09-16 | 2015-12-16 | 小米科技有限责任公司 | Equipment control method, device and terminal equipment |
| CN106161151A (en) * | 2016-06-12 | 2016-11-23 | 青岛海信移动通信技术股份有限公司 | The control method of a kind of Smart Home and equipment |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019184533A1 (en) * | 2018-03-29 | 2019-10-03 | 深圳市九洲电器有限公司 | Method and apparatus for remotely configuring control panel of intelligent device |
| CN110083324A (en) * | 2019-04-30 | 2019-08-02 | 华为技术有限公司 | Method, apparatus, electronic equipment and the computer storage medium of Image Rendering |
| CN113014614A (en) * | 2019-12-20 | 2021-06-22 | 青岛海信移动通信技术股份有限公司 | Equipment control method, control equipment and controlled equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019184533A1 (en) | 2019-10-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108667900A (en) | The method and device of the control panel of remotely located smart machine | |
| CN108228125A (en) | The long-range control method and system of smart machine | |
| CN106415501B (en) | Mating application program for activity cooperation | |
| CN111459433B (en) | Screen transmission method, device and storage medium | |
| CN102866848B (en) | Method for controlling cloud classroom intelligent pointer based on wifi | |
| CN109104416B (en) | Multi-device cooperation cloud service platform based on PON (Passive optical network) local area network | |
| CN106201430A (en) | A kind of method of volume adjusting and electronic equipment | |
| CN103685389A (en) | System and method for realizing user interface interaction through remotely controlling data terminal | |
| CN109660858A (en) | Transmission method, device, terminal and the server of direct broadcasting room interaction data | |
| CN108011951B (en) | Remote assistance method, device and system and electronic equipment | |
| CN103281580A (en) | Television set remote control method for separating user interface and system thereof | |
| CN106354107A (en) | Smart classroom control system and its centralized control facilities | |
| CN107147945A (en) | Multimedia resource play system, method and device | |
| CN107948566A (en) | Realize that plug and play passes the method and device of screen | |
| CN107948567A (en) | The method and device of the wired biography screens of USB | |
| CN110221759A (en) | A kind of element dragging method, device, storage medium and interactive intelligent tablet computer | |
| CN202799005U (en) | Cloud computing based internet monitoring system of set top box and set top box | |
| CN113364587A (en) | System, method, device, medium and equipment for processing streaming media data | |
| CN110177300A (en) | Monitoring method, device, electronic equipment and the storage medium of running state of programs | |
| CN112583866B (en) | Sharing method and device of intelligent household electrical appliance, electronic equipment and medium | |
| CN105812432A (en) | Cloud file processing method and device | |
| CN202533929U (en) | Screen capture system based on Android platform intelligent television | |
| CN104053057A (en) | Hardware upgrading method, equipment and system | |
| CN110324692B (en) | Live broadcast room processing method and device for playing videos through small window | |
| CN103901824B (en) | Wired home control method and system, wired home control centre and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181016 |