CN115668892A - Master control device, auxiliary device, control system, and control method - Google Patents

Master control device, auxiliary device, control system, and control method Download PDF

Info

Publication number
CN115668892A
CN115668892A CN202080101244.2A CN202080101244A CN115668892A CN 115668892 A CN115668892 A CN 115668892A CN 202080101244 A CN202080101244 A CN 202080101244A CN 115668892 A CN115668892 A CN 115668892A
Authority
CN
China
Prior art keywords
control
information
equipment
auxiliary
main control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202080101244.2A
Other languages
Chinese (zh)
Inventor
田文强
张治�
沈嘉
杨宁
唐海
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Publication of CN115668892A publication Critical patent/CN115668892A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications

Abstract

The embodiment of the application provides a main control device, an auxiliary device, a control system and a control method, which can avoid touch control of a common control interface of a public device and avoid potential safety and health risks of a public contact type touch control mode. This master control equipment includes: the device comprises a first authorization module, a first input module and a first processing module, wherein the first authorization module is used for authorizing the auxiliary device to acquire the control right of the control interface of the main control device; the first input module is used for receiving control information which is sent by the auxiliary equipment and used for controlling the control interface; the first processing module is used for analyzing and executing the control information.

Description

Master control device, auxiliary device, control system, and control method Technical Field
The present invention relates to the field of communications, and in particular, to a master device, an auxiliary device, a control system, and a control method.
Background
Electronic displays are becoming increasingly common in public areas such as the keys of elevators, touch screens for shopping malls, touch screens for industrial controls, etc. However, since many people need to slide, drag, click, etc. on the screen of a public device, such a common touch method is risky, for example, during epidemic outbreak, if a certain user transfers possibly pathogenic viruses and bacteria to the screen or keys of the public device by touch, then the subsequent user touches again, which presents a great health risk. For another example, the electric leakage of the public device may cause an electric shock risk of the touch control, such as a touch demand in an industrial control scenario.
Disclosure of Invention
The embodiment of the application provides a main control device, an auxiliary device, a control system and a control method, which can avoid touch control of a common control interface of a public device and avoid potential safety and health risks of a public contact type touch control mode.
In a first aspect, a master control device is provided, including:
a first authorization module, a first output module, a first input module, and a first processing module,
the first authorization module is used for authorizing the auxiliary equipment to acquire the control right of the control interface of the main control equipment;
the first output module is configured to transmit control interface information of the main control device to the auxiliary device, where the control interface information is used by the auxiliary device to determine control information for controlling the control interface;
the first input module is used for receiving the control information sent by the auxiliary equipment;
the first processing module is used for analyzing and executing the control information.
In a second aspect, there is provided an auxiliary device comprising:
a second authorization module, a second output module, a second input module, and a second processing module, wherein,
the second authorization module is used for the auxiliary equipment to acquire the control right of the control interface of the main control equipment authorized by the main control equipment;
the second input module is used for receiving the control interface information of the main control equipment sent by the main control equipment;
the second processing module is used for determining control information for controlling the control interface according to the control interface information;
the second output module is used for transmitting the control information to the main control equipment.
In a third aspect, a control method is provided, including:
the main control equipment authorizes the auxiliary equipment to obtain the control right of a control interface of the main control equipment;
the main control device transmits control interface information of the main control device to the auxiliary device, wherein the control interface information is used for the auxiliary device to determine control information for controlling the control interface;
the main control device receives the control information sent by the auxiliary device;
the master control device parses and executes the control information.
In a fourth aspect, there is provided a control method comprising:
the auxiliary equipment acquires the control right of the control interface of the main control equipment authorized by the main control equipment;
the auxiliary equipment receives the control interface information of the main control equipment sent by the main control equipment;
the auxiliary equipment determines control information for controlling the control interface according to the control interface information;
the auxiliary device transmits the control information to the main control device.
In a fifth aspect, a master device is provided, configured to perform the method in the third aspect or each implementation manner thereof.
Specifically, the master control device includes a functional module configured to execute the method in the third aspect or its implementation manner.
In a sixth aspect, an auxiliary device is provided for performing the method of the fourth aspect or its implementations.
In particular, the auxiliary device comprises functional modules for performing the methods of the fourth aspect or its implementations described above.
In a seventh aspect, a master device is provided that includes a processor and a memory. The memory is used for storing a computer program, and the processor is used for calling and running the computer program stored in the memory to execute the method in the third aspect or each implementation mode thereof.
In an eighth aspect, an auxiliary device is provided that includes a processor and a memory. The memory is used for storing a computer program, and the processor is used for calling and running the computer program stored in the memory, and executing the method in the fourth aspect or each implementation manner thereof.
In a ninth aspect, an apparatus is provided for implementing the method in any one of the third to fourth aspects or its implementation manners.
Specifically, the apparatus includes: a processor configured to call and run the computer program from the memory, so that the apparatus on which the apparatus is installed performs the method according to any one of the third aspect to the fourth aspect or the implementation manner thereof.
A tenth aspect provides a computer-readable storage medium for storing a computer program, the computer program causing a computer to execute the method of any one of the third to fourth aspects or implementations thereof.
In an eleventh aspect, there is provided a computer program product comprising computer program instructions for causing a computer to perform the method of any one of the third to fourth aspects or implementations thereof.
In a twelfth aspect, there is provided a computer program which, when run on a computer, causes the computer to perform the method of any of the third to fourth aspects or implementations thereof.
According to the technical scheme, the auxiliary equipment is used for obtaining the control authority of the main control equipment, obtaining the control interface of the main control equipment and performing corresponding interactive operation, the auxiliary equipment is used for indirectly controlling the main control equipment, the touch of the common control interface of the public equipment can be avoided, and potential safety and health risks of a public contact type touch mode are avoided.
Drawings
Fig. 1 is a schematic diagram of a communication system architecture provided in an embodiment of the present application.
Fig. 2 is a schematic block diagram of a control system provided according to an embodiment of the present application.
Fig. 3 is a schematic diagram of a first authorization zone of a master device provided according to an embodiment of the application.
Fig. 4 is a schematic diagram of a second authorization zone of an auxiliary device provided in accordance with an embodiment of the application.
Fig. 5 is a schematic flow chart of an authorization process provided according to an embodiment of the present application.
Fig. 6 is a schematic flow chart of another authorization flow provided according to an embodiment of the present application.
Fig. 7 is a schematic diagram illustrating content respectively displayed by a main control device and an auxiliary device according to an embodiment of the present application.
Fig. 8 is a schematic flow chart of a control flow provided according to an embodiment of the present application.
Fig. 9 is a schematic diagram of another main control device and an auxiliary device respectively displaying content provided according to an embodiment of the present application.
Fig. 10 is a schematic flow chart of another control flow provided according to an embodiment of the present application.
Fig. 11 is a schematic flow chart of still another control flow provided according to an embodiment of the present application.
Fig. 12 is a schematic diagram of content respectively displayed by a main control device and an auxiliary device provided according to an embodiment of the present application.
Fig. 13 is a schematic flow chart of still another control flow provided according to an embodiment of the present application.
Fig. 14 is a schematic flow chart of still another control flow provided according to an embodiment of the present application.
Fig. 15 is a schematic flow chart of a control method provided according to an embodiment of the present application.
Fig. 16 is a schematic block diagram of a communication device provided according to an embodiment of the present application.
Fig. 17 is a schematic block diagram of an apparatus provided in accordance with an embodiment of the present application.
Fig. 18 is a schematic block diagram of a communication system provided in accordance with an embodiment of the present application.
Detailed Description
Technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art without making any creative effort for the embodiments in the present application belong to the protection scope of the present application.
The communication protocol between the main control device and the auxiliary device in the embodiment of the present application includes, but is not limited to, at least one of the following:
near Field Communication (NFC), bluetooth protocol, wireless-Fidelity (Wi-Fi) protocol, ultra Wide Band (UWB) protocol, zigbee (Zigbee) protocol, cellular Communication protocol, sidelink Communication protocol, device to Device (D2D) protocol.
In the case that the communication protocol between the main control device and the auxiliary device is a cellular communication protocol, the technical solution of the embodiment of the present application may be applied to various communication systems, for example: global System for Mobile communications (GSM) System, code Division Multiple Access (CDMA) System, wideband Code Division Multiple Access (WCDMA) System, general Packet Radio Service (GPRS), long Term Evolution (Long Term Evolution, LTE) System, LTE-a System, new Radio (NR) System, evolution System of NR System, LTE-based Access to unlicensed spectrum, LTE-U) System, NR (NR-based to unlicensed spectrum) System on unlicensed spectrum, non-Terrestrial communication network (NTN) System, universal Mobile Telecommunications System (UMTS), wireless Local Area Network (WLAN), wireless Fidelity (WiFi), 5th-Generation (5G) System, or other communication systems.
With the development of Communication technology, a mobile Communication system will support not only conventional Communication but also, for example, device to Device (D2D) Communication, machine to Machine (M2M) Communication, machine Type Communication (MTC), vehicle to Vehicle (V2V) Communication, or Vehicle to internet (V2X) Communication, bluetooth Communication, zigbee (Zigbee) Communication, ultra Wide Band (UWB) Communication, etc., and the embodiments of the present application can also be applied to these Communication systems.
Optionally, the communication system in the embodiment of the present application may be applied to a Carrier Aggregation (CA) scenario, may also be applied to a Dual Connectivity (DC) scenario, and may also be applied to an independent (SA) networking scenario.
Optionally, the communication system in the embodiment of the present application may be applied to an unlicensed spectrum, where the unlicensed spectrum may also be considered as a shared spectrum; alternatively, the communication system in the embodiment of the present application may also be applied to a licensed spectrum, where the licensed spectrum may also be regarded as an unshared spectrum.
Various embodiments are described in conjunction with a master device and an auxiliary device, where the auxiliary device may also be referred to as a User Equipment (UE), an access terminal, a subscriber unit, a subscriber station, a mobile station, a remote terminal, a mobile device, a User terminal, a wireless communication device, a User agent, or a User Equipment.
The auxiliary device may be a STATION (ST) in a WLAN, and may be a cellular phone, a cordless phone, a Session Initiation Protocol (SIP) phone, a Wireless Local Loop (WLL) STATION, a Personal Digital Assistant (PDA) device, a handheld device with Wireless communication capability, a computing device or other processing device connected to a Wireless modem, a vehicle-mounted device, a wearable device, a terminal device in a next generation communication system such as an NR Network, or a terminal device in a future evolved Public Land Mobile Network (PLMN) Network, and so on.
In embodiments of the present application, the auxiliary device may be deployed on land, including indoors or outdoors, hand-held, worn, or vehicle-mounted; can also be deployed on the water surface (such as a ship and the like); and may also be deployed in the air (e.g., airplanes, balloons, satellites, etc.).
In the embodiment of the present application, the auxiliary device may be a Mobile Phone (Mobile Phone), a tablet computer (Pad), a computer with a wireless transceiving function, a Virtual Reality (VR) terminal device, an Augmented Reality (AR) terminal device, a wireless terminal device in industrial control (industrial control), a wireless terminal device in self driving (self driving), a wireless terminal device in remote medical (remote medical), a wireless terminal device in smart grid (smart grid), a wireless terminal device in transportation safety (transportation safety), a wireless terminal device in city (smart city), a wireless terminal device in smart home (smart home), or the like.
By way of example and not limitation, in embodiments of the present application, the auxiliary device may also be a wearable device. Wearable equipment can also be called wearable intelligent equipment, is the general term of applying wearable technique to carry out intelligent design, develop the equipment that can dress to daily wearing, like glasses, gloves, wrist-watch, dress and shoes etc.. The wearable device may be worn directly on the body or may be a portable device integrated into the user's clothing or accessory. The wearable device is not only a hardware device, but also realizes powerful functions through software support, data interaction and cloud interaction. The generalized wearable smart device includes full functionality, large size, and can implement full or partial functionality without relying on a smart phone, such as: smart watches or smart glasses and the like, and only focus on a certain type of application functions, and need to be used in cooperation with other devices such as smart phones, such as various smart bracelets for physical sign monitoring, smart jewelry and the like.
In the embodiment of the present application, the master control device may be a device for communicating with the auxiliary device, and the master control device may be various public contact control devices, for example, a shopping mall self-service machine, a movie theater ticket purchasing machine, a restaurant self-service queuing machine, a factory machine tool control interface, an airport self-service check-in system, a train station ticket fetching machine, a bank ATM, and the like.
In addition, the main control device may also be an Access Point (AP) in the WLAN, a Base Transceiver Station (BTS) in the GSM or CDMA, a Base Station (NodeB, NB) in the WCDMA, an evolved Node B (eNB or eNodeB) in the LTE, a relay Station or an Access Point, or a vehicle-mounted device, a wearable device, and a network device (gNB) in the NR network, or a network device in the PLMN network that is evolved in the future, or a network device in the NTN network.
By way of example and not limitation, in the embodiments of the present application, the master device may have a mobile characteristic, for example, the master device may be a mobile device. Alternatively, the master device may be a satellite, balloon station. For example, the satellite may be a Low Earth Orbit (LEO) satellite, a Medium Earth Orbit (MEO) satellite, a geosynchronous Orbit (GEO) satellite, a High Elliptic Orbit (HEO) satellite, and the like. Optionally, the master control device may also be a base station disposed on land, water, or the like.
For example, a communication system 100 applied in the embodiment of the present application is shown in fig. 1. The communication system 100 may include a master device 110, the master device 110 may be a device in communication with a secondary device 120. The master device 110 may provide communication coverage for a particular geographic area and may communicate with secondary devices 120 located within the coverage area.
Fig. 1 exemplarily shows one master device and two auxiliary devices, and optionally, the communication system 100 may include a plurality of master devices and each master device may include other numbers of auxiliary devices within a coverage area thereof, which is not limited in this embodiment of the present application.
Optionally, the communication system 100 may further include other network entities, which is not limited in this embodiment.
It should be understood that a device having a communication function in a network/system in the embodiments of the present application may be referred to as a communication device. Taking the communication system 100 shown in fig. 1 as an example, the communication device may include a main control device 110 and an auxiliary device 120 having a communication function, and the main control device 110 and the auxiliary device 120 may be the specific devices described above and are not described herein again; the communication device may also include other devices in the communication system 100, which is not limited in this embodiment.
It should be understood that the terms "system" and "network" are often used interchangeably herein. The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
It should be understood that "indication" mentioned in the embodiments of the present application may be a direct indication, an indirect indication, or an indication of an association relationship. For example, a indicates B, which may mean that a directly indicates B, e.g., B may be obtained by a; it may also mean that a indicates B indirectly, for example, a indicates C, and B may be obtained by C; it can also mean that there is an association between a and B.
In the description of the embodiments of the present application, the term "correspond" may indicate that there is a direct correspondence or an indirect correspondence between the two, may also indicate that there is an association between the two, and may also indicate and be indicated, configure and configured, and so on.
The control system mainly has the following control modes:
(1) Public contact type control system
Specifically, the main control device is controlled by a direct contact mode, for example, a specific key is pressed, and operations such as sliding, dragging, clicking and the like are performed on a screen. At present, most of the control modes are adopted by most devices, such as keys of an elevator, a touch screen of self-service shopping in a shopping mall, a touch screen of industrial control and the like. When the master control device is a public device, this means that many users need to perform these operations on a public master control device, and this public touch manner is risky. For example, in the period of epidemic disease outbreak, if a certain user touches a possibly pathogenic virus or bacteria to the master control device, for example, to the screen or keys of the master control device, then a subsequent user touches the master control device again, which may cause a great health risk. In addition, some other potential risks also exist, such as the risk of electric shock caused by leakage of the master control device to the touch control, for example, the touch control requirement in an industrial control scenario.
(2) Private application type control system
Specifically, a control operation is performed in a private application on a private terminal to obtain a service, for example, a specific software is downloaded on a mobile phone, a commodity is purchased in the software, and the like. Since the manipulation is performed on a private application of the private device. However, it should be noted that there are many current scenarios requiring touch operation, and not all scenarios have a private program of a corresponding private terminal to solve the problem accordingly. In addition, if a specific program is designed for all touch requirements at present, for example, through an Application (APP) in a mobile phone, the workload of developing the programs is very large, and even if such a huge Application is designed, storage and transmission of the program are very big problems. It is expected that some of the requirements can be met by a private non-contact control method, but the method is not a generally applicable method and cannot solve the problems of all public contact control systems.
(3) Voice interactive control system
Specifically, the service is obtained by performing control operation in a voice interaction and voice control manner, for example, in some vehicle-mounted applications, the in-vehicle electronic device may be controlled in a voice manner, for example, the music volume may be adjusted. Control operation is performed through voice interaction and voice control to obtain services, and potential health and safety risks caused by public touch keys and screens can be avoided. It should be noted, however, that not all situations apply as a solution the way speech control. For example, in a situation with many people, the transmission of some control information by voice has a problem of privacy exposure, and in addition, the method is not suitable for the use habit of some people. It is also envisioned that some of the requirements may be met by means of voice control, but this is not a universally applicable approach.
In view of the above description, it can be seen that there are certain health and safety risks in the public contact control system with a wide application range. Some private application solutions and voice solutions can meet the requirements of non-public contact control and interaction in partial scenes, but all have some limitations, for example, on the problems of use scenes, development feasibility, privacy and the like.
In summary, the present application provides a control system, which utilizes an auxiliary device to obtain a control authority of a main control device, obtain a control interface of the main control device, and perform corresponding interactive operation, so as to indirectly control the main control device by utilizing the auxiliary device, and the auxiliary device can perform corresponding interactive operation with various main control devices.
Fig. 2 is a schematic flow chart of a control system 200 according to an embodiment of the present application, as shown in fig. 2, the control system 200 including:
a main control device 210 and an auxiliary device 220, wherein the main control device 210 includes a first authorization module 211, a first input module 213, and a first processing module 214, and the auxiliary device 220 includes a second authorization module 221, a second output module 222, and a second processing module 224.
Alternatively, the control system 200 can be applied to the communication system 100 shown in fig. 1, in which case, the main control device 210 can be the main control device 110 in fig. 1, and the auxiliary device 220 can be the auxiliary device 120 in fig. 1.
Specifically, in the main control device 210, the first authorization module 211 is configured to authorize the auxiliary device 220 to obtain a control right of a control interface of the main control device 210; the first input module 213 is configured to receive control information sent by the auxiliary device 220 for controlling the control interface; the first processing module 214 is configured to parse and execute the control information.
Specifically, in the auxiliary device 220, the second authorization module 221 is configured to obtain a control right authorized by the main control device 210 for the control interface of the main control device 210; the second processing module 224 is configured to determine control information for controlling the control interface; the second output module 222 is configured to transmit the control information to the main control device 210.
Optionally, in some embodiments of the present application, the main device 210 further includes a first output module 212, and the auxiliary device 220 further includes a second input module 223, as shown in fig. 2. The first output module 212 is configured to transmit control interface information of the main control device 210 to the auxiliary device 220, where the control information is determined by the auxiliary device 220 according to the control interface information; the second input module 223 is configured to receive the control interface information of the main control device sent by the main control device 210.
It should be noted that, in some scenarios, the operation performed by the first authorization module 211 may also be performed by the first processing module 214, that is, the first authorization module 211 may not be separately provided in the main control device 210. Likewise, in some scenarios, the operations performed by the second authorization module 221 may also be performed by the second processing module 224, i.e., the second authorization module 221 may not be separately provided in the auxiliary device 220.
In this embodiment, the auxiliary device 220 obtains the control authority of the main control device 210, and the user can control the main control device 210 by controlling the auxiliary device 220, that is, in this embodiment, the control system 200 can implement contactless control between the main control device 210 and the auxiliary device 220, thereby avoiding potential risks caused by the contact control.
It should be noted that, in some embodiments of the present application, the main control device 210 and the auxiliary device 220 may also be referred to as participating devices of a screen-projection control system, that is, the main control device 210 may project its control interface onto the auxiliary device 220 for display, so that a user may control the main control device 210 by operating the auxiliary device 220. In this case, the control operations of the primary device 210 may all be extracted and the equivalent operations are performed on the secondary device 220. For example, the operations such as clicking and sliding that originally need to be performed on the main control device 210 may be performed on the screen-projection display interface of the auxiliary device 220, or may be performed on the screen-projection display interface of the auxiliary device 220 with the same effects as the operations such as clicking and sliding.
The master control device 210 in this embodiment may be various public contact control devices, for example: the machine tool control interfaces of the shopping mall self-service shopping machine, cinema ticket purchasing machine, restaurant self-service queuing machine, factory, airport self-service check-in machine system, railway station ticket fetching machine, bank ATM, etc., which are not listed one by one. In addition, the main control device 210 in this embodiment may also be some other control device, for example, a base station in a cellular communication system, and for example, a terminal device in sidelink communication or D2D communication.
The auxiliary device 220 in the embodiment of the present application may be a user device, and specifically may be a user device having a short-range wireless communication function or a cellular wireless communication function, for example: cell-phone, panel computer, intelligent wrist-watch, intelligent glasses etc. no longer lists one by one here.
Optionally, in this embodiment, the control information is generated after the auxiliary device 220 performs at least one of dragging, sliding, clicking, double-clicking, and region selecting. That is, the user may perform at least one of dragging, sliding, clicking, double-clicking, and region selection on the auxiliary device 220, thereby generating the control information. In other words, the user controls the main control device 210 by performing operations of dragging, sliding, clicking, double-clicking, region selection, etc. on the auxiliary device 220.
Optionally, in a possible embodiment, the control flow of the present application may be as shown in steps 1 to 3, for example, in which an automatic shopping machine of a shopping mall is taken as the main control device 210, and a mobile phone is taken as the auxiliary device 220.
Step 1, the mobile phone and the self-service shopping machine are determined to be capable of obtaining the authority of controlling the self-service shopping machine through an authorization module.
And 2, displaying control interfaces of the self-service shopping machine, such as a commodity selection interface, a checkout interface and the like on a mobile phone interface, directly performing operations of commodity selection, checkout and the like on the mobile phone interface by a user, and transmitting the operations of the user on the mobile phone interface to the self-service shopping machine.
And 3, after the self-service shopping machine receives the control information reflecting the user operation, making corresponding operation according to the received control information. For example, the self-service shopping machine receives control information from a mobile phone, the control information indicates that a specific commodity needs to be added to a shopping cart, and the self-service shopping machine adds the commodity to the shopping cart after receiving the control information for adding the commodity to the shopping cart. For another example, the self-service shopping machine receives a checkout instruction from the mobile phone, then the self-service shopping machine determines to execute a checkout operation corresponding to the checkout instruction, and jumps to a checkout page for the user to checkout.
Optionally, the communication protocol between the main device 210 and the auxiliary device 220 includes at least one of the following:
near Field Communication (NFC), a bluetooth protocol, a Wireless-Fidelity (Wi-Fi) protocol, an Ultra Wide Band (UWB) protocol, a Zigbee (Zigbee) protocol, a cellular Communication protocol, a sidelink Communication protocol, and a D2D protocol.
The cellular communication may be, for example, 4G/5G cellular communication, or may be 6G or future-developed cellular communication, and the present application is not limited thereto. In addition, the bluetooth protocol may be, for example, a bluetooth 4.0 protocol, a bluetooth 4.1 protocol, a bluetooth 5.0 protocol, and a future developed bluetooth protocol, which is not limited in this application.
Optionally, in this embodiment of the application, the main control device 210 may specifically obtain the control right of the control interface of the main control device through the following examples 1 to 3, where the auxiliary device 220 is authorized.
Example 1, authorization may be performed between the master device 210 and the secondary device 220 based on a first authorization zone of the master device 210. The first authorization zone may be, for example, as shown in fig. 3.
Specifically, the first authorization module 211 authorizes the auxiliary device 220 to obtain the control right of the control interface of the main control device 210 according to the first authorization area that the main control device 210 has.
Optionally, the first authorization zone includes, but is not limited to, at least one of:
a specific space, a specific area.
It should be noted that the first authorized region may be a specific space and/or a specific area near or around the master device 210, and since the position of the master device 210 (e.g., shopping mall, elevator) is usually fixed, the first authorized region of the master device 210 may also be understood as fixed in position to some extent. In addition, the size of the first authorized region may be determined by the attributes of the master device 210.
Optionally, in example 1, the secondary device 220 can obtain control authority of the primary device 210 when the secondary device 220 (e.g., cell phone) is in proximity to the primary device 210 (e.g., shopping mall, elevator). That is, after the auxiliary device 220 enters the first authorization zone, the first authorization module 211 may directly authorize the auxiliary device 210 to obtain the control right of the control interface of the main control device 210. In this case, the first authorized area may be a specific room or a specific area. For example, after the auxiliary equipment enters a bank teller machine compartment, an elevator room and other specific areas, the auxiliary equipment automatically acquires the control authority of the main control equipment. Of course, the control authority at this time is equivalent to that the user can touch the main control device.
For example, when a user approaches an elevator with a mobile phone or enters the elevator, the mobile phone interface can directly display the elevator control interface, and the user can input the desired floor information through the mobile phone.
For another example, when the user carries a mobile phone and is in a specific position in front of the self-service shopping machine, the mobile phone interface can directly display the content on the screen of the self-service shopping machine, and the user can directly control the operation on the self-service shopping machine, such as the checkout operation, on the mobile phone.
Optionally, in example 1, in a case that the auxiliary device 220 enters the first authorization zone, the first authorization module 211 triggers an authorization procedure between the auxiliary device 220 and the main control device 210, and authorizes the auxiliary device 220 to obtain a control right of the control interface of the main control device 210. Optionally, in this case, the first authorization module 211 is further configured to start an authorization procedure if the device to be authorized exists in the first authorization area, and close the authorization procedure if the device to be authorized does not exist in the first authorization area. Therefore, energy conservation of the main control equipment can be realized. For example, before the self-service shopping machine, when a detection device on the self-service shopping machine finds that a customer approaches the self-service shopping machine, the self-service shopping machine starts an authorization flow with a mobile phone of the customer; and when the detection equipment on the self-service shopping machine does not find that the customer approaches the self-service checkout machine, the authorization flow is not started. For another example, before the self-service checkout machine, when the self-service checkout machine finds that a commodity carried by a customer is close to the self-service checkout machine in a video detection mode, the self-service checkout machine starts an authorization flow with a mobile phone of the customer; and when the self-service checkout machine does not find that the customer needs to checkout in a video detection mode, the authorization flow is not started.
Optionally, in example 1, the first processing module 214 is further configured to detect whether the auxiliary device 220 enters the first authorized region.
Optionally, the first processing module 214 is specifically configured to detect whether the auxiliary device 220 enters the first authorized area through at least one of the following detection manners:
infrared, radar, millimeter wave, bluetooth, near field communication over the Industrial Scientific Medical (ISM) band, video, images.
Example 2, authorization may be performed between the primary device 210 and the secondary device 220 based on a second authorization zone of the secondary device 220. The second authorization zone may be, for example, as shown in fig. 4.
Specifically, the second authorization module 221 obtains the control right of the control interface authorized by the main control device 210 according to the second authorization area of the auxiliary device 220.
Optionally, the second authorization zone comprises at least one of:
specific space, specific area.
It should be noted that the second authorization zone may be a specific space and/or a specific area near or around the auxiliary device 220, since the auxiliary device 220 is usually a device (e.g. a mobile phone) carried by the user, that is, the auxiliary device 220 may move freely with the user, and to a certain extent, the second authorization zone of the auxiliary device 220 may also be understood as being freely movable with the user. Further, the size of the second authorization zone may be determined by the attributes of the secondary device 220.
Optionally, in example 2, the secondary device 220 may obtain control authority of the primary device 210 when the secondary device 220 (e.g., cell phone) discovers that the primary device 210 (e.g., kiosk, elevator) is present within its second authorized area. Of course, the control authority at this time is equivalent to that the user can touch the main control device.
For example, after the user finds that there is an elevator nearby, the user's mobile phone interface can directly display the elevator control interface, and the user can input the desired floor information through the mobile phone.
For another example, when the user finds that there is a self-service shopping machine nearby, the user's mobile phone interface may directly display the content on the self-service shopping machine screen, and the user may directly control the operation on the self-service shopping machine, such as a checkout operation, on the mobile phone.
Optionally, in example 2, in a case that the secondary device 220 detects that the main control device 210 exists in the second authorization area, the second authorization module 221 triggers an authorization procedure between the secondary device 220 and the main control device 210, and obtains a control right of the control interface authorized by the main control device 210. Optionally, in this case, the second authorization module 221 is further configured to start an authorization procedure when detecting that the master control device exists in the second authorization area, and close the authorization procedure when detecting that the master control device does not exist in the second authorization area. Thereby, energy saving of the auxiliary equipment can be realized. For example, when a user detects that a self-service shopping machine is nearby through a mobile phone, the mobile phone starts an authorization flow with the self-service shopping machine; and when the user does not detect that a self-service checkout machine is nearby through the mobile phone, the authorization flow is not started. For another example, when the user finds that a self-service checkout machine is nearby, the user controls the mobile phone to start an authorization flow of the mobile phone and the self-service checkout machine; when the user does not find that a self-service checkout machine exists nearby, the user does not control the mobile phone to start the authorization flow of the mobile phone and the self-service checkout machine.
Optionally, in example 2, the second processing module 224 is further configured to detect whether a master device exists in the second authorization zone.
Optionally, the second processing module 224 is specifically configured to detect whether the master control device exists in the second authorized area through at least one of the following detection manners:
infrared, radar, millimeter wave, bluetooth, near field communication over ISM-based frequency bands, video, images.
Example 3, the first authorization module 211 is specifically configured to authorize the auxiliary device 220 to obtain the control right of the control interface of the main control device 210 according to information interaction between the main control device 210 and the auxiliary device 220.
Optionally, in example 3, the main device 210 and the auxiliary device 220 perform information interaction by at least one of the following ways:
scanning two-dimensional code, NFC, bluetooth, wi-Fi, UWB, zigbee protocol, cellular communication, sidelink communication, D2D.
Optionally, in example 3, it may be an authorization procedure triggered by the master device, in which case, the information interaction between the master device and the secondary device may be implemented by, for example, steps 11 to 16 as shown in fig. 5.
Step 11, the first output module 213 of the main control device 210 sends main control device information to the auxiliary device 220, where the main control device information is used for the auxiliary device to discover the main control device 210;
step 12, the second processing module 224 of the auxiliary device 220 discovers the main control device 210 according to the main control device information;
step 13, the second output module 222 of the auxiliary device 220 sends auxiliary device information;
step 14, in response to the auxiliary device information, the first authorization module 211 of the main control device 210 authorizes the auxiliary device 220 to obtain the control right of the control interface of the main control device 210;
step 15, the first output module 213 of the main control device 210 sends authorization information to the auxiliary device 220, where the authorization information is used to authorize the auxiliary device 220 to obtain the control right of the control interface of the main control device 210;
in step 16, the second authorization module 221 of the auxiliary device 220 determines to obtain the control right of the control interface authorized by the main control device 210.
It should be noted that in the authorization flow shown in fig. 5, for example, in some scenarios, the main control device can only be controlled by one auxiliary device at a time, and after the main control device authorizes one auxiliary device, the main control device may stop sending the information of the main control device, or the main control device sends the information that the main control device is being used, so as to notify other auxiliary devices that desire to obtain the control authority of the main control device to determine the current state of the main control device. In addition, after the control authorization of the main control device and the auxiliary device is finished, the main control device continues to send the main control device information for other auxiliary devices to access.
In a scenario suitable for the authorization flow shown in fig. 5, for example, after a commodity is selected in a mall, the self-service checkout machine finds that a user approaches and has a checkout requirement within a certain range of the self-service checkout machine, the self-service checkout machine transmits information of the self-service checkout machine, a mobile phone of the user initiates an authorization request to the self-service checkout machine in an NFC manner after monitoring the information, and after the self-service checkout machine feeds back authorization permission information through NFC, the user can control checkout operation on the mobile phone without touching a control interface of the self-service checkout machine.
Optionally, in example 3, it may be an authorization procedure triggered by the secondary device, in which case, the information interaction between the primary device and the secondary device may be implemented by, for example, steps 21 to 24 shown in fig. 6.
Step 21, the second output module 222 of the auxiliary device 220 sends auxiliary device information;
step 22, in response to the auxiliary device information, the first authorization module 211 of the main control device 210 authorizes the auxiliary device 220 to obtain the control right of the control interface of the main control device 210;
step 23, the first output module 213 of the main control device 210 sends authorization information to the auxiliary device 220, where the authorization information is used to authorize the auxiliary device 220 to obtain the control right of the control interface of the main control device 210;
in step 24, the second authorization module 221 of the auxiliary device 220 determines to obtain the control right of the control interface authorized by the main control device 210.
It should be noted that, in a scenario adapted to the authorization flow shown in fig. 6, for example, after a commodity is selected in a shopping mall, an authorization request is initiated to the self-service checkout machine by scanning a specific two-dimensional code with a mobile phone before the self-service checkout machine, and after the self-service checkout machine transmits feedback authorization permission information through bluetooth, a user may control a checkout operation on the mobile phone without touching a control interface of the self-service checkout machine.
Optionally, in example 3, the master device information includes identification information of the master device, type information of the master device, and function information of the master device. The auxiliary device information includes identification information of the auxiliary device, type information of the auxiliary device, function information of the auxiliary device, and requirement information of the auxiliary device.
Optionally, in some embodiments, the first processing module 214 is further configured to update the control interface and generate updated control interface information, and the first output module 212 is further configured to transmit the updated control interface information to the auxiliary device 220. That is, the main device 210 updates its control interface in real time and sends the updated control interface information to the auxiliary device 220, so that the auxiliary device 220 performs further control operation.
Optionally, in this embodiment of the application, the control interface information sent by the main control device 210 to the auxiliary device 220 may be specifically shown in examples a to d.
Example a, the control interface information includes all information displayed by the control interface.
That is, the information displayed on the control interface of the main control device 210 is extracted, in which case, the control interface information may include both the information presented by the control interface and some control instruction information (e.g., instruction information of payment, return, cancellation, etc.).
Optionally, in example a, the control interface information is also used for the auxiliary device 220 to display all information of the control interface, as shown in fig. 7. That is, after receiving the control interface information, the auxiliary device 220 may display all information of the control interface based on the control interface information. That is, the master device 210 may holographically project a screen to the secondary device 220.
Alternatively, in example a, the control information is obtained by the secondary device 220 performing an equivalent control operation with the primary device 210. That is, the control operations of the main control device 210 are all extracted and equivalently performed on the auxiliary device 220, for example, the operations such as clicking and sliding that originally need to be performed on the main control device 210 can be equivalently performed on the projection display of the auxiliary device 220. In addition, control information generated by the user's operation on the secondary device 220 is parsed and executed by the main control device 210.
Alternatively, fig. 8 shows a typical scenario in which example a may be applied, and in such a scenario, the auxiliary device 220 may implement control over the main control device 210 through steps 31 to 37 shown in fig. 8.
Step 31, the main control device 210 sends control interface information to the auxiliary device 220;
step 32, displaying a control interface of the main control device 210 on a screen of the auxiliary device 220;
step 33, the user performs control operation on the auxiliary device 220 to generate control information;
step 34, the auxiliary device 220 sends the control information to the main control device 210;
step 35, the main control device 210 executes corresponding operations according to the control information;
step 36, the main control device 210 updates the control interface;
in step 37, the main control device 210 sends the updated control interface information to the auxiliary device 220.
Example b, the control interface information includes characteristic information of the control interface, and the characteristic information includes information for manipulating the control interface. That is, the feature information displayed on the control interface of the main control device 210 is extracted, and in this case, the feature information may be some control instruction information (for example, instruction information of payment, return, cancellation, and the like).
For example, the first processing module 214 in the main control device 210 is further configured to extract the feature information of the control interface.
Optionally, in example b, the control interface information is further used for the auxiliary device 220 to display the feature information, as shown in fig. 9. That is, after receiving the control interface information, the auxiliary device 220 may display the characteristic information of the control interface based on the control interface information. That is, the primary device 210 may partially project a screen to the secondary device 220.
Optionally, in example b, the control information is obtained by the auxiliary device 220 manipulating the feature information.
It should be noted that, in the example b, the feature information (which may also be referred to as meta information) in the control interface of the main device 210 is extracted and transmitted to the auxiliary device 220. For example, in a shopping interface, when the actual manipulable information (feature information) is only "purchase", "return", or "continuously stroll", at this time, the main control device 210 does not need to transmit the complete interface information to the auxiliary device, and only needs to extract the feature information and transmit the extracted feature information to the auxiliary device 220 for the auxiliary device 220 to manipulate.
In example b, the above feature information is displayed on the screen of the auxiliary device 220. The user controls the main control device by controlling the characteristic information displayed on the auxiliary device. Such as clicking a particular button that would otherwise be required on the primary device 210, the user may do an equivalent operation on the feature information projection screen display of the secondary device 220. In addition, control information generated by the user's operation on the secondary device 220 is parsed and executed by the main control device 210.
Alternatively, fig. 10 shows a typical scenario in which example b may be applied, and in such a scenario, the auxiliary device 220 may implement control over the main device 210 through steps 41 to 48 shown in fig. 10.
Step 41, the main control device 210 extracts feature information of the control interface;
step 42, the main control device 210 sends the feature information to the auxiliary device 220;
step 43, displaying the feature information of the main control device 210 on the screen of the auxiliary device 220;
step 44, the user performs control operation on the feature information on the auxiliary device 220 to generate control information;
step 45, the auxiliary device 220 sends the control information to the main control device 210;
step 46, the main control device 210 executes corresponding operations according to the control information;
step 47, the main control device 210 updates the control interface;
in step 48, the main control device 210 sends the updated control interface information to the auxiliary device 220.
Example c, the control interface information includes all information displayed by the control interface, and the control interface information is further used for the auxiliary device to extract and display feature information of the control interface, and the feature information includes information for manipulating the control interface, as shown in fig. 9. That is, after receiving the control interface information, the auxiliary device 220 extracts and displays feature information of the control interface based on the control interface information. That is, the primary device 210 may partially project a screen to the secondary device 220.
For example, the second processing module 224 in the auxiliary device 220 may extract and display feature information of the control interface based on the control interface information.
Optionally, in example c, the control information is obtained by the auxiliary device 220 manipulating the feature information.
It should be noted that, in example c, the auxiliary device 220 extracts feature information (which may also be referred to as meta information) based on the control interface information. For example, when the actual manipulable information (feature information) is only "purchase", "return", "continuously stroll", in a shopping interface, the auxiliary device 210 may extract the feature information from the complete interface information, thereby implementing the manipulation of the auxiliary device 220.
In example c, the above feature information is displayed on the screen of the auxiliary device 220. The user controls the main control device by controlling the characteristic information displayed on the auxiliary device. Such as clicking a particular button that would otherwise be required on the primary device 210, the user may do an equivalent operation on the feature information projection screen display of the secondary device 220. In addition, control information generated by the user's operation on the secondary device 220 is parsed and executed by the main control device 210.
Alternatively, fig. 11 shows a typical scenario in which the example c may be applied, and in such a scenario, the auxiliary device 220 may implement control over the main control device 210 through steps 51 to 58 shown in fig. 11.
Step 51, the main control device 210 sends control interface information to the auxiliary device 220;
step 52, the auxiliary device 220 extracts feature information of the control interface according to the control interface information;
step 53, displaying the characteristic information of the main control device 210 on the screen of the auxiliary device 220;
step 54, the user performs control operation on the feature information on the auxiliary device 220 to generate control information;
step 55, the auxiliary device 220 sends the control information to the main control device 210;
step 56, the main control device 210 executes corresponding operations according to the control information;
step 57, the main control device 210 updates the control interface;
in step 58, the primary device 210 sends the updated control interface information to the secondary device 220.
Example d, the control interface information is further used by the auxiliary device 220 to generate a console, the console operates a virtual control point generated on the control interface of the main control device 210 through the control information, and the virtual control point is used to control the control interface, as shown in fig. 12. That is, after receiving the control interface information, the auxiliary device 220 may generate the console based on the control interface information, and the user controls the virtual control point on the main control device 210 by manipulating the console on the auxiliary device 220, thereby controlling the control interface on the main control device 210.
In example d, the first processing module 214 of the master device 210 is further configured to generate the virtual control point on the control interface.
It is understood that the console may control the virtual control point to perform various operations, such as purchase, return, payment, etc., on the control interface of the master device 210 in real time.
It should be noted that the console generated by the auxiliary device 220 is equivalent to a virtual mouse or a virtual touch pad of the main control device 210.
In addition, in example d, the secondary device 220 may also generate the console based on some other information (e.g., preconfigured information), or after the secondary device 220 obtains the control right of the control interface of the primary device 210, the secondary device 220 directly generates the console, and the primary device 210 is not required to transmit the control interface information to the secondary device 220.
It should be noted that, in example d, the auxiliary device 220 generates a console, where the console is used to control a virtual control point on the screen of the main control device 210, and the console here may be a screen area used for a user to perform operations such as touch, drag, slide, click, etc. in the area, and is used to control the virtual control point of the main control device 210. The user controls the movement of the screen virtual control point of the main control device 210 by an operation of touching, dragging, sliding, etc. on the auxiliary device 220. For example, the user controls the operation of the virtual control point on the screen of the main control device 210 by a single click, a double click, or the like on the secondary device 220, e.g., controls a single click, a double click, or the like of the virtual control point. As another example, the user controls the clicking of a virtual control point on the screen of the main control device 210 by the clicking of a virtual key on the auxiliary device 220.
Alternatively, fig. 13 shows a typical scenario in which the example d may be applied, and in such a scenario, the auxiliary device 220 may implement control over the main control device 210 through steps 61 to 67 shown in fig. 13.
Step 61, the main control device 210 sends control interface information to the auxiliary device 220;
step 62, generating a virtual control point on the control interface of the main control device 210;
step 63, the auxiliary device 220 generates a console on its screen according to the control interface information, the console is used to control the virtual control point;
step 64, the user controls the virtual control point of the main control device 210 on the console of the auxiliary device 220 to generate control information, including controlling operations such as moving and clicking the virtual control point;
step 65, the auxiliary device 220 sends the control information to the main control device 210;
step 66, the main control device 210 updates the operations of moving, clicking and the like of the virtual control point according to the control information;
in step 67, the main control device 210 executes corresponding operations according to the control of the virtual control point.
Optionally, as an example e, the first processing module 214 is further configured to generate a virtual control point on the control interface for controlling the control interface, and the second processing module 224 is further configured to generate a console on the video screen of the auxiliary device 220, and the virtual control point is manipulated by the console through the control information, as shown in fig. 12.
It is understood that the console may control the virtual control point to perform various operations, such as purchase, return, payment, etc., on the control interface of the master device 210 in real time.
It should be appreciated that example e differs from example d above in that the secondary device 220 does not need to obtain control interface information from the master device 210 to generate a console.
It should be noted that the console generated by the auxiliary device 220 is equivalent to a virtual mouse or a virtual touch pad of the main control device 210.
It should be noted that, in example e, the auxiliary device 220 generates a console, where the console is used to control a virtual control point on the screen of the main control device 210, and the console here may be a screen area used for a user to touch, drag, slide, click, etc. in the area, and used to control the virtual control point of the main control device 210. The user controls the movement of the screen virtual control point of the main control device 210 by an operation of touching, dragging, sliding, etc. on the auxiliary device 220. For example, the user controls the operation of the virtual control point on the screen of the main control device 210 by a single-click, double-click, or the like operation on the auxiliary device 220, such as controlling a single-click, double-click, or the like of the virtual control point. As another example, the user controls the clicking of a virtual control point on the screen of the main control device 210 by the clicking of a virtual key on the auxiliary device 220.
Further, in example e, although it is not necessary to acquire the control interface information from the master device 210, some parameters of the master information may be necessary for determining the controllable range and the like.
Alternatively, fig. 14 shows a typical scenario in which example e may be applied, and in such a scenario, the auxiliary device 220 may implement control over the main control device 210 through steps 71 to 76 shown in fig. 14.
Step 71, generating a virtual control point on the control interface of the main control device 210;
step 72, the auxiliary device 220 generates a console on its screen, the console being used to control the virtual control point;
step 73, the user controls the virtual control point of the main control device 210 on the console of the auxiliary device 220 to generate control information, including controlling operations such as moving, clicking and the like of the virtual control point;
step 74, the auxiliary device 220 sends the control information to the main control device 210;
step 75, the main control device 210 updates operations such as moving, clicking and the like of the virtual control point according to the control information;
in step 76, the master device 210 performs corresponding operations according to the control of the virtual control point.
Optionally, in some embodiments, in a case that cellular communication such as 4G/5G is adopted between the main Control device 210 and the auxiliary device 220, the main Control device 210 may be a base station device, and the auxiliary device 220 may be a terminal device, and in the above embodiments, the main Control device 210 and the auxiliary device 220 may communicate through a data message, a broadcast message, a Radio Resource Control (RRC) message, a Media Access Control Element (MAC CE), downlink Control Information (DCI), uplink Control Information (UCI), and other messages or signaling, where the messages or signaling may be specifically carried in a Physical Downlink Shared Channel (PDSCH)/Physical Uplink Shared Channel (PDCCH)/Physical Uplink Shared Channel (PUCCH)/Physical Downlink Control Channel (PDCCH)/Physical Uplink Control Channel (Physical Control Channel).
Optionally, in some embodiments, in a case that cellular communication such as 4G/5G is adopted between the main Control device 210 and the secondary device 220, the main Control device 210 may serve as one terminal device, and the secondary device 220 may serve as another terminal device, in the above embodiments, communication may be realized between the main Control device 210 and the secondary device 220 through messages or signaling such as data messages, broadcast messages, RRC messages, sidelink Control Information (SCI), and the messages or signaling may be specifically carried in a Physical Sidelink Shared Channel (psch)/Physical Sidelink Control Channel (PSCCH)/Physical Sidelink Feedback Channel (PSFCH).
Therefore, in the embodiment of the present application, the auxiliary device obtains the control authority of the main control device, and the user controls the control interface of the main control device through the auxiliary device and performs an interactive operation with the main control device, so as to indirectly control the main control device by using the auxiliary device. In addition, in the embodiment of the application, the auxiliary device can control the main control device to perform corresponding interactive operation in multiple modes, and the method is high in operability and easy to implement. On one hand, the technical scheme of the application avoids touch control on a public control interface of public equipment, avoids potential safety and health risks, for example, controls the transmission path of viruses and bacteria and reduces the transmission probability of the viruses and the bacteria, and can effectively inhibit epidemic outbreaks in the infectious disease transmission period. On the other hand, the technical scheme of the application does not need to design specific application programs for each application, has strong operability and is easy to implement.
While an embodiment of the control system 200 of the present application is described in detail above with reference to fig. 2 to 14, an embodiment of a method performed by the main control device and the auxiliary device of the present application is described in detail below with reference to fig. 15, it should be understood that the method embodiment corresponds to an embodiment of the control system 200, and similar descriptions may refer to an embodiment of the control system 200.
Fig. 15 is a schematic flow chart of a control method 300 according to an embodiment of the present application, and as shown in fig. 15, the control method 300 may include, but is not limited to, the following:
s310, the main control device authorizes the auxiliary device to obtain the control right of the control interface of the main control device;
s320, the auxiliary equipment determines control information for controlling the control interface;
s330, the auxiliary device transmits the control information to the main control device;
s340, the main control device receives the control information sent by the auxiliary device;
s350, the master device parses and executes the control information.
Optionally, in this embodiment, the main control device transmits control interface information of the main control device to the auxiliary device, where the control information is determined by the auxiliary device according to the control interface information.
Optionally, in some embodiments of the present application, the control interface information includes all information displayed by the control interface.
Optionally, the control interface information is also used for the auxiliary device to display all information of the control interface. Correspondingly, the auxiliary equipment displays all information of the control interface on the auxiliary equipment according to the information of the control interface.
Optionally, the control information is obtained by the auxiliary device performing an equivalent control operation to that of the main control device.
Optionally, in some embodiments of the present application, the master control device extracts feature information of the control interface, where the control interface information includes the feature information of the control interface, and the feature information includes information for controlling the control interface.
Optionally, the control interface information is further used for the auxiliary device to display the feature information. Correspondingly, the auxiliary equipment displays the characteristic information on the auxiliary equipment according to the control interface information.
Optionally, in some embodiments of the present application, the control interface information includes all information displayed by the control interface, and the control interface information is further used for the auxiliary device to extract and display feature information of the control interface, and the feature information includes information used for manipulating the control interface. Correspondingly, the auxiliary equipment extracts the characteristic information of the control interface according to the control interface information, and the characteristic information comprises information for controlling the control interface; and the auxiliary device displaying the characteristic information on the auxiliary device.
Optionally, the control information is obtained by the auxiliary device manipulating the characteristic information.
Optionally, in some embodiments of the present application, the control interface information is further used for the auxiliary device to generate a console, the console operates a virtual control point generated on the control interface through the control information, and the virtual control point is used for controlling the control interface. Correspondingly, the auxiliary device generates a console according to the control interface information, the console is used for controlling a virtual control point generated on the control interface through the control information, and the virtual control point is used for controlling the control interface.
Optionally, the master device generates the virtual control point on the control interface.
Optionally, in some embodiments of the present application, the master device generates a virtual control point on the control interface, where the virtual control point is controlled by the console generated by the auxiliary device through the control information. Correspondingly, the auxiliary device generates a console, the console is used for controlling the virtual control point generated on the control interface through the control information, and the virtual control point is used for controlling the control interface.
Optionally, the control information is obtained by the auxiliary device operating the console.
Optionally, in this embodiment of the present application, the main control device updates the control interface, generates updated control interface information, and sends the updated control interface information to the auxiliary device. Correspondingly, the auxiliary device receives the updated control interface information sent by the main control device.
Optionally, the S310 may specifically be:
the main control device authorizes the auxiliary device to obtain the control right of the control interface of the main control device according to the first authorization area.
Specifically, when the auxiliary device enters the first authorization zone, the main control device triggers an authorization procedure between the auxiliary device and the main control device, and authorizes the auxiliary device to obtain a control right of the control interface of the main control device.
Optionally, in a case that the device to be authorized exists in the first authorization area, the master control device starts an authorization procedure, an
And under the condition that the device to be authorized does not exist in the first authorization area, the main control device closes the authorization flow.
Optionally, the main control device detects whether the auxiliary device enters the first authorization zone.
Optionally, the main control device is specifically configured to detect whether the auxiliary device enters the first authorization area through at least one of the following detection manners:
infrared, radar, millimeter wave, bluetooth, near field communication over ISM-based frequency bands, video, images.
Optionally, the first authorization zone includes at least one of:
specific space, specific area.
Optionally, the S310 may specifically be:
and the auxiliary equipment acquires the control right of the control interface authorized by the main control equipment according to the second authorization area.
Specifically, when the secondary device detects that the master control device exists in the second authorization area, the secondary device triggers an authorization procedure between the secondary device and the master control device, and obtains a control right of the control interface authorized by the master control device.
Optionally, the auxiliary device starts an authorization procedure when detecting that the main control device exists in the second authorization zone, and
and under the condition that the main control device is detected not to exist in the second authorization area, the auxiliary device closes an authorization process.
Optionally, the secondary device detects whether a master device exists in the second authorization zone.
Optionally, the auxiliary device is specifically configured to detect whether the main control device exists in the second authorization area through at least one of the following detection manners:
infrared, radar, millimeter wave, bluetooth, near field communication over ISM-based frequency bands, video, images.
Optionally, the second authorization zone comprises a specific area around the auxiliary device.
Optionally, the S310 may specifically be:
the main control device authorizes the auxiliary device to obtain the control right of the control interface of the main control device according to the information interaction between the main control device and the auxiliary device.
Optionally, the main control device and the auxiliary device perform information interaction through at least one of the following manners:
scanning two-dimensional code, NFC, bluetooth, wi-Fi, UWB, zigbee protocol, cellular communication, sidelink communication, D2D.
Specifically, in some embodiments, the primary device sends primary device information to the secondary device, where the primary device information is used for the secondary device to discover the primary device; the main control equipment receives auxiliary equipment information sent by the auxiliary equipment; the main control device sends authorization information to the auxiliary device according to the auxiliary device information, wherein the authorization information is used for authorizing the auxiliary device to obtain the control right of the control interface of the main control device.
Correspondingly, the auxiliary device receives the main control device information sent by the main control device; the auxiliary equipment discovers the main control equipment according to the main control equipment information; the auxiliary device sends auxiliary device information to the main control device; the auxiliary device receives authorization information sent by the main control device, wherein the authorization information is used for authorizing the auxiliary device to acquire the control right of the control interface of the main control device.
Specifically, in other embodiments, the master device receives the auxiliary device information sent by the auxiliary device; the main control device sends authorization information to the auxiliary device according to the auxiliary device information, wherein the authorization information is used for authorizing the auxiliary device to obtain the control right of the control interface of the main control device.
Correspondingly, the auxiliary device sends auxiliary device information to the main control device; the auxiliary device receives authorization information sent by the main control device, wherein the authorization information is used for authorizing the auxiliary device to acquire the control right of the control interface of the main control device.
Optionally, the master device information includes at least one of the following:
the identification information of the main control equipment, the type information of the main control equipment and the function information of the main control equipment.
Optionally, the auxiliary device information includes at least one of:
identification information of the auxiliary device, type information of the auxiliary device, function information of the auxiliary device, and requirement information of the auxiliary device.
Optionally, in this embodiment of the application, the control information is generated after the auxiliary device performs at least one of dragging, sliding, clicking, double-clicking, and region selecting.
Optionally, in this embodiment of the present application, a communication protocol between the master device and the auxiliary device includes at least one of the following:
NFC, bluetooth, wi-Fi, UWB, zigBee, cellular, sidelink, D2D.
Fig. 16 is a schematic structural diagram of a communication device 400 according to an embodiment of the present application. The communication device 400 shown in fig. 16 includes a processor 410, and the processor 410 can call and run a computer program from a memory to implement the method in the embodiment of the present application.
Optionally, as shown in fig. 16, the communication device 400 may further include a memory 420. From the memory 420, the processor 410 can call and run a computer program to implement the method in the embodiment of the present application.
The memory 420 may be a separate device from the processor 410, or may be integrated into the processor 410.
Optionally, as shown in fig. 16, the communication device 400 may further include a transceiver 430, and the processor 410 may control the transceiver 430 to communicate with other devices, and specifically, may transmit information or data to the other devices or receive information or data transmitted by the other devices.
The transceiver 430 may include a transmitter and a receiver, among others. The transceiver 430 may further include antennas, and the number of antennas may be one or more.
Optionally, the communication device 400 may specifically be a master control device in this embodiment, and the communication device 400 may implement a corresponding process implemented by the master control device in each method in this embodiment, which is not described herein again for brevity.
Optionally, the communication device 400 may specifically be an auxiliary device in the embodiment of the present application, and the communication device 400 may implement a corresponding process implemented by the auxiliary device in each method in the embodiment of the present application, which is not described herein again for brevity.
Fig. 17 is a schematic configuration diagram of an apparatus according to an embodiment of the present application. The apparatus 500 shown in fig. 17 comprises a processor 510, and the processor 510 can call and run a computer program from a memory to implement the method in the embodiment of the present application.
Optionally, as shown in fig. 17, the apparatus 500 may further include a memory 520. From the memory 520, the processor 510 may call and run a computer program to implement the method in the embodiment of the present application.
The memory 520 may be a separate device from the processor 510, or may be integrated into the processor 510.
Optionally, the apparatus 500 may further comprise an input interface 530. The processor 510 can control the input interface 530 to communicate with other devices or chips, and in particular, can obtain information or data transmitted by other devices or chips.
Optionally, the apparatus 500 may further comprise an output interface 540. The processor 510 may control the output interface 540 to communicate with other devices or chips, and in particular, may output information or data to the other devices or chips.
Optionally, the apparatus may be applied to the main control device in the embodiment of the present application, and the apparatus may implement the corresponding process implemented by the main control device in each method in the embodiment of the present application, and for brevity, details are not described here again.
Optionally, the apparatus may be applied to the auxiliary device in the embodiment of the present application, and the apparatus may implement the corresponding process implemented by the auxiliary device in each method in the embodiment of the present application, and for brevity, details are not described here again.
Optionally, the apparatus mentioned in this embodiment of the present application may also be a chip. For example, it may be a system-on-chip, a system-on-chip or a system-on-chip, etc.
Fig. 18 is a schematic block diagram of a communication system 600 according to an embodiment of the present application. As shown in fig. 18, the communication system 600 includes a primary device 610 and a secondary device 620.
The main control device 610 may be configured to implement the corresponding function implemented by the main control device in the foregoing method, and the auxiliary device 620 may be configured to implement the corresponding function implemented by the auxiliary device in the foregoing method, which is not described herein again for brevity.
It should be understood that the processor of the embodiments of the present application may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method embodiments may be performed by integrated logic circuits of hardware in a processor or by instructions in the form of software. The Processor may be a general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off the shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules may be located in ram, flash, rom, prom, or eprom, registers, etc. as is well known in the art. The storage medium is located in a memory, and a processor reads information in the memory and completes the steps of the method in combination with hardware of the processor.
It will be appreciated that the memory in the embodiments of the subject application can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. The non-volatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of example, and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), synchronous Dynamic Random Access Memory (SDRAM), double Data Rate Synchronous Dynamic random access memory (DDR SDRAM), enhanced Synchronous SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to comprise, without being limited to, these and any other suitable types of memory.
It should be understood that the above memories are exemplary but not limiting illustrations, for example, the memories in the embodiments of the present application may also be Static Random Access Memory (SRAM), dynamic random access memory (dynamic RAM, DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (enhanced SDRAM, ESDRAM), synchronous Link DRAM (SLDRAM), direct Rambus RAM (DR RAM), and the like. That is, the memory in the embodiments of the present application is intended to comprise, without being limited to, these and any other suitable types of memory.
The embodiment of the application also provides a computer readable storage medium for storing the computer program.
Optionally, the computer-readable storage medium may be applied to the main control device in the embodiment of the present application, and the computer program enables the computer to execute the corresponding process implemented by the main control device in each method in the embodiment of the present application, which is not described herein again for brevity.
Optionally, the computer-readable storage medium may be applied to the auxiliary device in the embodiment of the present application, and the computer program enables the computer to execute the corresponding process implemented by the auxiliary device in each method in the embodiment of the present application, which is not described herein again for brevity.
Embodiments of the present application also provide a computer program product, including computer program instructions.
Optionally, the computer program product may be applied to the main control device in the embodiment of the present application, and the computer program instruction enables the computer to execute a corresponding process implemented by the main control device in each method in the embodiment of the present application, which is not described herein again for brevity.
Optionally, the computer program product may be applied to an auxiliary device in the embodiment of the present application, and the computer program instructions enable a computer to execute a corresponding process implemented by the auxiliary device in each method in the embodiment of the present application, which is not described herein again for brevity.
The embodiment of the application also provides a computer program.
Optionally, the computer program may be applied to the main control device in the embodiment of the present application, and when the computer program runs on a computer, the computer executes a corresponding process implemented by the main control device in each method in the embodiment of the present application, which is not described herein again for brevity.
Optionally, the computer program may be applied to the auxiliary device in the embodiment of the present application, and when the computer program runs on a computer, the computer is enabled to execute the corresponding process implemented by the auxiliary device in each method in the embodiment of the present application, and for brevity, details are not described here again.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one type of logical functional division, and other divisions may be realized in practice, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. With regard to such understanding, the technical solutions of the present application may be essentially implemented or contributed to by the prior art, or may be implemented in a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a control device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (117)

  1. A master device, comprising:
    a first authorization module, a first input module, and a first processing module, wherein,
    the first authorization module is used for authorizing the auxiliary equipment to acquire the control right of the control interface of the main control equipment;
    the first input module is used for receiving control information which is sent by the auxiliary equipment and used for controlling the control interface;
    the first processing module is used for analyzing and executing the control information.
  2. The main control device according to claim 1, further comprising a first output module, wherein the first output module is configured to transmit control interface information of the main control device to the auxiliary device, and the control information is determined by the auxiliary device according to the control interface information.
  3. The master device of claim 2, wherein the control interface information comprises all information displayed by the control interface.
  4. The master device of claim 3, wherein the control interface information is used by the secondary device to display all information of the control interface.
  5. The master device of claim 4, wherein the control information is obtained by the secondary device performing an equivalent control operation as the master device.
  6. The master control device according to claim 2, wherein the first processing module is further configured to extract feature information of the control interface, and the control interface information includes the feature information of the control interface, and the feature information includes information for manipulating the control interface.
  7. The master device of claim 6, wherein the control interface information is used by the secondary device to display the feature information.
  8. The master device according to claim 2, wherein the control interface information includes all information displayed by the control interface, and the control interface information is used by the auxiliary device to extract and display feature information of the control interface, and the feature information includes information used to manipulate the control interface.
  9. The master device according to claim 7 or 8, wherein the control information is obtained by the secondary device manipulating the feature information.
  10. The main control device according to any one of claims 2 to 9, wherein the first processing module is further configured to update the control interface and generate updated control interface information, and the first output module is further configured to transmit the updated control interface information to the auxiliary device.
  11. The master control device according to claim 2, wherein the control interface information is used for the auxiliary device to generate a console, the console controls a virtual control point generated on the control interface through the control information, and the virtual control point is used for controlling the control interface.
  12. The master device according to claim 1, wherein the first processing module is further configured to generate a virtual control point on the control interface for controlling the control interface, and the virtual control point is controlled by a console generated by the auxiliary device through the control information.
  13. The master control device according to any one of claims 1 to 12, wherein the first authorization module is specifically configured to:
    and authorizing the auxiliary equipment to acquire the control right of the control interface of the main control equipment according to a first authorization area which the main control equipment has.
  14. The master control device according to claim 13, wherein the first authorization module is specifically configured to:
    and under the condition that the auxiliary equipment enters the first authorization area, triggering an authorization flow between the auxiliary equipment and the main control equipment, and authorizing the auxiliary equipment to acquire the control right of the control interface of the main control equipment.
  15. The master device according to claim 13 or 14, wherein the first authorization module is further configured to open an authorization procedure if the device to be authorized exists in the first authorization area, and close the authorization procedure if the device to be authorized does not exist in the first authorization area.
  16. The master device of any one of claims 13 to 15, wherein the first processing module is further configured to detect whether the secondary device enters the first authorized region.
  17. The master control device according to claim 16, wherein the first processing module is specifically configured to detect whether the secondary device enters the first authorized area through at least one of the following detection manners:
    infrared, radar, millimeter wave, bluetooth, near field communication over industrial scientific medical ISM-based frequency bands, video, images.
  18. The master device of any one of claims 13 to 17, wherein the first authorization zone comprises at least one of:
    a specific space, a specific area.
  19. The master control device according to any one of claims 1 to 18, wherein the first authorization module is specifically configured to:
    and authorizing the auxiliary equipment to acquire the control right of the control interface of the main control equipment according to the information interaction between the main control equipment and the auxiliary equipment.
  20. The master device of claim 19, wherein the master device and the secondary device perform information interaction through at least one of the following methods:
    scanning two-dimensional codes, near Field Communication (NFC), bluetooth, wireless fidelity (Wi-Fi), ultra-wideband UWB, zigbee protocol, cellular communication, sidelink communication, and terminal-to-terminal (D2D).
  21. The master device according to claim 19 or 20, wherein the master device further comprises a first output module, wherein the information interaction between the master device and the auxiliary device comprises:
    the first output module is configured to send master control device information to the auxiliary device, where the master control device information is used for the auxiliary device to discover the master control device;
    the first input module is further used for receiving auxiliary equipment information sent by the auxiliary equipment;
    the first output module is further configured to send authorization information to the auxiliary device according to the auxiliary device information, where the authorization information is used to authorize the auxiliary device to obtain a control right of the control interface of the main control device.
  22. The master device according to claim 19 or 20, wherein the master device further comprises a first output module, wherein the information interaction between the master device and the auxiliary device comprises:
    the first input module is further used for receiving auxiliary equipment information sent by the auxiliary equipment;
    the first output module is configured to send authorization information to the auxiliary device according to the auxiliary device information, where the authorization information is used to authorize the auxiliary device to obtain a control right of the control interface of the main control device.
  23. The master device of claim 21, wherein the master device information comprises at least one of:
    the identification information of the main control equipment, the type information of the main control equipment and the function information of the main control equipment.
  24. The master device of claim 21 or 22, wherein the secondary device information comprises at least one of:
    identification information of the auxiliary device, type information of the auxiliary device, function information of the auxiliary device, and requirement information of the auxiliary device.
  25. The master device of any one of claims 1 to 24, wherein the control information is generated after the secondary device performs at least one of dragging, sliding, clicking, double clicking, and region selection.
  26. The master device of any one of claims 1 to 25, wherein a communication protocol between the master device and the secondary device comprises at least one of:
    NFC, bluetooth protocol, wi-Fi protocol, UWB protocol, zigBee protocol, cellular communication protocol, sidelink communication protocol, D2D protocol.
  27. An accessory, comprising:
    a second authorization module, a second output module, and a second processing module, wherein,
    the second authorization module is used for the auxiliary equipment to acquire the control right of the control interface of the main control equipment authorized by the main control equipment;
    the second processing module is used for determining control information for controlling the control interface;
    the second output module is used for transmitting the control information to the main control equipment.
  28. The accessory of claim 27, further comprising a second input module, wherein,
    the second input module is configured to receive control interface information of the main control device sent by the main control device, where the control information is determined by the auxiliary device according to the control interface information.
  29. The accessory of claim 28, wherein the control interface information includes all information displayed by the control interface.
  30. The accessory of claim 29, wherein the second processing module is further configured to display all information of the control interface on the accessory according to the control interface information.
  31. The secondary device of claim 30, wherein the control information is obtained by the secondary device performing an equivalent control operation as the primary device.
  32. The accessory device of claim 28, wherein the control interface information includes feature information of the control interface extracted by the master device, and the feature information includes information for manipulating the control interface.
  33. The accessory of claim 32, wherein the second processing module is further configured to display the feature information on the accessory according to the control interface information.
  34. The auxiliary device of claim 28, wherein the control interface information includes all information displayed by the control interface, wherein,
    the second processing module is further configured to extract feature information of the control interface according to the control interface information, where the feature information includes information for controlling the control interface;
    the second processing module is further configured to display the characteristic information on the auxiliary device.
  35. The accessory of claim 33 or 34, wherein the control information is derived from manipulation of the characteristic information by the accessory.
  36. The auxiliary device of any one of claims 28 to 35, wherein the second input module is further configured to receive updated control interface information sent by the main control device.
  37. The auxiliary device according to claim 28, wherein the second processing module is further configured to generate a console according to the control interface information, the console is configured to manipulate a virtual control point generated on the control interface through the control information, and the virtual control point is configured to control the control interface.
  38. The auxiliary device of claim 27, wherein the second processing module is further configured to generate a console, the console is configured to manipulate a virtual control point generated on the control interface through the control information, and the virtual control point is configured to control the control interface.
  39. An accessory as claimed in claim 37 or 38, wherein the control information is derived from manipulation of the console by the accessory.
  40. The auxiliary device according to any one of claims 27 to 39, wherein the second authorization module is specifically configured to:
    and acquiring the control right of the control interface authorized by the main control equipment according to a second authorization area of the auxiliary equipment.
  41. The auxiliary device according to claim 40, wherein the second authorization module is specifically configured to:
    and under the condition that the auxiliary equipment detects that the main control equipment exists in the second authorization area, triggering an authorization process between the auxiliary equipment and the main control equipment, and acquiring the control right of the main control equipment to the control interface.
  42. The secondary device of claim 40 or 41, wherein the second authorization module is further configured to start an authorization procedure if it is detected that a master device is present in the second authorization zone, and to close an authorization procedure if it is detected that a master device is not present in the second authorization zone.
  43. The secondary device according to any one of claims 40 to 42, wherein the second processing module is further configured to detect whether a master device is present in the second authorized area.
  44. The auxiliary device according to claim 43, wherein the second processing module is specifically configured to detect whether a master device exists in the second authorized area through at least one of the following detection manners:
    infrared, radar, millimeter wave, bluetooth, near field communication over the industrial scientific medical ISM band, video, images.
  45. An accessory as claimed in any of claims 40 to 44, wherein the second authorisation zone comprises a specific zone around the accessory.
  46. The auxiliary device according to any of claims 27 to 39, wherein the second authorization module is specifically configured to:
    and acquiring the control right of the control interface authorized by the main control equipment according to the information interaction between the main control equipment and the auxiliary equipment.
  47. The auxiliary device of claim 46, wherein the main control device and the auxiliary device perform information interaction through at least one of the following methods:
    scanning two-dimensional codes, near Field Communication (NFC), bluetooth, wireless fidelity (Wi-Fi), ultra-wideband UWB, zigbee protocol, cellular communication, sidelink communication, and terminal-to-terminal (D2D).
  48. The auxiliary device of claim 46 or 47, further comprising a second input module, wherein the information interaction between the main control device and the auxiliary device comprises:
    the second input module is used for receiving the master control equipment information sent by the master control equipment;
    the second processing module is further configured to discover the master device according to the master device information;
    the second output module is further configured to send auxiliary device information to the main control device;
    the second input module is further configured to receive authorization information sent by the master control device, where the authorization information is used to authorize the auxiliary device to obtain a control right of the control interface of the master control device.
  49. The auxiliary device of claim 46 or 47, further comprising a second input module, wherein the information interaction between the main control device and the auxiliary device comprises:
    the second output module is further configured to send auxiliary device information to the main control device;
    the second input module is configured to receive authorization information sent by the main control device, where the authorization information is used to authorize the auxiliary device to obtain a control right of the control interface of the main control device.
  50. The secondary device of claim 48, wherein the master device information comprises at least one of:
    the identification information of the main control equipment, the type information of the main control equipment and the function information of the main control equipment.
  51. Auxiliary device according to claim 48 or 49, wherein said auxiliary device information comprises at least one of:
    identification information of the auxiliary device, type information of the auxiliary device, function information of the auxiliary device, and requirement information of the auxiliary device.
  52. The auxiliary device of any of claims 27-51, wherein the control information is generated after the auxiliary device performs at least one of dragging, sliding, clicking, double clicking, and region selection.
  53. The secondary device of any one of claims 27 to 52, wherein a communication protocol between the master device and the secondary device comprises at least one of:
    NFC, bluetooth protocol, wi-Fi protocol, UWB protocol, zigBee protocol, cellular communication protocol, sidelink communication protocol, D2D protocol.
  54. A control method, comprising:
    the main control equipment authorizes the auxiliary equipment to obtain the control right of a control interface of the main control equipment;
    the main control equipment receives control information which is sent by the auxiliary equipment and used for controlling the control interface;
    and the master control equipment analyzes and executes the control information.
  55. The control method of claim 54, further comprising:
    and the main control equipment transmits control interface information of the main control equipment to the auxiliary equipment, wherein the control information is determined by the auxiliary equipment according to the control interface information.
  56. The control method of claim 55, wherein the control interface information includes all information displayed by the control interface.
  57. The control method of claim 56, wherein the control interface information is used by the secondary device to display all information of the control interface.
  58. The control method according to claim 57, wherein the control information is obtained by the secondary device performing an equivalent control operation to the primary device.
  59. The control method according to claim 55, characterized by further comprising:
    the master control equipment extracts the characteristic information of the control interface, wherein the control interface information comprises the characteristic information of the control interface, and the characteristic information comprises information for controlling the control interface.
  60. The control method of claim 59, wherein the control interface information is further used for the auxiliary device to display the characteristic information.
  61. The control method according to claim 55, wherein the control interface information includes all information displayed by the control interface, and the control interface information is used for the auxiliary device to extract and display characteristic information of the control interface, and the characteristic information includes information used for manipulating the control interface.
  62. The control method according to claim 60 or 61, wherein the control information is obtained by the auxiliary device manipulating the characteristic information.
  63. The control method according to any one of claims 55 to 62, characterized by further comprising:
    and the main control equipment updates the control interface, generates updated control interface information and transmits the updated control interface information to the auxiliary equipment.
  64. The control method according to claim 55, wherein the control interface information is used for the auxiliary device to generate a console, the console controls a virtual control point generated on the control interface through the control information, and the virtual control point is used for controlling the control interface.
  65. The control method according to claim 54, characterized by further comprising:
    and the main control equipment generates a virtual control point for controlling the control interface on the control interface, and the virtual control point is controlled by a console generated by the auxiliary equipment through the control information.
  66. The method according to any one of claims 54 to 65, wherein the authorizing, by the master device, the secondary device to obtain control of the control interface of the master device includes:
    and the main control equipment authorizes the auxiliary equipment to acquire the control right of the control interface of the main control equipment according to the first authorization area of the main control equipment.
  67. The method as claimed in claim 66, wherein the authorizing, by the primary device according to the first authorization zone the primary device has, the secondary device to obtain the control right of the control interface of the primary device includes:
    and under the condition that the auxiliary equipment enters the first authorization area, the main control equipment triggers an authorization flow between the auxiliary equipment and the main control equipment and authorizes the auxiliary equipment to obtain the control right of the control interface of the main control equipment.
  68. The control method according to claim 66 or 67, characterized by further comprising:
    the master control device starts an authorization flow under the condition that the device to be authorized exists in the first authorization area, and
    and under the condition that the equipment to be authorized does not exist in the first authorization area, the main control equipment closes an authorization flow.
  69. A control method according to any one of claims 66-68, characterized in that the control method further comprises:
    the master device detects whether the secondary device enters the first authorization zone.
  70. The control method according to claim 69, wherein the main control device is specifically configured to detect whether the secondary device enters the first authorized region by at least one of the following detection manners:
    infrared, radar, millimeter wave, bluetooth, near field communication over industrial scientific medical ISM-based frequency bands, video, images.
  71. The control method according to any one of claims 66 to 70, wherein the first authorization zone comprises at least one of:
    specific space, specific area.
  72. The control method according to any one of claims 54 to 65, wherein the authorizing, by the master device, the secondary device to obtain the control right of the control interface of the master device includes:
    and the main control equipment authorizes the auxiliary equipment to acquire the control right of the control interface of the main control equipment according to the information interaction between the main control equipment and the auxiliary equipment.
  73. The control method according to claim 72, wherein the information interaction between the main control device and the auxiliary device is performed by at least one of:
    scanning two-dimensional codes, near Field Communication (NFC), bluetooth, wireless fidelity (Wi-Fi), ultra-wideband UWB, zigbee protocol, cellular communication, sidelink communication, and terminal-to-terminal (D2D).
  74. The method as claimed in claim 72 or 73, wherein the step of the master device authorizing the secondary device to obtain the control right of the control interface of the master device according to the information interaction between the master device and the secondary device comprises:
    the main control equipment sends main control equipment information to the auxiliary equipment, and the main control equipment information is used for the auxiliary equipment to discover the main control equipment;
    the main control equipment receives auxiliary equipment information sent by the auxiliary equipment;
    and the main control equipment sends authorization information to the auxiliary equipment according to the auxiliary equipment information, wherein the authorization information is used for authorizing the auxiliary equipment to acquire the control right of the control interface of the main control equipment.
  75. The method as claimed in claim 72 or 73, wherein the step of the master device authorizing the secondary device to obtain the control right of the control interface of the master device according to the information interaction between the master device and the secondary device comprises:
    the main control equipment receives auxiliary equipment information sent by the auxiliary equipment;
    and the main control equipment sends authorization information to the auxiliary equipment according to the auxiliary equipment information, wherein the authorization information is used for authorizing the auxiliary equipment to acquire the control right of the control interface of the main control equipment.
  76. The control method of claim 74, wherein the master device information comprises at least one of:
    the identification information of the main control equipment, the type information of the main control equipment and the function information of the main control equipment.
  77. The control method of claim 74 or 75, wherein the auxiliary device information comprises at least one of:
    identification information of the auxiliary device, type information of the auxiliary device, function information of the auxiliary device, and requirement information of the auxiliary device.
  78. The control method according to any one of claims 54 to 77, wherein the control information is generated after the auxiliary device performs at least one of dragging, sliding, clicking, double clicking, and region selecting.
  79. The method according to any one of claims 54 to 78, wherein the communication protocol between the master device and the secondary device comprises at least one of:
    NFC, bluetooth protocol, wi-Fi protocol, UWB protocol, zigBee protocol, cellular communication protocol, sidelink communication protocol, D2D protocol.
  80. A control method, characterized by comprising:
    the auxiliary equipment acquires the control right of a control interface of the main control equipment authorized by the main control equipment;
    the auxiliary device determining control information for controlling the control interface;
    and the auxiliary equipment transmits the control information to the main control equipment.
  81. The control method of claim 80, further comprising:
    and the auxiliary equipment receives control interface information of the main control equipment, which is sent by the main control equipment, wherein the control information is determined by the auxiliary equipment according to the control interface information.
  82. The control method of claim 81, wherein the control interface information includes all information displayed by the control interface.
  83. The control method according to claim 82, characterized by further comprising:
    and the auxiliary equipment displays all the information of the control interface on the auxiliary equipment according to the information of the control interface.
  84. The control method according to claim 83, wherein the control information is obtained by the secondary device performing an equivalent control operation as the primary device.
  85. The control method of claim 81, wherein the control interface information includes feature information of the control interface extracted by the master control device, and the feature information includes information for manipulating the control interface.
  86. The control method of claim 85, further comprising:
    and the auxiliary equipment displays the characteristic information on the auxiliary equipment according to the control interface information.
  87. The control method of claim 81, wherein the control interface information includes all information displayed by the control interface, the control method further comprising:
    the auxiliary equipment extracts feature information of the control interface according to the control interface information, wherein the feature information comprises information for controlling the control interface;
    the auxiliary device displays the feature information on the auxiliary device.
  88. The control method according to claim 86 or 87, wherein the control information is obtained by the auxiliary device manipulating the characteristic information.
  89. The control method according to any one of claims 81 to 88, further comprising:
    and the auxiliary equipment receives the updated control interface information sent by the main control equipment.
  90. The control method of claim 81, further comprising:
    and the auxiliary equipment generates a control console according to the control interface information, the control console is used for controlling a virtual control point generated on the control interface through the control information, and the virtual control point is used for controlling the control interface.
  91. The control method of claim 80, further comprising:
    the auxiliary equipment generates a console, the console is used for controlling a virtual control point generated on the control interface through the control information, and the virtual control point is used for controlling the control interface.
  92. The control method according to claim 90 or 91, wherein the control information is obtained by the auxiliary device operating the console.
  93. The method according to any one of claims 80 to 92, wherein the obtaining, by the secondary device, the control right authorized by the primary device to the control interface of the primary device comprises:
    and the auxiliary equipment acquires the control right of the control interface authorized by the main control equipment according to the second authorization area of the auxiliary equipment.
  94. The method according to claim 93, wherein the obtaining, by the auxiliary device according to the second authorization zone that the auxiliary device has, the control right of the control interface authorized by the main control device includes:
    and under the condition that the auxiliary equipment detects that the main control equipment exists in the second authorization area, the auxiliary equipment triggers an authorization process between the auxiliary equipment and the main control equipment and acquires the control right of the main control equipment to the control interface.
  95. The control method according to claim 93 or 94, characterized in that the control method further comprises:
    the secondary device starts an authorization procedure upon detecting that the primary device exists in the second authorization zone, an
    And under the condition that the main control equipment is detected not to exist in the second authorization area, the auxiliary equipment closes an authorization process.
  96. The control method according to any one of claims 93 to 95, characterized by further comprising:
    and the auxiliary equipment detects whether the main control equipment exists in the second authorization area.
  97. The method according to claim 96, wherein the auxiliary device is specifically configured to detect whether a master control device exists in the second authorized area through at least one of the following detection manners:
    infrared, radar, millimeter wave, bluetooth, near field communication over the industrial scientific medical ISM band, video, images.
  98. The method according to any one of claims 93 to 97, wherein the second authorized area comprises a specific area around the secondary device.
  99. The method according to any one of claims 90 to 92, wherein the obtaining, by the secondary device, the control right authorized by the master device to the control interface of the master device comprises:
    and the auxiliary equipment acquires the control right of the control interface authorized by the main control equipment according to the information interaction between the auxiliary equipment and the main control equipment.
  100. The control method according to claim 99, wherein the information interaction between the main control device and the auxiliary device is performed by at least one of:
    scanning two-dimensional codes, near Field Communication (NFC), bluetooth, wireless fidelity (Wi-Fi), ultra-wideband UWB, zigbee protocol, cellular communication, sidelink communication, and terminal-to-terminal (D2D).
  101. The method according to claim 99 or 100, wherein the obtaining, by the auxiliary device, the control right of the control interface authorized by the main control device according to the information interaction between the auxiliary device and the main control device includes:
    the auxiliary equipment receives main control equipment information sent by the main control equipment;
    the auxiliary equipment discovers the main control equipment according to the main control equipment information;
    the auxiliary equipment sends auxiliary equipment information to the main control equipment;
    and the auxiliary equipment receives authorization information sent by the main control equipment, wherein the authorization information is used for authorizing the auxiliary equipment to acquire the control right of the control interface of the main control equipment.
  102. The method according to claim 99 or 100, wherein the obtaining, by the auxiliary device, the control right of the control interface authorized by the main control device according to the information interaction between the auxiliary device and the main control device includes:
    the auxiliary equipment sends auxiliary equipment information to the main control equipment;
    and the auxiliary equipment receives authorization information sent by the main control equipment, wherein the authorization information is used for authorizing the auxiliary equipment to acquire the control right of the control interface of the main control equipment.
  103. The control method of claim 101, wherein the master device information comprises at least one of:
    the identification information of the main control equipment, the type information of the main control equipment and the function information of the main control equipment.
  104. The control method of claim 101 or 102, wherein the auxiliary device information comprises at least one of:
    identification information of the auxiliary device, type information of the auxiliary device, function information of the auxiliary device, and requirement information of the auxiliary device.
  105. The control method according to any one of claims 80 to 104, wherein the control information is generated after the auxiliary device performs at least one of dragging, sliding, clicking, double clicking, and region selecting.
  106. The control method according to any one of claims 80 to 105, wherein the communication protocol between the secondary device and the primary device comprises at least one of:
    NFC, bluetooth, wi-Fi, UWB, zigBee, cellular, sidelink, D2D.
  107. A control system, comprising:
    the master device of claims 1-26; and
    auxiliary device as claimed in claims 27 to 53.
  108. A master device, comprising: a processor and a memory for storing a computer program, the processor being configured to invoke and execute the computer program stored in the memory to perform the method of any of claims 54 to 79.
  109. An auxiliary device, comprising: a processor and a memory for storing a computer program, the processor for invoking and executing the computer program stored in the memory to perform the method of any of claims 80-106.
  110. A chip, comprising: a processor for calling and running a computer program from a memory so that a device on which the chip is installed performs the method of any one of claims 54 to 79.
  111. A chip, comprising: a processor for calling and running a computer program from a memory so that a device on which the chip is installed performs the method of any one of claims 80 to 106.
  112. A computer-readable storage medium for storing a computer program which causes a computer to perform the method of any one of claims 54 to 79.
  113. A computer-readable storage medium for storing a computer program which causes a computer to perform the method of any one of claims 80 to 106.
  114. A computer program product comprising computer program instructions to cause a computer to perform the method of any of claims 54 to 79.
  115. A computer program product comprising computer program instructions to cause a computer to perform the method of any of claims 80 to 106.
  116. A computer program, characterized in that the computer program causes a computer to perform the method of any of claims 54 to 79.
  117. A computer program for causing a computer to perform the method of any one of claims 80 to 106.
CN202080101244.2A 2020-06-04 2020-06-04 Master control device, auxiliary device, control system, and control method Pending CN115668892A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/094289 WO2021243630A1 (en) 2020-06-04 2020-06-04 Master control device, auxiliary device, control system, and control method

Publications (1)

Publication Number Publication Date
CN115668892A true CN115668892A (en) 2023-01-31

Family

ID=78831566

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080101244.2A Pending CN115668892A (en) 2020-06-04 2020-06-04 Master control device, auxiliary device, control system, and control method

Country Status (2)

Country Link
CN (1) CN115668892A (en)
WO (1) WO2021243630A1 (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100571375C (en) * 2006-12-11 2009-12-16 腾讯科技(深圳)有限公司 A kind of method and system by the portable terminal operating video play apparatus
KR20150009698A (en) * 2013-07-17 2015-01-27 삼성전자주식회사 Method for processing received data and an electronic device thereof
CN108639879B (en) * 2018-04-11 2021-02-23 拉扎斯网络科技(上海)有限公司 Elevator operation control method, elevator control equipment and application server
CN108502657A (en) * 2018-04-24 2018-09-07 吴东辉 Elevator control method based on instant messaging and apparatus and system
CN111091644B (en) * 2018-10-24 2022-12-13 奥的斯电梯公司 Authorization management of elevator service requests and authorization requests

Also Published As

Publication number Publication date
WO2021243630A1 (en) 2021-12-09

Similar Documents

Publication Publication Date Title
KR102376335B1 (en) Method and apparatus for broadcasting using channel information
US20200092925A1 (en) Controlling electronic devices based on wireless ranging
KR102448170B1 (en) Method and electronic device regarding wireless communication using wireless local area network
US9722759B2 (en) Radio transceiver for virtual full duplex communication using unused resources
KR102039213B1 (en) Systems and methods for rapid availability of critical functionalities on devices using cellular operating systems
US20230268988A1 (en) Satellite communication method and apparatus, and core network element and storage medium
CN114079902A (en) Method and device for federal learning
CN113747570A (en) Communication method and device
US20230362869A1 (en) Wireless communication method and device
CN112534914B (en) Resource allocation method and device, message frame processing method and device and storage medium
WO2021243630A1 (en) Master control device, auxiliary device, control system, and control method
CN115516914A (en) Method and device for switching
CN117981369A (en) Information indication method, first access network equipment and core network element
CN114868353A (en) Communication method, communication device and communication equipment
US11051288B2 (en) Providing LTE network devices with downlink channels in an unlicensed spectrum
CN107438277B (en) Network system capable of quickly establishing WPS online and WPS online method thereof
WO2023159351A1 (en) Wireless communication method and device
CN111357306B (en) Communication processing method, device and computer storage medium
WO2024085084A1 (en) Avatar control device
JP5948942B2 (en) Wireless access device, wireless terminal, program, and wireless communication system
CN112425257B (en) Timing Advance Indication Method, Device, Communication Equipment and Storage Medium
WO2024022168A1 (en) Negotiation method, and terminal and network-side device
WO2023036327A1 (en) Resource selection method and apparatus and terminal
WO2023164838A1 (en) Wireless communication method and device
EP4318967A1 (en) Information transmission method and apparatus, communication device, and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination