CN111367452B - Equipment interaction method, device, equipment, system and medium - Google Patents

Equipment interaction method, device, equipment, system and medium Download PDF

Info

Publication number
CN111367452B
CN111367452B CN202010188711.1A CN202010188711A CN111367452B CN 111367452 B CN111367452 B CN 111367452B CN 202010188711 A CN202010188711 A CN 202010188711A CN 111367452 B CN111367452 B CN 111367452B
Authority
CN
China
Prior art keywords
input
instruction
equipment
operation instruction
accessory
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010188711.1A
Other languages
Chinese (zh)
Other versions
CN111367452A (en
Inventor
王泽湘
陈建哲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apollo Zhilian Beijing Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN202010188711.1A priority Critical patent/CN111367452B/en
Publication of CN111367452A publication Critical patent/CN111367452A/en
Priority to JP2021042315A priority patent/JP7262498B2/en
Priority to KR1020210034295A priority patent/KR102528104B1/en
Application granted granted Critical
Publication of CN111367452B publication Critical patent/CN111367452B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
    • B60R16/0373—Voice control
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38—Information transfer, e.g. on bus
    • G06F13/382—Information transfer, e.g. on bus using universal interface adapter
    • G06F13/385—Information transfer, e.g. on bus using universal interface adapter for adaptation of a particular data processing system to different peripheral devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces

Abstract

The embodiment of the application discloses a device interaction method, a device, equipment, a system and a medium, and relates to the field of vehicle-mounted equipment control. The specific implementation scheme is as follows: receiving an operation instruction sent by the main control equipment; the operation instruction is generated by the main control equipment in response to the touch operation of a user on the touch assembly; writing an input instruction corresponding to the operation instruction into an instruction space of the input equipment corresponding to the operation instruction; the accessory device is controlled by accessing and responding to the input command from the command space through the driving of the input device. The auxiliary equipment is controlled through touch operation in the main control equipment; through the instruction space of the input equipment corresponding to the control instruction, the distinguishing of different input equipment and input instructions is realized, and a foundation is laid for the generalized input of the accessory equipment; the input command is accessed and responded from the command space through the driving of the input device, so that the generalized control of the accessory device is realized.

Description

Equipment interaction method, device, equipment, system and medium
Technical Field
The present application relates to communications technologies, and in particular, to the field of vehicle-mounted device control, and in particular, to a device interaction method, apparatus, device, system, and medium.
Background
With the increasing demand of intellectualization, it is usually necessary to fixedly arrange accessory devices in a device to enrich the functions of the device. In general, the user may have inconvenience in operating the accessory device due to no screen or a small screen.
In the prior art, a voice or gesture is generally input into a main control device which is convenient to operate to generate an operation instruction, and the operation instruction is issued to an accessory device through the main control device, so that the accessory device executes a corresponding operation in response to the operation instruction.
However, the above method is only applicable to the case where the operable area is unique, and when a plurality of operable areas are included in the accessory device, the operation may fail because the area currently required to be operated cannot be determined.
Disclosure of Invention
The embodiment of the application provides a device interaction method, a device, a system and a medium, so that the generalization operation of an auxiliary device is realized in the interaction process of a main control device and the auxiliary device.
In a first aspect, an embodiment of the present application provides a device interaction method, which is performed by an accessory device, and includes:
receiving an operation instruction sent by the main control equipment; the operation instruction is generated by the main control equipment in response to the touch operation of a user on the touch assembly;
writing an input instruction corresponding to the operation instruction into an instruction space of input equipment corresponding to the operation instruction;
the input device is driven to access and respond to the input command from the command space so as to control the auxiliary device.
According to the embodiment of the application, the auxiliary equipment receives an operation instruction generated by the main control equipment in response to the touch operation of a user on the touch assembly; writing an input instruction corresponding to the operation instruction into an instruction space of the input equipment corresponding to the operation instruction; the accessory device is controlled by accessing and responding to the input command from the command space through the driving of the input device. According to the technical scheme, the auxiliary equipment receives the operation instruction sent by the main control equipment and responds, so that the operation control of the auxiliary equipment is realized through touch operation in the main control equipment in the interaction process of the main control equipment and the auxiliary equipment; meanwhile, the auxiliary equipment writes the input instruction corresponding to the operation instruction into the instruction space of the input equipment corresponding to the control instruction in the process of responding to the operation instruction, so that the differentiation of different input equipment and input instructions is realized, and a foundation is laid for the generalized input of the auxiliary equipment; the input command is accessed and responded from the command space through the driving of the input device, so that the generalized control of the accessory device is realized.
Optionally, accessing and responding to the input command from the command space through the driving of the input device to control the accessory device, including:
accessing and analyzing an input command from the command space through the driving of the input device;
and distributing the analysis result of the input instruction to the corresponding accessory application through the operating system of the accessory device for responding through the drive of the input device so as to control the accessory application.
In an optional implementation manner in the above application, access response operation of the input instruction is refined into accessing and analyzing the input instruction from an instruction space through driving of the input device, and an analysis result is distributed to a corresponding accessory application through an operating system for corresponding, so that control over the accessory application is realized, and an access response mechanism of the input instruction is perfected.
Optionally, the touch component includes a hardware touch component and/or a software touch component;
the operation instruction comprises an operation event and/or an input text;
correspondingly, the drivers of the input device comprise a hardware touch control component driver and/or a text input driver.
In an optional implementation manner in the foregoing application, the touch component, the operation instruction, and the driver of the input device are refined, so that event operation control and/or text input control are performed on the accessory device through the hardware touch component and/or the software touch component, and an interaction manner and an interaction content between the main control device and the accessory device are enriched.
Optionally, accessing and responding to the input command from the command space through the driving of the input device to control the accessory device, including:
acquiring a control character instruction of the operation event from the instruction space through the drive of the hardware touch control component, and updating a current focus in an auxiliary application display interface according to the control character instruction; and/or the presence of a gas in the gas,
and acquiring a text character instruction of the input text from the instruction space through the text input drive, and controlling an auxiliary application to display the input text from a current focus according to the text character instruction.
In the optional implementation method in the above application, the access response operation to the input instruction is refined into driving through the hardware touch control component to update the focus position in the display interface of the accessory application, and/or the text input control in the accessory application is realized through the text input driving, so that the control mechanism of the main control device in controlling the accessory device is further improved.
Optionally, receiving an operation instruction sent by the master control device includes:
and receiving an operation instruction sent by the transmission application of the main control equipment through a receiving application.
In an optional implementation manner in the foregoing application, the receiving application in the accessory device receives the operation instruction sent by the transmission application of the main control device, so that a data interaction manner between the main control device and the accessory device is improved.
Optionally, after receiving, by a receiving application, an operation instruction sent by a transmission application of the master control device, before writing an input instruction corresponding to the operation instruction into an instruction space of an input device corresponding to the operation instruction, the method further includes:
and analyzing the operation instruction based on an AOA protocol of the android open attachment.
In an optional implementation manner of the above application, the operation instruction is analyzed through the AOA protocol, and the corresponding input device is determined according to the analysis result, so that a communication mechanism between the main control device and the accessory device is perfected.
Optionally, writing an input instruction corresponding to the operation instruction into an instruction space of the input device corresponding to the operation instruction, including:
determining corresponding input equipment according to the operation instruction;
constructing an input instruction according to the operation instruction;
writing the input instruction into an instruction space of the input device.
In an optional implementation manner in the above application, the writing operation of the input instruction in the instruction space is refined into determining the corresponding input device according to the operation instruction and constructing the input instruction; the input instruction is written into the instruction space of the input equipment, so that the determination mechanism of the input equipment and the writing mechanism of the input instruction are perfected, and the guarantee is provided for the differentiation of different input instructions of different input equipment.
Optionally, the master control device is a vehicle machine; the accessory equipment is vehicle-mounted equipment.
An optional implementation in the above-mentioned application is through refining master control equipment into the car machine, refines auxiliary equipment into mobile unit to realized controlling through the car machine to mobile unit's generalization, for the user provides convenience to mobile unit's control, operate through the touch-control subassembly of user in to the car machine simultaneously, can realize controlling the mobile unit's generalization, promoted user's operation and felt.
In a second aspect, an embodiment of the present application further provides a device interaction method, which is executed by a master device, and includes:
responding to the touch operation of a user on the touch assembly, and generating an operation instruction;
and sending the operation instruction to the accessory equipment, so that the accessory equipment writes the input instruction corresponding to the operation instruction into the instruction space of the input equipment corresponding to the operation instruction, accesses from the instruction space through the driving of the input equipment and responds to the input instruction, and controls the accessory equipment.
In a third aspect, an embodiment of the present application further provides an apparatus interaction device, configured to an accessory apparatus, including:
the operation instruction receiving module is used for receiving an operation instruction sent by the main control equipment; the operation instruction is generated by the main control equipment in response to the touch operation of a user on the touch assembly;
an input instruction writing module, configured to write an input instruction corresponding to the operation instruction into an instruction space of an input device corresponding to the operation instruction;
and the auxiliary input instruction response module is used for accessing and responding to the input instruction from the instruction space so as to control the auxiliary equipment.
In a fourth aspect, an embodiment of the present application further provides an apparatus for device interaction, configured in a master device, including:
the operation instruction generating module is used for responding to the touch operation of the user on the touch assembly and generating an operation instruction;
and the operation instruction sending module is used for sending the operation instruction to the accessory equipment so as to enable the accessory equipment to write the input instruction corresponding to the operation instruction into the instruction space of the input equipment corresponding to the operation instruction, and access and respond to the input instruction from the instruction space through the driving of the input equipment so as to control the accessory equipment.
In a fifth aspect, an embodiment of the present application further provides an accessory device, including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute a device interaction method provided in the embodiments of the first aspect.
In a sixth aspect, an embodiment of the present application further provides a master control device, including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute a device interaction method provided in the second aspect.
In a seventh aspect, an embodiment of the present application further provides an interactive system, including:
a master control device and an accessory device;
the main control equipment responds to the touch operation of a user on the touch assembly, generates an operation instruction and sends the operation instruction to the accessory equipment;
and the auxiliary equipment writes an input instruction corresponding to the operation instruction into an instruction space of the input equipment corresponding to the operation instruction, accesses from the instruction space through the driving of the input equipment and responds to the input instruction so as to control the auxiliary equipment.
In an eighth aspect, embodiments of the present application further provide a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform a device interaction method provided in the first or second aspect.
Other effects of the above-described alternative will be described below with reference to specific embodiments.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
fig. 1 is a flowchart of a device interaction method in a first embodiment of the present application;
fig. 2 is a flowchart of a device interaction method in the second embodiment of the present application;
fig. 3 is a flowchart of a device interaction method in a third embodiment of the present application;
fig. 4 is a flowchart of a device interaction method in the fourth embodiment of the present application;
fig. 5A is a flowchart of a device interaction method in the fifth embodiment of the present application;
fig. 5B is an interaction diagram of operations between a vehicle-mounted device and a vehicle-mounted device in the fifth embodiment of the present application;
fig. 6 is a block diagram of an apparatus interaction device according to a sixth embodiment of the present application;
fig. 7 is a block diagram of an apparatus interaction device in a seventh embodiment of the present application;
FIG. 8 is a block diagram of an electronic device for implementing a device interaction method of an embodiment of the present application;
fig. 9 is a schematic structural diagram of a device interaction system in a ninth embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Example one
Fig. 1 is a flowchart of a device interaction method in a first embodiment of the present application. The method is executed by a device interaction device, and the device is realized by software and/or hardware and is specifically configured in the accessory device.
A device interaction method as shown in fig. 1, comprising:
s101, receiving an operation instruction sent by a main control device; the operation instruction is generated by the main control device in response to the touch operation of the user on the touch assembly.
The touch control component may be understood as an input device in the main control device, for example, a hardware touch control component such as a key, a knob, and an operation rod, or a software touch control component such as a virtual key in a soft keyboard and a touch screen.
Optionally, the operating instructions comprise operating events that control the accessory device. Or alternatively, the operating instructions include input text for text entry into an accessory application in the accessory device.
For example, when a user performs a touch operation on the touch component in the input device of the main control device, the main control device generates an operation instruction in response to the touch operation on the touch component by the user, and sends the operation instruction to the accessory device. Accordingly, the accessory device receives the operation instruction.
Alternatively, the operating system of the accessory device may directly receive the operating instruction sent by the main control device. Or optionally, in order to distinguish an operation instruction generated by a user directly touching the accessory device from an operation instruction sent by the main control device to implement direct multiplexing of the existing accessory device, a receiving application may be set in the accessory device, and the operation instruction sent by the main control device may be received by the receiving application.
And S102, writing an input instruction corresponding to the operation instruction into an instruction space of the input equipment corresponding to the operation instruction.
Exemplarily, the corresponding input device may be determined according to the operation instruction; constructing an input instruction according to the operation instruction; and writing the input command into the command space of the input device.
Specifically, according to an operation instruction, determining an input device capable of executing the operation instruction; according to the operation instruction, constructing an input instruction which can be identified by the determined input equipment; and writing the constructed input instruction into the determined instruction space, thereby distinguishing the input instructions which can be processed by different input devices, realizing the ordered storage of the input instructions and laying a foundation for the generalized control of the main control device on the auxiliary devices.
The input device corresponding to the operation instruction may be understood as a hardware input device such as a key, a knob, and a joystick in the accessory device, or a software input device such as a touch screen virtual key and a soft keyboard.
It can be understood that the input operation of the input device of the main control device is mapped to the input device of the accessory device by sending the operation instruction associated with the input device of the main control device to the accessory device and writing the input instruction corresponding to the operation instruction into the instruction space of the input device of the accessory device corresponding to the operation instruction by the accessory device, so as to achieve the effect that the input device of the main control device equivalently replaces the input device of the accessory device.
And S103, accessing from the instruction space through the driving of the input device and responding to the input instruction so as to control the auxiliary device.
Illustratively, input instructions may be accessed and parsed from the instruction space by a driver of the input device; and distributing the analysis result of the input instruction to the corresponding auxiliary application through the operating system of the auxiliary equipment for responding so as to control the auxiliary application.
Specifically, an input instruction is accessed from an instruction space through the driving of input equipment, and the input instruction is analyzed to obtain a corresponding instruction and content; transmitting the analyzed instruction and content to an operating system of the accessory equipment, and distributing the analyzed instruction and content to the accessory application through the operating system of the accessory equipment; the accessory application receives instructions and content sent by the operating system in response.
Optionally, the driver of the input device may be a hardware touch component driver corresponding to the hardware touch component; or optionally, the driver of the input device may further include a text input driver corresponding to the software touch component, and the like.
In an optional implementation manner of the embodiment of the present application, if the driver of the input device includes a hardware touch component driver, accessing and responding to the input instruction from the instruction space through the driver of the input device to control the accessory device, the method may include: and driving through a hardware touch control assembly, acquiring a control character instruction of the operation event from the instruction space, and updating the current focus in the display interface of the auxiliary application according to the control character instruction. By adopting the mode, the current focus in the auxiliary application display interface in the auxiliary equipment can be updated through the touch operation executed in the hardware input equipment such as the key, the knob or the operating rod in the main control equipment, so that the auxiliary equipment can be operated and controlled at different focuses.
In another optional implementation manner of the embodiment of the present application, if the driver of the input device includes a text input driver, accessing and responding to the input instruction from the instruction space through the driver of the input device to control the accessory device may be: and acquiring a text character instruction of the input text from the instruction space through a text input drive, and controlling the auxiliary application to display the input text from the current focus according to the text character instruction. And the current focus is a focus corresponding to the current moment in the display interface of the auxiliary application. The focus can be a default focus in advance, a focus updated through a touch operation of the user on the accessory device, or a focus updated through a touch operation of the user on the touch component in the main control device.
According to the embodiment of the application, the auxiliary equipment receives an operation instruction generated by the main control equipment in response to the touch operation of a user on the touch assembly; writing an input instruction corresponding to the operation instruction into an instruction space of the input equipment corresponding to the operation instruction; the accessory device is controlled by accessing and responding to the input command from the command space through the driving of the input device. According to the technical scheme, the auxiliary equipment receives the operation instruction sent by the main control equipment and responds, so that the operation control of the auxiliary equipment is realized through touch operation in the main control equipment in the interaction process of the main control equipment and the auxiliary equipment; meanwhile, the auxiliary equipment writes the input instruction corresponding to the operation instruction into the instruction space of the input equipment corresponding to the control instruction in the process of responding to the operation instruction, so that the differentiation of different input equipment and input instructions is realized, and a foundation is laid for the generalized input of the auxiliary equipment; the input command is accessed and responded from the command space through the driving of the input device, so that the generalized control of the accessory device is realized.
On the basis of the technical scheme of each embodiment, the main control device can be a car machine, and the auxiliary device can be a vehicle-mounted device, so that interactive operation between the car machine and the vehicle-mounted device is realized, generalized control over the vehicle-mounted device is realized through touch operation of a touch component on the car machine, convenience is provided for a user to control over the vehicle-mounted device, meanwhile, the user operates the touch component of the car machine, generalized control over the vehicle-mounted device can be realized, and the operation feeling of the user is improved.
Example two
Fig. 2 is a flowchart of an apparatus interaction method in the second embodiment of the present application, and the second embodiment of the present application performs optimization and improvement on the basis of the technical solutions of the foregoing embodiments.
Further, the operation of receiving the operation instruction sent by the main control device is refined into receiving the operation instruction sent by the transmission application of the main control device through the receiving application, so that the data interaction mode between the main control device and the accessory device is perfected.
A device interaction method as shown in fig. 2, comprising:
s201, receiving an operation instruction sent by a transmission application of the main control equipment through a receiving application; the operation instruction is generated by the main control device in response to the touch operation of the user on the touch assembly.
Exemplarily, when a user performs a touch operation on a touch component in an input device of a main control device, the main control device generates an operation instruction in response to the touch operation of the user on the touch component; the operation instruction is sent to a corresponding transmission application through the drive of the main control equipment; and sending the operation instruction to the accessory equipment through the transmission application.
Correspondingly, in order to distinguish the operation instruction generated by the user directly touching the accessory device from the operation instruction sent by the main control device to realize direct multiplexing of the existing accessory device, a receiving application can be set in the accessory device, and the operation instruction sent by the transmission application of the main control device is received through the receiving application.
Optionally, data transmission may be performed between the main control device and the accessory device by using a USB (Universal Serial Bus) or a local area network.
Exemplarily, when the main control device communicates with the Accessory device based on an AOA (Android access Protocol), and the main control device sends an operation instruction to the Accessory device, the operation instruction is sent to a corresponding transmission application through a driver of the main control device; acquiring an operation instruction from an operation system of the master control equipment through the transmission application; and encapsulating the operation instruction based on the AOA protocol, and transmitting the encapsulation result to the accessory equipment through a data transmission channel. Correspondingly, the accessory device receives the operation instruction sent by the transmission application of the main control device through the receiving application, and analyzes the operation instruction based on the AOA protocol.
It should be noted that, when the master device and the accessory device communicate based on the AOA protocol, the accessory mode is entered, where the master device acts as a USB slave, and the accessory device acts as a USB host and supplies power to the bus. At this time, the accessory device is an android accessory.
S202, writing an input instruction corresponding to the operation instruction into an instruction space of the input equipment corresponding to the operation instruction.
Exemplarily, according to the analysis result of the operation instruction, determining the corresponding input device; according to the analysis result of the control instruction, an input instruction which can be identified by the input equipment is constructed; and writing the input command into the command space of the input device.
And S203, accessing from the instruction space through the driving of the input device and responding to the input instruction so as to control the auxiliary device.
According to the embodiment of the application, the receiving mode of the operation instruction is perfected by refining the operation instruction sent by the receiving main control device into the operation instruction sent by the transmission application of the receiving application receiving main control device, and meanwhile, the operation instruction sent by the main control device is received by setting the receiving application, so that the operation instruction generated by the auxiliary device and the operation instruction generated by the main control device are distinguished, and the multiplexing of the auxiliary device is realized.
EXAMPLE III
Fig. 3 is a flowchart of a device interaction method in a third embodiment of the present application, where the third embodiment of the present application is applicable to a case where, in an interaction process between a main control device and an accessory device, the main control device controls the accessory device, and the method is executed by a device interaction apparatus, and the apparatus is implemented by software and/or hardware and is specifically configured in the main control device.
A device interaction method as shown in fig. 3, comprising:
s301, responding to the touch operation of the user on the touch assembly, and generating an operation instruction.
The touch control component may be understood as an input device in the main control device, for example, a hardware touch control component such as a key, a knob, and an operation rod, or a software touch control component such as a virtual key in a soft keyboard and a touch screen.
Optionally, the operating instructions comprise operating events that control the accessory device. Or alternatively, the operating instructions include input text for text entry into an accessory application in the accessory device.
For example, if the touch component includes a hardware touch component, the generating the operation instruction in response to the user's touch operation on the hardware touch component may be: responding to the touch operation of a user on the hardware touch control assembly, generating a control electric signal, and converting the control electric signal into a touch control digital signal; and converting the touch digital signal into an operation event based on a preset protocol, and generating an operation instruction comprising the operation event.
Specifically, after a user performs touch operation on the hardware touch component, a message of the touch operation is transmitted to the main control device through a Controller Area Network (CAN) bus protocol; the CAN bus protocol divides the transmission message into a data frame, a meta town, an error frame, an overload frame and the like. The types of events are distinguished in each frame according to the frame identification. For example, when an electronic control unit such as an engine control system, an anti-lock system-level seat adjustment system, and the like in a vehicle is connected through a CAN bus, a light signal, a knob signal, and the like CAN be distinguished through frame identification. Wherein, the frame identification of the light signal is 0X555, and the frame identification of the knob signal is 0X 566.
When the master control equipment receives the electric signal of the CAN bus, converting the control electric signal into a touch digital signal; and converting the digital signal into an analog event of the control system according to a preset protocol, and generating an operation instruction comprising an operation event. The simulation event is an operation event, and may be at least one of a knob event and a key event.
For example, if the touch component includes a software touch component, the generating the operation instruction in response to the touch operation of the user on the software touch component may be: and generating an operation instruction comprising an input text in response to the input operation of the user on the software touch component.
S302, the operation instruction is sent to the accessory equipment, so that the accessory equipment writes the input instruction corresponding to the operation instruction into the instruction space of the input equipment corresponding to the operation instruction, accesses from the instruction space through the driving of the input equipment and responds to the input instruction, and the accessory equipment is controlled.
Optionally, the main control device may send the operation instruction to the accessory device through its own operating system.
Optionally, in order to distinguish different functions of the main control device, a transmission application may be further set in the main control device, and the transmission application is configured to perform data transmission to an operating system of the main control device or perform data transmission between the main control device and the accessory device according to an operation of the user on the main control device. Correspondingly, the main control device sends the operation instruction to the accessory device through the transmission application.
According to the embodiment of the application, the main control equipment responds to the touch operation of a user on the touch assembly to generate an operation instruction; and sending the operation instruction to the accessory equipment so that the accessory equipment writes the input instruction corresponding to the operation instruction into the instruction space of the input equipment corresponding to the operation instruction, and accessing and responding to the input instruction from the instruction space through the driving of the input equipment so as to control the accessory equipment. According to the technical scheme, the operation instruction is generated through the touch operation of the user on the touch component in the main control device, and the auxiliary device is controlled based on the operation instruction, so that the operation control on the auxiliary device is realized through the touch operation in the main control device in the interaction process of the main control device and the auxiliary device; meanwhile, the auxiliary equipment writes the input instruction corresponding to the operation instruction into the instruction space of the input equipment corresponding to the control instruction in the process of responding to the operation instruction, so that the differentiation of different input equipment and input instructions is realized, and a foundation is laid for the generalized input of the auxiliary equipment; the input command is accessed and responded from the command space through the driving of the input device, so that the generalized control of the accessory device is realized.
On the basis of the technical scheme of each embodiment, the main control device can be a car machine, and the auxiliary device can be a vehicle-mounted device, so that interactive operation between the car machine and the vehicle-mounted device is realized, generalized control over the vehicle-mounted device is realized through touch operation of a touch component on the car machine, convenience is provided for a user to control over the vehicle-mounted device, meanwhile, the user operates the touch component of the car machine, generalized control over the vehicle-mounted device can be realized, and the operation feeling of the user is improved.
Example four
Fig. 4 is a flowchart of an apparatus interaction method in the fourth embodiment of the present application, and the embodiment of the present application performs optimization and improvement on the basis of the technical solutions of the foregoing embodiments.
Further, the operation of sending the operation instruction to the accessory equipment is refined into the operation of sending the operation instruction to a corresponding transmission application through the drive of the main control equipment; and sending the operation instruction to the accessory equipment through the transmission application so as to perfect a data interaction mode between the main control equipment and the accessory equipment.
A device interaction method as shown in fig. 4, comprising:
s401, responding to the touch operation of the user on the touch assembly, and generating an operation instruction.
S402, the operation instruction is sent to the corresponding transmission application through the drive of the main control equipment.
And S403, sending the operation instruction to the accessory equipment through the transmission application, so that the accessory equipment writes the input instruction corresponding to the operation instruction into the instruction space of the input equipment corresponding to the operation instruction, accesses from the instruction space through the drive of the input equipment and responds to the input instruction, and controls the accessory equipment.
Alternatively, the transfer application may be an application additionally installed to facilitate data transfer between the main control device and the accessory device.
In the existing main control device, when a user performs operation control on the main control device through an input device of the main control device, data transmission is performed to an operating system of the main control device according to an application program set by the user in response to an input operation of the user, so as to realize inherent functions of the input device of the main control device, such as controlling lights through a knob operation in a vehicle. Correspondingly, the transmission application can also realize data transmission between the main control device and the accessory device by multiplexing the application program set by the transmission application so as to realize the operation control of the accessory device.
When multiplexing the transmission application, in order to avoid confusion between the operation control of the main control device and the operation control of the accessory device, the transmission application and the accessory device can be distinguished through the operation mode of the transmission application.
Illustratively, if the transmission application is in the foreground operation mode, the operation instruction is sent to the corresponding transmission application through the driver of the main control device, so that the operation instruction is sent to the accessory device through the transmission application. If the transmission application is in the background operation mode, the transmission application can realize the inherent function of the transmission application and cannot realize the transmission of data between the main control equipment and the accessory equipment.
Optionally, the transmission application sends the operation instruction to the accessory device, and the operation instruction may be implemented in a USB or local area network transmission manner.
For example, the data transmission in the USB mode may be performed by acquiring an operation instruction from an operating system of the master control device through a transmission application; packaging the operation instruction based on the AOA protocol; and transmitting the encapsulation result to the accessory equipment through a data transmission channel. Correspondingly, the accessory device receives the operation instruction sent by the transmission application of the main control device through the receiving application, and analyzes the operation instruction based on the AOA protocol. The data transmission channel may be an AOA connection channel, and is established between the main control device and the accessory device after the main control device and the accessory device are in communication connection through the USB.
It should be noted that, when the master device and the accessory device communicate based on the AOA protocol, the accessory mode is entered, where the master device acts as a USB slave, and the accessory device acts as a USB host and supplies power to the bus. At this time, the accessory device is an android accessory.
According to the embodiment of the application, the process of sending the operation instruction is refined into the process of sending the operation instruction to the corresponding transmission application through the drive of the main control equipment; the operation instruction is sent to the accessory equipment through the transmission application, so that a data transmission mode between the main control equipment and the accessory equipment is perfected, the operation control of the main control equipment and the operation control of the accessory equipment are distinguished, and the phenomenon of control confusion is avoided.
EXAMPLE five
Fig. 5A is a flowchart of an apparatus interaction method in the fifth embodiment of the present application, and the embodiment of the present application provides a preferred implementation manner based on the technical solutions of the foregoing embodiments to implement control of a vehicle-mounted apparatus by a vehicle-mounted apparatus. And an operation interaction diagram of the vehicle-mounted device and the vehicle-mounted device shown in fig. 5B is combined for exemplary description.
A device interaction method as shown in fig. 5A, comprising:
s501, responding to the knob operation of the user on the vehicle, generating an operation signal.
The vehicle machine knob is a vehicle machine touch control assembly and serves as input equipment of a vehicle machine.
And S502, converting the operation signal into a knob signal frame by the knob control system, and transmitting the knob signal frame to the vehicle machine through the CAN bus in the form of an electric signal.
The electric signal refers to voltage or current converted along with time, an operation signal generated by knob operation is a non-electric signal, the signal can be converted into the electric signal through a sensor, and the electric signal is formed through the matching of time and high and low levels to transmit non-electric physical quantity.
The CAN bus is an ISO international standard serial communication protocol and is used for connecting various electronic control units (such as an engine control system, an anti-lock system, a seat adjusting system and the like) in a vehicle. In the CAN bus protocol, transmission messages are divided into data frames, remote frames, error frames, overload frames and the like. In each frame, the types of events are distinguished according to the frame Identification (ID), for example, the light signal frame ID is 0X555, the knob signal frame ID is 0X566, etc.
And S503, after the vehicle machine receives the electric signal of the CAN bus, the electric signal is converted into a digital signal.
And S504, converting the digital signal into an analog event of the vehicle-mounted machine system according to the vehicle-mounted machine protocol.
The simulation events can be summarized into up, down, left and right instructions for representing different operation events, such as knob events, key events and the like.
And S505, responding to the keyboard input operation and generating an input text.
S506, the car machine receives the input text through the car machine keyboard.
The car keyboard is a touch control component of the car and serves as input equipment of the car. Wherein the transport application is in a foreground operating mode.
Wherein, the car keyboard can be a hard keyboard or a soft keyboard.
S505-S506 may be performed before S501-S505, or alternatively performed after S501-S505.
And S507, after forwarding through the driver and the car machine operating system, distributing the operating instruction comprising the simulation event and/or the input text to a specific transmission application.
S508, the transmission application of the vehicle machine is used for establishing an AOA connection channel between the vehicle machine and the vehicle-mounted equipment.
Wherein, the mobile unit can be equipment such as intelligent audio amplifier and intelligent rear-view mirror.
S508 constructs the AOA connection channel when the car machine and the car-mounted device are connected via the USB, and this operation may be performed at any time before data transmission is performed based on the AOA connection channel.
S509, the transmission application acquires the operation instruction from the operation system and encapsulates the operation instruction into AOA protocol data.
And S510, transmitting the packaged operation instruction to the vehicle-mounted equipment through the AOA connecting channel.
And S511, the receiving application of the vehicle-mounted equipment analyzes the operation instruction according to the AOA protocol.
And S512, determining character equipment nodes in the vehicle-mounted equipment according to the analysis result.
The character equipment node comprises a hardware touch control component driver and a text input driver. For example, an operation instruction including a knob event is generated by a knob operation; correspondingly, the character device node is a knob drive "/dev/input/event 1".
And S513, constructing a character instruction which can be identified by the character equipment node according to the analysis result.
Such as character command "13301" corresponding to the operation command of the knob event.
And S514, writing the character command into the command space of the character device node.
If the knob drive "/dev/input/event 1" is written with the character command "13301", the "/dev/input/event 113301" is obtained.
And S515, the character device driver analyzes the command and the content in the character command.
And the analysis result comprises an intersection point updating instruction corresponding to the knob operation and an input text corresponding to the text input operation.
And S516, distributing the analysis result to the vehicle-mounted application through the operating system of the vehicle-mounted equipment.
S517, the vehicle-mounted application changes the current focus in the display interface in the vehicle-mounted application according to the received focus updating instruction; and/or to begin displaying text content at the current focus based on the received input text.
EXAMPLE six
Fig. 6 is a block diagram of an apparatus interaction device in the sixth embodiment of the present application. The embodiment of the application is suitable for the condition that the auxiliary equipment is controlled by the main control equipment in the interaction process of the main control equipment and the auxiliary equipment, and the device is realized by software and/or hardware and is specifically configured in the auxiliary equipment.
A device interaction apparatus 600 as shown in fig. 6, comprising: an operation instruction receiving module 601, an input instruction writing module 602 and an input instruction response module 603. Wherein the content of the first and second substances,
an operation instruction receiving module 601, configured to receive an operation instruction sent by a master control device; the operation instruction is generated by the main control equipment in response to the touch operation of a user on the touch assembly;
an input instruction writing module 602, configured to write an input instruction corresponding to the operation instruction into an instruction space of an input device corresponding to the operation instruction;
an input command response module 603, configured to access and respond to the input command from the command space to control the accessory device.
According to the embodiment of the application, an operation instruction generated by the main control equipment in response to the touch operation of a user on the touch assembly is received through the operation instruction receiving module; writing an input instruction corresponding to the operation instruction into an instruction space of the input equipment corresponding to the operation instruction through an input instruction writing module; and accessing and responding to the input command from the command space through the input command response module so as to control the accessory equipment. According to the technical scheme, the auxiliary equipment receives the operation instruction sent by the main control equipment and responds, so that the operation control of the auxiliary equipment is realized through touch operation in the main control equipment in the interaction process of the main control equipment and the auxiliary equipment; meanwhile, the auxiliary equipment writes the input instruction corresponding to the operation instruction into the instruction space of the input equipment corresponding to the control instruction in the process of responding to the operation instruction, so that the differentiation of different input equipment and input instructions is realized, and a foundation is laid for the generalized input of the auxiliary equipment; the input command is accessed and responded from the command space through the driving of the input device, so that the generalized control of the accessory device is realized.
Further, the input instruction response module 603 is specifically configured to:
accessing and parsing an input instruction from the instruction space;
and distributing the analysis result of the input instruction to the corresponding auxiliary application through the operating system of the auxiliary equipment for responding so as to control the auxiliary application.
Further, the touch control component comprises a hardware touch control component and/or a software touch control component;
the operation instruction comprises an operation event and/or an input text;
accordingly, the input command response module 603 includes a hardware touch device driver and/or a text input driver.
Further, the input instruction response module 603 is specifically configured to:
acquiring a control character instruction of the operation event from the instruction space, and updating a current focus in the display interface of the auxiliary application according to the control character instruction; and/or the presence of a gas in the gas,
and acquiring a text character instruction of the input text from the instruction space, and controlling the auxiliary application to display the input text from the current focus according to the text character instruction.
Further, the operation instruction receiving module 601 is specifically configured to:
and receiving an operation instruction sent by the transmission application of the main control equipment.
Further, the apparatus further includes an operation instruction parsing module, configured to:
after the operation instruction receiving module 601 receives an operation instruction sent by the transmission application of the main control device, before the input instruction writing module 602 writes the input instruction corresponding to the operation instruction into the instruction space of the input device corresponding to the operation instruction, the operation instruction is analyzed based on an android open attachment AOA protocol.
Further, the input command writing module 602 is specifically configured to:
determining corresponding input equipment according to the operation instruction;
constructing an input instruction according to the operation instruction;
writing the input instruction into an instruction space of the input device.
Further, the master control equipment is a vehicle machine; the accessory equipment is vehicle-mounted equipment.
The device interaction device can execute the device interaction method provided by any embodiment of the application, and has the corresponding functional modules and beneficial effects of executing the device interaction method.
EXAMPLE seven
Fig. 7 is a block diagram of an apparatus interaction device in a seventh embodiment of the present application. The embodiment of the application is suitable for the condition that the auxiliary equipment is controlled by the main control equipment in the interaction process of the main control equipment and the auxiliary equipment, and the device is realized by software and/or hardware and is specifically configured in the main control equipment.
A device interaction apparatus 700 as shown in fig. 7, comprising: an operation instruction generating module 701 and an operation instruction transmitting module 702. Wherein the content of the first and second substances,
an operation instruction generating module 701, configured to generate an operation instruction in response to a touch operation performed on the touch component by a user;
an operation instruction sending module 702, configured to send the operation instruction to an accessory device, so that the accessory device writes an input instruction corresponding to the operation instruction into an instruction space of an input device corresponding to the operation instruction, and accesses and responds to the input instruction from the instruction space through driving of the input device, so as to control the accessory device.
According to the embodiment of the application, the operation instruction generation module responds to the touch operation of a user on the touch assembly to generate the operation instruction; and the operation instruction sending module sends the operation instruction to the accessory equipment so that the accessory equipment writes the input instruction corresponding to the operation instruction into the instruction space of the input equipment corresponding to the operation instruction, and accesses and responds to the input instruction from the instruction space through the driving of the input equipment so as to control the accessory equipment. According to the technical scheme, the operation instruction is generated through the touch operation of the user on the touch component in the main control device, and the auxiliary device is controlled based on the operation instruction, so that the operation control on the auxiliary device is realized through the touch operation in the main control device in the interaction process of the main control device and the auxiliary device; meanwhile, the auxiliary equipment writes the input instruction corresponding to the operation instruction into the instruction space of the input equipment corresponding to the control instruction in the process of responding to the operation instruction, so that the differentiation of different input equipment and input instructions is realized, and a foundation is laid for the generalized input of the auxiliary equipment; the input command is accessed and responded from the command space through the driving of the input device, so that the generalized control of the accessory device is realized.
Further, the operation instruction sending module 702 is specifically configured to:
the operation instruction is sent to a corresponding transmission application through the drive of the main control equipment;
and sending the operation instruction to the accessory equipment through the transmission application.
Further, the operation instruction sending module 702, when executing sending the operation instruction to the accessory device through the transmission application, is specifically configured to:
acquiring the operation instruction from an operation system of the accessory equipment through the transmission application;
packaging the operation instruction based on an AOA protocol of the android open attachment;
and transmitting the encapsulation result to the auxiliary equipment through a data transmission channel.
Further, the apparatus further includes a data transmission channel establishing module, configured to:
and before transmitting the encapsulation result to the accessory device through a data transmission channel, establishing the data transmission channels of the main control device and the accessory device.
Further, the operation instruction sending module 702, when executing the operation instruction sent to the corresponding transmission application by the driver of the main control device, is specifically configured to:
and if the transmission application is in a foreground operation mode, the operation instruction is sent to the corresponding transmission application through the drive of the main control equipment.
Further, the touch control component comprises a hardware touch control component and/or a software touch control component.
Further, if the touch component includes a hardware touch component, the operation instruction generating module 701 is specifically configured to:
responding to the touch operation of a user on the hardware touch control assembly, generating a control electric signal, and converting the control electric signal into a touch control digital signal;
and converting the touch digital signal into an operation event based on a preset protocol, and generating an operation instruction comprising the operation event.
Further, the operation event comprises a knob event and/or a key event.
Further, if the touch component includes a software touch component, the operation instruction generating module 701 is specifically configured to:
and generating an operation instruction comprising an input text in response to the input operation of the user on the software touch component.
Further, the master control equipment is a vehicle machine; the accessory equipment is vehicle-mounted equipment.
The device interaction device can execute the device interaction method provided by any embodiment of the application, and has the corresponding functional modules and beneficial effects of executing the device interaction method.
Example eight
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided. The electronic device may be a main control device or may also be an accessory device.
Fig. 8 is a block diagram of an electronic device implementing the device interaction method according to the embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 8, the electronic apparatus includes: one or more processors 801, memory 802, and interfaces for connecting the various components, including a high speed interface and a low speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). Fig. 8 illustrates an example of a processor 801.
The memory 802 is a non-transitory computer readable storage medium as provided herein. Wherein the memory stores instructions executable by at least one processor to cause the at least one processor to perform the device interaction method provided herein. The non-transitory computer-readable storage medium of the present application stores computer instructions for causing a computer to perform the device interaction method provided herein.
The memory 802 is a non-transitory computer-readable storage medium, and can be used for storing non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the device interaction method in the embodiment of the present application (for example, the operation instruction receiving module 601, the input instruction writing module 602, and the input instruction responding module 603 shown in fig. 6, or the operation instruction generating module 701 and the operation instruction transmitting module 702 shown in fig. 7). The processor 801 executes various functional applications of the server and data processing by running non-transitory software programs, instructions, and modules stored in the memory 802, that is, implements the device interaction method in the above-described method embodiment.
The memory 802 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created by use of an electronic device implementing the device interaction method, and the like. Further, the memory 802 may include high speed random access memory and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 802 optionally includes memory located remotely from the processor 801, which may be connected via a network to an electronic device implementing the device interaction method. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device implementing the device interaction method may further include: an input device 803 and an output device 804. The processor 801, the memory 802, the input device 803, and the output device 804 may be connected by a bus or other means, and are exemplified by a bus in fig. 8.
The input device 803 may receive input numeric or character information and generate key signal inputs related to user settings and function controls of an electronic device implementing the device interaction method, such as an input device like a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointer stick, one or more mouse buttons, a track ball, a joystick, etc. The output devices 804 may include a display device, auxiliary lighting devices (e.g., LEDs), and haptic feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), the internet, and blockchain networks.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
According to the embodiment of the application, the auxiliary equipment receives an operation instruction generated by the main control equipment in response to the touch operation of a user on the touch assembly; writing an input instruction corresponding to the operation instruction into an instruction space of the input equipment corresponding to the operation instruction; the accessory device is controlled by accessing and responding to the input command from the command space through the driving of the input device. According to the technical scheme, the auxiliary equipment receives the operation instruction sent by the main control equipment and responds, so that the operation control of the auxiliary equipment is realized through touch operation in the main control equipment in the interaction process of the main control equipment and the auxiliary equipment; meanwhile, the auxiliary equipment writes the input instruction corresponding to the operation instruction into the instruction space of the input equipment corresponding to the control instruction in the process of responding to the operation instruction, so that the differentiation of different input equipment and input instructions is realized, and a foundation is laid for the generalized input of the auxiliary equipment; the input command is accessed and responded from the command space through the driving of the input device, so that the generalized control of the accessory device is realized.
Example nine
Fig. 9 is a schematic structural diagram of an interactive system in a ninth embodiment of the present application, where the interactive system includes: a master device 901 and an accessory device 902;
the main control device 901 generates an operation instruction in response to a touch operation of a user on the touch component, and sends the operation instruction to the accessory device 902;
the accessory device 902 writes an input command corresponding to the operation command into a command space of an input device corresponding to the operation command, and accesses and responds to the input command from the command space by driving the input device, so as to control the accessory device 902.
Further, the master control device 901 may execute a device interaction method provided in the embodiment of the present application; the accessory device 902 may perform another device interaction method provided by embodiments of the present application.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present application can be achieved, and the present invention is not limited herein.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims (24)

1. A device interaction method, performed by an accessory device, comprising:
receiving an operation instruction sent by the main control equipment; the operation instruction is generated by the main control equipment in response to the touch operation of a user on the touch assembly;
writing an input instruction corresponding to the operation instruction into an instruction space of an input device of the accessory device corresponding to the operation instruction;
and accessing and responding to the input instruction from the instruction space through the driving of the input device of the auxiliary device so as to control the auxiliary device, thereby realizing the mapping of the input operation of the input device of the main control device to the input device of the auxiliary device.
2. The method of claim 1, wherein accessing and responding to the input commands from the command space by actuation of an input device of the accessory device to control the accessory device comprises:
accessing and parsing an input command from the command space through driving of an input device of the accessory device;
and distributing the analysis result of the input instruction to the corresponding accessory application through the operating system of the accessory device for responding through the drive of the input device of the accessory device so as to control the accessory application.
3. The method of claim 1, wherein the touch component comprises a hardware touch component and/or a software touch component;
the operation instruction comprises an operation event and/or an input text;
correspondingly, the drivers of the input device comprise a hardware touch control component driver and/or a text input driver.
4. The method of claim 3, wherein accessing and responding to the input commands from the command space by actuation of an input device of the accessory device to control the accessory device comprises:
acquiring a control character instruction of the operation event from the instruction space through the drive of the hardware touch control component, and updating a current focus in an auxiliary application display interface according to the control character instruction; and/or the presence of a gas in the gas,
and acquiring a text character instruction of the input text from the instruction space through the text input drive, and controlling an auxiliary application to display the input text from a current focus according to the text character instruction.
5. The method of claim 1, wherein receiving the operation instruction sent by the master device comprises:
and receiving an operation instruction sent by the transmission application of the main control equipment through a receiving application.
6. The method according to claim 5, wherein after receiving, by a receiving application, an operation instruction sent by a transmission application of the master device, before writing an input instruction corresponding to the operation instruction into an instruction space of an input device of a slave device corresponding to the operation instruction, the method further comprises:
and analyzing the operation instruction based on an AOA protocol of the android open attachment.
7. The method according to claim 1, wherein writing the input command corresponding to the operation command into the command space of the input device of the accessory device corresponding to the operation command comprises:
determining corresponding input equipment according to the operation instruction;
constructing an input instruction according to the operation instruction;
and writing the input command into a command space of an input device of the auxiliary device.
8. The method according to any one of claims 1 to 7, wherein the master control device is a vehicle machine; the accessory equipment is vehicle-mounted equipment.
9. A device interaction method is executed by a master control device and comprises the following steps:
responding to the touch operation of a user on the touch assembly, and generating an operation instruction;
and sending the operation instruction to the accessory equipment, so that the accessory equipment writes the input instruction corresponding to the operation instruction into an instruction space of the input equipment of the accessory equipment corresponding to the operation instruction, accesses the instruction space through the drive of the input equipment of the accessory equipment and responds to the input instruction to control the accessory equipment, and thus the input operation of the input equipment of the main control equipment is mapped to the input equipment of the accessory equipment.
10. The method of claim 9, wherein sending the operating instructions to the accessory device comprises:
the operation instruction is sent to a corresponding transmission application through the drive of the main control equipment;
and sending the operation instruction to the accessory equipment through the transmission application.
11. The method of claim 10, wherein sending the operating instructions to the accessory device via the transport application comprises:
acquiring the operation instruction from an operation system of the main control equipment through the transmission application;
packaging the operation instruction based on an AOA protocol of the android open attachment;
and transmitting the encapsulation result to the auxiliary equipment through a data transmission channel.
12. The method of claim 11, wherein prior to transmitting the encapsulated result to the accessory device over a data transmission channel, the method further comprises:
and establishing a data transmission channel of the main control equipment and the accessory equipment.
13. The method of claim 10, wherein sending the operation instruction to the corresponding transmission application through a driver of a master device comprises:
and if the transmission application is in a foreground operation mode, the operation instruction is sent to the corresponding transmission application through the drive of the main control equipment.
14. The method of claim 9, wherein the touch component comprises a hardware touch component and/or a software touch component.
15. The method of claim 14, wherein if the touch component comprises a hardware touch component, generating an operation instruction in response to a user touch operation on the hardware touch component comprises:
responding to the touch operation of a user on the hardware touch control assembly, generating a control electric signal, and converting the control electric signal into a touch control digital signal;
and converting the touch digital signal into an operation event based on a preset protocol, and generating an operation instruction comprising the operation event.
16. The method of claim 15, wherein the operational event comprises a knob event and/or a key event.
17. The method of claim 14, wherein if the touch component comprises a software touch component, generating an operation instruction in response to a user's touch operation on the software touch component comprises:
and generating an operation instruction comprising an input text in response to the input operation of the user on the software touch component.
18. The method according to any one of claims 9-17, wherein the master control device is a vehicle machine; the accessory equipment is vehicle-mounted equipment.
19. A device interaction apparatus, configured to an accessory device, comprising:
the operation instruction receiving module is used for receiving an operation instruction sent by the main control equipment; the operation instruction is generated by the main control equipment in response to the touch operation of a user on the touch assembly;
an input instruction writing module, configured to write an input instruction corresponding to the operation instruction into an instruction space of an input device of the accessory device corresponding to the operation instruction;
and the input instruction response module is used for accessing and responding the input instruction from the instruction space to control the auxiliary equipment, so that the input operation of the input equipment of the main control equipment is mapped to the input equipment of the auxiliary equipment.
20. An apparatus interaction device, configured to a master device, includes:
the operation instruction generating module is used for responding to the touch operation of the user on the touch assembly and generating an operation instruction;
and the operation instruction sending module is used for sending the operation instruction to the accessory equipment so as to enable the accessory equipment to write the input instruction corresponding to the operation instruction into the instruction space of the input equipment of the accessory equipment corresponding to the operation instruction, access the instruction space through the drive of the input equipment of the accessory equipment and respond to the input instruction so as to control the accessory equipment, and therefore the input operation of the input equipment of the main control equipment is mapped to the input equipment of the accessory equipment.
21. An accessory device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform a method of device interaction according to any one of claims 1-8.
22. A master device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform a device interaction method as claimed in any one of claims 9 to 18.
23. An interactive system, comprising:
a master control device and an accessory device;
the main control equipment responds to the touch operation of a user on the touch assembly, generates an operation instruction and sends the operation instruction to the accessory equipment;
and the auxiliary equipment writes an input instruction corresponding to the operation instruction into an instruction space of input equipment of the auxiliary equipment corresponding to the operation instruction, accesses from the instruction space through the drive of the input equipment of the auxiliary equipment and responds to the input instruction to control the auxiliary equipment, so that the input operation of the input equipment of the main control equipment is mapped to the input equipment of the auxiliary equipment.
24. A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform a device interaction method as claimed in any one of claims 1 to 8, or to perform a device interaction method as claimed in any one of claims 9 to 18.
CN202010188711.1A 2020-03-17 2020-03-17 Equipment interaction method, device, equipment, system and medium Active CN111367452B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202010188711.1A CN111367452B (en) 2020-03-17 2020-03-17 Equipment interaction method, device, equipment, system and medium
JP2021042315A JP7262498B2 (en) 2020-03-17 2021-03-16 Device interaction method, device, device, system and medium
KR1020210034295A KR102528104B1 (en) 2020-03-17 2021-03-16 Equipment interaction method, device, equipment, system and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010188711.1A CN111367452B (en) 2020-03-17 2020-03-17 Equipment interaction method, device, equipment, system and medium

Publications (2)

Publication Number Publication Date
CN111367452A CN111367452A (en) 2020-07-03
CN111367452B true CN111367452B (en) 2021-08-03

Family

ID=71204448

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010188711.1A Active CN111367452B (en) 2020-03-17 2020-03-17 Equipment interaction method, device, equipment, system and medium

Country Status (3)

Country Link
JP (1) JP7262498B2 (en)
KR (1) KR102528104B1 (en)
CN (1) CN111367452B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112572418A (en) * 2020-12-15 2021-03-30 北京百度网讯科技有限公司 Control method and device for unmanned vehicle and electronic equipment
CN114691553B (en) * 2020-12-29 2023-05-16 成都鼎桥通信技术有限公司 Method and device for accessing accessory device
CN113553198A (en) * 2021-06-01 2021-10-26 刘启成 Data processing method and device
CN115542809B (en) * 2022-09-30 2024-02-20 佛山食神网络智能科技有限公司 Universal controller
CN115390980B (en) * 2022-10-27 2023-04-07 深圳开鸿数字产业发展有限公司 Processing method of distributed interaction, computer equipment and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103309308A (en) * 2013-05-17 2013-09-18 华为技术有限公司 Equipment intelligent control method, device, system and plug-and-play equipment
CN103677768A (en) * 2012-09-05 2014-03-26 优三第科技开发（深圳）有限公司 Electronic device and control method and device thereof
CN104424036A (en) * 2013-08-28 2015-03-18 中兴通讯股份有限公司 Synchronous operation method and device of smart terminal
CN105282258A (en) * 2015-11-10 2016-01-27 福建星网视易信息系统有限公司 Method and system for controlling remote desktop
CN108108105A (en) * 2017-12-18 2018-06-01 联想(北京)有限公司 A kind of information processing equipment and information processing method

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010130369A (en) * 2008-11-27 2010-06-10 Fujitsu Ten Ltd On-board device and remote control system
JP5230380B2 (en) * 2008-11-28 2013-07-10 富士通テン株式会社 In-vehicle device and in-vehicle display system
US8433828B2 (en) 2010-02-26 2013-04-30 Apple Inc. Accessory protocol for touch screen device accessibility
EP3326056B1 (en) * 2015-07-17 2022-10-12 Crown Equipment Corporation Processing device having a graphical user interface for industrial vehicle
US11054894B2 (en) * 2017-05-05 2021-07-06 Microsoft Technology Licensing, Llc Integrated mixed-input system
KR102410941B1 (en) * 2017-10-17 2022-06-20 현대자동차주식회사 Apparatus and method for controlling mobile device communicated with in-vehicle terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103677768A (en) * 2012-09-05 2014-03-26 优三第科技开发（深圳）有限公司 Electronic device and control method and device thereof
CN103309308A (en) * 2013-05-17 2013-09-18 华为技术有限公司 Equipment intelligent control method, device, system and plug-and-play equipment
CN104424036A (en) * 2013-08-28 2015-03-18 中兴通讯股份有限公司 Synchronous operation method and device of smart terminal
CN105282258A (en) * 2015-11-10 2016-01-27 福建星网视易信息系统有限公司 Method and system for controlling remote desktop
CN108108105A (en) * 2017-12-18 2018-06-01 联想(北京)有限公司 A kind of information processing equipment and information processing method

Also Published As

Publication number Publication date
JP2021101356A (en) 2021-07-08
JP7262498B2 (en) 2023-04-21
KR20210036880A (en) 2021-04-05
CN111367452A (en) 2020-07-03
KR102528104B1 (en) 2023-05-02

Similar Documents

Publication Publication Date Title
CN111367452B (en) Equipment interaction method, device, equipment, system and medium
US20210210091A1 (en) Method, device, and storage medium for waking up via speech
CN111645521B (en) Control method and device for intelligent rearview mirror, electronic equipment and storage medium
US20190237003A1 (en) Display device, electronic device and method of controlling screen display
JP7269265B2 (en) VIDEO FRAME TRANSMISSION METHOD, DEVICE, ELECTRONIC DEVICE AND READABLE STORAGE MEDIUM
KR20160069445A (en) User apparatus for managing web application and method therefor
JP7200277B2 (en) Method and apparatus, electronic device, storage medium and computer program for identifying word slots
JP2021106015A (en) Vehicle group management method, device and related appliance
CN112793570A (en) Control method, device, equipment and storage medium for automatic driving vehicle
WO2017051171A1 (en) Private access to human interface devices
CN111966939A (en) Page skipping method and device
CN110717999B (en) Communication method, communication device, electronic equipment and storage medium
CN111930678A (en) Data transmission method and device, electronic equipment and storage medium
US7836461B2 (en) Computer interface system using multiple independent hardware and virtual human-computer input devices and related enabling subroutines
CN110536283B (en) Terminal identifier acquisition method, device, electronic equipment and medium
JP7266556B2 (en) AR navigation display method, device, electronic device and storage medium
CN112329907A (en) Dialogue processing method and device, electronic equipment and storage medium
JP2022028669A (en) Method, apparatus, electronic device, computer-readable storage medium, and computer program for outputting traffic light information
CN112017528B (en) Vehicle-mounted machine map configuration method and device and electronic equipment
CN112653602A (en) Intelligent control method, device, system and storage medium
CN112506826A (en) Communication method, system, master chip and slave chip
US20190237007A1 (en) Display device, electronic device and method of controlling screen display
CN111506399A (en) Task migration method and device, electronic equipment and storage medium
CN103975379A (en) Display system
CN112578713B (en) Vehicle information processing method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20211019

Address after: 100176 101, floor 1, building 1, yard 7, Ruihe West 2nd Road, Beijing Economic and Technological Development Zone, Daxing District, Beijing

Patentee after: Apollo Zhilian (Beijing) Technology Co.,Ltd.

Address before: 2 / F, baidu building, 10 Shangdi 10th Street, Haidian District, Beijing 100085

Patentee before: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd.