WO2022227034A1 - 电子设备的按键设置方法和控制方法、模拟设备及车辆 - Google Patents

电子设备的按键设置方法和控制方法、模拟设备及车辆 Download PDF

Info

Publication number
WO2022227034A1
WO2022227034A1 PCT/CN2021/091604 CN2021091604W WO2022227034A1 WO 2022227034 A1 WO2022227034 A1 WO 2022227034A1 CN 2021091604 W CN2021091604 W CN 2021091604W WO 2022227034 A1 WO2022227034 A1 WO 2022227034A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
button
instruction
keys
simulation
Prior art date
Application number
PCT/CN2021/091604
Other languages
English (en)
French (fr)
Inventor
施嘉
李凯瑞
于华洲
马瑞
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN202210950529.4A priority Critical patent/CN115352375A/zh
Priority to PCT/CN2021/091604 priority patent/WO2022227034A1/zh
Priority to CN202180001458.7A priority patent/CN113329914B/zh
Publication of WO2022227034A1 publication Critical patent/WO2022227034A1/zh

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
    • B60R11/0264—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof for control means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
    • B60R16/0231—Circuits relating to the driving or the functioning of the vehicle
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R2011/0001—Arrangements for holding or mounting articles, not otherwise provided for characterised by position
    • B60R2011/0003—Arrangements for holding or mounting articles, not otherwise provided for characterised by position inside the vehicle
    • B60R2011/001—Vehicle control means, e.g. steering-wheel or column

Definitions

  • the present application relates to the technical field of smart cars, and in particular, to a key setting method and control method of an electronic device, a simulation device and a vehicle.
  • Driving a vehicle may involve controlling multiple electronic devices within the vehicle.
  • the electronic equipment can be, for example, a central control system, a car window, an audio-visual entertainment system, and the like.
  • the audio-visual entertainment system can be set on the back of the front seat, which is convenient for the rear passengers to watch. Since multiple electronic devices are generally located in different positions of the vehicle, buttons of multiple electronic devices or multiple buttons of one electronic device are far away from the driver, which is inconvenient for the driver to control, which is not conducive to improving the driving experience. Moreover, drivers using these electronic devices while driving may also create safety risks due to distraction.
  • the embodiments of the present application provide a button setting method and control method for an electronic device, a simulation device, and a vehicle.
  • the control buttons of other electronic devices can be simulated/duplicated on the steering wheel, and the user can drive It can easily control other electronic devices, ensure driving safety, and improve the user experience.
  • an embodiment of the present application provides a method for setting buttons of an electronic device, the method comprising: receiving a button simulation instruction from at least one electronic device, where the button simulation instruction carries button information of the electronic device; The button simulates the instruction, so that the button of the at least one electronic device is displayed on the touch screen, wherein the touch screen is arranged on the steering wheel of the vehicle, and the button displayed on the touch screen is triggered when the at least one electronic device is caused to perform a corresponding action.
  • the control buttons of other electronic devices can be simulated/replicated on the steering wheel, and the user can easily control other electronic devices while driving to ensure driving safety.
  • the method before the receiving a key simulation instruction from at least one electronic device, the method includes: sending a key simulation request to the at least one electronic device, where the key simulation request is used to request all Whether the at least one electronic device simulates a button through the touch display screen, wherein the button simulation indication is sent when the at least one electronic device simulates a button through the touch display screen.
  • the analog device can first initiate a button simulation request to the electronic device. After the electronic device passes the request, it sends a button simulation instruction to the analog device, and then the analog device simulates the button according to the button simulation instruction.
  • the electronic device may directly send a button emulation instruction to the analog device, and the electronic device is the first initiator.
  • the displaying the button of the at least one electronic device on the touch-sensitive display screen according to the button simulation instruction includes: determining to add a new key according to the button simulation instruction sent by the first electronic device
  • the function button wherein the first electronic device is one of the at least one electronic device, and the new function button can realize the functions of at least two buttons set on the first electronic device or can realize A function different from the function of the button set on the first electronic device; the button of the first electronic device is displayed on the touch display screen, and the button of the first electronic device includes the new function button . That is to say, the keys of the electronic device displayed on the touch display screen only need to correspond to the keys set on the electronic device, and need not be identical.
  • one key set on the touch screen can integrate the functions of two keys set on the electronic device, or, in order to realize the keys different from those on the electronic device
  • a new function button can be added to the touch display screen, and the new function button can control the electronic device to perform a function different from the original button on the electronic device, which can better meet the needs of users.
  • the displaying the at least one button of the electronic device on the touch-sensitive display screen according to the button simulation instruction includes: determining, according to the button simulation instruction, two or more to-be-displayed buttons An electronic device; detecting a user gesture, determining that the user gesture matches a set gesture, and displaying the keys of a second electronic device on the touch display screen, wherein the second electronic device is the two or more electronic devices In one of the set gestures, the corresponding relationship between the set gesture and the second electronic device is preset. That is to say, in order to facilitate the control of multiple electronic devices, the key simulation instructions of multiple electronic devices can be received, but the space of the touch screen is limited and the number of keys displayed on the touch screen is also avoided.
  • the corresponding relationship between the set gesture and the second electronic device can be preset, so that when it is detected that the user gesture matches the set gesture, it indicates that the user wishes to control the second electronic device through the touch display screen, so the touch screen can be used to control the second electronic device.
  • the control display screen displays the keys of the second electronic device.
  • the displaying the button of the at least one electronic device on the touch display screen according to the button simulation instruction includes: according to the button simulation instruction, displaying on the touch display screen the button of the at least one electronic device. Displaying the identifiers of two or more electronic devices: when the identifier of one of the two or more electronic devices is triggered, the touch display screen is switched to display the keys of the triggered electronic device. That is to say, when receiving a button simulation instruction of two or more electronic devices, the logos of two or more electronic devices can be displayed first, and then the user can select the logo of the electronic device to be controlled, and then the touch screen can be switched to Displays the keys of the electronic device.
  • the displaying the button of the at least one electronic device on the touch display screen according to the button simulation instruction includes: according to the button simulation instruction, displaying on the touch display screen the button of the at least one electronic device.
  • a plurality of pages are displayed in an upper layer and dislocated, and each page includes at least one button of an electronic device; in response to a selection operation on at least one page of the plurality of pages, the touch display screen is switched to display the at least one page keys of electronic devices. That is to say, when receiving a button simulation instruction of two or more electronic devices, multiple pages can be displayed first, each page includes the buttons of one or more electronic devices, and then the user can select the button of the electronic device to be controlled. page, you can switch the touch screen display to display only the keys of the electronic device on the page.
  • causing the touch display screen to display the key of the at least one electronic device according to the key simulation instruction includes: causing the touch display screen to display, according to the key simulation instruction, the touch display screen. Displaying the keys of the first part of the electronic devices in the plurality of electronic devices; and switching the touch display screen to display the keys of the second part of the electronic devices in the plurality of electronic devices in response to the switching operation. That is to say, when the keys of multiple electronic devices need to be displayed on the touch screen, the touch screen can be made to display the keys of the first part of the electronic device first, and then a switching operation can be performed, such as sliding the screen, so that the touch screen can be displayed on the touch screen. The display screen then displays the keys of the second part of the electronic device.
  • the first part of the electronic device and the second part of the electronic device respectively comprise at least one electronic device.
  • the first portion of electronic equipment includes a third electronic device
  • the second portion of electronic equipment includes a fourth electronic device.
  • the touch screen can only display the buttons of the third electronic device (or the fourth electronic device); in response to the switching operation, the touch screen can be switched to display the fourth electronic device (or the fourth electronic device). the button of the third electronic device).
  • the displaying the button of the at least one electronic device on the touch display screen according to the button simulation instruction includes: according to the button simulation instruction, displaying on the touch display screen the button of the at least one electronic device.
  • the upper section displays the keys of more than two electronic devices. That is to say, when the display space of the touch screen allows the buttons of multiple electronic devices to be displayed at the same time and the user needs to control more than two electronic devices, the touch screen can be partitioned to display the buttons of more than two electronic devices. It is convenient for users to control these electronic devices.
  • the method further includes: in response to the moving operation, adjusting the display position of the selected key on the touch display screen, and setting the position of the key to be movable, for example, dragging the key It can be moved, so that the frequently used keys can be conveniently moved to a position that is more convenient for the user to control; and/or, when multiple keys are displayed on the touch screen, the multiple keys are deleted in response to the filtering operation selected keys from the plurality of keys, and retain the remaining keys of the plurality of keys.
  • buttons of the electronic device displayed on the touch screen may not be controlled by the user, or the user does not use the button frequently, at this time, in order to simplify the buttons on the touch screen, in order to reduce the probability of misoperation and facilitate control or Add buttons that need to be controlled frequently in other electronic devices, and users can choose to delete some buttons.
  • the displaying the button of the at least one electronic device on the touch-sensitive display screen according to the button simulation instruction specifically includes: performing a first process on the button simulation instruction, and the The first process includes at least one of integrity verification, decryption and decoding; and the touch display screen is controlled to display the keys of the at least one electronic device according to the key simulation instruction after the first process. That is to say, in order to ensure the security and integrity of the transmission of the button simulation instructions, the electronic device can first perform encryption, encoding and integrity verification when sending the button simulation instructions, and then send the processed button simulation instructions. Correspondingly, after receiving the key simulation instruction, the simulation device can perform processing such as integrity verification, decryption and decoding, and then display the keys of the electronic device on the touch screen according to the processed key simulation instruction.
  • the electronic equipment includes on-board equipment and/or mobile terminal equipment, and chips or processing devices in the above-mentioned equipment; the on-board equipment includes a central control system, a sound system, a car window, and audio-visual entertainment. , at least one of devices such as head-up display, and the mobile terminal device includes at least one of a mobile phone and a tablet computer.
  • the electronic device may further include other devices, such as a projector, a refrigerator, a massager, a television, an air conditioner, a camera, a video camera, and the like, if necessary.
  • an embodiment of the present application provides a method for controlling an electronic device.
  • the method includes: detecting a user's first operation on a touch display screen, and generating a control instruction, wherein the touch display screen is disposed on a vehicle on the steering wheel; sending the control command to at least one electronic device, wherein the at least one electronic device is determined by the first operation, and the control command is used to control the action of the at least one electronic device.
  • the touch display screen on the steering wheel of the vehicle to control the electronic equipment is to facilitate the control of other electronic equipment while the user is driving, so as to ensure driving safety.
  • the sending a control instruction to the at least one electronic device includes: respectively sending a control instruction to the first electronic device.
  • the device and the second electronic device send the control instruction; or, the control instruction is only sent to the first electronic device, and the corresponding relationship between the first operation and the first electronic device is preset. That is to say, when the first operation is detected, a control instruction can be sent to the two electronic devices respectively. It can be understood that there is no need to set a correspondence between the first operation and the two electronic devices, as long as the two electronic devices are in a state capable of receiving the control command, the control command can be received and corresponding actions can be performed.
  • the first operation only has a preset corresponding relationship with the first electronic device, and when the first operation is detected, only a control command may be sent to the first electronic device, so that the first electronic device performs corresponding actions according to the control command.
  • the sending a control instruction only to the first electronic device specifically includes: determining the first electronic device according to the first operation, and displaying on the touch display screen The button of the first electronic device, wherein the button is determined by the button information carried in the button simulation instruction sent by the first electronic device; it is detected that the button of the first electronic device is triggered, and the button is sent to the The first electronic device sends the control instruction. That is to say, it can be determined through the first operation that it is necessary to control the first electronic device in the at least one electronic device. Then, when the touch screen displays the keys of the first electronic device, and then by triggering the corresponding keys, the The first electronic device sends a corresponding control instruction, and makes the first electronic device perform a corresponding action according to the control instruction.
  • the sending a control instruction to at least one electronic device specifically includes: performing authority verification on the control instruction; determining that the authority verification of the control instruction passes, and sending the control instruction to the at least one electronic device. That is to say, in order to ensure that the control command needs to be sent to the electronic device, permission verification can be performed before sending the control command, and the control command can be sent to the electronic device after the permission verification is passed, so as to avoid sending invalid control commands. Alternatively, it is avoided to send control instructions not used to control the electronic device to the electronic device, reducing the risk of control errors.
  • the performing permission verification on the control command specifically includes: determining that the signal of the control command is within a preset signal range or that the identity of the application sending the control command has sending permission , the verification is passed; or, it is determined that the signal of the control instruction is outside the preset signal range or the identity of the application sending the control instruction does not have the sending authority, the verification is not passed. That is to say, the range of the signal for sending the control command can be preset, and the control command located within the preset signal range is determined to be sent to the electronic device, which can be verified through verification, while the control command located outside the preset signal range can be determined. If it does not need to be sent to the electronic device, it will not pass the verification.
  • the key setting method of the electronic device can be implemented by an application, and the application has the authority to send control instructions.
  • the simulated device also includes other applications, such as time and other conventional applications, which do not have the authority to send control instructions, so it can be determined to send Whether the identity of the application that controls the command has the permission to send, when the application has the permission to send, it is determined that the control command sent by the application needs to be sent to the electronic device, and the verification can be passed; when the application does not have the permission to send, determine the control command sent by the application.
  • the instruction does not need to be sent to the electronic device, and may not pass the verification.
  • determining that the authority verification of the control instruction is passed, and sending the control instruction to the at least one electronic device specifically includes: performing a second processing on the control instruction, and then sending the control instruction to the at least one electronic device.
  • the second processing includes at least one of encryption, encoding and integrity checking; and the control instruction after the second processing is sent to the at least one electronic device. That is to say, in order to ensure that the control command can be sent to the electronic device safely, quickly and completely, before sending the control command, the control command can be encrypted, encoded and integrity checked, and then the processed control command can be processed.
  • the method further includes: receiving feedback information sent by the at least one electronic device, where the feedback information is used to instruct the at least one electronic device to execute an execution result of the control instruction; When the feedback information indicates that the execution of the control instruction fails, make the touch screen display first indication information and a button of the at least one electronic device, where the first indication information is used to indicate that the execution of the control instruction fails ; when the feedback information indicates that the control instruction is successfully executed, make the touch screen display the key of the at least one electronic device or display the second instruction information and the key of the at least one electronic device, the first The second indication information is used to indicate that the control instruction is successfully executed.
  • the electronic device can return feedback information to indicate the execution result of the control command, and when the feedback information indicates that the execution of the control command fails, the touch screen can simultaneously display the electronic device's execution result.
  • the feedback information of the failure to execute the key and the control command when the feedback information indicates that the control command is successfully executed, the touch screen can only display the keys of the electronic device or simultaneously display the keys of the electronic device and the feedback information of the successful execution of the control command.
  • an embodiment of the present application provides a key setting device for an electronic device, the key setting device comprising: a receiving module for receiving a key simulation instruction from at least one electronic device, the key simulation instruction carrying the button information of the electronic device; a display module configured to display the button of the at least one electronic device on the touch screen display according to the button simulation instruction, wherein the touch screen screen is arranged on the steering wheel of the vehicle, and When a key displayed on the touch screen is triggered, the at least one electronic device is caused to perform a corresponding action.
  • the control buttons of other electronic devices can be simulated/replicated on the steering wheel, and the user can easily control other electronic devices while driving to ensure driving safety.
  • the key setting device further includes: a sending module, configured to send a key simulation request to the at least one electronic device before receiving the key simulation instruction from the at least one electronic device, so that the The button simulation request is used to request whether the at least one electronic device simulates a button through the touch display screen, wherein the button simulation indication is a request by the at least one electronic device to simulate a button through the touch display screen sent when.
  • a sending module configured to send a key simulation request to the at least one electronic device before receiving the key simulation instruction from the at least one electronic device, so that the The button simulation request is used to request whether the at least one electronic device simulates a button through the touch display screen, wherein the button simulation indication is a request by the at least one electronic device to simulate a button through the touch display screen sent when.
  • the display module is specifically configured to: determine to add a new function button according to a button simulation instruction sent by a first electronic device, where the first electronic device is the at least one electronic device
  • One of the new function keys can realize the functions of at least two keys set on the first electronic device or can realize functions different from the functions of the keys set on the first electronic device;
  • the touch screen displays the keys of the first electronic device, and the keys of the first electronic device include the new function keys.
  • the display module is specifically configured to: determine more than two electronic devices to be displayed according to the button simulation instruction; detect user gestures, determine that the user gestures match the set gestures, and make The touch screen displays buttons of a second electronic device, wherein the second electronic device is one of the two or more electronic devices, and the setting gesture corresponds to the second electronic device Relationships are preset.
  • the display module is specifically configured to: according to the key simulation instruction, display the identifiers of two or more electronic devices on the touch display screen: among the two or more electronic devices When the identifier of one of the electronic devices is triggered, the touch display screen is switched to display the keys of the triggered electronic device.
  • the display module is specifically configured to: display a plurality of pages on the touch-sensitive display screen in a stacked and dislocated position according to the button simulation instruction, and each page includes at least one button of an electronic device; In response to a selection operation on at least one page of the plurality of pages, the touch display screen is switched to a key of an electronic device displaying the at least one page.
  • the display module is specifically configured to: according to the key simulation instruction, make the touch screen display the keys of the first part of the electronic device among the plurality of electronic devices; in response to the switching operation, make The touch display screen is switched to display keys of a second part of the electronic devices among the plurality of electronic devices.
  • the display module is specifically configured to: display the buttons of two or more electronic devices on the touch-sensitive display screen by partition according to the button simulation instruction.
  • the button setting device further includes: an adjustment module, configured to adjust the display position of the selected button on the touch display screen in response to the moving operation; and/or, a deletion module, When a plurality of keys are displayed on the touch screen, in response to a screening operation, the selected keys of the plurality of keys are deleted, and the remaining keys of the plurality of keys are retained.
  • an adjustment module configured to adjust the display position of the selected button on the touch display screen in response to the moving operation
  • a deletion module When a plurality of keys are displayed on the touch screen, in response to a screening operation, the selected keys of the plurality of keys are deleted, and the remaining keys of the plurality of keys are retained.
  • the display module is specifically configured to: perform a first process on the button simulation indication, where the first process includes at least one of integrity verification, decryption and decoding;
  • the first processed key simulation instruction controls the touch display screen to display the keys of the at least one electronic device.
  • the electronic device includes a vehicle-mounted device and/or a mobile terminal device and a chip or a processing device in the vehicle-mounted device and/or the mobile terminal device;
  • the vehicle-mounted device includes a central control system, an audio system, At least one of car windows, audio-visual entertainment, head-up display, projector, refrigerator, massager, TV, air conditioner, camera, and video camera
  • the mobile terminal device includes at least one of a mobile phone and a tablet computer.
  • an embodiment of the present application provides a control device for an electronic device.
  • the control device includes: a detection and generation module, configured to detect a user's first operation on the touch display screen, and generate a control instruction, wherein the The touch screen is arranged on the steering wheel of the vehicle; the sending module is configured to send the control instruction to at least one electronic device, wherein the at least one electronic device is determined by the first operation, and the control instruction is used to control the The at least one electronic device acts.
  • the touch display screen on the steering wheel of the vehicle to control the electronic equipment is to facilitate the control of other electronic equipment while the user is driving, so as to ensure driving safety.
  • the sending module is configured to send messages to the first electronic device and the second electronic device, respectively.
  • the device sends the control instruction; or, the sending module is configured to send the control instruction only to the first electronic device, and the corresponding relationship between the first operation and the first electronic device is preset.
  • the sending module when the sending module only sends a control instruction to the first electronic device, it is specifically configured to: determine the first electronic device according to the first operation, and send the control instruction to the first electronic device when the touch control command is executed.
  • the button of the first electronic device is displayed on the display screen, wherein the button is determined by the button information carried in the button simulation instruction sent by the first electronic device; it is detected that the button of the first electronic device is Triggering, sending the control instruction to the first electronic device.
  • the sending module is specifically configured to: perform authority verification on the control instruction; determine that the authority verification of the control instruction passes, and send the control instruction to the at least one electronic device equipment.
  • the sending module performs permission verification on the control command, which specifically includes: determining that the signal of the control command is within a preset signal range or the identity of the application sending the control command has If it is determined that the signal of the control command is outside the preset signal range, or if it is determined that the identity of the application sending the control command does not have the right to send, the verification will not pass.
  • the sending module determines that the authority check of the control instruction passes, and the control instruction is sent to the at least one electronic device, which specifically includes: performing a second processing on the control instruction , the second processing includes at least one of encryption, encoding and integrity checking; sending the control instruction after the second processing to the at least one electronic device.
  • the control apparatus further includes: a receiving module, configured to receive feedback information sent by the at least one electronic device, where the feedback information is used to instruct the at least one electronic device to perform the control The execution result of the instruction; when the feedback information indicates that the execution of the control instruction fails, the display module is further configured to make the touch screen display the first instruction information and the key of the at least one electronic device, the The first indication information is used to indicate that the execution of the control instruction fails; when the feedback information indicates that the execution of the control instruction is successful, the display module is further used to make the touch display screen display the information of the at least one electronic device. pressing a key or displaying second indication information and a key of the at least one electronic device, where the second indication information is used to indicate that the control instruction is successfully executed.
  • an embodiment of the present application provides a simulation device, the simulation device includes: at least one memory for storing a program; at least one processor for executing a program stored in the memory, when the memory stored in the memory When the program is executed, the processor is configured to execute the method of the above-mentioned first aspect and/or the above-mentioned second aspect.
  • an embodiment of the present application provides a vehicle, including a steering wheel, at least one electronic device, and the simulation device provided in the fifth aspect, where a touch display screen of the simulation device is provided on the steering wheel.
  • an embodiment of the present application provides a computer storage medium, where instructions are stored in the computer storage medium, and when the instructions are executed on a computer, the computer is made to execute the first aspect and/or the second aspect method provided in.
  • an embodiment of the present application provides a computer program product containing instructions, when the instructions are executed on a computer, the computer causes the computer to execute the method of the first aspect and/or the second aspect.
  • an embodiment of the present application provides an electronic device, the electronic device includes at least one processor and an interface; the at least one processor obtains program instructions or data through the interface; the at least one processor is used for The program instructions are executed to implement the method of any one of the first aspect and/or the second aspect.
  • FIG. 1 is a schematic diagram of a partial structure of a vehicle provided by an embodiment of the present application.
  • FIG. 2 is a flowchart of a method for setting buttons of an electronic device provided by an embodiment of the present application
  • step S202 of the button setting method is a specific process diagram of step S202 of the button setting method according to an embodiment of the present application.
  • step S202 of the button setting method is another specific process diagram of step S202 of the button setting method according to an embodiment of the present application.
  • FIG. 5 is a schematic diagram of a user gesture involved in the specific process of step S202 in FIG. 4;
  • step S202 of the button setting method is another specific process diagram of step S202 of the button setting method according to an embodiment of the present application.
  • step S202 of the button setting method is another specific process diagram of step S202 of the button setting method according to an embodiment of the present application.
  • step S202 of the button setting method is another specific process diagram of step S202 of the button setting method according to an embodiment of the present application.
  • step S202 of the button setting method is another specific process diagram of step S202 of the button setting method according to an embodiment of the present application.
  • step S203 is a specific process diagram of step S203 and step S204 of the button setting method according to the embodiment of the present application;
  • FIG. 11 is a flowchart of an electronic device control method provided by an embodiment of the present application.
  • FIG. 12 is a schematic structural diagram of a button setting device of an electronic device provided by an embodiment of the present application.
  • FIG. 13 is a schematic structural diagram of a control device for an electronic device provided by an embodiment of the present application.
  • FIG. 14 is a schematic structural diagram of a simulation device provided by an embodiment of the present application.
  • FIG. 15 is an exemplary software structure diagram of the simulation device and the central control system provided by the embodiment of the present application.
  • Fig. 16 is a process diagram when data is transmitted between the simulation equipment and the central control system based on the software structure shown in Fig. 15;
  • Fig. 17 is an exemplary concrete flow chart when data is transmitted in the simulated device shown in Fig. 15;
  • FIG. 18 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • FIG. 1 is a schematic partial structure diagram of a vehicle provided by an embodiment of the present application.
  • the vehicle includes a steering wheel 10, an analog device, and at least one electronic device.
  • the simulation device has a touch display screen 201, and the touch display screen 201 is arranged on the steering wheel 10 of the vehicle.
  • the touch display screen 201 can be deployed in the upper middle position of the steering wheel.
  • the size of the 201 can be customized, and generally it can accommodate at least 5 to 6 buttons without affecting the installation of the airbag in the steering wheel.
  • the electronic equipment may include in-vehicle equipment and/or mobile terminal equipment.
  • the in-vehicle equipment may include at least one of a central control system, a sound system, a car window, audio-visual entertainment, a head up display (HUD), a projector, a refrigerator, a massager, a TV, an air conditioner, a camera, and a video camera.
  • the mobile terminal device may include at least one of a mobile phone and a tablet computer. It can be understood that the in-vehicle device and the mobile terminal device may also be other devices.
  • a central control system 30 and an audio-visual entertainment system 40 are shown in FIG. 1 .
  • the electronic device may also refer to a chip or circuit capable of realizing processing functions.
  • the simulation device can simulate the keys of one electronic device, and can also simulate the keys of multiple electronic devices.
  • the electronic device may be a head-up display.
  • the touch display screen 201 of the analog device may display at least one button of the head-up display, such as a button for adjusting the angle of the head-up display, and for example, a button for adjusting the position of the head-up display. .
  • the electronic device may be, for example, a central control system.
  • the simulation device may simulate the keys in the interface of an application (application, APP) displayed on the central control screen.
  • the shortcut keys of the application specially displayed on the touch screen of the steering wheel can be organized into an installation package in advance, and the installation package can be stored in the cloud or on the simulated device, but it is not loaded. It will be reloaded when the system sends the button simulation instruction. In this way, by using the touch display screen 201 on the steering wheel, the vehicle application on the central control screen can be controlled in real time.
  • the first solution is to control the center through the combination knob, button and/or touchpad on the center armrest (located between the two front seats).
  • the vehicle application on the control screen is to control the vehicle application on the central control screen through a combination of knobs, buttons and/or touchpads on the steering wheel.
  • the position of the operation buttons for controlling the central control screen is fixed or limited in number, and they are generally mechanical buttons.
  • the user needs to be distracted when controlling. Specifically, he needs to look at the central control screen first to find the application that needs to be opened, and then look at the center armrest or steering wheel. , find the operation button to open the application, then look at the central control screen to locate the specific option that needs to be set in the application, and then operate the center armrest or steering wheel (such as the touchpad) to set the specific option. Therefore, users need to move their eyes from the road to the center control screen and the center armrest/steering wheel for a long time, which can easily cause the driver to be distracted and cause safety risks during driving.
  • embodiments of the present application provide a key setting method and control method for an electronic device, a simulation device, and a vehicle, which can utilize the existing cabin environment to quickly and naturally control vehicle applications and/or electronic devices.
  • the control buttons of other electronic devices can be simulated/replicated on the steering wheel.
  • the buttons displayed on the touch screen are slightly different from the buttons of the electronic device itself.
  • the buttons on the display screen control the vehicle application and/or electronic device, the user can quickly observe the content of each control button and locate the position of the control button at any time without spending much attention. It is convenient to control other electronic devices and/or vehicle applications, ensure driving safety, and improve the driving comfort of the driver.
  • the simulation device can be divided into a simulation stage and a use stage.
  • the embodiment of the present application provides a key setting method for an electronic device
  • the embodiment of the present application provides a control method for an electronic device.
  • the key setting method of the electronic device will be introduced first.
  • FIG. 2 is a flowchart of a method for setting buttons of an electronic device provided by an embodiment of the present application.
  • the button setting method can be performed by an analog device. As shown in Figure 2, the button setting method includes the following steps:
  • Step S201 Receive a button simulation instruction from at least one electronic device, where the button simulation instruction carries the button information of the electronic device.
  • Step S202 display at least one button of the electronic device on the touch screen, wherein the touch screen is set on the steering wheel of the vehicle, and when the button displayed on the touch screen is triggered, at least one button is displayed on the touch screen.
  • An electronic device performs the corresponding action.
  • the "key-press simulation indication" may be one message or multiple messages.
  • the "key information” may include key numbers or symbols or icons, and the like.
  • the electronic device may directly send a button simulation instruction to the analog device, that is, step S201, when the electronic device is the first initiator; or , before step S201, the button setting method may further include step S200, sending a button simulation request to at least one electronic device, where the button simulation request is used to request whether at least one electronic device simulates a button through the touch display screen, wherein the button simulation indicates It is sent when at least one electronic device simulates a button request through the touch display screen.
  • the electronic device has not set the analog button function before and needs to be initiated by the simulated device, that is, the simulated device is the first initiator.
  • Step S203 in response to the moving operation, adjust the display position of the selected key on the touch screen.
  • Step S204 when multiple keys are displayed on the touch screen, in response to the screening operation, delete the selected key among the multiple keys, and keep the remaining keys among the multiple keys.
  • buttons of the electronic device displayed on the touch screen may not be controlled by the user, or the user does not use the button frequently, in order to simplify the buttons on the touch screen to reduce the probability of misoperation and facilitate control or increase the number of other electronic devices
  • the user can choose to delete some buttons, so as to better meet the needs of personalized use.
  • the above button setting method is suitable for the control of various vehicle applications.
  • the main control buttons of the current page of the vehicle application can be obtained through the interface and displayed on the touch screen of the smart steering wheel.
  • each application has With a deeper level and a complex interface, when the user controls the vehicle application by using the touch screen on the smart steering wheel, the user can quickly observe the content of each operation button at any time and locate the position of the operation button, so as to realize Effective control.
  • the user searches for the application to be opened on the central control screen, and opens the application; then, the application can automatically project its main keys to the touch screen of the steering wheel; then, the user clicks the display on the touch screen button to control the electronic device to perform corresponding actions.
  • the interface here refers to the interface agreed between the simulation device and the vehicle. Specifically, it is the open interface of the vehicle and the machine, and the analog device uses the interface through the Ethernet according to the agreed protocol.
  • the control buttons of other electronic devices can be simulated/replicated on the steering wheel, and the user can easily control other electronic devices while driving to ensure driving safety.
  • the method of using the independent touch screen to control the application can not only realize the control of the car application, but also can be extended to various electronic devices with additional independent intelligent control screens, such as notebook computers, TVs, tablet computers, monitors, etc. .
  • a first process may be performed on the key simulation instruction, and the first process includes at least one of integrity verification, decryption and decoding.
  • the touch display screen can be controlled to display the keys of at least one electronic device according to the key simulation instruction after the first processing. That is to say, in order to ensure the security and integrity of the transmission of the key simulation instructions, the electronic device can first perform encryption, encoding and integrity verification when sending the key simulation instructions, and then send the key simulation instructions. After the device receives the key simulation instruction, it can first perform processing such as integrity verification, decryption and decoding, and then display the keys of the electronic device on the touch screen according to the processed key simulation.
  • FIG. 3 is a specific process diagram of step S202 of the button setting method according to the embodiment of the present application.
  • step S202 may specifically include: first, the touch display screen sends a button simulation request to a first electronic device, such as a central control system with a central control screen, and then, the central control system with a central control screen sends a button simulation request Instruct the touch screen display, and the button simulation instruction carries the buttons displayed on the central control screen. Then, the simulation device determines to add a new function button such as B+C according to the button simulation instruction sent by the first electronic device such as the central control system. , wherein the first electronic device is one of at least one electronic device. Next, the keys of the first electronic device are displayed on the touch display screen, and the keys of the first electronic device include new function keys.
  • the new function button can realize the functions of at least two buttons set on the first electronic device.
  • the first interface of the first application on the central control screen It includes button A, button B, and button C.
  • the buttons that display the first electronic device on the touch screen include button A and button B+C.
  • buttons B+C on the touch screen can realize the For example, long press the button B+C on the touch screen to realize the function of clicking the button B on the central control screen, and click the button B+C on the touch screen to realize the function of clicking button B on the touch screen. Realize the function of clicking button C on the central control screen.
  • the buttons B+C on the touch screen are long-pressed, the central control screen switches to display the second interface of the first application, and the second interface includes buttons B1 and B2. At this time, the touch screen Buttons B1 and B2 are displayed above.
  • the new function button can realize a function different from the function of the button set on the first electronic device.
  • the buttons of the electronic device itself do not have a fast-forward playback function, but the new function buttons can realize fast-forward playback.
  • the keys set on the touch display screen may correspond to the keys set on the electronic device, and need not be exactly the same.
  • one key set on the touch display screen can integrate the functions of two keys set on the electronic device, or, in order to realize different functions from the keys on the electronic device Function, a new function button can be added on the touch screen, and the new function button can control the electronic device to perform a function different from the original button on the electronic device, which can better meet the needs of users.
  • FIG. 4 is another specific process diagram of step S202 of the button setting method according to the embodiment of the present application.
  • step S202 may specifically include: first, according to the key simulation instructions, determine two or more electronic devices to be displayed, and at this time, on the touch screen
  • the buttons of two or more electronic devices to be displayed can be displayed at the same time, such as button A, button B and button C of the first electronic device and button E and button F of the second electronic device, or other content can also be displayed.
  • the touch display screen determines which button of the electronic device is displayed; then, the user gesture is detected, and it is determined that the user gesture matches the set gesture, so that the button of the second electronic device is displayed on the touch display screen,
  • the second electronic device is one of two or more electronic devices, and the corresponding relationship between the setting gesture and the second electronic device is preset.
  • FIG. 5 is a schematic diagram of a user gesture involved in the specific process of step S202 in FIG. 4 .
  • the user can draw “W” on the touch display screen, if the "W" gesture is preset to correspond to the second electronic device.
  • the keys of the second electronic device are displayed on the touch display screen, for example, a user gesture is detected by a sensor.
  • a sensor can also be used to detect user gestures, such as installing a camera, and obtaining user gestures by taking pictures; Represents the voice function of the wake-up electronic device.
  • the button simulation instructions of multiple electronic devices can be received, but the space of the touch display screen is limited and to avoid the number of user-controlled buttons, the user can choose according to specific needs.
  • the correspondence between the gesture and the second electronic device can be preset, so that when it is detected that the user gesture matches the set gesture, it indicates that the user wishes to control the second electronic device through the touch display screen, so that the touch screen can be used to control the second electronic device.
  • the control display screen displays the keys of the second electronic device.
  • FIG. 6 is another specific process diagram of step S202 of the button setting method according to the embodiment of the present application.
  • step S202 when receiving key simulation instructions of two or more electronic devices, step S202 may specifically include: first, displaying the identifiers of two or more electronic devices on the touch display screen according to the key simulation instructions; then, When the identification of one electronic device among the two or more electronic devices is triggered, the touch display screen is switched to display the keys of the triggered electronic device.
  • the first electronic device includes button A, button B and button C
  • the second electronic device includes button E and button F.
  • the simulation device receives the button simulation instruction 1 sent by the first electronic device and the second electronic device
  • the touch screen displays the identification of the first electronic device such as electronic device 1 and the identification of the second electronic device such as electronic device 2, and then, when the user touches the identification electronic device 1, the touch display The screen is switched to display only the button A, the button B and the button C of the first electronic device.
  • the logos of two or more electronic devices can be displayed first, and then the user can select the logo of the electronic device to be controlled, and then the touch screen can be switched to Displays the keys of the electronic device.
  • FIG. 7 is another specific process diagram of step S202 of the button setting method according to the embodiment of the present application.
  • step S202 when receiving key simulation instructions of two or more electronic devices, step S202 may specifically include: first, according to the key simulation instructions, stacking and dislocating a plurality of pages on the touch screen display, each page includes at least one button of the electronic device; then, in response to a selection operation on at least one page among the multiple pages, the touch display screen is switched to the button of the electronic device displaying at least one page.
  • the first electronic device includes button A, button B and button C
  • the second electronic device includes button E and button F.
  • the simulation device receives the button simulation instruction 1 sent by the first electronic device and the second electronic device When sending the key simulation instruction 2, make the touch screen display two pages, the first page displays the keys of the first electronic device, the second page displays the keys of the second electronic device, and then, when the user touches the first page, The touch screen is switched to display only the button A, the button B and the button C of the first electronic device.
  • each page includes the buttons of one or more electronic devices, and then the user can select the button of the electronic device to be controlled. page, the touch screen can be switched to display the keys of the electronic device.
  • FIG. 8 is another specific process diagram of step S202 of the button setting method according to the embodiment of the present application.
  • the touch display screen is made to display the keys of the first part of the electronic devices among the plurality of electronic devices; in response to the switching operation, the touch display screen is switched to display the The keys of the second part of the plurality of electronic devices.
  • the switching operation can make the display content of the touch display screen switch among the keys of a plurality of electronic devices.
  • the switching operation can be a sliding screen operation or other setting operation.
  • the setting operation can make the touch screen switch display content, that is, switch from displaying the keys of the first part of the electronic device (or the second part of the electronic device) to displaying the second part The keys of the electronic device (or the first part of the electronic device). Moreover, when more electronic devices are included, the buttons of the third part of the electronic devices can also be switched to be displayed.
  • the first, second and third parts of electronic devices may each include at least one electronic device.
  • the first part of the electronic device may include the third electronic device
  • the second part of the electronic device may include the fourth electronic device.
  • the third electronic device includes a key D, a key E and a key F
  • the fourth electronic device includes a key M and a key N.
  • the touch screen can be made to display the buttons of the first part of the electronic device first, and then the switching operation can be performed, for example, sliding the screen to the left or Swipe right to bring the touchscreen display back to the second part of the electronics keys.
  • FIG. 9 is another specific process diagram of step S202 of the button setting method according to the embodiment of the present application.
  • step S202 may specifically include: according to the key simulation instruction, displaying the keys of two or more electronic devices in zones on the touch display screen.
  • the "keys of the electronic device” may include the original keys on the electronic device, or may include the new function keys of the electronic device.
  • the two or more electronic devices may include a first electronic device and a fourth electronic device.
  • the first electronic device may include a key A, a key B, and a key C
  • the fourth electronic device may include a key M and a key N.
  • the touch screen can simultaneously display the buttons A and B+C of the first electronic device and the buttons M and N of the fourth electronic device.
  • the button B+C can realize the functions of both the button B and the button C originally in the first electronic device.
  • the touch screen can be partitioned to display the buttons of more than two electronic devices. It is convenient for users to control these electronic devices.
  • FIG. 10 is a specific process diagram of step S203 and step S204 of the button setting method according to the embodiment of the present application.
  • the two or more electronic devices may include a first electronic device and a fourth electronic device.
  • the first electronic device may include a key A, a key B, and a key C
  • the fourth electronic device may include a key M and a key N.
  • the touch screen can simultaneously display the button A, the button B and the button C of the first electronic device and the button M and the button N of the fourth electronic device.
  • the user presses the button C for a long time to delete or drags the button to delete, so that only the button A, the button B, the button M and the button N are displayed on the touch screen.
  • it can respond to a moving operation, for example, the user drags the button C and the button M to move, so that the button C is located at the edge of the touch screen display, which is convenient for the user to control.
  • FIG. 11 is a flowchart of an electronic device control method provided by an embodiment of the present application.
  • the control method can be performed by a simulated device, as shown in Figure 11, the control method includes the following steps:
  • Step S1101 the simulation device detects a user's first operation on the touch screen display, and generates a control instruction, wherein the touch screen screen is arranged on the steering wheel of the vehicle.
  • Step S1102 the simulation device sends a control instruction to at least one electronic device, wherein the at least one electronic device is determined by the first operation, and the control instruction is used to control the action of the at least one electronic device.
  • the authority verification may be performed on the control instruction first; it is determined that the authority verification of the control instruction is passed, and then the control instruction is sent to at least one electronic device. Further, performing authority verification on the control instruction specifically includes: confirming that the signal of the control instruction is located within the preset signal range or the identity of the application that sends the control instruction has the sending authority, then the verification is passed; or, determining that the signal of the control instruction is located in the preset signal range. If it is outside the range of the signal or it is determined that the identity of the application sending the control command does not have the permission to send, the verification will not be passed.
  • a second process may also be performed on the control instruction, the second process includes at least one of encryption, encoding and integrity checking, and then the control instruction after the second process is sent to at least one electronic device.
  • step S1102 specifically includes sending a control instruction to the first electronic device and the second electronic device respectively; or, sending a control instruction only to the first electronic device, the first electronic device
  • the corresponding relationship between the operation and the first electronic device is preset.
  • only sending the control instruction to the first electronic device specifically includes: first determining the first electronic device according to the first operation, and displaying the keys of the first electronic device on the touch screen, wherein the keys are sent by the first electronic device It is determined by the key information carried in the key simulation instruction of the first electronic device; it is detected that the key of the first electronic device is triggered, and a control command is sent to the first electronic device.
  • step S1103 After the electronic device receives the control command sent by the analog device, it may perform step S1103 to execute corresponding actions according to the control command; then, step S1104 is performed to form feedback information according to the execution result of the control command.
  • Step S1105 the simulated device receives feedback information sent by at least one electronic device, and the feedback information is used to indicate the execution result of the at least one electronic device executing the control instruction
  • Step S1106 when the feedback information indicates that the control instruction fails to be executed, the simulation device causes the touch screen to display first indication information and at least one button of the electronic device, and the first indication information is used to indicate that the control instruction execution fails;
  • the touch display screen is made to display at least one button of the electronic device or display second instruction information and at least one button of the electronic device, where the second instruction information is used to indicate that the control instruction is successfully executed.
  • the touch display screen on the steering wheel of the vehicle to control the electronic equipment is to facilitate the control of other electronic equipment while the user is driving, so as to ensure driving safety.
  • FIG. 12 is a schematic structural diagram of a button setting device of an electronic device provided by an embodiment of the present application.
  • the key setting device 1200 includes a receiving module 1201 and a display module 1202 .
  • the receiving module 1201 is configured to receive a button simulation instruction from at least one electronic device, where the button simulation instruction carries the button information of the electronic device.
  • the display module 1202 is configured to display at least one button of the electronic device on the touch screen according to the button simulation instruction, wherein the touch screen is arranged on the steering wheel of the vehicle, and when the button displayed on the touch screen is triggered, At least one electronic device is caused to perform a corresponding action.
  • the electronic device may include the above-mentioned in-vehicle device and/or mobile terminal device.
  • the control buttons of other electronic devices can be simulated/replicated on the steering wheel, and the user can easily control other electronic devices while driving to ensure driving safety.
  • the key setting apparatus 1200 further includes a sending module 1203, the sending module is configured to send a key simulation request to at least one electronic device before receiving a key simulation instruction from at least one electronic device, where the key simulation request is used to request Whether at least one electronic device simulates a button through the touch display screen, wherein the button simulation indication is sent when the at least one electronic device simulates a button through the touch display screen.
  • a sending module 1203 the sending module is configured to send a key simulation request to at least one electronic device before receiving a key simulation instruction from at least one electronic device, where the key simulation request is used to request Whether at least one electronic device simulates a button through the touch display screen, wherein the button simulation indication is sent when the at least one electronic device simulates a button through the touch display screen.
  • the display module 1202 is specifically configured to: determine to add a new function button according to a button simulation instruction sent by the first electronic device, wherein the first electronic device is one of at least one electronic device, and the new function button Can realize the functions of at least two buttons set on the first electronic device or can realize functions different from the functions of the buttons set on the first electronic device; display the buttons of the first electronic device on the touch screen, the first electronic device
  • the device's keys include new function keys.
  • the display module 1202 is specifically configured to: determine two or more electronic devices to be displayed according to the key simulation instructions; detect user gestures, determine that the user gestures match the set gestures, and display the second electronic device on the touch screen The button of the device, wherein the second electronic device is one of two or more electronic devices, and the corresponding relationship between the setting gesture and the second electronic device is preset.
  • the display module 1202 is specifically configured to: display the identifiers of two or more electronic devices on the touch display screen according to the button simulation instruction: when the identifier of one of the two or more electronic devices is triggered, make The touchscreen display switches to display the keys of the electronic device being triggered.
  • the display module 1202 is specifically configured to: display a plurality of pages stacked and dislocated on the touch display screen according to a key simulation instruction, each page including at least one key of an electronic device; responding to at least one of the plurality of pages The page selection operation switches the touch screen to the keys of the electronic device displaying at least one page.
  • the display module 1202 is specifically configured to: according to the key simulation instruction, make the touch screen display the keys of the first part of the electronic devices among the plurality of electronic devices; and in response to the switching operation, make the touch display display The screen is switched to display the keys of the second part of the electronic devices among the plurality of electronic devices.
  • the display module 1202 is specifically configured to include: according to the key simulation instruction, displaying the keys of two or more electronic devices in zones on the touch display screen.
  • the button setting apparatus 1200 further includes an adjustment module 1204, configured to adjust the display position of the selected button on the touch display screen in response to the moving operation.
  • the button setting device 1200 further includes a deletion module 1205, configured to delete a selected button among the multiple buttons in response to a filtering operation when multiple buttons are displayed on the touch screen, and keep the selected button from the multiple buttons. remaining keys.
  • the display module 1202 is specifically configured to: perform a first process on the key simulation instruction, where the first process includes at least one of integrity verification, decryption and decoding; control according to the key simulation instruction after the first process
  • the touch screen displays at least one key of the electronic device.
  • buttons setting device is used to execute the button setting method in the above-mentioned embodiment, such as the method described in relation to FIG. Similar to the description, for the working process of the key setting device, reference may be made to the corresponding process in the above method, which will not be repeated here.
  • FIG. 13 is a schematic structural diagram of a control apparatus for an electronic device provided by an embodiment of the present application.
  • the control device 1300 includes a detection generation module 1301 and a transmission module 1302 .
  • the detection and generation module 1301 is configured to detect a user's first operation on the touch screen display, and generate a control instruction, wherein the touch screen screen is arranged on the steering wheel of the vehicle.
  • the sending module 1302 is configured to send a control instruction to at least one electronic device, wherein the at least one electronic device is determined by the first operation, and the control instruction is used to control the action of the at least one electronic device.
  • the touch display screen on the steering wheel of the vehicle to control the electronic equipment is to facilitate the control of other electronic equipment while the user is driving, so as to ensure driving safety.
  • the sending module 1302 is configured to send control instructions to the first electronic device and the second electronic device respectively; or, the sending module 1302 is configured to only A control instruction is sent to the first electronic device, and the corresponding relationship between the first operation and the first electronic device is preset.
  • the sending module 1302 when the sending module 1302 only sends a control instruction to the first electronic device, it is specifically configured to: determine the first electronic device according to the first operation, and display the keys of the first electronic device on the touch display screen, wherein, The key is determined by the key information carried in the key simulation instruction sent by the first electronic device; it is detected that the key of the first electronic device is triggered, and a control instruction is sent to the first electronic device.
  • the sending module 1302 is specifically configured to: perform authority verification on the control instruction; determine that the authority verification of the control instruction passes, and send the control instruction to at least one electronic device.
  • the sending module 1302 performs permission verification on the control command, which specifically includes: determining that the signal of the control command is within a preset signal range or the identity of the application sending the control command has the sending permission, then the verification is passed; or, determining If the signal of the control command is outside the preset signal range or it is determined that the identity of the application sending the control command does not have the sending authority, the verification will not pass.
  • the sending module 1302 determines that the authority verification of the control instruction is performed by sending the control instruction to at least one electronic device, which specifically includes: performing a second processing on the control instruction, and the second processing includes encryption, encoding, and integrity verification. at least one of: sending the second processed control instruction to at least one electronic device.
  • the control device 1300 further includes a receiving module 1303 .
  • the receiving module 1303 is used to receive feedback information sent by at least one electronic device, and the feedback information is used to indicate the execution result of the at least one electronic device executing the control instruction; when the feedback information indicates that the execution of the control instruction fails, the control device 1300 makes the touch screen display The first indication information and the button of at least one electronic device, the first indication information is used to indicate that the execution of the control command fails; when the feedback information indicates that the execution of the control command is successful, the control device 1300 makes the touch screen display the button of at least one electronic device or Second instruction information and at least one key of the electronic device are displayed, where the second instruction information is used to indicate that the control instruction is successfully executed.
  • control device is used to execute the control method in the above-mentioned embodiment.
  • the implementation principle and technical effect of the corresponding program module in the control device are similar to those described in the above-mentioned method,
  • the working process of the control device reference may be made to the corresponding process in the above method, which will not be repeated here.
  • FIG. 14 is a schematic structural diagram of a simulation device provided by an embodiment of the present application.
  • the simulation device 1400 includes at least one memory 1402 and at least one processor 1403 .
  • at least one memory 1402 is used to store programs.
  • At least one processor 1403 is configured to execute a program stored in the memory, and when the program stored in the memory 1402 is executed, the processor 1403 is configured to execute the above-mentioned key setting method and/or control method of an electronic device.
  • the simulation device may further include a touch display screen 1401 . That is to say, the touch display screen 1401 can be used as a part of the simulation device 1400, or the touch display screen 1401 can be separated from the simulation device 1400. At this time, the simulation device 1400 and the touch display screen 1401 do not belong to the same device .
  • the analog device may be an in-vehicle device, or a circuit or chip with a processing function set in the in-vehicle device.
  • FIG. 15 , FIG. 16 and FIG. 17 are only used for exemplary illustration, and the software structure of the simulation device and the central control system is not limited in the present application.
  • FIG. 15 is an exemplary software structure diagram of the simulation device and the central control system provided by the embodiment of the present application.
  • the software structures of both the simulated device and the central control system can include an application layer, a service layer (Service), a hardware abstraction layer (HAL) and a kernel layer (Kenerl).
  • Service service layer
  • HAL hardware abstraction layer
  • Kenerl kernel layer
  • HAL is a routine package of the software layer, which is used to simulate the details of a specific system platform, so that the program can directly access the resources of the hardware.
  • the application layer can include applications such as music, radio and settings
  • the Service layer can include car-machine interconnection services and car-machine safety services
  • the HAL layer can include car-machine interconnection HAL, Kenerl
  • the layer may include, for example, an in-vehicle network driver.
  • the central control system can receive data such as control commands from analog devices, and perform integrity verification and decryption on the received data, and then follow the agreement.
  • the protocol parses/decodes the data, then sends the obtained data to the car-machine interconnection service, calls the car-machine security service for permission verification, and then sends it to the application (such as music) to perform the corresponding action.
  • the application layer may include applications such as display and setting
  • the Service layer may include interconnection services and security services
  • the HAL layer may include interconnection HAL
  • the Kenerl layer may include network drivers.
  • the display program of the application layer may include a touch screen and a display system.
  • the touch screen presents an operation interface and displays basic information. The user can manually click, drag, etc. to operate the touch screen to realize key setting, Display icon settings, control the central control screen and other functions.
  • the interconnection service and the security service are two independent modules of the Service layer.
  • the interconnection service mainly carries the interconnection function of the system, accepts the operation of the display interface and calls the interface of the HAL layer to send down messages/data, and also completes the security verification function by calling the interface provided by the security service.
  • the completion of the authority verification mainly includes the following two situations: 1) The verification of the signal agreed with the analog device, that is, whether the sent message/data such as the control command is within the agreed signal range, if not, then The verification fails; if it is, the verification is passed; (2) The message/data is sent from the application to the interconnected HAL, and it is verified whether the identity of the application has the permission to send, if not, the verification fails; if so, the verification is passed. test.
  • the interconnected HAL is mainly responsible for forwarding the messages/data of interconnected services.
  • the main functions are to shield the differences between hardware and communication protocols, and to build communication links to realize interconnection with the vehicle-machine/central control system.
  • it refers to the system (including the Service layer and the application layer).
  • the application layer and the Service layer use the agreed fixed interface, but different models
  • the simulated device may have different conventions for this message. For example, in simulated device A, 0x1 represents playing the next song, and in simulated device B, 0x0 represents playing the next song.
  • the HAL layer shields the difference from the service layer by adapting the hardware.
  • the interconnected HAL can be divided into a data processing/control module and a communication module.
  • the functions of the data processing/control module are encryption and decryption, integrity check and encoding and decoding, and the function of the communication module is to establish an Ethernet communication link.
  • the network driver of the Kenerl layer is mainly responsible for the implementation of the communication protocol stack.
  • the interior of the simulated device generally uses inter-process communication (IPC), and for the sake of efficiency, socket/other communication protocols are used between the interconnected HAL and the network driver.
  • security-enhanced Linux (SELinux) is a security service of the Linux kernel, which provides an access control security policy mechanism, including mandatory access control.
  • SELinux is a set of kernel modification and userspace tools that have been added to various Linux distributions. It is used to decouple the execution of security decisions from security policy and to simplify the amount of software involved in enforcing security policy.
  • the kernels of the simulation device and the central control system are both linux, so they are both controlled by SElinux, that is, the IPCs of the system are both controlled by SELinux.
  • FIG. 16 is a process diagram when data is transferred between the simulation device and the central control system based on the software structure shown in FIG. 15 . As shown in Figure 16, the following steps may be included:
  • the communication module of the analog device establishes a communication connection with the vehicle-machine communication module through a socket (ie, Ethernet) interface/vehicle local area network.
  • a socket ie, Ethernet
  • the application developer can define the functions of the buttons in the car operating system, such as playing the next song, the previous song, etc., and can define the interface provided by the car operating system, so that external devices such as analog devices can pass This interface obtains key information.
  • a proprietary protocol that can receive data from Ethernet, and both parties perform specific functions by parsing the protocol.
  • the emulated device may then prompt for softkey selection. That is to say, the central control system may not actively send messages to the analog device.
  • the analog device After the analog device is connected to the vehicle/central control system, it will actively obtain the supported buttons from the vehicle, and then display them on the touch screen. You can customize the required buttons and button positions on the control display. Specifically, in the "Settings" of the simulated device, you can choose whether to customize the function keys, you can select the keys to be displayed by checking, and you can customize the display orientation of the keys by dragging.
  • the APP operation can be performed. Even the user can click, slide or drag the buttons on the touch screen (set on the steering wheel) of the simulated device to operate the functions of the car.
  • the user operates the buttons of the APP displayed on the touch display screen of the simulated device, for example, clicks the button to play the next song of music, generates a control command, and sends the control command to the Internet service through IPC; Perform authority verification on control commands (for example, check whether the signal of the control command is within the agreed signal range and whether the identity of the application sending the control command has the sending authority); after the authority verification is passed, the control command is sent to the Internet through IPC
  • the data processing/control module of the HAL after the data processing/control module encrypts, encodes, and checks the integrity of the user control instructions received through the IPC and forwarded from the interconnection service, and then sends the control instructions to the communication module of the interconnected HAL.
  • the communication module has completed the connection with the vehicle machine, and the control command can be sent to the vehicle machine through the communication module.
  • An operation authority verification mechanism based on the combination of operation signals and SELinux.
  • the operation signal is first verified by the security service, and after the verification is successful, the control command can be sent to the communication module. Both the communication module and the interconnection service are controlled by the system SELinux authority.
  • Fig. 17 is an exemplary specific flow chart when data is transmitted in the simulated device shown in Fig. 15, as shown in Fig. 17, the following steps may be included:
  • Step S1701 sending a control instruction.
  • the APP invokes the cross-process operation interface provided by the interconnection service, and sends the control command.
  • the application pushes the control buttons and other related information on the interface to the touch screen of the smart steering wheel.
  • the shortcut control buttons of the application can be displayed on the touch screen of the smart steering wheel, and the driver can control the application through gestures such as taps and swipes.
  • Step S1702 the interconnection service sends a permission check to the security service.
  • Step S1703 the security service performs authority verification.
  • the security service can realize the security verification function, for example, the authority verification mechanism based on the operation signal is adopted, that is, the operational authority of the preset operation signal (including only receiving, only sending, allowing to receive and send) and the level of the user who is allowed to operate (user level, system level, etc.).
  • the security service determines whether to allow the operation by comparing the client identity and its operation signal called across the inter-process with the preset operation signal.
  • Step S1704 the security service completes the authority verification, and sends the authority verification result to the interconnection service.
  • Step S1705 the interconnection service determines that the authority verification is passed.
  • Step S1706 the interconnection service sends a callback of the subscription operation result, that is, the execution result of the subscription control instruction, to the communication module of the interconnected HAL.
  • Step S1707 the interconnection service issues a control instruction to the HAL. Specifically, it can be performed by calling the interface provided by the communication module.
  • step S1706 and S1707 since the central control system takes time to process, the message of the execution result of the control instruction can be subscribed first, and then the control instruction is sent. Since the two actions are separate, they are asynchronous execution processes.
  • Step S1708 the interconnected HAL encrypts, encodes, and checks the integrity of the control instruction.
  • the subscription management After receiving the subscription operation, the subscription management is completed. After receiving the issued control command, the message encoding and message encryption are performed, and then the control command is sent to the vehicle terminal through network communication.
  • Step S1709 the interconnected HAL issues the processed control command to the vehicle machine.
  • Step S1710 the vehicle machine returns feedback information to the interconnected HAL.
  • the vehicle is connected to the smart steering wheel through the network, receives the control commands sent by the smart steering wheel through the network, and feeds back the execution result to the smart steering wheel through the network after completing the operation.
  • Step S1711 the interconnected HAL performs integrity verification, decryption and decoding on the feedback information
  • Step S1712 the interconnection service returns the corresponding state according to the processed feedback information.
  • Step S1713 the APP displayed on the touch screen returns to a corresponding state according to the feedback information. That is, according to the processed feedback information, the touch display screen is switched to display the corresponding page.
  • a fast, natural and safe interaction method suitable for smart car cockpit control in-vehicle applications is provided, which can be adapted to various models, improves interaction efficiency, does not require customized steering wheel styles, and helps reduce costs.
  • the car application is controlled through the touch screen on the smart steering wheel. Based on a unified standard interface, the car application can directly project the main buttons on the interface to the touch screen on the smart steering wheel, free from the original traditional Defined limits for mechanical buttons on the steering wheel.
  • users can directly control the car application in the most efficient and easy-to-understand interactive way without leaving the steering wheel. Interactive operations can be completed efficiently and naturally, bringing a minimalist interactive experience.
  • the method of using the independent touch screen to control the application can not only realize the control of the car application, but also can be extended to various electronic devices with additional independent intelligent control screens, such as notebook computers, TVs, tablet computers, monitors, etc. .
  • FIG. 18 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. As shown in FIG. 18 , the electronic device 1800 includes one or more processors 1801 and an interface circuit 1802 . Optionally, the electronic device 1800 may also include a bus 1803 .
  • the processor 1801 may be an integrated circuit chip, which has signal processing capability. In the implementation process, each step of the above-mentioned method can be completed by an integrated logic circuit of hardware in the processor 1801 or an instruction in the form of software.
  • the above-mentioned processor 1801 may be a general purpose processor, a digital communicator (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components .
  • DSP digital communicator
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
  • the interface circuit 1802 can be used to send or receive data, instructions or information.
  • the processor 1801 can use the data, instructions or other information received by the interface circuit 1802 to process, and can send the processing completion information through the interface circuit 1802.
  • the electronic device 1800 further includes a memory, which may include read-only memory and random access memory, and provides operation instructions and data to the processor.
  • a portion of the memory may also include non-volatile random access memory (NVRAM).
  • the memory stores executable software modules or data structures, and the processor can perform corresponding operations by calling operation instructions stored in the memory (the operation instructions can be stored in the operating system).
  • the interface circuit 1802 can be used to output the execution result of the processor 1801 .
  • processor 1801 and the interface circuit 1802 can be implemented by hardware design, software design, or a combination of software and hardware, which is not limited here.
  • the steps in the above method embodiments may be implemented by logic circuits in the form of hardware or instructions in the form of software in the processor.
  • the electronic device may be a chip that can be applied to the above-mentioned electronic device, so as to implement the method provided in the embodiments of the present application.
  • the term “and/or” is only an association relationship for describing associated objects, indicating that there may be three relationships, for example, A and/or B, which may indicate: A alone exists, A alone exists There is B, and there are three cases of A and B at the same time.
  • the term “plurality” means two or more.
  • multiple systems refer to two or more systems
  • multiple terminals refer to two or more terminals.
  • first and second are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implying the indicated technical features.
  • a feature defined as “first” or “second” may expressly or implicitly include one or more of that feature.
  • the terms “including”, “including”, “having” and their variants mean “including but not limited to” unless specifically emphasized otherwise.
  • processor in the embodiments of the present application may be a central processing unit (central processing unit, CPU), and may also be other general-purpose processors, digital signal processors (digital signal processors, DSP), application-specific integrated circuits (application specific integrated circuit, ASIC), field programmable gate array (field programmable gate array, FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof.
  • CPU central processing unit
  • DSP digital signal processors
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • a general-purpose processor may be a microprocessor or any conventional processor.
  • the method steps in the embodiments of the present application may be implemented in a hardware manner, or may be implemented in a manner in which a processor executes software instructions.
  • Software instructions can be composed of corresponding software modules, and software modules can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (programmable rom) , PROM), erasable programmable read-only memory (erasable PROM, EPROM), electrically erasable programmable read-only memory (electrically EPROM, EEPROM), registers, hard disks, removable hard disks, CD-ROMs or known in the art in any other form of storage medium.
  • An exemplary storage medium is coupled to the processor, such that the processor can read information from, and write information to, the storage medium.
  • the storage medium can also be an integral part of the processor.
  • the processor and storage medium may reside in an ASIC.
  • the above-mentioned embodiments it may be implemented in whole or in part by software, hardware, firmware or any combination thereof.
  • software it can be implemented in whole or in part in the form of a computer program product.
  • the computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated.
  • the computer may be a general purpose computer, special purpose computer, computer network, or other programmable device.
  • the computer instructions may be stored in or transmitted over a computer-readable storage medium.
  • the computer instructions can be sent from one website site, computer, server, or data center to another website site by wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.) , computer, server or data center.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media.
  • the usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), or semiconductor media (eg, solid state disks (SSDs)), and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种电子设备的按键设置方法和控制方法、模拟设备及车辆，涉及智能汽车技术领域。首先，接收来自至少一个电子设备的按键模拟指示，按键模拟指示携带有电子设备的按键信息。接着，根据按键模拟指示，使触控显示屏（201）上显示至少一个电子设备的按键，其中，触控显示屏设置在车辆的方向盘（10）上。在检测到用户对触控显示屏（201）的第一操作后，生成控制指令，并向至少一个电子设备发送该控制指令，至少一个电子设备由第一操作确定，控制指令用于控制至少一个电子设备动作。该方法通过在方向盘（10）上设置触控显示屏（201），可以在方向盘（10）上模拟/复制其他电子设备的控制按键，在用户驾驶时，可以方便控制其他电子设备，保障驾驶安全。

Description

电子设备的按键设置方法和控制方法、模拟设备及车辆 技术领域
本申请涉及智能汽车技术领域，尤其涉及一种电子设备的按键设置方法和控制方法、模拟设备及车辆。
背景技术
在驾驶车辆时，可能会涉及到控制车辆内的多个电子设备的情形。电子设备例如可为中控系统、车窗和影音娱乐系统等。其中，影音娱乐系统可设置在前排座椅背部，方便后排人员观看。由于多个电子设备一般位于车辆的不同位置，多个电子设备的按键或者是一个电子设备的多个按键，距离驾驶者较远，不方便驾驶者进行控制，这不利于提升驾驶体验。并且，驾驶者在驾驶过程中使用这些电子设备，还可能因分神而产生安全风险。
发明内容
本申请实施例提供了一种电子设备的按键设置方法和控制方法、模拟设备及车辆，通过在方向盘上设置触控显示屏，可以在方向盘上模拟/复制其他电子设备的控制按键，在用户驾驶时，可以方便控制其他电子设备，保障驾驶安全，提升了用户体验。
第一方面，本申请实施例提供了一种电子设备的按键设置方法，该方法包括：接收来自至少一个电子设备的按键模拟指示，所述按键模拟指示携带有所述电子设备的按键信息；根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，其中，所述触控显示屏设置在车辆的方向盘上，在所述触控显示屏上显示的按键被触发时，使所述至少一个电子设备执行相应的动作。
在本申请实施例的方案中，通过在方向盘上设置触控显示屏，可以在方向盘上模拟/复制其他电子设备的控制按键，在用户驾驶时，可以方便控制其他电子设备，保障驾驶安全。
在一种可能的实现方式中，在所述接收来自至少一个电子设备的按键模拟指示前，所述方法包括：向所述至少一个电子设备发送按键模拟请求，所述按键模拟请求用于请求所述至少一个电子设备是否通过所述触控显示屏模拟按键，其中，所述按键模拟指示是所述至少一个电子设备在通过所述触控显示屏模拟按键的请求时发送的。也就是说，可以是由模拟设备先向电子设备发起按键模拟请求，电子设备通过请求后，发送给模拟设备按键模拟指示，然后模拟设备再根据按键模拟指示模拟按键，此时模拟设备是先发起者。或者，在模拟设备与电子设备之间建立通信连接并唤醒模拟设备的按键模拟功能后，可以是电子设备直接向模拟设备发送按键模拟指示，此时电子设备是先发起者。
在一种可能的实现方式中，所述根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，包括：根据第一电子设备发送的按键模拟指示，确定增加 新的功能按键，其中，所述第一电子设备为所述至少一个电子设备中的一者，所述新的功能按键能够实现所述第一电子设备上设置的至少两个按键的功能或能够实现与所述第一电子设备上设置的按键的功能不同的功能；在所述触控显示屏上显示所述第一电子设备的按键，所述第一电子设备的按键包括所述新的功能按键。也就是说，触控显示屏上显示的电子设备的按键与该电子设备上设置的按键只需对应即可，不必完全相同。举例而言，由于触控显示屏的显示空间较小，因此，触控显示屏上设置的一个按键可集成电子设备上设置的两个按键的功能，或者，为了实现不同于电子设备上的按键的功能，触控显示屏上可增加新的功能按键，该新的功能按键能够控制电子设备执行不同于电子设备上原有按键的功能，这样能够更好地满足用户使用需求。
在一种可能的实现方式中，所述根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，包括：根据所述按键模拟指示，确定待显示的两个以上电子设备；检测用户手势，确定所述用户手势与设定手势匹配，使所述触控显示屏上显示第二电子设备的按键，其中，所述第二电子设备为所述两个以上电子设备中的一者，所述设定手势与所述第二电子设备的对应关系是预先设置的。也就是说，为了方便控制多个电子设备，可接收多个电子设备的按键模拟指示，但触控显示屏的空间有限并且也为了避免触控显示屏显示的按键的数量较多，可使用户根据具体需要选择需要显示的电子设备的按键。具体地，可预先设置设定手势与第二电子设备的对应关系，这样在检测到用户手势与设定手势匹配时，表明用户是希望通过触控显示屏控制第二电子设备，因此可使触控显示屏显示第二电子设备的按键。
在一种可能的实现方式中，所述根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，包括：根据所述按键模拟指示，在所述触控显示屏上显示两个以上电子设备的标识：在所述两个以上电子设备中的一个电子设备的标识被触发时，使所述触控显示屏切换为显示被触发的电子设备的按键。也就是说，当接收到两个以上电子设备的按键模拟指示时，可先显示两个以上电子设备的标识，然后用户可选中需要控制的电子设备的标识，即可使触控显示屏切换为显示该电子设备的按键。
在一种可能的实现方式中，所述根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，包括：根据所述按键模拟指示，在所述触控显示屏上层叠错位显示多个页面，每个页面包括至少一个电子设备的按键；响应对所述多个页面中的至少一个页面的选择操作，使所述触控显示屏切换为显示所述至少一个页面的电子设备的按键。也就是说，当接收到两个以上电子设备的按键模拟指示时，可先显示多个页面，每个页面上包括一个或两个以上电子设备的按键，然后用户可选中需要控制的电子设备的页面，即可使触控显示屏切换为仅显示该页面上的电子设备的按键。
在一种可能的实现方式中，所述根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，包括：根据所述按键模拟指示，使所述触控显示屏显示多个电子设备中的第一部分电子设备的按键；响应切换操作，使所述触控显示屏切换为显示所述多个电子设备中的第二部分电子设备的按键。也就是说，当多个电子设备的按键都需要在触控显示屏上显示时，可使触控显示屏先显示第一部分电子设备的按键，然后可进行切换操作，例如滑屏，使触控显示屏再显示第二部分电子设备的按键。其中，第一部分电子设备和第二部分电子设备分别包括至少一个电子设备。例如，第一 部分电子设备包括第三电子设备，第二部分电子设备包括第四电子设备。此时，可先根据按键模拟指示，使触控显示屏仅显示第三电子设备(或第四电子设备)的按键；响应切换操作，再使触控显示屏切换为显示第四电子设备(或第三电子设备)的按键。
在一种可能的实现方式中，所述根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，包括：根据所述按键模拟指示，在所述触控显示屏上分区显示两个以上电子设备的按键。也就是说，当触控显示屏的显示空间允许同时显示多个电子设备的按键且用户需要控制两个以上的电子设备时，可使触控显示屏分区显示两个以上电子设备的按键，这样方便用户控制该些电子设备。
在一种可能的实现方式中，所述方法还包括：响应移动操作，调整选定的按键在所述触控显示屏上的显示位置，将按键的位置设置为可移动的，例如拖动按键可进行移动，这样可方便将经常使用的按键移动至更方便用户进行控制的位置；和/或，在所述触控显示屏上显示多个按键时，响应筛选操作，删除所述多个按键中选定的按键，并保留所述多个按键中剩余的按键。由于触控显示屏显示的电子设备的按键可能不是用户需要进行控制的，或用户不经常使用该按键，此时，为了简化触控显示屏上的按键，以降低误操作的概率和方便控制或增加其他电子设备中需要经常控制的按键，用户可选择将一些按键删除。
在一种可能的实现方式中，所述根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，具体包括：对所述按键模拟指示进行第一处理，所述第一处理包括完整性校验、解密和解码中的至少一者；根据进行所述第一处理后的按键模拟指示控制所述触控显示屏显示所述至少一个电子设备的按键。也就是说，为了保证按键模拟指示的传输的安全性和完整性，电子设备发送按键模拟指示时可先进行加密、编码和完整性校验等处理，然后再将处理过的按键模拟指示发送出去，相应地，模拟设备接收到按键模拟指示后，可进行完整性校验、解密和解码等处理，然后再根据处理后的按键模拟指示在触控显示屏上显示电子设备的按键。
在一种可能的实现方式中，所述电子设备包括车载设备和/或移动终端设备，以及上述设备中的芯片或处理装置；所述车载设备包括中控系统、音响系统、车窗、影音娱乐、抬头显示等设备中的至少一者，所述移动终端设备包括手机和平板电脑中的至少一者。另外，可以理解的是，在有需要的情况下，电子设备还可包括其他设备，如投影仪、冰箱、按摩器、电视、空调、照相机、摄影机等。
第二方面，本申请实施例提供了一种电子设备控制方法，该方法包括：检测到用户对触控显示屏的第一操作，生成控制指令，其中，所述触控显示屏设置在车辆的方向盘上；向至少一个电子设备发送所述控制指令，其中，所述至少一个电子设备由所述第一操作确定，所述控制指令用于控制所述至少一个电子设备动作。
在本申请实施例的方案中，检测到用户对触控显示屏的第一操作时，确定用户是希望控制第一电子设备并发送控制指令，来使第一电子设备动作，实现了通过设置在车辆的方向盘上的触控显示屏控制电子设备的目的，在用户驾驶时，可以方便控制其他电子设备，保障驾驶安全。
在一种可能的实现方式中，当所述至少一个电子设备包括第一电子设备和所述第二电子设备时，所述向至少一个电子设备发送控制指令，包括：分别向所述第一电子设 备和所述第二电子设备发送所述控制指令；或，仅向所述第一电子设备发送所述控制指令，所述第一操作和所述第一电子设备的对应关系是预先设置的。也就是说，当检测到第一操作时，可分别向两个电子设备发送控制指令，此时，可以理解第一操作与第一电子设备和第二电子设备之间预先设置有对应关系，或者可以理解为第一操作与两个电子设备之间无需设置对应关系，只要两个电子设备处于能够接收控制指令的状态，即可接收该控制指令并进行相应动作。当第一操作仅与第一电子设备预先设置了对应关系时，检测到第一操作时，可仅向第一电子设备发送控制指令，以便使第一电子设备根据控制指令进行相应动作。
在一种可能的实现方式中，所述仅向所述第一电子设备发送控制指令，具体包括：根据所述第一操作确定所述第一电子设备，并在所述触控显示屏上显示所述第一电子设备的按键，其中，所述按键是由所述第一电子设备发送的按键模拟指示中携带的按键信息确定的；检测到所述第一电子设备的按键被触发，向所述第一电子设备发送所述控制指令。也就是说，可先通过第一操作确定是需要控制至少一个电子设备中的第一电子设备，接着，在触控显示屏显示第一电子设备的按键时，然后通过触发相应的按键，可向第一电子设备发送相应的控制指令，并使第一电子设备根据该控制指令执行相应的动作。
在一种可能的实现方式中，所述向至少一个电子设备发送控制指令，具体包括：对所述控制指令进行权限校验；确定所述控制指令的权限校验通过，将所述控制指令发送给所述至少一个电子设备。也就是说，为了保证控制指令是需要发送给电子设备的，在发送控制指令前可进行权限校验，在权限校验通过后才将控制指令发送给电子设备，这样可避免发送无效控制指令，或者，避免将不是用于控制电子设备的控制指令发送给电子设备，降低了发生控制错误的风险。
在一种可能的实现方式中，所述对所述控制指令进行权限校验，具体包括：确定所述控制指令的信号位于预设信号范围内或发送所述控制指令的应用的身份具有发送权限，则通过校验；或，确定所述控制指令的信号位于预设信号范围外或确定发送所述控制指令的应用的身份不具有发送权限，则不通过校验。也就是说，可以预先设定发送控制指令的信号的范围，位于预设信号范围内的控制指令确定是需要发送给电子设备的，可通过校验，而位于预设信号范围外的控制指令确定不是需要发送给电子设备的，则不通过校验。另外，实现电子设备的按键设置方法的可以为一个应用，该应用具有发送控制指令的权限，模拟设备还包括其他应用，如时间等常规应用，其不具有发送控制指令的权限，因此可确定发送控制指令的应用的身份是否具有发送权限，当应用具有发送权限时，确定该应用发送的控制指令需要发送给电子设备，可通过校验；当应用不具有发送权限时，确定该应用发送的控制指令不需要发送给电子设备，可不通过校验。
在一种可能的实现方式中，所述确定所述控制指令的权限校验通过，将所述控制指令发送给所述至少一个电子设备，具体包括：对所述控制指令进行第二处理，所述第二处理包括加密、编码和完整性校验中的至少一者；将经过所述第二处理后的所述控制指令发送给所述至少一个电子设备。也就是说，为了保证控制指令能够安全、快速、完整地发送给电子设备，在发送控制指令前，可对控制指令进行加密、编码和完整性 校验等处理，然后再将处理后的控制指令发送给电子设备，相应地，电子设备在收到该控制指令后，可先进行完整性校验、解密和解码等处理，然后再根据处理后的控制指令执行相应动作。
在一种可能的实现方式中，所述方法还包括：接收所述至少一个电子设备发送的反馈信息，所述反馈信息用于指示所述至少一个电子设备执行所述控制指令的执行结果；在所述反馈信息指示所述控制指令执行失败时，使所述触控显示屏显示第一指示信息和所述至少一个电子设备的按键，所述第一指示信息用于指示所述控制指令执行失败；在所述反馈信息指示所述控制指令执行成功时，使所述触控显示屏显示所述至少一个电子设备的按键或显示第二指示信息和所述至少一个电子设备的按键，所述第二指示信息用于指示所述控制指令执行成功。也就是说，为了方便用户及时获知控制指令的执行结果，电子设备可返回反馈信息来指示控制指令的执行结果，并且在反馈信息指示控制指令执行失败时，触控显示屏可同时显示电子设备的按键和控制指令执行失败的反馈信息；在反馈信息指示控制指令执行成功时，触控显示屏可以仅显示电子设备的按键或者同时显示电子设备的按键和控制指令执行成功的反馈信息。
第三方面，本申请实施例提供了一种电子设备的按键设置装置，该按键设置装置包括：接收模块，用于接收来自至少一个电子设备的按键模拟指示，所述按键模拟指示携带有所述电子设备的按键信息；显示模块，用于根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，其中，所述触控显示屏设置在车辆的方向盘上，在所述触控显示屏上显示的按键被触发时，使所述至少一个电子设备执行相应的动作。
在本申请实施例的方案中，通过在方向盘上设置触控显示屏，可以在方向盘上模拟/复制其他电子设备的控制按键，在用户驾驶时，可以方便控制其他电子设备，保障驾驶安全。
在一种可能的实现方式中，所述按键设置装置还包括：发送模块，用于在所述接收来自至少一个电子设备的按键模拟指示前，向所述至少一个电子设备发送按键模拟请求，所述按键模拟请求用于请求所述至少一个电子设备是否通过所述触控显示屏模拟按键，其中，所述按键模拟指示是所述至少一个电子设备在通过所述触控显示屏模拟按键的请求时发送的。
在一种可能的实现方式中，所述显示模块具体用于：根据第一电子设备发送的按键模拟指示，确定增加新的功能按键，其中，所述第一电子设备为所述至少一个电子设备中的一者，所述新的功能按键能够实现所述第一电子设备上设置的至少两个按键的功能或能够实现与所述第一电子设备上设置的按键的功能不同的功能；在所述触控显示屏上显示所述第一电子设备的按键，所述第一电子设备的按键包括所述新的功能按键。
在一种可能的实现方式中，所述显示模块具体用于：根据所述按键模拟指示，确定待显示的两个以上电子设备；检测用户手势，确定所述用户手势与设定手势匹配，使所述触控显示屏上显示第二电子设备的按键，其中，所述第二电子设备为所述两个以上电子设备中的一者，所述设定手势与所述第二电子设备的对应关系是预先设置的。
在一种可能的实现方式中，所述显示模块具体用于：根据所述按键模拟指示，在所 述触控显示屏上显示两个以上电子设备的标识：在所述两个以上电子设备中的一个电子设备的标识被触发时，使所述触控显示屏切换为显示被触发的电子设备的按键。
在一种可能的实现方式中，所述显示模块具体用于：根据所述按键模拟指示，在所述触控显示屏上层叠错位显示多个页面，每个页面包括至少一个电子设备的按键；响应对所述多个页面中的至少一个页面的选择操作，使所述触控显示屏切换为显示所述至少一个页面的电子设备的按键。
在一种可能的实现方式中，所述显示模块具体用于：根据所述按键模拟指示，使所述触控显示屏显示多个电子设备中的第一部分电子设备的按键；响应切换操作，使所述触控显示屏切换为显示所述多个电子设备中的第二部分电子设备的按键。
在一种可能的实现方式中，所述显示模块具体用于：根据所述按键模拟指示，在所述触控显示屏上分区显示两个以上电子设备的按键。
在一种可能的实现方式中，所述按键设置装置还包括：调整模块，用于响应移动操作，调整选定的按键在所述触控显示屏上的显示位置；和/或，删除模块，用于在所述触控显示屏上显示多个按键时，响应筛选操作，删除所述多个按键中选定的按键，并保留所述多个按键中剩余的按键。
在一种可能的实现方式中，所述显示模块具体用于：对所述按键模拟指示进行第一处理，所述第一处理包括完整性校验、解密和解码中的至少一者；根据进行所述第一处理后的按键模拟指示控制所述触控显示屏显示所述至少一个电子设备的按键。
在一种可能的实现方式中，所述电子设备包括车载设备和/或移动终端设备以及车载设备和/或移动终端设备中的芯片或处理装置；所述车载设备包括中控系统、音响系统、车窗、影音娱乐、抬头显示、投影仪、冰箱、按摩器、电视、空调、照相机、摄影机中的至少一者，所述移动终端设备包括手机和平板电脑中的至少一者。
第四方面，本申请实施例提供了一种电子设备的控制装置，该控制装置包括：检测生成模块，用于检测到用户对触控显示屏的第一操作，生成控制指令，其中，所述触控显示屏设置在车辆的方向盘上；发送模块，用于向至少一个电子设备发送所述控制指令，其中，所述至少一个电子设备由所述第一操作确定，所述控制指令用于控制所述至少一个电子设备动作。
在本申请实施例的方案中，检测到用户对触控显示屏的第一操作时，确定用户是希望控制第一电子设备并发送控制指令，来使第一电子设备动作，实现了通过设置在车辆的方向盘上的触控显示屏控制电子设备的目的，在用户驾驶时，可以方便控制其他电子设备，保障驾驶安全。
在一种可能的实现方式中，当所述至少一个电子设备包括第一电子设备和所述第二电子设备时，所述发送模块用于分别向所述第一电子设备和所述第二电子设备发送所述控制指令；或，所述发送模块用于仅向所述第一电子设备发送所述控制指令，所述第一操作和所述第一电子设备的对应关系是预先设置的。
在一种可能的实现方式中，所述发送模块仅向所述第一电子设备发送控制指令时，具体用于：根据所述第一操作确定所述第一电子设备，并在所述触控显示屏上显示所述第一电子设备的按键，其中，所述按键是由所述第一电子设备发送的按键模拟指示中携带的按键信息确定的；检测到所述第一电子设备的按键被触发，向所述第一电子 设备发送所述控制指令。
在一种可能的实现方式中，所述发送模块具体用于：对所述控制指令进行权限校验；确定所述控制指令的权限校验通过，将所述控制指令发送给所述至少一个电子设备。
在一种可能的实现方式中，所述发送模块对所述控制指令进行权限校验，具体包括：确定所述控制指令的信号位于预设信号范围内或发送所述控制指令的应用的身份具有发送权限，则通过校验；或，确定所述控制指令的信号位于预设信号范围外或确定发送所述控制指令的应用的身份不具有发送权限，则不通过校验。
在一种可能的实现方式中，所述发送模块将确定所述控制指令的权限校验通过，所述控制指令发送给所述至少一个电子设备，具体包括：对所述控制指令进行第二处理，所述第二处理包括加密、编码和完整性校验中的至少一者；将经过所述第二处理后的所述控制指令发送给所述至少一个电子设备。
在一种可能的实现方式中，所述控制装置还包括：接收模块，用于接收所述至少一个电子设备发送的反馈信息，所述反馈信息用于指示所述至少一个电子设备执行所述控制指令的执行结果；在所述反馈信息指示所述控制指令执行失败时，所述显示模块还用于使所述触控显示屏显示第一指示信息和所述至少一个电子设备的按键，所述第一指示信息用于指示所述控制指令执行失败；在所述反馈信息指示所述控制指令执行成功时，所述显示模块还用于使所述触控显示屏显示所述至少一个电子设备的按键或显示第二指示信息和所述至少一个电子设备的按键，所述第二指示信息用于指示所述控制指令执行成功。
第五方面，本申请实施例提供了一种模拟设备，该模拟设备包括：至少一个存储器，用于存储程序；至少一个处理器，用于执行所述存储器存储的程序，当所述存储器存储的程序被执行时，所述处理器用于执行上述第一方面和/或上述第二方面的方法。
第六方面，本申请实施例提供了一种车辆，包括方向盘、至少一个电子设备和第五方面提供的模拟设备，所述模拟设备的触控显示屏设置在所述方向盘上。
第七方面，本申请实施例提供了一种计算机存储介质，所述计算机存储介质中存储有指令，当所述指令在计算机上运行时，使得所述计算机执行第一方面和/或第二方面中所提供的方法。
第八方面，本申请实施例提供了一种包含指令的计算机程序产品，当所述指令在计算机上运行时，使得所述计算机执行第一方面和/或第二方面所述的方法。
第九方面，本申请实施例提供了一种电子装置，所述电子装置包括至少一个处理器和接口；所述至少一个处理器通过所述接口获取程序指令或者数据；所述至少一个处理器用于执行所述程序指令，以实现第一方面和/或第二方面任一所述的方法。
附图说明
下面对实施例或现有技术描述中所需使用的附图作简单地介绍；
图1是本申请实施例提供的一种车辆的局部结构示意图；
图2是本申请实施例提供的一种电子设备的按键设置方法的流程图；
图3是本申请实施例的按键设置方法的步骤S202的一种具体过程图；
图4是本申请实施例的按键设置方法的步骤S202的另一种具体过程图；
图5是图4中的步骤S202的具体过程中涉及的一种用户手势的示意图；
图6是本申请实施例的按键设置方法的步骤S202的又一种具体过程图；
图7是本申请实施例的按键设置方法的步骤S202的又一种具体过程图；
图8是本申请实施例的按键设置方法的步骤S202的又一种具体过程图；
图9是本申请实施例的按键设置方法的步骤S202的又一种具体过程图；
图10是本申请实施例的按键设置方法的步骤S203和步骤S204的一种具体过程图；
图11是本申请实施例提供的一种电子设备控制方法的流程图；
图12是本申请实施例提供的一种电子设备的按键设置装置的结构示意图；
图13是本申请实施例提供的一种电子设备的控制装置的结构示意图；
图14是本申请实施例提供的一种模拟设备的结构示意图；
图15是本申请实施例提供的模拟设备和中控系统的一种示例性的软件结构图；
图16是基于图15所示的软件结构在模拟设备和中控系统之间传输数据时的过程图；
图17是在图15所示的模拟设备中传输数据时的一种示例性的具体流程图；
图18是本申请实施例提供的一种电子装置的结构示意图。
具体实施方式
为了使本申请实施例的目的、技术方案和优点更加清楚，下面将结合附图，对本申请实施例中的技术方案进行描述。
图1是本申请实施例提供的一种车辆的局部结构示意图。如图1所示，车辆包括方向盘10、模拟设备和至少一个电子设备。其中，模拟设备具有触控显示屏201，该触控显示屏201设置在车辆的方向盘10上，具体地，触控显示屏201可部署在方向盘的中间偏上的位置，并且，触控显示屏201的尺寸可自定义，一般是能够满足放置至少5～6个按键，同时不影响方向盘内安全气囊的安装。
电子设备可包括车载设备和/或移动终端设备。车载设备可包括中控系统、音响系统、车窗、影音娱乐、抬头显示(head up display，HUD)、投影仪、冰箱、按摩器、电视、空调、照相机、摄影机中的至少一者。移动终端设备可包括手机和平板电脑中的至少一者。可以理解的是，车载设备和移动终端设备还可为其他设备。在图1中示出了中控系统30和影音娱乐系统40。另外，电子设备也可以是指能够实现处理功能的芯片或者电路。
并且，模拟设备可模拟一个电子设备的按键，也可以模拟多个电子设备的按键。例如，电子设备可为抬头显示，此时，模拟设备的触控显示屏201可显示抬头显示的至少一个按键，例如用于调整抬头显示的角度的按键，再例如，调整抬头显示的位置的按键。
另外，电子设备例如可为中控系统，此时，模拟设备可模拟中控屏上显示的应用(application，APP)的界面中的按键。并且，可将专门在方向盘的触控显示屏上显示的应用的快捷按键提前整理成安装包，该安装包可存储在云端，也可存储在模拟设备上，但没有装载，当收到中控系统发送的按键模拟指示时再装载。这样，利用方向盘上的触控显示屏201，可实时操控中控屏上的车机应用。
众所周知，当前在车载中控屏上安装的应用越来越多，驾驶者频繁使用车载应用的 场景也越来越普遍。为了实现车载应用的控制，常见有以下两种方案：第一种方案是通过(设置在两个前排座椅之间的)中央扶手上的组合旋钮、按键和/或触控板来控制中控屏上的车机应用；第二种方案是通过方向盘上的组合旋钮、按键和/或触控板来控制中控屏上的车机应用。上述两种方案中，控制中控屏的操作按键的位置固定或数量有限，一般为机械按键，一经定型，无法更改，功能单一，对应用有较大的限制，由于不同应用具有不同的按键，因此不能很好地适配车机应用的所有功能；或者，车机应用种类繁多，每个应用都有较深的层级和复杂的界面，用户无法快速定位到每个操作按键的位置，例如，不同的应用有不同的布局，用户通过触控板操作应用时需要反复定位，即用户每打开一个应用都需要重新定位按键位置，导致操作繁琐。
另外，由于上述操控按键与应用界面的按键差异较大，用户进行控制时，需要分散较多注意力，具体地，需要先注视中控屏，找寻需要打开的应用，接着，注视中央扶手或方向盘，找寻操作按键打开应用，然后注视中控屏定位应用中需要设定的具体选项，接着操作中央扶手或方向盘(例如触控板)设置该具体选项。因此，用户需要长时间将视线从路面移至中控屏和中央扶手/方向盘，在驾驶过程中使用容易导致驾驶者分神而产生安全风险。
鉴于此，本申请实施例提供一种电子设备的按键设置方法和控制方法、模拟设备及车辆，能够利用现有的座舱环境，快速、自然地操控车机应用和/或电子设备。具体地，通过在方向盘上设置触控显示屏，可以在方向盘上模拟/复制其他电子设备的控制按键，触控显示屏上显示的按键与电子设备本身的按键差异较小，当用户使用触控显示屏上的按键操控车机应用和/或电子设备时，用户可以随时快速观察到各个操控按键的内容并定位到该操控按键的位置，不会花费较多注意力，在用户驾驶时，可方便控制其他电子设备和/或车机应用，保障驾驶安全，能够提升驾驶员驾驶舒适度。
其中，模拟设备可分为模拟阶段和使用阶段，对于模拟阶段，本申请实施例提供了一种电子设备的按键设置方法，对于使用阶段，本申请实施例提供了一种电子设备控制方法。下面先对电子设备的按键设置方法进行介绍。
图2是本申请实施例提供的一种电子设备的按键设置方法的流程图。该按键设置方法可由模拟设备执行，如图2所示，该按键设置方法包括以下步骤：
步骤S201，接收来自至少一个电子设备的按键模拟指示，按键模拟指示携带有电子设备的按键信息。
步骤S202，根据按键模拟指示，使触控显示屏上显示至少一个电子设备的按键，其中，触控显示屏设置在车辆的方向盘上，在触控显示屏上显示的按键被触发时，使至少一个电子设备执行相应的动作。
需说明的是，“按键模拟指示”可以是一条消息，也可以是多条消息。“按键信息”可包括按键编号或符号或图标等。并且，在模拟设备与电子设备之间建立通信连接并唤醒模拟设备的按键模拟功能后，可以是电子设备直接向模拟设备发送按键模拟指示，即步骤S201，此时电子设备是先发起者；或者，在步骤S201前，该按键设置方法还可包括步骤S200，向至少一个电子设备发送按键模拟请求，按键模拟请求用于请求至少一个电子设备是否通过触控显示屏模拟按键，其中，按键模拟指示是至少一个电子设备在通过触控显示屏模拟按键的请求时发送的，此时，电子设备之前没有设置模拟 按键功能，需要模拟设备主动发起，即模拟设备是先发起者。
步骤S203，响应移动操作，调整选定的按键在触控显示屏上的显示位置。
将按键的位置设置为可移动的，例如拖动按键进行移动，这样可方便将经常使用的按键移动至方便用户进行控制的位置。
步骤S204，在触控显示屏上显示多个按键时，响应筛选操作，删除多个按键中选定的按键，并保留多个按键中剩余的按键。
由于触控显示屏显示的电子设备的按键可能不是用户需要进行控制的，或用户不经常使用该按键，为了简化触控显示屏上的按键，以降低误操作的概率和方便控制或增加其他电子设备中需要经常控制的按键，用户可选择将一些按键删除，从而能够更好地满足个性化使用需求。
上述按键设置方法适配各种车机应用操控，可通过接口获取车机应用当前页面的主要操控按键，并呈现在智能方向盘的触控显示屏上，车机应用种类繁多，每个应用都有较深的层级和复杂的界面，当用户通过使用智能方向盘上的触控显示屏操控车机应用时，用户便可以随时快速观察到各个操作按键的内容并定位到该操作按键的位置，从而实现有效操控。具体地，用户在中控屏上找寻需要打开的应用，并打开该应用；接着，应用可自动将其主要的按键投射到方向盘的触控显示屏上；然后，用户点击触控显示屏上显示的按键，即可控制电子设备进行相应动作。其中，这里的接口指的是模拟设备与车机间约定的接口。具体来说是车机开放的接口，模拟设备通过以太网按照约定的协议使用该接口。
在本申请实施例的方案中，通过在方向盘上设置触控显示屏，可以在方向盘上模拟/复制其他电子设备的控制按键，在用户驾驶时，可以方便控制其他电子设备，保障驾驶安全。另外，使用独立触控显示屏操控应用的方法不仅可实现对车机应用的操控，还可扩展到带有附加独立智能操控屏的各种电子设备，如笔记本电脑、电视、平板电脑、显示器等。
在步骤S202中，具体地，可先对按键模拟指示进行第一处理，第一处理包括完整性校验、解密和解码中的至少一者。然后，可根据进行第一处理后的按键模拟指示控制触控显示屏显示至少一个电子设备的按键。也就是说，为了保证按键模拟指示的传输的安全性和完整性，电子设备发送按键模拟指示时可先进行加密、编码和完整性校验，然后再将按键模拟指示发送出去，相应地，模拟设备接收到按键模拟指示后可先进行完整性校验、解密和解码等处理，然后再根据处理后的按键模拟在触控显示屏上显示电子设备的按键。
图3是本申请实施例的按键设置方法的步骤S202的一种具体过程图。如图3所示，步骤S202具体可包括：首先，触控显示屏发送按键模拟请求给第一电子设备如具有中控屏的中控系统，接着，具有中控屏的中控系统发送按键模拟指示给触控显示屏，按键模拟指示中携带有中控屏上显示的按键，然后，模拟设备根据第一电子设备如中控系统发送的按键模拟指示，确定增加新的功能按键如B+C，其中，第一电子设备为至少一个电子设备中的一者。接着，在触控显示屏上显示第一电子设备的按键，第一电子设备的按键包括新的功能按键。
其中，当电子设备的按键较多时，新的功能按键能够实现第一电子设备上设置的至 少两个按键的功能，例如，在图3中，中控屏上的第一应用的第一界面中包括按键A、按键B和按键C，触控显示屏上显示第一电子设备的按键包括按键A和按键B+C，此时，触控显示屏上的按键B+C可实现中控屏上的按键B和按键C的功能，举例而言，长按触控显示屏上的按键B+C可实现点击中控屏上的按键B的功能，点击触控显示屏上的按键B+C可实现点击中控屏上的按键C的功能。继续参考图3，当长按触控显示屏上的按键B+C时，中控屏切换为显示第一应用的第二界面，该第二界面包括按键B1和B2，此时触控显示屏上显示按键B1和B2。
另外，当电子设备自身的按键功能无法满足用户的需求时，新的功能按键能够实现与第一电子设备上设置的按键的功能不同的功能。例如，电子设备本身的按键无快进播放功能，新的功能按键能够实现快进播放。
也就是说，触控显示屏上设置的按键与电子设备上设置的按键对应即可，不必完全相同。具体地，由于触控显示屏的显示空间较小，因此，触控显示屏上设置的一个按键可集成电子设备上设置的两个按键的功能，或者，为了实现不同于电子设备上的按键的功能，触控显示屏上可增加新的功能按键，该新的功能按键能够控制电子设备执行不同于电子设备上原有按键的功能，这样能够更好地满足用户使用需求。
图4是本申请实施例的按键设置方法的步骤S202的另一种具体过程图。如图4所示，当接收到两个以上电子设备的按键模拟指示时，步骤S202具体可包括：首先，根据按键模拟指示，确定待显示的两个以上电子设备，此时触控显示屏上可同时显示待显示的两个以上电子设备的按键，如第一电子设备的按键A、按键B和按键C以及第二电子设备的按键E和按键F，或者，也可显示其他内容，该内容表示需要用户进一步给出指示，使触控显示屏确定显示哪个电子设备的按键；接着，检测用户手势，确定用户手势与设定手势匹配，使触控显示屏上显示第二电子设备的按键，其中，第二电子设备为两个以上电子设备中的一者，设定手势与第二电子设备的对应关系是预先设置的。
图5是图4中的步骤S202的具体过程中涉及的一种用户手势的示意图。如图5所示，用户可以在触控显示屏幕上画“W”，若预先设置“W”手势与第二电子设备对应。当模拟设备检测到“W”手势时，使触控显示屏上显示第二电子设备的按键，例如通过传感器来检测用户手势。可以理解的是，也可采用其他方式检测用户手势，例如安装摄像头，通过拍摄照片来获得用户手势；或者，也可将手势与电子设备的具体功能之间设置对应关系，例如画圈的手势就代表唤醒电子设备的语音功能。
也就是说，为了方便控制多个电子设备，可接收多个电子设备的按键模拟指示，但触控显示屏的空间有限并且也为了避免用户控制按键的数量较多，可使用户根据具体需要选择需要显示的电子设备的按键。具体地，可通过预先设定手势与第二电子设备的对应关系，这样在检测到用户手势与设定手势匹配时，表明用户是希望通过触控显示屏控制第二电子设备，因此可使触控显示屏显示第二电子设备的按键。
图6是本申请实施例的按键设置方法的步骤S202的又一种具体过程图。如图6所示，当接收到两个以上电子设备的按键模拟指示时，步骤S202具体可包括：首先，根据按键模拟指示，在触控显示屏上显示两个以上电子设备的标识；接着，在两个以上电子设备中的一个电子设备的标识被触发时，使触控显示屏切换为显示被触发的电子 设备的按键。
在图6中，第一电子设备包括按键A、按键B和按键C，第二电子设备包括按键E和按键F，当模拟设备接收到第一电子设备发送的按键模拟指示1和第二电子设备发送的按键模拟指示2时，使触控显示屏显示第一电子设备的标识如电子设备1和第二电子设备的标识如电子设备2，接着，当用户触摸标识电子设备1时，触控显示屏上切换为仅显示第一电子设备的按键A、按键B和按键C。
也就是说，当接收到两个以上电子设备的按键模拟指示时，可先显示两个以上电子设备的标识，然后用户可选中需要控制的电子设备的标识，即可使触控显示屏切换为显示该电子设备的按键。
图7是本申请实施例的按键设置方法的步骤S202的又一种具体过程图。如图7所示，当接收到两个以上电子设备的按键模拟指示时，步骤S202具体可包括：首先，根据按键模拟指示，在触控显示屏上层叠错位显示多个页面，每个页面包括至少一个电子设备的按键；接着，响应对多个页面中的至少一个页面的选择操作，使触控显示屏切换为显示至少一个页面的电子设备的按键。
在图7中，第一电子设备包括按键A、按键B和按键C，第二电子设备包括按键E和按键F，当模拟设备接收到第一电子设备发送的按键模拟指示1和第二电子设备发送的按键模拟指示2时，使触控显示屏显示两个页面，第一页面显示第一电子设备的按键，第二页面显示第二电子设备的按键，接着，当用户触摸第一页面时，触控显示屏上切换为仅显示第一电子设备的按键A、按键B和按键C。
也就是说，当接收到两个以上电子设备的按键模拟指示时，可先显示多个页面，每个页面上包括一个或两个以上电子设备的按键，然后用户可选中需要控制的电子设备的页面，即可使触控显示屏切换为显示该电子设备的按键。
图8是本申请实施例的按键设置方法的步骤S202的又一种具体过程图。如图8所示，根据所述按键模拟指示，使所述触控显示屏显示多个电子设备中的第一部分电子设备的按键；响应切换操作，使所述触控显示屏切换为显示所述多个电子设备中的第二部分电子设备的按键。其中，切换操作可使得触控显示屏的显示内容在多个电子设备的按键之间切换。切换操作可为滑屏操作或其他设定操作，该设定操作可使触控显示屏切换显示内容，即由显示第一部分电子设备(或第二部分电子设备)的按键切换为显示第二部分电子设备(或第一部分电子设备)的按键。并且，当包括更多个电子设备时，还可切换为显示第三部分电子设备的按键。其中，第一、第二和第三部分电子设备可分别包括至少一个电子设备。
在图8中，第一部分电子设备可包括第三电子设备，第二部分电子设备可包括第四电子设备。第三电子设备包括按键D、按键E和按键F，第四电子设备包括按键M和按键N。当模拟设备接收到第三电子设备发送的按键模拟指示3和第四电子设备发送的按键模拟指示4时，可使触控显示屏先显示第三电子设备的按键D、按键E和按键F(或第四电子设备的按键M和按键N)，接着，当用户切换屏幕时，例如滑屏操作，再使触控显示屏切换为显示第四电子设备的按键M和按键N(或第三电子设备的按键D、按键E和按键F)。
也就是说，当多个电子设备的按键都需要在触控显示屏上显示时，可使触控显示屏 先显示第一部分电子设备的按键，然后可进行切换操作，例如，向左滑屏或向右滑屏，使触控显示屏再显示第二部分电子设备的按键。
图9是本申请实施例的按键设置方法的步骤S202的又一种具体过程图。如图9所示，步骤S202具体可包括：根据按键模拟指示，在触控显示屏上分区显示两个以上电子设备的按键。其中“电子设备的按键”可以包括电子设备上原有的按键，也可以包括电子设备新的功能按键。
在图9中，两个以上电子设备可包括第一电子设备和第四电子设备。第一电子设备可包括按键A、按键B和按键C，第四电子设备包括按键M和按键N。此时，触控显示屏可同时显示第一电子设备的按键A和按键B+C以及第四电子设备的按键M和按键N。其中，按键B+C能够实现第一电子设备原有的按键B和按键C两者的功能。
也就是说，当触控显示屏的显示空间允许同时显示多个电子设备的按键且用户需要控制两个以上的电子设备时，可使触控显示屏分区显示两个以上电子设备的按键，这样方便用户控制该些电子设备。
图10是本申请实施例的按键设置方法的步骤S203和步骤S204的一种具体过程图。如图10所示，两个以上电子设备可包括第一电子设备和第四电子设备。第一电子设备可包括按键A、按键B和按键C，第四电子设备包括按键M和按键N。此时，触控显示屏可同时显示第一电子设备的按键A、按键B和按键C以及第四电子设备的按键M和按键N。然后，可响应筛选操作，例如用户将按键C长按删除或拖动删除，使得触控显示屏仅显示按键A、按键B、按键M和按键N。或者，可响应移动操作，例如用户拖动按键C和按键M进行移动，使得按键C位于触控显示屏的边缘位置，方便用户进行控制。
上面对模拟设备的模拟阶段涉及的电子设备的按键设置方法进行了介绍，下面对模拟设备的使用阶段涉及的电子设备控制方法进行介绍。
图11是本申请实施例提供的一种电子设备控制方法的流程图。该控制方法可由模拟设备执行，如图11所示，该控制方法包括以下步骤：
步骤S1101，模拟设备检测到用户对触控显示屏的第一操作，生成控制指令，其中，触控显示屏设置在车辆的方向盘上。
步骤S1102，模拟设备向至少一个电子设备发送控制指令，其中，至少一个电子设备由第一操作确定，控制指令用于控制至少一个电子设备动作。
具体地，可先对控制指令进行权限校验；确定控制指令的权限校验通过，再将控制指令发送给至少一个电子设备。进一步地，对控制指令进行权限校验具体包括：确定控制指令的信号位于预设信号范围内或发送控制指令的应用的身份具有发送权限，则通过校验；或，确定控制指令的信号位于预设信号范围外或确定发送控制指令的应用的身份不具有发送权限，则不通过校验。并且，还可对控制指令进行第二处理，第二处理包括加密、编码和完整性校验中的至少一者，再将经过第二处理后的控制指令发送给至少一个电子设备。
当至少一个电子设备包括第一电子设备和第二电子设备时，步骤S1102具体包括分别向第一电子设备和第二电子设备发送控制指令；或，仅向第一电子设备发送控制指令，第一操作和第一电子设备的对应关系是预先设置的。
其中，仅向第一电子设备发送控制指令具体包括：先根据第一操作确定第一电子设备，并在触控显示屏上显示第一电子设备的按键，其中，按键是由第一电子设备发送的按键模拟指示中携带的按键信息确定的；检测到第一电子设备的按键被触发，向第一电子设备发送控制指令。
在电子设备在接收到模拟设备发送的控制指令后，可进行步骤S1103，根据控制指令执行相应动作；接着，进行步骤S1104，根据控制指令的执行结果形成反馈信息。
步骤S1105，模拟设备接收至少一个电子设备发送的反馈信息，反馈信息用于指示至少一个电子设备执行控制指令的执行结果
步骤S1106，模拟设备在反馈信息指示控制指令执行失败时，使触控显示屏显示第一指示信息和至少一个电子设备的按键，第一指示信息用于指示控制指令执行失败；模拟设备在反馈信息指示控制指令执行成功时，使触控显示屏显示至少一个电子设备的按键或显示第二指示信息和至少一个电子设备的按键，第二指示信息用于指示控制指令执行成功。
在本申请实施例的方案中，检测到用户对触控显示屏的第一操作时，确定用户是希望控制第一电子设备并发送控制指令，来使第一电子设备动作，实现了通过设置在车辆的方向盘上的触控显示屏控制电子设备的目的，在用户驾驶时，可以方便控制其他电子设备，保障驾驶安全。
图12是本申请实施例提供的一种电子设备的按键设置装置的结构示意图。如图12所示，该按键设置装置1200包括接收模块1201和显示模块1202。其中，接收模块1201用于接收来自至少一个电子设备的按键模拟指示，按键模拟指示携带有电子设备的按键信息。显示模块1202用于根据按键模拟指示，使触控显示屏上显示至少一个电子设备的按键，其中，触控显示屏设置在车辆的方向盘上，在触控显示屏上显示的按键被触发时，使至少一个电子设备执行相应的动作。并且，电子设备可包括上述提到的车载设备和/或移动终端设备。
在本申请实施例的方案中，通过在方向盘上设置触控显示屏，可以在方向盘上模拟/复制其他电子设备的控制按键，在用户驾驶时，可以方便控制其他电子设备，保障驾驶安全。
在一个例子中，该按键设置装置1200还包括发送模块1203，该发送模块用于在接收来自至少一个电子设备的按键模拟指示前，向至少一个电子设备发送按键模拟请求，按键模拟请求用于请求至少一个电子设备是否通过触控显示屏模拟按键，其中，按键模拟指示是至少一个电子设备在通过触控显示屏模拟按键的请求时发送的。
在一个例子中，显示模块1202具体用于：根据第一电子设备发送的按键模拟指示，确定增加新的功能按键，其中，第一电子设备为至少一个电子设备中的一者，新的功能按键能够实现第一电子设备上设置的至少两个按键的功能或能够实现与第一电子设备上设置的按键的功能不同的功能；在触控显示屏上显示第一电子设备的按键，第一电子设备的按键包括新的功能按键。
在一个例子中，显示模块1202具体用于：根据按键模拟指示，确定待显示的两个以上电子设备；检测用户手势，确定用户手势与设定手势匹配，使触控显示屏上显示第二电子设备的按键，其中，第二电子设备为两个以上电子设备中的一者，设定手势 与第二电子设备的对应关系是预先设置的。
在一个例子中，显示模块1202具体用于：根据按键模拟指示，在触控显示屏上显示两个以上电子设备的标识：在两个以上电子设备中的一个电子设备的标识被触发时，使触控显示屏切换为显示被触发的电子设备的按键。
在一个例子中，显示模块1202具体用于：根据按键模拟指示，在触控显示屏上层叠错位显示多个页面，每个页面包括至少一个电子设备的按键；响应对多个页面中的至少一个页面的选择操作，使触控显示屏切换为显示至少一个页面的电子设备的按键。
在一个例子中，显示模块1202具体用于：根据所述按键模拟指示，使所述触控显示屏显示多个电子设备中的第一部分电子设备的按键；响应切换操作，使所述触控显示屏切换为显示所述多个电子设备中的第二部分电子设备的按键。
在一个例子中，显示模块1202具体用于，包括：根据按键模拟指示，在触控显示屏上分区显示两个以上电子设备的按键。
在一个例子中，按键设置装置1200还包括调整模块1204，用于响应移动操作，调整选定的按键在触控显示屏上的显示位置。在另一个例子中，按键设置装置1200还包括删除模块1205，用于在触控显示屏上显示多个按键时，响应筛选操作，删除多个按键中选定的按键，并保留多个按键中剩余的按键。
在一个例子中，显示模块1202具体用于：对按键模拟指示进行第一处理，第一处理包括完整性校验、解密和解码中的至少一者；根据进行第一处理后的按键模拟指示控制触控显示屏显示至少一个电子设备的按键。
应当理解的是，上述按键设置装置用于执行上述实施例中的按键设置方法，如关于图2所述的方法，按键设置装置中相应的程序模块，其实现原理和技术效果与上述方法中的描述类似，该按键设置装置的工作过程可参考上述方法中的对应过程，此处不再赘述。
图13是本申请实施例提供的一种电子设备的控制装置的结构示意图。如图13所示，该控制装置1300包括检测生成模块1301和发送模块1302。其中，检测生成模块1301用于检测到用户对触控显示屏的第一操作，生成控制指令，其中，触控显示屏设置在车辆的方向盘上。发送模块1302用于向至少一个电子设备发送控制指令，其中，至少一个电子设备由第一操作确定，控制指令用于控制至少一个电子设备动作。
在本申请实施例的方案中，检测到用户对触控显示屏的第一操作时，确定用户是希望控制第一电子设备并发送控制指令，来使第一电子设备动作，实现了通过设置在车辆的方向盘上的触控显示屏控制电子设备的目的，在用户驾驶时，可以方便控制其他电子设备，保障驾驶安全。
在一个例子中，当至少一个电子设备包括第一电子设备和第二电子设备时，发送模块1302用于分别向第一电子设备和第二电子设备发送控制指令；或，发送模块1302用于仅向第一电子设备发送控制指令，第一操作和第一电子设备的对应关系是预先设置的。
在一个例子中，发送模块1302仅向第一电子设备发送控制指令时，具体用于：根据第一操作确定第一电子设备，并在触控显示屏上显示第一电子设备的按键，其中，按键是由第一电子设备发送的按键模拟指示中携带的按键信息确定的；检测到第一电 子设备的按键被触发，向第一电子设备发送控制指令。
在一个例子中，发送模块1302具体用于：对控制指令进行权限校验；确定控制指令的权限校验通过，将控制指令发送给至少一个电子设备。
在一个例子中，发送模块1302对控制指令进行权限校验，具体包括：确定控制指令的信号位于预设信号范围内或发送控制指令的应用的身份具有发送权限，则通过校验；或，确定控制指令的信号位于预设信号范围外或确定发送控制指令的应用的身份不具有发送权限，则不通过校验。
在一个例子中，发送模块1302确定控制指令的权限校验通过将控制指令发送给至少一个电子设备，具体包括：对控制指令进行第二处理，第二处理包括加密、编码和完整性校验中的至少一者；将经过第二处理后的控制指令发送给至少一个电子设备。
在一个例子中，控制装置1300还包括接收模块1303。接收模块1303用于接收至少一个电子设备发送的反馈信息，反馈信息用于指示至少一个电子设备执行控制指令的执行结果；在反馈信息指示控制指令执行失败时，控制装置1300使触控显示屏显示第一指示信息和至少一个电子设备的按键，第一指示信息用于指示控制指令执行失败；在反馈信息指示控制指令执行成功时，控制装置1300使触控显示屏显示至少一个电子设备的按键或显示第二指示信息和至少一个电子设备的按键，第二指示信息用于指示控制指令执行成功。
应当理解的是，上述控制装置用于执行上述实施例中的控制方法，如关于图11所述的方法，控制装置中相应的程序模块，其实现原理和技术效果与上述方法中的描述类似，该控制装置的工作过程可参考上述方法中的对应过程，此处不再赘述。
图14是本申请实施例提供的一种模拟设备的结构示意图，如图14所示，该模拟设备1400包括至少一个存储器1402和至少一个处理器1403。其中，至少一个存储器1402用于存储程序。至少一个处理器1403用于执行存储器存储的程序，当存储器1402存储的程序被执行时，处理器1403用于执行上述的电子设备的按键设置方法和/或控制方法。可选地，模拟设备还可包括触控显示屏1401。也就是说，可以将触控显示屏1401作为模拟设备1400的一部分，也可将触控显示屏1401从模拟设备1400中分离出来，此时，模拟设备1400与触控显示屏1401不属于同一设备。其中，模拟设备可以是车载设备，也可以是车载设备中设置的具有处理功能的电路或芯片。
下面结合图15-图17对模拟设备和中控系统的软件结构进行介绍。应理解，图15、图16和图17仅用于示例性说明，本申请对于模拟设备和中控系统的软件结构不作限定。
图15是本申请实施例提供的模拟设备和中控系统的一种示例性的软件结构图。如图15所示，模拟设备和中控系统的软件结构均可包括应用层、服务层(Service)、硬件抽象层(hardware abstraction layer，HAL)和内核层(Kenerl)。
其中，HAL是软件层的例行程序包，用于模拟特定系统平台的细节，使程序可以直接访问硬件的资源。将硬件方面的不同抽离操作系统的核心，核心模式的代码就不必因硬件的不同而需要修改，因此HAL可加大软件的移植性。
在中控系统中，应用层示例性可包括音乐、电台和设置等应用程序，Service层示例性可包括车机互联服务和车机安全服务等，HAL层示例性可包括车机互联HAL， Kenerl层示例性可包括车机网络驱动。通过新增车机互联HAL、车机互联服务和车机安全服务，使得中控系统能够接收来自模拟设备的数据如控制指令，并对接收到的数据进行完整性校验、解密，然后按照约定的协议解析/解码数据，接着将获得的数据发送至车机互联服务，并调用车机安全服务进行权限校验，再然后发送至应用(如音乐)执行相应的动作。
在智能设备中，应用层示例性可包括显示、设置等应用程序，Service层示例性可包括互联服务和安全服务等，HAL层示例性可包括互联HAL，Kenerl层示例性可包括网络驱动。
其中，应用层的显示程序可包括触控显示屏以及显示系统，触控显示屏呈现操作界面，显示基本信息，用户可通过手动点击、拖动等方式操作触控显示屏，以实现按键设置、显示图标设置、控制中控屏等功能。
互联服务和安全服务为Service层两个独立的模块。互联服务主要承载系统的互联功能，接受显示界面的操作并调用HAL层的接口向下发送消息/数据，其还通过调用安全服务提供的接口完成安全校验功能。具体地，完成权限校验主要包括以下两种情况：1)与模拟设备约定的信号的校验，即校验发送的消息/数据如控制指令，是否在约定的信号范围内，如果不在，则校验失败；如果在，则通过该校验；(2)消息/数据从应用发送至互联HAL，校验应用的身份是否具有发送权限，如果没有，则校验失败；如果有，则通过校验。
互联HAL主要负责转发互联服务的消息/数据，主要功能有屏蔽硬件和通信协议的差异，搭建通信链路实现和车机/中控系统的互联互通。对于屏蔽硬件和通信协议，指的是对于系统来说(包括Service层和应用层)，以播放音乐下一曲为例，应用层和Service层使用约定好的固定不变的接口，但是不同型号的模拟设备可能对于该消息有不同的约定，例如在模拟设备A中，0x1代表播放下一曲，在模拟设备B中，0x0代表播放下一曲，为了保证Service层可以使用相同的接口操作不同型号的按键，HAL层通过适配硬件来对服务层屏蔽该差异。
具体地，互联HAL可分为数据处理/控制模块和通信模块。数据处理/控制模块的功能为加解密、完整性校验和编解码，通信模块的功能为建立以太通信链路。
Kenerl层的网络驱动主要负责通信协议栈的实现。
继续参考图15，模拟设备的内部一般使用进程间通信(inter-process communication，IPC)，出于效率考虑，互联HAL与网络驱动之间使用socket/其他通信协议。另外，安全增强式Linux(security-enhanced linux，SELinux)是Linux内核的安全服务，其提供了访问控制安全策略机制，包括强制访问控制。SELinux是一组内核修改和用户空间工具，已经被添加到各种Linux发行版中。其用于将安全决策的执行与安全策略分离，并简化涉及执行安全策略的软件的数量。本申请实施例中，模拟设备与中控系统(车机的操作系统)的内核均为linux，因此均受SElinux控制，即本系统的IPC均受SELinux控制。
图16是基于图15所示的软件结构在模拟设备和中控系统之间传输数据时的过程图。如图16所示，可包括以下步骤：
首先，在“开始”位置处，需要启动车辆上安装的模拟设备，并使模拟设备与车机 /中控系统之间建立通信连接。
具体地，模拟设备的通信模块与车机通信模块通过scoket(即以太网)接口/车载局域网建立通信连接。其中，应用程序开发人员可在车机操作系统中定义按键的功能，例如播放下一曲、上一曲等，并且可定义车机操作系统对外提供的接口，以使诸如模拟设备的外部设备通过该接口获得按键信息。举例而言，可从以太网接收数据的私有协议，双方均通过解析该协议完成特定功能。然后，模拟设备可提示自定义功能按键的选择。也就是说，中控系统可以不主动向模拟设备发消息，模拟设备与车机/中控系统连接后，主动向车机获取支持的按键，然后显示在触控显示屏上，由用户在触控显示屏上自定义需要的按键及按键位置。具体地，在模拟设备的“设置”中，可以选择是否自定义功能按键，可以通过勾选方式选择需要显示的按键，可以通过拖动方式自定义按键的显示方位。
然后，可进行APP操作。即用户便可以点击、滑动或拖动模拟设备的触控显示屏(设置在方向盘上)上的按键，来操作车机的功能。
具体地，用户对模拟设备的触控显示屏上显示的APP的按键进行操作，例如点击播放音乐的下一曲的按键，生成控制指令，控制指令通过IPC发送至互联服务；接着通过安全服务对控制指令进行权限校验(如校验控制指令的信号是否位于约定的信号范围内以及发送控制指令的应用的身份是否具有发送权限)；权限校验通过后，将控制指令通过IPC下发至互联HAL的数据处理/控制模块，数据处理/控制模块对通过IPC接收到的来自互联服务转发的用户控制指令进行加密、编码和完整性校验处理后，将控制指令发送至互联HAL的通信模块，通信模块已完成和车机的连接，通过通信模块可将控制指令发送至车机。
基于操作信号与SELinux组合的操作权限校验机制。当使用者操作某个指令后，该操作信号首先经安全服务校验，校验成功后才可以继续向通信模块下发控制指令，通信模块与互联服务均受系统SELinux权限控制。
图17是在图15所示的模拟设备中传输数据时的一种示例性的具体流程图，如图17所示，可包括以下步骤：
步骤S1701，发送控制指令。
具体地，用户点击模拟设备的触控显示屏上显示的APP的操作按键后，APP调用互联服务提供的跨进程操作接口，发送控制指令。通过统一的接口定义，由应用将界面上的操控按键和其它相关信息推送至智能方向盘的触控显示屏上。启动车机应用后，该应用的快捷操控按键可在智能方向盘的触控显示屏显示，驾驶者通过点击、滑动等手势可对应用实施操控。
步骤S1702，互联服务向安全服务发送权限校验。
步骤S1703，安全服务进行权限校验。
其中，安全服务能够实现安全校验功能，例如采用基于操作信号的权限校验机制，即预置操作信号的可操作权限(包括只接收、只发送、允许接收和发送)以及允许操作用户的级别(用户级、系统级等)。当调用安全服务校验接口时，安全服务通过对跨进程间调用的客户端身份及其操作信号与预置操作信号进行比较决定是否允许操作。
步骤S1704，安全服务完成权限校验，向互联服务发送权限校验结果。
步骤S1705，互联服务确定权限校验通过。
步骤S1706，互联服务向互联HAL的通信模块发送订阅操作结果回调，即订阅控制指令的执行结果。
步骤S1707，互联服务下发控制指令给HAL。具体地，可通过调用通信模块提供的接口进行。
关于步骤S1706和步骤S1707，由于中控系统处理需要时间，因此可首先订阅控制指令的执行结果的消息，然后再发送控制指令，由于两者动作是分开的，故为异步执行过程。
步骤S1708，互联HAL对控制指令进行加密、编码和完整性校验等处理。
接收到订阅操作后，完成订阅管理，当收到下发控制指令后，进行消息编码和消息加密，再通过网络通信将控制指令发送至车机端。
步骤S1709，互联HAL下发处理后的控制指令给车机。
步骤S1710，车机返回反馈信息给互联HAL。
具体地，车机通过网络与智能方向盘连接，接收智能方向盘通过网络发来的控制指令，完成操作后通过网络将执行结果反馈至智能方向盘。
步骤S1711，互联HAL对反馈信息进行完整性校验、解密和解码等处理
步骤S1712，互联服务根据处理后的反馈信息，返回对应状态。
步骤S1713，触控显示屏上显示的APP根据反馈信息，返回对应状态。即根据处理后的反馈信息使触控显示屏切换为显示相应的页面。
综上所述，提供了一种适合智能汽车座舱操控车载应用的快速、自然、安全的交互方式，能够适配各种车型，提升了交互效率，无需定制化方向盘样式，有助于降低成本。具体地，通过智能方向盘上的触控显示屏来操控车机应用，基于统一的标准接口，车机应用可将界面上的主要按键直接投射到智能方向盘上的触控显示屏，不受原先传统方向盘上机械按键的定义限制。通过将车机应用的主要按键投射到智能方向盘的触控显示屏上，让用户双手不离开方向盘即可采用最高效、最容易理解的交互方式直接操控车机应用，通过极低的学习成本，可以高效、自然的完成交互操作，带来极简的交互体验。另外，使用独立触控显示屏操控应用的方法不仅可实现对车机应用的操控，还可扩展到带有附加独立智能操控屏的各种电子设备，如笔记本电脑、电视、平板电脑、显示器等。
图18是本申请实施例提供的一种电子装置的结构示意图。如图18所示，电子装置1800包括一个或多个处理器1801以及接口电路1802。可选地，电子装置1800还可以包含总线1803。
其中，处理器1801可能是一种集成电路芯片，具有信号的处理能力。在实现过程中，上述方法的各步骤可以通过处理器1801中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器1801可以是通用处理器、数字通信器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或者其它可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
接口电路1802可以用于数据、指令或者信息的发送或者接收，处理器1801可以利 用接口电路1802接收的数据、指令或者其它信息，进行加工，可以将加工完成信息通过接口电路1802发送出去。
可选地，电子装置1800还包括存储器，存储器可以包括只读存储器和随机存取存储器，并向处理器提供操作指令和数据。存储器的一部分还可以包括非易失性随机存取存储器(NVRAM)。可选地，存储器存储了可执行软件模块或者数据结构，处理器可以通过调用存储器存储的操作指令(该操作指令可存储在操作系统中)，执行相应的操作。
可选地，接口电路1802可用于输出处理器1801的执行结果。
需要说明的，处理器1801、接口电路1802各自对应的功能既可以通过硬件设计实现，也可以通过软件设计来实现，还可以通过软硬件结合的方式来实现，这里不作限制。
应理解，上述方法实施例的各步骤可以通过处理器中的硬件形式的逻辑电路或者软件形式的指令完成。其中，该电子装置可以是可应用于上述电子设备中的芯片，以实现本申请实施例中提供的方法。
可以理解的是，在本申请实施例的描述中，“示例性的”、“例如”或者“举例来说”等词用于表示作例子、例证或说明。本申请实施例中被描述为“示例性的”、“例如”或者“举例来说”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。确切而言，使用“示例性的”、“例如”或者“举例来说”等词旨在以具体方式呈现相关概念。
在本申请实施例的描述中，术语“和/或”，仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，单独存在B，同时存在A和B这三种情况。另外，除非另有说明，术语“多个”的含义是指两个或两个以上。例如，多个系统是指两个或两个以上的系统，多个终端是指两个或两个以上的终端。此外，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”，除非是以其他方式另外特别强调。
可以理解的是，本申请的实施例中的处理器可以是中央处理单元(central processing unit，CPU)，还可以是其他通用处理器、数字信号处理器(digital signal processor，DSP)、专用集成电路(application specific integrated circuit，ASIC)、现场可编程门阵列(field programmable gate array，FPGA)或者其他可编程逻辑器件、晶体管逻辑器件，硬件部件或者其任意组合。通用处理器可以是微处理器，也可以是任何常规的处理器。
本申请的实施例中的方法步骤可以通过硬件的方式来实现，也可以由处理器执行软件指令的方式来实现。软件指令可以由相应的软件模块组成，软件模块可以被存放于随机存取存储器(random access memory，RAM)、闪存、只读存储器(read-only memory，ROM)、可编程只读存储器(programmable rom，PROM)、可擦除可编程只读存储器(erasable PROM，EPROM)、电可擦除可编程只读存储器(electrically EPROM，EEPROM)、寄存器、硬盘、移动硬盘、CD-ROM或者本领域熟知的任何其它形式的 存储介质中。一种示例性的存储介质耦合至处理器，从而使处理器能够从该存储介质读取信息，且可向该存储介质写入信息。当然，存储介质也可以是处理器的组成部分。处理器和存储介质可以位于ASIC中。
在上述实施例中，可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时，可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者通过所述计算机可读存储介质进行传输。所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质，(例如，软盘、硬盘、磁带)、光介质(例如，DVD)、或者半导体介质(例如固态硬盘(solid state disk，SSD))等。
可以理解的是，在本申请的实施例中涉及的各种数字编号仅为描述方便进行的区分，并不用来限制本申请的实施例的范围。

Claims (23)

  1. 一种电子设备的按键设置方法，其特征在于，包括：
    接收来自至少一个电子设备的按键模拟指示，所述按键模拟指示携带有所述电子设备的按键信息；
    根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，其中，所述触控显示屏设置在车辆的方向盘上，在所述触控显示屏上显示的按键被触发时，使所述至少一个电子设备执行相应的动作。
  2. 根据权利要求1所述的方法，其特征在于，在所述接收来自至少一个电子设备的按键模拟指示前，所述方法包括：
    向所述至少一个电子设备发送按键模拟请求，所述按键模拟请求用于请求所述至少一个电子设备是否通过所述触控显示屏模拟按键，其中，所述按键模拟指示是所述至少一个电子设备在通过所述触控显示屏模拟按键的请求时发送的。
  3. 根据权利要求1或2所述的方法，其特征在于，所述根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，包括：
    根据第一电子设备发送的按键模拟指示，确定增加新的功能按键，其中，所述第一电子设备为所述至少一个电子设备中的一者，所述新的功能按键能够实现所述第一电子设备上设置的至少两个按键的功能或能够实现与所述第一电子设备上设置的按键的功能不同的功能；
    在所述触控显示屏上显示所述第一电子设备的按键，所述第一电子设备的按键包括所述新的功能按键。
  4. 根据权利要求1-3中任一项所述的方法，其特征在于，所述根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，包括：
    根据所述按键模拟指示，确定待显示的两个以上电子设备；
    检测用户手势，确定所述用户手势与设定手势匹配，使所述触控显示屏上显示第二电子设备的按键，其中，所述第二电子设备为所述两个以上电子设备中的一者，所述设定手势与所述第二电子设备的对应关系是预先设置的。
  5. 根据权利要求1-3中任一项所述的方法，其特征在于，所述根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，包括：
    根据所述按键模拟指示，在所述触控显示屏上显示两个以上电子设备的标识；
    在所述两个以上电子设备中的一个电子设备的标识被触发时，使所述触控显示屏切换为显示被触发的电子设备的按键。
  6. 根据权利要求1-3中任一项所述的方法，其特征在于，所述根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，包括：
    根据所述按键模拟指示，在所述触控显示屏上层叠错位显示多个页面，每个页面包括至少一个电子设备的按键；
    响应对所述多个页面中的至少一个页面的选择操作，使所述触控显示屏切换为显示所述至少一个页面的电子设备的按键。
  7. 根据权利要求1-3中任一项所述的方法，其特征在于，所述根据所述按键模拟指 示，使触控显示屏上显示所述至少一个电子设备的按键，包括：
    根据所述按键模拟指示，使所述触控显示屏显示多个电子设备中的第一部分电子设备的按键；
    响应切换操作，使所述触控显示屏切换为显示所述多个电子设备中的第二部分电子设备的按键。
  8. 根据权利要求1-3中任一项所述的方法，其特征在于，所述根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，包括：
    根据所述按键模拟指示，在所述触控显示屏上分区显示两个以上电子设备的按键。
  9. 根据权利要求1-8中任一项所述的方法，其特征在于，所述方法还包括：
    响应移动操作，调整选定的按键在所述触控显示屏上的显示位置；和/或，
    在所述触控显示屏上显示多个按键时，响应筛选操作，删除所述多个按键中选定的按键，并保留所述多个按键中剩余的按键。
  10. 根据权利要求1-9中任一项所述的方法，其特征在于，所述根据所述按键模拟指示，使触控显示屏上显示所述至少一个电子设备的按键，具体包括：
    对所述按键模拟指示进行第一处理，所述第一处理包括完整性校验、解密和解码中的至少一者；
    根据进行所述第一处理后的按键模拟指示控制所述触控显示屏显示所述至少一个电子设备的按键。
  11. 根据权利要求1-10中任一项所述的方法，其特征在于，所述电子设备包括车载设备和/或移动终端设备以及车载设备和/或移动终端设备中的芯片或处理装置；所述车载设备包括中控系统、音响系统、车窗、影音娱乐、抬头显示、投影仪、冰箱、按摩器、电视、空调、照相机、摄影机中的至少一者，所述移动终端设备包括手机和平板电脑中的至少一者。
  12. 一种电子设备控制方法，其特征在于，包括：
    检测到用户对触控显示屏的第一操作，生成控制指令，其中，所述触控显示屏设置在车辆的方向盘上；
    向至少一个电子设备发送所述控制指令，其中，所述至少一个电子设备由所述第一操作确定，所述控制指令用于控制所述至少一个电子设备动作。
  13. 根据权利要求12所述的方法，其特征在于，当所述至少一个电子设备包括第一电子设备和所述第二电子设备时，所述向至少一个电子设备发送控制指令，包括：
    分别向所述第一电子设备和所述第二电子设备发送所述控制指令；或，
    仅向所述第一电子设备发送所述控制指令，所述第一操作和所述第一电子设备的对应关系是预先设置的。
  14. 根据权利要求13所述的方法，其特征在于，所述仅向所述第一电子设备发送控制指令，具体包括：
    根据所述第一操作确定所述第一电子设备，并在所述触控显示屏上显示所述第一电子设备的按键，其中，所述按键是由所述第一电子设备发送的按键模拟指示中携带的按键信息确定的；
    检测到所述第一电子设备的按键被触发，向所述第一电子设备发送所述控制指令。
  15. 根据权利要求12所述的方法，其特征在于，所述向至少一个电子设备发送控制指令，具体包括：
    对所述控制指令进行权限校验；
    确定所述控制指令的权限校验通过，将所述控制指令发送给所述至少一个电子设备。
  16. 根据权利要求15所述的方法，其特征在于，所述对所述控制指令进行权限校验，具体包括：
    确定所述控制指令的信号位于预设信号范围内或发送所述控制指令的应用的身份具有发送权限，则通过校验；或，
    确定所述控制指令的信号位于预设信号范围外或确定发送所述控制指令的应用的身份不具有发送权限，则不通过校验。
  17. 根据权利要求15所述的方法，其特征在于，所述确定所述控制指令的权限校验通过，将所述控制指令发送给所述至少一个电子设备，具体包括：
    对所述控制指令进行第二处理，所述第二处理包括加密、编码和完整性校验中的至少一者；
    将经过所述第二处理后的所述控制指令发送给所述至少一个电子设备。
  18. 根据权利要求12-17中任一项所述的方法，其特征在于，所述方法还包括：
    接收所述至少一个电子设备发送的反馈信息，所述反馈信息用于指示所述至少一个电子设备执行所述控制指令的执行结果；
    在所述反馈信息指示所述控制指令执行失败时，使所述触控显示屏显示第一指示信息和所述至少一个电子设备的按键，所述第一指示信息用于指示所述控制指令执行失败；
    在所述反馈信息指示所述控制指令执行成功时，使所述触控显示屏显示所述至少一个电子设备的按键或显示第二指示信息和所述至少一个电子设备的按键，所述第二指示信息用于指示所述控制指令执行成功。
  19. 一种模拟设备，其特征在于，包括：
    至少一个存储器，用于存储程序；
    至少一个处理器，用于执行所述存储器存储的程序，当所述存储器存储的程序被执行时，所述处理器用于执行如权利要求1-18任一所述的方法。
  20. 一种车辆，其特征在于，包括方向盘、至少一个电子设备和如权利要求19所述的模拟设备，所述模拟设备的触控显示屏设置在所述方向盘上。
  21. 一种计算机存储介质，所述计算机存储介质中存储有指令，当所述指令在计算机上运行时，使得所述计算机执行如权利要求1-18任一所述的方法。
  22. 一种包含指令的计算机程序产品，当所述指令在计算机上运行时，使得所述计算机执行如权利要求1-18任一所述的方法。
  23. 一种电子装置，其特征在于，包括至少一个处理器和接口；
    所述至少一个处理器通过所述接口获取程序指令或者数据；
    所述至少一个处理器用于执行所述程序指令，以实现如权利要求1-18任一所述的方法。
PCT/CN2021/091604 2021-04-30 2021-04-30 电子设备的按键设置方法和控制方法、模拟设备及车辆 WO2022227034A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202210950529.4A CN115352375A (zh) 2021-04-30 2021-04-30 电子设备的按键设置方法和控制方法、模拟设备及车辆
PCT/CN2021/091604 WO2022227034A1 (zh) 2021-04-30 2021-04-30 电子设备的按键设置方法和控制方法、模拟设备及车辆
CN202180001458.7A CN113329914B (zh) 2021-04-30 2021-04-30 电子设备的按键设置方法和控制方法、模拟设备及车辆

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/091604 WO2022227034A1 (zh) 2021-04-30 2021-04-30 电子设备的按键设置方法和控制方法、模拟设备及车辆

Publications (1)

Publication Number Publication Date
WO2022227034A1 true WO2022227034A1 (zh) 2022-11-03

Family

ID=77427070

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/091604 WO2022227034A1 (zh) 2021-04-30 2021-04-30 电子设备的按键设置方法和控制方法、模拟设备及车辆

Country Status (2)

Country Link
CN (2) CN115352375A (zh)
WO (1) WO2022227034A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114084162B (zh) * 2021-10-29 2024-07-16 上海集度汽车有限公司 一种显示方法、装置、设备以及存储介质
CN114647347B (zh) * 2022-02-16 2024-04-16 东风汽车集团股份有限公司 车辆按键控制方法及相关设备
CN115027386B (zh) * 2022-04-29 2023-08-22 北京龙腾佳讯科技股份公司 基于汽车云栈的车载服务控制方法、系统、装置及介质
CN116279187B (zh) * 2023-01-16 2024-05-14 广州汽车集团股份有限公司 方向盘开关复用控制方法、装置、车辆及存储介质

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110166748A1 (en) * 2010-01-07 2011-07-07 Ford Global Technologies, Llc Multi-display vehicle information system and method
US20140281964A1 (en) * 2013-03-14 2014-09-18 Maung Han Method and system for presenting guidance of gesture input on a touch pad
WO2014160229A1 (en) * 2013-03-13 2014-10-02 Robert Bosch Gmbh System and method for transitioning between operational modes of an in-vehicle device using gestures
CN104657075A (zh) * 2015-01-29 2015-05-27 刘波 一种汽车电器手势控制装置及方法
CN105377612A (zh) * 2013-01-04 2016-03-02 约翰逊控制技术公司 基于上下文的车辆用户界面重配置
CN105620542A (zh) * 2014-10-31 2016-06-01 鸿富锦精密工业（深圳）有限公司 车辆及其方向盘
CN109739428A (zh) * 2018-12-07 2019-05-10 北京梧桐车联科技有限责任公司 触控交互方法及装置、显示设备及存储介质
CN111923731A (zh) * 2020-08-19 2020-11-13 北京罗克维尔斯科技有限公司 车辆方向盘虚拟按键的配置方法和装置

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110166748A1 (en) * 2010-01-07 2011-07-07 Ford Global Technologies, Llc Multi-display vehicle information system and method
CN105377612A (zh) * 2013-01-04 2016-03-02 约翰逊控制技术公司 基于上下文的车辆用户界面重配置
WO2014160229A1 (en) * 2013-03-13 2014-10-02 Robert Bosch Gmbh System and method for transitioning between operational modes of an in-vehicle device using gestures
US20140281964A1 (en) * 2013-03-14 2014-09-18 Maung Han Method and system for presenting guidance of gesture input on a touch pad
CN105620542A (zh) * 2014-10-31 2016-06-01 鸿富锦精密工业（深圳）有限公司 车辆及其方向盘
CN104657075A (zh) * 2015-01-29 2015-05-27 刘波 一种汽车电器手势控制装置及方法
CN109739428A (zh) * 2018-12-07 2019-05-10 北京梧桐车联科技有限责任公司 触控交互方法及装置、显示设备及存储介质
CN111923731A (zh) * 2020-08-19 2020-11-13 北京罗克维尔斯科技有限公司 车辆方向盘虚拟按键的配置方法和装置

Also Published As

Publication number Publication date
CN113329914A (zh) 2021-08-31
CN115352375A (zh) 2022-11-18
CN113329914B (zh) 2022-08-19

Similar Documents

Publication Publication Date Title
WO2022227034A1 (zh) 电子设备的按键设置方法和控制方法、模拟设备及车辆
US11582517B2 (en) Setup procedures for an electronic device
KR101948645B1 (ko) 그래픽 오브젝트를 이용한 컨텐츠 제어 방법 및 장치
US8970647B2 (en) Pushing a graphical user interface to a remote device with display rules provided by the remote device
US8099666B2 (en) Method and apparatus for providing user interface for multistreaming audio control
WO2021052255A1 (zh) 热点推荐弹窗的控制方法、装置、介质及电子设备
KR101941736B1 (ko) 프로그래밍 가능한 멀티미디어 제어기를 위한 구성 인터페이스
US20090284476A1 (en) Pushing a user interface to a remote device
JP7381518B2 (ja) アプリケーションプログラムの操作ガイダンス方法、装置、機器及び読み取り可能な記憶媒体
US20230300415A1 (en) Setup procedures for an electronic device
EP3508998B1 (en) Electronic device, control method thereof, and computer readable recording medium
US20170185422A1 (en) Method and system for generating and controlling composite user interface control
CN111708431A (zh) 人机交互方法、装置、头戴显示设备及存储介质
US11222104B2 (en) Verification method, mobile terminal, device, and system
WO2023246390A1 (zh) 数据处理的方法及装置
CN112109644B (zh) 一种车辆控制的方法、装置、设备及存储介质
CN110072148B (zh) 一种基于主从模式的车载信息系统的实现方法
US20150185988A1 (en) Method, apparatus and recording medium for guiding text editing position
WO2022111472A1 (zh) 游戏控制方法、装置及存储介质
WO2019236412A1 (en) Setup procedures for an electronic device
RO127448A0 (ro) Tehnologie naturală de comunicare
WO2023092746A1 (zh) 基于移动终端控制车辆的方法、设备及存储介质
TWI815095B (zh) 具操作介面切換功能之車載娛樂系統
CN116243842A (zh) 数据交互方法、电子设备及存储介质
US20140009380A1 (en) Electronic apparatus and method of storing activity thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21938508

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21938508

Country of ref document: EP

Kind code of ref document: A1