WO2022095303A1 - Procédé, dispositif informatique et support de stockage informatique permettant l'interaction d'un véhicule - Google Patents

Procédé, dispositif informatique et support de stockage informatique permettant l'interaction d'un véhicule Download PDF

Info

Publication number
WO2022095303A1
WO2022095303A1 PCT/CN2021/075741 CN2021075741W WO2022095303A1 WO 2022095303 A1 WO2022095303 A1 WO 2022095303A1 CN 2021075741 W CN2021075741 W CN 2021075741W WO 2022095303 A1 WO2022095303 A1 WO 2022095303A1
Authority
WO
WIPO (PCT)
Prior art keywords
user terminal
response
determining
vehicle
indication information
Prior art date
Application number
PCT/CN2021/075741
Other languages
English (en)
Chinese (zh)
Inventor
王庆坛
龙涛
俞铭
Original Assignee
博泰车联网(南京)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 博泰车联网(南京)有限公司 filed Critical 博泰车联网(南京)有限公司
Publication of WO2022095303A1 publication Critical patent/WO2022095303A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30—Services specially adapted for particular environments, situations or purposes
    • H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/14—Direct-mode setup

Definitions

  • the present disclosure relates generally to information processing, and in particular, to methods, computing devices, and computer storage media for vehicle interaction.
  • the user terminal can be interconnected with the vehicle equipment, and the display information of the user terminal can be projected onto the touch screen of the vehicle equipment, so that the user can browse the screen display of the user terminal by using the touch screen of the vehicle equipment.
  • the user needs to operate the touch screen of the in-vehicle device to control the user terminal connected to the in-vehicle device.
  • the user terminal does not actually support reverse control by the vehicle device due to hardware configuration or software settings, but the vehicle device cannot recognize that it can be normally interconnected with the vehicle device, but does not A user terminal that supports reverse control of in-vehicle equipment.
  • the in-vehicle device cannot identify the user terminal that does not support the anti-control of the in-vehicle device, and cannot assist the user to realize the interconnection method that supports the anti-control of the in-vehicle device.
  • the present disclosure provides a method, computing device and computer storage medium for vehicle interaction, which can identify user terminals that do not support reverse control of on-board equipment, and assist users to confirm whether the user terminal has an interconnection mode that supports reverse control of on-board equipment.
  • a method for vehicle interaction includes: monitoring the interconnection signal between the on-board device of the vehicle and the user terminal, so as to determine that the on-board device and the user terminal have established a wireless communication connection;
  • the operation action of the object on the touch screen obtains the device attribute information of the user terminal; determines whether the device attribute information of the user terminal belongs to a predetermined set; and generates first indication information in response to determining that the device attribute information of the user terminal belongs to the predetermined set, the first The indication information is used to indicate that the user terminal does not support wireless manipulation by the touch screen; in response to determining that the device attribute information of the user terminal does not belong to the predetermined set, a first test signal is sent via the application program interface of the user terminal, the first test signal and the operation The action is associated; in response to determining that a response signal from the user terminal to the first test signal is not received within the first predetermined time interval, at least one of the first indication information and the second indication information is generated, and
  • a computing device comprising: a memory configured to store one or more computer programs; and a processor coupled to the memory and configured to execute the one or more programs to cause computing
  • the apparatus performs the method of the first aspect of the present disclosure.
  • non-transitory computer storage medium has stored thereon machine-executable instructions that, when executed, cause a machine to perform the method of the first aspect of the present disclosure.
  • generating at least one of the first indication information and the second indication information in response to determining that a response signal from the user terminal to the first test signal is not received within the first predetermined time interval includes: A response signal from the user terminal to the first test signal is not received within a predetermined time interval, determining whether the number of historical Bluetooth paired devices indicated in the Bluetooth pairing list of the user terminal is less than a predetermined number threshold; and in response to determining the Bluetooth When the number of historical Bluetooth paired devices indicated in the pairing list is less than a predetermined number threshold, at least one of the first indication information and the second indication information is generated.
  • for the vehicle interaction comprises: in response to determining that the number of historical Bluetooth paired devices is greater than or equal to a predetermined number threshold, presenting information indicative of reducing the historical Bluetooth paired devices in the Bluetooth connection list; and in response to determining the history The number of Bluetooth paired devices is reduced to less than a predetermined number threshold, and the first test signal is sent again via the application program interface of the user terminal to determine whether a response from the user terminal to the first test signal is received within the first predetermined time interval Signal.
  • the predetermined number threshold is seven.
  • for vehicle interaction includes presenting a response signal in response to determining that a response signal from the user terminal to the first test signal is received within a first predetermined time interval.
  • for vehicle interaction includes: in response to determining that the user terminal is connected to the vehicle-mounted device via a USB connection, generating a second test signal for transmission to the user terminal, the second test signal and the user terminal via a touch screen Control the association in a USB connection; and in response to determining that a response signal from the user terminal to the second test signal is not received within the second predetermined time interval, acquiring an image displayed on the touch screen of the in-vehicle device for determining what the image contains The indicated target object.
  • the method for vehicle interaction includes: in response to determining that the target object indicated by the image meets a predetermined condition, generating a third indication signal for indicating that the user terminal cannot be operated via the touch screen in a USB connection; and in the vehicle The third indication information is presented on the touch screen of the device.
  • determining that the target object indicated by the image meets a predetermined condition includes one of the following: determining that the matching degree of the target object indicated by the image and a predetermined template is greater than a predetermined matching degree threshold, and the predetermined template and the cursor Image correlation; a target object recognition model trained on multiple samples predicts that the class of target object indicated by the image is a cursor.
  • for vehicle interaction includes: in response to determining that at least one of the first indication signal and the third indication signal is generated, adding device attribute information of the user terminal to a predetermined set, the predetermined set being obtained from the cloud server.
  • FIG. 1 shows a schematic diagram of a system for a method of vehicle interaction according to an embodiment of the present disclosure.
  • FIG. 2 shows a flowchart of a method for vehicle interaction according to an embodiment of the present disclosure.
  • FIG. 3 schematically shows a flowchart of a method for generating at least one of first indication information and second indication information according to an embodiment of the present disclosure.
  • FIG. 4 schematically shows a flowchart of a method 400 for presenting a reduced history Bluetooth paired device according to an embodiment of the present disclosure.
  • FIG. 5 schematically shows a flowchart of a method for identifying a user terminal supported by a USB connection in a reverse control manner according to an embodiment of the present disclosure.
  • FIG. 6 schematically shows a schematic structural diagram of a computing device for implementing the method of an embodiment of the present disclosure.
  • the term “including” and variations thereof mean open-ended inclusion, ie, "including but not limited to”.
  • the term “or” means “and/or” unless specifically stated otherwise.
  • the term “based on” means “based at least in part on”.
  • the terms “one example embodiment” and “one embodiment” mean “at least one example embodiment.”
  • the term “another embodiment” means “at least one additional embodiment.”
  • the terms “first”, “second”, etc. may refer to different or the same objects. Other explicit and implicit definitions may also be included below.
  • example embodiments of the present disclosure propose a solution for vehicle interaction.
  • the solution includes: monitoring the interconnection signal between the in-vehicle device and the user terminal of the vehicle, so as to determine that the in-vehicle device and the user terminal have established a wireless communication connection;
  • the operation action of the object on the screen obtain the device attribute information of the user terminal; determine whether the device attribute information of the user terminal belongs to a predetermined set; in response to determining that the device attribute information of the user terminal belongs to the predetermined set, generate first indication information, the first indication
  • the information is used to indicate that the user terminal does not support wireless manipulation by the touch screen; in response to determining that the device attribute information of the user terminal does not belong to the predetermined set, a first test signal is sent via the application program interface of the user terminal, the first test signal and the operation action associated; in response to determining that a response signal from the user terminal to the first test signal is not received within the first predetermined time interval, generating at
  • the first test signal associated with the operation action is sent via the application program interface of the user terminal; if it is determined that no response to the first test signal is received within the first predetermined time interval signal, generating and presenting information indicating that the user terminal does not support wireless manipulation by the touch screen, and/or information indicating that the user terminal is to be connected to the in-vehicle device via a USB connection. Therefore, even for a new type of user terminal that is not recorded, the present disclosure can accurately identify the user terminal that does not support the wireless reverse control of the in-vehicle device, and instruct the user terminal to try the USB reverse control. Therefore, the present disclosure can identify the user terminal that does not support the anti-control of the in-vehicle device, and assist the user to confirm whether the user terminal has an interconnection mode that supports the anti-control of the in-vehicle device.
  • FIG. 1 shows a schematic diagram of a system 100 for a method of vehicle interaction according to an embodiment of the present disclosure.
  • the system 100 includes a vehicle 110 and its in-vehicle equipment 130 , a user terminal 120 , a cloud server 160 , a base station 150 , and a network 170 .
  • the vehicle 110 , the user terminal 120 , and the cloud server 160 may perform data interaction via, for example, the base station 150 and the network 170 .
  • the cloud server 160 is used to store and update a predetermined set, and the predetermined set includes device attribute information of user terminals that do not support reverse control of each vehicle-mounted device 130 .
  • the cloud server 160 may receive the device attribute information of the newly added user terminal that does not support reverse control sent by the in-vehicle device 130, and add the device attribute information of the newly added user terminal to a predetermined set.
  • the cloud server may have one or more processing units including, for example, a Graphics Processing Unit (GPU), a Field Programmable Gate Array (FPGA), and an Application-Specific Integrated Circuit (Application Specific Integrated Circuit, ASIC), etc., and general-purpose processing units such as CPUs.
  • one or more virtual machines can be running on each server.
  • the vehicle 110 includes, for example, at least an in-vehicle device 130 (eg, an in-vehicle device) and its touch screen, an in-vehicle Bluetooth device, and the like.
  • an in-vehicle device 130 eg, an in-vehicle device
  • its touch screen e.g., a touch screen
  • an in-vehicle Bluetooth device e.g., a Wi-Fi device
  • the in-vehicle device 130 it is used for data interaction and sharing with the user terminal 120 through wireless or wired interconnection methods such as Bluetooth and USB.
  • the in-vehicle device 130 is also configured with a high definition multimedia interface (High Definition Multimedia Interface, HDMI) interface, which can display content on the interface of the user terminal 120, for example, transmit the played video signal to the display of the in-vehicle device 130.
  • HDMI High Definition Multimedia Interface
  • the in-vehicle device 130 can be used to monitor the interconnection signal between the in-vehicle device 130 and the user terminal 120, so as to determine that the two have established a wireless communication connection;
  • mapping to the operation action of the object on the touch screen determine whether the acquired device attribute information of the user terminal belongs to the predetermined device set; if it belongs to the predetermined device set, it indicates that the user terminal does not support wireless manipulation by the touch screen; if it is determined If the user terminal does not belong to the predetermined equipment set, the first test signal associated with the operation action is sent via the application program interface of the user terminal, and if the corresponding response signal is not received within the first predetermined time interval, it indicates that the user terminal does not support the
  • the touch screen controls wirelessly or indicates the in-vehicle device can be connected via a USB connection.
  • the in-vehicle device 130 includes, for example, at least a wireless communication connection confirmation unit 132 , a device attribute information acquisition unit 134 , a predetermined set determination unit 136 , a first indication information generation unit 138 , a first test signal transmission unit 140 , and a response signal confirmation unit 142 .
  • the wireless communication connection confirmation unit 132 it is used to monitor the interconnection signal between the in-vehicle device of the vehicle and the user terminal, so as to determine that the in-vehicle device and the user terminal have established a wireless communication connection.
  • the device attribute information acquisition unit 134 it is used to confirm whether an operation action applied to the touch screen of the in-vehicle device for an object mapped to the touch screen by the user terminal is detected; For the operation actions of the user terminal mapped to the object on the touch screen, the device attribute information of the user terminal is acquired.
  • the predetermined set determining unit 136 it is used to determine whether the device attribute information of the user terminal belongs to the predetermined device set.
  • the first indication information generating unit 138 if it is determined that the device attribute information of the user terminal does not belong to the predetermined device set, send a first test signal via the application program interface of the user terminal, the first test signal is associated with the operation action, and the first test signal is associated with the operation action.
  • an indication message is used to indicate that the user terminal does not support manipulation by the touch screen in a wireless manner; and if it is determined that a response signal from the user terminal to the first test signal is not received within the first predetermined time interval, generating the first indication information and the second indication message At least one of the indication information, and the second indication information is used to indicate that the user terminal is to be connected to the in-vehicle device via a USB connection.
  • the first test signal sending unit 140 if it is determined that the user terminal does not belong to the predetermined device set, the first test signal is sent via the application program interface of the user terminal, and the first test signal is associated with the operation action.
  • response signal confirmation unit 142 it is configured to determine whether a response signal of the user terminal to the first test signal is not received within the first predetermined time interval.
  • the user terminal 120 it is, for example, but not limited to, a mobile phone.
  • the mobile device 120 may directly interact and share data with the in-vehicle device 130 through wireless or wired interconnection such as Bluetooth and USB. Data interaction with the server 160 may also be performed via the base station 150 and the network 170 .
  • the user terminal 120 can project the displayed content onto the touch screen of the vehicle-mounted device 130 .
  • the user terminal 120 may include an application program interface 122, a Bluetooth module 124, a video playing unit 126 and other units not shown.
  • the user terminal 120 may be implemented by the computing device 600 shown in FIG. 6 .
  • the application program interface 122 it is, for example and not limited to, data interaction with in-vehicle devices.
  • the in-vehicle device 130 can, for example, obtain the device attribute information of the user terminal through the application program interface 122; and obtain the number of historical Bluetooth paired devices in the Bluetooth pairing list of the user terminal 120 through the application program interface 122.
  • the Bluetooth module 124 is used for the user terminal 120 and the in-vehicle device 130 to perform Bluetooth connection and data interaction.
  • the Bluetooth module 124 includes, for example, at least a protocol layer and underlying hardware modules.
  • the protocol layer is composed of, for example, a Bluetooth-specific protocol formulated by the Bluetooth Special Interest Group (SIG).
  • the underlying hardware modules include, for example, a radio frequency module, a baseband module, a link control module, a link management module, and a host controller interface.
  • the radio frequency module (Radio) is used for data reception and transmission.
  • the baseband module (BaseBand) is used for wireless media access conventions, providing synchronous connection-oriented physical links and asynchronous connectionless physical links.
  • the Link Control (LC) module is used for encoding and decoding of Bluetooth data packets.
  • the Link Management (LM) module is used to create, modify and publish logical links and update physical link parameters between devices.
  • the Host Controller Interface (HCI) is used to provide a command interface for the baseband controller, connection manager, hardware status and control registers. For example, pairing and interconnection with the in-vehicle Bluetooth device of the in-vehicle device 130 is realized via the Bluetooth module 124 .
  • the in-vehicle device 130 can obtain the identification of the user terminal 120 and the Bluetooth pairing password; and then configure the data connection and personal hotspot function of the user terminal 120 to be enabled, so that the in-vehicle device 130 can scan the user terminal 120 for interconnection.
  • the video playing unit 126 is used to play video files stored locally or obtained online by the user terminal.
  • the user terminal 120 supports the high-definition video and audio standard interface (Mobile High-Definition Link, MHL) function of the mobile terminal, and via the MHL function, the video signal being played by the user terminal 120 can be transmitted to the touch screen of the in-vehicle device 130.
  • MHL line can be connected to the USB interface of the user terminal 120 and the HDMI interface of the in-vehicle device 130 at the same time to realize the screen mapping of the video signal played by the user terminal 120 to the touch screen of the in-vehicle device 130 .
  • FIG. 2 shows a flowchart of a method 200 for vehicle interaction according to an embodiment of the present disclosure. It should be appreciated that the method 200 may be performed, for example, at the computing device 600 depicted in FIG. 6 . It may also be performed at the in-vehicle device 130 described in FIG. 1 . It should be understood that the method 200 may also include additional actions not shown and/or the actions shown may be omitted, and the scope of the present disclosure is not limited in this regard.
  • the in-vehicle device 130 monitors the interconnection signal between the in-vehicle device of the vehicle and the user terminal, so as to determine that the in-vehicle device and the user terminal have established a wireless communication connection.
  • the in-vehicle device 130 confirms whether an operation action applied to the touch screen of the in-vehicle device for an object mapped on the touch screen by the user terminal is detected.
  • the object mapped by the user terminal to the touch screen it is, for example, but not limited to, the video player and the video being played by the user terminal 120 and projected to the touch screen of the in-vehicle device 130 .
  • the operation action it is, for example, but not limited to, dragging the playback progress bar of the video player projected to the touch screen of the in-vehicle device 130 .
  • the operation action may also be a click operation for an icon in the display interface of the user terminal 120 that is projected onto the touch screen of the in-vehicle device 130 .
  • the in-vehicle device 130 detects an operation action applied to the touch screen of the in-vehicle device for the object mapped to the touch screen by the user terminal, the device attribute information of the user terminal is obtained.
  • the in-vehicle device 130 acquires the record model of the user terminal via the user terminal application programming interface (Application Programming Interface, API).
  • API Application Programming Interface
  • the in-vehicle device 130 determines whether the device attribute information of the user terminal belongs to a predetermined set.
  • the predetermined device set includes, for example, a set of device attribute information that does not support user terminals that are wirelessly controlled by each in-vehicle device.
  • the device attribute information is, for example, the record model of the user terminal.
  • step 210 if the in-vehicle device 130 determines that the device attribute information of the user terminal belongs to a predetermined set, first indication information is generated, and the first indication information is used to indicate that the user terminal does not support wireless manipulation by the touch screen.
  • a first test signal is sent via the application program interface of the user terminal, and the first test signal is associated with the operation action.
  • the in-vehicle device 130 determines whether a response signal from the user terminal to the first test signal has not been received within the first predetermined time interval. If the in-vehicle device 130 determines that a response signal from the user terminal to the first test signal is received within the first predetermined time interval, it jumps to step 220 to present the response signal.
  • the response signal to the first test signal it is, for example, a processing result of an operation action or an associated interaction signal.
  • the feedback information of the application program interface of the user terminal that does not support wirelessly controlled by various in-vehicle devices may indicate that the in-vehicle device 130 and the user terminal 120 are compatible and can normally perform wireless interconnection.
  • the feedback information of the application program interface cannot reflect whether the user terminal does not support reverse control by the in-vehicle device.
  • Studies have shown that the Bluetooth module of the user terminal 120 may not be able to support wireless control by various in-vehicle devices due to the incompatibility of the underlying hardware modules; In-vehicle devices are controlled wirelessly.
  • the in-vehicle device 130 can detect whether the processing result related to the operation action or the associated interaction signal is not received within the first predetermined time interval, and then can accurately determine whether the current user terminal 120 is in a state that does not support wireless manipulation by the in-vehicle device. state.
  • step 216 if the in-vehicle device 130 determines that a response signal from the user terminal to the first test signal is not received within the first predetermined time interval, at least one of the first indication information and the second indication information is generated, and the second indication information It is used to indicate that the user terminal is to be connected to the in-vehicle device via the USB connection.
  • the in-vehicle device 130 may determine that the current user terminal 120 is in a state that does not support wireless manipulation by various in-vehicle devices, and generate indication information (such as an indicator, or an indication icon), and/or generate indication information (for example, an indication word or an indication icon) for instructing to replace the user terminal 120 with a USB connection.
  • indication information such as an indicator, or an indication icon
  • indication information for example, an indication word or an indication icon
  • the present disclosure can remind the user to try whether to support the reverse control of the USB connection method when it is confirmed that the user terminal does not support the reverse control of the wireless method.
  • the first test signal associated with the operation action is sent via the application program interface of the user terminal; if it is determined that no response to the first test signal is received within the first predetermined time interval signal, generating and presenting information indicating that the user terminal does not support wireless manipulation by the touch screen, and/or information indicating that the user terminal is to be connected to the in-vehicle device via a USB connection. Therefore, even for a new type of user terminal that is not recorded, the present disclosure can accurately identify the user terminal that does not support the wireless reverse control of the in-vehicle device, and instruct the user terminal to try the USB reverse control. Therefore, the present disclosure can identify the user terminal that does not support the anti-control of the in-vehicle device, and assist the user to confirm whether the user terminal has an interconnection mode that supports the anti-control of the in-vehicle device.
  • the method 200 further includes: if the in-vehicle device 130 determines that at least one of the first indication signal and the third indication signal is generated, adding the device attribute information of the user terminal to the predetermined device set, and obtaining the predetermined device set from cloud server.
  • the cloud server can update a predetermined set of device attribute information about user terminals that do not support reverse control by each vehicle device 130 at any time based on information fed back by multiple vehicle devices, so that each vehicle device can identify user terminals that do not support reverse control.
  • the method 200 further includes a method 300 for generating at least one of the first indication information and the second indication information.
  • FIG. 3 shows a flowchart of a method 300 for generating at least one of first indication information and second indication information according to an embodiment of the present disclosure. It should be understood that the method 300 may be performed, for example, at the computing device 600 depicted in FIG. 6 . It may also be performed at the in-vehicle device 130 described in FIG. 1 . It should be understood that the method 300 may also include additional actions not shown and/or the actions shown may be omitted, and the scope of the present disclosure is not limited in this regard.
  • the in-vehicle device 130 determines that a response signal from the user terminal to the first test signal has not been received within a first predetermined time interval.
  • the in-vehicle device 130 determines whether the number of historical Bluetooth paired devices indicated in the user terminal's Bluetooth pairing list is less than a predetermined number threshold.
  • the reasons that cause the user terminal not to support the anti-control of in-vehicle equipment include hardware configuration and software configuration.
  • the reasons for software configuration include, for example, if the user terminal has too many historical Bluetooth paired devices, even if the historical Bluetooth paired device is not currently connected, the function of the in-vehicle device to reversely control the user terminal cannot be realized. Therefore, if the in-vehicle device 130 detects that the number of historical Bluetooth paired devices exceeds a predetermined number threshold, the user can be prompted to delete the number of historical Bluetooth paired devices, so as to troubleshoot and avoid the situation that the reverse control is not supported due to software configuration reasons.
  • the predetermined number threshold it is, for example, seven.
  • the in-vehicle device 130 determines that the number of historical Bluetooth paired devices indicated in the user terminal's Bluetooth pairing list is less than a predetermined number threshold, at least one of first indication information and second indication information is generated. If it is detected that the number of historical Bluetooth paired devices does not exceed the predetermined number threshold, the software configuration can be excluded, and the hardware of the user terminal can be determined and instructed that the in-vehicle device does not support the reverse control of the in-vehicle device by Bluetooth, or the user can be instructed at the same time to The user terminal is interconnected with the in-vehicle device in a USB way, so as to identify whether the hardware of the user terminal supports the in-vehicle device to perform reverse control in the way of USB connection.
  • the present disclosure can quickly identify and check whether there are user terminals that do not support reverse control of in-vehicle devices due to too many historical Bluetooth paired devices.
  • FIG. 4 shows a flowchart of a method 400 for presenting a reduced history Bluetooth paired device according to an embodiment of the present disclosure. It should be understood that the method 400 may be performed, for example, at the computing device 600 depicted in FIG. 6 . It may also be performed at the in-vehicle device 130 described in FIG. 1 . It should be understood that the method 400 may also include additional actions not shown and/or the actions shown may be omitted, and the scope of the present disclosure is not limited in this regard.
  • step 402 if the in-vehicle device 130 determines that the number of historical Bluetooth paired devices is greater than or equal to a predetermined number threshold, indication information about reducing the historical Bluetooth paired devices in the Bluetooth connection list is presented.
  • the research found that if the user terminal has too many historical Bluetooth pairing devices, even if the historical Bluetooth pairing device is not currently connected, the function of the in-vehicle device to counter-control the user terminal cannot be realized. Therefore, if the in-vehicle device 130 determines that the number of historical Bluetooth paired devices is greater than or equal to 7, an indication message is presented on the touch screen of the in-vehicle device 130 to remind the user to partially delete the historical Bluetooth paired devices from the Bluetooth pairing list.
  • the in-vehicle device 130 determines whether the number of historical Bluetooth paired devices has been reduced to less than a predetermined number threshold.
  • the in-vehicle device 130 determines that the number of historical Bluetooth paired devices is reduced to less than the predetermined number threshold, the first test signal is re-sent via the application program interface of the user terminal for determining whether within the first predetermined time interval A response signal of the user terminal to the first test signal is received.
  • the in-vehicle device 130 determines that the number of historical Bluetooth paired devices of the user terminal is less than 7, the first test signal associated with the aforementioned operation signal is sent again, so as to test again whether the user terminal whose Bluetooth pairing list has been adjusted supports the in-vehicle device reverse operation. control. If the in-vehicle device 130 determines that it still does not receive a response signal from the user terminal to the re-sent first test signal within the first predetermined time interval, it indicates that the user terminal belongs to hardware that does not support in-vehicle device anti-control.
  • the present disclosure can prompt the user to confirm whether it belongs to the user terminal that supports the anti-control of the in-vehicle device on the hardware by reducing the historical Bluetooth paired devices.
  • FIG. 5 shows a flowchart of a method 500 for identifying a user terminal supported by a USB connection in a reverse control manner according to an embodiment of the present disclosure. It should be appreciated that the method 500 may be performed, for example, at the computing device 600 depicted in FIG. 6 . It may also be performed at the in-vehicle device 130 described in FIG. 1 . It should be understood that the method 500 may also include additional actions not shown and/or the actions shown may be omitted, and the scope of the present disclosure is not limited in this regard.
  • the in-vehicle device 130 determines whether the user terminal is connected to the in-vehicle device via a USB connection.
  • step 502 is continued until it is determined that the user terminal has been connected to the in-vehicle device by a USB connection.
  • step 504 if the in-vehicle device 130 determines that the user terminal is connected to the in-vehicle device via a USB connection, a second test signal for sending to the user terminal is generated, and the second test signal is related to the user terminal being operated via the touch screen in a USB connection. link.
  • the second test signal it is associated with the operation action on the touch screen of the in-vehicle device mentioned in the aforementioned step 204 for the object mapped on the touch screen by the user terminal.
  • the second test signal is different from the first test signal used for testing wireless reverse control.
  • the in-vehicle device 130 determines whether a response signal from the user terminal to the second test signal has not been received within the second predetermined time interval.
  • step 508 if the in-vehicle device 130 determines that a response signal from the user terminal to the second test signal has not been received within the second predetermined time interval, the image displayed on the touch screen of the in-vehicle device is acquired to determine the target.
  • the in-vehicle device 130 can obtain the image displayed on the touch screen by means of screen copying or the like, and then identify the target object indicated by the image to determine whether the user terminal cannot be controlled by the USB connection via the touch screen.
  • the in-vehicle device 130 determines whether the target object indicated by the image meets a predetermined condition. For example, determining that the target object indicated by the image meets the predetermined condition includes one of the following: determining that the matching degree of the target object indicated by the image and the predetermined template is greater than a predetermined matching degree threshold, and the predetermined template is associated with the cursor image; The target object recognition model predicts that the category of the target object indicated by the image is a cursor.
  • the predetermined condition it is, for example, that the predicted class of the target object is a cursor.
  • the predetermined condition may also be that the image including the target object matches a predetermined template (eg, a cursor image).
  • the way to determine the target object indicated by the image may also be to predict whether the category of the target object is a cursor through a target object recognition model trained with multiple samples.
  • the target object recognition model is constructed based on, for example, a neural network model (such as, but not limited to, a Convolutional Neural Network (CNN) model).
  • CNN Convolutional Neural Network
  • the in-vehicle device 130 determines whether the matching degree of the target object indicated by the image and the predetermined template is greater than a predetermined matching degree threshold, for example, by template matching. Specifically, the in-vehicle device 130 may move the predetermined template pixel by pixel from left to right and from top to bottom on the acquired image to be recognized, and calculate the degree of matching between the predetermined template image and the overlapping sub-images of the image to be recognized. , the greater the matching degree, the greater the possibility that the predetermined template is the same as the overlapping sub-image.
  • the in-vehicle device 130 may use the squared difference to calculate the matching degree.
  • I(x+x', y+y') represents the acquired parameters of the touch screen display image to be recognized, and the parameters are, for example, 8-bit integers or 32-bit floating point numbers.
  • x, y represent the pixels of the touch screen display image to be identified.
  • T(x', y') represents parameters of a predetermined template (eg, a cursor template image).
  • the predetermined template is smaller than the touch screen display image to be recognized and has the same data type.
  • x', y' represent the pixels of the predetermined template image.
  • R(x,y) represents the matching result.
  • the in-vehicle device 130 may also calculate the matching degree through correlation matching calculation or standard correlation matching calculation through the multiplication operation between the predetermined template and the touch screen display image to be recognized.
  • a third indication signal is generated for indicating that the user terminal cannot be manipulated via the touch screen in a USB connection manner.
  • the in-vehicle device 130 presents the third indication information at the touch screen of the in-vehicle device.
  • the present disclosure can further identify whether the user terminal can be reverse-controlled by the vehicle-mounted device via the USB connection when it is confirmed that the user terminal cannot be reverse-controlled by the vehicle-mounted device via the Bluetooth method.
  • FIG. 6 schematically illustrates a block diagram of a computing device 600 suitable for implementing embodiments of the present disclosure.
  • the computing device 600 may be a device for implementing the methods 200 to 500 shown in FIGS. 2 to 5 .
  • the computing device 600 includes a central processing unit (Central Processing Unit, CPU) 601, which can be loaded according to computer program instructions stored in a read-only memory (Read-Only Memory, ROM) 602 or from a storage unit 608 Computer program instructions into random access memory (RAM) 603 to perform various appropriate actions and processes.
  • RAM 603 various programs and data required for the operation of computing device 600 may also be stored.
  • the CPU 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604.
  • Input/output (I/O) interface 605 is also connected to bus 604 .
  • I/O Input/output
  • a number of components in the computing device 600 are connected to the I/O interface 605, including: an input unit 606, an output unit 607, and a storage unit 608, and the CPU 601 executes the various methods and processes described above, such as methods 200 to 500.
  • methods 200 - 500 may be implemented as a computer software program stored on a machine-readable medium, such as storage unit 608 .
  • part or all of the computer program may be loaded and/or installed on computing device 600 via ROM 602 and/or communication unit 609 .
  • CPU 601 may be configured to perform one or more actions of methods 200-500 by any other suitable means (eg, by means of firmware).
  • the present disclosure may be a method, an apparatus, a system and/or a computer program product.
  • the computer program product may include a non-transitory computer storage medium having computer readable program instructions loaded thereon for carrying out various aspects of the present disclosure.
  • Non-transitory computer storage media may also be referred to as non-transitory computer readable storage media, or computer storage media.
  • a computer storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device.
  • Computer storage media may be, for example, but not limited to, electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing.
  • Non-exhaustive list of computer storage media include: portable computer disks, hard disks, RAM, ROM, Erasable Programmable Read-Only Memory (EPROM or flash memory), static random access Access Memory (Static Random-Access Memory, SRAM), Portable Compact Disc Read-Only Memory (CD-ROM), Digital Video Disc (DVD), Memory Stick, Floppy Disk, Mechanical Encoding devices, such as punched cards or raised structures in grooves on which instructions are stored, and any suitable combination of the foregoing.
  • portable computer disks hard disks, RAM, ROM, Erasable Programmable Read-Only Memory (EPROM or flash memory), static random access Access Memory (Static Random-Access Memory, SRAM), Portable Compact Disc Read-Only Memory (CD-ROM), Digital Video Disc (DVD), Memory Stick, Floppy Disk, Mechanical Encoding devices, such as punched cards or raised structures in grooves on which instructions are stored, and any suitable combination of the foregoing.
  • Computer storage media are not to be interpreted as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or transmitted through electrical wires electric signal.
  • the computer readable program instructions described herein may be downloaded to various computing/processing devices from computer storage media, or to external computers or external storage devices over a network, such as the Internet, a local area network, a wide area network, and/or a wireless network.
  • the network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers.
  • a network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer storage medium in the respective computing/processing device.
  • the computer program instructions for carrying out the operations of the present disclosure may be assembly instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or in one or more Source or object code written in any combination of programming languages, including object-oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as the "C" language or similar programming languages.
  • the computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement.
  • the remote computer may be connected to the user's computer through any kind of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or, may be connected to an external computer (eg, use an internet service provider to connect via the internet).
  • LAN Local Area Network
  • WAN Wide Area Network
  • electronic circuits such as programmable logic circuits, FPGAs, or Programmable Logic Arrays (PLAs), that can execute computer-readable Program instructions are read to implement various aspects of the present disclosure.
  • PDAs Programmable Logic Arrays
  • These computer readable program instructions may be provided to a processor in a voice interaction device, a general purpose computer, a special purpose computer, or a processing unit of other programmable data processing devices, thereby producing a machine in which the instructions are processed by a computer or other programmable
  • the processing elements of the data processing apparatus when executed, produce means for implementing the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.
  • These computer readable program instructions can also be stored in a computer storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, whereby the computer readable medium storing the instructions includes a manufacturing Articles comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
  • Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which contains one or more oper- ables for implementing the specified logical function(s) Execute the instruction.
  • the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)

Abstract

La présente divulgation concerne un procédé, un dispositif informatique et un support de stockage informatique permettant l'interaction d'un véhicule. Le procédé comprend les étapes suivantes : surveiller un signal d'interconnexion entre un dispositif embarqué et un terminal d'utilisateur afin de déterminer qu'une connexion de communication sans fil a été établie entre le dispositif embarqué et le terminal d'utilisateur ; en réponse à la détection d'une action de fonctionnement sur un objet mis en correspondance avec un écran tactile par le terminal d'utilisateur, obtenir des informations concernant les attributs du dispositif du terminal d'utilisateur ; s'il est déterminé que les informations concernant les attributs du dispositif du terminal d'utilisateur appartiennent à un ensemble prédéterminé, générer des premières informations d'indication ; s'il est déterminé que les informations concernant les attributs du dispositif du terminal d'utilisateur n'appartiennent pas à un ensemble prédéterminé, envoyer un premier signal d'essai au moyen d'une interface d'un programme d'application du terminal d'utilisateur ; s'il est déterminé qu'aucun signal de réponse n'est reçu du terminal d'utilisateur pour le premier signal d'essai dans un premier intervalle de temps prédéterminé, générer et présenter les premières informations d'indication et/ou les secondes informations d'indication. La présente invention permet d'identifier un terminal d'utilisateur qui ne prend pas en charge la commande de marche arrière du dispositif embarqué.
PCT/CN2021/075741 2020-11-04 2021-02-07 Procédé, dispositif informatique et support de stockage informatique permettant l'interaction d'un véhicule WO2022095303A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011214197.0 2020-11-04
CN202011214197.0A CN112040468B (zh) 2020-11-04 2020-11-04 用于车辆交互的方法、计算设备和计算机存储介质

Publications (1)

Publication Number Publication Date
WO2022095303A1 true WO2022095303A1 (fr) 2022-05-12

Family

ID=73572943

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/075741 WO2022095303A1 (fr) 2020-11-04 2021-02-07 Procédé, dispositif informatique et support de stockage informatique permettant l'interaction d'un véhicule

Country Status (2)

Country Link
CN (2) CN112887954B (fr)
WO (1) WO2022095303A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116095636A (zh) * 2023-04-07 2023-05-09 宁波均联智行科技股份有限公司 一种引导车载设备与移动设备建立连接的方法和车载设备

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112887954B (zh) * 2020-11-04 2022-08-30 博泰车联网(南京)有限公司 用于车辆交互的方法、计算设备和计算机存储介质
CN112888044B (zh) * 2021-01-28 2023-04-25 南京奇元科技有限公司 一种设备匹配方法
CN115032329B (zh) * 2021-03-08 2024-05-03 博泰车联网科技(上海)股份有限公司 车内空气质量的监测方法、装置、电子设备及介质
CN115056745B (zh) * 2021-12-16 2024-05-17 博泰车联网科技(上海)股份有限公司 车辆、控制车辆的方法以及识别车辆外部手势的方法
CN114655299B (zh) * 2022-03-23 2023-06-16 博泰车联网(南京)有限公司 方向盘的除湿装置的控制方法、电子设备及存储介质
CN114945162B (zh) * 2022-04-08 2022-11-29 杭州辰汉智能科技有限公司 一种车辆仪表的用户管理系统
CN115017352B (zh) * 2022-06-22 2023-04-07 润芯微科技(江苏)有限公司 一种基于图像识别的手机车机交互系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203911921U (zh) * 2013-11-08 2014-10-29 江波 车载系统与智能终端互联系统
CN105722250A (zh) * 2014-12-03 2016-06-29 中国移动通信集团公司 一种数据传输与反向控制方法、设备及系统
CN105933509A (zh) * 2016-04-05 2016-09-07 上海博泰悦臻网络技术服务有限公司 设备双向控制方法、系统、车载终端及其控制方法、车辆
CN108268197A (zh) * 2016-12-30 2018-07-10 乐视汽车（北京）有限公司 反向控制方法、移动设备、车载显示设备及系统
CN111726785A (zh) * 2020-07-21 2020-09-29 辽宁尔雅网信科技有限公司 一种车载娱乐及移动终端系统总成及其使用方法
CN112040468A (zh) * 2020-11-04 2020-12-04 博泰车联网(南京)有限公司 用于车辆交互的方法、计算设备和计算机存储介质

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006036121A (ja) * 2004-07-29 2006-02-09 Alps Electric Co Ltd 車両用制御装置
CN108255399A (zh) * 2016-12-29 2018-07-06 乐视汽车（北京）有限公司 用于车机屏幕上的流画面窗口切换的方法、车机和车辆
CN107231489B (zh) * 2017-07-06 2020-08-21 钛马信息网络技术有限公司 一种终端及其投屏方法
CN108337667B (zh) * 2018-02-12 2020-12-01 武汉卡比特信息有限公司 手机与车载显示终端在投屏状态蓝牙配对的装置及方法
CN208752602U (zh) * 2018-10-24 2019-04-16 深圳市鸿基盛科技有限公司 车载同屏反控系统
CN110209327A (zh) * 2019-05-14 2019-09-06 百度在线网络技术（北京）有限公司 显示界面焦点控制方法、装置、系统、移动终端及介质
CN111399789B (zh) * 2020-02-20 2021-11-19 华为技术有限公司 界面布局方法、装置及系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203911921U (zh) * 2013-11-08 2014-10-29 江波 车载系统与智能终端互联系统
CN105722250A (zh) * 2014-12-03 2016-06-29 中国移动通信集团公司 一种数据传输与反向控制方法、设备及系统
CN105933509A (zh) * 2016-04-05 2016-09-07 上海博泰悦臻网络技术服务有限公司 设备双向控制方法、系统、车载终端及其控制方法、车辆
CN108268197A (zh) * 2016-12-30 2018-07-10 乐视汽车（北京）有限公司 反向控制方法、移动设备、车载显示设备及系统
CN111726785A (zh) * 2020-07-21 2020-09-29 辽宁尔雅网信科技有限公司 一种车载娱乐及移动终端系统总成及其使用方法
CN112040468A (zh) * 2020-11-04 2020-12-04 博泰车联网(南京)有限公司 用于车辆交互的方法、计算设备和计算机存储介质

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116095636A (zh) * 2023-04-07 2023-05-09 宁波均联智行科技股份有限公司 一种引导车载设备与移动设备建立连接的方法和车载设备
CN116095636B (zh) * 2023-04-07 2023-07-21 宁波均联智行科技股份有限公司 一种引导车载设备与移动设备建立连接的方法和车载设备

Also Published As

Publication number Publication date
CN112040468A (zh) 2020-12-04
CN112887954B (zh) 2022-08-30
CN112887954A (zh) 2021-06-01
CN112040468B (zh) 2021-01-08

Similar Documents

Publication Publication Date Title
WO2022095303A1 (fr) Procédé, dispositif informatique et support de stockage informatique permettant l'interaction d'un véhicule
US11880629B2 (en) Display control method and apparatus
US11677806B2 (en) Platform-independent content generation for thin client applications
AU2013390850B2 (en) Synchronizing device association data among computing devices
CN110417641B (zh) 一种发送会话消息的方法与设备
WO2021012952A1 (fr) Procédé et dispositif de traitement de message, et équipement électronique
US11740851B2 (en) Display method and apparatus
WO2021147455A1 (fr) Procédé et dispositif de traitement de message, et appareil électronique
WO2022001027A1 (fr) Procédé et appareil d'autoadaptation d'image d'écran de projection dans l'apprentissage de réseau
US10983903B1 (en) Enhanced automated protocol for secure application testing
US9134887B2 (en) Multi-device visual correlation interaction
CN104423922A (zh) 图像显示装置和数据传送方法
WO2023134559A1 (fr) Procédé et appareil d'invite de commentaires, ainsi que dispositif électronique, support de stockage et produit-programme
WO2021098643A1 (fr) Procédé et dispositif de configuration d'accessoire dans une salle de diffusion en continu en direct, support lisible et dispositif électronique
WO2024109786A1 (fr) Procédé et appareil de traitement d'informations de session de messagerie instantanée, et dispositif électronique
CN106843932A (zh) 虚拟现实设备固件的升级方法及系统
US20150215575A1 (en) Relay apparatus
CN110413800B (zh) 一种提供小说信息的方法与设备
US20210031100A1 (en) Multipath Wireless Controller
KR102485368B1 (ko) 전자 장치, 그 제어 방법 및 컴퓨터 판독가능 기록 매체
CN113760215B (zh) 基于鸿蒙系统的多终端显示数据传输方法、设备及介质
KR102369525B1 (ko) 원격 접속을 위한 장치, 시스템 및 방법
CN111142820B (zh) 一种基于多屏的远程控制方法、装置、及系统
KR20200056557A (ko) 원격 접속을 위한 장치, 시스템 및 방법
KR20240009273A (ko) 디스플레이 장치 및 그 동작 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21888008

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21888008

Country of ref document: EP

Kind code of ref document: A1