WO2023051011A1

WO2023051011A1 - Vehicle remote interaction method and apparatus, wearable device, system, and medium

Info

Publication number: WO2023051011A1
Application number: PCT/CN2022/109090
Authority: WO
Inventors: 周洲
Original assignee: 中兴通讯股份有限公司
Priority date: 2021-09-30
Filing date: 2022-07-29
Publication date: 2023-04-06
Also published as: CN115941751A

Abstract

The present application provides a vehicle remote interaction method and apparatus, a wearable device, a system, and a medium. The method comprises: acquiring an operation instruction of a user for a target vehicle; sending an interaction signal to the target vehicle according to the operation instruction, and receiving an interaction result fed back by the target vehicle.

Description

A vehicle remote interaction method, device, wearable device, system and medium

This application claims priority to a Chinese patent application with application number 202111165530.8 filed with the China Patent Office on September 30, 2021, the entire contents of which are incorporated herein by reference.

technical field

The present application relates to the technical field of vehicle remote control, for example, to a vehicle remote interaction method, device, wearable device, system and medium.

Background technique

With the rapid development of remote control technology, the demand for remote control interaction of products is getting higher and higher, and vehicles are no exception. Vehicle remote interaction refers to the remote control interaction between the user and the vehicle. For example, the user controls the vehicle by sending instructions to the vehicle, and the vehicle can feed back vehicle-related information to the user terminal according to the user's instruction, so as to realize the remote control interaction between the user and the vehicle. . Vehicle remote interaction is widely used, which can provide convenience for users to remotely control and view vehicles.

The remote interaction method for the vehicle in the related art mainly relies on the mobile phone, but in many cases the user does not carry the mobile phone, or it is inconvenient to open the mobile phone and operate it, for example, in the state of motion, when holding other objects in the hand or When there is no mobile phone around, the user cannot remotely control the vehicle, and the convenience and flexibility of the interaction are poor.

Contents of the invention

This application provides a vehicle remote interaction method, device, wearable device, system and medium, so as to realize flexible and intelligent remote control of vehicles through wearable devices, and use wearable devices to enhance the convenience of remote interaction functions for users experience.

An embodiment of the present application provides a vehicle remote interaction method applied to wearable devices, including:

Obtain the user's operation instructions on the target vehicle;

Sending an interaction signal to the target vehicle according to the operation instruction, and receiving an interaction result fed back by the target vehicle.

The embodiment of the present application also provides a vehicle remote interaction device, including:

An instruction acquisition module is configured to acquire the user's operation instruction to the target vehicle;

An interaction module, configured to send an interaction signal to the target vehicle according to the operation instruction, and receive an interaction result fed back by the target vehicle.

The embodiment of the present application also provides a wearable device, including a communication device, a memory, a processor, and a computer program stored in the memory and operable on the processor. When the processor executes the program, the above-mentioned vehicle remote interaction method.

An embodiment of the present application also provides a vehicle remote interaction system, including: a target vehicle and the above-mentioned wearable device, where the target vehicle is connected to the wearable device in a wireless manner.

The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the above-mentioned vehicle remote interaction method is realized.

Description of drawings

Fig. 1 is a flow chart of a vehicle remote interaction method provided by an embodiment;

Fig. 2 is a flowchart of another vehicle remote interaction method provided by an embodiment;

Fig. 3 is a schematic structural diagram of a vehicle remote interaction device provided by an embodiment;

Fig. 4 is a schematic structural diagram of a vehicle remote interaction system provided by an embodiment;

Fig. 5 is a schematic diagram of a hardware structure of a wearable device provided by an embodiment.

Detailed ways

The application will be described below in conjunction with the accompanying drawings and embodiments.

Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the steps as sequential processing, many of the steps may be performed in parallel, concurrently, or simultaneously. Additionally, the order of the steps can be rearranged. The process may be terminated when its operations are complete, but may also have additional steps not included in the figure. The processing may correspond to a method, function, procedure, subroutine, subroutine, or the like.

It should be noted that concepts such as "first" and "second" mentioned in the embodiments of the present application are only used to distinguish different devices, modules, units or other objects, and are not used to limit these devices, modules, units or The sequence or interdependence of functions performed by other objects.

Fig. 1 is a flow chart of a vehicle remote interaction method provided by an embodiment. This embodiment is applicable to the situation of remote control interaction with the vehicle. Exemplarily, the vehicle remote interaction method can be executed by a vehicle remote interaction device, which can be realized by means of software and/or hardware, and integrated into a wearable device. Exemplarily, the wearable device may be an electronic device with a remote communication function and an intelligent control function, including but not limited to: a watch, a wristband and other electronic devices that can be worn on the user's body.

As shown in FIG. 1 , the vehicle remote interaction method in this embodiment includes step 110 , step 120 and step 130 .

In step 110, the user's operation instructions on the target vehicle are acquired.

In this embodiment, the target vehicle may be a vehicle bound or paired with the wearable device in advance. The operation instruction may refer to an instruction for the user to control the target vehicle or view related information of the target vehicle through the wearable device. The user's operation instruction on the target vehicle acquired by the wearable device (that is, the operation instruction for the user to trigger the remote control function of the wearable device) may include at least one of the following: voice instructions, motion instructions and touch instructions. That is to say, the wearable device can obtain the user's operation instruction on the target vehicle through at least one of three ways: voice instruction, action instruction and touch instruction, which is not limited herein.

In an embodiment, the wearable device is a watch as an example. The voice command can refer to the command sent by the user to the watch in the form of voice. The voice command can be collected by the sensor in the watch, such as the sound sensor; after receiving the voice command, the watch can trigger the corresponding The operation of controlling the target vehicle or reading information about the target vehicle.

The action command can refer to the command sent by the user to the watch through a specific action, and the action command can be sensed by a sensor in the watch, such as a motion sensor. And different specific actions can be bound to different operations. For example, the action of shaking the wrist can trigger the operation of the watch to read the relevant data of the vehicle status, the action of flicking the wrist downward can trigger the operation of the watch to remotely control the locking of the car door, and the action of flicking the wrist upward can trigger the operation of the watch. Trigger the watch to remotely control the closing of the car window, etc. On this basis, voice commands and action commands can also be used in combination with each other. For example, after shaking the wrist to trigger the watch to view vehicle status-related data, you can use the corresponding voice commands to check one or more of the vehicle status data. certain types of data.

The touch instruction may refer to an instruction sent by the user to the watch by manually touching the relevant control options on the display screen of the watch.

In this embodiment, voice commands and action commands are set to facilitate the user to trigger the remote control of the target vehicle through the wearable device, so as to solve the problem that the user cannot control the vehicle when it is inconvenient to manually operate the mobile phone, and improve the diversity and flexibility of remote control. flexibility.

In step 120, an interaction signal is sent to the target vehicle according to the operation instruction.

In this embodiment, the interaction signal may refer to the signal sent by the wearable device to control the target vehicle or view the relevant information of the target vehicle according to the user's operation instructions, such as controlling the closing of the vehicle window, or reading the relevant data of the vehicle status, etc. . Exemplarily, the wearable device can send the corresponding interaction signal to the vehicle control system of the target vehicle according to the operation instruction, and after receiving the interaction signal, the vehicle control system performs the corresponding control operation or data integration operation according to the interaction signal, and The results of the interactions performed are fed back to the wearable device.

In step 130, an interaction result fed back by the target vehicle is received.

In this embodiment, the interaction result may refer to the result fed back by the target vehicle after controlling or integrating its own state data according to the interaction signal; where the interaction result may include the result that the target vehicle executes the instruction successfully and/or the vehicle data is normal, for example, the vehicle The window is closed (that is, the target vehicle executes the command successfully), or the fuel consumption of the vehicle is within the normal range (that is, the vehicle data is normal), etc. It can also include the results of the execution command failure and/or abnormal vehicle data, such as the abnormal closing of the window (that is, failure to execute the command), or abnormal fuel consumption of the vehicle (that is, abnormal vehicle data), etc.

Exemplarily, the implementation process of the vehicle remote interaction method is as follows: when the wearable device detects that the user is in a motion state through the sensor, it can trigger its own remote interaction function and establish a connection with the target vehicle in a wireless manner; then, the wearable device The user's voice command, action command and/or touch command can be obtained; finally, the wearable device sends a corresponding interaction signal to the target vehicle according to the operation command to remotely interact with the target vehicle and receive feedback from the target vehicle Interaction results.

The vehicle remote interaction method provided in this embodiment uses the wearable device to send an interaction signal to the target vehicle, and can realize remote intelligent interaction with the target vehicle. In addition, if the user is using the mobile terminal to remotely control the vehicle, but it is inconvenient to use the mobile phone in some states, this method does not need to manually switch when the user is inconvenient, and the wearable device can automatically perform remote interaction, which enhances the user's use of remote interaction. Convenience and flexibility of the function, optional, this method can trigger the wearable device to perform remote vehicle interaction when the user is detected to be in motion, which is convenient for the user and will not cause the wearable device to be in high power consumption for a long time state.

In an embodiment, before the wearable device obtains the user's operation instruction on the target vehicle, it further includes: establishing a wireless connection with the target vehicle. For example, the wearable device can be connected to the target vehicle (vehicle control system) through a wireless transmission method such as a Subscriber Identification Module (SIM), Bluetooth, or a wireless network (Wireless Fidelity, WIFI). In addition, the process of establishing the connection for the first time may include: Bluetooth pairing between the wearable device and the target vehicle, authentication between the wearable device and the target vehicle through a password or a verification code, or the wearable device sending a connection request to the target vehicle and waiting Target vehicle authorization, etc.

In an embodiment, before obtaining the user's operation instruction on the target vehicle, in order to avoid the user's false touch during the exercise, the wearable device can be preset with a method of preventing false touch, for example, for the touch command, you can set It is specified that the user needs to press and hold the button on the screen for 2 seconds or double-click to be effective; as for voice commands, it can be set that the detected user voice commands need to include specified words or clear command words, etc.

In an embodiment, obtaining the user's operation instruction for the target vehicle includes: displaying a list of operation instructions and an instruction selection control through a user interface, wherein the operation instruction includes at least one of the following: vehicle control instructions; vehicle data viewing instructions; The user selects the instruction selection control to determine the operation instruction for the target vehicle.

In this embodiment, the user interface mainly refers to the display screen interface of the wearable device. The list of operation instructions may refer to a table displaying information corresponding to the operation instructions. The instruction selection control may refer to buttons or icons such as up, down, left, right, page turning, confirmation, exit, and close, and the instruction selection control may be set to select and control related information in the list of operation instructions. The list of operation instructions and the instruction selection control can be displayed in the user interface at the same time, and the displayed position and size of the list of operation instructions and the instruction selection control are not limited here.

The operation instruction includes at least one of a vehicle control instruction and a vehicle data viewing instruction. Among them, the vehicle control command can refer to the command to control the target vehicle, such as the command to control the opening or closing of the car window, the opening or closing of the air conditioner, the locking or unlocking of the car door, and the playing or closing of the car music; the command of viewing the vehicle data can refer to viewing the basic information of the vehicle Instructions related to vehicle status data, such as viewing the vehicle name, fuel consumption, and mileage.

The selection operation may refer to an operation in which the user selects an instruction selection control in the display screen interface by manual touch, voice instruction and/or specific action. In this embodiment, the wearable device can obtain the user's operation instruction to the target vehicle according to the user's selection operation on the instruction selection control.

In an embodiment, it is taken that the operation instruction includes a vehicle control instruction and a vehicle data viewing instruction, and the selection operation includes a touch operation as an example. The left block in the user interface can be used to display a list of operation instructions, and the list of operation instructions shows two options of vehicle control instructions and vehicle data viewing instructions; the right block can be used to display instruction selection controls. By clicking on the specific instruction selection control, the user can choose to enter the next display page of the vehicle control instruction or the vehicle data viewing instruction. Options such as car window closing; or options such as car windows, air conditioning, and music can also be displayed. After selecting the corresponding option through the command selection control, a window will pop up, and the window displays open, close, rise, fall, increase and decrease. and other options, and car windows, air conditioners, music, etc. can correspond to different display windows. For example, the pop-up window corresponding to the car window can include open, close, rise and fall options, and the user can select the control through the command selection. On this basis, the wearable device can determine the corresponding operation instruction to the target vehicle according to the user's selection operation on the instruction selection control. It should be noted that the list of operation instructions can also directly display the specific operation instructions corresponding to the vehicle control instruction and the vehicle data viewing instruction, for example, it can directly display options such as window opening and window closing, which is not limited here.

In an embodiment, in response to an abnormal interaction result, an alarm prompt tone is played, wherein the interaction result includes at least one of the following: execution result data; vehicle data.

In this embodiment, the interaction result includes at least one of the following: execution result data, including the execution result fed back to the wearable device after the target vehicle performs the corresponding operation according to the control instruction corresponding to the interaction signal; vehicle data, including the execution result fed back to the wearable device by the target vehicle The basic information of the vehicle fed back by the device (such as license plate number, model and location information, etc.) Abnormal interaction results can refer to failure to execute at least one command, failure to view vehicle data, or abnormal basic information or related status of the vehicle, such as abnormal closing of windows, unlocked doors, or abnormal fuel consumption.

In an embodiment, for an abnormal interaction result, the wearable device can play a corresponding alarm sound in voice form to remind the user; it can also display corresponding abnormal data information on the display screen. It should be noted that it is more convenient to play the alarm prompt tone by voice than the display mode during the user's exercise, and it will not affect the user's exercise. Therefore, in this embodiment, the voice broadcast and the display screen display can be used Combined ways to remind the user, which is not limited here.

In an embodiment, the method further includes: detecting a state of the user, wherein the state includes an exercise state or a non-exercise state; and the state is detected by at least two sensors.

In this embodiment, the sensor installed on the wearable device and used to detect the user's state (that is, the state of exercise or non-exercise) can be a human body temperature sensor (because the body temperature will rise to a certain extent during the movement of the human body, through the human body measurement A temperature sensor can detect whether the user is in a state of motion), a heart rate sensor, a pulse sensor, an acceleration sensor (through the vibration signal generated by the human body to sense the acceleration of the human body, so as to determine whether the user is in a state of motion) and/or a three-axis gyroscope (by measuring the angular velocity to determine the state of motion of the human body, also known as a motion sensor) and so on. In this embodiment, at least two sensors are combined to detect the user's state, which can effectively avoid misjudgment of the user's state and improve the accuracy of user state detection. On this basis, it can be determined whether to enable the remote interaction function of the wearable device according to the state of the user. For example, when it is detected that the user is in motion, the wearable device starts the remote interaction function, and detects the user's voice, motion, touch and other behaviors in real time to obtain the user's operation instructions for the target vehicle; while the user is not in motion state, the wearable device can turn off the remote interaction function without waiting for the user's operation instruction. By detecting the user's motion status to trigger the wearable device to perform remote interaction with the vehicle, it is convenient for the user and will not keep the wearable device in a high power consumption state for a long time, taking into account the user experience and power consumption performance.

In one embodiment, a combination of two sensors is used to detect user status as an example. In order to avoid misjudgment of the user's state, it can be determined that the user is in the state of motion after the relevant data monitored by the two sensors conforms to the motion state and lasts for more than a preset time (such as 5 seconds), and the preset time is not set here. or it may also be determined that the user is in a state of motion when the motions sensed by the two sensors maintain a specific regularity within a preset time (such as 10 seconds). Here, there is no limitation on how to determine that the user is in an exercise state and the setting of each preset time.

In an embodiment, before acquiring the user's operation instruction on the target vehicle, it further includes: verifying the user's interaction authority through a facial recognition device, and the interaction authority includes at least one of vehicle control authority and vehicle data viewing authority.

In this embodiment, the interaction authority may refer to whether the user has the authority to interact with the target vehicle, and the interaction authority includes vehicle control authority and/or vehicle data viewing authority. Among them, the user of the wearable device that has been bound to the target vehicle in advance must have the authority to interact with the target vehicle, and the verification of the interaction authority is mainly to ensure the safety of the interaction process. The binding method can be a combination of account binding and facial recognition binding. When the user is verifying the interaction authority, the interaction authority can be verified not only through the face recognition device on the wearable device, but also by inputting the account number through the display screen.

In an embodiment, the interaction authority can also be graded, and people with different identities can be preset to have different interaction authority levels when binding; the levels can be divided into two types: having vehicle control authority and vehicle data viewing Authority, only has the authority to view vehicle data. For example, the car owner has both the vehicle control authority and the vehicle data viewing authority; while the car owner's family and friends only have the vehicle data viewing authority. It should be noted that if the facial recognition binding method is adopted, the car owner can set that only his own facial recognition can have both vehicle control authority and vehicle data viewing authority during pre-binding, and other people's facial recognition can only trigger vehicle data. View permissions; if the account binding method is used, since there is only one account related to the target vehicle for security reasons, the owner can set a separate password that triggers the vehicle control authority during pre-binding to avoid entering the account by someone else Two commands will also be triggered at the same time.

In an embodiment, after receiving the interaction result fed back by the target vehicle, it further includes: detecting the user's line of sight position through the line of sight detection device; and displaying the interaction result in response to the line of sight position falling within the screen range of the wearable device.

In this embodiment, during exercise (such as running), the user will not keep staring at the wearable device and wait to check the interaction result. If the wearable device keeps displaying the interaction result until the user finishes checking it, it will cause unnecessary functions. Therefore, in order to save the power of the wearable device, a line-of-sight detection device can be set on the wearable device, and the line-of-sight detection device is set to detect the line-of-sight position of the user. Exemplarily, if the line of sight falls within the screen range of the wearable device, the display screen displays the interaction result for the user to view. Set the time (such as 5 seconds, which is not limited here), then turn off the display screen.

In one embodiment, the sight detection device can be a pinhole camera with a small footprint, which can be installed on one side of the display screen, so as to detect whether the user's sight position is in line with the characteristics of viewing the interaction results on the screen. When detecting the line of sight position through the pinhole camera, the position of the user's eye or pupil is determined according to the captured image, and then the user's eye can be determined according to the relative position information between the position of the eye or pupil and the wearable device. Or the angle information between the pupil and the display screen of the wearable device, based on which, it can be determined whether the user's line of sight falls within the screen range of the wearable device according to the angle information. The form of the line of sight detection device is not limited here.

In an embodiment, some sensors can also be used to assist the pinhole camera to determine the line of sight position. For example, according to the height of the user, when it is detected that the user raises the wrist to the range near the height of the eye, it can be considered that the user wants to view the interaction result on the screen. .

In an embodiment, in addition to displaying the interaction result on the screen, after the wearable device receives the interaction result fed back by the target vehicle, it can automatically announce the content of the interaction result by voice, so as not to disturb the user's movement. On this basis, if the user still wants to view the interaction result again after the voice broadcast is over, then within the preset time (for example, within 5 seconds, there is no limit to this here, but it should be noted that the preset time is not appropriate is too long, so as not to affect the subsequent user's operation instructions), when it is detected that the user's line of sight falls within the range of the wearable device, the previous interaction results can be displayed again on the screen for the user to view.

Fig. 2 is a flow chart of another vehicle remote interaction method provided by an embodiment. As shown in Figure 2, the method provided in this embodiment includes:

Step 210: verify the user's interaction authority through the facial recognition device, the interaction authority includes vehicle control authority and/or vehicle data viewing authority.

In this embodiment, the facial recognition device can be used to first verify whether the user is the owner of the car, and then determine the corresponding interaction authority according to the verification result.

Step 220: Detect the state of the user through at least two sensors.

In this embodiment, the state of the user can be detected by at least two sensors.

Step 230: Determine whether the state of the user is an exercise state, if the state of the user is an exercise state, execute step 240; if the state of the user is not an exercise state, repeat step 220 until it is detected that the user is in an exercise state In motion state, go to step 240 again.

In this embodiment, the state of the user includes an exercise state or a non-exercise state. If it is detected that the user is currently in motion, the wearable device can obtain the user's operation instructions for the target vehicle.

Step 240: Displaying a list of operation instructions and an instruction selection control through the user interface, wherein the operation instructions include at least one of the following: a vehicle control instruction; a vehicle data viewing instruction.

In this embodiment, a list of operation instructions and an instruction selection control are displayed through a display screen interface of the wearable device. It should be noted that the list of operation instructions can be displayed according to the determined interaction authority. For example, if the interaction authority determined by the facial recognition device is vehicle control authority and vehicle data viewing authority, the list of operation instructions can be displayed These two corresponding instructions; if the determined interaction authority is the vehicle data viewing authority, then the list of operating instructions only displays the corresponding instruction for vehicle data viewing.

Step 250: Determine the operation instruction to the target vehicle according to the user's selection operation on the instruction selection control.

In this embodiment, the wearable device determines the operation instruction for the target vehicle according to the user's selection operation on the instruction selection control.

Step 260: Send an interaction signal to the target vehicle according to the operation instruction, and receive an interaction result fed back by the target vehicle.

In this embodiment, the wearable device sends an interaction signal to the target vehicle according to the operation instruction, and then the target vehicle performs a corresponding operation according to the received interaction signal, and finally the wearable device receives the interaction result fed back by the target vehicle.

Step 270: Detect the position of the user's line of sight through the line of sight detection device.

In this embodiment, after receiving the interaction result, the wearable device detects whether the user's line of sight is within the scope of its own display screen through the line of sight detection device.

In an embodiment, the received interaction result may also be broadcast in voice form.

Step 280: Determine whether the line of sight falls within the screen range of the wearable device. If the line of sight falls within the screen range of the wearable device, execute step 290; if the line of sight does not fall within the screen range of the wearable device, repeat step 280 , so that when it is detected that the line of sight falls within the screen range of the wearable device, the interaction result can be displayed in time for the user to view.

Step 290: Display the interaction result.

In one embodiment, if the interaction result is abnormal, an alarm sound is played to remind the user without affecting the user's movement. If there is no abnormal data in the interaction result, the interaction result can be played automatically by voice or according to the user's voice command when the user does not want to stop to check the display screen.

The vehicle remote interaction method provided in this embodiment, through the setting of the interaction authority, avoids the situation that other people except the owner control the vehicle at will, and improves the security of the vehicle interaction; detects the state of the user through at least two sensors , can improve the accuracy of user state detection; detect whether the user's line of sight position is within the display screen through the line of sight detection device, and then determine whether to display the interaction result, can effectively avoid unnecessary power consumption, and facilitate the user to view the interaction result in real time; through The way of displaying the results on the display screen or voice broadcast can improve the flexibility and selection diversity of the display mode, and the voice broadcast form will not affect the user's movement, which can improve the user's experience of remote interaction with the vehicle during the movement. In addition, this method can also automatically trigger the remote interaction function of the wearable device when the user's motion state is detected, without manual switching, which not only enhances the convenience and flexibility of the user's use of the remote interaction function, but also does not make the wearable device long-term in a high power state.

The embodiment of the present application also provides a vehicle remote interaction device. Fig. 3 is a schematic structural diagram of a vehicle remote interaction device provided by an embodiment. As shown in Figure 3, the device includes:

Instruction acquisition module 310, configured to acquire the user's operation instruction to the target vehicle;

The interaction module 320 is configured to send an interaction signal to the target vehicle according to the operation instruction, and receive an interaction result fed back by the target vehicle.

The vehicle remote interaction device of this embodiment uses the wearable device to send interaction signals to the target vehicle, which can realize remote intelligent interaction with the target vehicle, and even if the user originally uses a mobile phone terminal to remotely control the vehicle, the user can still control the vehicle when the user is in motion. Without manual switching, the wearable device can automatically detect the user's motion state and automatically turn on the remote interaction function, which enhances the convenience and flexibility of the user's use of the remote interaction function; The remote interaction of the wearable device with the vehicle can not only facilitate the user's use, but also prevent the wearable device from being in a high power consumption state for a long time.

In one embodiment, the command acquisition module 310 includes:

The display unit is configured to display a list of operation instructions and an instruction selection control through a user interface, wherein the operation instructions include at least one of the following: vehicle control instructions; vehicle data viewing instructions;

The instruction determining unit is configured to determine the operation instruction for the target vehicle according to the user's selection operation on the instruction selection control.

In one embodiment, the device also includes:

The prompt sound playing module is configured to play an alarm prompt sound when the interaction result is abnormal, wherein the interaction result includes at least one of the following: execution result data; vehicle data.

In an embodiment, before obtaining the user's operation instruction on the target vehicle, the device further includes:

The state detection module is configured to detect the state of the user, wherein the state includes an exercise state or a non-exercise state; the state is detected by at least two sensors.

In an embodiment, after receiving the interaction result fed back by the target vehicle, the device further includes:

The position detection module is configured to detect the position of the user's line of sight through the line of sight detection device;

The result display module is configured to display the interaction result in response to the line of sight falling within the screen range of the wearable device.

The authority verification module is configured to verify the user's interaction authority through a facial recognition device, and the interaction authority includes vehicle control authority and/or vehicle data viewing authority.

In one embodiment, the interaction module 320 includes: a vehicle control unit and a data viewing unit;

Wherein, the vehicle control unit may include an air conditioner switch subunit, a music switch subunit, a door lock or unlock subunit, and a window switch subunit;

The data viewing unit may include a mileage viewing subunit, a fuel consumption viewing subunit, and the like.

The vehicle remote interaction device proposed in this embodiment and the vehicle remote interaction method proposed in the above embodiments belong to the same inventive concept, and technical details not described in detail in this embodiment can be referred to any of the above embodiments.

The embodiment of the present application also provides a vehicle remote interaction system. Fig. 4 is a schematic structural diagram of a vehicle remote interaction system provided by an embodiment. As shown in Fig. 4, the system includes: a target vehicle 420 and a wearable device 410, and the target vehicle 420 is connected to the wearable device 410 in a wireless manner .

The vehicle remote interaction system of this embodiment uses the wearable device to send interaction signals to the target vehicle, which can realize remote intelligent interaction with the target vehicle, and even if the user originally uses a mobile phone terminal to remotely control the vehicle, the user can still control the vehicle when the user is in motion. Without manual switching, the wearable device can automatically detect the user's motion status and automatically turn on the remote interaction function, which enhances the convenience and flexibility of the user's use of the remote interaction function. In addition, the method can trigger the wearable device to perform remote interaction with the vehicle when the user's motion state is detected, which is convenient for the user and does not keep the wearable device in a high power consumption state for a long time.

In one embodiment, target vehicle 420 includes:

An instruction receiving module is configured to receive an operation instruction sent by the wearable device when the user is in a state of motion;

The vehicle data collection module is configured to collect data related to vehicle conditions;

An instruction execution module is configured to perform corresponding operations according to the received operation instructions;

The transmission module is configured to feed back the interaction result to the wearable device.

In an embodiment, the target vehicle 420 may further include: an authority management module, which is configured to manage vehicle control authority and/or vehicle data viewing authority according to the interaction authority result fed back by the wearable device, so as to improve vehicle interaction safety.

The embodiment of the present application also provides a wearable device. FIG. 5 is a schematic diagram of the hardware structure of a wearable device provided by an embodiment. As shown in FIG. 5 , the wearable device provided by the present application includes a processor 510, a memory 520, and a The computer program running on 510 also includes a communication device 530 , and the above-mentioned vehicle remote interaction method is realized when the processor 510 executes the program.

There may be at least one processor 510 in the wearable device, and a processor 510 is taken as an example in FIG. 5; the memory 520 is set to store at least one program; The at least one processor 510 implements the vehicle remote interaction method described in the embodiment of the present application.

The wearable device also includes: an input device 540 and an output device 550 .

Optionally, the wearable device may further include: a face recognition device and a line of sight detection device.

The processor 510, the memory 520, the communication device 530, the input device 540 and the output device 550 in the wearable device may be connected through a bus or in other ways. In FIG. 5, connection through a bus is taken as an example.

The input device 540 can be configured to receive input digital or character information, and generate key signal input related to user settings and function control of the wearable device. The output device 550 may include a display device such as a display screen.

Communications device 530 may include a receiver and a transmitter. The communication device 530 is configured to perform information sending and receiving communication according to the control of the processor 510 .

The wearable device can also include a core component 560, which can refer to a printed circuit board (Printed Circuit Boards, PCB) integrated with various electronic components, and the core component 560 can be set to control the wearable device. Running, providing the clock, alarm clock, stopwatch and other functions of the watch.

The memory 520, as a computer-readable storage medium, can be set to store software programs, computer-executable programs and modules, such as the program instructions/modules corresponding to the vehicle remote interaction method described in the embodiment of the present application (for example, in the vehicle remote interaction device instruction acquisition module 310 and interaction module 320). The memory 520 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the test equipment, and the like. In addition, the memory 520 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage devices. In some examples, memory 520 may include memory located remotely from processor 510, and such remote memory may be connected to the wearable device through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the vehicle remote interaction method described in any one of the embodiments of the present application is implemented . The method includes: acquiring a user's operation instruction to the target vehicle; sending an interaction signal to the target vehicle according to the operation instruction, and receiving an interaction result fed back by the target vehicle.

The computer storage medium in the embodiments of the present application may use any combination of at least one computer-readable medium. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer-readable storage medium may be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: electrical connections having at least one lead, portable computer disks, hard disks, Random Access Memory (RAM), Read Only Memory (Read Only) Only Memory, ROM), Erasable Programmable Read Only Memory (Erasable Programmable Read Only Memory, EPROM), flash memory, optical fiber, portable CD-ROM (Compact Disc Read-Only Memory, CD-ROM), optical storage devices, magnetic A storage device, or any suitable combination of the above. A computer readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a data signal carrying computer readable program code in baseband or as part of a carrier wave. Such propagated data signals may take many forms, including but not limited to: electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. .

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wires, optical cables, radio frequency (Radio Frequency, RF), etc., or any suitable combination of the above.

Computer program codes for performing the operations of the present application may be written in one or more programming languages or combinations thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional A procedural programming language, such as the "C" language or similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or it may be connected to an external computer such as use an Internet service provider to connect via the Internet).

Those skilled in the art will understand that the term user terminal covers any suitable type of wireless user equipment, such as a mobile phone, a portable data processing device, a portable web browser or a vehicle-mounted mobile station.

In general, the various embodiments of the present application can be implemented in hardware or special purpose circuits, software, logic or any combination thereof. For example, some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software, which may be executed by a controller, microprocessor or other computing device, although the application is not limited thereto.

The embodiments of the present application may be implemented by a data processor of a mobile device executing computer program instructions, for example in a processor entity, or by hardware, or by a combination of software and hardware. Computer program instructions may be assembly instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or written in any combination of one or more programming languages source or object code.

Any logic flow block diagrams in the drawings of the present application may represent program steps, or may represent interconnected logic circuits, modules and functions, or may represent a combination of program steps and logic circuits, modules and functions. Computer programs can be stored on memory. The memory may be of any type suitable for the local technical environment and may be implemented using any suitable data storage technology, such as but not limited to Read-Only Memory (ROM), Random Access Memory (RAM), Optical Memory devices and systems (Digital Video Disc (DVD) or Compact Disk (CD), etc. Computer-readable media may include non-transitory storage media. Data processors may be any Types, such as but not limited to general-purpose computers, special-purpose computers, microprocessors, digital signal processors (Digital Signal Processing, DSP), application-specific integrated circuits (Application Specific Integrated Circuit, ASIC), programmable logic devices (Field-Programmable Gate Array , FPGA) and processors based on multi-core processor architectures.

Claims

A vehicle remote interaction method applied to a wearable device, the method comprising:

Obtain the user's operation instructions on the target vehicle;

Sending an interaction signal to the target vehicle according to the operation instruction, and receiving an interaction result fed back by the target vehicle.
The method according to claim 1, wherein obtaining the user's operation instruction on the target vehicle comprises:

A list of operation instructions and an instruction selection control are displayed through a user interface, wherein the operation instructions include at least one of the following: vehicle control instructions; vehicle data viewing instructions;

The operation instruction to the target vehicle is determined according to the selection operation of the instruction selection control by the user.
The method of claim 2, further comprising:

In response to the abnormality of the interaction result, an alarm sound is played, wherein the interaction result includes at least one of the following: execution result data; vehicle data.
The method according to claim 1, further comprising:

Detecting the state of the user, wherein the state includes an exercise state or a non-exercise state; the state is detected by at least two sensors.
The method according to claim 1, after receiving the interaction result fed back by the target vehicle, further comprising:

Detect the user's line of sight position through the line of sight detection device;

In response to the line of sight position falling within the screen range of the wearable device, the interaction result is displayed.
According to the method according to claim 1, before acquiring the user's operation instruction to the target vehicle, further comprising:

The interaction authority of the user is verified by a facial recognition device, and the interaction authority includes at least one of vehicle control authority and vehicle data viewing authority.
A vehicle remote interaction device, comprising:

An instruction acquisition module (310), configured to acquire the user's operation instruction to the target vehicle;

An interaction module (320), configured to send an interaction signal to the target vehicle according to the operation instruction, and receive an interaction result fed back by the target vehicle.
A wearable device, comprising a communication device (530), a memory (520), a processor (510), and a computer program stored on the memory (520) and operable on the processor (510), the processor ( 510) Implementing the vehicle remote interaction method according to any one of claims 1-6 when executing the computer program.
A vehicle remote interaction system, comprising: a target vehicle (420) and the wearable device (410) according to claim 8;

The target vehicle (420) is wirelessly connected with the wearable device (410).
A computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the vehicle remote interaction method according to any one of claims 1-6 is implemented.