TWI823211B - Vehicle communication system and method - Google Patents

Abstract

This application discloses a vehicle communication system and method. The system comprises: a control module, a communication module, a judgment module and an action acquisition module. The communication module is communicatively connected to the mobile terminal, and the communication module is configured for communicatively connecting the mobile terminal to the vehicle communication system. The action acquisition module is configured for obtaining a user action information after the mobile terminal receives a voice information. The judgment module is configured judging the sound source output device according to the action information. The control module is configured for controlling the output of the voice information to the judged sound source output device.

Description

Vehicle communication system and method

The present application relates to the technical field of safe driving, and in particular to a vehicle communication system and method.

With the development of the economy and the advancement of science and technology, automobiles, as a common means of transportation, are becoming more and more popular in people's lives. Whether a driver is attentive when driving a vehicle has a serious impact on safe driving. Therefore, driver distraction should be avoided as much as possible. Drivers may encounter incoming calls or voice messages while driving and may need to answer or respond. Currently, the process for drivers to answer or reply to messages while driving is relatively complicated, which can cause drivers to be distracted and unable to understand road conditions in a timely manner, which may lead to accidents.

In view of this, this application provides a vehicle communication system and method. The driver's intention can be obtained through the action acquisition module, and the sound source of the mobile terminal can be switched according to the driver's intention.

The vehicle communication system of this application includes: a control module, a communication module, a judgment module and an action acquisition module; the communication module is connected to a mobile terminal, and the communication module is used to connect the mobile terminal to communication to the vehicle communication system; the action acquisition module is used to acquire the user's action information after the mobile terminal receives the voice information; the judgment module is used to obtain the user's action information according to the action As an information judgment sound source output device; the control module is used to control the output of the voice information to the judged sound source output device.

The vehicle communication method of the present application is applied to the vehicle communication system as mentioned above, including: communicating with the mobile terminal and the vehicle communication system; after the mobile terminal receives the voice information, obtains the user's action information; Determine the sound source output device according to the action information; control the output of the voice information to the judged sound source output device.

10;10a: Vehicle communication system

100:Control module

200:Communication module

300:Judgement module

400: Action acquisition module

410:Camera

500:Audio module

600: Communication module

700:Wireless headphones

800:Wired headphones

20;20a: mobile terminal

Figure 1 is a schematic diagram of a vehicle communication system module provided by an embodiment of the present application.

FIG. 2 is a schematic diagram of a vehicle communication system module provided by another embodiment of the present application.

FIG. 3 is a schematic flowchart of a vehicle communication method provided by an embodiment of the present application.

In order to understand the above objects, features and advantages of the present application more clearly, the present application will be described in detail below with reference to the accompanying drawings and specific embodiments. It should be noted that, as long as there is no conflict, the embodiments of the present application and the features in the embodiments can be combined with each other. Many specific details are set forth in the following description to facilitate a full understanding of the present application. The described embodiments are only some, not all, of the embodiments of the present application.

It should be noted that although a logical sequence is shown in the flowchart, in some cases, the steps shown or described may be performed in a sequence different from that in the flowchart. The methods disclosed in the embodiments of this application include one or a plurality of steps or actions for implementing the method. Method steps and/or actions may be interchanged with each other without departing from the scope of the claims. In other words, unless a specific step or action is specified order, otherwise the order and/or use of specific steps and/or actions may be modified without departing from the scope of the request.

Below, some embodiments of the application will be described in detail with reference to the accompanying drawings. The following embodiments and features in the embodiments may be combined with each other unless there is any conflict.

With the development of the economy and the advancement of science and technology, automobiles, as a common means of transportation, are becoming more and more popular in people's lives. Whether a driver is attentive when driving a vehicle has a serious impact on safe driving. Therefore, driver distraction should be avoided as much as possible. Drivers may encounter incoming calls or voice messages while driving and may need to answer or respond. The driver's process of answering or replying to messages while driving is relatively complicated, which will cause the driver to be distracted and unable to understand the road conditions in a timely manner, which may lead to accidents.

Currently, when driving, drivers often connect their mobile terminals to their cars to use the car speakers to play music or navigation information. When the mobile terminal receives a call or voice message, the car audio can be used for sound amplification. When there are other people in the car, playing incoming calls or voice messages directly through the car audio may affect the driver's privacy. Therefore, the driver may need to switch the audio source to headphones to avoid privacy leaks.

The vehicle communication system and method provided by the embodiments of the present application can obtain the driver's intention through the action acquisition module, and switch the sound source of the mobile terminal according to the driver's intention.

Below, some embodiments of the application will be described in detail with reference to the accompanying drawings. The following embodiments and features in the embodiments may be combined with each other unless there is any conflict.

FIG. 1 is a schematic module diagram of a vehicle communication system 10 provided by an embodiment of the present application. As shown in FIG. 1 , the vehicle communication system 10 includes: a control module 100 , a communication module 200 , a judgment module 300 and an action acquisition module 400 .

It can be understood that the communication module 200 is connected to the mobile terminal 20 . The communication module 200 is used to transmit interactive information between the mobile terminal 20 and the vehicle communication system 10, and to transmit interactive information between the control module 100 and the action acquisition module 400.

It can be understood that the communication module 200 can communicate with the mobile terminal 20 through wireless communication technology and the network. The wireless communication technology may include Bluetooth (BLE), Vehicle to Everything (V2X), global system for mobile communications (GSM), general packet radio service (GPRS) , code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA) , long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technology, etc.

It can be understood that the control module 100 controls the action acquisition module 400 to acquire the user's action information after the mobile terminal 200 receives the voice information.

It can be understood that voice information may include phone calls, voice calls on instant messaging software, voice messages (Voice Message Service, VMS), etc.

Exemplary instant messaging software may include WeChat, QQ, WhatsApp, iMessage, LINE, SKYPE, Viber, Facebook Messenger, etc.

Exemplary voice information may also be messages containing voice such as audio conference or video conference connection.

In some embodiments, if the mobile terminal 20 includes a text-to-speech conversion function, the voice message may also include text messages, such as short message (Short Message Service, SMS), multimedia message (Multimedia Messaging Service, MMS), and instant messaging software. News etc. When the voice message is a text message, the mobile terminal 20 can play the corresponding voice message by reading the text message.

It can be understood that the motion acquisition module 400 includes one or more cameras to collect motion information of users in the vehicle. It can be understood that the motion acquisition module 400 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) photoelectric transistor. In some embodiments, the vehicle communication system 10 may include 1 or N action acquisition modules 400, where N is a positive integer greater than 1.

Exemplary user action information may include the user's mouth shape, gestures, body movements, etc. The control module 100 can obtain the corresponding sound source output type after the action acquisition module 400 recognizes a specific mouth shape, a specific gesture, or a specific body movement. It can be understood that the audio source output types include: wired headphones, wireless headphones and car audio sources. And transmit the corresponding audio source output type to the control module 100, so that the control module 100 switches the output audio source of the mobile terminal 20 to the corresponding audio source to output voice information according to the audio source output type. It can be understood that the specific mouth shape includes the mouth shape corresponding to wired earphones, wireless earphones and car audio sources or the mouth shape corresponding to the number. It can be understood that specific gestures include but are not limited to raising hands, waving, raising fingers, crossing fingers, etc. Specific body movements include actions such as picking up headphones and putting on headphones.

It can be understood that wired headphones, wireless headphones and car audio sources all include microphones and speakers for voice playback and collection.

It can be understood that the action acquisition module 400 can be a driver monitoring system (Driver Monitoring System, DMS). An exemplary DMS is a car safety system that can also obtain the driver's expression, emotion or action and the driver's status as feedback through one or more cameras, and play warning messages through the vehicle audio source. For example, when the driver blinks frequently, it is determined that the driver may be at risk of fatigue driving, and a prompt message is played through the car audio source, such as, "You have entered a fatigue driving state, please take a rest in time", etc.

The following takes the action acquisition module 400 as a DMS, the audio source output types include: wired earphones, wireless earphones and vehicle audio sources, and the vehicle communication system 10 and the mobile terminal 20 are connected through Bluetooth as an example to describe the vehicle communication system 10 provided by this application. the workflow.

The vehicle communication system 10 is automatically activated after the driver starts the vehicle. After the vehicle communication system 10 is started, the control module 100 controls the communication module 200 to connect to the mobile terminal 20 using Bluetooth technology, and play music or navigation information and other sounds through the vehicle audio source. If the vehicle communication system 10 cannot connect to the mobile terminal 20, the vehicle communication system 10 enters a standby state and retryes to connect to the mobile terminal 20 after a certain period of time.

After the communication module 200 is connected to the mobile terminal 20 via Bluetooth, the control module 100 continues to monitor whether there is an incoming call from the mobile terminal 20 . If there is an incoming call on the mobile terminal 20, the control module 100 identifies the driver's action information through the DMS. If the DMS recognizes the driver's action of taking the earphones and wearing the earphones, the determination module 300 further determines whether the earphones worn by the driver are wireless earphones or wired earphones. If the headset worn by the driver is a wireless headset, such as a Bluetooth headset, the control module 100 switches the audio source output of the mobile terminal 20 to the wireless headset and automatically answers the incoming call.

If the earphone worn by the driver is a wired earphone, the control module 100 directly controls the mobile terminal 20 to automatically answer the incoming call through the wired earphone.

It can be understood that if the control module 100 is equipped with an automatic answering function or an automatic voice information playing function, and the mobile terminal 20 has answered the call function or played voice through the vehicle audio source, the control module 100 detects driving when the action acquisition module 400 After the operator takes the earphone, the control module 100 automatically switches the mobile terminal 20 to answer calls or play voice to the earphone.

It can be understood that the determination module 300 is also used to determine whether the audio source output type is a wireless headset. If the sound source output type is the wireless earphone, the determination module 300 further determines whether the mobile terminal 20 is successfully connected to the wireless earphone. If the mobile terminal 20 is successfully connected to the wireless headset, the control module 100 controls The mobile terminal 20 is controlled to automatically play or answer the voice information. If the mobile terminal 20 fails to successfully connect to the wireless headset, the control module 100 controls the mobile terminal 20 to switch to the vehicle audio source.

It can be understood that the control module 100 is also used to determine whether the wireless headset or wired headset can normally play the voice information when the mobile terminal 20 automatically plays or receives voice information through the wireless headset or wired headset. If the wireless headset or wired headset cannot play the voice information normally, the mobile terminal is controlled to switch to the car audio source.

FIG. 2 is a schematic diagram of a module of a vehicle communication system 10a and a mobile terminal 20a provided by another embodiment of the present application. Compared with the vehicle communication system 10 shown in Figure 1, the vehicle communication system 10a shown in Figure 2 also includes: an audio module 500, and a camera 410 is also provided in the action acquisition module 400. Compared with the mobile terminal 20 shown in FIG. 1 , the mobile terminal 20 a shown in FIG. 2 also includes: a communication module 600 , a wireless headset 700 and a wired headset 800 .

It can be understood that the camera 410 in Figure 2 can be a camera in the DMS, and the number of cameras 410 can be one or more, and this application does not limit this.

It can be understood that the audio module 500 includes devices such as a microphone and a speaker, so as to play voice information and collect voice information through the microphone when performing a call answering function or playing voice.

It can be understood that the communication module 600 in the mobile terminal 20a shown in FIG. 2 can be a Bluetooth module, so that the mobile terminal 20a can be connected to the communication module 200 in the vehicle communication system 10a through the communication module 600. Or wireless headphones 700.

The mobile terminal 20a in the exemplary FIG. 2 is connected to both the wireless earphone 700 and the wired earphone 800. In some embodiments, the mobile terminal 20a may only be connected to the wireless earphone 700 or the wired earphone 800, or not connected to the earphone. In some embodiments, the mobile terminal 20a may be connected to the wireless headset 700 or the wired headset 800 before receiving the voice information, or may be connected to the wireless headset 700 or the wired headset 800 after receiving the voice information.

FIG. 3 is a schematic flowchart of a vehicle communication method provided by an embodiment of the present application. The vehicle communication method is applied to the vehicle communication system 10 shown in FIG. 1 .

The following uses the vehicle communication system 10 as an example to describe the vehicle communication method provided by the embodiment of the present application. In-vehicle communication methods include:

S100: Communication connects mobile terminals and vehicle communication systems.

It can be understood that in step S100, the control module 100 can communicate with the mobile terminal 20 and the vehicle communication system 10 through the communication module 200. Please refer to Figure 1 and its related description for the specific connection method, which will not be described again.

S200: After the mobile terminal receives the voice information, obtain the user's action information.

It can be understood that in step S200, the control module 100 can obtain the user's action information through the action acquisition module 400 after the mobile terminal 20 receives the voice information. Please refer to Figure 1 and its related description for the specific acquisition method. , which will not be described again here.

S300: Determine the audio source output device based on the motion information.

It can be understood that in step S300, the control module 100 can determine the corresponding sound source output device according to the action information obtained by the action acquisition module 400 through the judgment module 400. Please refer to Figure 1 and its related description for the specific acquisition method. , which will not be described again here.

S400: Control the output of voice information to the determined audio source output device.

It can be understood that in step S400, the control module 100 can switch the mobile terminal 20 to the corresponding sound source to output voice information according to the sound source output device. Please refer to Figure 1 and its related description for the specific switching method, which will not be described again here.

It can be understood that the vehicle communication method provided by the embodiment of the present application can also be applied to the vehicle communication system 10a shown in Figure 2. When the vehicle communication system 10a performs the vehicle communication method, please refer to Figures 1, 2 and their related descriptions. This will not be described again. The embodiments of the present application have been described in detail in conjunction with the accompanying drawings, but the present application is not limited to the above embodiments. Various changes can be made within the scope of knowledge without departing from the purpose of this application. In addition, the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

10: Vehicle communication system

100:Control module

200:Communication module

300:Judgement module

400: Action acquisition module

20:Mobile terminal

Claims (8)

A vehicle-mounted communication system, which is improved in that it includes: a control module, a communication module, a judgment module and an action acquisition module; the communication module is connected to a mobile terminal through communication, and the communication module is used to connect the mobile terminal to The communication is connected to the vehicle communication system; the action acquisition module is used to acquire the user's action information after the mobile terminal receives the voice information; the determination module is used to determine the audio source output device according to the action information , the sound source output device includes: wired earphones, wireless earphones and car audio sources; when the action information includes at least one of earphone taking action information, earphone wearing action information, and earphone answering action information, the determination module determines that the The sound source output device is the wired headset or the wireless headset; the control module is used to control the output of the voice information to the determined sound source output device. The vehicle communication system according to claim 1, wherein said obtaining the user's movement information includes: obtaining the user's movement information through one or more cameras. The vehicle communication system according to claim 2, wherein the obtaining the user's action information includes: recognizing the user's mouth shape, gestures or body movements to generate the action information. The vehicle communication system according to claim 1, wherein the control module is also used to automatically play or answer the voice after the mobile terminal switches the audio source output device to the wireless headset or the wired headset. information. The vehicle communication system as described in claim 1, wherein the control module It is also used to control the mobile terminal to switch to the vehicle sound source when the mobile terminal cannot be connected to the wireless headset. The vehicle communication system of claim 1, wherein the control module is also used to control the mobile terminal to switch to the vehicle audio source when the action acquisition module cannot obtain the corresponding audio source output device based on the action information. . The vehicle communication system according to any one of claims 1 to 6, wherein the voice information includes phone calls, voice calls, audio conferences, video conferences and voice messages. A vehicle-mounted communication method, the improvement of which is that it is applied to the vehicle-mounted communication system as described in any one of claims 1 to 6, including: communicating with the mobile terminal and the vehicle-mounted communication system; After the voice information is obtained, the user's action information is obtained; the sound source output device is determined based on the action information. The sound source output device includes: wired headphones, wireless headphones and car audio sources; when the action information includes headphone taking action information, headphone When at least one of the wearing action information and the earphone listening action information is used, it is determined that the audio source output device is the wired earphone or the wireless earphone; and the voice information is controlled to be output to the determined audio source output device.

Images