CN116821511A

CN116821511A - Information recommendation method and device, electronic equipment and storage medium

Info

Publication number: CN116821511A
Application number: CN202310968247.1A
Authority: CN
Inventors: 翁敏
Original assignee: Apollo Zhilian Beijing Technology Co Ltd
Current assignee: Apollo Zhilian Beijing Technology Co Ltd
Priority date: 2023-08-02
Filing date: 2023-08-02
Publication date: 2023-09-29

Abstract

The disclosure provides an information recommendation method, an information recommendation device, electronic equipment and a storage medium, relates to the technical field of data processing, particularly relates to the technical field of intelligent driving, and particularly relates to the information recommendation method, the information recommendation device, the electronic equipment and the storage medium. The specific implementation scheme is as follows: the method comprises the steps of obtaining interaction information acquired by information acquisition equipment, wherein the information acquisition equipment is arranged in a cabin in a seat of a vehicle; determining whether the user has an interactive intention in the vehicle based on the interactive information; if the interaction intention exists, current vehicle running information of the vehicle is obtained; determining suggestion information to be recommended, which accords with the behavior habit of a user, according to the vehicle running information and the current time; the determined suggestion information is recommended to the user. By applying the proposal provided by the embodiment of the disclosure, the proposal information can be recommended to the user with high efficiency, and the experience of the user using the vehicle-mounted equipment is improved.

Description

Information recommendation method and device, electronic equipment and storage medium

Technical Field

The disclosure relates to the technical field of data processing, in particular to the technical field of intelligent driving, and particularly relates to an information recommendation method, an information recommendation device, electronic equipment and a storage medium.

Background

With the development of intelligent driving technology, the vehicle-mounted devices installed in the vehicle are capable of providing more and more functions for users, such as map viewing, route navigation, weather viewing, radio, and phone call making. Currently, when a user uses the various functions provided by the vehicle-mounted device, a cumbersome selection operation needs to be performed on the vehicle-mounted device, and thus, the required functions are selected.

Disclosure of Invention

The disclosure provides an information recommendation method, an information recommendation device, electronic equipment and a storage medium.

According to an aspect of the present disclosure, there is provided an information recommendation method including:

the method comprises the steps of obtaining interaction information acquired by information acquisition equipment, wherein the information acquisition equipment is arranged in a cabin in a vehicle;

determining whether a user in the vehicle has an interactive intention based on the interactive information;

if the interaction intention exists, current vehicle running information of the vehicle is obtained;

determining suggestion information to be recommended, which accords with the behavior habit of the user, according to the vehicle running information and the current time;

recommending the determined suggestion information to the user.

According to another aspect of the present disclosure, there is provided an information recommendation apparatus including:

The information acquisition device is arranged in a cabin of the vehicle;

the interactive intention determining module is used for determining whether the user in the vehicle has interactive intention or not based on the interactive information;

the vehicle running information obtaining module is used for obtaining the current vehicle running information of the vehicle under the condition that the user has interactive intention;

the advice information determining module is used for determining advice information to be recommended, which accords with the behavior habit of the user, according to the running information of the vehicle and the current time;

and the suggestion information recommending module is used for recommending the determined suggestion information to the user.

According to still another aspect of the present disclosure, there is provided an electronic apparatus including:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein, the liquid crystal display device comprises a liquid crystal display device,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform any one of the information recommendation methods described above.

According to yet another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform any one of the information recommendation methods described above.

According to yet another aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements any of the above-mentioned information recommendation methods.

According to yet another aspect of the present disclosure, there is provided a vehicle including the electronic device as described above.

In view of the above, in the solution provided by the embodiments of the present disclosure, whether a user has an interaction intention can be determined according to interaction information collected by an information collecting device disposed in a cabin of a vehicle. And under the condition that the user is confirmed to have the interactive intention, determining suggestion information conforming to the behavior habit of the user according to the running information of the vehicle and the current time, and recommending the suggestion information to the user. Therefore, the user can recommend the recommended information to the user only by confirming that the user wants to interact based on the interaction information acquired by the information acquisition device, and the user can use the function corresponding to the recommended information according to the recommended information without complex selection operation. Therefore, the selection operation of the user is simplified, and the experience of the user for using the vehicle-mounted equipment is improved.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.

Drawings

The drawings are for a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

fig. 1 is a schematic flow chart of an information recommendation method according to an embodiment of the disclosure;

FIG. 2 is a schematic view of a portion of an interior cabin provided in an embodiment of the present disclosure;

fig. 3 is a schematic view of a display area of a display assembly in a vehicle-mounted screen according to an embodiment of the present disclosure;

fig. 4 is a schematic structural diagram of an information recommendation device provided in an embodiment of the present disclosure;

fig. 5 is a block diagram of an electronic device for implementing an information recommendation method of an embodiment of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

The execution body of the embodiment of the present disclosure is described below.

The execution body of the embodiment of the disclosure may be an on-vehicle device in a vehicle for providing various functions, or may be an intelligent electronic device in the vehicle for performing information recommendation, where the intelligent electronic device may be in communication connection with an on-vehicle device in the vehicle for providing various functions. The embodiments of the present disclosure are not limited in this regard. The information recommendation scheme provided in the embodiment of the present disclosure will be described below by taking the execution subject as the above-mentioned in-vehicle device as an example.

The information recommendation method provided by the embodiment of the present disclosure is described in detail below through specific embodiments.

In one embodiment of the present disclosure, referring to fig. 1, fig. 1 provides a flowchart of an information recommendation method. The method includes the following steps S101-S105.

Step S101: and obtaining the interaction information acquired by the information acquisition equipment.

Wherein the information acquisition device is arranged in a cabin of the vehicle. The seat compartment is the area of space in the vehicle for the seating of a person.

The specific location of the information collecting device is described below.

In one implementation, the information-gathering device may be disposed in a surrounding area of the in-vehicle display screen in the interior cabin of the vehicle, e.g., may be disposed above the in-vehicle display screen.

In another implementation, the information gathering device may be disposed in the cabin above the front side of the operator's seat. For example, the vehicle may be disposed on the top of a windshield in front of the driver's seat in the cabin, or may be disposed on the top of the vehicle in front of the driver's seat in the cabin.

The implementation of obtaining the interaction information in step S101 is described below.

In one implementation, an information acquisition device may include: an image acquisition device and/or a voice acquisition device. The image data may be acquired by an image acquisition device. The image data is not affected by environmental noise, so that the vehicle-mounted equipment can obtain accurate interaction information under the noisy environment. The voice acquisition device can acquire the audio data, so that the vehicle-mounted device can acquire the voice data of the user, and can acquire the interaction information without dispersing the energy and the attention of the user. In addition, in the case where the information collection device includes the image collection device and the voice collection device, the vehicle-mounted device can obtain the interactive information including the voice data and the image data, so that two different types of data are combined in the interactive information, and the interactive information is more accurate.

Further, in the case where the information collection apparatus includes an image collection apparatus, the in-vehicle apparatus may recognize the image to obtain image data including the person in the image. Under the condition that the information acquisition equipment comprises voice acquisition equipment, the vehicle-mounted equipment can process voice data, blank parts in the voice data are removed, and voice data containing personnel voice are obtained. Therefore, the data volume to be processed can be reduced, and the data processing efficiency is improved.

In another implementation, the information collecting device may also include: interaction buttons. The interactive buttons may include mechanical buttons, which may be disposed around the vehicle display screen, or in a location convenient for the user to reach. The interactive buttons may also include touch screen buttons in the in-vehicle display screen. If the user wishes to interact, the user can click the interaction button, so that the vehicle-mounted device obtains a signal that the user clicks the interaction button as interaction information.

Step S102: it is determined whether the user has an interactive intention in the vehicle based on the interactive information.

Wherein the interaction intent characterizes a user's desire to interact with the in-vehicle device. For example, a user wants to obtain information through an in-vehicle device, and a user wants to use various functions of the in-vehicle device.

The implementation of step S102 is described below and is not described in detail here.

Step S103: and if the interaction intention exists, acquiring the current vehicle running information of the vehicle.

Wherein the vehicle travel information may include at least one of the following information: geographic location information of the vehicle, travel state information of the vehicle, and planned route information of the vehicle traveling.

Therefore, the geographic position information of the vehicle, the running state information of the vehicle and the planned route information of the running of the vehicle can describe the current state of the user driving the vehicle more accurately, the recommended information to be recommended, which accords with the behavior habit of the user, can be determined more accurately based on the information, and the accuracy of information recommendation is improved.

Next, an implementation manner of obtaining the vehicle travel information in step S103 will be described.

In one implementation, if the vehicle travel information includes geographic location information of the vehicle, the vehicle-mounted device may obtain the geographic location information of the vehicle using an onboard GPS (Global Positioning System ).

If the vehicle running information comprises the running state information of the vehicle, the data measured in real time by the vehicle-mounted sensor can be obtained, and then the running state information of the vehicle is obtained. For example, the in-vehicle device may obtain the vehicle speed of the vehicle, record the vehicle speed of the vehicle stored for a while, and further obtain whether the vehicle is in an acceleration state, a state of transition from a running state to a stopped state, or a running state such as a starting state according to the vehicle speed. The in-vehicle apparatus may also obtain the operation of the user, and thus obtain the running state information of the vehicle. For example, information such as braking by stepping on a brake by a user, acceleration by stepping on an accelerator by a user, and opening and closing of a door by a user is obtained, and thus travel state information is obtained.

In the case where the user performs route navigation or uses an autopilot function of an autopilot vehicle, planned route information for the vehicle to travel may be obtained from route navigation information in the in-vehicle apparatus.

Further, on the basis of the above step S103, the in-vehicle apparatus may obtain maintenance information of the vehicle in addition to current vehicle running information of the vehicle. For example, tank oil amount information of a vehicle, battery power information of a vehicle, vehicle tank temperature information, vehicle tank water level information, engine oil level information, and the like.

Step S104: and determining the suggestion information to be recommended which accords with the behavior habit of the user according to the vehicle driving information and the current time.

Step S104 may be implemented by the following step a.

Step A: and determining the function to be recommended which accords with the behavior habit of the user according to the running information of the vehicle and the current time. And acquiring the suggestion information to be recommended, which accords with the behavior habit of the user, in the function to be recommended.

Specifically, according to the vehicle running information and the current time, the function used by the user in the same historical time period can be determined and used as the function to be recommended, which accords with the behavior habit of the user. And determining the suggestion information to be recommended under the function of the category according to the category of the function obtained by determination.

For example, if the determined function to be recommended is route navigation, the in-vehicle apparatus may determine geographical location information of the vehicle and destination information of the user, and determine advice information including route navigation information. The in-vehicle apparatus may also determine a time required to reach the destination based on the current time and the predicted arrival destination time.

If the determined function to be recommended is a broadcasting function, the vehicle-mounted device can determine broadcasting channel information preferred by the user and recommend broadcasting channels preferred by the user to the user. The in-vehicle apparatus may also determine a broadcast channel that the user wishes to listen to at the current time, based on the current time. For example, at 8 a.m., the user may listen to the news broadcast program of the news broadcast channel. Although the user listens to the music broadcast channel for a longer period of time, the user prefers the music broadcast channel, the in-vehicle device may recommend switching to the news broadcast channel to the user within a preset time around 8 o' clock in the morning.

If the determined function to be recommended is a music function, the vehicle-mounted device may determine music preferred by the user and recommend playing the music preferred by the user to the user. The in-vehicle apparatus may also determine the type of music preferred by the user and recommend music to the user that plays the type of music preferred by the user, for example, classical music, pop music, rock music, jazz music, ethnic music, and the like may be preferred by the user. For example, if the in-vehicle device determines that the user prefers classical music, the user may be recommended to play classical music.

Therefore, the function to be recommended which accords with the behavior habit of the user is determined first, and the recommended information to be recommended which accords with the behavior habit of the user in the function to be recommended is obtained according to the type of the function to be recommended, so that the accuracy of information recommendation is improved.

Other implementations of step S104 are described in detail in the embodiments below and are not described in detail herein.

Step S105: the determined suggestion information is recommended to the user.

The implementation of step S105 is described in detail in the following embodiments, which are not described in detail here.

An implementation of determining whether the user has an interactive intention in step S102 is described below.

In one implementation, if the information acquisition device includes an image acquisition device, feature extraction is performed on an image acquired by the image acquisition device, so as to obtain a sight feature of a user in the vehicle. And determining whether the user looks at a preset area of the vehicle-mounted display screen according to the sight features, and if so, determining that the user has interaction intention.

In particular, the manner in which whether the user looks at the preset area of the in-vehicle display screen is determined may be related to the installation position of the image capturing apparatus. Assuming that the vehicle-mounted display screen is mounted in the right-hand region of the steering wheel, as shown in fig. 2, fig. 2 provides a schematic view of a part of the cabin in the seat. If the image acquisition equipment is arranged above the front side of the driver seat in the sitting cabin, the vehicle-mounted equipment can determine a target sight range when the sight of the user looks at the preset area according to the installation position of the image acquisition equipment, the position of the vehicle-mounted display screen and the position of the user. If the vehicle-mounted device determines that the sight line gazing direction of the user is positioned in the target sight line range according to the sight line characteristics, determining that the user gazes at a preset area of the vehicle-mounted display screen, and determining that the user has interaction intention. In contrast, if it is determined from the line-of-sight feature that the line-of-sight gaze direction of the user is outside the target line-of-sight range, the user does not have an interactive intention.

The target sight line range represents the range of the user sight line and the preset standard sight line when the user gazes at the preset area. The image pickup apparatus may be an image pickup apparatus having a distance measuring function, for example, a binocular distance camera. The image acquisition equipment can determine the distance between the head of the user and the head and the installation position of the user, and determine the position of the user. The preset area may be a partial area of the in-vehicle display screen, for example, a central area of the in-vehicle display screen, a left area of the in-vehicle display screen, or a right area of the in-vehicle display screen.

Similarly, assuming that the image capturing device is disposed on the upper side of the vehicle-mounted display screen, the implementation manner of determining whether the user has the interaction intention is the same as the above manner.

The vehicle-mounted device can determine whether the user has the interactive intention by detecting whether the user looks at the preset area or not, and can also determine whether the user has the interactive intention by voice interaction or not.

In another implementation manner, if the information acquisition device includes a voice acquisition device, feature extraction is performed on the audio data acquired by the voice acquisition device, whether the voice sent by the user contains a preset keyword is determined according to the extracted feature, and if so, the user is determined to have an interaction intention.

Wherein the speech gathering device may comprise a microphone. In addition, under the condition that the information acquisition equipment comprises image acquisition equipment and voice acquisition equipment, the image acquisition equipment and the voice acquisition equipment can be arranged at the same position or at different positions respectively. For example, the image acquisition device may be disposed on the upper side of the in-vehicle display screen, in front of the driver's seat in the in-seat cabin of the voice acquisition device. The embodiments of the present disclosure are not limited in this regard.

In this way, different interaction intention determining modes are adopted according to different types of acquisition equipment, so that a plurality of types of information are combined, inaccuracy of the acquired interaction information caused by environmental interference is reduced, the acquired interaction information is more accurate, whether a user has the interaction intention can be determined more accurately, and the accuracy of information recommendation is further improved.

In still another implementation manner, in a case where the information collecting device includes an interactive button, if the vehicle-mounted device receives a signal that the button user clicks the interactive button, it may be determined that the user has an interactive intention.

An implementation of determining whether the user has an interactive intention in step S102 and determining advice information in step S104 will be described below.

The above step S102 may be implemented by the following step B.

And (B) step (B): based on the information of the driver in the interaction information, whether the driver has the interaction intention is judged. Therefore, the judgment for the driver can be performed, the interference of other people in the vehicle is reduced, the possibility of misjudgment is reduced, and the accuracy of information recommendation is improved.

In the case where step S102 is implemented by step B, the advice information to be recommended that conforms to the behavior habit of the driver is determined in step S104, and the determined advice information is recommended to the driver in step S105.

Step S104 may also be implemented in a similar manner to step a described above: and determining a function to be recommended which accords with the behavior habit of the driver according to the vehicle running information and the current time. And acquiring the suggestion information to be recommended, which accords with the behavior habit of the driver, in the function to be recommended. This implementation is similar to step a above, except for the differences in user and driver names, which are not described in detail here.

In addition, for the case where step S102 is implemented by step B, the information collecting apparatus may be installed above the front side of the driver' S seat in the in-seat cabin. Therefore, the information acquisition equipment can clearly and accurately determine the interactive information of the driver, and the accuracy of information recommendation is improved.

In the case where step S102 is implemented by step B, the manner in which the above-described step S104 determines the advice information may be implemented by the following steps C to D.

Step C: and extracting the characteristics of the information aiming at the driver in the interaction information to obtain the characteristics of the driver.

In one implementation, where the information gathering device comprises a voice gathering device, a microphone with positioning functionality may be used to gather the interactive information. Such as: multichannel microphones, array microphones, combination microphones, etc. Thus, the vehicle-mounted device can determine the position where the voice is transmitted according to the voice data in the obtained interaction information, and further determine the voice data belonging to the driver based on the position where the voice is transmitted. Then, the in-vehicle apparatus performs feature extraction for voice data belonging to the driver.

In another implementation manner, in the case that the information acquisition device includes an image acquisition device, a driving location area may be preset in the acquired image according to a position of the image acquisition device, and the vehicle device performs feature extraction for the preset driving location area in the acquired image, so as to obtain features of the driver.

Step D: and determining the suggestion information to be recommended, which accords with the behavior habit of the driver, based on the vehicle driving information, the current time and the characteristics of the driver.

The implementation of step D is described below by means of three implementations.

Implementation one

This can be achieved in a similar manner to step a above: based on the vehicle driving information, the current time and the characteristics of the driver, the function to be recommended which accords with the behavior habit of the driver is determined. And acquiring the suggestion information to be recommended, which accords with the behavior habit of the driver, in the function to be recommended. The characteristics of the driver are used for determining the identity of the driver, and after the identity of the driver is determined, the function to be recommended conforming to the behavior habit of the driver can be determined.

This implementation is similar to step a above, except that the user and driver names are different, and driver features are used, which will not be described in detail here.

Implementation II

And matching the characteristics of the driver with the recorded user characteristics, and determining the user identification corresponding to the successfully matched user characteristics as the identity of the driver. And selecting the suggestion information to be recommended which accords with the behavior habit of the driver from the identification corresponding information set according to the vehicle running information and the current time.

Wherein, the information set is: the obtained advice information to be recommended is optimized based on the history advice information recommended to the driver and the response operation of the driver to the history advice information.

The vehicle-mounted device can generate different user identifications for different users, and record the characteristics of the user, the history suggestion information recommended to the user and the response operation of the user for the history suggestion information in the process of recommending the information to the user each time. And then the user identification corresponding information set of the user can be determined according to the information stored in the record.

For example, both the user a and the user B may use the same vehicle, and if the obtained characteristics of the driver are successfully matched with the user characteristics of the user a, the user identifier of the user a is determined as the identity identifier of the driver. Then, the vehicle-mounted device may select the advice information to be recommended conforming to the behavior habit of the driver from the information set of the user a.

For another example, if the user a frequently performs an operation of turning on the weather forecast to check weather after starting the vehicle every morning. User a often goes to destination a on the work day after launching the vehicle and to destination B on the weekend. User a often goes home in the evening. The information set may then include open weather forecast, go to destination a to destination B, and go home. Then. The vehicle-mounted device can determine that the recommended information to be recommended, which accords with the behavior habit of the driver, is according to the fact that the current time is in the morning and the vehicle running information is in a preset time period after the vehicle is started: it is recommended to turn on the weather forecast.

For another example, if the behavior habit of the user a changes, for example, to go to the destination C on the weekday, the in-vehicle apparatus may optimize the information set after obtaining the response operation of the driver to the history advice information every time the advice information is recommended to the driver.

From the above, it is seen that the information set is to-be-recommended advice information optimized based on the history advice information recommended to the driver and the response operation of the driver to the history advice information. The information can accurately represent the behavior habit of the driver, preference information and the like, so that the advice information selected from the identity corresponding information set can be more consistent with the behavior habit of the driver according to the running information of the vehicle and the current time.

Implementation III

And inputting the vehicle driving information, the current time and the characteristics of the driver into an information recommendation model to obtain the recommended information to be recommended, which is output by the information recommendation model and accords with the behavior habit of the driver.

The information recommendation model is as follows: and a model which is obtained according to the historical suggestion information recommended to the driver and the response operation training of the driver to the historical suggestion information and is used for determining the suggestion information to be recommended.

For example, the driver uses a map to navigate a route to destination a, the driver uses a radio function, the driver opens a music application, the driver makes a call, etc.

Based on the vehicle travel information and the current time, it is determined whether the current operation is similar to the operation of the driver in the history. For example, the driver will always go to destination a on Saturday to pick up friend A. And the driver is accustomed to making a call to notify friend a 5 minutes before reaching destination a. Then, the information recommendation model may determine that the driver a has turned on the route navigation function for the destination a in the map application software according to the vehicle traveling information, and determine that the driver a has reached the destination a from about 5 minutes according to the current geographic position. Then the information recommendation model may output suggested information to dial a phone to buddy a. If the user receives the suggested information and performs the operation of dialing the phone to the friend A, the information recommendation model determines that the result of the suggested information is successful, and the information recommendation model can be optimized based on the suggested information.

In addition, the optimization process of the information recommendation model may be performed after each information recommendation, or may be performed in each preset period of time based on the collected historical recommendation information recommended to the driver and the response operation of the driver to the historical recommendation information.

In the process of determining the recommended information, the information recommendation model can also determine the function to be recommended which accords with the behavior habit of the driver according to the running information of the vehicle, the current time and the characteristic input information of the driver. And acquiring the suggestion information to be recommended, which accords with the behavior habit of the driver, in the function to be recommended.

From the above, it can be seen that the information recommendation model is trained based on the history advice information recommended to the driver and the response operation of the driver to the history advice information. The information can accurately represent the behavior habit, preference information and the like of the driver, and the information recommendation model can be continuously optimized according to the response operation of the user, so that the recommended suggestion information is more accurate.

From the above, the vehicle-mounted device can determine the recommended information to be recommended, which accords with the behavior habit of the driver, for different drivers, and recommend different information for different habits of the drivers, so that different information requirements of different drivers can be met, and the experience of using the same vehicle by multiple people can be improved.

In one embodiment of the present disclosure, if the in-vehicle apparatus obtains maintenance information of the vehicle in addition to current vehicle running information of the vehicle.

Under the condition that the maintenance information characterizes that the vehicle needs to perform corresponding maintenance operation, the vehicle-mounted equipment can determine the recommended information to be recommended, which accords with the behavior habit of the user, according to the running information of the vehicle, the current time and the maintenance information. For example, in the case where the fuel tank amount information of the vehicle indicates that the vehicle can travel a mileage less than a preset threshold, a nearest fuel station may be determined according to the geographical position information of the vehicle, and advice information including a navigation route to the fuel station may be recommended to the user according to the current time and the time at which the fuel station is expected to be reached.

The manner in which the advice information is determined in step S104 is exemplified below.

In the case where the vehicle traveling information includes at least one of geographical position information of the vehicle, traveling state information of the vehicle, and planned route information of the vehicle traveling, step S104 may be implemented as follows.

For example, users often drive vehicles to companies in the morning on weekdays and users often drive vehicles to markets on weekdays. If the vehicle-mounted device determines that the current time is the morning of the work day and determines that the distance between the vehicle position of the user and the company exceeds the preset threshold range according to the geographic position information, the vehicle-mounted device can determine that the travel to the company accords with the behavior habit of the user, so that the suggestion information comprising the route navigation information for suggesting the travel to the company is determined. If the vehicle-mounted device determines that the current time is a holiday and determines that the distance between the vehicle position of the user and the mall exceeds a preset threshold range according to the geographic position information, the vehicle-mounted device can determine that the route to the mall accords with the behavior habit of the user, so that the suggestion information comprising the route navigation information for suggesting the route to the mall is determined.

For another example, the user is used to turn on the map to view the road condition information when waiting for the red light, and if the vehicle-mounted device determines that the vehicle stops in the driving process according to the driving state information of the vehicle, the recommended information including turning on the map can be determined.

An implementation of recommending advice information to the user in step S105 is explained below.

In one implementation, the target presentation component may be obtained based on the determined function to which the suggestion information corresponds. The target presentation component is invoked to present the determined suggestion information.

The display component is preset for application software. The display component can display the functions preset in the application software in a main interface of the vehicle-mounted screen. For example, for weather forecast type application software, its preset display components may include a display component for displaying weather information of the current city. For map-like applications, its preset presentation components may include presentation components for providing map viewing functionality. The target presentation component may be a presentation component for presenting advice information among the respective presentation components.

Different display areas can be preset for each display assembly, referring to fig. 3, fig. 3 provides a schematic view of the display areas of the display assemblies in the vehicle-mounted screen. The display component of the weather forecast application software may display weather information in the upper right corner region of the vehicle screen shown in fig. 3. The presentation component of the map application software may present map information and route navigation information in a central region of the on-vehicle screen as shown in the figure. The status information of the vehicle may be presented in the left area of the in-vehicle screen shown in fig. 3. The presentation component may also provide interactive buttons, as shown in fig. 3, with the lower right corner area of the vehicle screen being the presentation area of the presentation component of the music application software, which provides buttons for the last song, the tentative/play button, and the next song. The user may use the interactive buttons described above to use the functionality of the application software.

Specifically, the target display component for displaying the determined advice information may be determined from among display components of respective information provided by application software according to the application software for providing the function corresponding to the advice information. The vehicle device may invoke the target presentation component to present the advice information in a preset area in the in-vehicle display screen. For example, if the target presentation component is a component for presenting map information and route navigation information, the map information and route navigation information may be presented in a central area of the in-vehicle screen and displayed: "advice: home for 42 minutes, whether home is to be taken ", as shown in fig. 3, in the central area of the vehicle-mounted screen. In addition, other text in fig. 3 is not relevant to the embodiments of the present disclosure by way of example only.

After the user no longer has the interactive intention, the vehicle-mounted device can display the display component preset by the user in the area. The vehicle-mounted device can determine that the user does not have the interaction intention when the user's sight is not gazing at the preset area of the vehicle-mounted display screen any more. The in-vehicle device may also determine that the user no longer has the interactive intention after determining the preset duration for which the user has the interactive intention.

The display component is preset according to various functions provided by the application software, and the display component is determined by determining the function corresponding to the suggestion information, so that the target display component for displaying the suggestion information can be accurately obtained, and the accuracy of information display is improved. In addition, the display assembly has strong self-ability, and a user can select a preset display area according to own habits. The display component has strong expandability, and when the application software updates a new function, a new display component can be created, so that the expansion is convenient.

In another implementation manner, the determined suggestion information can be recommended to the user through voice in a voice broadcasting manner. Thus, the situation that the driver views the vehicle-mounted display screen can be reduced, and the situation that the driver is distracted can be reduced.

According to another aspect of the present disclosure, referring to fig. 4, fig. 4 provides a schematic structural diagram of an information recommendation apparatus, the apparatus includes:

the interaction information obtaining module 401 is configured to obtain interaction information collected by an information collecting device, where the information collecting device is disposed in an interior cabin of a vehicle.

The interactive intention determining module 402 is configured to determine whether the user has an interactive intention in the vehicle based on the interactive information.

The vehicle running information obtaining module 403 is configured to obtain current vehicle running information of the vehicle if the user has an interactive intention.

The advice information determining module 404 is configured to determine advice information to be recommended that accords with the behavior habit of the user according to the vehicle driving information and the current time.

The suggestion information recommending module 405 is configured to recommend the determined suggestion information to the user.

In one embodiment of the present disclosure, the interactive intention determining module 402 is specifically configured to determine whether the driver has an interactive intention based on the information for the driver in the interactive information.

Therefore, the judgment for the driver can be performed, the interference of other people in the vehicle is reduced, the possibility of misjudgment is reduced, and the accuracy of information recommendation is improved.

In one embodiment of the present disclosure, the suggestion information determination module 404 includes:

and the feature extraction unit is used for extracting features of the information aiming at the driver in the interaction information to obtain the features of the driver.

And the advice information determining unit is used for determining advice information to be recommended, which accords with the behavior habit of the driver, based on the running information of the vehicle, the current time and the characteristics of the driver.

In one embodiment of the disclosure, the suggestion information determining unit is specifically configured to match a characteristic of a driver with a recorded user characteristic, and determine a user identifier corresponding to the successfully matched user characteristic as an identity of the driver; according to the vehicle running information and the current time, selecting the recommended information to be recommended which accords with the behavior habit of the driver from the identity mark corresponding information set, wherein the information set is as follows: the obtained advice information to be recommended is optimized based on the history advice information recommended to the driver and the response operation of the driver to the history advice information.

In one embodiment of the disclosure, the advice information determining unit is specifically configured to input the driving information of the vehicle, the current time, and the characteristics of the driver into the information recommendation model, and obtain advice information to be recommended, which is output by the information recommendation model and accords with the behavior habit of the driver, where the information recommendation model is: and a model which is obtained according to the historical suggestion information recommended to the driver and the response operation training of the driver to the historical suggestion information and is used for determining the suggestion information to be recommended.

In one embodiment of the present disclosure, the information collecting device is installed in the cabin above the front side of the driver's seat.

Therefore, the information acquisition equipment can clearly and accurately determine the interactive information of the driver, and the accuracy of information recommendation is improved.

In one embodiment of the present disclosure, the suggestion information determining module 404 is specifically configured to determine, according to the vehicle driving information and the current time, a function to be recommended that accords with the behavior habit of the user; and acquiring the suggestion information to be recommended, which accords with the behavior habit of the user, in the function to be recommended.

In one embodiment of the present disclosure, an information acquisition apparatus includes: an image acquisition device and/or a voice acquisition device.

In this way, the in-vehicle apparatus can obtain the voice data of the user, and can obtain the interaction information without dispersing the user's energy and attention. In addition, in the case where the information collection device includes the image collection device and the voice collection device, the vehicle-mounted device can obtain the interactive information including the voice data and the image data, so that two different types of data are combined in the interactive information, and the interactive information is more accurate.

In one embodiment of the present disclosure, the interaction intention determining module 402 is specifically configured to, if the information collecting device includes an image collecting device, perform feature extraction on an image collected by the image collecting device, and obtain a line of sight feature of a user in the vehicle; determining whether the user looks at a preset area of the vehicle-mounted display screen according to the sight features, if so, determining that the user has interaction intention;

and/or

If the information acquisition equipment comprises voice acquisition equipment, extracting characteristics of the audio data acquired by the voice acquisition equipment, determining whether voice sent by a user contains preset keywords according to the extracted characteristics, and if so, determining that the user has interaction intention.

In one embodiment of the present disclosure, the suggestion information recommending module 405 is specifically configured to obtain a target display component based on the determined function corresponding to the suggestion information; the target presentation component is invoked to present the determined suggestion information.

In one embodiment of the present disclosure, the vehicle travel information includes at least one of the following information: geographic location information of the vehicle, travel state information of the vehicle, and planned route information of the vehicle traveling.

In the technical scheme of the disclosure, the related processes of collecting, storing, using, processing, transmitting, providing, disclosing and the like of the personal information of the user accord with the regulations of related laws and regulations, and the public order colloquial is not violated.

Note that, the head model in this embodiment is not a head model for a specific user, and cannot reflect personal information of a specific user.

According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

Fig. 5 illustrates a schematic block diagram of an example electronic device 500 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 5, the apparatus 500 includes a computing unit 501 that can perform various suitable actions and processes according to a computer program stored in a Read Only Memory (ROM) 502 or a computer program loaded from a storage unit 508 into a Random Access Memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the device 500 can also be stored. The computing unit 501, ROM 502, and RAM 503 are connected to each other by a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.

Various components in the device 500 are connected to the I/O interface 505, including: an input unit 506 such as a keyboard, a mouse, etc.; an output unit 507 such as various types of displays, speakers, and the like; a storage unit 508 such as a magnetic disk, an optical disk, or the like; and a communication unit 509 such as a network card, modem, wireless communication transceiver, etc. The communication unit 509 allows the device 500 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.

The computing unit 501 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 501 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 501 performs the respective methods and processes described above, such as method information recommendation. For example, in some embodiments, the method information recommendation may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 508. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 500 via the ROM 502 and/or the communication unit 509. When the computer program is loaded into the RAM 503 and executed by the computing unit 501, one or more steps of the method information recommendation described above may be performed. Alternatively, in other embodiments, the computing unit 501 may be configured to perform the method information recommendation in any other suitable way (e.g. by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.

The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server incorporating a blockchain.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel, sequentially, or in a different order, provided that the desired results of the disclosed aspects are achieved, and are not limited herein.

The above detailed description should not be taken as limiting the scope of the present disclosure. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present disclosure are intended to be included within the scope of the present disclosure.

Claims

1. An information recommendation method, comprising:

Recommending the determined suggestion information to the user.

2. The method of claim 1, wherein the determining whether the user has an intent to interact within the vehicle based on the interaction information comprises:

and judging whether the driver has interactive intention or not based on the information aiming at the driver in the interactive information.

3. The method of claim 2, wherein the determining advice information to be recommended that conforms to the user behavior habit according to the vehicle traveling information and the current time includes:

extracting characteristics of information aiming at a driver in the interaction information to obtain characteristics of the driver;

and determining advice information to be recommended, which accords with the behavior habit of the driver, based on the vehicle driving information, the current time and the characteristics of the driver.

4. The method according to claim 3, wherein the determining advice information to be recommended that conforms to the driver behavior habit based on the vehicle running information, the current time, and the characteristics of the driver includes:

matching the characteristics of the driver with the recorded user characteristics, and determining a user identifier corresponding to the successfully matched user characteristics as the identity of the driver;

According to the vehicle running information and the current time, selecting the recommended information to be recommended which accords with the behavior habit of the driver from the information set corresponding to the identity mark, wherein the information set is as follows: optimizing the obtained to-be-recommended suggestion information based on the history suggestion information recommended to the driver and the response operation of the driver to the history suggestion information.

5. The method according to claim 3, wherein the determining advice information to be recommended that conforms to the driver behavior habit based on the vehicle running information, the current time, and the characteristics of the driver includes:

inputting the vehicle running information, the current time and the characteristics of the driver into an information recommendation model to obtain the recommended information to be recommended, which is output by the information recommendation model and accords with the behavior habit of the driver, wherein the information recommendation model is as follows: and training a model for determining the to-be-recommended suggestion information according to the historical suggestion information recommended to the driver and the response operation of the driver to the historical suggestion information.

6. The method according to any one of claims 2-5, wherein,

The information acquisition equipment is arranged above the front side of the driving seat in the inner cabin.

7. The method of claim 1, wherein the determining advice information to be recommended that conforms to the user behavior habit according to the vehicle traveling information and the current time includes:

determining a function to be recommended which accords with the behavior habit of the user according to the vehicle running information and the current time;

and acquiring suggestion information to be recommended, which accords with the behavior habit of the user, in the function to be recommended.

8. The method according to any one of claims 1-5, 7, wherein,

the information acquisition device includes: an image acquisition device and/or a voice acquisition device.

9. The method of claim 8, wherein the determining whether the user has an intent to interact within the vehicle based on the interaction information comprises:

if the information acquisition equipment comprises image acquisition equipment, extracting characteristics of the images acquired by the image acquisition equipment to obtain sight characteristics of a user in the vehicle; determining whether the user looks at a preset area of the vehicle-mounted display screen according to the sight features, if so, determining that the user has interaction intention;

And/or

If the information acquisition equipment comprises voice acquisition equipment, extracting characteristics of the audio data acquired by the voice acquisition equipment, determining whether voice sent by the user contains preset keywords according to the extracted characteristics, and if so, determining that the user has interaction intention.

10. The method of any of claims 1-5, 7, wherein the recommending the determined suggestion information to the user comprises:

obtaining a target display component based on the determined function corresponding to the suggestion information;

invoking the target presentation component to present the determined suggestion information.

11. The method according to any one of claims 1-5, 7, wherein,

the vehicle travel information includes at least one of the following information:

geographic position information of the vehicle, travel state information of the vehicle, and planned route information of the vehicle.

12. An information recommendation apparatus, comprising:

the information acquisition device is arranged in a cabin of the vehicle;

13. The apparatus of claim 12, wherein,

the interactive intention determining module is specifically configured to determine whether the driver has an interactive intention based on information about the driver in the interactive information.

14. The apparatus of claim 13, wherein the advice information determining module comprises:

the feature extraction unit is used for extracting features of the information aiming at the driver in the interaction information to obtain the features of the driver;

and the advice information determining unit is used for determining advice information to be recommended, which accords with the behavior habit of the driver, based on the vehicle driving information, the current time and the characteristics of the driver.

15. The apparatus of claim 14, wherein,

the suggestion information determining unit is specifically configured to match the characteristics of the driver with the recorded user characteristics, and determine a user identifier corresponding to the user characteristics that are successfully matched as the identity identifier of the driver; according to the vehicle running information and the current time, selecting the recommended information to be recommended which accords with the behavior habit of the driver from the information set corresponding to the identity mark, wherein the information set is as follows: optimizing the obtained to-be-recommended suggestion information based on the history suggestion information recommended to the driver and the response operation of the driver to the history suggestion information.

16. The apparatus of claim 14, wherein,

the advice information determining unit is specifically configured to input the vehicle driving information, the current time and the characteristics of the driver into an information recommendation model, and obtain advice information to be recommended, which is output by the information recommendation model and accords with the behavior habit of the driver, where the information recommendation model is: and training a model for determining the to-be-recommended suggestion information according to the historical suggestion information recommended to the driver and the response operation of the driver to the historical suggestion information.

17. The device according to any one of claims 13-16, wherein,

18. The apparatus of claim 12, wherein,

the suggestion information determining module is specifically configured to determine a function to be recommended according to the vehicle running information and the current time, where the function to be recommended accords with the behavior habit of the user; and acquiring suggestion information to be recommended, which accords with the behavior habit of the user, in the function to be recommended.

19. The device according to any one of claims 12-16, 18, wherein,

20. The apparatus of claim 19, wherein,

the interaction intention determining module is specifically configured to, if the information collecting device includes an image collecting device, perform feature extraction on an image collected by the image collecting device, and obtain a sight feature of a user in the vehicle; determining whether the user looks at a preset area of the vehicle-mounted display screen according to the sight features, if so, determining that the user has interaction intention;

and/or

21. The device according to any one of claims 12-16, 18, wherein,

the suggestion information recommending module is specifically used for obtaining a target display component based on the function corresponding to the determined suggestion information; invoking the target presentation component to present the determined suggestion information.

22. The device according to any one of claims 12-16, 18, wherein,

23. An electronic device, comprising:

at least one processor; and

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-11.

24. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-11.

25. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any of claims 1-11.

26. A vehicle comprising the electronic device of claim 23.