CN116594585A

CN116594585A - Social application content playing method, social application content processing method, social application content playing device, social application content processing equipment, social application content playing device and social application content processing vehicle

Info

Publication number: CN116594585A
Application number: CN202310539874.3A
Authority: CN
Inventors: 黄启立
Original assignee: Apollo Zhilian Beijing Technology Co Ltd
Current assignee: Apollo Zhilian Beijing Technology Co Ltd
Priority date: 2023-05-12
Filing date: 2023-05-12
Publication date: 2023-08-15

Abstract

The disclosure provides a social application content playing method, a social application content processing device, a social application content playing device, a social application content processing device and a social application content playing vehicle, and relates to the technical field of artificial intelligence, in particular to the technical fields of automatic driving, deep learning, human-computer interaction and the like, and the social application content playing device comprises the following specific schemes: acquiring social content of a social application, and sending the social content to a network model; receiving first voice information, and sending the first information to the network model, wherein the first information comprises the first voice information or text information of the first voice information; acquiring first output content fed back by the network model, wherein the first output content is as follows: the network model responds to the first information, and output content for replying to the first voice information is generated based on the social content; and playing the voice information of the first output content in the vehicle. The safety of vehicle driving can be improved.

Description

Social application content playing method, social application content processing method, social application content playing device, social application content processing equipment, social application content playing device and social application content processing vehicle

Technical Field

The disclosure relates to the technical field of artificial intelligence, in particular to the technical fields of automatic driving, deep learning, man-machine interaction and the like, and particularly relates to a social application content playing method, a social application content processing device, social application content processing equipment and a vehicle.

Background

With the development of artificial intelligence technology, more media content is available on vehicles, for example: the vehicle can be in communication connection with the mobile device, so that information on the mobile device can be projected to the vehicle-mounted terminal for display. At present, social contents of a social application, such as a chat interface, can be displayed on the vehicle-mounted terminal.

Disclosure of Invention

The disclosure provides a social application content playing method, a social application content processing device, social application content processing equipment and a social application content playing vehicle.

According to an aspect of the present disclosure, there is provided a social application content playing method, including:

acquiring social content of a social application, and sending the social content to a network model;

receiving first voice information, and sending the first information to the network model, wherein the first information comprises the first voice information or text information of the first voice information;

acquiring first output content fed back by the network model, wherein the first output content is as follows: the network model responds to the first information, and output content for replying to the first voice information is generated based on the social content;

and playing the voice information of the first output content in the vehicle.

According to another aspect of the present disclosure, there is provided a social application content processing method, including:

acquiring social content of a social application;

acquiring first information, wherein the first information comprises first voice information received by a vehicle-mounted terminal or text information of the first voice information;

first output content generated based on the social content for replying to the first voice information in response to the first information;

outputting the first output content.

According to another aspect of the present disclosure, there is provided a social application content playing apparatus, including:

the first acquisition module is used for acquiring social content of the social application and sending the social content to the network model;

the first receiving module is used for receiving first voice information and sending the first information to the network model, wherein the first information comprises the first voice information or text information of the first voice information;

the second obtaining module is used for obtaining first output content fed back by the network model, wherein the first output content is as follows: the network model responds to the first information, and output content for replying to the first voice information is generated based on the social content;

And the first playing module is used for playing the voice information of the first output content in the vehicle.

According to another aspect of the present disclosure, there is provided a social application content processing apparatus including:

the first acquisition module is used for acquiring social contents of the social application;

the second acquisition module is used for acquiring first information, wherein the first information comprises first voice information received by the vehicle-mounted terminal or text information of the first voice information;

a response module for responding to the first information, and generating first output content for replying to the first voice information based on the social content;

and the output module is used for outputting the first output content.

According to another aspect of the present disclosure, there is provided an electronic device including:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein, the liquid crystal display device comprises a liquid crystal display device,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the social application content playing method or the social application content processing method provided by the present disclosure.

According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing the computer to execute the social application content playing method or the social application content processing method provided by the present disclosure.

According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the social application content playing method or social application content processing method provided by the present disclosure.

According to another aspect of the present disclosure, there is provided a vehicle including the electronic device provided by the present disclosure.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.

Drawings

The drawings are for a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

FIG. 1 is a flow chart of a social application content playing method provided by the present disclosure;

FIG. 2 is a flow chart of a social application content processing method provided by the present disclosure;

FIG. 3 is a schematic diagram of a social application content playing method provided by the present disclosure;

fig. 4a to 4d are block diagrams of a social application content playing device provided by the present disclosure;

5 a-5 b are block diagrams of social application content processing apparatus provided by the present disclosure;

fig. 6 is a block diagram of an electronic device used to implement an embodiment of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

Referring to fig. 1, fig. 1 is a flowchart of a social application content playing method provided by the present disclosure, as shown in fig. 1, including the following steps:

step S101, obtaining social content of a social application, and sending the social content to a network model.

In this disclosure, social applications may include, but are not limited to: instant messaging applications, video applications, office applications, shopping applications, and the like, which are capable of information interaction.

The social content may include, but is not limited to: chat content, barrage content, comment content, shared content (e.g., content such as microblogs, circles of friends, etc.), etc. are sent through the social application. In addition, social content may be in the form of text, voice, video, and the like.

The social content of the social application may be that the vehicle-mounted terminal receives social content of the mobile device, such as chat content of an instant messaging application operated by the mobile device, where the social content of the social application is sent; alternatively, the social content of the social application may be social content of a social application running on the vehicle terminal, such as chat content of an instant messaging application running on the vehicle terminal.

In the disclosure, the social application content playing method is applied to a vehicle-mounted terminal, and the vehicle-mounted terminal can be understood as a vehicle, a vehicle-mounted system, intelligent equipment installed on the vehicle or equipment connected with the vehicle through a wireless network.

The network model may be a deep neural network model, such as a language model, a natural language generation model, a Transformer (Transformer) model, and the like.

In some embodiments, the network model may be a Generative Pre-Trained Transformer (GPT) model, a dialect of the core model, or the like.

In some embodiments, the above-described network model may also be understood as a network model for generating corresponding output content based on social content. And the network model may have multiple functions, wherein generating corresponding output content based on social content is only one of the functions of the network model.

In addition, the network model may be a remote network model, that is, a network model not deployed on a vehicle, but a network model deployed on a remote device, and the sending the social content to the network model may be sending the social content to a device deploying the network model.

Alternatively, the network model may be a network model deployed on an in-vehicle terminal, and the sending the social content to the network model may be that the vehicle terminal transfers the social content to the network model.

Step S102, receiving first voice information, and sending the first information to the network model, wherein the first information comprises the first voice information or text information of the first voice information.

The receiving of the first voice information may be that the vehicle-mounted terminal collects voice information in the vehicle, such as voice information of a vehicle owner, or voice information of a passenger on the vehicle.

In some embodiments, the first voice information may be voice information for querying or inquiring about the social content, for example: "XXX just says something, gives me a summary of" or "what the chat content in the XX group is," or "what they prefer to do with the XX site" etc.

In the present disclosure, the first voice information is not limited, and the first voice information may be any voice information that the network model can reply or respond to, or may be any voice information collected by the vehicle-mounted terminal.

The text information of the first voice information may be text information obtained by text converting the first voice information.

The foregoing description of the sending of the first information to the network model may refer to the foregoing description of the sending of the social content to the network model, which is not described herein.

It should be noted that, in the present disclosure, step S101 may be performed one or more times, for example: updated social content can be obtained in time and then sent to the network model. And the partial number may be performed after step S102 or may be performed before step S102.

Step 103, obtaining first output content fed back by the network model, where the first output content is: the network model is responsive to the first information for generating output content for replying to the first voice information based on the social content.

In the disclosure, after receiving the first information, the network model identifies text information of the first voice information, or converts the first voice information into text information, and then generates output content for returning the first voice information based on the social content.

In some embodiments, the network model may summarize, refine, reduce, or optimize the social content according to the text information of the first voice information to generate the output content for returning the first voice information. The output content may be text content, and in some embodiments, may be video or voice information.

In some embodiments, the output content for returning the first voice information may be output content for performing a dialogue reply to the first voice information, for example: the first voice message is "what is just described by XXX, and is summarized for me", and the first output content is a content that the network model summarizes chat content sent by XXX in the social content; also for example: and if the first voice information is "what the chat content in the xx group is," the first output content is the content in which the network model summarizes or simplifies the chat content in the xx group in the social content.

In some embodiments, the output content for returning the first voice information may be a dialogue content input by using the first voice information or text information of the first voice information as a network model, where the network model is based on the social content as a dialogue content replied with reference, that is, a dialogue between the vehicle terminal and the network model is implemented.

Step S104, playing the voice information of the first output content in the vehicle.

The voice information for playing the first output content in the vehicle may be that, when the first output content is text content, the text content is converted into voice information and played. Alternatively, when the first output content is video or voice content, voice information of the content is directly played.

In the method, after the first voice information or the text information of the first voice information is sent to the network model, the first output content fed back by the network model is obtained, and the voice information of the first output content is played in the vehicle, so that the user can know social content of social application only through interaction of the voice information in the vehicle, and the vehicle owner is prevented from checking the social content through the mobile device or the vehicle-mounted display screen, so that the driving safety of the vehicle is improved.

In one embodiment, the obtaining social content of the social application includes:

and receiving social content of the social application sent by the mobile equipment, wherein the social application is a social application operated by the mobile equipment.

The mobile device can be mobile devices such as a mobile phone and a tablet computer.

The social application is a social application running on the mobile device.

In the embodiment, the social content of the mobile device can be played in a voice interaction mode, so that the safety of vehicle driving is improved.

In some embodiments, the receiving the social content of the social application sent by the mobile device may be that the mobile device actively sends the changed social content to the vehicle-mounted terminal when determining that the social content has the change.

In one embodiment, the social content includes chat content of a target conversation window of the social application, the method further comprising:

receiving second voice information, wherein the second voice information is used for indicating and recording chat contents of the target session window in the social application; the first instruction information corresponding to the second voice information is sent to the mobile equipment, and the first instruction information is used for indicating to send chat content of the target session window to the vehicle-mounted terminal; or alternatively

And acquiring parameter information of the vehicle and sending the parameter information to the mobile equipment, wherein the chat content in the target session window comprises chat content matched with the parameter information.

The target session window may be a group chat session window, and in some embodiments, the target session window may also be a non-group chat session window.

The second voice information may be voice information for indicating the target session window, for example: "I want the chat content of XX window", or "record the chat content of XX window", etc.

When the mobile equipment receives the first instruction information, the mobile equipment starts to monitor the change of the target session window and the chat content, if the mobile equipment receives the first instruction information, the chat content in the target session window is sent to the vehicle-mounted terminal, and if the mobile equipment is changed, the changed chat content is sent to the vehicle-mounted terminal in time.

In this embodiment, the voice interaction with respect to the specific session window may be implemented through the second voice information, so as to reduce transmission resource consumption between the vehicle-mounted terminal and the mobile device.

The parameter information of the vehicle may include at least one of:

Position information of the vehicle, destination position information of the vehicle navigation, and state information of the vehicle.

For example: the target session window includes chat content corresponding to the position information of the vehicle, chat content for discussing a scene in the vicinity of the position information, news information, and the like.

Also for example: the target session window includes chat contents corresponding to the destination location information of the vehicle navigation, chat contents for discussing a scene in the vicinity of the location information, news information, and the like.

Also for example: the state information of the vehicle comprises the current abnormal state of the vehicle, such as a certain function failure, and a certain session in the social application of the mobile device comprises related chat content, so that the chat content related to the abnormal state is obtained; also for example: the state information of the vehicle comprises the current speed information of the vehicle, and a certain session in the social application of the mobile device comprises the related chat content, so that the chat content related to the speed information, such as the chat content whether the speed is overtime or not at the speed of 123 km at high speed, is obtained.

In the embodiment, the vehicle owner can timely acquire chat content related to the parameter information through the parameter information, so that the interaction performance between the vehicle and the vehicle owner is improved.

In one embodiment, the social content includes at least one piece of chat information, and the first output content includes output content obtained by:

the network model converts the at least one piece of chat information into output content for replying to the first voice information based on semantic information and context information, wherein the semantic information is the semantic information of the chat information in the at least one piece of chat information, and the context information is the context information of the chat information in the at least one piece of chat information.

In this embodiment, after receiving the first information, the network model identifies semantic information of chat information in at least one piece of chat information, and identifies context information of chat information in at least one piece of chat information; alternatively, the network model may identify semantic information of chat information in at least one piece of chat information and context information of chat information in at least one piece of chat information after receiving the social content.

The context information of the chat information may be context information of information content in the chat information, or context information of the chat information and other adjacent chat information.

The converting the at least one piece of chat information into the output content for replying to the first voice information based on the semantic information and the context information may be summarizing, refining, optimizing or compacting the at least one piece of chat information based on the semantic information and the context information to obtain the output content for replying to the first voice information.

In some embodiments, the method may include determining, from the at least one piece of chat information, a target chat information that matches the text information based on the text information of the first voice information, and converting the target chat information into output content for replying to the first voice information based on semantic information and context information of the target chat information.

In this embodiment, since the at least one piece of chat information is converted into the output content for replying to the first voice information based on the semantic information and the context information, the accuracy of the first output content can be improved. In some embodiments, the number of characters of the output content is smaller than the number of characters of the at least one piece of chat information, so that the generated first output content is a simplified content and is an output content with emphasis on at least one piece of chat information, thereby improving the accuracy of voice interaction.

It should be noted that, the present disclosure is not limited to converting the at least one chat message into output content for replying to the first voice message based on the semantic information and the context information, for example: in some embodiments or scenes, a final piece of chat information may be located in the plurality of pieces of chat information according to the text information of the first voice information, and then key information or key information in the piece of chat information is used as output content.

In one embodiment, the method further comprises:

receiving third voice information, and sending second information to the network model, wherein the second information comprises the third voice information or text information of the third voice information;

acquiring second output content fed back by the network model, wherein the second output content is information obtained by optimizing the third voice information or text information of the third voice information by the network model;

and sending the second output content to the social application.

The third voice information may be understood as information that the in-vehicle user wants to send in the social application, such as chat information that the in-vehicle user wants to send in the social application.

The optimizing processing of the third voice information or the text information of the third voice information by the network model may be that the optimizing processing of the third voice information or the text information of the third voice information is performed with simplifying, refining, summarizing, etc. so that the second output is more simplified or strict than the third voice information or the text information of the third voice information.

Wherein, the second output content can be text information or voice information.

In this embodiment, the social application sends the second output content, instead of sending the second voice information, so that the social application can send the optimized content, so as to improve the chat performance of the vehicle-mounted terminal.

In one embodiment, the sending the second output content to the social application includes:

and sending second instruction information to the mobile device, wherein the second instruction information comprises the second output content and instruction information, and the instruction information is used for instructing the second output content to be sent in a target session window of the social application.

In this embodiment, the mobile device may be instructed to send the second output content in a specific session window through the instruction information, so as to improve interaction performance between the vehicle-mounted terminal and the mobile device.

In some embodiments, the sending the second output content to the social application may also be that the vehicle-mounted terminal directly sends the second output content in the social application, for example, the vehicle-mounted terminal runs the social application.

In one embodiment, the method further comprises:

acquiring vehicle navigation information and vehicle position information;

identifying whether social information which needs to be informed to a vehicle owner in the vehicle driving process exists in the social content or not based on the vehicle navigation information and the vehicle position information;

playing third voice information in the vehicle under the condition that social information which needs to be informed to the vehicle owner in the vehicle driving process exists, wherein the third voice information is used for indicating that the social information which needs to be informed to the vehicle owner in the vehicle driving process exists in the social content;

wherein the first voice information is voice information received under the condition of playing the third voice information.

The above-described vehicle navigation information may include destination location information of vehicle navigation.

The social information that needs to be notified to the vehicle owner during the driving process of the vehicle may include at least one of the following:

a designated session window is preset in the social application to have new chat information;

Chat information pointing to an account number logged in by the mobile device exists in the social application, such as chat information of the account number logged in by the mobile device;

work-related information in a social application;

emergency to-do information exists in the social application.

In the embodiment, the third voice information can be timely played in the vehicle under the condition that the social information which needs to be informed to the vehicle owner in the running process of the vehicle is identified, so that the vehicle owner can timely acquire the corresponding social information, and the timeliness of the social information acquired by the vehicle owner is improved.

In one embodiment, when the time period from the vehicle navigation information to the navigation end point is identified to be greater than a preset threshold based on the vehicle navigation information and the vehicle position information, and social information related to a target account number exists in the social content, determining that the social information which needs to be informed to a vehicle owner in the vehicle driving process exists, wherein the target account number is an account number related to the vehicle; or alternatively, the process may be performed,

determining that social information which needs to be informed to a vehicle owner in the vehicle driving process exists under the condition that the time length from the vehicle driving to a navigation terminal point is greater than a preset threshold value based on the vehicle navigation information and the vehicle position information and the social information related to the vehicle position information or the navigation terminal point exists in the social content; or alternatively, the process may be performed,

And determining that social information which needs to be informed to an owner in the vehicle driving process does not exist when the time length from the vehicle driving to the navigation end point is less than a preset threshold value based on the vehicle navigation information and the vehicle position information.

The account number associated with the vehicle may be an account number on which the mobile device associated with the vehicle logs in, or an account number on which the vehicle logs in.

In the embodiment, when the time length from the vehicle running to the navigation terminal point is greater than the preset threshold value, if social information related to the target account number exists or social information related to the vehicle position information or the navigation terminal point exists, the vehicle owner can be timely informed, and the timeliness of the social information acquired by the vehicle owner is improved.

In addition, when the duration of the vehicle running to the navigation end point is smaller than a preset threshold value, it is determined that social information which needs to be informed to the vehicle owner in the vehicle running process does not exist, and therefore the fact that voice information is not played to the vehicle owner under the condition that the vehicle owner finishes driving soon can be achieved, driving safety is further improved, and because under the condition that the vehicle owner finishes driving soon, the vehicle owner is often required to carefully observe road conditions so as to avoid accidents.

Referring to fig. 2, fig. 2 is a flowchart of a social application content processing method provided in the present disclosure, as shown in fig. 2, including the following steps:

step S201, obtaining social content of a social application.

The social content of the social application may be social content of the social application sent by the receiving vehicle-mounted terminal, and specifically, refer to a corresponding description of the embodiment shown in fig. 1, which is not repeated herein.

Step S202, acquiring first information, wherein the first information comprises first voice information received by a vehicle-mounted terminal or text information of the first voice information.

The obtaining the first information may be receiving the first information sent by the vehicle-mounted terminal, and specifically, refer to a corresponding description of the embodiment shown in fig. 1, which is not repeated herein.

Step S203, in response to the first information, generates first output content for replying to the first voice information based on the social content.

This step may be the generation of the first output content by the network model in the embodiment shown in fig. 1, and specifically refer to the corresponding description of the embodiment shown in fig. 1, which is not repeated herein.

Step S204, outputting the first output content.

This step may be to transmit the first output content to the in-vehicle terminal.

According to the method, the device and the system, the social content of the social application can be obtained by the user only through interaction of voice information in the vehicle, so that a vehicle owner is prevented from viewing the social content through the mobile device or the vehicle-mounted display screen, and safety of driving of the vehicle is improved.

In one embodiment, the social content includes at least one piece of chat information, and the first output content generated based on the social content for replying to the first voice information in response to the first information includes:

identifying semantic information of chat information in the at least one piece of chat information and identifying context information of chat information in the at least one piece of chat information in response to the first information;

and converting the at least one piece of chat information into first output content for replying to the first voice information based on the semantic information and the context information.

The above conversion of the at least one chat message into the first output content for replying to the first voice message is that the network model in the embodiment shown in fig. 1 converts the at least one chat message into the first output content for replying to the first voice message, and specifically, refer to the corresponding description of the embodiment shown in fig. 1, which is not repeated herein.

In one embodiment, the method further comprises:

acquiring second information, wherein the second information comprises second voice information received by the vehicle-mounted terminal or text information of the second voice information;

optimizing the second voice information or text information of the second voice information to obtain second output content;

and outputting the second output content.

The second voice information is the third voice information in the embodiment shown in fig. 1, and specifically, refer to the corresponding description of the embodiment shown in fig. 1, which is not repeated herein.

In this embodiment, the social application content processing method is applied to a network model or an electronic device deploying the network model, and specific implementation manner and beneficial effects refer to corresponding descriptions of the embodiment shown in fig. 1, which are not repeated herein.

Referring to fig. 3, fig. 3 is a schematic diagram of a social application content playing method provided by the present disclosure, as shown in fig. 3, including the following steps:

step S301, the mobile device is in a group chat page of a social application, namely the mobile device runs social software;

step S302, the vehicle-mounted system is connected with the mobile equipment to transmit data, and video data of group chat pages in the mobile equipment are transmitted to the vehicle-mounted system to be displayed;

Step S303, initializing relevant content of a network model (such as a text in one word) by the vehicle-mounted system, wherein the initialization can be understood as indicating that the network model is ready for the following steps;

step S304, the vehicle-mounted system receives an instruction initiated by a vehicle owner through voice, wherein the instruction is used for indicating to start recording the change and text of the group chat page, the mobile equipment starts barrier-free service, and specifically, the instruction flows to the mobile equipment, and the mobile equipment starts barrier-free service;

step S305, the mobile device monitors page changes, and the group chat page of the social application is immediately called back as long as the group chat page changes, so that the mobile device is informed;

step S306, after the mobile equipment acquires the new chat content, the chat text is sent to the vehicle-mounted system;

step S307, after the vehicle-mounted system receives the chat text, the chat text is written in the network model in time;

step S308, a microphone of the vehicle-mounted system receives a query voice command initiated by a vehicle owner to a network model, such as ' what a certain person just says, and ' summary for me ';

step S309, converting the inquiry voice command into text through a voice recognition engine, and writing into a network model;

s3010, generating a simplified text by a network model;

Step S3011, returning a result, namely a simplified text, by the network model;

step S3012, a microphone of the vehicle-mounted system receives reply voice of a vehicle owner;

step S3013, writing the reply voice into a voice recognition engine, and re-writing the obtained text into a network model;

step S3013, the network model generates a proper reply and returns a result, wherein the result is chat content;

step S3014, transmitting chat content to the mobile device;

step S3015, send chat content to the social application.

And then the reply is transmitted to the social software of the mobile device side.

Referring to fig. 4a, fig. 4a is a social application content playing device provided by the present disclosure, and as shown in fig. 4a, the social application content playing device 400 includes:

a first obtaining module 401, configured to obtain social content of a social application, and send the social content to a network model;

a first receiving module 402, configured to receive first voice information, and send first information to the network model, where the first information includes the first voice information or text information of the first voice information;

a second obtaining module 403, configured to obtain first output content fed back by the network model, where the first output content is: the network model responds to the first information, and output content for replying to the first voice information is generated based on the social content;

The first playing module 404 is configured to play the voice information of the first output content in the vehicle.

In one embodiment, the first obtaining module 401 is configured to: and receiving social content of the social application sent by the mobile equipment, wherein the social application is a social application operated by the mobile equipment.

In one embodiment, the social content includes chat content of a target session window of the social application, as shown in fig. 4b, the apparatus further includes:

a first sending module 405, configured to receive second voice information, where the second voice information is used to instruct recording of chat content of the target session window in the social application; the first instruction information corresponding to the second voice information is sent to the mobile equipment, and the first instruction information is used for indicating to send chat content of the target session window to the vehicle-mounted terminal; or alternatively

And a second sending module 406, configured to obtain parameter information of a vehicle, and send the parameter information to the mobile device, where the chat content in the target session window includes a chat content matched with the parameter information.

In one embodiment, as shown in fig. 4c, the apparatus further comprises:

a second receiving module 407, configured to receive third voice information, and send second information to the network model, where the second information includes the third voice information or text information of the third voice information;

a third obtaining module 408, configured to obtain second output content fed back by the network model, where the second output content is information obtained by performing optimization processing on the third voice information or text information of the third voice information by using the network model;

and a third sending module 409, configured to send the second output content to the social application.

In one embodiment, the third sending module 409 is configured to: and sending second instruction information to the mobile device, wherein the second instruction information comprises the second output content and instruction information, and the instruction information is used for instructing the second output content to be sent in a target session window of the social application.

In one embodiment, as shown in fig. 4d, the apparatus further comprises:

a fourth acquisition module 4011 for acquiring vehicle navigation information and vehicle position information;

an identifying module 4012, configured to identify whether social information that needs to be notified to a vehicle owner during a vehicle driving process exists in the social content based on the vehicle navigation information and the vehicle position information;

the second playing module 4013 is configured to play third voice information in the vehicle when social information that needs to be notified to the vehicle owner during the running process of the vehicle exists, where the third voice information is used to indicate that social information that needs to be notified to the vehicle owner during the running process of the vehicle exists in the social content;

The social application content playing device provided by the disclosure can realize each process realized by the social application content playing method provided by the disclosure, and achieve the same technical effect, and in order to avoid repetition, the description is omitted here.

Referring to fig. 5a, fig. 5a is a social application content processing apparatus provided by the present disclosure, and as shown in fig. 5a, a social application content processing apparatus 500 includes:

a first obtaining module 501, configured to obtain social content of a social application;

a second obtaining module 502, configured to obtain first information, where the first information includes first voice information received by a vehicle-mounted terminal or text information of the first voice information;

A response module 503, configured to respond to the first information, and generate first output content for replying to the first voice information based on the social content;

an output module 504, configured to output the first output content.

In one embodiment, the social content includes at least one piece of chat information, and the response module 503 is configured to: identifying semantic information of chat information in the at least one piece of chat information and identifying context information of chat information in the at least one piece of chat information in response to the first information; and converting the at least one piece of chat information into first output content for replying to the first voice information based on the semantic information and the context information.

In one embodiment, as shown in fig. 5b, the apparatus further comprises:

a third obtaining module 505, configured to obtain second information, where the second information includes second voice information received by the vehicle-mounted terminal or text information of the second voice information;

the optimizing module 506 is configured to perform optimizing processing on the second voice information or text information of the second voice information, so as to obtain second output content;

And a second output module 507, configured to output the second output content.

The social application content processing device provided by the disclosure can realize each process realized by the social application content processing method provided by the disclosure, and achieve the same technical effect, and in order to avoid repetition, the description is omitted here.

In the technical scheme of the disclosure, the acquisition, storage, application and the like of the related user personal information all conform to the regulations of related laws and regulations, and the public sequence is not violated.

According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, a computer program product, and a vehicle.

Wherein, above-mentioned electronic equipment includes: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the social application content playing method or the social application content processing method provided by the present disclosure.

The readable storage medium stores computer instructions, where the computer instructions are configured to cause the computer to execute the social application content playing method or the social application content processing method provided by the present disclosure.

The computer program product described above includes a computer program that, when executed by a processor, implements the social application content playing method or social application content processing method provided by the present disclosure.

The vehicle comprises the electronic equipment provided by the disclosure.

Fig. 6 illustrates a schematic block diagram of an example electronic device 600 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 6, the apparatus 600 includes a computing unit 601 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 602 or a computer program loaded from a storage unit 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the device 600 may also be stored. The computing unit 601, ROM 602, and RAM 603 are connected to each other by a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.

Various components in the device 600 are connected to the I/O interface 605, including: an input unit 606 such as a keyboard, mouse, etc.; an output unit 607 such as various types of displays, speakers, and the like; a storage unit 608, such as a magnetic disk, optical disk, or the like; and a communication unit 609 such as a network card, modem, wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information/data with other devices via a computer grid, such as the internet, and/or various telecommunications grids.

The computing unit 601 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 601 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 601 performs the respective methods and processes described above, such as a social application content playing method or a social application content processing method. For example, in some embodiments, the social application content playing method or social application content processing method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 608. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 600 via the ROM 602 and/or the communication unit 609. When the computer program is loaded into the RAM 603 and executed by the computing unit 601, one or more steps of the social application content playing method or the social application content processing method described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to perform the social application content playing method or the social application content processing method in any other suitable way (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a grid browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication grid). Examples of communication grids include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.

The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communications grid. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server incorporating a blockchain.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel, sequentially, or in a different order, provided that the desired results of the disclosed aspects are achieved, and are not limited herein.

The above detailed description should not be taken as limiting the scope of the present disclosure. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present disclosure are intended to be included within the scope of the present disclosure.

Claims

1. A social application content playing method, comprising:

And playing the voice information of the first output content in the vehicle.

2. The method of claim 1, wherein the obtaining social content of a social application comprises:

3. The method of claim 2, wherein the social content comprises chat content of a target conversation window of the social application, the method further comprising:

4. A method according to any one of claims 1 to 3, wherein the social content comprises at least one piece of chat information, and the first output content comprises output content obtained by:

5. A method according to any one of claims 1 to 3, the method further comprising:

and sending the second output content to the social application.

6. The method of claim 5, wherein the sending the second output content to the social application comprises:

7. A method according to any one of claims 1 to 3, the method further comprising:

acquiring vehicle navigation information and vehicle position information;

8. The method of claim 7, wherein in the case that the duration of the vehicle traveling to the navigation end point is recognized to be greater than a preset threshold based on the vehicle navigation information and the vehicle position information, and social information associated with a target account is present in the social content, determining that social information which needs to be notified to a vehicle owner during the vehicle traveling exists, wherein the target account is an account associated with the vehicle; or alternatively, the process may be performed,

9. A social application content processing method, comprising:

acquiring social content of a social application;

outputting the first output content.

10. The method of claim 9, wherein the social content comprises at least one piece of chat information, and wherein generating first output content for replying to the first voice information based on the social content in response to the first information comprises:

11. The method of claim 9 or 10, the method further comprising:

and outputting the second output content.

12. A social application content playing device, comprising:

13. The apparatus of claim 12, wherein the first acquisition module is to: and receiving social content of the social application sent by the mobile equipment, wherein the social application is a social application operated by the mobile equipment.

14. The apparatus of claim 13, wherein the social content comprises chat content of a target conversation window of the social application, the apparatus further comprising:

the first sending module is used for receiving second voice information, and the second voice information is used for indicating and recording chat contents of the target session window in the social application; the first instruction information corresponding to the second voice information is sent to the mobile equipment, and the first instruction information is used for indicating to send chat content of the target session window to the vehicle-mounted terminal; or alternatively

And the second sending module is used for acquiring the parameter information of the vehicle and sending the parameter information to the mobile equipment, wherein the chat content in the target session window comprises the chat content matched with the parameter information.

15. The apparatus of any of claims 12-14, wherein the social content comprises at least one piece of chat information, and the first output content comprises output content obtained by:

16. The apparatus according to any one of claims 12 to 14, further comprising:

the second receiving module is used for receiving third voice information and sending second information to the network model, wherein the second information comprises the third voice information or text information of the third voice information;

the third acquisition module is used for acquiring second output content fed back by the network model, wherein the second output content is information obtained by optimizing the third voice information or text information of the third voice information by the network model;

and the third sending module is used for sending the second output content to the social application.

17. The apparatus of claim 16, wherein the third transmitting module is configured to: and sending second instruction information to the mobile device, wherein the second instruction information comprises the second output content and instruction information, and the instruction information is used for instructing the second output content to be sent in a target session window of the social application.

18. The apparatus according to any one of claims 12 to 14, further comprising:

a fourth acquisition module for acquiring vehicle navigation information and vehicle position information;

the identification module is used for identifying whether social information which needs to be informed to a vehicle owner in the vehicle driving process exists in the social content or not based on the vehicle navigation information and the vehicle position information;

the second playing module is used for playing third voice information in the vehicle under the condition that social information which needs to be informed to the vehicle owner in the vehicle driving process exists, and the third voice information is used for indicating that the social information which needs to be informed to the vehicle owner in the vehicle driving process exists in the social content;

19. The apparatus of claim 18, wherein, in a case where it is identified, based on the vehicle navigation information and the vehicle position information, that a duration of a vehicle traveling to a navigation end point is greater than a preset threshold, and social information associated with a target account is present in the social content, it is determined that social information that needs to be notified to a vehicle owner during the vehicle traveling exists, the target account being an account associated with the vehicle; or alternatively, the process may be performed,

20. A social application content processing apparatus, comprising:

and the output module is used for outputting the first output content.

21. The apparatus of claim 20, wherein the social content comprises at least one piece of chat information, the response module to: identifying semantic information of chat information in the at least one piece of chat information and identifying context information of chat information in the at least one piece of chat information in response to the first information; and converting the at least one piece of chat information into first output content for replying to the first voice information based on the semantic information and the context information.

22. The apparatus of claim 20 or 21, the apparatus further comprising:

the third acquisition module is used for acquiring second information, wherein the second information comprises second voice information received by the vehicle-mounted terminal or text information of the second voice information;

the optimizing module is used for optimizing the second voice information or the text information of the second voice information to obtain second output content;

and the second output module is used for outputting the second output content.

23. An electronic device, comprising:

at least one processor; and

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-8 or to enable the at least one processor to perform the method of any one of claims 9-11.

24. A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method of any one of claims 1-8 or for causing a computer to perform the method of any one of claims 9-11.

25. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any of claims 1-8 or which, when executed by a processor, implements the method according to any of claims 9-11.

26. A vehicle comprising the electronic device of claim 23.