CN113535112A - Abnormity feedback method, abnormity feedback device, vehicle-mounted terminal and vehicle - Google Patents
Abnormity feedback method, abnormity feedback device, vehicle-mounted terminal and vehicle Download PDFInfo
- Publication number
- CN113535112A CN113535112A CN202110775341.6A CN202110775341A CN113535112A CN 113535112 A CN113535112 A CN 113535112A CN 202110775341 A CN202110775341 A CN 202110775341A CN 113535112 A CN113535112 A CN 113535112A
- Authority
- CN
- China
- Prior art keywords
- control
- feedback
- vehicle
- voice
- attribute
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
- G06F9/44526—Plug-ins; Add-ons
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Mechanical Engineering (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
- Navigation (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The invention discloses an abnormality feedback method, an abnormality feedback device, a vehicle-mounted terminal and a vehicle. The anomaly feedback method comprises the following steps: under the condition that the current control hit by the voice instruction has custom feedback, judging whether the voice instruction meets the execution condition of the current control according to the state information of the vehicle; under the condition that the voice command does not accord with the execution condition, obtaining self-defined feedback information according to the state information; and broadcasting the self-defined feedback information. According to the abnormity feedback method, the abnormity feedback device, the vehicle-mounted terminal and the vehicle, under the condition that the current control has custom feedback and the voice command does not accord with the execution condition of the current control, the custom feedback information is obtained and broadcasted according to the state information, so that different current controls have different custom feedback information, and the state information of the vehicle can be accurately prompted to a user through the custom feedback information, so that the user can know whether the voice command cannot be executed and the reason why the voice command cannot be executed.
Description
Technical Field
The present invention relates to a voice control technology, and in particular, to an abnormality feedback method, an abnormality feedback device, a vehicle-mounted terminal, and a vehicle.
Background
It can be said that the function to be implemented is that all controls visible on the page can perform voice hit to simulate the operation of the GUI, and after the controls are hit, there is a general reply for different controls, for example, a common control may be "ok", etc., a control of a switch class may be "bluetooth switch", and "help you turn on/off" may be replied to, and the like. The voice is visible, that is, the general reply after the hit can be said to cause the error of the prompt message and bring misdirection to the user, for example: when the user turns on the low-power-consumption and the query turns on the key to remotely park the vehicle, the user may misunderstand that the remote-control automatic parking function is turned on correctly.
Disclosure of Invention
The invention provides an abnormality feedback method, an abnormality feedback device, a vehicle-mounted terminal and a vehicle.
An abnormality feedback method of an embodiment of the present invention may be applied to a vehicle, the abnormality feedback method including: under the condition that the current control hit by the voice instruction has custom feedback, judging whether the voice instruction meets the execution condition of the current control according to the state information of the vehicle; under the condition that the voice instruction does not accord with the execution condition, obtaining self-defined feedback information according to the state information; and broadcasting the user-defined feedback information.
According to the abnormal feedback method, under the condition that the current control has custom feedback and the voice command does not accord with the execution condition of the current control, custom feedback information is obtained according to the state information and broadcast, so that different current controls have different custom feedback information, and the state information of the vehicle of a user can be accurately prompted through the custom feedback information, so that the user can know whether the voice command cannot be executed or not and the reason why the voice command cannot be executed.
In some embodiments, the vehicle is configured to communicate with a cloud, and in a case that the current control hit by the voice instruction has a custom feedback, before determining whether the voice instruction meets an execution condition of the current control according to the state information of the vehicle, the abnormality feedback method further includes: pre-creating a UI control library for an application program; when a graphical user interface of the application program is displayed, acquiring a control list of the graphical user interface, wherein the control list comprises a plurality of controls; acquiring a first voice interaction attribute of the control from the UI control library according to a preset strategy and generating scene element information corresponding to the control according to the first voice interaction attribute, wherein the first voice interaction attribute is generated according to the control attribute of the control through the UI control library; constructing a voice interaction scene according to the scene element information and uploading the voice interaction scene to the cloud; the cloud generates a scene snapshot according to the voice interaction scene, wherein the scene snapshot comprises scene identification and control attributes of each control, and the control attributes comprise at least one of identification, labels, feedback attributes, timestamps, names, types and data of the controls.
In some embodiments, in a case that the current control hit by the voice instruction has a custom feedback, before determining whether the voice instruction meets an execution condition of the current control according to the state information of the vehicle, the abnormality feedback method further includes: adding the feedback attribute of the user-defined feedback to the control attribute of the preset control; responding to the change of the control attribute of the preset control, and updating the first voice interaction attribute according to the change to obtain a second voice interaction attribute; generating updated scene element information according to the second voice interaction attribute; and constructing an updated voice interaction scene according to the updated scene element information.
In some embodiments, in a case that the current control hit by the voice instruction has a custom feedback, before determining whether the voice instruction meets an execution condition of the current control according to the state information of the vehicle, the abnormality feedback method further includes: the cloud terminal analyzes the voice instruction to determine a current scene identification corresponding to the voice instruction and a current control attribute of the current control; the cloud end determines a current scene snapshot according to a current scene identification, wherein the scene identification of the current scene snapshot is the same as the current scene identification; the cloud end judges whether the current control attribute is matched with the control attribute of the control in the current scene snapshot; and under the condition that the current control attribute is matched with the control attribute of the control, the cloud end determines the corresponding control to be used as the current control.
In some embodiments, after the cloud determines the corresponding control as the current control in the case that the current control attribute matches the control attribute of the control, the anomaly feedback method further includes: judging whether the current control has the feedback attribute of the custom feedback; and under the condition that the current control has the feedback attribute of the custom feedback, determining that the current control has the custom feedback.
In some embodiments, the anomaly feedback method further comprises: and broadcasting preset feedback information under the condition that the voice command meets the execution condition.
In some embodiments, the anomaly feedback method comprises: timing when the current control hit by the voice instruction has custom feedback; if the user-defined feedback information is received within the preset time, broadcasting the user-defined feedback information; and broadcasting the preset feedback information if the user-defined feedback information is not received within the preset time.
The abnormality feedback device of the embodiment of the invention can be used for a vehicle and comprises an application module and a voice module. The application module is used for judging whether the voice instruction accords with the execution condition of the current control or not according to the state information of the vehicle under the condition that the current control hit by the voice instruction has custom feedback, and acquiring custom feedback information according to the state information under the condition that the voice instruction does not accord with the execution condition. The voice module is used for broadcasting the user-defined feedback information.
In the abnormity feedback device, under the condition that the current control has custom feedback and the voice command does not accord with the execution condition of the current control, the custom feedback information is obtained according to the state information and is broadcasted, so that different current controls have different custom feedback information, and the state information of the vehicle of a user can be accurately prompted through the custom feedback information, so that the user can know whether the voice command can not be executed and the reason why the voice command can not be executed.
The vehicle-mounted terminal of the embodiment of the invention can be used for a vehicle, and comprises one or more processors and a memory, wherein the memory stores a computer program, and the computer program realizes the steps of the abnormality feedback method of any one of the above embodiments when executed by the processors.
In the vehicle-mounted terminal, under the condition that the current control has the custom feedback and the voice instruction does not accord with the execution condition of the current control, the custom feedback information is obtained according to the state information and is broadcasted, so that different current controls can have different custom feedback information, and the state information of the vehicle of a user can be accurately prompted through the custom feedback information, so that the user can know whether the voice instruction cannot be executed and the reason why the voice instruction cannot be executed.
The vehicle of the embodiment of the invention comprises a body and the vehicle-mounted terminal of the embodiment, wherein the vehicle-mounted terminal is mounted on the body.
In the vehicle, under the condition that the current control has the custom feedback and the voice instruction does not accord with the execution condition of the current control, the custom feedback information is obtained according to the state information and is broadcasted, so that different current controls can have different custom feedback information, and the state information of the vehicle of a user can be accurately prompted through the custom feedback information, so that the user can know whether the voice instruction can not be executed and the reason why the voice instruction cannot be executed.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a schematic flow diagram of an anomaly feedback method in accordance with certain embodiments of the present invention;
FIG. 2 is a schematic illustration of a vehicle according to certain embodiments of the present invention;
FIG. 3 is a schematic diagram of an anomaly feedback device in accordance with certain embodiments of the present invention;
FIG. 4 is a timing diagram illustrating an anomaly feedback method according to some embodiments of the present invention;
FIG. 5 is a schematic flow diagram of an anomaly feedback method in accordance with certain embodiments of the present invention;
FIG. 6 is a schematic illustration of a communication connection between a vehicle and a cloud in accordance with certain embodiments of the present invention;
FIGS. 7-12 are flow diagrams of an anomaly feedback method according to some embodiments of the present invention;
FIG. 13 is a schematic diagram of a vehicle mounted terminal in accordance with certain embodiments of the present invention.
Description of the main element symbols:
the vehicle 100, the body 10, the processor 22, the memory 24, the in-vehicle terminal 20, the cloud 300, the abnormality feedback device 500, the application module 520, the voice module 540, and the processing module 560.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
Referring to fig. 1 and 2, an abnormality feedback method according to an embodiment of the present invention may be applied to a vehicle 100. The anomaly feedback method comprises the following steps:
s12: under the condition that the current control hit by the voice instruction has custom feedback, judging whether the voice instruction meets the execution condition of the current control according to the state information of the vehicle 100;
s14: under the condition that the voice command does not accord with the execution condition, obtaining self-defined feedback information according to the state information;
s16: and broadcasting the self-defined feedback information.
Referring to fig. 3 and 4, an abnormality feedback device 500 according to an embodiment of the present invention may be used for the vehicle 100. The anomaly feedback device 500 includes an application module 520 and a speech module 540. The abnormality feedback method according to the embodiment of the present invention may be implemented by the abnormality feedback apparatus 500 according to the embodiment of the present invention, wherein the steps S12 and S14 may be implemented by the application module 520, and the step S16 may be implemented by the voice module 540. That is, the application module 520 may be configured to determine whether the voice instruction meets the execution condition of the current control according to the state information of the vehicle 100 when the current control hit by the voice instruction has the custom feedback, and obtain the custom feedback information according to the state information when the voice instruction does not meet the execution condition. The voice module 540 may be used to broadcast the custom feedback information.
In particular, the application module 520 and the voice module 540 may be deployed in the vehicle 100, for example, the application module 520 may be a service APP of the vehicle 100, specifically, for example, related applications such as bluetooth, network, voice, display, laboratory, user feedback, related systems, and the like; the voice module 540 may be a voice assistant for the vehicle 100. The control of the invention can be a virtual button in the business APP, the invention forms a voice command through voice input, and the operation of simulating the user to click the GUI can be realized by hitting the virtual button with the voice command by using the visible or speaking technology. Different controls have different execution conditions, for example, a control of "key-operated parking" is generally prohibited from being used when the vehicle 100 is turned on to save power, and therefore, it is possible to determine whether or not the voice command meets the execution condition of the current control according to the state information of the vehicle 100, including but not limited to the driving state of the vehicle (e.g., vehicle speed), the driving mode (automatic navigation-assisted driving mode, adaptive cruise control driving mode, lane centering-assisted driving mode, manual driving mode, etc.), and the operating state (whether or not to turn on to save power, etc.).
In the related art, it can be seen that the function to be realized is that all controls visible on a page can perform voice hit to simulate the operation of a GUI, and after the controls are hit, there is a general reply for different controls, for example, a general control may be "ok", etc., a control in a switch class may be "bluetooth switch", and "help you turn on/off" may be replied to, and the like. The voice is visible, that is, the general reply after the hit can be said to cause the error of the prompt message and bring misdirection to the user, for example: when the user turns on the low-power-consumption and the query turns on the key to remotely park the vehicle, the user may misunderstand that the remote-control automatic parking function is turned on correctly.
In the anomaly feedback method and the anomaly feedback device 500 of the embodiment of the invention, under the condition that the current control has custom feedback and the voice command does not meet the execution condition of the current control, the custom feedback information is obtained and broadcasted according to the state information, so that different current controls have different custom feedback information, and the state information of the vehicle can be accurately prompted to the user through the custom feedback information so that the user can know whether the voice command can not be executed and the reason of the voice command can not be executed. Specifically, for example, the user voice instruction is "open key remote parking", the current control hit by the voice instruction is "key remote parking", and the "key remote parking" has a custom feedback, and if the state information of the vehicle 100 indicates that the vehicle 100 is in the low power consumption mode, it is determined that the voice instruction does not meet the execution condition of "key remote parking", so that the custom feedback information can be obtained according to the state information of the vehicle 100, where a corresponding relationship between the state information of the vehicle 100 and the custom feedback information may be stored in advance, for example, the state information of the vehicle is "low power consumption is already on", and the corresponding custom feedback information is "low power consumption is already on, and cannot be used"; further, for example, if the vehicle state information is "low power consumption off", the corresponding customized feedback information is "low power consumption off, and cannot be used". After the application module 520 acquires the custom feedback information, the custom feedback information can be packaged, the packaged custom feedback information is transmitted to the voice module 540, and the voice module 540 can broadcast the custom feedback to prompt a user after receiving the custom feedback information, so that the user can know whether the voice instruction can not be normally executed and the reason why the voice instruction cannot be executed. In one embodiment, the custom feedback information may include a control ID, control status (open or not), reply type (voice reply or pop-up reply), reply content (e.g., "low power consumption open, not available"), and the like.
Referring to fig. 5 and 6, in some embodiments, the vehicle 100 is configured to communicate with the cloud 300, and before step S12, the method for anomaly feedback further includes:
s21: pre-creating a UI control library for an application program;
s22: when a graphical user interface of an application program is displayed, acquiring a control list of the graphical user interface, wherein the control list comprises a plurality of controls;
s23: acquiring a first voice interaction attribute of a control from a UI control library according to a preset strategy and generating scene element information corresponding to the control according to the first voice interaction attribute, wherein the first voice interaction attribute is generated according to the control attribute of the control through the UI control library;
s24: constructing a voice interaction scene according to the scene element information and uploading the voice interaction scene to the cloud 300;
s25: the cloud 300 generates a scene snapshot according to the voice interaction scene, where the scene snapshot includes a scene identifier and control attributes of each control, and the control attributes include at least one of an identifier, a tag, a feedback attribute, a timestamp, a name, a type, and data of the control.
Referring to fig. 3 and 4, in some embodiments, the anomaly feedback device 500 further includes a processing module 560. Step S21, step S22, and step S23 may be implemented by the application module 520, step S24 may be implemented by the voice module 540, and step S25 may be implemented by the processing module 560. That is, the application module 520 may be used to create a UI control library for an application in advance; when a graphical user interface of an application program is displayed, acquiring a control list of the graphical user interface, wherein the control list comprises a plurality of controls; and acquiring a first voice interaction attribute of the control from the UI control library according to a preset strategy and generating scene element information corresponding to the control according to the first voice interaction attribute, wherein the first voice interaction attribute is generated according to the control attribute of the control through the UI control library. The voice module 540 may be configured to construct a voice interaction scenario according to the scenario element information and upload the voice interaction scenario to the cloud 300. The processing module 560 may be configured to generate a scene snapshot according to the voice interaction scene, where the scene snapshot includes a scene identifier and control attributes of each control, and the control attributes include at least one of an identifier, a tag, a feedback attribute, a timestamp, a name, a type, and data of the control.
Specifically, the processing module 560 may be disposed in the cloud 300, for example, the processing module 560 may be a processing chip of the cloud 300. It should be noted that the application program in the present application is an example of a program carrier having a graphical user interface GUI. According to the abnormal feedback method, the GUI page of the application program can be converted into a voice interaction scene, in some embodiments, the application program can further comprise an applet application, and the widget of the applet application can be subjected to attribute addition in a pre-established UI widget library. When the application program enters the GUI page of the small program, the GUI page of the small program and the control thereof can be subjected to voice interaction scene construction. Applets and other program classes with graphical user interfaces GUI can be considered as simple alternatives to the application in this application.
The vehicle 100 of the embodiment of the present application may include a dashboard screen, an on-board screen, and a head-up display that may be implemented on a vehicle windshield, and the like. The in-vehicle screen includes a screen having a graphical user interface. An on-board system operating on a vehicle presents the presented content to a User using a Graphical User Interface (GUI). The in-vehicle screen display area includes many UI elements, and different display areas may present the same or different UI elements. The UI elements may include card objects, application icons or interfaces, folder icons, multimedia file icons, and controls for making interactive operations, among others.
In step S21, a UI control library for the application is created in advance. The UI control library is an Android UI component library packaged according to an actual application program, and may include a UI public control library or a UI control library which is specially generated from a UI common control library according to the actual application program and corresponds to the application program.
In step S22, when the graphical user interface of the application program is displayed, a control list of the graphical user interface is obtained, where the control list includes a plurality of controls. It will be appreciated that each graphical user interface GUI in an application has a list of controls, with a plurality of controls included in the list of controls. And each UI control view and the attribute of the control view can be called from the UI control library. When the graphical user interface is displayed, namely, the user makes the display on the display screen enter a certain graphical user interface through a certain operation.
Specifically, when entering the graphical user interface, a corresponding trigger request can be generated to characterize and judge the current event entering a certain graphical user interface. In some embodiments, triggering a request may also include determining whether to enter a graphical user interface by way of an event, a buried point, or the like. For example, a user clicks 'navigation' through manual operation in a vehicle or makes a home page of a navigation APP displayed on a screen through voice interaction such as 'open navigation', the home page of the navigation APP is the current graphical user interface, when the home page of the navigation APP is opened and displayed, a trigger request of a graphical user interface scene is received, and the graphical user interface display at the moment is judged.
When entering the graphical user interface, a control list in the graphical user interface is obtained. It is understood that the GUI of each page has a plurality of controls therein, wherein the controls are GUI controls with known meanings, such as controls of directory Text, Edit, UpDown, Picture, Button, Checkbox, and so on.
Further, in step S23, traversing each control in the control list, obtaining a first voice interaction attribute of the control from the UI control library according to a predetermined policy, and generating scene element information corresponding to the control according to the first voice interaction attribute, where the first voice interaction attribute is generated by an attribute of the control in the UI control library. The first Voice interaction attribute comprises attributes of a corresponding control required for a Voice User Interface (VUI) function, and may comprise attributes such as a unique identifier, a control type, a control executable action and the like. The corresponding voice interaction operation can be executed by changing the first voice interaction attribute in the voice interaction process. The obtaining mode comprises extracting from the attribute corresponding to the control displayed by the graphical user interface according to a preset strategy or extracting from the voice label added in advance.
Specifically, a first voice interaction attribute Vui attribute for generating the control view may be added to the UI control library according to each attribute of the control view. That is, according to the attributes of different views, the attribute of the view in the UI control library is determined as the Vui attribute required by the VUI. In one example, the voice interaction control Vuiview may be defined in VuiCommon package by creating VuiCommon package, for which the application relies on the UI control library to add Vui properties, such as setVuiLabel (String), search.
Further, in step S23, a first voice interaction attribute of the control is obtained according to a predetermined policy, and scene element information corresponding to the control is generated according to the first voice interaction attribute. The scene element information corresponds to each control one by one and is generated by the first voice interaction attribute. And generating scene element information corresponding to the control according to the first voice interaction attributes, for example, generating VuiElement by each first voice interaction attribute, adding the VuiElement to the generated numerical structure, and finally forming the information of the voice interaction scene of the graphical user interface.
In step S24, a voice interaction scene is constructed according to the scene element information, which may be specifically, scene basic information of the graphical user interface scene is obtained, and the voice interaction scene is constructed according to the scene element information and the scene basic information, where the scene basic information includes scene information such as a scene ID, a Vui version number, a timestamp, and the like. After the voice interaction scene is constructed, the voice interaction scene may be cached in the local area of the vehicle 100 or uploaded to the cloud 300. And after the user outputs the voice instruction, the corresponding control in the corresponding graphical user interface can be hit.
In step S25, the cloud 300 generates a scene snapshot according to the voice interaction scene, where the scene snapshot includes a scene identifier and control attributes of each control, and the control attributes include at least one of an identifier, a tag, a feedback attribute, a timestamp, a name, a type, and data of the control. The scene identifier may refer to an interface ID, and the control attribute includes at least one of an Identifier (ID) of the control, a tag (label), a feedback attribute (props), a timestamp (timestamp), a name (resourceName), a type (type), and data (values). Through the voice interaction scene and the scene snapshot, the visual and speaking functions can be realized in an auxiliary mode.
Referring to fig. 7, in some embodiments, before step S12, the method for anomaly feedback further includes:
s26: adding the feedback attribute of the user-defined feedback to the control attribute of the preset control;
s27: responding to the change of the control attribute of the preset control, and updating the first voice interaction attribute according to the change to obtain a second voice interaction attribute;
s28: generating updated scene element information according to the second voice interaction attribute;
s29: and constructing an updated voice interaction scene according to the updated scene element information.
Referring to fig. 3 and 4, in some embodiments, step S26, step S27, and step S28 may be implemented by the application module 520, and step S29 may be implemented by the voice module 540. That is, the application module 520 may be configured to add the feedback attribute of the custom feedback to the control attribute of the preset control; responding to the change of the control attribute of the preset control, and updating the first voice interaction attribute according to the change to obtain a second voice interaction attribute; and generating updated scene element information according to the second voice interaction attribute. The voice module 540 may be configured to construct an updated voice interaction scene according to the updated scene element information.
Specifically, step S26 may be performed during the encoding stage of the service APP. In the encoding stage of the service APP, all the controls can be artificially divided into controls that need to be fed back by user-definition (i.e., preset controls) and controls that do not need to be fed back by user-definition, the preset controls can refer to controls that can be executed only when the state information of the vehicle 100 meets the execution conditions, and the controls that do not need to be fed back by user-definition can refer to controls that can be executed as long as the control instructions (the state information of the vehicle 100 does not need to meet certain conditions). The application module 520 may add the feedback attribute of the custom feedback to the control attribute of the preset control, so that whether the control is the preset control can be determined by whether the feedback attribute of the custom feedback exists or not.
In step S27, a response is made to the change of the property of the control corresponding to the operation of the control in the graphical user interface. The operation on the control in the graphical user interface comprises that a user hits any control on a displayed GUI page through a voice instruction. The change of the control attribute corresponding to the control operation in the graphical user interface comprises hitting any control according to the voice instruction content of the user and executing change operation on any attribute of the control, for example, adding a feedback attribute of custom feedback in the control attribute.
Further, when the control attribute is changed, the first voice interaction attribute corresponding to the control attribute is updated according to the change so as to obtain a second voice interaction attribute.
Step S28 is similar to "generate scene element information corresponding to the control according to the first voice interaction attribute" in step S23, and step S29 is similar to "construct a voice interaction scene according to the scene element information" in step S24, and details thereof are not repeated here.
Referring to fig. 8, in some embodiments, before step S12, the method for anomaly feedback further includes:
s32: the cloud 300 analyzes the voice instruction to determine a current scene identifier corresponding to the voice instruction and a current control attribute of the current control;
s34: the cloud 300 determines a current scene snapshot according to the current scene identification, wherein the scene identification of the current scene snapshot is the same as the current scene identification;
s36: the cloud 300 determines whether the current control attribute matches the control attribute of the control in the current scene snapshot;
s38: under the condition that the current control attribute is matched with the control attribute of the control, the cloud 300 determines the corresponding control as the current control.
Referring to fig. 3 and 4, in some embodiments, step S32, step S34, step S36 and step S38 may be implemented by the processing module 560. That is, the processing module 560 may be configured to parse the voice instruction to determine a current scene identifier corresponding to the voice instruction and a current control attribute of the current control; determining a current scene snapshot according to the current scene identification, wherein the scene identification of the current scene snapshot is the same as the current scene identification; judging whether the attributes of the current control are matched with the attributes of the control in the current scene snapshot; and under the condition that the current control attribute is matched with the control attribute of the control, determining the corresponding control as the current control.
In this way, the meaning expressed by the voice instruction can be determined through the scene snapshot, so that the voice instruction can be responded subsequently to realize corresponding operation.
Specifically, the voice module 540 may be configured to receive a voice instruction of a user and send the voice instruction to the processing module 560, and the processing module 560 may parse the voice instruction to determine the current scene identifier and the current control attribute of the current control. The current scene identifier is an identifier of a current scene snapshot, where the current scene snapshot corresponds to the current scene interaction information of the voice module 540 and the current graphical user interface of the application module 520. The current control attribute of the current control may include a label of the current control and data of the current control, for example, if the voice instruction is "unlock key remote parking", the label of the current control is "key remote parking", and the data of the current control is "unlock switch". Determining a current scene snapshot according to a current scene identifier, then judging whether a control attribute matched with the current control attribute of the current control exists in the current scene snapshot, for example, a label of the current control is "key remote parking", data of the current control is "open switch", judging whether a label matched with the "key remote parking" exists in the current scene snapshot, if so, taking the "key remote parking" as the current control and generating a corresponding scene event, for example, the scene event is instruction information "open key remote parking" and preset feedback information "help you open" that can be recognized by the voice module 540, and the processing module 560 may send the scene event to the voice module 540 so that the voice module 540 can respond to the scene event.
Referring to fig. 9, in some embodiments, after step S38, the method for anomaly feedback further includes:
s42: judging whether the current control has the feedback attribute of the user-defined feedback;
s44: and under the condition that the current control has the feedback attribute of the custom feedback, determining that the current control has the custom feedback.
Referring to fig. 3 and 4, in some embodiments, steps S42 and S44 may be implemented by the voice module 540, that is, the voice module 540 may be configured to determine whether the current control has a feedback attribute of the custom feedback; and under the condition that the current control has the feedback attribute of the custom feedback, determining that the current control has the custom feedback.
Specifically, after receiving the scene event of the processing module 560, the voice module 540 corresponds to the scene event, and determines whether the current control has a feedback attribute of the custom feedback, and if the current control has the feedback attribute of the custom feedback, it indicates that the current control needs to determine whether the voice instruction meets the execution condition of the current control according to the state information of the vehicle 100, so the voice module 540 may dispatch the scene event to the application module 520, the application module 520 may execute the scene event according to the execution logic of the GUI, and then determine whether the voice instruction meets the execution condition of the current control according to the state of the vehicle 100, and in the case that the voice instruction does not meet the execution condition, the voice module 540 may encapsulate the custom feedback information according to the state information of the vehicle 100 and send the custom feedback information to the voice module 540. Because each control can be a virtual button in the application module 520, the application module 520 can know what execution condition each control needs to satisfy and can normally execute, and therefore, the execution condition is judged by the application module 520, so that the judgment accuracy is higher, and the application module 520 is deployed in the vehicle 100, so that the state information of the vehicle 100 can be acquired more timely, and the judgment real-time performance is higher.
Referring to fig. 10, in some embodiments, the method for anomaly feedback further includes:
s52: and broadcasting the preset feedback information under the condition that the current control does not have the custom feedback.
Referring to fig. 3 and fig. 4, in some embodiments, the step S52 may be implemented by the voice module 540, that is, the voice module 540 may be configured to broadcast the preset feedback information when the current control does not have the custom feedback.
Therefore, when user-defined feedback is not needed, preset feedback information can be directly broadcasted, and the preset feedback information can be 'ok', opened/closed by your, and the like.
Referring to fig. 11, in some embodiments, the method for anomaly feedback further includes:
s62: and broadcasting the preset feedback information under the condition that the voice command meets the execution condition.
Referring to fig. 3 and fig. 4, in some embodiments, the step S62 may be implemented by the voice module 540, that is, the voice module 540 may be configured to broadcast the preset feedback information when the voice command meets the execution condition.
Therefore, under the condition that the voice instruction meets the execution condition, the voice instruction can be normally executed, namely, custom feedback is not needed at the moment, so that the preset feedback information can be directly broadcasted, and the preset feedback information can be ' ok ', opened/closed by you ', and the like.
Referring to fig. 12, in some embodiments, the anomaly feedback method includes:
s72: timing under the condition that the current control hit by the voice instruction has custom feedback;
s74: if the user-defined feedback information is received within the preset time, broadcasting the user-defined feedback information;
s76: and if the user-defined feedback information is not received within the preset time, broadcasting the preset feedback information.
Referring to fig. 3 and 4, in some embodiments, step S72, step S74, and step S76 may be implemented by the voice module 540, that is, the voice module 540 may be configured to time when the current control hit by the voice command has a custom feedback; if the user-defined feedback information is received within the preset time, broadcasting the user-defined feedback information; and if the user-defined feedback information is not received within the preset time, broadcasting the preset feedback information.
Specifically, under the condition that the current control hit by the voice instruction has the custom feedback, an event for delaying broadcasting of the preset feedback information can be started, and if the custom feedback information capable of being broadcasted is received within the delay time (preset time), the event for delaying broadcasting of the preset feedback information is deleted and the custom feedback information is broadcasted; if the user-defined feedback information which can be broadcasted is not received within the delay time, for example, the voice instruction meets the execution condition of the current control or the user-defined feedback information has errors, the preset feedback information is broadcasted after the timing is finished. Therefore, whether the user-defined feedback information or the preset feedback information is broadcasted can be selected under different conditions. The preset time is, for example, 1S.
Referring to fig. 13, the in-vehicle terminal 20 according to the embodiment of the present invention may be used in a vehicle 100. The in-vehicle terminal 20 includes one or more processors 22 and a memory 24, the memory 24 stores a computer program, and when the computer program is executed by the processor 22, the steps of the abnormality feedback method according to any one of the above embodiments are implemented.
The abnormality feedback method according to the embodiment of the present invention may be implemented by the in-vehicle terminal 20 according to the embodiment of the present invention, for example, step S12, step S14, and step S16 may all be implemented by the in-vehicle terminal 20, that is, in a case where the computer program is executed by the processor 22, the following abnormality feedback method may be implemented: under the condition that the current control hit by the voice instruction has custom feedback, judging whether the voice instruction meets the execution condition of the current control according to the state information of the vehicle 100; under the condition that the voice command does not accord with the execution condition, obtaining self-defined feedback information according to the state information; and broadcasting the self-defined feedback information.
In the above embodiment, the abnormality feedback methods implemented by the application module 520, the voice module 540 and the processing module 560 may all be implemented by the processor 22, or the abnormality feedback methods implemented by the application module 520 and the voice module 540 may be implemented by the processor 22, and the abnormality feedback method implemented by the processing module 560 is implemented by the cloud 300, which is not limited specifically herein.
In the vehicle-mounted terminal 10 according to the embodiment of the present invention, when the current control has the custom feedback and the voice instruction does not meet the execution condition of the current control, the custom feedback information is obtained according to the state information and broadcasted, so that different current controls have different custom feedback information, and the state information of the vehicle can be accurately prompted to the user through the custom feedback information, so that the user can know whether the voice instruction cannot be executed or not and the reason why the voice instruction cannot be executed.
Referring to fig. 2, a vehicle 100 according to an embodiment of the present invention includes a body 10 and a vehicle-mounted terminal 20 according to any one of the embodiments described above, and the vehicle-mounted terminal 20 is mounted on the body 10.
In the vehicle 100 according to the embodiment of the present invention, when the current control has the custom feedback and the voice instruction does not meet the execution condition of the current control, the custom feedback information is obtained according to the state information and broadcasted, so that different current controls have different custom feedback information, and the state information of the vehicle can be accurately prompted to the user through the custom feedback information, so that the user can know whether the voice instruction cannot be executed or not and the reason why the voice instruction cannot be executed.
Specifically, the vehicle 100 includes, but is not limited to, a pure electric vehicle, a hybrid electric vehicle, an extended range electric vehicle, a fuel vehicle, and the like. The vehicle 100 may be connected to the cloud 300 through a wireless communication manner (e.g., WIFI, a mobile communication network, etc.).
In the present invention, the computer program comprises computer program code. The computer program code may be in the form of source code, object code, an executable file or some intermediate form, etc. The memory 104 may include high-speed random access memory and may also include non-volatile memory such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device. The Processor 102 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (10)
1. An abnormality feedback method for a vehicle, characterized by comprising:
under the condition that the current control hit by the voice instruction has custom feedback, judging whether the voice instruction meets the execution condition of the current control according to the state information of the vehicle;
under the condition that the voice instruction does not accord with the execution condition, obtaining self-defined feedback information according to the state information;
and broadcasting the user-defined feedback information.
2. The anomaly feedback method according to claim 1, wherein the vehicle is used for communicating with a cloud, and in the case that the current control hit by the voice command has custom feedback, before judging whether the voice command meets the execution condition of the current control according to the state information of the vehicle, the anomaly feedback method further comprises:
pre-creating a UI control library for an application program;
when a graphical user interface of the application program is displayed, acquiring a control list of the graphical user interface, wherein the control list comprises a plurality of controls;
acquiring a first voice interaction attribute of the control from the UI control library according to a preset strategy and generating scene element information corresponding to the control according to the first voice interaction attribute, wherein the first voice interaction attribute is generated according to the control attribute of the control through the UI control library;
constructing a voice interaction scene according to the scene element information and uploading the voice interaction scene to the cloud;
the cloud generates a scene snapshot according to the voice interaction scene, wherein the scene snapshot comprises scene identification and control attributes of each control, and the control attributes comprise at least one of identification, labels, feedback attributes, timestamps, names, types and data of the controls.
3. The abnormality feedback method according to claim 2, wherein in a case where the current control hit by the voice command has custom feedback, before determining whether the voice command meets an execution condition of the current control according to the state information of the vehicle, the abnormality feedback method further comprises:
adding the feedback attribute of the user-defined feedback to the control attribute of the preset control; responding to the change of the control attribute of the preset control, and updating the first voice interaction attribute according to the change to obtain a second voice interaction attribute;
generating updated scene element information according to the second voice interaction attribute;
and constructing an updated voice interaction scene according to the updated scene element information.
4. The abnormality feedback method according to claim 3, wherein in a case where the current control hit by the voice command has custom feedback, before determining whether the voice command meets an execution condition of the current control according to the state information of the vehicle, the abnormality feedback method further comprises:
the cloud terminal analyzes the voice instruction to determine a current scene identification corresponding to the voice instruction and a current control attribute of the current control;
the cloud end determines a current scene snapshot according to a current scene identification, wherein the scene identification of the current scene snapshot is the same as the current scene identification;
the cloud end judges whether the current control attribute is matched with the control attribute of the control in the current scene snapshot;
and under the condition that the current control attribute is matched with the control attribute of the control, the cloud end determines the corresponding control to be used as the current control.
5. The anomaly feedback method according to claim 4, wherein after the cloud determines the corresponding control as the current control in the case that the current control attribute matches the control attribute of the control, the anomaly feedback method further comprises:
judging whether the current control has the feedback attribute;
determining that the current control has custom feedback if the current control has the feedback attribute.
6. The abnormality feedback method according to claim 1, further comprising:
and broadcasting preset feedback information under the condition that the voice command meets the execution condition.
7. The abnormality feedback method according to claim 1, characterized in that the abnormality feedback method comprises:
timing when the current control hit by the voice instruction has custom feedback;
if the user-defined feedback information is received within the preset time, broadcasting the user-defined feedback information;
and broadcasting the preset feedback information if the user-defined feedback information is not received within the preset time.
8. An abnormality feedback device for a vehicle, characterized by comprising:
the application module is used for judging whether the voice instruction meets the execution condition of the current control or not according to the state information of the vehicle under the condition that the current control hit by the voice instruction has custom feedback, and acquiring custom feedback information according to the state information under the condition that the voice instruction does not meet the execution condition;
and the voice module is used for broadcasting the custom feedback information.
9. An in-vehicle terminal for a vehicle, characterized in that the in-vehicle terminal comprises one or more processors and a memory, the memory storing a computer program that, when executed by the processors, implements the steps of the anomaly feedback method of any one of claims 1-7.
10. A vehicle characterized by comprising a body and the in-vehicle terminal of claim 9 mounted to the body.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110775341.6A CN113535112B (en) | 2021-07-09 | 2021-07-09 | Abnormality feedback method, abnormality feedback device, vehicle-mounted terminal and vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110775341.6A CN113535112B (en) | 2021-07-09 | 2021-07-09 | Abnormality feedback method, abnormality feedback device, vehicle-mounted terminal and vehicle |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113535112A true CN113535112A (en) | 2021-10-22 |
| CN113535112B CN113535112B (en) | 2023-09-12 |
Family
ID=78098137
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110775341.6A Active CN113535112B (en) | 2021-07-09 | 2021-07-09 | Abnormality feedback method, abnormality feedback device, vehicle-mounted terminal and vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113535112B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115788185A (en) * | 2022-10-28 | 2023-03-14 | 成都赛力斯科技有限公司 | Vehicle locking prompt system, method, computer equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105895093A (en) * | 2015-11-02 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Voice information processing method and device |
| CN106992009A (en) * | 2017-05-03 | 2017-07-28 | 深圳车盒子科技有限公司 | Vehicle-mounted voice exchange method, system and computer-readable recording medium |
| CN109960537A (en) * | 2019-03-29 | 2019-07-02 | 北京金山安全软件有限公司 | Interaction method and device and electronic equipment |
| US20200057604A1 (en) * | 2018-08-14 | 2020-02-20 | Alticast Corporation | Graphical user interface (gui) voice control apparatus and method |
| CN111002996A (en) * | 2019-12-10 | 2020-04-14 | 广州小鹏汽车科技有限公司 | Vehicle-mounted voice interaction method, server, vehicle and storage medium |
-
2021
- 2021-07-09 CN CN202110775341.6A patent/CN113535112B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105895093A (en) * | 2015-11-02 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Voice information processing method and device |
| CN106992009A (en) * | 2017-05-03 | 2017-07-28 | 深圳车盒子科技有限公司 | Vehicle-mounted voice exchange method, system and computer-readable recording medium |
| US20200057604A1 (en) * | 2018-08-14 | 2020-02-20 | Alticast Corporation | Graphical user interface (gui) voice control apparatus and method |
| CN109960537A (en) * | 2019-03-29 | 2019-07-02 | 北京金山安全软件有限公司 | Interaction method and device and electronic equipment |
| CN111002996A (en) * | 2019-12-10 | 2020-04-14 | 广州小鹏汽车科技有限公司 | Vehicle-mounted voice interaction method, server, vehicle and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115788185A (en) * | 2022-10-28 | 2023-03-14 | 成都赛力斯科技有限公司 | Vehicle locking prompt system, method, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113535112B (en) | 2023-09-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Chen et al. | Android/OSGi-based vehicular network management system | |
| US20220244945A1 (en) | Vehicle controller, program updating method, and non-transitory storage medium that stores program for updating program | |
| CN109445783B (en) | Method and device for constructing dynamic configuration application driven by service | |
| CN101608925B (en) | Feedback method, terminal and server of information of geographic elements of navigation electronic map | |
| US20150186548A1 (en) | System and method for acquiring data of electronic control unit | |
| CN109407931B (en) | Control method of vehicle-mounted control touch screen and electronic control equipment | |
| CN102883306A (en) | Enhanced smartphone in-vehicle accommodation | |
| CN112092803B (en) | Automatic parking method and device, medium, equipment and vehicle | |
| CN102901511A (en) | Vehicle navigation method and system, terminal and mobile terminal, cloud server | |
| CN113253971A (en) | Voice interaction method and device, voice interaction system, vehicle and medium | |
| CN112770952B (en) | Improvements to system controllers | |
| CN113535112A (en) | Abnormity feedback method, abnormity feedback device, vehicle-mounted terminal and vehicle | |
| CN112887342B (en) | Service scheduling method, vehicle-mounted service processing system, electronic device and storage medium | |
| CN107708064B (en) | Method and system for positioning mobile phone by vehicle-mounted equipment | |
| US20180352040A1 (en) | Method for data transmission in a transportation vehicle communication network, transportation vehicle communication network, subscribers and transportation vehicle | |
| AU2018432003A1 (en) | Video processing method and device, and terminal and storage medium | |
| CN102902579A (en) | Processing system for functional assembly | |
| CN106375862A (en) | GIF picture acquisition method and apparatus, and terminal | |
| CN115269034A (en) | Method and device for acquiring vehicle-mounted machine program, cloud server and storage medium | |
| US20200257413A1 (en) | Vehicular avnt system, method of controlling the same and vehicle including the same | |
| CN113580933B (en) | Remote setting system, method and readable storage medium for automobile display interface | |
| CN117272521A (en) | Vehicle scene arrangement method, device, equipment and medium | |
| CN114629740B (en) | Vehicle-mounted can signal receiving and transmitting method and device, vehicle-mounted system, computer equipment and storage medium | |
| CN203929081U (en) | Be installed on the convenience-for-people guider in commerial vehicle | |
| KR102418309B1 (en) | Device for providing notification messages seamlessly in vehicle and operating method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |