CN113879235A - Method, system, equipment and storage medium for multi-screen control of automobile - Google Patents
Method, system, equipment and storage medium for multi-screen control of automobile Download PDFInfo
- Publication number
- CN113879235A CN113879235A CN202010617788.6A CN202010617788A CN113879235A CN 113879235 A CN113879235 A CN 113879235A CN 202010617788 A CN202010617788 A CN 202010617788A CN 113879235 A CN113879235 A CN 113879235A
- Authority
- CN
- China
- Prior art keywords
- intention
- automobile
- screen
- driving
- driving state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000001755 vocal effect Effects 0.000 claims description 31
- 238000004590 computer program Methods 0.000 claims description 27
- 238000001514 detection method Methods 0.000 claims description 18
- 238000004891 communication Methods 0.000 claims description 7
- 230000006870 function Effects 0.000 description 31
- 238000004458 analytical method Methods 0.000 description 9
- 238000003058 natural language processing Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 244000062793 Sorghum vulgare Species 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 230000002650 habitual effect Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 235000019713 millet Nutrition 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
- B60R16/0373—Voice control
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- User Interface Of Digital Computer (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The invention relates to the technical field of automobiles, in particular to a method, a system, equipment and a storage medium for multi-screen control of an automobile, wherein the method comprises the following steps: receiving a voice instruction and acquiring the intention of the voice instruction; detecting a driving state and a passenger state of the automobile; and controlling the operation of the multiple automobile screens according to the intention, the driving state and the related operation records. Therefore, the invention realizes multi-screen control of the automobile, and distinguishes the operation intentions of the driver or the passenger so that the corresponding intentions can be operated on the corresponding screen.
Description
Technical Field
The invention relates to the technical field of automobiles, in particular to a method, a system, equipment and a storage medium for multi-screen control of an automobile.
Background
The man-machine conversation is a working mode of a computer, namely, a computer operator or a user and the computer work in a conversation mode through a console or a terminal display screen. An operator may tell a computer to perform a task with a command or a command process. Man-machine conversation is widely applied to various technical fields and lives of people, serves the society, but the technical content is quite complex.
As shown in fig. 1, the bottom-most left, is the most basic big data, machine learning and Linguistics (Linguistics); in the above, the map is a Knowledge map (Knowledge Graph) which comprises an entity map, an attention map and an intention map. Further, the left side is Language Understanding (Language Understanding), and the right side is Language Generation (Language Understanding), including Query Understanding, text Understanding, emotion Analysis (Sentiment Analysis), and other analyses at different levels, such as Lexical (Lexical), syntactic (Syntax), and Semantic (Semantic). Language generation, including writing, reading comprehension, and the like. The top is a system level, which comprises a question-answering system, a machine translation system and a dialogue system. At the far right, are various application scenarios, including search, feeds stream, O2O, advertisement, and so on.
In the face of such a scenario, how to better pick up voice of VAD according to voice instruction of user is a problem to be solved by the present invention. In the N LP (Natural Language Processing), the intention represents the purpose that the user wants to achieve, and is expressed in Language expression as "what the user wants to do", and the problem of communication between people and machines is solved. What is meant to be composed of? In the Android internet, an Action, data and some attributes form the Android internet, in NLU, which means natural language understanding, and in N LP, an intention can be expressed by a slot, which is the parameter information of the intention. A slot refers to a specific concept extracted from a sentence. Say for example "how do the weather today" what the intention is for a conversational smart device? The intent is to "inquire about weather". That intention is expressed by which slots? "today" and "Beijing".
After BATM (Baidu, Ali, Tencent, millet) started to enter the main car networking in 2016, another climax of the car networking was initiated. Automobile manufacturers refer to the priority of the intellectualization of the on-board system to the height of the selling point. At present, many automobile manufacturers are equipped with a control screen of a vehicle-mounted system in a driver seat of an automobile, and a user can control the automobile to play music, open an air conditioner, adjust windows and the like only by speaking a corresponding awakening word or clicking a voice awakening button on a screen of an attached drawing. In order to attract consumers, the current high-end vehicle models are provided with corresponding screens on the backseat for entertainment of people on the backseat.
The rear seat screen does not necessarily have to be provided with a front microphone array to pick up sound, as this may lead to safety for the main driver. And if the backseat screen does not have the voice control function, or at ordinary times, parents in order to control the watching time of children in the backseat, the function that the screen at the front end can control the backseat screen is actually needed. And voice is the best means for realizing the control of the backseat screen by the front seat. However, during driving, the front and rear seats are different in terms of functional requirements. At present, however, the technology of the front-end microphone array cannot well distinguish who sends a corresponding instruction to the vehicle-mounted system, and although some vehicle models can help to identify who sends an instruction to the vehicle screen through detection of the camera or the direction of the sound source. Meanwhile, the BATM does not have a good scheme to help distinguish the operation intentions of the driver, so that the corresponding intentions can be executed on the corresponding screen, for example, audio or video playing can be performed on the corresponding screen, or the vehicle-mounted system can be accurately judged before the intentions are executed.
In view of the above, the prior art is obviously inconvenient and disadvantageous in practical use, and needs to be improved.
Disclosure of Invention
In view of the foregoing drawbacks, an object of the present invention is to provide a method, a system, a device, and a storage medium for multi-screen control of an automobile, so that the multi-screen control of the automobile realizes distinguishing an operation intention of a driver or a passenger, so that the corresponding intention can be operated on a corresponding screen.
In order to achieve an object of the present invention, there is provided a method for multi-screen control of an automobile, the method including:
receiving a voice instruction and acquiring the intention of the voice instruction;
detecting a driving state and a passenger state of the automobile;
and controlling the operation of the multiple automobile screens according to the intention, the driving state and the related operation records.
According to the method, the receiving a voice instruction and the obtaining the intention of the voice instruction comprise:
receiving voice of the voice instruction;
recognizing the speech as corresponding text;
and analyzing the text according to pre-stored big data information to obtain the field category to which the text belongs and the corresponding intention.
According to the method, the detecting the driving state and the passenger state of the automobile comprises the following steps:
detecting whether the automobile is in a running state or a stopped running state at present;
and detecting whether a person sits on the front seat and/or the rear seat of the automobile.
According to the method, the automobile multi-screen comprises the following steps: the screen is at least arranged on the front seat of the automobile and the screen is arranged on the rear seat of the automobile;
the operation of controlling the multiple automobile screens according to the intention, the driving state and the relevant operation records comprises the following steps:
when the intention is an intention related to driving and/or a vocal intention, the automobile is in a driving state, and people are in the front seat, controlling an operation function corresponding to the intention to operate on a screen of the front seat of the automobile;
when the intention is an intention and/or a vocal intention related to driving, but the intention and/or vocal intention related to driving does not conform to the related operation record, and the automobile is in a driving state and a person is in the front seat, an operation function corresponding to the intention is prompted and confirmed on a screen of the automobile front seat;
when the intention is an intention and/or a video intention which is not related to driving, the automobile is in a driving state, and people are in the rear seat, controlling an operation function corresponding to the intention to operate on a screen of the rear seat of the automobile;
and when the intention is an intention related to driving and/or a vocal intention, the automobile is in a stop driving state, and a person is in the front seat, controlling an operation function corresponding to the intention to operate on a screen of the front seat of the automobile.
According to the method, the vocal intention is an intention of playing an audio file or an intention of voice call; the video intention is an intention for playing a video file or a video call intention;
the related operation records are stored in a cloud server in communication connection with a vehicle-mounted system of the automobile; or in a storage medium of an on-board system of the car.
According to the method, the detecting whether the automobile is currently in a running state or a stopped running state comprises the following steps:
detecting whether the current running speed of the automobile is greater than a preset speed per hour, and if so, judging that the automobile is in a running state currently;
and detecting whether the current running speed of the automobile is zero or not and whether the duration time is longer than the preset time or not, and judging that the automobile is in a running stop state currently if the current running speed of the automobile is zero and the duration time is longer than the preset time.
In order to achieve another object of the present invention, the present invention further provides a system for multi-screen control of an automobile, the system comprising:
the intention acquisition module is used for receiving a voice instruction and acquiring the intention of the voice instruction;
the detection module is used for detecting the driving state and the passenger state of the automobile;
and the intention control module is used for controlling the operation of the multiple automobile screens according to the intention, the driving state and the relevant operation records.
In order to achieve still another object of the present invention, the present invention also provides a terminal including the above system.
To achieve still another object of the present invention, the present invention also provides a storage medium storing a computer program for executing any one of the methods described above.
To achieve still another object of the present invention, the present invention further provides a computer device including a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, the processor implementing any one of the above methods when executing the computer program.
The invention receives the voice command firstly, and the voice command is sent by a driver or a passenger of the automobile. And then according to the received voice instruction, acquiring the intention of a driver or a passenger of the automobile, after acquiring the intention of the user, detecting the driving state of the automobile, and finally controlling the multi-screen operation of the automobile according to the acquired intention, the driving state and the related operation record. The operation intention of distinguishing the driver is realized, so that the corresponding intention can be operated on the corresponding screen, the complicated operation of secondary confirmation of the user is avoided, and the intelligence of automobile driving is improved.
Drawings
FIG. 1 is a theoretical block diagram of a man-machine dialog management system in the related art;
FIG. 2 is a flowchart of a method for controlling multiple screens of an automobile according to an embodiment of the present invention;
FIG. 3 is a block diagram of a multi-screen control system for an automobile according to an embodiment of the present invention;
FIG. 4 is a block diagram of a multi-screen control system for an automobile according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of a storage medium according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a computer device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It should be noted that references in the specification to "one embodiment," "an example embodiment," etc., indicate that the embodiment described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not intended to refer to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is submitted that it is within the knowledge of one skilled in the art to effect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.
Moreover, where certain terms are used throughout the description and following claims to refer to particular components or features, those skilled in the art will understand that manufacturers may refer to a component or feature by different names or terms. This specification and the claims that follow do not intend to distinguish between components or features that differ in name but not function. In the following description and in the claims, the terms "include" and "comprise" are used in an open-ended fashion, and thus should be interpreted to mean "include, but not limited to. In addition, the term "connected" as used herein includes any direct and indirect electrical connection. Indirect electrical connection means include connection by other means.
Referring to fig. 2, in an embodiment of the present invention, a method for multi-screen control of an automobile is provided, the method comprising:
in step S201, a voice instruction is received, and an intention of the voice instruction is acquired;
in step S202, a driving state and a passenger state of the automobile are detected;
and in step S203, controlling the operation of the multiple automobile screens according to the intention, the driving state and the relevant operation records.
In this embodiment, a voice command is first received, the voice command being issued by a driver or passenger of the vehicle. According to the received voice instruction, the intention of the driver or the passenger of the automobile is judged, such as playing audio, turning on an air conditioner and the like. After the intention of the user is obtained, the driving state of the automobile is detected, and the driving state of the automobile needs to be judged because the accuracy of executing the voice command can be improved in the driving process of the automobile or different driving stopping states of the automobile. For example, if the automobile is in a high-speed driving state, the voice command for opening the window is received to display that whether the voice command is a reasonable intention of the automobile driver needs to be judged. And finally, controlling the operation of multiple automobile screens according to the obtained intention, the driving state and relevant operation records, such as some habitual operations of the driver, for example, adjusting the temperature of an air conditioner to 22 ℃, or playing music frequently listened by the driver. The method and the device realize the distinguishing of the operation intentions of the driver, so that the corresponding intentions can be operated on the corresponding screen, such as playing videos, or the vehicle-mounted system can have more accurate judgment before the intention is executed. Wherein, many screens of car include: the screen is at least arranged on the front seat of the automobile and the screen is arranged on the rear seat of the automobile; of course, one or more screens may be provided at other locations in the vehicle, but primarily at the main screen of the main driver's seat.
In one embodiment of the present invention, the receiving a voice instruction and the intent to retrieve the voice instruction includes:
receiving voice of the voice instruction;
recognizing the speech as corresponding text;
and analyzing the text according to pre-stored big data information to obtain the field category to which the text belongs and the corresponding intention.
In this embodiment, a voice command issued by a passenger or a driver is received, the voice is recognized as a corresponding text, the text is a language text which can be recognized by a machine, the text is analyzed according to pre-stored big data information, the big data information is data information of which an approved intention is obtained finally according to some voice commands of people, and therefore a field category to which the text belongs and the corresponding intention are obtained, wherein the field category to which the text belongs comprises various intentions under various categories such as automobile driving or e-commerce shopping, daily life service and the like, and the voice command is an expression of each intention. In one embodiment of the present invention, ASR (Automatic Speech Recognition) and NLP (non-linear Speech Recognition) technologies, and DM (Dialog Management) Dialog Management engine technologies are used, which implement human-computer Dialog.
In one embodiment of the present invention, the detecting the driving state and the passenger state of the automobile includes:
detecting whether the automobile is in a running state or a stopped running state at present;
and detecting whether a person sits on the front seat and/or the rear seat of the automobile.
In this embodiment, the determination of whether the automobile is in a driving state facilitates accurate execution of the acquired intention, and in addition, the detection of whether a person is seated on the front seat and/or the rear seat of the automobile also facilitates the operation of the intention execution of multiple automobile screens. The detecting whether the automobile is in a running state or a stopped running state comprises the following steps:
detecting whether the current running speed of the automobile is greater than a preset speed per hour, and if so, judging that the automobile is in a running state currently; if the speed per hour is greater than 5 km/h, and if the speed per hour is zero at the moment, the automobile is in a stop driving state;
and detecting whether the current running speed of the automobile is zero or not and whether the duration time is longer than the preset time or not, and judging that the automobile is in a running stop state currently if the current running speed of the automobile is zero and the duration time is longer than the preset time. For example, if the vehicle stops traveling for more than 5 minutes, it can be determined that the vehicle has stopped traveling, and is traveling while holding the vehicle in a traffic jam state although the speed per hour is small.
In one embodiment of the invention, the operation of controlling the multiple screens of the automobile according to the intention, the driving state and the relevant operation records comprises the following steps:
when the intention is an intention related to driving and/or a vocal intention, the automobile is in a driving state, and people are in the front seat, controlling an operation function corresponding to the intention to operate on a screen of the front seat of the automobile; if the main driver says the intention related to driving and partial vocal intention, and if the screen viewing is not involved, the function corresponding to the intention is realized on the front seat screen by default. The vocal intention is an intention of playing an audio file or an intention of voice call; such as playing music or making a voice call with a specified object.
When the intention is an intention and/or a vocal intention related to driving, but the intention and/or vocal intention related to driving does not conform to the related operation record, and the automobile is in a driving state and a person is in the front seat, an operation function corresponding to the intention is prompted and confirmed on a screen of the automobile front seat; if the obtained intention does not accord with the related operation record, namely the operation prompt with larger difference with the past history record or the past intention instruction confirms the operation function corresponding to the intention, if the current intention is to play the video, the prompt confirms whether to play the video in the rear seat, thereby controlling the passenger in the rear seat, such as the content or time of playing the video by the passenger for children, and carrying out effective management control on video playing. Or the current driving-related intention is to initiate an automatic driving mode, the corresponding intention handling function can only be implemented on the screen of the front seat.
When the intention is an intention and/or a video intention which is not related to driving, the automobile is in a driving state, and people are in the rear seat, controlling an operation function corresponding to the intention to operate on a screen of the rear seat of the automobile; in this case, the intention unrelated to driving generally includes control of various parts of the automobile, such as turning on of a lamp, a wiper, and the like, and if these intentions are received and the rear seat occupant is usually an intention of a rear seat passenger, such as an adult who may wish to turn on a rear reading lamp, or watch a video program on a screen of the rear seat, or make a voice call with a specified person, an operation function corresponding to the corresponding intention is operated on the screen of the rear seat of the automobile.
And when the intention is an intention related to driving and/or a vocal intention and/or a video intention, the automobile is in a stop driving state, and a person is in the front seat, controlling an operation function corresponding to the intention to operate on a screen of the front seat of the automobile. If the intention of playing the video is acquired and the automobile is detected not to be in the running state, the video is played in the front seat by default without any prompt, because the automobile stops running at the moment, a driver may have a rest in the automobile or wait for the driver to listen to music or turn off the automobile lamps and the like.
In addition, preferably, the relevant operation records are stored in a cloud server in communication connection with an on-board system of the automobile; or in a storage medium of an on-board system of the car. Each time a record of the intention received at the vehicle and the associated action of the corresponding driver or passenger is recorded, data support is provided for the following better service driver and passenger, which information can be stored in the cloud or in a storage medium of the vehicle system of the vehicle.
In order to achieve another object of the present invention, the present invention further provides a system 100 for multi-screen control of an automobile, for implementing the method in the above embodiments, where the system 100 includes:
an intention acquisition module 10, configured to receive a voice instruction and acquire an intention of the voice instruction;
a detection module 20 for detecting a driving state and a passenger state of the automobile;
and the intention control module 30 is used for controlling the operation of the multiple automobile screens according to the intention, the driving state and the relevant operation records.
In this embodiment, the intention acquisition module 10 receives a voice instruction, which is issued by a driver or a passenger of the automobile, and acquires a corresponding intention according to the language instruction; the detection module 20 detects the driving state and the passenger state of the automobile; finally, the intention control module 30 controls the operation of the multiple screens of the automobile according to the intention, the driving state and the relevant operation records. Therefore, the intelligent operation intention of the driver can be distinguished through the help, so that the corresponding intention can be played on the corresponding screen, or the vehicle-mounted system can accurately judge and give a corresponding prompt before the intention is executed, secondary operation of the driver or passengers is omitted, and the whole operation is more intelligent. Wherein, many screens of car include: the screen is arranged at least on the front seat of the automobile and the screen is arranged on the rear seat of the automobile.
In one embodiment of the present invention, the intention acquisition module 10 includes:
the voice receiving submodule 11 is used for receiving voice of the voice instruction;
a voice recognition submodule 12, configured to recognize the voice as a corresponding text;
and the analysis submodule 13 is configured to analyze the text according to the pre-stored big data information, and obtain a field category to which the text belongs and a corresponding intention.
In this embodiment, the voice receiving sub-module 11 receives the voice of the voice instruction, which may be received by the microphone; the speech recognition submodule 12 recognizes the speech as a corresponding text, and the text is a language text which can be recognized by a machine; the analysis submodule 13 analyzes the text according to the pre-stored big data information to obtain the field category to which the text belongs and the corresponding intention. Specifically, the speech receiving submodule 11, the speech recognition submodule 12, and the analysis submodule 13 are implemented by using an ASR technology and an NLP technology, and after receiving a speech recognition instruction, convert the speech recognition instruction into a language that can be understood by a machine, and send the data to the NLP semantic processing engine, so that the NLP analyzes the domain type to which the speech recognition instruction belongs and the corresponding intention after receiving the speech instruction.
In one embodiment of the present invention, the detection module 20 includes:
a first detection submodule 21 configured to detect whether the vehicle is currently in a driving state or a stopped driving state;
and the second detection submodule 22 is used for detecting whether a person sits on the front seat and/or the rear seat of the automobile.
The first detection submodule 21 detects that the current running speed of the automobile is greater than a preset speed per hour, and judges that the automobile is currently in a running state; and
the first detection submodule 21 detects that the current running speed of the automobile is zero, and the duration time is longer than the preset time, and judges that the automobile is currently in a running stop state. The intention can be better executed on the corresponding automobile screen by checking the current driving state of the automobile and the riding condition in the automobile.
In one embodiment of the present invention, the intent manipulation module 30 includes:
a first intention manipulation module 31, configured to, when the intention is an intention related to driving and/or a vocal intention, and the automobile is in a driving state and a person is in the front seat, control an operation function corresponding to the intention to operate on a screen of the front seat of the automobile;
when the intention is an intention and/or a vocal intention related to driving, but the intention and/or vocal intention related to driving does not conform to the related operation record, and the automobile is in a driving state and a person is in the front seat, an operation function corresponding to the intention is prompted and confirmed on a screen of the automobile front seat;
a second intention manipulation module 32, configured to, when the intention is an intention unrelated to driving and/or a video intention, and the automobile is in a driving state and a person is in the rear seat, control an operation function corresponding to the intention to operate on a screen of the rear seat of the automobile;
and a third intention manipulation module 33, configured to, when the intention is an intention related to driving and/or a vocal intention, and the automobile is in a stop driving state and a person is in the front seat, control an operation function corresponding to the intention to operate on a screen of the front seat of the automobile.
In this embodiment, the vocal intention is an intention to play an audio file or an intention to talk with voice; the video intention is an intention for playing a video file or a video call intention; the related operation records are stored in a cloud server in communication connection with a vehicle-mounted system of the automobile; or in a storage medium of an on-board system of the car. In one embodiment of the invention, if two or more corresponding screens are arranged on the front seat and the rear seat of the automobile, when the automobile is detected to belong to a driving state, people exist on the front seat and the rear seat of the automobile. The intention manipulation module 30 may be implemented by the DM session management, after the intention is obtained by the intention obtaining module 10, send the intention to the DM session management engine for further analysis, and compare it with the past history of operations or plays of the related intention instructions on the front screen. The intention and part of the intention related to driving which is not related to the screen viewing, that is, the intention of playing an audio file or the intention of voice call as described above, are played on the screen at the front end by default, and the intention related to screen viewing is played on the screen at the rear seat. The DM session management engine prompts whether or not an operation prompt having a large difference from the past history or the past intention instruction is played in the backseat. And when the automobile is detected not to belong to the driving state, the automobile is played in the front seat by default without any prompt. Furthermore, when the main driver speaks an intention related to driving and a part of vocal intention (not related to screen viewing), the corresponding function may be implemented on the front seat screen by default.
In addition, after the intention acquisition module 10 acquires the intention, the intention is sent to the intention manipulation module 30, and the intention manipulation module 30 is implemented by using a DM session management engine, which may be disposed in the vehicle-mounted system or a cloud server. The intention manipulation module 30 performs further analysis and compares it with past history of operation or play of the relevant intention instruction on the front-end screen. In general, the intention related to driving and the intention partially not related to the screen viewing may be played by default on the screen at the front end, and the intention related to the screen viewing may be played on the screen at the rear seat. If the intention of the voice instruction of the user is to play the popular music after being analyzed and understood by the NLP, the popular music is played at the front end by default, and if the voice instruction related to the playing is played for the 'playing celebration remaining year', whether the popular music is played at the backseat or not is prompted after the voice instruction is ended by default. The DM session management engine prompts whether or not an operation prompt having a large difference from the past history or the past intention instruction is played in the backseat. If the music frequently listened to by the past user is mainly popular music, the voice instruction is the intention of playing the children song, and whether the children song is played in the backseat or not is prompted. And if the automobile is detected not to belong to the driving state, if the user stops or the automobile is blocked for a long time, the voice instruction of the user is normally instructed, the voice instruction is played in the front seat by default, and no prompt is given. Of course, there are many possible combinations, and the description will be repeated in the present invention.
In addition, in order to achieve another object of the present invention, the present invention also provides a terminal including the system 100 described in any one of the above. The terminal is an automobile screen arranged on the automobile, such as a front seat screen or a rear seat screen.
To achieve another object of the present invention, the present invention also provides a computer program storing a program for executing any one of the methods described above.
In order to achieve another object of the present invention, the present invention further provides a computer device 400, which includes a storage medium 200, a processor 300, and a computer program stored on the storage medium and executable on the processor 300, wherein the processor 300 implements any one of the methods described above when executing the computer program.
Referring to fig. 5 and 6, in an embodiment of the present invention, there is also provided a storage medium 200 for storing a computer program for executing any one of the methods in the above embodiments. And a computer device 400 comprising a storage medium 200, a processor 300 and a computer program stored on said storage medium 200 and executable on said processor 300, said processor 300 implementing said method in any of the above embodiments when executing said computer program.
The invention provides a storage medium 200 for storing a computer program according to any of the methods described in fig. 2. Such as computer program instructions, which when executed by a computer, may invoke or otherwise provide methods and/or techniques in accordance with the present application through the operation of the computer. Program instructions which invoke the methods of the present application may be stored on fixed or removable storage media and/or transmitted via a data stream over a broadcast or other signal-bearing medium and/or stored on a storage medium of a computer device operating in accordance with the program instructions. Here, an embodiment according to the present application includes a computer device 400 as shown in fig. 6, the computer device 400 preferably includes a storage medium 200 for storing a computer program and a processor 300 for executing the computer program, wherein when the computer program is executed by the processor 300, the computer device 400 is triggered to execute the method and/or the technical solution according to the foregoing embodiments.
It should be noted that the present application may be implemented in software and/or a combination of software and hardware, for example, implemented using Application Specific Integrated Circuits (ASICs), general purpose computers or any other similar hardware devices. In one embodiment, the software programs of the present application may be executed by a processor to implement the above steps or functions. Likewise, the software programs (including associated data structures) of the present application may be stored in a computer readable recording medium, such as RAM memory, magnetic or optical drive or diskette and the like. Additionally, some of the steps or functions of the present application may be implemented in hardware, for example, as circuitry that cooperates with the processor to perform various steps or functions.
The method according to the invention can be implemented on a computer as a computer-implemented method, or in dedicated hardware, or in a combination of both. Executable code for the method according to the invention or parts thereof may be stored on a computer program product. Examples of computer program products include memory devices, optical storage devices, integrated circuits, servers, online software, and so forth. Preferably, the computer program product comprises non-transitory program code means stored on a computer readable medium for performing the method according to the invention when said program product is executed on a computer.
In a preferred embodiment, the computer program comprises computer program code means adapted to perform all the steps of the method according to the invention when the computer program is run on a computer. Preferably, the computer program is embodied on a computer readable medium.
In summary, the present invention receives a voice command first, and the voice command is sent by a driver or a passenger of a vehicle. And then according to the received voice instruction, acquiring the intention of a driver or a passenger of the automobile, after acquiring the intention of the user, detecting the driving state of the automobile, and finally controlling the multi-screen operation of the automobile according to the acquired intention, the driving state and the related operation record. The operation intention of distinguishing the driver is realized, so that the corresponding intention can be operated on the corresponding screen, the complicated operation of secondary confirmation of the user is avoided, and the intelligence of automobile driving is improved.
The invention discloses A1 and a method for controlling multiple automobile screens, which comprises the following steps:
receiving a voice instruction and acquiring the intention of the voice instruction;
detecting a driving state and a passenger state of the automobile;
and controlling the operation of the multiple automobile screens according to the intention, the driving state and the related operation records.
A2, according to the method of A1, the receiving a voice instruction and the obtaining the intention of the voice instruction includes:
receiving voice of the voice instruction;
recognizing the speech as corresponding text;
and analyzing the text according to pre-stored big data information to obtain the field category to which the text belongs and the corresponding intention.
A3, the method of A2, the detecting the driving status and the passenger status of the automobile comprising:
detecting whether the automobile is in a running state or a stopped running state at present;
and detecting whether a person sits on the front seat and/or the rear seat of the automobile.
A4, according to the method in A3, the multi-screen automobile comprises: the screen is at least arranged on the front seat of the automobile and the screen is arranged on the rear seat of the automobile;
the operation of controlling the multiple automobile screens according to the intention, the driving state and the relevant operation records comprises the following steps:
when the intention is an intention related to driving and/or a vocal intention, the automobile is in a driving state, and people are in the front seat, controlling an operation function corresponding to the intention to operate on a screen of the front seat of the automobile;
when the intention is an intention and/or a vocal intention related to driving, but the intention and/or vocal intention related to driving does not conform to the related operation record, and the automobile is in a driving state and a person is in the front seat, an operation function corresponding to the intention is prompted and confirmed on a screen of the automobile front seat;
when the intention is an intention and/or a video intention which is not related to driving, the automobile is in a driving state, and people are in the rear seat, controlling an operation function corresponding to the intention to operate on a screen of the rear seat of the automobile;
and when the intention is an intention related to driving and/or a vocal intention, the automobile is in a stop driving state, and a person is in the front seat, controlling an operation function corresponding to the intention to operate on a screen of the front seat of the automobile.
A5, according to the method of A4, the vocal intention is an intention to play an audio file or a voice call intention; the video intention is an intention for playing a video file or a video call intention;
the related operation records are stored in a cloud server in communication connection with a vehicle-mounted system of the automobile; or in a storage medium of an on-board system of the car.
A6, the method of A2, the detecting whether the automobile is currently in a driving state or a stopped driving state comprising:
detecting whether the current running speed of the automobile is greater than a preset speed per hour, and if so, judging that the automobile is in a running state currently;
and detecting whether the current running speed of the automobile is zero or not and whether the duration time is longer than the preset time or not, and judging that the automobile is in a running stop state currently if the current running speed of the automobile is zero and the duration time is longer than the preset time.
The invention also discloses B7 and an automobile multi-screen control system, which comprises:
the intention acquisition module is used for receiving a voice instruction and acquiring the intention of the voice instruction;
the detection module is used for detecting the driving state and the passenger state of the automobile;
and the intention control module is used for controlling the operation of the multiple automobile screens according to the intention, the driving state and the relevant operation records.
B8, the system of B7, the intent acquisition module comprising:
the voice receiving submodule is used for receiving the voice of the voice instruction;
the voice recognition submodule is used for recognizing the voice into a corresponding text;
and the analysis submodule is used for analyzing the text according to the pre-stored big data information to obtain the field category to which the text belongs and the corresponding intention.
B9, the system according to B8, the detection module comprising:
the first detection submodule is used for detecting whether the automobile is in a running state or a stopped running state at present;
and the second detection submodule is used for detecting whether a person sits on the front seat and/or the rear seat of the automobile.
B10, the system according to B9, the automobile multi-screen comprises: the screen is at least arranged on the front seat of the automobile and the screen is arranged on the rear seat of the automobile;
the intent manipulation module includes:
the first intention control module is used for controlling an operation function corresponding to the intention to operate on a screen of a front seat of the automobile when the intention is an intention related to driving and/or a vocal intention, the automobile is in a driving state and a person is in the front seat;
when the intention is an intention and/or a vocal intention related to driving, but the intention and/or vocal intention related to driving does not conform to the related operation record, and the automobile is in a driving state and a person is in the front seat, an operation function corresponding to the intention is prompted and confirmed on a screen of the automobile front seat;
the second intention control module is used for controlling an operation function corresponding to the intention to operate on a screen of the rear seat of the automobile when the intention is an intention and/or a video intention which is irrelevant to driving and the automobile is in a driving state and people are in the rear seat;
and the third intention control module is used for controlling the operation function corresponding to the intention to operate on the screen of the front seat of the automobile when the intention is the intention and/or the vocal intention related to driving, the automobile is in a stop driving state and a person is in the front seat.
B11, according to the system of B10, the vocal intention is an intention to play an audio file or a voice call intention; the video intention is an intention for playing a video file or a video call intention;
the related operation records are stored in a cloud server in communication connection with a vehicle-mounted system of the automobile; or in a storage medium of an on-board system of the car.
B12, according to the system of B8, if the first detection submodule detects that the current running speed of the automobile is greater than a preset speed per hour, the automobile is judged to be in a running state currently; and
the first detection submodule detects that the current running speed of the automobile is zero, the duration time of the first detection submodule is longer than the preset time, and the automobile is judged to be in a running stop state currently.
The invention also discloses a C13 and a terminal, which comprises the system of any one of B7-B12.
The invention also discloses D14 and a storage medium, which is characterized by storing a computer program for executing any one method of A1-A6.
The invention also discloses E15, and a computer device, which comprises a storage medium, a processor and a computer program stored on the storage medium and running on the processor, wherein the processor realizes the method of A1-A6 when executing the computer program.
Claims (10)
1. A method for multi-screen control of an automobile, the method comprising:
receiving a voice instruction and acquiring the intention of the voice instruction;
detecting a driving state and a passenger state of the automobile;
and controlling the operation of the multiple automobile screens according to the intention, the driving state and the related operation records.
2. The method of claim 1, wherein receiving the voice instruction and retrieving the intent of the voice instruction comprises:
receiving voice of the voice instruction;
recognizing the speech as corresponding text;
and analyzing the text according to pre-stored big data information to obtain the field category to which the text belongs and the corresponding intention.
3. The method of claim 2, wherein the detecting the driving status and the passenger status of the automobile comprises:
detecting whether the automobile is in a running state or a stopped running state at present;
and detecting whether a person sits on the front seat and/or the rear seat of the automobile.
4. The method of claim 3, wherein the automotive multi-screen comprises: the screen is at least arranged on the front seat of the automobile and the screen is arranged on the rear seat of the automobile;
the operation of controlling the multiple automobile screens according to the intention, the driving state and the relevant operation records comprises the following steps:
when the intention is an intention related to driving and/or a vocal intention, the automobile is in a driving state, and people are in the front seat, controlling an operation function corresponding to the intention to operate on a screen of the front seat of the automobile;
when the intention is an intention and/or a vocal intention related to driving, but the intention and/or vocal intention related to driving does not conform to the related operation record, and the automobile is in a driving state and a person is in the front seat, an operation function corresponding to the intention is prompted and confirmed on a screen of the automobile front seat;
when the intention is an intention and/or a video intention which is not related to driving, the automobile is in a driving state, and people are in the rear seat, controlling an operation function corresponding to the intention to operate on a screen of the rear seat of the automobile;
and when the intention is an intention related to driving and/or a vocal intention, the automobile is in a stop driving state, and a person is in the front seat, controlling an operation function corresponding to the intention to operate on a screen of the front seat of the automobile.
5. The method of claim 4, wherein the audible intent is an intent to play an audio file or a voice call intent; the video intention is an intention for playing a video file or a video call intention;
the related operation records are stored in a cloud server in communication connection with a vehicle-mounted system of the automobile; or in a storage medium of an on-board system of the car.
6. The method of claim 2, wherein the detecting whether the vehicle is currently in a driving state or a stopped driving state comprises:
detecting whether the current running speed of the automobile is greater than a preset speed per hour, and if so, judging that the automobile is in a running state currently;
and detecting whether the current running speed of the automobile is zero or not and whether the duration time is longer than the preset time or not, and judging that the automobile is in a running stop state currently if the current running speed of the automobile is zero and the duration time is longer than the preset time.
7. A system for multi-screen control of an automobile, the system comprising:
the intention acquisition module is used for receiving a voice instruction and acquiring the intention of the voice instruction;
the detection module is used for detecting the driving state and the passenger state of the automobile;
and the intention control module is used for controlling the operation of the multiple automobile screens according to the intention, the driving state and the relevant operation records.
8. A terminal, characterized in that it comprises a system according to claim 7.
9. A storage medium storing a computer program for performing the method of any one of claims 1 to 6.
10. A computer device comprising a storage medium, a processor and a computer program stored on the storage medium and executable on the processor, characterized in that the processor implements the method of one of claims 1 to 6 when executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010617788.6A CN113879235A (en) | 2020-07-01 | 2020-07-01 | Method, system, equipment and storage medium for multi-screen control of automobile |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010617788.6A CN113879235A (en) | 2020-07-01 | 2020-07-01 | Method, system, equipment and storage medium for multi-screen control of automobile |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113879235A true CN113879235A (en) | 2022-01-04 |
Family
ID=79011997
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010617788.6A Pending CN113879235A (en) | 2020-07-01 | 2020-07-01 | Method, system, equipment and storage medium for multi-screen control of automobile |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113879235A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115440212A (en) * | 2022-06-30 | 2022-12-06 | 北京罗克维尔斯科技有限公司 | Voice control method, device, electronic equipment, vehicle and storage medium |
| CN115440211A (en) * | 2022-06-01 | 2022-12-06 | 北京罗克维尔斯科技有限公司 | Vehicle-mounted voice management method, device, equipment and medium |
| WO2024045675A1 (en) * | 2022-08-31 | 2024-03-07 | 比亚迪股份有限公司 | Vehicle-mounted multi-screen interaction method, vehicle-mounted controller, automobile, and storage medium |
-
2020
- 2020-07-01 CN CN202010617788.6A patent/CN113879235A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115440211A (en) * | 2022-06-01 | 2022-12-06 | 北京罗克维尔斯科技有限公司 | Vehicle-mounted voice management method, device, equipment and medium |
| CN115440212A (en) * | 2022-06-30 | 2022-12-06 | 北京罗克维尔斯科技有限公司 | Voice control method, device, electronic equipment, vehicle and storage medium |
| WO2024045675A1 (en) * | 2022-08-31 | 2024-03-07 | 比亚迪股份有限公司 | Vehicle-mounted multi-screen interaction method, vehicle-mounted controller, automobile, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106803423B (en) | Man-machine interaction voice control method and device based on user emotion state and vehicle | |
| CN113879235A (en) | Method, system, equipment and storage medium for multi-screen control of automobile | |
| JP6515764B2 (en) | Dialogue device and dialogue method | |
| US9529787B2 (en) | Concept search and semantic annotation for mobile messaging | |
| US9558739B2 (en) | Methods and systems for adapting a speech system based on user competance | |
| US20050216271A1 (en) | Speech dialogue system for controlling an electronic device | |
| WO2020046776A1 (en) | Method, system, and device for interfacing with a terminal with a plurality of response modes | |
| US20140136214A1 (en) | Adaptation methods and systems for speech systems | |
| CN112242141B (en) | Voice control method, intelligent cabin, server, vehicle and medium | |
| CN112397065A (en) | Voice interaction method and device, computer readable storage medium and electronic equipment | |
| CN112614491B (en) | Vehicle-mounted voice interaction method and device, vehicle and readable medium | |
| JP2010128099A (en) | In-vehicle voice information providing system | |
| KR20180135595A (en) | Apparatus for selecting at least one task based on voice command, a vehicle including the same and a method thereof | |
| CN116153311A (en) | Audio processing method, device, vehicle and computer readable storage medium | |
| CN113643704A (en) | Test method, upper computer, system and storage medium of vehicle-mounted machine voice system | |
| CN111086512B (en) | Method and device for turning on ACC function of automobile through passive voice | |
| JP7272293B2 (en) | Agent device, agent system and program | |
| JP7347244B2 (en) | Agent devices, agent systems and programs | |
| CN111192580A (en) | Method and device for actively starting ACC function of automobile through voice | |
| JP2020154098A (en) | On-vehicle apparatus control system, on-vehicle apparatus controller, on-vehicle apparatus control method and program | |
| CN113771703B (en) | Automobile co-driver seat adjusting method and system | |
| CN114005447A (en) | Voice conversation interaction method, device, vehicle and medium | |
| KR20230142243A (en) | Method for processing dialogue, user terminal and dialogue system | |
| CN113220265A (en) | Automobile and voice response text display method | |
| CN113961114A (en) | Theme replacement method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20220104 |
|
| WD01 | Invention patent application deemed withdrawn after publication |