CN111145750A - Control method and device for vehicle-mounted intelligent voice equipment - Google Patents

Control method and device for vehicle-mounted intelligent voice equipment Download PDF

Info

Publication number
CN111145750A
CN111145750A CN201911412847.XA CN201911412847A CN111145750A CN 111145750 A CN111145750 A CN 111145750A CN 201911412847 A CN201911412847 A CN 201911412847A CN 111145750 A CN111145750 A CN 111145750A
Authority
CN
China
Prior art keywords
vehicle
intelligent voice
mounted intelligent
image information
passenger
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911412847.XA
Other languages
Chinese (zh)
Inventor
程志俊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
WM Smart Mobility Shanghai Co Ltd
Original Assignee
WM Smart Mobility Shanghai Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by WM Smart Mobility Shanghai Co Ltd filed Critical WM Smart Mobility Shanghai Co Ltd
Priority to CN201911412847.XA priority Critical patent/CN111145750A/en
Publication of CN111145750A publication Critical patent/CN111145750A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Abstract

The invention discloses a control method and a device of vehicle-mounted intelligent voice equipment, wherein the control method comprises the following steps: obtaining sight line image information of passengers in the vehicle; analyzing the sight line direction of the passenger in the vehicle from the acquired sight line image information; and responding to the fact that the duration time of the sight direction towards the preset position is larger than or equal to a first preset time period, and outputting a waking instruction to the vehicle-mounted intelligent voice equipment to enable the vehicle-mounted intelligent voice equipment to wake up the intelligent voice application program. According to the method and the device, the intelligent voice interaction function can be conveniently awakened without the need that a passenger in the vehicle awakens the intelligent voice function by himself, so that the steps of voice awakening are effectively reduced, the interaction mode is more humanized, the voice awakening efficiency is improved, and the user experience is improved.

Description

Control method and device for vehicle-mounted intelligent voice equipment
Technical Field
The invention relates to the technical field of human-computer interaction, in particular to a control method and device of vehicle-mounted intelligent voice equipment.
Background
With the development of intelligent technology, intelligent voice interaction technology has been widely applied.
Especially in the automotive field, smart voice has considerable advantages as a human-vehicle interaction means, and the corresponding market size has also increased year by year. With the development of new technologies such as unmanned driving and intelligent cockpit of the automobile, the intelligent voice can be developed in the automobile.
In the driving environment, the passenger uses the intelligent voice interaction function more and more frequently, and the main advantage is that the sight line does not need to leave the road surface for a long time, and the operation of a vehicle machine and a vehicle can be realized. Moreover, the intelligent voice interaction function can communicate operation and control information in the vehicle, so that one-step communication is realized, and the passengers can conveniently finish the operation.
The intelligent voice interaction process generally comprises: wake voice → listen state → enter command → analyze and execute command → end. However, for waking up the voice, the voice in the car cannot be always in the monitoring state due to power consumption, easy misoperation and the like.
At present, the mainstream awakening mode of the intelligent voice interaction function is user-defined voice awakening, that is, the intelligent voice system is awakened by voice through a user-defined fixed awakening word, and then a specific voice instruction is input.
However, the above-mentioned customized voice wake-up mode still needs the passenger to wake up the intelligent voice function by oneself, and the wake-up period will be affected by factors such as voice interference, etc., resulting in unsuccessful wake-up, affecting passenger experience, and the passenger must use fixed wake-up words, resulting in that the passenger such as a driver and the like cannot adopt the above-mentioned customized voice wake-up mode, thereby reducing voice wake-up efficiency.
Disclosure of Invention
The following presents a simplified summary of one or more aspects in order to provide a basic understanding of such aspects. This summary is not an extensive overview of all contemplated aspects, and is intended to neither identify key or critical elements of all aspects nor delineate the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as a prelude to the more detailed description that is presented later.
The invention aims to overcome the defects that awakening is unsuccessful and passenger experience is influenced due to the fact that an intelligent voice interaction function is influenced by factors such as voice interference during awakening in the prior art, and provides a control method and a control device of vehicle-mounted intelligent voice equipment.
The technical problem is solved by the following technical scheme:
a control method of vehicle-mounted intelligent voice equipment comprises the following steps:
obtaining sight line image information of passengers in the vehicle;
analyzing the sight line direction of the passenger in the vehicle from the acquired sight line image information; and the number of the first and second groups,
responding to the fact that the duration time of the sight direction towards the preset position is larger than or equal to a first preset time period, and outputting a waking instruction to the vehicle-mounted intelligent voice equipment to enable the vehicle-mounted intelligent voice equipment to wake up the intelligent voice application program.
Optionally, the preset position includes a position of a display screen of the vehicle-mounted intelligent voice device.
Optionally, the step of acquiring the sight line image information of the occupant in the vehicle includes:
and acquiring sight image information of a driver at a main driving position in the vehicle through the first camera.
Optionally, the step of acquiring the sight line image information of the occupant in the vehicle includes:
and acquiring sight image information of the passenger at the driving position in the vehicle through the second camera.
Optionally, the first camera is disposed at a position of a central rearview mirror in the vehicle; and/or the presence of a gas in the gas,
the second camera is arranged at the position of the central rearview mirror in the automobile.
Optionally, the setting range of the first preset time period is 400ms to 600 ms.
Optionally, after the step of outputting the wake-up command to the in-vehicle smart audio device, the control method further includes:
and responding to the situation that the duration time of the voice input instruction of the passenger is not received and is larger than or equal to a second preset time period, and outputting a sleep instruction to the vehicle-mounted intelligent voice equipment so that the vehicle-mounted intelligent voice equipment is switched to a sleep state.
Optionally, after the step of outputting the wake-up command to the in-vehicle smart audio device, the control method further includes:
and outputting a wake-up prompting instruction to the vehicle-mounted intelligent voice equipment to prompt a wake-up state.
A computer readable medium having stored thereon computer instructions which, when executed by a processor, implement the steps of the control method of the in-vehicle intelligent speech device as described above.
The control device of the vehicle-mounted intelligent voice equipment comprises a processor and a memory which is in communication connection with the processor;
the processor is configured to:
obtaining sight line image information of passengers in the vehicle;
analyzing the sight line direction of the passenger in the vehicle from the acquired sight line image information;
responding to the fact that the duration time of the sight direction towards the preset position is larger than or equal to a first preset time period, and outputting a waking instruction to the vehicle-mounted intelligent voice equipment to enable the vehicle-mounted intelligent voice equipment to wake up the intelligent voice application program.
Optionally, the preset position includes a position of a display screen of the vehicle-mounted intelligent voice device.
Optionally, the processor is configured to:
and acquiring the sight line image information of the driver at the main driving position in the vehicle from the first camera.
Optionally, the processor is configured to:
and acquiring sight line image information of the passenger at the passenger driving position in the vehicle from the second camera.
Optionally, the first camera is disposed at a position of a central rearview mirror in the vehicle; and/or the presence of a gas in the gas,
the second camera is arranged at the position of the central rearview mirror in the automobile.
Optionally, the setting range of the first preset time period is 400ms to 600 ms.
Optionally, the processor is further configured to:
and after the awakening instruction is output to the vehicle-mounted intelligent voice equipment, responding to the condition that the duration time of the voice input instruction of the passenger is not received is greater than or equal to a second preset time period, and outputting a sleeping instruction to the vehicle-mounted intelligent voice equipment so as to enable the vehicle-mounted intelligent voice equipment to be switched to a sleeping state.
Optionally, the processor is further configured to:
and outputting a wake-up prompt instruction to the vehicle-mounted intelligent voice equipment after outputting the wake-up instruction to the vehicle-mounted intelligent voice equipment so as to prompt a wake-up state.
On the basis of the common knowledge in the field, the preferred conditions can be combined randomly to obtain the preferred embodiments of the invention.
The positive progress effects of the invention are as follows:
according to the control method and device for the vehicle-mounted intelligent voice equipment, the intelligent voice interaction function can be conveniently awakened without the need that a passenger in a vehicle awakens the intelligent voice function by himself, so that the steps of voice awakening are effectively reduced, the interaction mode is more humanized, the voice awakening efficiency is improved, and the user experience degree is further improved.
Drawings
The features and advantages of the present disclosure will be better understood upon reading the detailed description of embodiments of the disclosure in conjunction with the following drawings. In the drawings, components are not necessarily drawn to scale, and components having similar relative characteristics or features may have the same or similar reference numerals.
Fig. 1 is a flowchart illustrating a control method for a vehicle-mounted intelligent speech device according to an embodiment of the present invention.
Fig. 2 is a schematic structural diagram of a control device of a vehicle-mounted intelligent voice device according to an embodiment of the present invention.
Fig. 3 is a scene diagram of intelligent voice interaction according to an embodiment of the present invention.
Description of reference numerals:
step 101;
step 102;
step 103;
a processor 1;
a memory 2.
Detailed Description
The invention is described in detail below with reference to the figures and specific embodiments. It is noted that the aspects described below in connection with the figures and the specific embodiments are only exemplary and should not be construed as imposing any limitation on the scope of the present invention.
The following description is presented to enable any person skilled in the art to make and use the invention and is incorporated in the context of a particular application. Various modifications, as well as various uses in different applications will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to a wide range of embodiments. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
In the following detailed description, numerous specific details are set forth in order to provide a more thorough understanding of the invention. It will be apparent, however, to one skilled in the art that the practice of the invention may not necessarily be limited to these specific details. In other instances, well-known structures and devices are shown in block diagram form, rather than in detail, in order to avoid obscuring the present invention.
In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "disposed," "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
Additionally, the terms "upper," "lower," "left," "right," "top," "bottom," "horizontal," "vertical" and the like as used in the following description are to be understood as referring to the segment and the associated drawings in the illustrated orientation. The relative terms are used for convenience of description only and do not imply that the described apparatus should be constructed or operated in a particular orientation and therefore should not be construed as limiting the invention.
It will be understood that, although the terms first, second, third, etc. may be used herein to describe various elements, regions, layers and/or sections, these elements, regions, layers and/or sections should not be limited by these terms, but rather are used to distinguish one element, region, layer and/or section from another element, region, layer and/or section. Thus, a first component, region, layer or section discussed below could be termed a second component, region, layer or section without departing from some embodiments of the present invention.
In the driving environment, the passenger uses the intelligent voice interaction function more and more frequently, and the main advantage is that the sight line does not need to leave the road surface for a long time, and the operation of a vehicle machine and a vehicle can be realized. Moreover, the intelligent voice interaction function can communicate operation and control information in the vehicle, so that one-step communication is realized, and the passengers can conveniently finish the operation.
The intelligent voice interaction process generally comprises: wake voice → listen state → enter command → analyze and execute command → end. However, for waking up the voice, the voice in the car cannot be always in the monitoring state due to power consumption, easy misoperation and the like.
At present, the mainstream awakening mode of the intelligent voice interaction function is user-defined voice awakening, that is, the intelligent voice system is awakened by voice through a user-defined fixed awakening word, and then a specific voice instruction is input.
However, the above-mentioned customized voice wake-up mode still needs the passenger to wake up the intelligent voice function by oneself, and the wake-up period will be affected by factors such as voice interference, etc., resulting in unsuccessful wake-up, affecting passenger experience, and the passenger must use fixed wake-up words, resulting in that the passenger such as a driver and the like cannot adopt the above-mentioned customized voice wake-up mode, thereby reducing voice wake-up efficiency.
In order to overcome the above existing defects, this embodiment provides a control method for a vehicle-mounted intelligent voice device, where the control method includes: obtaining sight line image information of passengers in the vehicle; analyzing the sight line direction of the passenger in the vehicle from the acquired sight line image information; and responding to the fact that the duration time of the sight direction towards the preset position is larger than or equal to a first preset time period, and outputting a waking instruction to the vehicle-mounted intelligent voice equipment so that the vehicle-mounted intelligent voice equipment wakes up the intelligent voice application program.
In this embodiment, need not the car interior passenger and carry out other operations, can awaken up intelligent voice interaction function automatically when satisfying the awakening condition, greatly promoted the convenience of use.
Specifically, as an embodiment, as shown in fig. 1, the control method mainly includes the following steps:
and step 101, obtaining sight line image information of passengers in the vehicle.
In this step, the sight line image information of the occupant in the vehicle is acquired by a camera provided in the vehicle.
Specifically, in this step, the sight line image information of the driver at the main driving position in the vehicle is exclusively acquired by the first camera.
Preferably, in this embodiment, as shown in fig. 3, in order to better collect the sight line image information of the driver in real time, the first camera is detachably disposed at a position of the central rearview mirror in the vehicle, but the installation position of the first camera is not particularly limited, and may be adjusted and selected accordingly according to actual requirements.
Preferably, in this embodiment, the first camera may further adjust a corresponding shooting angle according to a change of the driver's sight line direction, so as to ensure to shoot stable and reliable sight line image information in real time.
As another embodiment, in this step, the second camera may be used to exclusively acquire the sight line image information of the occupant at the passenger driving position in the vehicle.
Preferably, in this embodiment, in order to better acquire the sight line image information of the passenger at the passenger driving position in real time, the second camera is detachably disposed at the position of the central rearview mirror in the vehicle, but the installation position of the second camera is not particularly limited, and can be adjusted and selected accordingly according to actual requirements.
Preferably, in this embodiment, the second camera may further adjust a corresponding shooting angle according to a change of a sight line direction of the passenger at the passenger driving position, so as to ensure that stable and reliable sight line image information is shot in real time.
As another embodiment, in this step, the realized image information of the passenger on the rear seat can be obtained through other cameras, and the installation position of the camera can be adjusted and selected according to the actual situation.
And 102, analyzing the sight line direction of the passenger in the vehicle from the acquired sight line image information.
In this step, the sight line direction of the occupant in the vehicle is analyzed from the acquired sight line image information by an image processing device (which may be a D-Box or the like).
Of course, the above-described sight-line image information may include sight-line image information of the driver, the occupant in the passenger driving position, or the occupant in another position.
In this step, it is further determined whether the sight line direction of the occupant in the vehicle is directed to a preset position by using the image processing device, where the preset position may be a position range.
Preferably, in this embodiment, the preset position is a position where a display screen (which may be a central control display screen of the vehicle-mounted HU) of the vehicle-mounted intelligent voice device is located. For example, referring to fig. 3, it is determined whether the driver gazes at the display screen.
Of course, the preset position is not specifically limited in this embodiment, and as long as the corresponding function can be realized, the corresponding setting can be performed according to the actual requirement.
And 103, responding to the condition that the duration time of the sight direction towards the preset position is greater than or equal to a first preset time period, and outputting a wake-up instruction to the vehicle-mounted intelligent voice equipment.
In this step, if it is monitored that the sight line direction of the passenger in the vehicle faces the preset position, responding to that the duration time of the sight line direction facing the preset position is greater than or equal to a first preset time period, and outputting a wake-up instruction to the vehicle-mounted intelligent voice device so that the vehicle-mounted intelligent voice device wakes up the intelligent voice application program.
In the present embodiment, the first preset time period is not preferably set to be excessively long in consideration of driving safety, and is also not preferably set to be excessively short in consideration of power consumption, erroneous operation, and the like.
Therefore, the setting range of the first preset time period is preferably 400ms to 600ms, but the first preset time period is not limited specifically, and may be set accordingly according to actual requirements.
Preferably, in the present embodiment, the first preset time period is set to 500 ms.
In this step, after the wake-up instruction is output to the vehicle-mounted intelligent voice device, a wake-up prompt instruction is also output to the vehicle-mounted intelligent voice device so as to prompt the passenger of the wake-up state of the intelligent voice application program in a voice prompt mode or a text prompt mode displayed in a display screen.
In this step, after receiving the prompt, the passenger may speak a corresponding voice input instruction, and the vehicle-mounted intelligent voice device executes the intelligent voice application program to output a corresponding voice feedback, thereby implementing an intelligent voice interaction function.
Preferably, in this embodiment, after the wake-up command is output to the vehicle-mounted intelligent voice device in consideration of factors such as power consumption and passenger misoperation, a sleep command is output to the vehicle-mounted intelligent voice device in response to that the duration time during which the passenger voice input command is not received is greater than or equal to a second preset time period, so that the vehicle-mounted intelligent voice device is switched to a sleep state, and the intelligent voice interaction function is ensured to be turned off in time when unnecessary.
In this embodiment, the second preset time period is not particularly limited, and may be set according to actual requirements.
The embodiment also provides a computer readable medium, on which computer instructions are stored, and the computer instructions, when executed by a processor, implement the steps of the control method of the vehicle-mounted intelligent voice device.
According to the control method of the vehicle-mounted intelligent voice equipment, the intelligent voice interaction function can be conveniently awakened without the need that a passenger in the vehicle awakens the intelligent voice function by himself, so that the voice awakening steps are effectively reduced, the interaction mode is more humanized, the voice awakening efficiency is improved, and the user experience degree is further improved.
In order to overcome the above drawbacks, the present embodiment further provides a control device for a vehicle-mounted intelligent speech device, where the control device uses the above control method.
As shown in fig. 2, the control device mainly includes a processor 1 and a memory 2 communicatively connected to the processor 1, the memory 2 is configured to store programs and data executed by the processor 1, and the processor 1 may also be integrated into a vehicle-mounted intelligent speech device.
The processor 1 is configured to: obtaining sight line image information of passengers in the vehicle; analyzing the sight line direction of the passenger in the vehicle from the acquired sight line image information; responding to the fact that the duration time of the sight direction towards the preset position is larger than or equal to a first preset time period, and outputting a waking instruction to the vehicle-mounted intelligent voice equipment so that the vehicle-mounted intelligent voice equipment wakes up the intelligent voice application program.
In this embodiment, need not the car interior passenger and carry out other operations, can awaken up intelligent voice interaction function automatically when satisfying the awakening condition, greatly promoted the convenience of use.
Specifically, as an embodiment, the processor 1 is configured to: and acquiring sight line image information of passengers in the vehicle through a camera arranged in the vehicle.
Specifically, the processor 1 is configured to exclusively acquire the sight-line image information of the driver at the primary driving position in the vehicle through the first camera.
Preferably, in this embodiment, as shown in fig. 3, in order to better collect the sight line image information of the driver in real time, the first camera is detachably disposed at a position of the central rearview mirror in the vehicle, but the installation position of the first camera is not particularly limited, and may be adjusted and selected accordingly according to actual requirements.
Preferably, in this embodiment, the first camera may further adjust a corresponding shooting angle according to a change of the driver's sight line direction, so as to ensure to shoot stable and reliable sight line image information in real time.
As another embodiment, the processor 1 is further configured to exclusively acquire sight-line image information of the occupant in the passenger driving position in the vehicle through the second camera.
Preferably, in this embodiment, in order to better acquire the sight line image information of the passenger at the passenger driving position in real time, the second camera is detachably disposed at the position of the central rearview mirror in the vehicle, but the installation position of the second camera is not particularly limited, and can be adjusted and selected accordingly according to actual requirements.
Preferably, in this embodiment, the second camera may further adjust a corresponding shooting angle according to a change of a sight line direction of the passenger at the passenger driving position, so as to ensure that stable and reliable sight line image information is shot in real time.
As another embodiment, the processor 1 is further configured to obtain the realized image information of the occupant in the rear seat through another camera, and the installation position of the camera can be adjusted and selected according to the actual situation.
The processor 1 is also configured to analyze the sight line direction of the occupant in the vehicle from the acquired sight line image information, and in this case, the processor 1 may employ a processor of an image processing apparatus.
Of course, the above-described sight-line image information may include sight-line image information of the driver, the occupant in the passenger driving position, or the occupant in another position.
The processor 1 is further configured to further determine whether the sight line direction of the occupant in the vehicle is oriented to a preset position, and the preset position may be a position range.
Preferably, in this embodiment, the preset position is a position where a display screen (which may be a central control display screen of the vehicle-mounted HU) of the vehicle-mounted intelligent voice device is located. For example, referring to fig. 3, it is determined whether the driver gazes at the display screen.
Of course, the preset position is not specifically limited in this embodiment, and as long as the corresponding function can be realized, the corresponding setting can be performed according to the actual requirement.
The processor 1 is further configured to output a wake-up instruction to the vehicle-mounted intelligent voice device in response to that the duration time of the sight direction towards the preset position is greater than or equal to a first preset time period if it is monitored that the sight direction of the passenger in the vehicle faces the preset position, so that the vehicle-mounted intelligent voice device wakes up the intelligent voice application program.
In the present embodiment, the first preset time period is not preferably set to be excessively long in consideration of driving safety, and is also not preferably set to be excessively short in consideration of power consumption, erroneous operation, and the like.
Therefore, the setting range of the first preset time period is preferably 400ms to 600ms, but the first preset time period is not limited specifically, and may be set accordingly according to actual requirements.
Preferably, in the present embodiment, the first preset time period is set to 500 ms.
The processor 1 is further configured to output a wake-up instruction to the vehicle-mounted intelligent voice device, and then output a wake-up prompt instruction to the vehicle-mounted intelligent voice device, so as to prompt the passenger of the wake-up state of the intelligent voice application program in a voice prompt manner or a text prompt manner displayed on a display screen.
After receiving the prompt, the passenger can speak out a corresponding voice input instruction, and the vehicle-mounted intelligent voice device executes the intelligent voice application program to output corresponding voice feedback, so that an intelligent voice interaction function is realized.
Preferably, in this embodiment, in consideration of power consumption, passenger misoperation and other factors, the processor 1 is further configured to output a wake-up instruction to the vehicle-mounted intelligent voice device, and then, in response to that the duration time during which the passenger voice input instruction is not received is greater than or equal to a second preset time period, output a sleep instruction to the vehicle-mounted intelligent voice device so as to switch the vehicle-mounted intelligent voice device to a sleep state, thereby ensuring that the intelligent voice interaction function is turned off in time when not necessary.
In this embodiment, the second preset time period is not particularly limited, and may be set according to actual requirements.
The controlling means of on-vehicle intelligent speech equipment that this embodiment provided need not the car interior passenger and awakens up intelligent speech function by oneself, can conveniently awaken up intelligent voice interaction function, has reduced pronunciation awaken-up's step effectively to make the interactive mode more humanized, thereby promoted pronunciation awaken-up efficiency, and then promoted user experience degree.
The various illustrative logical modules, and circuits described in connection with the embodiments disclosed herein may be implemented or performed with a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in an occupant terminal. In the alternative, the processor and the storage medium may reside as discrete components in an occupant terminal.
In one or more exemplary embodiments, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software as a computer program product, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. Any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a web site, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk (disk) and disc (disc), as used herein, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk and blu-ray disc where disks (disks) usually reproduce data magnetically, while discs (discs) reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
While, for purposes of simplicity of explanation, the methodologies are shown and described as a series of acts, it is to be understood and appreciated that the methodologies are not limited by the order of acts, as some acts may, in accordance with one or more embodiments, occur in different orders and/or concurrently with other acts from that shown and described herein or not shown and described herein, as would be understood by one skilled in the art.
The previous description of the disclosure is provided to enable any person skilled in the art to make or use the disclosure. Various modifications to the disclosure will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other variations without departing from the spirit or scope of the disclosure. Thus, the disclosure is not intended to be limited to the examples and designs described herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (17)

1. A control method of vehicle-mounted intelligent voice equipment is characterized by comprising the following steps:
obtaining sight line image information of passengers in the vehicle;
analyzing the sight line direction of the passenger in the vehicle from the acquired sight line image information; and the number of the first and second groups,
responding to the fact that the duration time of the sight direction towards the preset position is larger than or equal to a first preset time period, and outputting a waking instruction to the vehicle-mounted intelligent voice equipment to enable the vehicle-mounted intelligent voice equipment to wake up the intelligent voice application program.
2. The control method according to claim 1, wherein the preset position comprises a position of a display screen of the vehicle-mounted intelligent voice device.
3. The control method according to claim 1, wherein the step of acquiring the sight-line image information of the occupant in the vehicle includes:
and acquiring sight image information of a driver at a main driving position in the vehicle through the first camera.
4. The control method according to claim 3, wherein the step of acquiring the sight-line image information of the occupant in the vehicle includes:
and acquiring sight image information of the passenger at the driving position in the vehicle through the second camera.
5. The control method according to claim 4, wherein the first camera is provided at a position of a center rearview mirror in the vehicle; and/or the presence of a gas in the gas,
the second camera is arranged at the position of the central rearview mirror in the automobile.
6. The control method according to claim 1, wherein the first preset time period is set within a range of 400ms to 600 ms.
7. The control method according to claim 1, wherein after the step of outputting the wake-up command to the in-vehicle smart audio device, the control method further comprises:
and responding to the situation that the duration time of the voice input instruction of the passenger is not received and is larger than or equal to a second preset time period, and outputting a sleep instruction to the vehicle-mounted intelligent voice equipment so that the vehicle-mounted intelligent voice equipment is switched to a sleep state.
8. The control method according to claim 1, wherein after the step of outputting the wake-up command to the in-vehicle smart audio device, the control method further comprises:
and outputting a wake-up prompting instruction to the vehicle-mounted intelligent voice equipment to prompt a wake-up state.
9. A computer-readable medium, characterized in that computer instructions are stored thereon, which, when executed by a processor, implement the steps of the control method of the vehicle-mounted intelligent voice device according to any one of claims 1 to 8.
10. The control device of the vehicle-mounted intelligent voice equipment is characterized by comprising a processor and a memory which is in communication connection with the processor;
the processor is configured to:
obtaining sight line image information of passengers in the vehicle;
analyzing the sight line direction of the passenger in the vehicle from the acquired sight line image information;
responding to the fact that the duration time of the sight direction towards the preset position is larger than or equal to a first preset time period, and outputting a waking instruction to the vehicle-mounted intelligent voice equipment to enable the vehicle-mounted intelligent voice equipment to wake up the intelligent voice application program.
11. The control device of claim 10, wherein the preset position comprises a position of a display screen of the vehicle-mounted intelligent voice device.
12. The control apparatus of claim 10, wherein the processor is configured to:
and acquiring the sight line image information of the driver at the main driving position in the vehicle from the first camera.
13. The control apparatus of claim 12, wherein the processor is configured to:
and acquiring sight line image information of the passenger at the passenger driving position in the vehicle from the second camera.
14. The control device of claim 13, wherein the first camera is disposed at a location of a center rear view mirror in the vehicle; and/or the presence of a gas in the gas,
the second camera is arranged at the position of the central rearview mirror in the automobile.
15. The control apparatus according to claim 10, wherein the first preset time period is set within a range of 400ms to 600 ms.
16. The control apparatus of claim 10, wherein the processor is further configured to:
and after the awakening instruction is output to the vehicle-mounted intelligent voice equipment, responding to the condition that the duration time of the voice input instruction of the passenger is not received is greater than or equal to a second preset time period, and outputting a sleeping instruction to the vehicle-mounted intelligent voice equipment so as to enable the vehicle-mounted intelligent voice equipment to be switched to a sleeping state.
17. The control apparatus of claim 10, wherein the processor is further configured to:
and outputting a wake-up prompt instruction to the vehicle-mounted intelligent voice equipment after outputting the wake-up instruction to the vehicle-mounted intelligent voice equipment so as to prompt a wake-up state.
CN201911412847.XA 2019-12-31 2019-12-31 Control method and device for vehicle-mounted intelligent voice equipment Pending CN111145750A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911412847.XA CN111145750A (en) 2019-12-31 2019-12-31 Control method and device for vehicle-mounted intelligent voice equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911412847.XA CN111145750A (en) 2019-12-31 2019-12-31 Control method and device for vehicle-mounted intelligent voice equipment

Publications (1)

Publication Number Publication Date
CN111145750A true CN111145750A (en) 2020-05-12

Family

ID=70522592

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911412847.XA Pending CN111145750A (en) 2019-12-31 2019-12-31 Control method and device for vehicle-mounted intelligent voice equipment

Country Status (1)

Country Link
CN (1) CN111145750A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112540677A (en) * 2020-12-18 2021-03-23 浙江合众新能源汽车有限公司 Control method, device and system of vehicle-mounted intelligent equipment and computer readable medium
CN113442941A (en) * 2020-12-04 2021-09-28 安波福电子(苏州)有限公司 Man-vehicle interaction system
CN114201225A (en) * 2021-12-14 2022-03-18 阿波罗智联(北京)科技有限公司 Method and device for awakening function of vehicle machine
CN114348000A (en) * 2022-02-15 2022-04-15 安波福电子(苏州)有限公司 Driver attention management system and method

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013255168A (en) * 2012-06-08 2013-12-19 Toyota Infotechnology Center Co Ltd Imaging apparatus and imaging method
US20180229654A1 (en) * 2017-02-16 2018-08-16 Regents Of The University Of Minnesota Sensing application use while driving
CN109976506A (en) * 2017-12-28 2019-07-05 深圳市优必选科技有限公司 Awakening method, storage medium and the robot of a kind of electronic equipment
CN110047487A (en) * 2019-06-05 2019-07-23 广州小鹏汽车科技有限公司 Awakening method, device, vehicle and the machine readable media of vehicle-mounted voice equipment
US20190346701A1 (en) * 2018-05-10 2019-11-14 International Business Machines Corporation Event-based, automated control of visual light transmission through vehicle window
CN111694424A (en) * 2020-04-20 2020-09-22 上汽大众汽车有限公司 System and method for awakening vehicle-mounted intelligent voice function
CN112540677A (en) * 2020-12-18 2021-03-23 浙江合众新能源汽车有限公司 Control method, device and system of vehicle-mounted intelligent equipment and computer readable medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013255168A (en) * 2012-06-08 2013-12-19 Toyota Infotechnology Center Co Ltd Imaging apparatus and imaging method
US20180229654A1 (en) * 2017-02-16 2018-08-16 Regents Of The University Of Minnesota Sensing application use while driving
CN109976506A (en) * 2017-12-28 2019-07-05 深圳市优必选科技有限公司 Awakening method, storage medium and the robot of a kind of electronic equipment
US20190346701A1 (en) * 2018-05-10 2019-11-14 International Business Machines Corporation Event-based, automated control of visual light transmission through vehicle window
CN110047487A (en) * 2019-06-05 2019-07-23 广州小鹏汽车科技有限公司 Awakening method, device, vehicle and the machine readable media of vehicle-mounted voice equipment
CN111694424A (en) * 2020-04-20 2020-09-22 上汽大众汽车有限公司 System and method for awakening vehicle-mounted intelligent voice function
CN112540677A (en) * 2020-12-18 2021-03-23 浙江合众新能源汽车有限公司 Control method, device and system of vehicle-mounted intelligent equipment and computer readable medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113442941A (en) * 2020-12-04 2021-09-28 安波福电子(苏州)有限公司 Man-vehicle interaction system
CN112540677A (en) * 2020-12-18 2021-03-23 浙江合众新能源汽车有限公司 Control method, device and system of vehicle-mounted intelligent equipment and computer readable medium
CN114201225A (en) * 2021-12-14 2022-03-18 阿波罗智联(北京)科技有限公司 Method and device for awakening function of vehicle machine
CN114348000A (en) * 2022-02-15 2022-04-15 安波福电子(苏州)有限公司 Driver attention management system and method

Similar Documents

Publication Publication Date Title
CN111145750A (en) Control method and device for vehicle-mounted intelligent voice equipment
CN105905052B (en) Method and apparatus for predictive vehicle preconditioning
US9424047B2 (en) System and methods for an in-vehicle computing system
US8880291B2 (en) Methods and systems for preventing unauthorized vehicle operation using face recognition
WO2019201304A1 (en) Face recognition-based voice processing method, and device
CN112977338B (en) Vehicle remote monitoring method, vehicle and readable storage medium
WO2019184837A1 (en) Control method for on-board display device, and control device
US20140092332A1 (en) System and method of controlling refraction in windshield based on driver ocular prescription
US10710503B2 (en) Systems and methods for streaming video from a rear view backup camera
CN112569447B (en) Sleep assistance method for vehicle user and in-vehicle infotainment system
CN112109647A (en) Vehicle and method and device for realizing vehicle contextual model
CN104354657A (en) Automobile control method, device and system
CN105681579A (en) Terminal, and screen control method and device for terminal in navigation state
CN112041201A (en) Method, system, and medium for controlling access to vehicle features
CN112441010A (en) System and method for reducing anxiety of vehicle occupants
CN113978354A (en) Vehicle control method, device, equipment and storage medium
KR20200045033A (en) Vehicle and method for outputting information
CN113225433A (en) Vehicle voice reminding method and device, electronic equipment and storage medium
CN111976626A (en) Mode control method, device, vehicle and computer readable storage medium
CN105099473A (en) Vehicle radio noise reduction method, device and system
CN112572293A (en) Vehicle-mounted control system, control method thereof and vehicle
WO2020079755A1 (en) Information providing device and information providing method
CN115139953A (en) Vehicle welcome method, device, equipment and storage medium
CN113299286A (en) Interaction method, device and system based on vehicle-mounted robot and readable medium
CN117657041A (en) Sleep mode control method and device, controller, storage medium and vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200512