CN113223521A - Vehicle-mounted screen display voice control system - Google Patents

Vehicle-mounted screen display voice control system Download PDF

Info

Publication number
CN113223521A
CN113223521A CN202110452458.0A CN202110452458A CN113223521A CN 113223521 A CN113223521 A CN 113223521A CN 202110452458 A CN202110452458 A CN 202110452458A CN 113223521 A CN113223521 A CN 113223521A
Authority
CN
China
Prior art keywords
voice
vehicle
information
cloud platform
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110452458.0A
Other languages
Chinese (zh)
Inventor
饶蕾
胡彩霞
马翼平
陈年生
范光宇
宫宇宸
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Dianji University
Original Assignee
Shanghai Dianji University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Dianji University filed Critical Shanghai Dianji University
Priority to CN202110452458.0A priority Critical patent/CN113223521A/en
Publication of CN113223521A publication Critical patent/CN113223521A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

The invention discloses a vehicle-mounted screen display voice control system, which comprises: the sound pick-up is used for collecting voice information of a user; the voice recognition cloud platform is used for receiving the voice information of the user and returning text information after voice data processing is carried out by combining the voice information; the instruction database is used for storing control instructions in advance; the embedded system control platform is used for receiving the user voice information and transmitting the user voice information to the voice recognition cloud platform, and is also used for receiving the text information, matching the text information with the control instruction, reading vehicle condition information from a sensor according to the matched control instruction, and controlling a vehicle-mounted screen and a player to display and play the vehicle condition information; the sensors are used for collecting the vehicle condition information and transmitting the vehicle condition information to the embedded system control platform; and the vehicle-mounted screen and the player are used for displaying and playing the vehicle condition information.

Description

Vehicle-mounted screen display voice control system
Technical Field
The invention relates to the technical field of voice recognition, in particular to a vehicle-mounted screen display voice control system.
Background
The existing vehicle-mounted screen display control system mainly adopts a manual control mode, and a user manually adjusts and switches the display content of a vehicle-mounted screen. And a localized voice control vehicle-mounted screen display module is also arranged on some high-end vehicle models, so that the voice control vehicle-mounted screen display can be realized.
However, the manual control disturbs the normal driving of the driver, distracts the driver, requires a plurality of manual operations for obtaining the display information, and is complicated in flow and inefficient. Approximately 6 million people die of a traffic accident each year, and more than 20 million people die of the traffic accident. The driving load is a main cause of various large traffic accidents, and the traditional driving operation process occupies factors such as the hearing and the vision of a driver and disperses the attention of the driver. In the localized voice control vehicle-mounted screen display module, the voice recognition module and the corpus occupy a large amount of memory space, and the requirements on the operation and space storage of the localized platform are high. Therefore, how to concentrate the attention of the driver in the driving process to ensure the safety of the driver, improve the accuracy and the recognition speed of voice recognition and reduce the operation requirement of a local control platform is the problem to be solved at present.
Disclosure of Invention
The technical problem to be solved by the invention is how to concentrate the attention of the driver to ensure the safety of the driver, improve the accuracy and the recognition speed of voice recognition, reduce the operation requirement of a local control platform and provide a vehicle-mounted screen display voice control system.
The invention solves the technical problems through the following technical scheme:
an on-board screen display voice control system, the control system comprising:
the sound pick-up is used for collecting voice information of a user;
the voice recognition cloud platform is used for receiving the voice information of the user and returning text information after voice data processing is carried out by combining the voice information;
the database is used for storing the control instruction in advance;
the embedded system control platform is used for receiving the user voice information and transmitting the user voice information to the voice recognition cloud platform, and is also used for receiving the text information, matching the text information with the control instruction, reading vehicle condition information from a sensor according to the matched control instruction, and controlling a vehicle-mounted screen and a player to display and play the vehicle condition information;
the sensors are used for collecting the vehicle condition information and transmitting the vehicle condition information to the embedded system control platform;
and the vehicle-mounted screen and the player are used for displaying and playing the vehicle condition information.
Further, the voice data processing includes:
and the cloud platform returns the text information after voice feature extraction, quantization and recognition.
Further, the control instructions comprise a vehicle speed reading and displaying instruction, a temperature reading and displaying instruction, an oil consumption reading and displaying instruction and a navigation displaying instruction.
Further, the sensor includes: vehicle speed sensor, temperature sensor, oil consumption sensor.
Further, the cloud platform comprises a science and university communication flying cloud platform and a Baidu cloud platform, which are cloud platforms.
On the basis of the common knowledge in the field, the above preferred conditions can be combined randomly to obtain the preferred embodiments of the invention.
The positive progress effects of the invention are as follows: the scheme changes the traditional method for manually adjusting the vehicle-mounted display, and realizes the voice control adjustment of the vehicle-mounted display by using an intelligent voice technology. Compared with the traditional manual regulation method, the intelligent voice regulation method is simpler and faster. The voice adjustment method is also beneficial to freeing the hands of the driver, and does not need to provide extra limb actions for adjusting the display of the display screen, so that the driver is more concentrated on driving.
Drawings
FIG. 1 is a block diagram of an embodiment of a vehicle-mounted screen display voice control system according to the present invention.
Detailed Description
To facilitate an understanding of the present application, the present application will now be described more fully with reference to the accompanying drawings. Preferred embodiments of the present application are shown in the drawings. This application may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
Fig. 1 is a block diagram of a system structure in an embodiment of the present invention:
in one example, the embedded system control platform 400 acts as an overall control unit that controls the sound pickup 100 to receive voice information of a user. After receiving the voice information of the user, the embedded system control platform 400 sends the voice information to the voice recognition cloud platform 300 for voice recognition. The voice recognition cloud platform 300 comprises a science and university communication flying cloud platform, a Baidu cloud platform and a Hua-Yun cloud platform, a corpus is stored on the voice recognition cloud platform 300, and the voice recognition cloud platform 300 returns character information obtained through recognition to the embedded system control platform 400 after combining data of the corpus and performing feature extraction, quantization and recognition on user voice information. The embedded system control platform 400 matches the returned text information with control commands stored in the command database 500 in advance, wherein the control commands include a vehicle speed reading and displaying command, a temperature reading and displaying command, a fuel consumption reading and displaying command and a navigation displaying command. After matching the control command, the embedded system control platform 400 controls the corresponding sensor 200 to acquire the corresponding vehicle condition information in real time, and reads the acquired real-time information of the corresponding sensor 200, where the sensor 200 includes: the vehicle speed sensor is used for monitoring the running speed of the vehicle in real time; the temperature sensor is used for measuring the temperature inside and outside the vehicle in real time; and the fuel consumption sensor is used for acquiring the residual fuel quantity of the vehicle in real time. The embedded system control platform 400 combines the control instruction matched with the voice information of the user to display the real-time vehicle condition information acquired by the corresponding sensor 200 on the vehicle-mounted screen and the player 600, and the voice broadcaster broadcasts the displayed information while the screen displays the information.
The voice recognition technology and the display screen control system are combined, the voice recognition technology is adopted, the voice information of a driver is monitored in real time, the voice is recognized through the voice recognition cloud platform 300, and the control instruction is obtained after the voice is matched through the instruction database 500. The embedded system control platform 400 acquires real-time data of the corresponding sensor 200 according to the control instruction, transmits the real-time data to the vehicle-mounted display screen, and displays and broadcasts the real-time data. According to the invention, on one hand, a method for manually operating and adjusting the display screen is abandoned, adverse effects caused by excessive manual operation of a driver in the driving process are overcome, and on the other hand, the voice recognition function is arranged on the Internet cloud platform, so that the operation requirement of the local control platform is reduced.
While specific embodiments of the invention have been described above, it will be appreciated by those skilled in the art that this is by way of example only, and that the scope of the invention is defined by the appended claims. Various changes and modifications to these embodiments may be made by those skilled in the art without departing from the spirit and scope of the invention, and these changes and modifications are within the scope of the invention.

Claims (5)

1. An on-board screen display voice control system, characterized in that the control system comprises:
the sound pick-up is used for collecting voice information of a user;
the voice recognition cloud platform is used for receiving the voice information of the user and returning text information after voice data processing is carried out by combining the voice information;
the instruction database is used for storing control instructions in advance;
the embedded system control platform is used for receiving the user voice information and transmitting the user voice information to the voice recognition cloud platform, and is also used for receiving the text information, matching the text information with the control instruction, reading vehicle condition information from a sensor according to the matched control instruction, and controlling a vehicle-mounted screen and a player to display and play the vehicle condition information;
the sensors are used for collecting the vehicle condition information and transmitting the vehicle condition information to the embedded system control platform;
and the vehicle-mounted screen and the player are used for displaying and playing the vehicle condition information.
2. The on-vehicle screen display voice control system according to claim 1, wherein the voice data processing includes:
and the cloud platform returns the text information after voice feature extraction, quantization and recognition.
3. The vehicle-mounted screen display voice control system according to claim 1, wherein the control command comprises a vehicle speed reading and displaying command, a temperature reading and displaying command, a fuel consumption reading and displaying command and a navigation displaying command.
4. The on-vehicle screen display voice control system according to claim 1, wherein the sensor includes: vehicle speed sensor, temperature sensor, oil consumption sensor.
5. The vehicle-mounted screen display voice control system of any one of claims 1 to 4, wherein the cloud platform comprises a science fiction flying cloud platform, a Baidu cloud platform, and a Huacheng cloud platform.
CN202110452458.0A 2021-04-26 2021-04-26 Vehicle-mounted screen display voice control system Pending CN113223521A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110452458.0A CN113223521A (en) 2021-04-26 2021-04-26 Vehicle-mounted screen display voice control system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110452458.0A CN113223521A (en) 2021-04-26 2021-04-26 Vehicle-mounted screen display voice control system

Publications (1)

Publication Number Publication Date
CN113223521A true CN113223521A (en) 2021-08-06

Family

ID=77089053

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110452458.0A Pending CN113223521A (en) 2021-04-26 2021-04-26 Vehicle-mounted screen display voice control system

Country Status (1)

Country Link
CN (1) CN113223521A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113872716A (en) * 2021-09-06 2021-12-31 江苏铁锚玻璃股份有限公司 Broadcast audio accompanying sound character display method and system based on OLED (organic light emitting diode) vehicle window

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103685524A (en) * 2013-12-16 2014-03-26 中国科学院深圳先进技术研究院 Intelligent vehicle-mounted terminal system
WO2015128960A1 (en) * 2014-02-26 2015-09-03 三菱電機株式会社 In-vehicle control apparatus and in-vehicle control method
CN105989841A (en) * 2015-02-17 2016-10-05 上海汽车集团股份有限公司 Vehicle-mounted speech control method and device
CN109830235A (en) * 2019-03-19 2019-05-31 东软睿驰汽车技术(沈阳)有限公司 Sound control method, device, onboard control device and vehicle
EP3511804A1 (en) * 2018-01-12 2019-07-17 Superior Marine Products LLC Gesturing for control input for a vehicle

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103685524A (en) * 2013-12-16 2014-03-26 中国科学院深圳先进技术研究院 Intelligent vehicle-mounted terminal system
WO2015128960A1 (en) * 2014-02-26 2015-09-03 三菱電機株式会社 In-vehicle control apparatus and in-vehicle control method
CN105989841A (en) * 2015-02-17 2016-10-05 上海汽车集团股份有限公司 Vehicle-mounted speech control method and device
EP3511804A1 (en) * 2018-01-12 2019-07-17 Superior Marine Products LLC Gesturing for control input for a vehicle
CN109830235A (en) * 2019-03-19 2019-05-31 东软睿驰汽车技术(沈阳)有限公司 Sound control method, device, onboard control device and vehicle

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113872716A (en) * 2021-09-06 2021-12-31 江苏铁锚玻璃股份有限公司 Broadcast audio accompanying sound character display method and system based on OLED (organic light emitting diode) vehicle window
CN113872716B (en) * 2021-09-06 2023-07-11 江苏铁锚玻璃股份有限公司 Broadcast audio accompanying sound and text display method and system based on OLED vehicle window

Similar Documents

Publication Publication Date Title
CN106328148B (en) Natural voice recognition method, device and system based on local and cloud hybrid recognition
CN108891422B (en) Control method and device of intelligent vehicle and computer readable storage medium
CN106233356B (en) Information presentation device and information demonstrating method
JP6173477B2 (en) Navigation server, navigation system, and navigation method
US10320354B1 (en) Controlling a volume level based on a user profile
JP2017521724A (en) Text rule based multiple accent speech recognition using single acoustic model and automatic accent detection
DE102015206600A1 (en) RIDING SCENARIOSIS AND AUTOMATIC VEHICLE POSITION COMPENSATION
DE112012006617T5 (en) Onboard information device
JP2015118709A (en) Voice recognition query response system
WO2014057540A1 (en) Navigation device and navigation server
CN108382155B (en) Air conditioner voice control device with reminding function
CN103063224B (en) Method for operating navigation system
CN202743179U (en) Voice control device for automobile
CN113223521A (en) Vehicle-mounted screen display voice control system
CN109080407A (en) The customizing method and vehicle device of ventilation mode
CN110100153B (en) Information providing system
JP6295884B2 (en) Information proposal system
CN113954855B (en) Self-adaptive matching method for automobile driving mode
US11904868B2 (en) Information processing device, recording medium, and information processing method
US20240046931A1 (en) Voice interaction method and apparatus
CN114312815B (en) Driving prompt method and device and automobile
CN105427881A (en) Voice recording book system for automobiles
JP2003044556A (en) Processing apparatus for vehicle information, and processing method for vehicle and vehicle information
DE102017211885A1 (en) A method for requesting a merchandise at a communication device of a motor vehicle external data server device, ordering device, and motor vehicle with an ordering device
JP2020144285A (en) Agent system, information processing device, control method for mobile body mounted apparatus, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210806